TECH

Tracking flaws in used building materials facilitates reuse
In circular construction, materials from old buildings are salvaged and reused in other building projects. The European Union this year has proposed legislation that would formalize and expand this concept.
While these reclaimed materials will likely be serviceable, they will not be perfect – and those imperfections can lead to unexpected construction delays and added cost.
Researchers from Cornell Tech and the Cornell Bowers College of Computing and Information Science have developed a documentation tool, Pentimento, that uses video, audio and computer simulation to better match on-site adaptations to the architects’ and engineers’ visions for a project.
The team described their tool in “Building Drift: Documenting On-Site Construction Adaptations Across Material Lifecycles,” which won the Best Paper Award at the Association for Computer Aided Design in Architecture (ACADIA’26), held Oct. 22-24 in Detroit.
With Pentimento, the history of a reclaimed piece of lumber, for example, is documented and stored in a web interface that can be accessed by all relevant parties. This can minimize delays due to unforeseen challenges that result in what’s known as “building drift” – a gradual straying from the structure’s initial vision and design.
“With building drift, what we were trying to explore is, what are the sources of change that happen through that journey of making,” said Ritik Batra, a doctoral candidate in information science at Cornell Tech, and lead author of the paper. “One example is the environment itself, environmental conditions. In the digital world, you can do whatever you want, it’s perfect. But in the real world, it’s not. You need to adjust.”
Co-authors include Thijs Roumen, assistant professor at Cornell Tech and the Cornell Ann S. Bowers College of Computing and Information Science; Steven Jackson, vice provost for academic innovation and professor of information science (Cornell Bowers); and researchers from the Royal Danish Academy’s Centre for Information Technology and Architecture (CITA).
Pentimento leverages both human and computerized input in an attempt to present a complete picture of a material’s history and condition. Five factors contributing to building drift are considered in painting this picture: environmental conditions; constraints due to available materials and tools, particularly if the building site is in a remote location; the hidden history of the materials; the imperfections and limitations of available tools; and knowledge gaps between site owners, designers, builders and other stakeholders.
The European Union is scheduled this year to adopt the Circular Economy Act, which among other things will establish a single market for secondary raw materials and increase the supply of high-quality recycled materials. But while these materials will likely be very good, they will not be perfect.
Pentimento, Batra said, is a way to document and track any flaws or imperfections that could impact future use.
“The challenge is that you have an imperfect reflection of how the materials were used in previous buildings,” Batra said. “What we’re hoping is Pentimento can be used as a low-effort way for construction site people to be able to record what they’re doing, document it, and then everyone down the line can refer to it and get the information they need.’
This work was conducted in the winter and spring of 2026, when Batra was a visiting scholar at CITA. Pentimento was tested on ReShelter, a pavilion built with reclaimed materials near Hvalsø, Denmark, west of Copenhagen. Batra was on site during its construction, and used smart glasses to both capture video and verbally document the construction process.
Video and audio were then uploaded to the Pentimento web interface when Batra returned to the CITA campus and had internet access. The system runs a structure-from-motion script (COLMAP) to estimate camera poses, then generates a 3D Gaussian splat reconstruction that can be overlaid onto the 3D model of the actual structure, resulting in a realistic, shareable 3D scene that can be rendered from any viewpoint within a web browser.
Pentimento’s realistic rendering, the researchers wrote, enables stakeholders to locate and interpret sources of drift relative to the original model.
Roumen said he’s used Gaussian splatting in previous projects focused on machinery – overlaying a CAD model onto the splat to troubleshoot a problem with the machine. But using this technology in architecture is uncharted territory.
“Rather than a machine’s bolt being off,” he said, “now it’s more like the whole world is off. That’s why we were so happy to see people at the conference get excited about how this work, which is already being used in HCI (human-computer interaction), actually makes sense in architecture, too.”
Researchers at Cornell Tech and the Cornell Bowers College of Computing and Information Science developed Pentimento, a documentation tool that uses video, audio, and 3D computer simulation to track imperfections in salvaged construction materials. By creating an accessible digital history of these flaws, the system reduces construction delays, prevents unexpected costs, and makes circular building practices much easier to adopt.
How pentimento works:
• Low-Effort Site Capture. Workers wear smart glasses on the construction site to record video and verbally describe adaptations as they build.
• 3D Reconstruction. The system processes the uploaded footage using structure-from-motion scripts (COLMAP) to generate a 3D Gaussian splat model.
• Digital Overlay. This realistic 3D scene overlays directly onto the architect's original digital blueprint inside a standard web browser. Stakeholders can inspect the exact physical state of the materials from any angle.
Solving "building drift":
Reclaimed materials—such as salvaged lumber—rarely match ideal digital specifications. When builders adjust to real-world imperfections on-site, the final structure gradually strays from the initial architectural design in a process researchers call "building drift".
Pentimento tracks five core factors behind building drift:
• Environmental Conditions. Weather and site environments alter material dimensions and behavior during construction.
• Hidden Material History. Previous uses leave behind unseen wear, nail holes, or structural stresses.
• Material and Tool Constraints. Remote building sites often face limited equipment and supply options.
• Tool Imperfections. Available construction tools have physical limitations that affect precision.
• Stakeholder Knowledge Gaps. Miscommunication often occurs between site owners, designers, and on-site builders.
Real-world testing and broader impact:
• Field Validation. Lead author Ritik Batra tested the system in early 2026 during the construction of ReShelter, a reclaimed-material pavilion near Hvalsø, Denmark.
• Policy Alignment. The tool supports growing regulatory pushes for sustainability, such as the European Union's Circular Economy Act, which aims to establish a unified market for secondary raw materials.










