Crafting Futures

Embedded AR Visualizations for Transforming Urban Spaces.

The “Crafting Futures” project leverages Augmented Reality (AR) and generative AI to make climate change impacts on urban areas visible and immersive, embedding real-time and future data visualizations directly into cityscapes. Led by the Human Data Interaction Lab in collaboration with the Chair of Digitalization, Visualization, and Monitoring in Spatial Planning at the University of Kaiserslautern-Landau (RPTU) and the SmartCity Living Lab at the German Research Center for Artificial Intelligence (DFKI), the initiative is supported by the Carl Zeiss Foundation.

Storyboard of an example scenario in our research project: Sophie checks the air quality in front of her house in real-time using her smartphone. With a quick gesture, she suggests sustainable measures and discusses their potential impacts with her neighbor Ben.

Background

The way cities are designed—and how we move through them every day—contributes to a host of significant, interconnected issues, from accelerating climate change to stressing urban systems in ways that are hard to ignore. What’s interesting is that we already know how cities need to transform to stay livable, or even habitable, in the future. The research is solid, and the data is there. But here’s the catch: while we understand that reshaping cities and shifting daily behaviors could make a major impact—cutting mobility-related CO2 emissions, mitigating extreme heat, or managing urban flooding—action lags when the problem feels abstract.

People respond when they can see and feel a threat. But as long as the causes and effects of these urban challenges remain invisible or theoretical, meaningful action tends to be delayed. Think about it: we know fossil-fuel-based transportation is a major source of CO2, but it’s invisible. Urban heat islands have hit some cities hard recently, but forecasts for 2040? They’re still hypothetical. So, what if we could flip that script? Imagine walking down your street and being able to see the CO2 from passing cars, or visualize the heat stress that your neighborhood could experience. That’s where Crafting Futures comes in. This project introduces a groundbreaking way to bridge that gap between knowledge and action using situated visualizations in augmented reality (AR). By embedding real-time and future data directly into the urban landscape, citizens can experience the invisible forces shaping their environment. With a smartphone, tablet, or AR glasses, you can explore the city from any perspective you choose and start to grasp the complex interconnections that drive these challenges. But Crafting Futures doesn’t stop at showing you the data. It goes further, offering an interactive tool to shape the future. Want to experiment with urban planning? With just a few swipes, you can modify streetscapes, and a generative AI instantly integrates these changes into the city’s fabric. You can then see, in real time, how those tweaks affect CO2 emissions, local temperatures, and more.

This project weaves together environmental science, mathematical modeling, and urban design in a deeply interdisciplinary approach. But beyond the technical challenges, it addresses something more fundamental: how understanding complex systems can drive societal shifts. By making the invisible visible, Crafting Futures sparks the kind of engagement that leads to new ways of thinking—and, crucially, acting.