AR has emerged as a popular approach to interacting with technology - creators are leveraging it for video games, educational experiences, live filters and more. We are motivated by this development to explore how AR is being used for pro-social communication. What can AR offer to things like communicating climate change data? What AR do to help motivate people to take action on personal, collective, or governmental challenges? This blog post shares what we have found so far, and what it suggests for a path forward.
Google Image search results matching “augmented reality climate change”
An Established Technology
Hundreds of millions now have the ability to run AR apps in their pocket; it is an established technology with a vast user base. A dominant form of use has turned out to be in the world of filters, thanks to social media and our collective obsession with selfies! SnapChat and Instagram are perhaps the best example of this. Their platforms have popularized AR filters.
A few examples of filters on Instagram and Snapchat.
AR filters such as these are massively popular, but are mostly used for entertainment purposes. In parallel to this growth we’ve seen rapid development in the tool space for creating these AR experiences - with Apple’s ARKit, Google’s ARCore, and higher level tools like Snapchat’s Lens Studio, Facebook’s Spark AR Studio, and others. The barrier to creating AR experiences is rapidly falling.
Current Approaches to Using AR to Fight Climate Change
Having fun with silly selfies is great, but we think there is an under-explored design space here. Climate change is one of the most pressing challenges of our time. In the US politicians are divided, but the public is not - survey data shows us that the majority of americans believe the government isn’t doing enough about climate change, and that it should be a top political priority. Data plays a central role in assessing and communicating the risk and scale of the impacts, but the barriers to effectively communicating climate change with data have been well documented and discussed for years (see Moser 2010 for a good summary).
People throw every new technology that emerges at climate change, and AR is no exception. We’ve seen a few patterns in the small set of AR projects that have focused on climate change over the last few years:
- Reflecting on our present conditions
- Imagining the future of our climate
- Designing resilient cities
Here’s a quick run down of some of the projects we came across in our survey of work.
Reflecting on our present conditions
A standard approach of data visualization is to “make visible the invisible”. We came across a set of projects that attempt to do this, showcasing the climate change happening around us already.
Screenshots from the AiR research app
We also found a number of academic researchers are investigating how to best use AR to show pollution levels. “AiR – An Augmented Reality Application for Visualizing Air Pollution” from Matthews, et al overlays your view with virtual smog based on local pollution levels. “Aire: visualize air quality” from Torres, et al last year similarly adds moving virtual pollution particulates on top of a live camera view via AR.
Imagining the future of our Climate
A standard way to imagine the future is to show it - AR makes that possible by modifying our view of the world around us. Numerous projects we found are using AR to show us the world of the future if no action is taken. The most common approach we saw to this was sea level rise. In fact, we saw so many examples that we’re pushed to call sea-level rise AR apps a cliche at this point.
The effects of climate change are altering the world around us.
See how the ocean could be impacted by 2100 with @SnapLensStudio’s Waterline Lens on @Snapchat. #EarthDay #ClimateAction pic.twitter.com/FnWTsylOpR— UN Environment Programme (@UNEP) April 22, 2019
Here is a quick sampling of the apps we found that showed sea level rise:
- Snapchat itself worked with the UN Environment Programme to create a lens in 2019 showing how sea level rise would impact your view of the world by 2100.
- In 2019 the insurance company Hiscox created an app to predict flood levels on an AR model of parts of NJ (available for Android in the Google Play Store).
- Artist Justin Brice Guariglia created After Ice in 2017 to show New York City residents how flooded it would be if the ice caps melt.
- Geospatial educators included sea level rise in a larger AR app they’ve used since 2016 introduce students to concepts such as topological maps.
- Journalist Eli Kintisch worked with researchers at MIT and RISD created the Looking Glass app in 2013 to show New England residents their risk from sea level rise.
Designing Resilient Cities
In the US at least, due to the lack of national action on climate change, cities have become a central organizing unit for our response. This has led to large, well-funded efforts like the Resilient Cities Network. Accordingly, we saw a number of AR apps that focused on climate-proofing the city.
Screenshot of Earthwatch’s app
Earthwatch Europe took an approach similar to SimCity in building an AR app that allows uses to try build a “climate proof” city by altering the makeup of land use, water supply, drainage, and more. The Klikovand task force worked with others to build an AR app that allows users to place green terrain in their built environment to provoke conversation about long-term climate resilience and day-to-day public works decisions. Artist Juan Carlos Gallo and others created an AR-connected mural in Miami to warn about climate change danger to localities.
An Opportunity for Evaluation and Impact
After exploring this space of climate change AR experiences, we are excited because we believe it has a lot of potential. We offer this blog post as a call to arms to study and explore the opportunity more! For instance, we saw little study of what people take away from these experiences - no assessment of whether their feeling of risk has increased, or if they are more motivated to support some policy, or even to share the message of warning with their friends. We are left feeling that there is more we can try out here.
We need to experiment and study more. Perhaps AR can actually be an effective tool to help us communicate and motivate action to the dire threats of climate change that are all around us. We just don’t know yet. Our next steps on this project are to audit the rapid prototyping tools we mentioned earlier to see what their design affordances are.
A screenshot of using Spark AR Studio- Ballori’s new look!
After that we’re hoping to build a simple experiment to study how people respond to AR experiences that are built around climate change data. Our key questions involve comparing AR experiences to other techniques like flat data visualization, infographics, or journalism-like narratives. We want to investigate question such as:
- Does AR communicate the threat more effectively?
- Are participants more motivated to act on a threat after an AR experience?
Drop us a line if you have a project we can learn from, or feel free to reach out if you’d like to collaborate with us.
