Volvo Group Develops Augmented Reality App

May 31, 2023
The app, built using PTC’s CAD and augmented reality technologies, is directed at first responders to help guide them in rescue operations.

This new app from Volvo Group—designed to aid crews responding to emergencies involving Volvo’s electric trucks—may seem outside the usual real of Automation World coverage, but it highlights how useful the technology can be in terms of delivering immediate information to operations and maintenance personnel in both critical and routine manufacturing operations.

Model simplification algorithms reduce 16 million polygons (CAD lines converted into 2D or 3D shapes) in the software to about 200,000 polygons so that the app can be used on mobile devices.

According to the Volvo Group, it is the first truck manufacturer to launch an augmented reality (AR) safety app for electric trucks. Volvo says the app is developed to “deliver instant, valuable information from the electric truck to the emergency services team arriving on the scene to guide them in real-time and ensure safe rescue conditions.”

Having this information readily available is critical in an emergency response situation due to the high-voltage systems used to power heavy electric trucks. The potential for harm to responders is not unlike the potential harm faced by operations and maintenance personnel in industrial environments—thus the transferrable value inherent in Volvo’s app for use in industry.

The app was developed by a team of experts at Volvo Group’s Research & Development facilities in Sweden, France and the United States and combines connectivity, cameras, sensors, 3D modeling and AR overlays. Volvo says its safety app provides a detailed view of the vehicle, with information on the location of high-voltage cables, battery packs and other key components. It also provides step-by-step instructions on how to safely shut down the electric vehicle’s power supply. Specific safety documentation related to the electric truck is also accessible via the app.

“The safety app has been tested in a variety of real-world scenarios and has received positive feedback from first responders who have tried it in the field,” said Vincent Barnoux, business solution engineer at Volvo Group.

Digital twin use in the app

In his presentation at PTC’s LiveWorx 2023 event, Barnoux said enabling this app to work for every Volvo electric truck (of which there are about 1500 across the company’s Renault, Volvo and Mack brands), the company accessed the digital twins of each vehicle. “It was a two-year process from building the digital twins using CAD data to using those data for the app,” he said.

Volvo Group announced the unification of its CAD platforms in 2021 around the use PTC’s Windchill product lifecycle management (PLM) and Creo computer aided design (CAD) software. Volvo did this to promote collaboration across Volvo Group’s PLM and CAD functions and significantly increase the reuse of digital product data throughout the Volvo Group.

Alluding to use of the app beyond first responders, Barnoux said the app can also be used for training so that users can see all components in the trucks. “For example, the blinking cable in the AR view directs the user to the exact cable to work on,” he said.

Simplifying the data for mobile use

Barnoux said Volvo used PTC’s Vuforia library to understand how AR works and make the app easy to use.

Michael Gervautz, vice president of product planning at PTC Vuforia, explained how PTC’s software cleans up data for use in the app. “It involves model simplification algorithms—for example reducing 16 million polygons (CAD lines converted into 2D or 3D shapes) in the CAD software to about 200,000 polygons for AR use—so that the app can be used on mobile devices that don’t have a lot of rendering power,” he said. “Digital threads [provided by the CAD data] helps make use of existing product data by automatically creating data for AR apps.”

Barnoux said Volvo is now looking to adapt this app for use in Volvo service areas. For that, the app will need more detailed digital twin data and advanced diagnostics information. “We have more than 15,000 service points and about 100,000 service technicians,” he explained, “so we’re focusing now on finding out what service technicians need to develop the most effective AR app for them. We want this app to be integrated [with the service technicians’ workflow] so technicians don’t have to jump between different systems when working. We’re working with PTC on that now.”

About the Author

David Greenfield, editor in chief | Editor in Chief

David Greenfield joined Automation World in June 2011. Bringing a wealth of industry knowledge and media experience to his position, David’s contributions can be found in AW’s print and online editions and custom projects. Earlier in his career, David was Editorial Director of Design News at UBM Electronics, and prior to joining UBM, he was Editorial Director of Control Engineering at Reed Business Information, where he also worked on Manufacturing Business Technology as Publisher. 

Sponsored Recommendations

Why Go Beyond Traditional HMI/SCADA

Traditional HMI/SCADAs are being reinvented with today's growing dependence on mobile technology. Discover how AVEVA is implementing this software into your everyday devices to...

4 Reasons to move to a subscription model for your HMI/SCADA

Software-as-a-service (SaaS) gives you the technical and financial ability to respond to the changing market and provides efficient control across your entire enterprise—not just...

Is your HMI stuck in the stone age?

What happens when you adopt modern HMI solutions? Learn more about the future of operations control with these six modern HMI must-haves to help you turbocharge operator efficiency...