- AR driving technology improves safety by overlaying navigation and hazard information directly in the driver’s field of vision.
- The integration of AR into automotive technology enhances the driving experience by providing clearer navigation cues and potentially reducing reliance on traditional GPS systems.
OUR TAKE
Augmented Reality (AR) is really changing the way we drive. It takes what you’re used to seeing on your GPS screen and puts it right on the road in front of you. That means less time looking away from the road and more time concentrating on driving safely. In the future, AR could completely transform our cars into interactive spaces, rather than just vehicles we use to get from one place to another.
–Heidi Luo, BTW reporter
Introduction to AR in driving
We’ve all been there. You’re at a complex crossroads, unsure of your next turn despite your GPS trying its best to help. It’s a pretty common scenario that can even confuse the most experienced drivers. I recently came across a promising solution that could really enhance our driving experience: in-car augmented reality (AR).
AR driving tech combines the virtual and the real to give drivers the visual info they need most, right where they need it: on the road. By putting graphical navigation and safety guidance right in the driver’s line of sight, AR driving systems turn windshields into dynamic displays.
“AR is really important for things like intelligent driving and map navigation. When you’re driving together with a machine, AR can show you what the car is seeing and what it’s doing, which makes you more confident and helps you take over the driving more quickly,” said Yujia Lin, product director of Neusoft Group, at the 2nd Smart Cockpit In-car display and perception conference on 11 July 2024.
How AR driving works
One rainy evening, I was driving home and the visibility was so bad I could barely see the road signs. The rain was relentless and, even with my headlights on, it was difficult to see where I was going. I ended up missing my turn not once, but several times, which was both annoying and a little frightening.
After that stressful experience, I started looking into how technology could help avoid such problems. That’s when I first came across AR for driving. The idea that my windscreen could show me clear directions and road markings, even in bad weather, really stood out to me.
The way AR in cars works is through head-up displays (HUDs), which project key driving information directly onto the windscreen. In particular, this innovative system uses the vehicle’s sensors and cameras to collect real-time data about what’s going on around you and how you’re driving.
This means that things like navigation instructions, lane guidance and hazard warnings appear right in front of the driver, so they can see them without taking their attention away from the road.
AR technology greatly enhances the interactive experience of map navigation, providing drivers with more information.
Yujia Lin, product director of Neusoft Group
HUDs in cars, similar to those used in games, but without the need for special equipment. First introduced in the late 1980s, these early systems displayed basic two-dimensional information directly in the driver’s line of sight.
But the latest development in HUD technology is holographic displays, which produce clear, three-dimensional images with height, width and depth that appear to be part of the view of the road ahead.
Over time, in-car AR technology has evolved from displaying basic data such as speed and safety alerts, to more complex features such as dynamic navigation and real-time traffic updates.
Also read: Application of augmented reality and mixed reality in life
Also read: Different types of Virtual Reality (VR) technology
Innovation in AR driving technology
Luxury car brands have been pioneers in this area, integrating AR to display navigation cues and safety alerts directly in the driver’s field of vision, effectively blending digital graphics with the actual driving experience.
Mercedes-Benz led the way with its MBUX system, which revolutionised navigation by projecting routes and street names directly onto the road in the driver’s line of sight, starting with the Mercedes-Benz A-Class in 2018.
Following this innovation, other luxury brands such as Cadillac, BMW and Audi have also embraced AR technology to enhance navigation aids and safety features in their vehicles.
In China, Huawei has entered the automotive space with its AR-HUD system, uses advanced optics to project critical driving information directly onto the car’s windscreen, creating a 70-inch virtual display that appears to be 7.5 metres ahead on the road.
This doesn’t mean that the information is physically placed on the road ahead, but rather that it is displayed in such a way that it appears to the driver to be hovering 7.5 metres in front of the vehicle.
Based in China, the Neusoft Group is also a leader in automotive technology integration. It is pioneering the use of AR to improve driver safety and navigation accuracy. Their innovative AR for Car solution specifically addresses the limitations of traditional navigation systems, which often struggle to accurately display the correct turn positions at complex intersections.
“By precisely overlaying navigation cues on the actual road environment, Neusoft’s technology ensures that drivers can make informed decisions smoothly, without the need for sudden lane changes,” said Yujia Lin.
Pop Quiz
What feature of augmented reality(AR) in driving helps drivers by showing navigation and hazard alerts on the windscreen?
A. Adaptive Cruise Control
B. Head-Up Displays (HUD)
C. Automatic Braking
D. Lane Departure Warning
The correct answer is at the bottom of the article.
The benefits of driving with AR
One of the key benefits of AR driving technology is its ability to enhance road safety. By providing drivers with crucial navigation and safety information in real-time, AR driving eliminates the need for them to divert their attention from the road to check their GPS or listen to voice commands.
Plus, the quick access to navigation data that AR tech provides means drivers can respond faster to things like roadworks or other hazards, which helps to cut down on accidents caused by distraction.
For urban white-collar commuters, this innovation doesn’t just streamline their daily journeys, it also significantly increases their job satisfaction and overall happiness. By reducing the stress of navigating complex city streets, AR helps them maintain a calmer, more focused mindset, both on the way to work and on the way home.
Another great thing about AR is that it helps you navigate by showing you virtual directions on top of the real road. So, when you need to turn, the system can show you an arrow on the windscreen that lines up with the road you’re on. It’ll show you where you need to go, so you can get on with driving.
This visual help is really useful in tricky or unfamiliar driving situations, making navigation easier and much less likely to result in you missing a turn or exit.
This is especially useful for people who suffer from “road blindness” – a condition where a person has difficulty remembering routes, lack of sense of direction and problems with distance perception, even with navigation aids. This often leads to missed turns and disorientation, escalating stress and the likelihood of accidents.
We can use dynamic AR element rendering technology in operational scenarios to make things more enjoyable for users.
Yujia Lin, product director of Neusoft group
Challenges and considerations
However, there are some genuine privacy issues when it comes to AR driving technologies. As these systems collect and process a lot of data to work, such as real-time location, driving habits and even personal preferences, there are questions about how this data is stored, used and shared.
Recent studies by UC Berkeley have shown that there are some privacy risks associated with AR technologies. The system collects a lot of data, including real-time location and driving behaviours, which could be a problem if it isn’t properly managed. If someone gets their hands on the data and uses it without permission, they could potentially identify and track users.
Another concern is the potential dependency on AR technology for basic driving tasks. While AR can significantly improve driving safety and convenience, there’s a risk that drivers will become too dependent on these visual aids, potentially compromising their driving skills or ability to drive without technological assistance.
At the conference, Yujia Lin also said that the smart car is heading towards a more anthropomorphic future. We’ve got all these different types of technology, from intelligent sensing hardware to technology in general. But we still need to bring them together to make them work seamlessly and understand what users want.
“This means combining large models with AI tech to create the perfect fusion of multimodal interaction. It should understand the user’s needs and automatically choose the best interaction mode for the situation, even incorporating emotional communication, so the intelligent car can truly be a smart partner.”
Final thoughts
As vehicle tech keeps on developing, AR and automated driving systems are coming together to form a really exciting new area in transportation. AR could become a key way to interact with autonomous vehicles, providing real-time information that helps them work better.
However, while AR has the potential to make driving more enjoyable and help us feel more confident in tricky situations, the rise of AI-driven technologies such as robotaxis is creating some economic challenges.
In Wuhan, for example, Baidu’s deployment of over 500 electric robotaxis has begun to disrupt the traditional taxi industry. These automated vehicles operate at a lower cost, posing a direct threat to the livelihoods of human drivers and raising concerns about potential job losses.
But above all, this technological shift requires a careful approach to policymaking. Governments and industry leaders must develop strategies that not only encourage technological innovation, but also address the socio-economic impacts.
Policies must ensure that workers displaced by automation can transition to new roles in this evolving landscape, balancing progress with protection and support for those affected.
In addition, regulations must address over-reliance on AR and automated technologies and ensure that drivers retain essential driving skills. Privacy concerns must also be rigorously managed, with clear guidelines on data use and protection to maintain public trust in these advancing technologies.
Correct answer: B. Head-Up Displays (HUD)
