Unity partners HERE Tech for real-time 3D in-vehicle experiences

Unity, a leading platform for creating and operating real-time 3D (RT3D) content has announced a collaborative agreement with HERE Technologies, the location data and technology platform, to partner on developing next-generation embedded automotive HMIs (Human Machine Interface) with state-of-the-art, RT3D rendering capabilities.

The collaboration will also extend to work on next-generation location technology for autonomous driving, simulations, city planning and digital twins. In order to showcase the combined capabilities of Unity’s real-time 3D platform and HERE’s location technology, the partners have developed a proof-of-concept application of an embedded in-vehicle-infotainment (IVI) system. Created on Unity’s platform and featuring HERE 3D city data, it showcases a futuristic, wide-screen navigation experience of a 3D map of San Francisco and demonstrates what can be achieved with the addition of game-changing HMI workflow design improvements. To date, HERE says it has mapped in 3D more than 70 major cities in the US, Europe and Asia with plans to eventually offer global 3D map coverage.

Julien Faure, VP – Verticals, Unity said: “Car buyers now care more about interactivity with their vehicle than horsepower or fuel-efficiency. Unity’s work with HERE opens up the ability to meet consumer demand, providing a continuous user experience across all displays powered by Unity and our ecosystem. By working with industry leaders like HERE, we feel that Unity has the potential to power dynamic infotainment, immersive augmentation, and geospatial and media experiences all integrated into a seamless user experience.”

The partners say while several dedicated HMI development solutions currently exist in the automotive industry this collaboration will combine elements of automotive-grade map data and services with an advanced real-time 3D engine that brings dynamic, high-end design capabilities to the automotive user-experience in terms of maps, infotainment and more.

Jorgen Behrens, chief product officer, HERE Technologies: “The goal of our collaboration with Unity is to meet our customers’ desire for an in-car navigation experience that’s an engaging representation of reality. Unity’s robust 3D rendering engine makes HERE 3D city data, route guidance and navigation look impressive, providing a rich and immersive in-dash experience to the driver.”

This collaboration underscores the companies’ commitment to developing the next generation of automotive HMIs. The HERE and Unity PoC application successfully runs on Qualcomm Snapdragon and in 2020, Unity announced collaborations with multiple companies across the HMI ecosystem, including Continental AG’s Elektrobit and NXP Semiconductors.