California-based Eyeris Technologies, a leading player in vision AI for in-cabin sensing has announced its collaboration with Texas Instruments (TI) on an industry-first in-cabin sensing AI solution, using TI's Jacinto TDA4 processors and 2D RGB-IR image sensors, at the Consumer Electronics Show (CES) 2021.
The D3 engineering designs products and integrates technologies from TI and Eyeris using its DesignCore platform to show this advanced in-cabin monitoring solution for autonomous and highly automated vehicles. This fully integrated in-cabin sensing AI solution will be demonstratable to select customers.
The TDA4 SoC processor enables efficient inference of the Eyeris deep neural network (DNN) portfolio from multiple RGB-IR cameras simultaneously. The complete in-cabin monitoring solution, integrated into the D3 Engineering DesignCore platform and is designed for rugged, field-deployable and production-intent units. The partners say the RGB-IR image sensors are quickly becoming an industry requirement because of their unique ability to accurately capture the in-cabin space under the widest range of lighting conditions.
The Eyeris DNNs are carefully designed for functional safety standards, flexible camera placements, and efficient inference on low-power edge processors. The Eyeris in-cabin sensing portfolio of AI algorithms includes driver monitoring system (DMS) and occupant monitoring system (OMS) features that adhere to global NCAP requirements.
Modar Alaoui, founder and CEO, Eyeris said: "As we continue to expand our hardware partnerships, teaming up with a well-established automotive processor company provides our automotive OEM customers with another compelling option for mass production. Collaborating with TI is another step forward where Eyeris continues to raise the bar for a complete in-cabin sensing solution. We are also delighted that D3 Engineering is providing our joint technology on their DesignCore platform."
TI's TDA4VM processors include embedded analytics acceleration to enable efficient deep learning performance within a low-power envelope. Additionally, these processors are able to perform safety-critical operations up to an ASIL D compliant level while also performing non-safety critical operations on one chip and function at an automotive operating junction temperature of 125 degrees Celsius. The SoC has built-in ISP and vision processing accelerators that help achieve more efficient system performance and reduce development costs.
Curt Moore, general manager of Jacinto processors, Texas Instruments said: "Leveraging specialised machine learning software, such as Eyeris' in-cabin sensing AI algorithm, on our TDA4 processor enables our customers to bring high-performance computing inside the vehicle cabin. Our Jacinto processors enable both machine vision and deep learning capabilities to help customers more easily develop their ADAS solutions."
Jerome Barczykowski, business development operations manager, D3 Engineering said: "We are pleased to work together with Texas Instruments and Eyeris to offer a robust in-cabin monitoring solution on our DesignCore platform. The DesignCore platform incorporates proven collections of hardware, software, applications, and testing. Combined with Eyeris AI algorithms, the solution accelerates time-to-market while reducing the cost and risk of production product development."
Interestingly, automakers and Tier-1 suppliers such as Toyota, Jaguar Land Rover, Honda, Hyundai Mobis, Karma Automotive, Panasonic Automotive, Bosch, Veoneer and Mitsubishi Motors have licensed Eyeris in-cabin sensing AI solutions. Eyeris expects its in-cabin sensing AI software portfolio to go into vehicle mass production in late 2022.