This application note details the implementation of a vision pipeline using an RGB-IR sensor on the AM62A platform. This document includes a reference design for driver and occupancy monitoring system with video telephony, utilizing the OX05B1S sensor and the AM62A SK EVM.
Arm® and Cortex® are registered trademarks of Arm Limited.
All trademarks are the property of their respective owners.
With the growing demand for image sensing in both visible and infrared light, RGB-IR sensors, which capture both RGB and IR images with a single camera, are becoming increasingly popular. Effectively processing and leveraging RGB-IR data is essential for various artificial intelligence applications, including driver monitoring and occupancy monitoring (also known as cabin monitoring), robotics, security surveillance, and smart home systems. The AM62A SoC is an excellent choice for building such intelligent systems, as detailed in [1].
This application note focuses on implementing a vision processing pipeline on the AM62A SoC, from an RGB-IR camera to the AI engine, for a driver and occupancy monitoring system (DMS or OMS) with support for video calls or video recording. This document begins by outlining the essential hardware and software components, followed by a reference design and benchmarks.