While today’s drivers rely heavily on mirrors to monitor their surroundings, tomorrow’s drivers may be able to leverage more advanced systems. In fact, the National Highway and Traffic Safety Administration estimates that requiring carmakers to equip new vehicles with rearview cameras by May 2018 will save 58-69 lives each year.
Through the Alliance of Auto Manufacturers, automakers petitioned the U.S. government in 2014 to relax federal regulations requiring driver’s side and rearview mirrors in favor of camera-based systems. As I highlighted in my earlier post, “Seeing more in the mirror is not just about your perspective!,” camera-based systems offer several advantages over mirrors, including decreased wind resistance for improved gas mileage, enhanced visibility for increased safety, support for vision-based analytics, potential cost reductions and vehicle aesthetics.
A new concept is pushing mirror replacement or camera monitoring systems (CMS) even further. The idea of being able to glance in one direction or toward a single screen for key information while driving is already a reality in many automobiles, in instrument clusters, center stacks and heads-up displays. This idea can (and likely will) apply to rear-facing mirrors such as side mirrors and, of course, the central rearview mirror. While it may take some time for drivers to get used to only having to look at one central mirror/display, it could eventually become second nature, as it is today for other functions.
The concept in Figure 1 shows a segregated method that has very distinct and separate views of three cameras (left/center/right). While certainly helpful, the driver’s ability to process all of this information separately may not be as efficient; therefore, such an implementation may not be as effective and safe as it truly could be for drivers, their passengers and other vehicles on the road.
But what if the three views weren’t so segregated, and were actually “stitched” together to provide a more seamless view of the driver’s surroundings? See Figure 2.
The stitched view shown in Figure 2 offers drivers a more natural way to perceive their surroundings, shown in the already-familiar rearview mirror location. This view is also more pleasing to the eye relative to the segregated method shown in Figure 1.
While the RSVP solution may still be considered a concept, it provides a strong proposition for displaying a highly coherent rear-facing view from a common, single point in the vehicle, and also greatly reduces blind-spot regions for drivers compared to traditional mirrors. See Figure 3.
This video, recorded at the 2017 Consumer Electronics Show (CES) in the Texas Instruments Village, demonstrates the RSVP concept.
It’s possible to achieve RSVP functionality with one of TI’s TDA3x system on chips (SoCs), a few FPD-Link devices and four digital cameras; see Figure 4. The TDA3x is based on a highly efficient heterogeneous architecture that includes an integrated image signal processor (ISP), C66 DSPs, an embedded vision engine (EVE), Camera Serial Interface (CSI)-2 and much more. The active image processing afforded by the highly integrated TDA3x SoC presents a much clearer and consistent image through an entire range of lighting and weather conditions.
An IEEE paper, “Rear-stitched view panorama: a low-power embedded implementation for smart rearview mirrors on vehicles,” describes this system’s details and associated processing within a power envelope of only a couple of watts. If you need additional processing, you can scale your system and associated software to the upcoming TDA2Px family, which combines the integrated ISP of the TDA3x with the extended computing and analytics capabilities of the TDA2x family.
TI PROVIDES TECHNICAL AND RELIABILITY DATA (INCLUDING DATASHEETS), DESIGN RESOURCES (INCLUDING REFERENCE DESIGNS), APPLICATION OR OTHER DESIGN ADVICE, WEB TOOLS, SAFETY INFORMATION, AND OTHER RESOURCES “AS IS” AND WITH ALL FAULTS, AND DISCLAIMS ALL WARRANTIES, EXPRESS AND IMPLIED, INCLUDING WITHOUT LIMITATION ANY IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT OF THIRD PARTY INTELLECTUAL PROPERTY RIGHTS.
These resources are intended for skilled developers designing with TI products. You are solely responsible for (1) selecting the appropriate TI products for your application, (2) designing, validating and testing your application, and (3) ensuring your application meets applicable standards, and any other safety, security, or other requirements. These resources are subject to change without notice. TI grants you permission to use these resources only for development of an application that uses the TI products described in the resource. Other reproduction and display of these resources is prohibited. No license is granted to any other TI intellectual property right or to any third party intellectual property right. TI disclaims responsibility for, and you will fully indemnify TI and its representatives against, any claims, damages, costs, losses, and liabilities arising out of your use of these resources.
TI’s products are provided subject to TI’s Terms of Sale (www.ti.com/legal/termsofsale.html) or other applicable terms available either on ti.com or provided in conjunction with such TI products. TI’s provision of these resources does not expand or otherwise alter TI’s applicable warranties or warranty disclaimers for TI products.
Mailing Address: Texas Instruments, Post Office Box 655303, Dallas, Texas 75265
Copyright © 2023, Texas Instruments Incorporated