Humanoid robots are gaining significant attention across industries due to the potential to automate tasks, perform human-like movements, and engage in social interaction. Applications for these robots range from healthcare, where humanoids assist patients, to industrial automation, education, and research. The development of humanoid robotics presents several challenges, including replicating complex human movements, achieving autonomous decision-making, and creating systems with the capability to adapt to unstructured environments.
A critical aspects of humanoid robots is the ability to detect and decipher a physical environment; as humans rely on senses to navigate and interact with the world, humanoid robots also require sophisticated sensing systems to perform tasks autonomously and effectively. Common types of sensors used in humanoid robots include visual systems (cameras), radars and LiDARs (navigation and perception), tactile sensors (mimicking touch), and auditory systems (microphones) which allow the robot to understand its own posture and balance. This application brief explores the benefits of millimeter wave (mmWave) radar sensors for navigation, identification, and integrating radar with camera sensors to enable sensor fusion in humanoid robots.
Long-range capabilities, high-motion sensitivity, and privacy features make radar-based sensor integrated circuits (IC) a popular technology for position and proximity sensing designs. Performing with high accuracy, radar sensors are also popular in automotive and industrial markets for detecting blind-spots, collisions, people, and motion.
60-GHz and 77-GHz radar sensors are replacing 24-GHz radar sensors, delivering higher resolution, improved accuracy, and a smaller form factor. The 60-GHz and 77-GHz radar bands enable new applications, such as object presence detection in industrial robotics and mobile robotics applications found in factories or homes.
mmWave Radar technology is often chosen over LiDAR, cameras, and other optical sensors for cost savings due to the ability of radar to work well in adverse weather conditions; cameras can be affected by poor lighting and weather. Radar also has broad range and coverage, allowing sensors to detect objects from over one hundred meters. With mobile robotic applications needing to save on power consumption, frequently users use radar that reaches as low as 1.7mW for presence detection. However, a combination of radar and LiDAR, a camera, or an alternative optical sensor type is usable in a wide variety of use-case scenarios.
From a functional safety standpoint, TI engineers design non-contact radar sensors, such as the IWR6843, following an extensive hardware and software development process, and with device certification from (TÜV) SÜD. All TI radar sensors include built-in functional safety mechanisms that provide the necessary diagnostic coverage required by IEC 61508 to meet hardware capabilities, as high as Safety Integrity Level (SIL) 2 at the component level.
Functional safety collateral is available online through a diagnostic software library, compiler qualification kits, third-party operating systems, development tools, and additional documentations allowing engineers to streamline the safety design process and system-level certification.
Using one type of sensor in humanoid robots presents significant limitations, including incomplete or inaccurate data collection. For example, cameras can struggle with depth perception, poor lighting, or detecting non-visual elements, and LiDAR sensors can collect inaccurate readings because a laser light bounces up and down when the robot is moving. Data collection constraints can lead to errors in navigation, object manipulation and environmental interaction.
Sensor fusion addresses these issues by integrating data from multiple sensors to create a more accurate, reliable, and comprehensive understanding of the robots environment. By combining inputs from various sensing modalities, humanoid robots can make more informed decisions, enhancing the ability to perform complex tasks such as navigating uneven terrain, grasping objects of different shapes and sizes, and interacting in dynamic, real-world environments. Advantages of sensor fusion include:
Radar is one of the top sensors frequently integrated into a system due to the durability of radar in harsh conditions, as well as reliability when detecting moving objects. To mitigate short comings of single sensor systems, TI has various offerings for users interested in maximizing robotic accuracy and awareness. TI offers a camera and radar sensor module with an IMX219 camera and IWR6843ISK EVM mmWave radar sensor. This module implements an object-level fusion approach that applies a camera-vision processing chain and radar processing chain focused on object clustering and tracking, allowing users to track and detect objects in a three-dimensional environment. Users demonstrate the many possibilities and capabilities of sensor fusion in the robotics SDK.
This application brief explores the benefits of mmWave sensing, safety, and sensor fusion in enabling precise detection of objects and movements around the humanoid robots. The mmWave sensing technique is particularly valuable in low-visibility conditions, such as dim lighting or dust, where traditional vision-based sensors can be unreliable. mmWave radars are low-cost, consume less-power, and function in adverse weather conditions, making the mmWave Radars a potential choice for robotic applications.
This application brief also addresses functional safety and sensor fusion techniques, which are crucial for the reliable operation of humanoid robots in complex environments. With built-in functional safety mechanisms and a device safety certification from (TÜV) SÜD, TI radar devices provide the necessary diagnostic coverage required by IEC 61508 to meet hardware capabilities as high as SIL 2 at the component level. Combining the safety enabled radars in with LiDAR, cameras or other optical sensors helps to improve accuracy in object detection, failure-redundancy, decision-making, and real-time adjustments in robot behavior to advance both autonomy and safety in humanoid robotic systems.
Texas Instruments, Humanoid robot overview
Texas Instruments, Webinar: Sensing in Robotics
Texas Instruments, Radar Toolbox for mmWave Sensors
Texas Instruments, Camera and Radar Fusion Demonstration
Texas Instruments, IWR6843AOP evaluation module for single-chip 60GHz antenna-on-package (AoP) mmWave sensor product page
Texas Instruments, D3 Engineering DesignCore® radar evaluation modules product page
Texas Instruments, Optimizing functional safety for industrial robots white paper
Texas Instruments, Streamlining Functional Safety Certification in Automotive and Industrial functional safety manual
DesignCore® is a registered trademark of Define Design Deploy Corp.
All trademarks are the property of their respective owners.
TI PROVIDES TECHNICAL AND RELIABILITY DATA (INCLUDING DATASHEETS), DESIGN RESOURCES (INCLUDING REFERENCE DESIGNS), APPLICATION OR OTHER DESIGN ADVICE, WEB TOOLS, SAFETY INFORMATION, AND OTHER RESOURCES “AS IS” AND WITH ALL FAULTS, AND DISCLAIMS ALL WARRANTIES, EXPRESS AND IMPLIED, INCLUDING WITHOUT LIMITATION ANY IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT OF THIRD PARTY INTELLECTUAL PROPERTY RIGHTS.
These resources are intended for skilled developers designing with TI products. You are solely responsible for (1) selecting the appropriate TI products for your application, (2) designing, validating and testing your application, and (3) ensuring your application meets applicable standards, and any other safety, security, or other requirements. These resources are subject to change without notice. TI grants you permission to use these resources only for development of an application that uses the TI products described in the resource. Other reproduction and display of these resources is prohibited. No license is granted to any other TI intellectual property right or to any third party intellectual property right. TI disclaims responsibility for, and you will fully indemnify TI and its representatives against, any claims, damages, costs, losses, and liabilities arising out of your use of these resources.
TI’s products are provided subject to TI’s Terms of Sale (www.ti.com/legal/termsofsale.html) or other applicable terms available either on ti.com or provided in conjunction with such TI products. TI’s provision of these resources does not expand or otherwise alter TI’s applicable warranties or warranty disclaimers for TI products.
Mailing Address: Texas Instruments, Post Office Box 655303, Dallas, Texas 75265
Copyright © 2024, Texas Instruments Incorporated