SPRADB4 june 2023 AM69A , TDA4VH-Q1
Lots of existing and emerging markets for edge AI processors fall into the multi-camera AI use case. Multi-camera AI is similar to AI Box. The difference is that multiple cameras are directly connected to the system through MIPI CSI-2 in multi-camera AI, while encoded bitstreams from remote cameras are streamed into the system through Ethernet in AI Box. The use cases of multi-camera AI include but are not limited to the following applications:
Figure 3-3 shows the data flow for a multi-camera AI use case example on the AM69A. In this example, eight 2MP cameras are combined using two MIPI CSI-2 aggregators and captured at 30 fps through two MIPI CSI-2 RX ports, which is the main difference from AI Box. The images through ISP (Image Signal Processor), demosaic and lens distortion correction are scaled to smaller resolution by MSC. The outputs obtained through DL pre-processing, DL network on MMA, and DL post-processing are encoded by the hardware accelerated H.264 or H.265 encoder, and streamed out or saved in storage. Table 3-3 shows the resource utilization and estimated power consumption for the multi-camera AI use case with eight channels of a 2MP camera.
Main IP | Utilization (8 × 2MP at 30 fps) |
---|---|
2 × CSI-2 RX | 8 × 2MP at 30 fps = 7.68Gbps (26%) |
VPAC (VISS, MSC, LDC) | 8 × 2MP at 30 fps = 480 MP/s (40%) |
MMA | 24 TOPS (75%) |
Encoder | 8 × 2MP at 30 fps = 480 MP/s (55%) |
8 × A72 | DL pre- and post-processing, and so forth (50%) |
DDR Bandwidth | 15.13GBps (22%) |
Power Consumption (85°C) | 20 W |