The demonstration described in Section 7.3 can achieve 60 ms glass-to-glass latency (not including deep learning related
processing). A few improvements can be made to further reduce the latency:
- Implementing the on-the-fly mode for VPAC, which
can reduce the latency by either the camera data accumulation time or VISS
processing time, whichever is shorter. For example, in the 2.1MP at 60 fps case,
utilizing on-the-fly mode can reduce latency by the processing time of VISS which is
8 ms.
- Removing MSC. The LDC block of VPAC can also resize the image, though LDC is not as flexible as MSC and LDC does not do anti-aliasing filtering. For certain applications, it is possible to just use LDC to resize the image without using MSC. In that case, the latency can be reduced by the MSC processing time, which is 8 ms for 2.1MP at 60 fps.