Fast CNN Stereo Depth Estimation through Embedded GPU Devices

Aguilera, Cristhian A; Aguilera, Cristhian; Navarro, Cristobal A.; Sappa, Angel D.

Abstract

Current CNN-based stereo depth estimation models can barely run under real-time constraints on embedded graphic processing unit (GPU) devices. Moreover, state-of-the-art evaluations usually do not consider model optimization techniques, being that it is unknown what is the current potential on embedded GPU devices. In this work, we evaluate two state-of-the-art models on three different embedded GPU devices, with and without optimization methods, presenting performance results that illustrate the actual capabilities of embedded GPU devices for stereo depth estimation. More importantly, based on our evaluation, we propose the use of a U-Net like architecture for postprocessing the cost-volume, instead of a typical sequence of 3D convolutions, drastically augmenting the runtime speed of current models. In our experiments, we achieve real-time inference speed, in the range of 5-32 ms, for 1216 x 368 input stereo images on the Jetson TX2, Jetson Xavier, and Jetson Nano embedded devices.

Más información

Título según WOS: Fast CNN Stereo Depth Estimation through Embedded GPU Devices
Título de la Revista: SENSORS
Volumen: 20
Número: 11
Editorial: MDPI
Fecha de publicación: 2020
DOI:

10.3390/S20113249

Notas: ISI