An FPGA-based processing pipeline for high-definition stereo video

Abstract

This paper presents a real-time processing platform for high-definition stereo video. The system is capable toprocess stereo video streams at resolutions up to 1, 920 × 1, 080 at 30 frames per second (1080p30). In the hybridFPGA-GPU-CPU system, a high-density FPGA is used not only to perform the low-level image processing tasks suchas color interpolation and cross-image color correction, but also to carry out radial undistortion, image rectification,and disparity estimation. We show how the corresponding algorithms can be implemented very efficiently inprogrammable hardware, relieving the GPU from the burden of these tasks. Our FPGA implementation results arecompared with corresponding GPU implementations and with other implementations reported in the literature.