Group-based atrous convolution stereo matching network
journal contributionposted on 06.12.2021, 16:28 authored by Qijie Zou, Jing Yu, Hui FangHui Fang, Jing Qin, Jie Zhang, Shengkai Liu
Stereo matching, is the key technology in stereo vision. Given a pair of rectified images, stereo matching determines correspondences between the pair images and estimate depth by obtaining disparity between corresponding pixels. Current work has shown that depth estimation from a stereo pair of images can be formulated as a supervised learning task with an end-to-end frame based on Convolutional Neural Networks (CNNs). However, 3D CNN makes a great burden on memory storage and computation, which further leads to the significantly increased computation time. To alleviate this issue, atrous convolution was proposed to reduce the number of convolutional operations via a relatively sparse receptive field. However, this sparse receptive field makes it difficult to find reliable corresponding points in fuzzy areas, e.g., occluded areas and untextured areas, owning to the loss of rich contextual information. To address this problem, we propose Group-based Atrous Convolution Spatial Pyramid Pooling (GASPP) to robustly segment objects at multiple scales with affordable computing resources. The main feature of GASPP module is to set convolutional layers with continuous dilation rate in each group, so that it can reduce the impact of holes introduced by atrous convolution on network performance. Moreover, we introduce a tailored cascade cost volume in a pyramid form to reduce memory, so as to meet real-time performance. Group-based atrous convolution stereo matching network is evaluated on the street scene benchmark KITTI 2015 and Scene Flow and achieves state-of-the-art performance.
Dalian University Research Platform Project Funding: Dalian Wise Information Technology of Med and Health Key Laboratory
National Natural Science Foundation of China (No. 11701061): Research on SA algorithm for nonconvex stochastic semidefinite programming
- Computer Science