Learning adversarial point-wise domain alignment for stereo matching

Publisher:
ELSEVIER
Publication Type:
Journal Article
Citation:
Neurocomputing, 2022, 491, pp. 564-574
Issue Date:
2022-06-28
Filename Description Size
1-s2.0-S0925231221018713-main.pdfPublished version3.89 MB
Adobe PDF
Full metadata record
The state-of-the-art stereo matching models trained on synthetic datasets have difficulty in generalizing to real-world datasets. One major reason is that illumination and texture in the real world are hard to be simulated, resulting in big differences between synthetic and real-world data. In this study, instead of narrowing the image-level appearance difference, we focus on aligning both data domains in feature space in an unsupervised manner and propose an end-to-end domain alignment stereo network (DAStereo). A domain alignment module (DAM) is introduced by learning a point-wise linear transformation. We demonstrate that DAM can maintain sufficient alignment capacity with fewer parameters than the globally nonlinear mapping. To explicitly promote the point-wise domain alignment, adversarial learning is further introduced using a cost volume discriminator in a hybrid training manner. Experimental results show that DAStereo outperforms the state-of-the-art unsupervised and adaptive methods and even achieves comparable performance to some supervised methods.
Please use this identifier to cite or link to this item: