ITSA: An information-theoretic approach to automatic shortcut avoidance and domain generalization in stereo matching networks

Author Identifier

David Suter

https://orcid.org/0000-0001-6306-3023

Document Type

Conference Proceeding

Publication Title

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volume

2022-June

First Page

13012

Last Page

13022

Publisher

IEEE

School

School of Science / Centre for Artificial Intelligence and Machine Learning (CAIML)

RAS ID

54184

Funders

Australian Research Council

Grant Number

ARC Number : DP200103448

Comments

Chuah, W., Tennakoon, R., Hoseinnezhad, R., Bab-Hadiashar, A., & Suter, D. (2022). ITSA: ITSA: An information-theoretic approach to automatic shortcut avoidance and domain generalization in stereo matching networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 13022-13032. https://doi.org/10.1109/CVPR52688.2022.01268

An open access version of this paper is provided by the Computer Vision Foundation.

Abstract

State-of-the-art stereo matching networks trained only on synthetic data often fail to generalize to more challenging real data domains. In this paper, we attempt to unfold an important factor that hinders the networks from generalizing across domains: through the lens of shortcut learning. We demonstrate that the learning of feature representations in stereo matching networks is heavily influenced by synthetic data artefacts (shortcut attributes). To mitigate this issue, we propose an Information-Theoretic Shortcut Avoidance (ITSA) approach to automatically restrict shortcut-related information from being encoded into the feature representations. As a result, our proposed method learns robust and shortcut-invariant features by minimizing the sensitivity of latent features to input variations. To avoid the prohibitive computational cost of direct input sensitivity optimization, we propose an effective yet feasible algorithm to achieve robustness. We show that using this method, state-of-the-art stereo matching networks that are trained purely on synthetic data can effectively generalize to challenging and previously unseen real data scenarios. Importantly, the proposed method enhances the robustness of the synthetic trained networks to the point that they outperform their fine-tuned counterparts (on real data) for challenging out-of-domain stereo datasets.

DOI

10.1109/CVPR52688.2022.01268

Access Rights

free_to_read

Link to Full Text

Share

 
COinS