The Norm Must Go On - Dynamic Unsupervised Domain Adaptation by Normalization.

Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandBegutachtung

Abstract

Domain adaptation is crucial to adapt a learned model to new scenarios, such as domain shifts or changing data distributions. Current approaches usually require a large amount of labeled or unlabeled data from the shifted domain. This can be a hurdle in fields which require continuous dynamic adaptation or suffer from scarcity of data, e.g. autonomous driving in challenging weather conditions. To address this problem of continuous adaptation to distribution shifts, we propose Dynamic Unsupervised Adaptation (DUA). We modify the feature representations of the model by continuously adapting the statistics of the batch normalization layers. We show that by accessing only a tiny fraction of unlabeled data from the shifted domain and adapting sequentially, a strong performance gain can be achieved. With even less than 1% of unlabeled data from the target domain, DUA already achieves competitive results to strong baselines. In addition, the computational overhead is minimal in contrast to previous approaches. Our approach is simple, yet effective and can be applied to any architecture which uses batch normalization as one of its components. We show the utility of DUA by evaluating it on a variety of domain adaptation datasets and tasks including object recognition, digit recognition and object detection
Originalspracheenglisch
TitelIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Seitenumfang17
PublikationsstatusVeröffentlicht - 2022
Veranstaltung2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition: CVPR 2022 - New Orleans Ernest N. Morial Convention Center, Hybrider Event, New Orleans, USA / Vereinigte Staaten
Dauer: 21 Juni 202224 Sept. 2022
Konferenznummer: 2022

Konferenz

Konferenz2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition
KurztitelCVPR 2022
Land/GebietUSA / Vereinigte Staaten
OrtHybrider Event, New Orleans
Zeitraum21/06/2224/09/22

Fingerprint

Untersuchen Sie die Forschungsthemen von „The Norm Must Go On - Dynamic Unsupervised Domain Adaptation by Normalization.“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren