Sharing matters for generalization in deep metric learning

Learning the similarity between images constitutes the foundation for numerous vision tasks. The common paradigm is discriminative metric learning, which seeks an embedding that separates different training classes. However, the main challenge is to learn a metric that not only generalizes from trai...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Milbich, Timo (VerfasserIn) , Roth, Karsten (VerfasserIn) , Brattoli, Biagio (VerfasserIn) , Ommer, Björn (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 2022
In: IEEE transactions on pattern analysis and machine intelligence
Year: 2022, Jahrgang: 44, Heft: 1, Pages: 416-427
ISSN:1939-3539
DOI:10.1109/TPAMI.2020.3009620
Online-Zugang:Verlag: http://dx.doi.org/10.1109/TPAMI.2020.3009620
Volltext
Verfasserangaben:Timo Milbich, Karsten Roth, Biagio Brattoli, and Björn Ommer
Beschreibung
Zusammenfassung:Learning the similarity between images constitutes the foundation for numerous vision tasks. The common paradigm is discriminative metric learning, which seeks an embedding that separates different training classes. However, the main challenge is to learn a metric that not only generalizes from training to novel, but related, test samples. It should also transfer to different object classes. So what complementary information is missed by the discriminative paradigm? Besides finding characteristics that separate between classes, we also need them to likely occur in novel categories, which is indicated if they are shared across training classes. This work investigates how to learn such characteristics without the need for extra annotations or training data. By formulating our approach as a novel triplet sampling strategy, it can be easily applied on top of recent ranking loss frameworks. Experiments show that, independent of the underlying network architecture and the specific ranking loss, our approach significantly improves performance in deep metric learning, leading to new the state-of-the-art results on various standard benchmark datasets.
Beschreibung:Gesehen am 04.01.2022
Date of Publication: 15 July 2020
Date of current version 3 Dec. 2021
Beschreibung:Online Resource
ISSN:1939-3539
DOI:10.1109/TPAMI.2020.3009620