HiBsteR: Hierarchical Boosted Deep Metric Learning for Image Retrieval

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

When the number of categories is growing into thousands, large-scale image retrieval becomes an increasingly hard task. Retrieval accuracy can be improved by learning distance metric methods that separate categories in a transformed embedding space. Unlike most methods that utilize a single embedding to learn a distance metric, we build on the idea of boosted metric learning, where an embedding is split into a boosted ensemble of embeddings. While in general metric learning is directly applied on fine labels to learn embeddings, we take this one step further and incorporate hierarchical label information into the boost-
ing framework and show how to properly adapt loss functions for this purpose. We show that by introducing several sub-embeddings which focus on specific hierarchical classes, the retrieval accuracy can be improved compared to standard flat label embeddings. The proposed method is especially suitable for exploiting hierarchical datasets or when additional labels can be retrieved without much effort. Our approach improves R@1 over state-of-the-art methods on the biggest available retrieval dataset (Stanford Online Products) and sets new reference baselines for hierarchical metric learning on several other datasets (CUB-200-2011, VegFru, FruitVeg-81). We show that the clustering quality in terms of NMI score is superior to previous works.
Original languageEnglish
Title of host publication2019 IEEE Winter Conference on Applications of Computer Vision (WACV)
Publication statusSubmitted - 8 Jan 2019

Cite this

Waltner, G., Opitz, M., Possegger, H., & Bischof, H. (2019). HiBsteR: Hierarchical Boosted Deep Metric Learning for Image Retrieval. Manuscript submitted for publication. In 2019 IEEE Winter Conference on Applications of Computer Vision (WACV)

HiBsteR: Hierarchical Boosted Deep Metric Learning for Image Retrieval. / Waltner, Georg; Opitz, Michael; Possegger, Horst; Bischof, Horst.

2019 IEEE Winter Conference on Applications of Computer Vision (WACV) . 2019.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Waltner, G, Opitz, M, Possegger, H & Bischof, H 2019, HiBsteR: Hierarchical Boosted Deep Metric Learning for Image Retrieval. in 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) .
Waltner G, Opitz M, Possegger H, Bischof H. HiBsteR: Hierarchical Boosted Deep Metric Learning for Image Retrieval. In 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) . 2019
@inproceedings{73ea3262abb44847b83672dbb81e2f87,
title = "HiBsteR: Hierarchical Boosted Deep Metric Learning for Image Retrieval",
abstract = "When the number of categories is growing into thousands, large-scale image retrieval becomes an increasingly hard task. Retrieval accuracy can be improved by learning distance metric methods that separate categories in a transformed embedding space. Unlike most methods that utilize a single embedding to learn a distance metric, we build on the idea of boosted metric learning, where an embedding is split into a boosted ensemble of embeddings. While in general metric learning is directly applied on fine labels to learn embeddings, we take this one step further and incorporate hierarchical label information into the boost-ing framework and show how to properly adapt loss functions for this purpose. We show that by introducing several sub-embeddings which focus on specific hierarchical classes, the retrieval accuracy can be improved compared to standard flat label embeddings. The proposed method is especially suitable for exploiting hierarchical datasets or when additional labels can be retrieved without much effort. Our approach improves R@1 over state-of-the-art methods on the biggest available retrieval dataset (Stanford Online Products) and sets new reference baselines for hierarchical metric learning on several other datasets (CUB-200-2011, VegFru, FruitVeg-81). We show that the clustering quality in terms of NMI score is superior to previous works.",
author = "Georg Waltner and Michael Opitz and Horst Possegger and Horst Bischof",
year = "2019",
month = "1",
day = "8",
language = "English",
booktitle = "2019 IEEE Winter Conference on Applications of Computer Vision (WACV)",

}

TY - GEN

T1 - HiBsteR: Hierarchical Boosted Deep Metric Learning for Image Retrieval

AU - Waltner, Georg

AU - Opitz, Michael

AU - Possegger, Horst

AU - Bischof, Horst

PY - 2019/1/8

Y1 - 2019/1/8

N2 - When the number of categories is growing into thousands, large-scale image retrieval becomes an increasingly hard task. Retrieval accuracy can be improved by learning distance metric methods that separate categories in a transformed embedding space. Unlike most methods that utilize a single embedding to learn a distance metric, we build on the idea of boosted metric learning, where an embedding is split into a boosted ensemble of embeddings. While in general metric learning is directly applied on fine labels to learn embeddings, we take this one step further and incorporate hierarchical label information into the boost-ing framework and show how to properly adapt loss functions for this purpose. We show that by introducing several sub-embeddings which focus on specific hierarchical classes, the retrieval accuracy can be improved compared to standard flat label embeddings. The proposed method is especially suitable for exploiting hierarchical datasets or when additional labels can be retrieved without much effort. Our approach improves R@1 over state-of-the-art methods on the biggest available retrieval dataset (Stanford Online Products) and sets new reference baselines for hierarchical metric learning on several other datasets (CUB-200-2011, VegFru, FruitVeg-81). We show that the clustering quality in terms of NMI score is superior to previous works.

AB - When the number of categories is growing into thousands, large-scale image retrieval becomes an increasingly hard task. Retrieval accuracy can be improved by learning distance metric methods that separate categories in a transformed embedding space. Unlike most methods that utilize a single embedding to learn a distance metric, we build on the idea of boosted metric learning, where an embedding is split into a boosted ensemble of embeddings. While in general metric learning is directly applied on fine labels to learn embeddings, we take this one step further and incorporate hierarchical label information into the boost-ing framework and show how to properly adapt loss functions for this purpose. We show that by introducing several sub-embeddings which focus on specific hierarchical classes, the retrieval accuracy can be improved compared to standard flat label embeddings. The proposed method is especially suitable for exploiting hierarchical datasets or when additional labels can be retrieved without much effort. Our approach improves R@1 over state-of-the-art methods on the biggest available retrieval dataset (Stanford Online Products) and sets new reference baselines for hierarchical metric learning on several other datasets (CUB-200-2011, VegFru, FruitVeg-81). We show that the clustering quality in terms of NMI score is superior to previous works.

M3 - Conference contribution

BT - 2019 IEEE Winter Conference on Applications of Computer Vision (WACV)

ER -