Graph Sampling Based Deep Metric Learning for Generalizable Person Re-Identification

CVPR 2022  ·  Shengcai Liao, Ling Shao ·

Recent studies show that, both explicit deep feature matching as well as large-scale and diverse training data can significantly improve the generalization of person re-identification. However, the efficiency of learning deep matchers on large-scale data has not yet been adequately studied. Though learning with classification parameters or class memory is a popular way, it incurs large memory and computational costs. In contrast, pairwise deep metric learning within mini batches would be a better choice. However, the most popular random sampling method, the well-known PK sampler, is not informative and efficient for deep metric learning. Though online hard example mining has improved the learning efficiency to some extent, the mining in mini batches after random sampling is still limited. This inspires us to explore the use of hard example mining earlier, in the data sampling stage. To do so, in this paper, we propose an efficient mini-batch sampling method, called graph sampling (GS), for large-scale deep metric learning. The basic idea is to build a nearest neighbor relationship graph for all classes at the beginning of each epoch. Then, each mini batch is composed of a randomly selected class and its nearest neighboring classes so as to provide informative and challenging examples for learning. Together with an adapted competitive baseline, we improve the state of the art in generalizable person re-identification significantly, by 25.1% in Rank-1 on MSMT17 when trained on RandPerson. Besides, the proposed method also outperforms the competitive baseline, by 6.8% in Rank-1 on CUHK03-NP when trained on MSMT17. Meanwhile, the training time is significantly reduced, from 25.4 hours to 2 hours when trained on RandPerson with 8,000 identities. Code is available at https://github.com/ShengcaiLiao/QAConv.

PDF Abstract CVPR 2022 PDF CVPR 2022 Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Generalizable Person Re-identification CUHK03-NP (detected) QAConv-GS ClonedPerson->mAP 21.8 # 2
ClonedPerson->Rank-1 22.6 # 2
RandPerson->mAP 16.1 # 1
RandPerson->Rank-1 18.4 # 1
MSMT17->mAP 20.6 # 2
MSMT17->Rank-1 20.9 # 2
MSMT17-All->mAP 28.0 # 2
MSMT17-All->Rank-1 27.6 # 2
Market-1501->mAP 18.1 # 2
Market-1501->Rank-1 19.1 # 2
Generalizable Person Re-identification Market-1501 QAConv-GS ClonedPerson->mAP 59.9 # 2
ClonedPerson->Rank-1 84.5 # 2
RandPerson->mAP 46.7 # 2
RandPerson->Rank-1 76.7 # 2
MSMT17->mAP 49.5 # 2
MSMT17->Rank-1 79.1 # 2
MSMT17-All->mAP 56.9 # 2
MSMT17-All->Rank-1 82.4 # 2
Generalizable Person Re-identification MSMT17 QAConv-GS RandPerson->mAP 15.5 # 2
RandPerson->Rank-1 45.1 # 2
Market-1501->Rank1 45.9 # 2
Market-1501->mAP 17.2 # 2
ClonedPerson->mAP 18.5 # 2
ClonedPerson->Rank-1 49.1 # 2

Methods