Meta-DM: Applications of Diffusion Models on Few-Shot Learning

14 May 2023  ·  Wentao Hu, Xiurong Jiang, Jiarun Liu, YuQi Yang, Hui Tian ·

In the field of few-shot learning (FSL), extensive research has focused on improving network structures and training strategies. However, the role of data processing modules has not been fully explored. Therefore, in this paper, we propose Meta-DM, a generalized data processing module for FSL problems based on diffusion models. Meta-DM is a simple yet effective module that can be easily integrated with existing FSL methods, leading to significant performance improvements in both supervised and unsupervised settings. We provide a theoretical analysis of Meta-DM and evaluate its performance on several algorithms. Our experiments show that combining Meta-DM with certain methods achieves state-of-the-art results.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Unsupervised Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) Meta-DM+UniSiam Accuracy 66.68 # 2
Unsupervised Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) Meta-DM+UniSiam Accuracy 85.29 # 2

Methods