TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot Learning

16 May 2019  ·  Sung Whan Yoon, Jun Seo, Jaekyun Moon ·

Handling previously unseen tasks after given only a few training examples continues to be a tough challenge in machine learning. We propose TapNets, neural networks augmented with task-adaptive projection for improved few-shot learning. Here, employing a meta-learning strategy with episode-based training, a network and a set of per-class reference vectors are learned across widely varying tasks. At the same time, for every episode, features in the embedding space are linearly projected into a new space as a form of quick task-specific conditioning. The training loss is obtained based on a distance metric between the query and the reference vectors in the projection space. Excellent generalization results in this way. When tested on the Omniglot, miniImageNet and tieredImageNet datasets, we obtain state of the art classification accuracies under various few-shot scenarios.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) TapNet Accuracy 61.65 # 65
Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) TapNet Accuracy 76.36 # 61
Few-Shot Image Classification OMNIGLOT - 1-Shot, 20-way TapNet Accuracy 98.07% # 4
Few-Shot Image Classification OMNIGLOT - 5-Shot, 20-way TapNet Accuracy 99.49% # 4
Few-Shot Image Classification Tiered ImageNet 5-way (1-shot) TapNet Accuracy 63.08 # 42
Few-Shot Image Classification Tiered ImageNet 5-way (5-shot) TapNet Accuracy 80.26 # 41

Methods


No methods listed for this paper. Add relevant methods here