Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotations

3D object detection has recently become popular due to many applications in robotics, augmented reality, autonomy, and image retrieval. We introduce the Objectron dataset to advance the state of the art in 3D object detection and foster new research and applications, such as 3D object tracking, view synthesis, and improved 3D shape representation. The dataset contains object-centric short videos with pose annotations for nine categories and includes 4 million annotated images in 14,819 annotated videos. We also propose a new evaluation metric, 3D Intersection over Union, for 3D object detection. We demonstrate the usefulness of our dataset in 3D object detection tasks by providing baseline models trained on this dataset. Our dataset and evaluation source code are available online at http://www.objectron.dev

PDF Abstract CVPR 2021 PDF CVPR 2021 Abstract

Datasets


Introduced in the Paper:

Objectron

Used in the Paper:

ImageNet ssd ShapeNet
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Monocular 3D Object Detection Google Objectron EfficientNetLite + keypoint regressor Average Precision at 0.5 3D IoU 0.6512 # 2
MPE 0.0467 # 1
AP at 15' Azimuth error 0.7844 # 2
AP at 10' Elevation error 0.8584 # 1

Methods