A Bayesian Filter for Multi-view 3D Multi-object Tracking with Occlusion Handling

13 Jan 2020  ·  Jonah Ong, Ba Tuong Vo, Ba Ngu Vo, Du Yong Kim, Sven Nordholm ·

This paper proposes an online multi-camera multi-object tracker that only requires monocular detector training, independent of the multi-camera configurations, allowing seamless extension/deletion of cameras without retraining effort. The proposed algorithm has a linear complexity in the total number of detections across the cameras, and hence scales gracefully with the number of cameras. It operates in the 3D world frame, and provides 3D trajectory estimates of the objects. The key innovation is a high fidelity yet tractable 3D occlusion model, amenable to optimal Bayesian multi-view multi-object filtering, which seamlessly integrates, into a single Bayesian recursion, the sub-tasks of track management, state estimation, clutter rejection, and occlusion/misdetection handling. The proposed algorithm is evaluated on the latest WILDTRACKS dataset, and demonstrated to work in very crowded scenes on a new dataset.

PDF Abstract

Datasets


Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Multi-Object Tracking Wildtrack GLMB-YOLOv3 IDF1 74.3 # 7
MOTA 69.7 # 8
Multi-Object Tracking Wildtrack GLMB-DO IDF1 72.5 # 8
MOTA 70.1 # 7

Methods


No methods listed for this paper. Add relevant methods here