ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation

7 Jun 2016  ·  Adam Paszke, Abhishek Chaurasia, Sangpil Kim, Eugenio Culurciello ·

The ability to perform pixel-wise semantic segmentation in real-time is of paramount importance in mobile applications. Recent deep neural networks aimed at this task have the disadvantage of requiring a large number of floating point operations and have long run-times that hinder their usability. In this paper, we propose a novel deep neural network architecture named ENet (efficient neural network), created specifically for tasks requiring low latency operation. ENet is up to 18$\times$ faster, requires 75$\times$ less FLOPs, has 79$\times$ less parameters, and provides similar or better accuracy to existing models. We have tested it on CamVid, Cityscapes and SUN datasets and report on comparisons with existing state-of-the-art methods, and the trade-offs between accuracy and processing time of a network. We present performance measurements of the proposed architecture on embedded systems and suggest possible software improvements that could make ENet even faster.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Semantic Segmentation Cityscapes test ENet Mean IoU (class) 58.3% # 99
Real-Time Semantic Segmentation Cityscapes test ENet mIoU 58.3% # 38
Time (ms) 13 # 7
Frame (fps) 76.9 # 7
Semantic Segmentation ScanNetV2 ENet Mean IoU 37.6% # 10

Methods