DEFER: Distributed Edge Inference for Deep Neural Networks

1 code implementation • 18 Jan 2022 • Arjun Parthasarathy, Bhaskar Krishnamachari

We find that for the ResNet50 model, the inference throughput of DEFER with 8 compute nodes is 53% higher and per node energy consumption is 63% lower than single device inference.