Automated Heterogeneous Low-Bit Quantization of Multi-Model Deep Learning Inference Pipeline

no code implementations • 10 Nov 2023 • Jayeeta Mondal, Swarnava Dey, Arijit Mukherjee

Multiple Deep Neural Networks (DNNs) integrated into single Deep Learning (DL) inference pipelines e. g. Multi-Task Learning (MTL) or Ensemble Learning (EL), etc., albeit very accurate, pose challenges for edge deployment.

Ensemble Learning Multi-Task Learning +1

DietCNN: Multiplication-free Inference for Quantized CNNs

1 code implementation • 9 May 2023 • Swarnava Dey, Pallab Dasgupta, Partha P Chakrabarti

The rising demand for networked embedded systems with machine intelligence has been a catalyst for sustained attempts by the research community to implement Convolutional Neural Networks (CNN) based inferencing on embedded resource-limited devices.