Model Quantization and Hardware Acceleration for Vision Transformers: A Comprehensive Survey

1 code implementation • 1 May 2024 • Dayou Du, Gu Gong, Xiaowen Chu

Model quantization, by converting high-precision numbers to lower-precision, reduces the computational demands and memory needs of ViTs, allowing the creation of hardware specifically optimized for these quantized algorithms, boosting efficiency.

Quantization