no code implementations • 7 May 2024 • Mohit Upadhyay, Rohan Juneja, Weng-Fai Wong, Li-Shiuan Peh
Attention mechanisms are becoming increasingly popular, being used in neural network models in multiple domains such as natural language processing (NLP) and vision applications, especially at the edge.
1 code implementation • 25 Nov 2019 • Bo Wang, Jun Zhou, Weng-Fai Wong, Li-Shiuan Peh
We show that conventional artificial neural networks (ANN) such as multilayer perceptron, convolutional neural networks, as well as the latest residual neural networks can be mapped successfully onto Shenjing, realizing ANNs with SNN's energy efficiency.