no code implementations • 6 Apr 2024 • Han Lei, Baoming Wang, Zuwei Shui, Peiyuan Yang, Penghao Liang
In addition to environmental perception sensors such as cameras, radars, etc.
2 code implementations • 22 May 2023 • Jinjie Ni, Rui Mao, Zonglin Yang, Han Lei, Erik Cambria
Specifically, the heads of MHA were originally designed to attend to information from different representation subspaces, whereas prior studies found that some attention heads likely learn similar features and can be pruned without harming performance.
no code implementations • 7 Mar 2023 • Jinjie Ni, Yukun Ma, Wen Wang, Qian Chen, Dianwen Ng, Han Lei, Trung Hieu Nguyen, Chong Zhang, Bin Ma, Erik Cambria
Learning on a massive amount of speech corpus leads to the recent success of many self-supervised speech models.