1 code implementation • 10 May 2024 • Zhiyuan Ning, Chunlin Tian, Meng Xiao, Wei Fan, Pengyang Wang, Li Li, Pengfei Wang, Yuanchun Zhou
Federated Learning faces significant challenges in statistical and system heterogeneity, along with high energy consumption, necessitating efficient client selection strategies.
no code implementations • 7 May 2024 • Chunlin Tian, Zhan Shi, Xinpeng Qin, Li Li, Chengzhong Xu
Federated Learning (FL) enables multiple devices to collaboratively train a shared model while ensuring data privacy.
1 code implementation • 30 Apr 2024 • Chunlin Tian, Zhan Shi, Zhijiang Guo, Li Li, Chengzhong Xu
Through a series of experiments, we have uncovered two critical insights that shed light on the training and parameter inefficiency of LoRA.
no code implementations • 20 Apr 2024 • Yebo Wu, Li Li, Chunlin Tian, Chengzhong Xu
In order to preserve the feature representation of each block, we decouple the whole training process into two stages: progressive model shrinking and progressive model growing.
no code implementations • 17 Jun 2023 • Shitian Li, Chunlin Tian, Kahou Tam, Rui Ma, Li Li
In this systematic survey, we aim to explore the current state-of-the-art techniques for breaking on-device training memory walls, focusing on methods that can enable larger and more complex models to be trained on resource-constrained devices.
no code implementations • 16 Jan 2017 • Chunlin Tian, Weijun Ji
Some DNN models were used in AVSR like Multimodal Deep Autoencoders (MDAEs), Multimodal Deep Belief Network (MDBN) and Multimodal Deep Boltzmann Machine (MDBM) that actually work better than traditional methods.
Audio-Visual Speech Recognition Automatic Speech Recognition +6