no code implementations • 17 Jun 2023 • Shitian Li, Chunlin Tian, Kahou Tam, Rui Ma, Li Li
In this systematic survey, we aim to explore the current state-of-the-art techniques for breaking on-device training memory walls, focusing on methods that can enable larger and more complex models to be trained on resource-constrained devices.