no code implementations • 9 May 2024 • Yining Wang, Junjie Sun, Chenyue Wang, Mi Zhang, Min Yang
Recent studies have noted an intriguing phenomenon termed Neural Collapse, that is, when the neural networks establish the right correlation between feature spaces and the training targets, their last-layer features, together with the classifier weights, will collapse into a stable and symmetric structure.