no code implementations • 6 Feb 2024 • Akira Ito, Masanori Yamada, Atsutoshi Kumagai
This finding shows that permutations found by WM mainly align the directions of singular vectors associated with large singular values across models.
Linear Mode Connectivity