Engineering flexible machine learning systems by traversing functionally-invariant paths

1 code implementation • 30 Apr 2022 • Guruprasad Raghavan, Bahey Tharwat, Surya Narayanan Hari, Dhruvil Satani, Matt Thomson

We conceptualize the weight space of a neural network as a curved Riemannian manifold equipped with a metric tensor whose spectrum defines low rank subspaces in weight space that accommodate network adaptation without loss of prior knowledge.

Adversarial Robustness Continual Learning +4