Predictive coding, precision and natural gradients

no code implementations • 12 Nov 2021 • Andre Ofner, Raihan Kabir Ratul, Suhita Ghosh, Sebastian Stober

Here we focus on the related, but still largely under-explored connection between precision weighting in predictive coding networks and the Natural Gradient Descent algorithm for deep neural networks.

Variational Inference