Examining the causal structures of deep neural networks using information theory

1 code implementation • 26 Oct 2020 • Simon Mattsson, Eric J. Michaud, Erik Hoel

Specifically, we introduce the effective information (EI) of a feedforward DNN, which is the mutual information between layer input and output following a maximum-entropy perturbation.