Modelling Identity Rules with Neural Networks

no code implementations • 6 Dec 2018 • Tillman Weyde, Radha Manisha Kopparti

We propose a new approach to modify standard neural network architectures, called Relation Based Patterns (RBP) with different variants for classification and prediction.

General Classification Inductive Bias

Feed-Forward Neural Networks Need Inductive Bias to Learn Equality Relations

no code implementations • 4 Dec 2018 • Tillman Weyde, Radha Manisha Kopparti

The DR units create an inductive bias in the networks, so that they do learn to generalise, even from small numbers of examples and we have not found any negative effect of their inclusion in the network.

Inductive Bias Relational Reasoning