no code implementations • 3 Dec 2023 • Gautam Reddy
In-context learning (ICL) is driven by the abrupt emergence of an induction head, which subsequently competes with in-weights learning.
no code implementations • NeurIPS 2018 • Chaitanya Ryali, Gautam Reddy, Angela J. Yu
We derive the theoretical relationship between DBM and EXP, and show that EXP gains computational efficiency by foregoing the representation of inferential uncertainty (as does the delta rule), but that it nevertheless achieves near-Bayesian performance due to its ability to incorporate a "persistent prior" influence unique to DBM and absent from the other algorithms.
no code implementations • 10 Oct 2018 • Martin Carballo-Pacheco, Jonathan Desponds, Tatyana Gavrilchenko, Andreas Mayer, Roshan Prizak, Gautam Reddy, Ilya Nemenman, Thierry Mora
Crosstalk is often thought of as a deviation from optimal specific recognition, as the binding of non-cognate ligands can interfere with the detection of the receptor's cognate ligand, possibly leading to a false triggering of a downstream signaling pathway.
no code implementations • 12 Jan 2016 • Gautam Reddy, Antonio Celani, Massimo Vergassola
Proper balance between exploitation and exploration is what makes good decisions, which achieve high rewards like payoff or evolutionary fitness.