no code implementations • 18 Jan 2024 • Junbin Qiu, Haiping Huang
Here, we treat searching for the steady state as an optimization problem, and construct an approximate potential closely related to the speed of the dynamics, and find that searching for the ground state of this potential is equivalent to running a stochastic gradient dynamics.
1 code implementation • 8 Sep 2023 • Chan Li, Junbin Qiu, Haiping Huang
Therefore, our model provides a starting point to investigate the connection among brain computation, next-token prediction and general intelligence.
no code implementations • 26 Nov 2021 • Yang Zhao, Junbin Qiu, Mingshan Xie, Haiping Huang
Binary perceptron is a fundamental model of supervised learning for the non-convex optimization, which is a root of the popular deep learning.