Sample Efficient Reinforcement Learning with Partial Dynamics Knowledge

1 code implementation • 19 Dec 2023 • Meshal Alharbi, Mardavij Roozbehani, Munther Dahleh

In the setting of finite episodic Markov decision processes with $S$ states, $A$ actions, and episode length $H$, we present an optimistic Q-learning algorithm that achieves $\tilde{\mathcal{O}}(\text{Poly}(H)\sqrt{T})$ regret under perfect knowledge of $f$, where $T$ is the total number of interactions with the system.

Q-Learning reinforcement-learning