TASK	DATASET	MODEL	METRIC NAME	METRIC VALUE	GLOBAL RANK
Atari Games	Atari 2600 Alien	MuZero (Res2 Adam)	Score	70192.35	# 5
Atari Games	Atari 2600 Amidar	MuZero (Res2 Adam)	Score	1197.38	# 22
Atari Games	Atari 2600 Assault	MuZero (Res2 Adam)	Score	33292.22	# 6
Atari Games	Atari 2600 Asterix	MuZero (Res2 Adam)	Score	862406.65	# 5
Atari Games	Atari 2600 Asteroids	MuZero (Res2 Adam)	Score	476412	# 4
Atari Games	Atari 2600 Atlantis	MuZero (Res2 Adam)	Score	1137475.12	# 10
Atari Games	Atari 2600 Bank Heist	MuZero (Res2 Adam)	Score	27219.8	# 1
Atari Games	Atari 2600 Battle Zone	MuZero (Res2 Adam)	Score	178716.9	# 6
Atari Games	Atari 2600 Beam Rider	MuZero (Res2 Adam)	Score	333077.44	# 3
Atari Games	Atari 2600 Berzerk	MuZero (Res2 Adam)	Score	2705.82	# 13
Atari Games	Atari 2600 Bowling	MuZero (Res2 Adam)	Score	131.65	# 10
Atari Games	Atari 2600 Boxing	MuZero (Res2 Adam)	Score	100	# 1
Atari Games	Atari 2600 Breakout	MuZero (Res2 Adam)	Score	758.04	# 12
Atari Games	Atari 2600 Centipede	MuZero (Res2 Adam)	Score	874301.64	# 4
Atari Games	Atari 2600 Chopper Command	MuZero (Res2 Adam)	Score	5989.55	# 28
Atari Games	Atari 2600 Crazy Climber	MuZero (Res2 Adam)	Score	158541.58	# 17
Atari Games	Atari 2600 Defender	MuZero (Res2 Adam)	Score	557200.75	# 8
Atari Games	Atari 2600 Demon Attack	MuZero (Res2 Adam)	Score	143838.04	# 6
Atari Games	Atari 2600 Double Dunk	MuZero (Res2 Adam)	Score	23.91	# 7
Atari Games	Atari 2600 Enduro	MuZero (Res2 Adam)	Score	2365.81	# 8
Atari Games	Atari 2600 Fishing Derby	MuZero (Res2 Adam)	Score	73.94	# 4
Atari Games	Atari 2600 Freeway	MuZero (Res2 Adam)	Score	33.87	# 13
Atari Games	Atari 2600 Frostbite	MuZero (Res2 Adam)	Score	374769.76	# 3
Atari Games	Atari 2600 Gopher	MuZero (Res2 Adam)	Score	122882.5	# 5
Atari Games	Atari 2600 Gravitar	MuZero (Res2 Adam)	Score	8006.93	# 3
Atari Games	Atari 2600 HERO	MuZero (Res2 Adam)	Score	37234.31	# 8
Atari Games	Atari 2600 Ice Hockey	MuZero (Res2 Adam)	Score	41.66	# 7
Atari Games	Atari 2600 James Bond	MuZero (Res2 Adam)	Score	28626.23	# 9
Atari Games	Atari 2600 Kangaroo	MuZero (Res2 Adam)	Score	13838	# 15
Atari Games	Atari 2600 Krull	MuZero (Res2 Adam)	Score	72570.5	# 7
Atari Games	Atari 2600 Kung-Fu Master	MuZero (Res2 Adam)	Score	116726.96	# 7
Atari Games	Atari 2600 Montezuma's Revenge	MuZero (Res2 Adam)	Score	2500	# 15
Atari Games	Atari 2600 Ms. Pacman	MuZero (Res2 Adam)	Score	70659.76	# 2
Atari Games	Atari 2600 Name This Game	MuZero (Res2 Adam)	Score	101197.71	# 2
Atari Games	Atari 2600 Phoenix	MuZero (Res2 Adam)	Score	815728.7	# 7
Atari Games	Atari 2600 Pitfall!	MuZero (Res2 Adam)	Score	0	# 4
Atari Games	Atari 2600 Pong	MuZero (Res2 Adam)	Score	20.95	# 16
Atari Games	Atari 2600 Private Eye	MuZero (Res2 Adam)	Score	100	# 43
Atari Games	Atari 2600 Q*Bert	MuZero (Res2 Adam)	Score	94906.25	# 7
Atari Games	Atari 2600 River Raid	MuZero (Res2 Adam)	Score	171673.78	# 2
Atari Games	Atari 2600 Road Runner	MuZero (Res2 Adam)	Score	531097	# 6
Atari Games	Atari 2600 Robotank	MuZero (Res2 Adam)	Score	100.59	# 6
Atari Games	Atari 2600 Seaquest	MuZero (Res2 Adam)	Score	999659.18	# 6
Atari Games	Atari 2600 Skiing	MuZero (Res2 Adam)	Score	-30000	# 3
Atari Games	Atari 2600 Solaris	MuZero (Res2 Adam)	Score	5132.95	# 13
Atari Games	Atari 2600 Space Invaders	MuZero (Res2 Adam)	Score	3645.63	# 23
Atari Games	Atari 2600 Star Gunner	MuZero (Res2 Adam)	Score	154548.26	# 10
Atari Games	Atari 2600 Surround	MuZero (Res2 Adam)	Score	9.9	# 3
Atari Games	Atari 2600 Tennis	MuZero (Res2 Adam)	Score	0	# 20
Atari Games	Atari 2600 Time Pilot	MuZero (Res2 Adam)	Score	424011.16	# 4
Atari Games	Atari 2600 Tutankham	MuZero (Res2 Adam)	Score	347.99	# 7
Atari Games	Atari 2600 Up and Down	MuZero (Res2 Adam)	Score	634898.18	# 6
Atari Games	Atari 2600 Venture	MuZero (Res2 Adam)	Score	1731.47	# 12
Atari Games	Atari 2600 Video Pinball	MuZero (Res2 Adam)	Score	865543.44	# 8
Atari Games	Atari 2600 Wizard of Wor	MuZero (Res2 Adam)	Score	100096.6	# 5
Atari Games	Atari 2600 Yars Revenge	MuZero (Res2 Adam)	Score	219838.09	# 7
Atari Games	Atari 2600 Zaxxon	MuZero (Res2 Adam)	Score	154131.86	# 5
Continuous Control	cartpole.swingup	MuZero Unplugged	Return	594.3	# 2
Continuous Control	cheetah.run	MuZero Unplugged	Return	869.9	# 2
Continuous Control	finger.turn_hard	MuZero Unplugged	Return	759	# 2
Continuous Control	fish.swim	MuZero Unplugged	Return	681.6	# 1
Continuous Control	humanoid.run	MuZero Unplugged	Return	643.1	# 1
Continuous Control	manipulator.insert_ball	MuZero Unplugged	Return	659.2	# 1
Continuous Control	manipulator.insert_peg	MuZero Unplugged	Return	556	# 1
Continuous Control	walker.stand	MuZero Unplugged	Return	887.2	# 2
Continuous Control	walker.walk	MuZero Unplugged	Return	949.5	# 2

Badge	Markdown
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-bank-heist)](https://paperswithcode.com/sota/atari-games-on-atari-2600-bank-heist?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-boxing)](https://paperswithcode.com/sota/atari-games-on-atari-2600-boxing?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/continuous-control-on-fish-swim)](https://paperswithcode.com/sota/continuous-control-on-fish-swim?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/continuous-control-on-humanoid-run)](https://paperswithcode.com/sota/continuous-control-on-humanoid-run?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/continuous-control-on-manipulator-insert-ball)](https://paperswithcode.com/sota/continuous-control-on-manipulator-insert-ball?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/continuous-control-on-manipulator-insert-peg)](https://paperswithcode.com/sota/continuous-control-on-manipulator-insert-peg?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-ms-pacman)](https://paperswithcode.com/sota/atari-games-on-atari-2600-ms-pacman?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-name-this-game)](https://paperswithcode.com/sota/atari-games-on-atari-2600-name-this-game?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-river-raid)](https://paperswithcode.com/sota/atari-games-on-atari-2600-river-raid?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/continuous-control-on-cartpole-swingup-2)](https://paperswithcode.com/sota/continuous-control-on-cartpole-swingup-2?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/continuous-control-on-cheetah-run-2)](https://paperswithcode.com/sota/continuous-control-on-cheetah-run-2?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/continuous-control-on-finger-turn-hard)](https://paperswithcode.com/sota/continuous-control-on-finger-turn-hard?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/continuous-control-on-walker-stand)](https://paperswithcode.com/sota/continuous-control-on-walker-stand?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/continuous-control-on-walker-walk-2)](https://paperswithcode.com/sota/continuous-control-on-walker-walk-2?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-beam-rider)](https://paperswithcode.com/sota/atari-games-on-atari-2600-beam-rider?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-frostbite)](https://paperswithcode.com/sota/atari-games-on-atari-2600-frostbite?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-gravitar)](https://paperswithcode.com/sota/atari-games-on-atari-2600-gravitar?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-skiing)](https://paperswithcode.com/sota/atari-games-on-atari-2600-skiing?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-surround)](https://paperswithcode.com/sota/atari-games-on-atari-2600-surround?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-asteroids)](https://paperswithcode.com/sota/atari-games-on-atari-2600-asteroids?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-centipede)](https://paperswithcode.com/sota/atari-games-on-atari-2600-centipede?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-fishing-derby)](https://paperswithcode.com/sota/atari-games-on-atari-2600-fishing-derby?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-pitfall)](https://paperswithcode.com/sota/atari-games-on-atari-2600-pitfall?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-time-pilot)](https://paperswithcode.com/sota/atari-games-on-atari-2600-time-pilot?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-alien)](https://paperswithcode.com/sota/atari-games-on-atari-2600-alien?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-asterix)](https://paperswithcode.com/sota/atari-games-on-atari-2600-asterix?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-gopher)](https://paperswithcode.com/sota/atari-games-on-atari-2600-gopher?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-wizard-of-wor)](https://paperswithcode.com/sota/atari-games-on-atari-2600-wizard-of-wor?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-zaxxon)](https://paperswithcode.com/sota/atari-games-on-atari-2600-zaxxon?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-assault)](https://paperswithcode.com/sota/atari-games-on-atari-2600-assault?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-battle-zone)](https://paperswithcode.com/sota/atari-games-on-atari-2600-battle-zone?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-demon-attack)](https://paperswithcode.com/sota/atari-games-on-atari-2600-demon-attack?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-road-runner)](https://paperswithcode.com/sota/atari-games-on-atari-2600-road-runner?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-robotank)](https://paperswithcode.com/sota/atari-games-on-atari-2600-robotank?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-seaquest)](https://paperswithcode.com/sota/atari-games-on-atari-2600-seaquest?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-up-and-down)](https://paperswithcode.com/sota/atari-games-on-atari-2600-up-and-down?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-double-dunk)](https://paperswithcode.com/sota/atari-games-on-atari-2600-double-dunk?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-ice-hockey)](https://paperswithcode.com/sota/atari-games-on-atari-2600-ice-hockey?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-krull)](https://paperswithcode.com/sota/atari-games-on-atari-2600-krull?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-kung-fu-master)](https://paperswithcode.com/sota/atari-games-on-atari-2600-kung-fu-master?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-phoenix)](https://paperswithcode.com/sota/atari-games-on-atari-2600-phoenix?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-qbert)](https://paperswithcode.com/sota/atari-games-on-atari-2600-qbert?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-tutankham)](https://paperswithcode.com/sota/atari-games-on-atari-2600-tutankham?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-yars-revenge)](https://paperswithcode.com/sota/atari-games-on-atari-2600-yars-revenge?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-defender)](https://paperswithcode.com/sota/atari-games-on-atari-2600-defender?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-enduro)](https://paperswithcode.com/sota/atari-games-on-atari-2600-enduro?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-hero)](https://paperswithcode.com/sota/atari-games-on-atari-2600-hero?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-video-pinball)](https://paperswithcode.com/sota/atari-games-on-atari-2600-video-pinball?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-james-bond)](https://paperswithcode.com/sota/atari-games-on-atari-2600-james-bond?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-atlantis)](https://paperswithcode.com/sota/atari-games-on-atari-2600-atlantis?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-bowling)](https://paperswithcode.com/sota/atari-games-on-atari-2600-bowling?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-star-gunner)](https://paperswithcode.com/sota/atari-games-on-atari-2600-star-gunner?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-breakout)](https://paperswithcode.com/sota/atari-games-on-atari-2600-breakout?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-venture)](https://paperswithcode.com/sota/atari-games-on-atari-2600-venture?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-berzerk)](https://paperswithcode.com/sota/atari-games-on-atari-2600-berzerk?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-freeway)](https://paperswithcode.com/sota/atari-games-on-atari-2600-freeway?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-solaris)](https://paperswithcode.com/sota/atari-games-on-atari-2600-solaris?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-kangaroo)](https://paperswithcode.com/sota/atari-games-on-atari-2600-kangaroo?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-montezumas-revenge)](https://paperswithcode.com/sota/atari-games-on-atari-2600-montezumas-revenge?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-pong)](https://paperswithcode.com/sota/atari-games-on-atari-2600-pong?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-crazy-climber)](https://paperswithcode.com/sota/atari-games-on-atari-2600-crazy-climber?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-tennis)](https://paperswithcode.com/sota/atari-games-on-atari-2600-tennis?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-amidar)](https://paperswithcode.com/sota/atari-games-on-atari-2600-amidar?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-space-invaders)](https://paperswithcode.com/sota/atari-games-on-atari-2600-space-invaders?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-chopper-command)](https://paperswithcode.com/sota/atari-games-on-atari-2600-chopper-command?p=online-and-offline-reinforcement-learning-by)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/online-and-offline-reinforcement-learning-by/atari-games-on-atari-2600-private-eye)](https://paperswithcode.com/sota/atari-games-on-atari-2600-private-eye?p=online-and-offline-reinforcement-learning-by)`

Online and Offline Reinforcement Learning by Planning with a Learned Model

NeurIPS 2021 · Julian Schrittwieser, Thomas Hubert, Amol Mandhane, Mohammadamin Barekatain, Ioannis Antonoglou, David Silver ·

Learning efficiently from small amounts of data has long been the focus of model-based reinforcement learning, both for the online case when interacting with the environment and the offline case when learning from a fixed dataset. However, to date no single unified algorithm could demonstrate state-of-the-art results in both settings. In this work, we describe the Reanalyse algorithm which uses model-based policy and value improvement operators to compute new improved training targets on existing data points, allowing efficient learning for data budgets varying by several orders of magnitude. We further show that Reanalyse can also be used to learn entirely from demonstrations without any environment interactions, as in the case of offline Reinforcement Learning (offline RL). Combining Reanalyse with the MuZero algorithm, we introduce MuZero Unplugged, a single unified algorithm for any data budget, including offline RL. In contrast to previous work, our algorithm does not require any special adaptations for the off-policy or offline RL settings. MuZero Unplugged sets new state-of-the-art results in the RL Unplugged offline RL benchmark as well as in the online RL benchmark of Atari in the standard 200 million frame setting.

PDF Abstract NeurIPS 2021 PDF NeurIPS 2021 Abstract

Code

Add Remove Mark official

DHDev0/Muzero-unplugged

enpasos/muzero

Tasks

Add Remove

Atari Games

Continuous Control

Model-based Reinforcement Learning

Offline RL

reinforcement-learning

Reinforcement Learning (RL)

Datasets

Arcade Learning Environment

Results from the Paper

Edit

Ranked #1 on Atari Games on Atari 2600 Bank Heist

Get a GitHub badge

Task	Dataset	Model	Metric Name	Metric Value	Global Rank	Benchmark
Atari Games	Atari 2600 Alien	MuZero (Res2 Adam)	Score	70192.35	# 5	Compare
Atari Games	Atari 2600 Amidar	MuZero (Res2 Adam)	Score	1197.38	# 22	Compare
Atari Games	Atari 2600 Assault	MuZero (Res2 Adam)	Score	33292.22	# 6	Compare
Atari Games	Atari 2600 Asterix	MuZero (Res2 Adam)	Score	862406.65	# 5	Compare
Atari Games	Atari 2600 Asteroids	MuZero (Res2 Adam)	Score	476412	# 4	Compare
Atari Games	Atari 2600 Atlantis	MuZero (Res2 Adam)	Score	1137475.12	# 10	Compare
Atari Games	Atari 2600 Bank Heist	MuZero (Res2 Adam)	Score	27219.8	# 1	Compare
Atari Games	Atari 2600 Battle Zone	MuZero (Res2 Adam)	Score	178716.9	# 6	Compare
Atari Games	Atari 2600 Beam Rider	MuZero (Res2 Adam)	Score	333077.44	# 3	Compare
Atari Games	Atari 2600 Berzerk	MuZero (Res2 Adam)	Score	2705.82	# 13	Compare
Atari Games	Atari 2600 Bowling	MuZero (Res2 Adam)	Score	131.65	# 10	Compare
Atari Games	Atari 2600 Boxing	MuZero (Res2 Adam)	Score	100	# 1	Compare
Atari Games	Atari 2600 Breakout	MuZero (Res2 Adam)	Score	758.04	# 12	Compare
Atari Games	Atari 2600 Centipede	MuZero (Res2 Adam)	Score	874301.64	# 4	Compare
Atari Games	Atari 2600 Chopper Command	MuZero (Res2 Adam)	Score	5989.55	# 28	Compare
Atari Games	Atari 2600 Crazy Climber	MuZero (Res2 Adam)	Score	158541.58	# 17	Compare
Atari Games	Atari 2600 Defender	MuZero (Res2 Adam)	Score	557200.75	# 8	Compare
Atari Games	Atari 2600 Demon Attack	MuZero (Res2 Adam)	Score	143838.04	# 6	Compare
Atari Games	Atari 2600 Double Dunk	MuZero (Res2 Adam)	Score	23.91	# 7	Compare
Atari Games	Atari 2600 Enduro	MuZero (Res2 Adam)	Score	2365.81	# 8	Compare
Atari Games	Atari 2600 Fishing Derby	MuZero (Res2 Adam)	Score	73.94	# 4	Compare
Atari Games	Atari 2600 Freeway	MuZero (Res2 Adam)	Score	33.87	# 13	Compare
Atari Games	Atari 2600 Frostbite	MuZero (Res2 Adam)	Score	374769.76	# 3	Compare
Atari Games	Atari 2600 Gopher	MuZero (Res2 Adam)	Score	122882.5	# 5	Compare
Atari Games	Atari 2600 Gravitar	MuZero (Res2 Adam)	Score	8006.93	# 3	Compare
Atari Games	Atari 2600 HERO	MuZero (Res2 Adam)	Score	37234.31	# 8	Compare
Atari Games	Atari 2600 Ice Hockey	MuZero (Res2 Adam)	Score	41.66	# 7	Compare
Atari Games	Atari 2600 James Bond	MuZero (Res2 Adam)	Score	28626.23	# 9	Compare
Atari Games	Atari 2600 Kangaroo	MuZero (Res2 Adam)	Score	13838	# 15	Compare
Atari Games	Atari 2600 Krull	MuZero (Res2 Adam)	Score	72570.5	# 7	Compare
Atari Games	Atari 2600 Kung-Fu Master	MuZero (Res2 Adam)	Score	116726.96	# 7	Compare
Atari Games	Atari 2600 Montezuma's Revenge	MuZero (Res2 Adam)	Score	2500	# 15	Compare
Atari Games	Atari 2600 Ms. Pacman	MuZero (Res2 Adam)	Score	70659.76	# 2	Compare
Atari Games	Atari 2600 Name This Game	MuZero (Res2 Adam)	Score	101197.71	# 2	Compare
Atari Games	Atari 2600 Phoenix	MuZero (Res2 Adam)	Score	815728.7	# 7	Compare
Atari Games	Atari 2600 Pitfall!	MuZero (Res2 Adam)	Score	0	# 4	Compare
Atari Games	Atari 2600 Pong	MuZero (Res2 Adam)	Score	20.95	# 16	Compare
Atari Games	Atari 2600 Private Eye	MuZero (Res2 Adam)	Score	100	# 43	Compare
Atari Games	Atari 2600 Q*Bert	MuZero (Res2 Adam)	Score	94906.25	# 7	Compare
Atari Games	Atari 2600 River Raid	MuZero (Res2 Adam)	Score	171673.78	# 2	Compare
Atari Games	Atari 2600 Road Runner	MuZero (Res2 Adam)	Score	531097	# 6	Compare
Atari Games	Atari 2600 Robotank	MuZero (Res2 Adam)	Score	100.59	# 6	Compare
Atari Games	Atari 2600 Seaquest	MuZero (Res2 Adam)	Score	999659.18	# 6	Compare
Atari Games	Atari 2600 Skiing	MuZero (Res2 Adam)	Score	-30000	# 3	Compare
Atari Games	Atari 2600 Solaris	MuZero (Res2 Adam)	Score	5132.95	# 13	Compare
Atari Games	Atari 2600 Space Invaders	MuZero (Res2 Adam)	Score	3645.63	# 23	Compare
Atari Games	Atari 2600 Star Gunner	MuZero (Res2 Adam)	Score	154548.26	# 10	Compare
Atari Games	Atari 2600 Surround	MuZero (Res2 Adam)	Score	9.9	# 3	Compare
Atari Games	Atari 2600 Tennis	MuZero (Res2 Adam)	Score	0	# 20	Compare
Atari Games	Atari 2600 Time Pilot	MuZero (Res2 Adam)	Score	424011.16	# 4	Compare
Atari Games	Atari 2600 Tutankham	MuZero (Res2 Adam)	Score	347.99	# 7	Compare
Atari Games	Atari 2600 Up and Down	MuZero (Res2 Adam)	Score	634898.18	# 6	Compare
Atari Games	Atari 2600 Venture	MuZero (Res2 Adam)	Score	1731.47	# 12	Compare
Atari Games	Atari 2600 Video Pinball	MuZero (Res2 Adam)	Score	865543.44	# 8	Compare
Atari Games	Atari 2600 Wizard of Wor	MuZero (Res2 Adam)	Score	100096.6	# 5	Compare
Atari Games	Atari 2600 Yars Revenge	MuZero (Res2 Adam)	Score	219838.09	# 7	Compare
Atari Games	Atari 2600 Zaxxon	MuZero (Res2 Adam)	Score	154131.86	# 5	Compare
Continuous Control	cartpole.swingup	MuZero Unplugged	Return	594.3	# 2	Compare
Continuous Control	cheetah.run	MuZero Unplugged	Return	869.9	# 2	Compare
Continuous Control	finger.turn_hard	MuZero Unplugged	Return	759	# 2	Compare
Continuous Control	fish.swim	MuZero Unplugged	Return	681.6	# 1	Compare
Continuous Control	humanoid.run	MuZero Unplugged	Return	643.1	# 1	Compare
Continuous Control	manipulator.insert_ball	MuZero Unplugged	Return	659.2	# 1	Compare
Continuous Control	manipulator.insert_peg	MuZero Unplugged	Return	556	# 1	Compare
Continuous Control	walker.stand	MuZero Unplugged	Return	887.2	# 2	Compare
Continuous Control	walker.walk	MuZero Unplugged	Return	949.5	# 2	Compare

Methods

Add Remove

Average Pooling • Batch Normalization • Convolution • Monte-Carlo Tree Search • MuZero • Prioritized Experience Replay • ReLU • Residual Block • Residual Connection

Edit Social Preview

Online and Offline Reinforcement Learning by Planning with a Learned Model

Code Edit Add Remove Mark official

Tasks Edit Add Remove

Datasets Edit

Results from the Paper Edit

Methods Edit Add Remove

Code

Add Remove Mark official

Tasks

Add Remove

Datasets

Results from the Paper

Edit

Methods

Add Remove