| pong | breakout | qbert | enduro | spaceinvaders | seaquest | |
|---|---|---|---|---|---|---|
| dqn | 20.93 | 46.05 | 7278 | 416 | 162.1 | 65.29 |
| double | 20.87 | 54.8 | 7554 | 569.7 | 232.6 | 74.18 |
| dueling | 21 | 87.56 | 5966 | 568.2 | 270.3 | 1366 |
| multistep | 20.13 | 36.99 | 8026 | 445.4 | 391.1 | 488.9 |
| noisy | 20.88 | 106.5 | 11906 | 386.9 | 210.9 | 24.81 |
| per | 21 | 311.5 | 5747 | 2775 | 580.4 | 6386 |
| c51 | 20.99 | 162.3 | 15518 | 573.2 | 411.4 | 7909 |
| qrdqn | 21 | 253.2 | 15210 | 1430 | 494.9 | 7510 |
| iqn | 20.94 | 199.7 | 14819 | 1542 | 573.2 | 98.68 |
| rainbow | - | - | - | - | - | - |
| rainbow_iqn | - | - | - | - | - | - |
| ape-x | 21 | 366.3 | 15283 | 2428 | 2379 | 2650 |
