Watch Q-values update as the agent learns. Each cell shows Q(s,a) for all 4 actions. Brighter = higher value.
Bellman Backup — Current Update
Q(s,a)
0.000
α
0.30
r
-0.040
γ·max Q(s')
new Q(s,a)
-0.012