One decision
Which of four plausible first moves keeps the floor winnable?
Because nothing can be undone, a decision early on can make the end of the floor impossible, and nothing on the screen says so. The first decision of the simple floor shows how sharp this is.
HP 470 · ATK 9 · DEF 4 · yellow keys 1 · at (5,1)
0
1
2
3
4
5
6
7
8
9
10
0
4
24
1
114
2
1141
3
562
4
553
5
182
55
6
24
7
55
56
8
9
114
182
114
10
!
The engine has picked up the key next to the start. Four actions are legal. Which one would you take?
The value shown after each action is the best final HP still reachable from the state it leads to, computed by the exact solver in your browser. The same measure, the state value, is used throughout the thesis to find the turn at which an episode was lost.