MAMustafaAH10

Spatial planning benchmark

RushHourEval

RushHourEval is a spatial-planning benchmark built from 450 Rush Hour puzzles across 3×3, 4×4, and 5×5 boards. Models must produce complete move-by-move plans; every step is replayed and classified for legality, target completion, and optimality.

Replay an answer ↓ View benchmark code ↗
450puzzles
3×board sizes
1,221replayable answers
Everymove validated
01
Puzzle in

Grid, pieces, target, and strict movement rules.

02
Plan out

The model returns a complete, ordered move sequence.

03
Every step checked

Optimal, sub-optimal, unsolved, illegal, or unparsed.

Interactive answer viewer

Replay lab

Watch the model’s attempted solution—even when it fails.

3x3 · Easy

Puzzle 1

TargetCar
Start
Prompt sent to the model view

            
Reference solution optimal

          

        


        

          

            
Validated model performance
One leaderboard, three board sizes

            

              
              
            

          

          
Target / optimal rates are shown together. Color bars split optimal, sub-optimal, unsolved, and illegal attempts.

          

          

            OptimalSub-optimalLegal, no targetIllegal / parse fail
          

        


        

          

            
Dataset browser
Inspect all 450 puzzles

            
Loading puzzles…

          

          

            
            
            
            
          

          

          
        


        

          

            
Original validation plots
Performance breakdowns

            
Click any plot to inspect it at full size.