[scrame]

Huh, nice. I got a little anxiety watching 6-3 of going the low path. That's not a human route, but then watching 8-2 there were a few nice bits that a skilled player would make.

I get that its a lot of trial and error, and its a nice attempt. What would it take to beat the maze levels, though? I guess since the reward is always just moving forward, its hard to tell when you're progressing without an internal map telling you that it's changed and that you're expecting that?

SMB1 i think is great to train on stuff like this, but it does have some secrets and some hiccups. Like, what would it take to get this AI to find the warp zones?

[jxf]

The game state and the heuristic need some extra information, since (spoiler?) Mario leaves the screen during the lead-up to the warp zones, and it doesn't look like it can account for that sort of positioning.