Hacker News new | ask | show | jobs
by dezgeg 15 days ago
Good stuff, I've been trying this myself with Geminis: https://www.youtube.com/watch?v=brkP58pZ23w&list=PL8C_UWcLmv...

Will be interesting to compare the results.

1 comments

Seems like I have much better results with Gemini <= 3.5 Flash being able to solve 10 Lake levels. Of course there may be methodology differences (like how many times the level is attempted from scratch).

I wonder if the reasoning tokens are still being accidentally discarded between turns in those tests. It seems to be much more important to preserve those for Gemini, as it likes to stay quiet and and just make tool calls, unlike Claude that yaps a lot what it's planning to do.