Hacker News new | ask | show | jobs
by mhitza 20 days ago
For a claim such as state of the art, or claims such as "great at any task" needs something of more substance. I've seen maze-solving robot competitions which can zoom around in seconds. The sped up video in the first part, and the "obstacle avoidance" are too slow for me to believe this is state of the art.

While impressive at 8B, what would the expectation be in real life, that it's run remotely or autonomously with a strapped on GPU and battery?
2 comments
YeGoblynQueenne 19 days ago
The claim is very specifically that it's SOTA on the R2R-CE benchmark, which is a bunch of 3D environments in a simulation. So, yes, it's SOTA; no, it's not very different than a maze. And it's sure not anywhere near anything that could be considered SOTA in the real world... if such a SOTA was even possible to define objectively.

(it's not because evaluation in the real world is very, very tricky).

link
nancyminusone 20 days ago
it is state of the art, those maze solving things are a different art.
link
mhitza 20 days ago
I've used that example as a contrast of what I've seen before. If you can point me at comparable efforts, in the same category as what Mistral is doing, I'd be interested in having a comparative look.

All I can think of are robot dogs, Tesla bots, and whatever flavor of the month Japanese robots show up at trade shows.

link