Hacker News new | ask | show | jobs
by jvanderbot 3 days ago
This is bananas to me. Theres been successful entries to snow plow competitions for ages. What a world that people now expect networks to handhold through it. Irresistable to all parties I suppose.

Well I guess I'll have to have a look!
2 comments
martythemaniak 2 days ago
Yeah, there's commercially available snow plow robots, you can buy a Yarbo for your house today. As far as I can tell, they all operate on a classical robotics stack - for the Yarbo you install an RTK antenna to give the robot cm-level precision, define a map and a routine, then the Yarbo can execute that routine by itself.

But can it deal with arbitrary lots without extensive premapping, manage piles, handle obstacles intelligently, correct itself (ie spot needs a second clearing ), tackle windrows, etc? It can't, and my hunch is that LLMs are the first tech we have that can plausibly handle all the various cases that a proper robot would need to handle.

link
jvanderbot 2 days ago
My hunch is that some kind of planning stack with environmental awareness at a network level is a good solution to this. My hunch is that LLMs aren't really it. Maybe VLA but I'd bet lower.

Robotics probably will absorb a lot of Rl/diffusion-based tech, with LLM at a high level interface at best.

link
martythemaniak 2 days ago
Yeah, afaik the approach people take today is always some form of bi or tri level hierarchical control, with a slow LLM doing planning and sub task management and diffusion or VLA doing the motor control at higher frequencies. Major differences seem like where and how you draw the boundaries. For my project I'm personally trying to use ROS2 as a low level tool call (instead of diffusion), with an agent /LLM doing the main decisions.

Having said that, this scheme seems like it might just be a reaction to current hardware limitations. When I saw Talaas demonstrate a 8B model running on a custom chip at 17k Tok/sec, first thing I thought was "wow, you can just run an LLM in a control loop"

link
officialchicken 3 days ago
> This is bananas to me. Theres been successful entries to snow plow competitions for ages.

Why do you hate subscriptions? What if you get a summertime snow storm?

link