Hacker News new | ask | show | jobs
by Larrikin 26 days ago
Looking at 5 tok/s after reading this comment made me think about why it felt slow and would be unacceptable for work. If you didn't plan or even sometimes despite planning, you have absolutely no idea if it is suddenly going to go off the rails in a wrong direction. Everyday, I'll look at the thinking and it seems pretty good until suddenly I have to slam the esc key because it decided to pursue a completely wrong direction. Much faster is better for skimming to make sure you don't have to throw everything away.
1 comments

and if it goes fast enough, it can fail and you can prompt again before you need to worry about if it's going in the wrong direction. or, it will try multiple directions!