[andai]

> The firm described how the AI worked at superhuman speed but also made strange decisions and mistakes that no human hacker would have made.

It seems to have been running on some kind of high speed inference hardware. I remember OpenAI announced the next release would have a high speed inference option.

I had a similar experience when I was testing some models on Cerebras a while back. It's really quite an incredible thing to experience. Burns money like crazy though. And you don't know what the heck it's doing because it moves way faster than you can read. So you got to pray you aimed it right, and that it didn't go off the rails.

I would definitely love to have high speed inference for smaller bite-sized tasks though. Changing a 10-second task into one second task changes the whole nature of the experience back from asynchronous to real-time/interactive.