[vagab0nd]

I thought we've long passed the Turing test, until I tried to implement a chat bot.

It's not even close.

It's easy to "pass the Turing test" for 5 minutes. It's extremely hard if you try to hold a longer, continuous conversation. Anything longer than 10 minutes the user will immediately know it's not human. Some problems you'll encounter:

- The bot needs to handle all situations, especially the nonsensical ones. This is when the user types "EEEEEEEEEEEEE...", or curse words, repeatedly.

- Who would've thought that it's extremely hard to decide when to stop talking?

- No matter how well you build the "persona" for the bot, they'll eventually converge to the same one, which is that of the llm itself.

- You'll notice that the bot is ignoring something obvious (e.g. it's not remembering past convo), and then give it some instructions to help with that. And then that'll be THE ONLY THING it does.

[intrasight]

I don't know why any sane human would think we've come anywhere close to passing the Turing test.

A human that can't tell a machine from a person has issues.