Hacker News new | ask | show | jobs
by GolDDranks 623 days ago
> Now, your run-of-the-mill LLM can breeze through the turing test.

Can they? You can ask arbitrary questions in the Turing test. I doubt many models would be able successfully imitate humans in such adversarial conditions. Note that the Turing test doesn't require to judge to be unsophisticated or unknowledgeable about AI's capabilities or weaknesses. I believe that AI's are closer than ever passing the Turing test, but I'm sceptical until I see it.
1 comments
stavros 623 days ago
What kind of questions would you ask to distinguish?
link
DoctorOetker 623 days ago
For me the simplest way to test would be to first ask specific knowledge, and then ask where it learnt that knowledge, and check the reference. Currently they fail spectacularly, and the most useful next step would be to use source-aware training
link
stavros 623 days ago
Why would I know where I learned a thing, much less be expected to produce a valid URL off the top of my head?
link
DoctorOetker 615 days ago
I am not trying to explain your specific brain. Next time people play the game werewolf in real life, join it for a couple of rounds, and tell the players you're not too familiar with the game, and ask them to discuss mistakes after each round. You will notice they pay a lot of attention to who said what. If you don't pay attention you become like a villager lynching random people, while if the villagers play enough attention they can prevent the wherewolf from killing the whole village most of the time.
link
stavros 615 days ago
Where did you learn that the capital of Virginia is Richmond?
link