[thebladerunner]

This is another variation of the Turing test. Time to realize: the Turing test is useless because: (a)the goal is to game the jury and (b) humans don't necessarily make sense either (example: bad or even just confusing poetry) so the human baseline is not always well-defined. Need Turing Test 2.0

[thaumasiotes]

I found a website once advertising "have a conversation with me or my chatbot, and try to guess who it is".

My counterparty quickly made some bizarre grammatical errors, prompting me to guess "chatbot" and be rewarded with a screen saying "No, you fool! See, telling the difference is harder than you think!"

Telling the difference between a robot and a human pretending to be that robot is apparently viewed as a Turing test, but it isn't actually the same thing.

Similarly, there's a Turing test that's run every year with very strict rules on what you can and can't say to the other side. This defeats the idea of the test (while making the event less nonsensical, in that the rules allow for people to misidentify chatbots some of the time).

I guess my point is, your point (a) is an artifact of a certain culture that's trying to appropriate the concept of a Turing test so that they can declare they've beaten it. Point (b) is better.

[p1esk]

Turing Test is a personal experience. For example, I will only believe TT has been passed if I personally had a chance to talk to the "Entity Under Test", and I can't tell it's human or not. I don't really care whether other people have been fooled or not.

Obviously, the EUT should be, or pretend to be, my intellectual peer (e.g. similar education, age, social status, country, etc). It should be a native English speaker, or at least as fluent as I am. I should be able to converse with EUT for as long as I need to (several conversations if needed, perhaps limited to a couple of weeks).

Most importantly, the human participants should be motivated to convince me they are human (e.g. they only get paid if they manage to do so).

[taneq]

A Turing test is meant to be both the AI and the human trying to convince the tester that they're human. To do it properly your human testee should be a third party not related to the AI developer, and should be independently motivated to 'win' by convincing the tester that they're the human.

Having the human pretend to be a chatbot is just disingenuous.