[rck]

I think the problem isn't with the published paper - it looks like they used a trained human interviewer and recorded both humans to evaluate their descriptors. The real problem is with the PR video, which looks really impressive, but seriously oversells the capabilities of the system. Not that the problem is unique to this situation - I think a lot of the videos in AI oversell the research. It's a pity, because the research is usually very good, but by itself isn't "exciting enough for general consumption," so they add bells and whistles that have nothing to do with the science.

[a_bonobo]

You're right, posting the paper and not that blog-post would have led to a much more interesting discussion.

One of the strangest things in that SimSensei is the automated interviewer - when I talk to a recorded voice instead of a real person, I behave enormously different! Why should I fidget around in answering when no-one really listens anyway? Why should I give proper answers? Why should I exhibit signs of shame when I talk to no-one about myself?

This doesn't work like described in the paper.