Hacker News new | ask | show | jobs
by dr_dshiv 521 days ago
It effectively bans the educational use of ChatGPT and Claude because they can and do respond to the emotional expression of students. That’s what is hilarious! Do these tools actually violate the act? No one knows. It isn’t clear. Meanwhile, my university is worried enough to sit on their hands.

And this is the whole danger/challenge of the AI act. Of course it seems reasonable to forbid emotion detecting AI in the workplace — or it would 5 years ago when the ideas were discussed. But now that all major AI systems can detect emotions and infer intent (via paralinguistic features, not just a user stating their emotions) — this kind of precaution puts Europe strategically behind. It is very hard to be an AI company in Europe. The AI act does not appear to be beneficial for anyone—-except I’m sure that it will support regulatory capture by large firms.
1 comments
dartos 520 days ago
Seems like you’re reading this rather broadly. Pathologically so.

An AI textbook QA tool may be able to infer emotions, but it’s not a function of that system.

> The AI act does not appear to be beneficial for anyone

It’s an attempt to be forward thinking. Imagine a fleet of emotionally abusive AI peers or administrators meant to shame students into studying more.

Hyperbolic example, sure, but that’s what the law seems to try and prevent

link
dr_dshiv 520 days ago
Calling me pathological doesn’t really strengthen the argument.

One can certainly imagine a textbook QA tool that doesn’t infer emotions. If one were introduced to the market with the ability to do so, it would seem to run afoul of the law, regardless of whether it was marketed as such.

The fact is that any textbook QA systems based on a current frontier model CAN infer emotions.

If they were so forward thinking, why ban emotion detection and not emotional abuse?

link