[JambalayaJimbo]

Your example actually demonstrates why anthropomorphism is a bad idea.

LLMs are vulnerable to classes of attacks that humans just aren’t. In your framework, the way to prevent attacks is to… invent human consciousness?? It’s an impossible goal.

[TeMPOraL]

What invent human consciousness?

> LLMs are vulnerable to classes of attacks that humans just aren’t

Name three that don't have direct analogues with humans.

[EvanAnderson]

> LLMs are vulnerable to classes of attacks that humans just aren’t.

Assume a human with complete credulity and gullibility. That's a human whose behaviour would be reasonably analogous to how an LLM processes input. The mitigation would be generalized intelligence and "common sense".

FWIW I also think anthropomorphizing LLMs is a bad idea. I think we can analogize their processing to human behavior without anthropomorphizing them.