Hacker News new | ask | show | jobs
by dwaltrip 67 days ago
LLMs have been trained to eagerly answer a user’s query.

They don’t reliably have the judgment to pause and proceed carefully if a delicate topic comes up. Hence these bandaids in the system prompt.