Y
Hacker News
new
|
ask
|
show
|
jobs
by
tjungblut
119 days ago
I wonder if we can do a prompt injection from the comments
2 comments
7moritz7
119 days ago
These are sota models, not open source 7b parameter ones. They've put lots of effort into preventing prompt injections during the agentic reinforcement learning
link
verdverm
119 days ago
not basic negatives one's so far, it already noticed those, you can see it in various "thoughts as posts"
I gave it points to reflect on and told it to apologize, which it has since done
link