|
|
|
|
|
|
by IanCal
15 days ago
|
|
|
This is really interesting. While I know others have posted about fixes I think it’s a very useful thing to see regardless about how well they can follow initial directions and understand what should happen. I think you could create an interesting benchmark for this, you could likely have models trying to to derail it and another scoring. Detecting when it’s happened shouldn’t be too complex for a model. I understand why LLMs do this, but ideally they wouldn’t. |
|
|