Hacker News new | ask | show | jobs
by david_shi 36 days ago
> I believe eval startups can work when they're targeting safety benchmarks specifically.

Are there any examples of successful startups doing this?

1 comments

In addition to naming one, I'd also be interesting in whether they actually do rigorous work.

The safety research that tends to get headlines is often extremely misleading, usually with directed prompting, or unreported additions to the system prompt specifying model roleplay behavior.