[the_gipsy]

With AIs, it seems like there never is a comparison that is useful.

[theptip]

You can build evals. Look at Harbor or Inspect. It’s just more work than most are interested in doing right now.

[jascha_eng]

yup its all vibes. And anthropic is winning on those in my book still