[i_have_an_idea]

Just because it is performing rather poorly by comparison, it doesn’t mean it isn’t benchmaxxed. It can still be worse than it appears.

[wasabi991011]

It isn't benchmaxxed because they are using human preference as an evaluation.