[ple13]

It fails other benchmarks vs Mistral-7b. https://twitter.com/Teknium1/status/1726846755344634020

(There is some doubts about the validity of the comparaison in the comments)

[eurekin]

Also, worth mentioning the next tweet:

  Update, I benchmarked 13b Orca 2, its still not surpassing gpt4all score of

  Base Mistral or OpenHermes 2.5 7B:

  Hermes 2.5 7B Mistral score: 73.12%

  Mistral Base 7B score: 71.16%

  Orca 13B GPT4All score: 70.58%

https://twitter.com/Teknium1/status/1726833004117635414