[sorokod]

I get different answers every time to "what is the third element in the periodic table" from llama2.

I'll hold off actually using them for now.

[cubefox]

That model is not state of the art. Even GPT-3.5 can answer this question.

[sorokod]

On GPT 3.5

Q: "What is the seventy fourth element of the periodic table?"

A: "The seventy-fourth element of the periodic table is Rhenium..."

But this is really shooting fish in a barrel. Given the way LLMs work why would you expect them to provide factually correct text completion?

[geoduck14]

Llama2, when fine-tuned, can be better than GPT3.5

Source: a trusted coworker