[blackeyeblitzar]

That is just the inference code. Not training code or evaluation code or whatever pre/post processing they do.

[patrickaljord]

Is there an LLM with actual open source training code and dataset? Besides BLOOM https://huggingface.co/bigscience/bloom

[navinsylvester]

Here you go - https://github.com/apple/corenet

[osanseviero]

Yes, there are a few dozen full open source models (license, code, data, models)

[blackeyeblitzar]

What are some of the other ones? I am aware mainly of OLMo (https://blog.allenai.org/olmo-open-language-model-87ccfc95f5...)