[Tepix]

So, they are taking the Llama model released by Meta, doing a little fine-tuning and then re-releasing the resulting model under a different license?

That seems very sketchy. The Meta license grants a "non-exclusive, worldwide, non-transferable, non-sublicensable, revocable, royalty free and limited license under Meta’s copyright interests to reproduce, distribute, and create derivative works of the Software solely for your non-commercial research purposes."

A better way would be to redistribute xdelta3 files so people with access to the LLaMA model weights can use them to arrive at the fine-tuned model weights. Or is there perhaps a better tool than xdelta3 specifically for LLMs?

[GaggiX]

They only released the LoRA.

[Tepix]

Oh, you're absolutely right. I must have looked at the wrong folder or something. Never mind then!

[jimsimmons]

HF wants to undercut OpenAI anyway possible.

My cynical take is that HF gives as much damn as OpenAI about open source. It's just whatever gets you ahead of your peers.

Right now OpenAI has a massive advantage with GPT4 and their RLHF stack. HF and maybe even Meta want to claw their way back via crowdsourcing

[refulgentis]

This has ~0 to do with Hugging Face, Hugging Face is Github for ML models