[ThorsBane]

Any recommended starting points for LORA training llama 30B on a specific niche? Books, tutorials, videos are all appreciated. Thanks for your time!

[f_devd]

Currently SOTA for specialization of LLMs is QLoRA: https://github.com/artidoro/qlora

[ThorsBane]

Thank you very much my friend. Be blessed in all that you do. <3