Hacker News new | ask | show | jobs
by code_biologist 980 days ago
Jeremy Howard talks about it in his recent video "A Hackers' Guide to Language Models": https://youtu.be/jkrNMKz9pWU?t=4808

That link goes directly to the timestamp where he discusses fine tuning, but the whole talk is great. Punchline, check out Axolotl: https://github.com/OpenAccess-AI-Collective/axolotl

1 comments

This is a walkthrough based on that talk for fine-tuning with axolotl https://dzlab.github.io/dltips/en/pytorch/llama-2-finetuning...