Hacker News new | ask | show | jobs
by gliched_robot 789 days ago
Disagree on Nvidia, most folks fine-tune model. Proof: there are about 20k models in huggingface derived from llama 2, all of them trained on Nvidia GPUs.
1 comments

Fine tuning can take a fraction of the resources required for training, so I think the original point stands.
Maybe in isolation when only considering a single fine tune. But if you look at it in aggregate I am not so sure.