Hacker News new | ask | show | jobs
by PlantsRpeople2 1151 days ago
Is it possible to add to an LLM without re-training it, my understanding was no.
1 comments

The original “pre-training” Is what’s expensive. The “fine-tuning” (also training that it modifies network weights) for instruction following or other tasks costs the thousand dollar range.