Hacker News new | ask | show | jobs
by alpaca128 1150 days ago
Not everyone wants to depend on and trust a cloud service, and not everyone needs GPT-4 quality.

If there's a viable way to tune and run models locally they could still be useful if you don't need it to play chess and imitate a Python interpreter at the same time.

1 comments

Is it possible to add to an LLM without re-training it, my understanding was no.
The original “pre-training” Is what’s expensive. The “fine-tuning” (also training that it modifies network weights) for instruction following or other tasks costs the thousand dollar range.