Hacker News new | ask | show | jobs
by anon373839 692 days ago
Small models can be fine-tuned to perform specific tasks with similar accuracy to large models. Small models can be served for internal use with a VERY modest hardware outlay.

There are also providers now that will let you upload low-rank adapters you have trained in top of open foundational models, so that you can use their efficient serverless infrastructure with your fine-tuned models. This requires even less capital.

None of this would exist had OpenAI’s vision of centralized, locked-down API access become the reality.