|
|
|
|
|
|
by ben_w
14 days ago
|
|
|
> If you think that running your local “artisanal” LLM for software development will be able to compete with the massive data centers that are lining the pockets of small-town politicians all over the world, convince me. I cannot currently afford enough RAM to run a ~3 trillion parameter model like Kimi K3. However, I do expect for the current trend for more expensive RAM will reverse and return back to the long-term trend of it being really cheap. Five years from now, I expect today's SOTA will probably be totally affordable to run locally (this is of course a terrible future to anyone who has recently invested in data centres). |
|
|