Hacker News new | ask | show | jobs
by randomNumber7 349 days ago
A lot of companies and research institutes in the EU would like to be able to use a locally hosted LLM for their employees so they don't have to worry what data they give away.

Also it is not rational for any individual to buy the hardware for running a serious LLM and then let it idle 99.9% of the day.
1 comments
johnisgood 349 days ago
Why would not these companies or research institutes in the EU not be able to run locally hosted LLMs for their employees though?
link
randomNumber7 349 days ago
What model do you propose that is close enough to chatgpt or Claude so people will actually use it for their work?
link
johnisgood 349 days ago
I am not up to date with the models, but I have heard good stories about a couple of open source models. You should ask Simon Willis. I hope he will be summoned (@simonw).
link
randomNumber7 349 days ago
It was my point that currently the best open weight models are from China, so not usable in the EU.

But of course the world changes so rapidly that what is now is irrelevant tomorrow.

link