Hacker News new | ask | show | jobs
Show HN: a desktop app to discover, download, and run offline LLMs (lmstudio.ai)
10 points by ybu 1117 days ago
3 comments
pearlsteinj 1117 days ago
Wow, this makes running LLMs locally significantly more approachable. Very cool!
link
leeholim 1117 days ago
Agreed!
link
asselinpaul 1117 days ago
This is great! CPU only for now or can it leverage GPU for sped up inference?
link
ybu 1117 days ago
Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build
link
dtagames 1117 days ago
Looks very useful! Can't wait to try the Windows version. Thanks!
link
ybu 1114 days ago
Follow up: Windows release is out.
link
ybu 1117 days ago
hopefully soon!
link