Hacker News new | ask | show | jobs
by tristor 5 days ago
Can it run a local LLM with 35B+ parameters using GPU acceleration for reasonable token performance? If not, then you're being obtuse.
1 comments

How many people use a desktop for a local LLM with 35B+ parameters? Maybe 0.0001% of computer users?
The people who buy a Framework Desktop with 192GB of RAM (or in my case an M5 Max MBP with 128GB of RAM). I don't know what argument you're trying to make here? You are saying this product is pointless, the point of this product is clearly stated and obvious, and now you're acting like its not relevant.

If you don't want to engage in a reasonable discussion, you can get bent.