Y
Hacker News
new
|
ask
|
show
|
jobs
by
am17an
172 days ago
Use llama.cpp? I get 250 toks/sec on gpt-oss using a 4090, not sure about the mac speeds