Y
Hacker News
new
|
ask
|
show
|
jobs
by
mythz
133 days ago
Not feasible for Large models, it takes 2x M3 512GB Ultra's to run the full Kimi K2.5 model at a respectable 24 tok/s. Hopefully the M5 Ultra will can improve on that.