Hacker News new | ask | show | jobs
by danielhanchen 58 days ago
Haha :) We had some issues with Kimi-2.6 since it was int4 and we were investigating how to handle it :)
1 comments
verdverm 58 days ago
Appreciate what y'all do! We were slacking about how many HGX-B300 it would take to run Kimi and it looks like we could actually fit 2-3 Kimis on a single HGX.
link
danielhanchen 51 days ago
Sorry on the delay - oh haha that would be cool :) We did release 2bit dynamic ones, but unsure if they'll be helpful
link