Hacker News new | ask | show | jobs
by chrisringrose 17 hours ago
Hi! I'm one of the deltafin devs. The biggest difference is that this is not actually a 100% "pure" uncut Kimi K3. This is requantized to 3-bit residual, whereas deltafin is the full real unaltered k3, through and through.

WASTE reads about 17 GB/token versus Deltafin’s 25.8 GB/pass—roughly. That's 34% less expert traffic, and some could argue a 34% reduction in quality.

1 comments

Why quantize to int8 when k3 is int4? I could be wrong, but that’s what I remember seeing.