Hacker News new | ask | show | jobs
by zackangelo 13 days ago
I don't believe safetensors has a native int4 dtype, so they packed 4 int4s into a bf16 in this checkpoint.