[kristianp]

Note that Kimi K2x is natively 4 bit int, which reduces the memory requirements somewhat.

[kristianp]

Here's the citation for that, I think its not in the Technical Report. https://huggingface.co/moonshotai/Kimi-K2.5#4-native-int4-qu...