[a_t48]

A float16 is 2 bytes. 7B * 2 bytes = 14GB. I can't say if that's an accurate number, but that's almost certainly how tonii141 calculated it.

[sfphoton]

Oh, so FP16 means FloatingPoint16? I'm glad to learn something today, thanks!