[roman-kashitsyn]

Those are good points; thanks for raising them!

> Not for writing. But you'll have fun reading this file.

Regular file reads aren’t much more complicated; they require only one extra call to stat and a few extra file seeks.

> Read the file from STDIN or from a socket, where you only get one pass over the data without buffering.

That would be a problem for files you want to keep in memory. My assumption with tensor files is that they are so large that you will always save them to disk before using them. That’s how HuggingFace tooling works anyway.

> Read the file, but the file is truncated by one byte (i.e. the last byte is missing).

That might be an argument for using the floating header! However, I don’t expect it to be a real issue with tensor files specifically. If they aren’t intact, they aren’t useable, and you should throw them away. Error correction should be one level higher.