[trentdotexe]

You're right! You should probably use Trail of Bits Fickling tool to investigate. https://github.com/trailofbits/fickling

[TaylorAlexander]

Thanks for the tip. I tried this on the 7B parameter model and got an error.

$ fickling --check-safety consolidated.00.pth

  File "/usr/lib/python3.10/pickletools.py", line 359, in read_stringnl
    data = codecs.escape_decode(data)[0].decode("ascii")

UnicodeDecodeError: 'ascii' codec can't decode byte 0x80 in position 63: ordinal not in range(128)