[ianand]

Google Sheets does struggle past a certain size.

For Spreadsheets-are-all-you-need (GPT2 Small implemented in Spreadsheet, ~1.25GB Excel file, 124M parameters), I have only been able to get the complete model working in Excel.

In Google Sheets, I've only been able to get it to implement a single layer out of the 12 in the model. And there's no way it can handle the embedding matrix. And it randomly quit during tokenization.

That being said, I am a fan of both Excel and Google Sheets. In Google Sheets the formulas are easier to read, and for teaching my class, it's great because students and I can be in the same sheet at the same time during a lesson.

I also tried LibreOffice briefly. While it could open the Excel file, it was unable to save it (it crashed during the save process).

[deafpolygon]

In my case, it doesn't crash. But there tends to be visual formatting issues.