[onlyrealcuzzo]

I will add that it seems:

1. The context window size to output accuracy problem seems like a genuinely hard problem

2. The vast majority of resources are being poured into driving down costs, not increasing output accuracy (and definitely not on gigantic context windows)

I will also add:

* I'm astounded at how terrible LLMs are at writing assembly in my experience. This seems like something they should excel at. So I'm genuinely confused on that piece.

[jasondigitized]

How much Assembly is posted in public repos?

[onlyrealcuzzo]

I can't imagine less than millions of lines...