[imtringued]

Most important? The idea that not every token needs the full context window should be an obvious optimization.

[whimsicalism]

that’s not the idea here