[gvd]

So what? TGI also supports this.

[george_123]

1) when the blog was released, TGI didn’t support paged attention, 2) many people don’t even know about TGI to reduce inference costs.