[furyofantares]

It certainly doesn't produce content as fast as I can read it.

[renonce]

Only if you use gpt-4. gpt-3.5-turbo is much faster, and gpt-4 is only going to get faster as GPUs get faster.

[furyofantares]

Yep. I use GPT-4 extensively and exclusively, and the comment I was replying to mentioned GPT-4. I can't wait for it to get faster.

[cubefox]

Bing also uses GPT-4 and it is very fast. Microsoft spends more ok compute.

[furyofantares]

It doesn't exclusively use GPT-4, you might be right anyway that their GPT-4 is much faster but you're also not always seeing GPT-4 with them.

[cubefox]

I'm pretty sure it at least mostly uses GPT-4.

[darknoon]

afaict OpenAI's instance is massively overloaded, you can see with the 32k context model actually being faster in practice rather than slower