[ralusek]

I didn't know people could just have GPT running on their own hardware. How does one...do that? Do you have a special relationship with OpenAI and they lock down your servers or something?

[stavros]

I think they meant they just ran a different context per invocation, not that they hosted the model themselves.

[jibal]

Why in the world is the OP's answer dead? Sometimes I really don't understand HN.

[stavros]

It's automatic, I vouched for it but it didn't budge.

[colin7snyder]

apologies, bad wording/explanation. As addressed in another comment: "Poor wording on my end, thanks for flagging. I pull the OAuth refresh token from each Codex account into a custom broker, which mints short-lived access tokens per request and load-balances across the pool."