[tempay]

I assume OP interpreted it as encryption that hides the prompts from OpenAI rather than OpenAI hiding information from users.

[LoganDark]

I'd be all for homomorphic encryption on inference, but as you say, this is probably mostly to prevent end users from observing intermediate results.

[fortuitous-frog]

Homomorphic encryption for LLMs is extremely expensive and nowhere near computationally possible for the scale of current LLMs.

[LoganDark]

When I say things like that, I'm talking about a hypothetical version that would be computationally possible. I'm not talking about today's homomorphic encryption.

[minraws]

ooooooof yeah totally misinterpreted it lmao

[LoganDark]

Apple's Private Cloud Compute is E2EE between the client and the attested node. Not sure if anyone else is legitimately doing that -- Apple has definitely gone the furthest in terms of verifiably ensuring that requests and responses are not misusable by Apple.

[skeledrew]

Given what we know about the company, I find it crazy anyone would misinterpret along those lines lol.

[minraws]

I can only say I am a little too optimistic about the technology world in general. Or at least would love to see some good news once in a while given the state of the world.

[mpeg]

to be fair, the title is very misleading, it took me a minute to understand what they meant