Hacker News new | ask | show | jobs
by LoganDark 18 days ago
I'd be all for homomorphic encryption on inference, but as you say, this is probably mostly to prevent end users from observing intermediate results.
1 comments

Homomorphic encryption for LLMs is extremely expensive and nowhere near computationally possible for the scale of current LLMs.
When I say things like that, I'm talking about a hypothetical version that would be computationally possible. I'm not talking about today's homomorphic encryption.