[mike_hearn]

I've thought of that but it wouldn't be easier.

1. Running modern models requires a whole rack of extremely loud equipment that can easily consume 130kw. That's not a load you can or should run at home.

2. It would require a very strong end-to-end implementation of confidential computing to keep the prompts encrypted. If there is any flaw in that infrastructure at all, like someone discovers a way to physically tamper with the hardware to read the GPU memory, then the entire network is a writeoff and would have to be replaced. That's a massive risk. Confidential computing can work in cases where hardware replacements aren't an issue or where the vendor has a long history of successfully defending the platform. But Nvidia is the only GPU vendor with these capabilities and their CC is untrusted.

Putting the workloads in space means noise and data privacy aren't an issue, assuming you trust SpaceX to not peek at your prompts on their way to the cluster.

[mike_hearn]

Sorry, by "their CC is untrusted" I meant it's not clear how much it's been attacked in the wild, not that there's consensus it's bad or anything.