Hacker News new | ask | show | jobs
by bloaf 17 days ago
I don't think this is entirely true, insofar as non-local models inherently have a "man cannot serve two masters" problem. The end user and the org running the AI may have different goals. That means even if AI alignment were to be in some sense "solved" for local models, you wouldn't be guaranteed an aligned AI using a non-local model because the "owners" of the non-local model may have deliberately misaligned the AI in their favor and against your interests.
1 comments

Think of AWS. If you break their ToS and host a pirate website there it will work despite being misaligned from AWS. You are that sole master of the software. AWS is the sole master of the "hardware." Now ultimately hardware has control over the software so technically AWS could just hack into whatever code you are running and do what they want, but in practice they act solely as the master of the hardware and will tell the hardware to "shut down" if they catch you acting out of their alignment.

With local models just because you are providing the compute, that doesn't mean you are the master of the model and it is aligned to your interests. You could just be subsidizing inference for a model aligned to someone else.