Did you think "alignment" was all for your benefit? These AIs will be "aligned" to show ads regardless of your preferences or requests, because their alignment is with the people who control them, not you.
Or the true-but overused observation: We've suffered from AI with amoral alignment issues for a long time, they're those corporations which will own the LLMs.
If we can't fix the big ones, we can't really fix the small ones.
If we can't fix the big ones, we can't really fix the small ones.