These attacks are getting more and more creative. I begin to think that there is no such thing as perfect security in a world that constantly demands new features.
Right. To be more precise, security is a set of costs on web developers, web viewers, and attackers. There is no obviously correct way to balance all three, once you start seeing feasible removed/missing features that would be genuinely useful tallied as costs.
Google "Users want and demand a rich computing experience." Back in the 90's a Microsoft person made that claim on comp.risks. It kind of became a joke to call every new attack a "rich computing experience."
If we're only talking about exploiting a device across a network, sure turn it off or disconnect it from the network. But there's more to security than that.
One can always take the device and turn it on for oneself.
If one can't exploit the device, one can resort to rubber-hose cryptanalysis.
You're right that there's a constant tension between features and security.