Maybe it’s just my bubble, but even my friends who don’t work in tech dislike amp pages for pretty much the same reason as those who work in tech. That being that greater than half the time when we click a link we didn’t want the AMP site, we wanted the actual website. The “less bloat” often times means less functional website.
It might come down to most people I know having high quality internet connections though, such that the load times aren’t as big a concern.