OP here; I gained ~30 points on my PageSpeed score by switching my blog from WordPress to Gatsby.js + Netlify. Really happy I finally did the conversion. It was easier than I thought! I've lost a lot of CMS and SEO features from WordPress, but so far I don't miss any of them.