I started with Hugo and ended up building my own static site generator (https://github.com/julien-blanchard/Loulou).
It's been nothing but fun all along. And as you said, building something yourself really makes a huge difference.
https://blanchardjulien.com/