What for do you need a framework? For buttons? For the grid? You most likely have to adjust them anyways, so why not make a clean approach without the bloat (in a sense of coding style [I'm very much into BEM]) of a framework?
yeah, mostly for the design part and CSS quirks among browsers. I do want to start with just sass and flexbox only though, but don't know how much hassle it will be.
Thanks for mentioning BEM, do you use it with sass?
For vast majority of websites, no need to use framework. Work from scratch. No resets, no normalizing, nothing. Add in components as you go. Keep it light and bug free this way. Frameworks are unnecessary for most projects.
Unless you aren't into herding cats when every developer develops a brand new button / grid / whatever ever time the is a new addition to the site because they can't understand or find the original NIH element styles. If you happen to be lucky enough to be the only person ever working on the project then I would agree.