If it's simple, yeah. A redux-type store does not have to be complicated. there are certainly performance optimizations to using redux versus rolling your own, but that would only happen in very large applications.
I agree that you can roll your own store. You'll miss lot of free functionality and the dev tools, but maybe it's not stuff you need.
I also agree that introducing a dependency at every opportunity comes with serious drawbacks.
Every situation is unique of course. In my case:
At work, I value code that is more standardised so that I get less bugs, documentation / best patterns and crucially easier on-boarding process.
For a personal project, I would definitely consider rolling out my own implementation, even just for the learning it comes with.