IE 10 and 11 are supported with browser prefixes, so you're only losing out on 8 and 9, which constitute ~2 of all internet traffic. Some non-trivial percentage of IE 8 and 9 users have them installed only for specific websites and internal corporate sites.
There just can't be that many people browsing the web with IE 8 and 9. Additionally, we need to draw the line somewhere, especially given how much easier flexbox makes front-end styling.
IE 8, IE 9 and IE 10 are still more widely used than Win10 with its Edge browser.
Don't use flexbox for your start page, especially if you want to do business (SaaS). It will be completely broken in IE8/9 and look like shit. Corporate managers will close your website instantly.
1. http://caniuse.com/#feat=flexbox