Visit Newcastle, Liverpool or Glasgow and I think a lot of people basing their English comprehension on the ‘BBC’ accent will not have an easy time, I agree.
True, I am fairly fluent in English, but when I moved to Liverpool I was lost and even ordering some basic stuff was often challenge. Even now when I get back I need some time to get used to their accent.