Why not support an interface on something that's not a phone too? It doesn't sound like supporting a web SPA would be stretching their core competence.
They have an emergency-access version at http://web.monzo.com but they're a mobile app bank.. not really much more than that to say, website wanters aren't the market they're serving
What's the big difference between website wanters and app wanters? Don't most people want to sit down on a chair at a keyboard and large screen if possible?
The UI of the monzo app is actually pretty good on a small screen. I've never felt I need to use a desktop to view it (same for the "traditional bank" app I use too to be honest - going desktop doesn't really add anything since its just a table of numbers really).
The reality is that you never really use the app anyway apart from very occasionally. The "UI" for this bank account is the card itself.