You would need to lug the device with you everywhere because BankID is used for all sort of things in Sweden. I couldn't even use a vending machine here without the BankID app.
Ah, thank you for the clarification! Does not really work in all countries, e.g. here it is quite common at events to pay through a QR code and you need your banking app to do so.