Assuming you're on Android, you should be able to get the behavior you want by turning on data saver. That specifically disables background downloads, and also pauses app updates etc.
You can do similar things on iPhone--which I did after 1GB of music synced one night when in Europe. But I mostly want data to transfer over mobile when not on WiFi at home. It's just easy to forget to change the various setting when traveling.