I have a habit now of getting that out of the way first just so I don't have to think about it. Get a basic functioning prototype and then figure out my infra and deployment as early as possible.
Depending on my projects, I tend to keep it pretty simple.
For personal projects, usually Firebase (+ occasional Cloud Run mixed in) which makes it relatively easy.
For professional projects, it's pretty easy now on AWS with their (unfortunately named) Copilot CLI [0] (highly, highly recommended).
But mostly, I keep my infra simple and bias towards modular monoliths [1] which ends up being the majority of my infra work (container packaging and deployment of the initial runtime infra).