The US has a lot of people in prison for non-violent offences. It even has a huge number of people in pre-trial detention, where other countries have better bail systems and things like electronic tagging to allow people to stay out of jail before they are convicted.
I think you’d find a lot of support for the idea that we should have fewer people total in jail (i.e. funneling drug users into medical care, use community service for non-violent property crimes, etc.) but more white collar criminals going to jail.
As a simple example, I’ve heard a lot of people of all ages comment that the bankers would repeat the kinds of crimes they committed during the mortgage bubble because they made more profits than they were fined. Jail time is far more plausibly a deterrent in those cases.