Some auth providers like Auth0 have support for it: https://auth0.com/docs/get-started/applications/dynamic-clie....
There are some caveats and security concerns when using DCR, so you should research more into that. Another option may be CIMD (https://www.ietf.org/archive/id/draft-parecki-oauth-client-i...) though I'm not totally familiar with it.
What you also mentioned, like using proxys, or wildcards, is also widely used, at least for what I've seen.