This has to be done in each repository you have checked out locally, but maybe it is possible to also have this done globally. But I never tried to do it.
You can add to the set of refs that git pulls (via remote.origin.refs); so for me it's `git checkout pr/123/head` (or /merge) instead, without creating a local branch that you need to delete later.