I run my own resolver on my home network and I never notice anything. When loading a webpage or doing pretty much anything else online the DNS delay is negligible. And if the answer is already cached in my house it's definitely faster than having to leave my home network to get a response.
The point is that if the TTL is 10mins and you lookup the domain after it expires the regular DNS will go and fetch it, unbound fetches it as soon as it expires and it is already cached
My nameserver, 8.8.8.8, and 1.1.1.1 are all about 25ms away from me. Mine is actually a few ms closer, but that will vary.
Bigger nameservers will have warmer caches, so first lookup might be a bit slower on my nameserver.
I presume the big nameservers are managed well under capacity, so load should not be significant.
All told, I cannot perceive any performance difference at all.