My grandpa built his home and it was a nightmare. Contractors kept going cheap, he had to watch over them, cost overruns, delays, etc. He probably has a better home than one could ever buy, but I don't have that kind of time or money.
When people say "buy a home", the majority of people are far more concerned with affording the land underneath (or share of a condo building) than the structure itself.