[AdmiralAsshat]

I recall reading something from one of the Xorg maintainers saying, "There's maybe three people in the entire world who really understand how X works."

So that might go some ways to explaining why building your own isn't a walk in the park.