I'd recommend looking up the existence of a book called Arbitrary Lines, and another called The Color of Law. If you read just the synopsis of each of those, I think you'll see that there are sources out there you're not aware of right now that offer perspectives that are well researched and scholarly and may have strong answers to what you believe.