No harm, it's more that after a certain amount of generations the information becomes pretty irrelevant. You arbitrarily choose to follow certain lines (for prestige or historical significance) and necessarily disregard others. Going back to the 1600s, you descend in equal part from one lineage you mention and many thousand others which remain entirely unknown.