Let lines A and B be non-parallel. They must intersect, because parallel lines do not intersect, by definition). Orthogonal lines are not parallel, but they must lie in the same plane (by definition of orthogonal). Therefore orthogonal lines must cross at exactly one point.
Also, orthogonal lines share a common point of intersection.