You’re not wrong about the name Byzantium but you are dead wrong about East/West being a later invention. The Romans themselves split it along these lines and even had an emperor for each half before Constantine.
The point you could be missing is that while there was an administrative split, the folks living in the East still considered themselves Roman citizens. Which they were, in law.
Having multiple emperors was perfectly acceptable though, if not entirely practical most of the time.