The aspiration is to represent structure in the most elemental form. Some definitions of the word "primitive" refer to a time before words existed. Shapes, motion, and relative positioning are the modes of communicating ideas and knowledge.
Also as mentioned in another comment, primitive types in programming languages lend themselves nicely to visual representation.