[scottmsul]

There was a point in time where everything in the visible universe was the size of a potato, but the entire universe (beyond the visible edge) is most likely just more matter in every direction indefinitely.

Because the universe follows general relativity, space itself behaves like a fluid. When the universe "expands", that's just space itself growing bigger over time.