It might be possible to build a set theory and the rest of mathematics based on the integers, but I am sure the result wouldn't look simple.