[phkahler]

Fermat did several proofs by infinite descent without bringing set theory into it ;-)

[henrydark]

Actually he did use set theory, but there wasn't enough space in the margins

[bombcar]

There's a large body of math that can be proved simply, or proved complexly using set theory ;)