[bawolff]

This is very not true.

Only RSA is built around factoring. I suppose if you consider discrete log to also be factoring related, some other public key & key agreement algs are also.

Hash functions and symmetric algorithms are not based around factoring.