> What's the point of having different ssh key per server?
Identity protection perhaps. A public key could reveal that the same person is accesing two or more servers. Different keys per server hide that information.
That's a good point. Moreover, someone built[1] an SSH server that prints your name when you connect (because GitHub publishes SSH public keys of every user):