Yes, but it would have to be done on every system that I use to access my server. Also, not all systems use the standard openssh unix client, or they may not allow access to the user configuration files. So changing the port is just an annoyance, and it doesn't really accomplish anything. My real account is safe, and having a few failed login attempts for admin and root in my log file doesn't really bother me.
I am not advising against changing the port; it just has no value for me as I currently use SSH.
I am not advising against changing the port; it just has no value for me as I currently use SSH.