[mayniac]

I couldn't think of anything more horrible than running Windows without a GUI. Why not use Linux at that point?

[wcoenen]

It's the same concept. For linux you'd use SSH which gets you to a shell for remote administration, for Windows you use powershell via the Enter-PSSession command.