Moreover, if you regularly use GPG, the GMail web interface would be nearly unusable, no? So it seems you'd be much better off with nearly any other email provider.
Most GPG messages I get are signed, not encrypted, and I usually don't need to check the signature. So the web client is fine, but it's still good to have desktop client access.