This works:
"ssh -oPKCS11Provider=/path/to/opensc-pkcs11.so user@host.com"
Or you place that in your ~/.ssh/config
Host *
PKCS11Provider /path/to/opensc-pkcs11.so