[giucal]

Sorry, I'm not sure I've understood your question.

Do you mean encrypting the same way we encrypt using public key?

If so:

No, because as far as I can tell, when you "encrypt" a message with your public key you are in fact encrypting a random symmetric key which has been used in turn to encrypt the message. (Both ciphertexts must be sent to the recipient.)

As you may infer, if we use the same mechanism but encrypt using the private key, we just cannot ensure the authenticity of the message.

Edit: corrected typos.