Is this for publishing to the chrome app store? If it is, I recommend taking down the extension and republishing with a new secure key ASAP.
You will need to generate a new key and resign with the new one.