[throwawaaarrgh]

or you could just use the -c option to ssh-add and be prompted every time the key is handed over