in theory with a mastery of speech recognization one would assume you could then apply that to any diction that has an accompanying ASL translator to derive ASL elements from the contexts given by the spoken word.
in practice that's all difficult, if at all possible -- but just sayin; we have decently good speech interpretation at this point, perhaps we aren't far from self-training ASL against something similar.