[imhoguy]

Check this as an introduction: https://en.m.wikipedia.org/wiki/Safety-critical_system

In general I think the direction is to cover any software development with formal proofs to detect any posibility of unexpected system state.