[LukeShu]

Not just about it only completing or failing, but another observer in the system should never be able to find it in the half-way state. To everyone but the implementer of the atomic operation, it has no half-way states.

[lomnakkus]

In the database terminology that's usually called "Isolation" to keep the concept separate from the rather restricted definition of atomicity.