[sandfox]

Writing code/recipes/etc for chef/ansible/puppet is no different to writing code for an application. Just because you think you have dictated (in code) that things should be a certain way does not mean that what will be executed or run.

[falcolas]

The exact same caveats could be applied to unit testing an environment. Common sense and practical tests rule any form of automation.