[relbeek2]

Testing is a big part of our CI/CD pipeline, if we are making changes we should definitely see a diff in some functions.

I would expect to have a build fail on unintended changes like we do with snapshots. How exactly do you indicate intended changes in Touca?

[pejman_gh]

Unless a special command-line flag is provided, the test runners return a success exit status. Since we don't know whether potential differences are intended, we don't want to fail the CI by default. When differences in a given version are expected, you can promote that version as the new baseline through the web interface. This way, the test results for all subsequent versions will automatically be compared against the new version.