[dharmab]

Worked on a piece of software which suffered from years of this split brain. It had some logging and some metrics, but the team was told to be economical about observability. This resulted in the software having many blind spots which led to production issues that had to be manually reproduced. When I become responsible for the software I personally overhauled the logging and the team had to work together to rebuild the metrics functionality.

[steveBK123]

this is an area that gets very political with architects, managers and other non-coders having too much of a say

a lot of paralysis on the app dev side as the status quo is easier than fighting for a sensible outcome

its also something that yes, benefits stakeholders... but only on a 2nd/3rd order effect of outage avoidance & remediation.. so theres not a huge reward for doing it really really well in many shops