Many firms are implicitly assuming the models will keep improving to the point where all these problems go away. But what if they don’t?