Anthropic is releasing blog articles where they are discovering how Claude works through experiments and observations. It seems more like science than engineering when even the creators have to run scientific experiments to figure out how what they engineered works.
The description of how Claude does "arithmetic" was enlightening. Shows how it uses clever pattern matching to fit the data, without ever learning the algorithm, even though the algorithm description was certainly in its training data.
anthropic is doing great work, that understanding models blog post was really ground breaking.