[joshribakoff]

In one instance it could not even describe why a test is bad unit test (asserting true is equal to true), which doesn’t even require context or multi file reasoning.

Its almost as if it has additional problems beyond the context limits :)

[eric-burel]

In an agentic setup you are still dependent on having relatively smart models that's true.