[rvz]

It means assessment tools like Leetcode and Hackerrank are not enough to evaluate programmer ability. In fact, it never was, and they have always been gamed for the sake of passing the interview.

Every passing day, the value of Leetcode and Hackerrank decreases as a measure, as 'reasoning' AI agents get increasingly better. It now takes a very skilled engineer to review the code from these LLMs as they are still non-deterministic tools and still generate plausible code that look correct but is in fact erroneous or unoptimal.

The real solution for proper software engineering interview assessments are live code reviewing ability and how a candidate reasons with code written by anyone (themselves, another person or AI). For example, open-source contributions towards highly significant repositories *always* require code review by the maintainers and that is very easy to verify and eliminates fraudsters claiming who did what.

Frankly speaking, Leetcode and Hackerrank are playing a losing game against LLMs and AI agents and code-review ability either on open-source projects or example projects are a much better method to assess SWEs on for interviews.

[CharlieDigital]

Exactly. When an AI can solve the coding challenging nearly instantly, what are you measuring by having a human do it as well?

That's like measuring a human against a hydraulic crane for lifting ability.

No, what you want is to measure if the human can safely and deftly operate the crane.