[rattray]

Fair point. They were wrong, not lying, and I only used that word because it was the one @idlewords used. Perhaps you're right that I should have corrected @idlewords that accusing people of being wrong is not the same as accusing them of lying. But I love the prose @idlewords writes so I didn't feel that it was my place to correct him on English, when I feel his is better than mine.

I do think it's entirely plausible that an automated coding test could be "failed" by a competent programmer in any programming language, because many automated coding tests are bullshit. It's not Toptal's fault that the state-of-the-art in automated programmer assessment is sub-par. Isn't that the problem Starfighter is solving -- better automated assessment of programmer ability? There's a reason it needs to exist.

[spitfire]

> It's not Toptal's fault that the state-of-the-art in automated programmer assessment is sub-par.

Yes it is.

They choose the tools they use, they take responsibility for their results. It is their business, they are responsible for everything that happens on their behalf.