[0xmohit]

I've also seen a similar tool that claims to do a partial evaluation of candidate's code. Guess what does it do! Assume that the expected answer was

   42

and your code emitted

   4

it'd give you 50% marks for the test case.

--

As an aside, such tools would give you a 0 even if you coded the perfect algorithm but goofed up the final printf.

Robotic evaluations might work, but not in the current form.

[jedmeyers]

I've had a similar problem with one of more recent HackerRank challenges. Part of the input were value pairs, the example contained only two pairs and the ordering of the pairs was not clearly specified, ie it could have been:

x1 x2 x3

y1 y2 y3

or:

x1 y1

x2 y2

x3 y3

The worst part way that their example still produced the same result if you read the values in the wrong order! I spent 40 minutes debugging my solution not understanding why my test cases work perfectly but HR does not accept the solution.