[tagolli]

This looks really interesting! It seems like there's potentially 2 great companies in here:

1. Providing good programming tests with automatic env setup

2. Automatic PR reviewing and grading.

By this I mean that you could do less and still be useful, for example just run linting and tests on the PR and let me review it myself. That will match what I do at work anyway. That would let you focus on just providing great example projects and covering more languages, rather than on the automatic grading.

[nicoburns]

+1 on this. The env setup and test design along with a way for the candidate to submit their solution would save us a ton of work. I'd happily pay $30/interview just for that. I wouldn't be wanting to to rely on a 3rd party for grading. Nor would I want to assign a grade without having a chance to talk through the code with the candidate.