Hacker News new | ask | show | jobs
by hollownobody 540 days ago
Not sure if this is not currently possible, but what about adding an LLM integration?

I work in DS for a large corp and we're currently working on replacing our hackerrank coding interview with something that lets us evaluate the daily life of a dev a bit more realistically. This includes letting them use LLMs and watching them do exploratory data analysis, instead of just coding.
1 comments
rvivek 540 days ago
Before you replace, can I show you how the LLM integration works on HackerRank?
link
hollownobody 539 days ago
Yes please!

For additional context, we are currently using problems which have test cases, and it feels as if it doesn't correctly reflect the day-to-day of a data scientist. In fact, many interviewers pass a candidate iff they pass the test cases.

I'd love more open-ended problems.

link
rvivek 539 days ago
That's awesome. I'm sorry, I couldn't find your email / contact info from your profile. Any chance you can email me: vivek [at] hackerrank?
link
hollownobody 539 days ago
Done! Email subject is "HN DS Interviews".
link