[kenschu]

I'm the founder of a new tech assessment co - I hear "you guys remind me of Triplebyte" at least 1x per week. Clearly they were onto something originally - there's a lot of lingering love among eng leaders.

Our thesis is that LLMs unlock a lot in this space - and that we can provide more signal to employers, while giving candidates a better experience. There's a lot of open/difficult questions to doing this well - we're trying to figure it out.

(edit: we're not building an "AI recruiter" that asks you a time you failed or automates hiring decisions - we are extensively using LLMs to do things like problem/module generation, etc.)

I'd love to better understand the Triplebyte story. If you enjoyed their product (as a hiring manager, or as a candidate) or if you feel passionately about this space, I'd love to talk to you. Email is in my bio.

[dmitrygr]

> LLMs unlock a lot in this space

I would NOPE out of any LLM-conducted or LLM-assisted interview so fast, the LLM's head would spin. I do the same for take-homes or any other kind of interview where the company is investing less of their time than I am. Either we are evaluating each other fairly and equally, or GTFO

[soared]

Feels very similar to when I took a test that asked me questions about my life and then I was auto-denied for a role. Very qualified, I knew many people at the org, ~$150k/yr or something. The recruiter emailed me later that day saying I actually could continue on with the interview process, but I declined.

[kenschu]

There's a lot of "AI Recruiters", etc floating around asking you about a time you failed, etc - we don't like that approach at all.

We're (1) only running technical (coding) assessments, and (2) still letting live evaluators making final hiring decisions

[minimaxir]

LLMs + hiring is a very very risky combination.

[kenschu]

One that we have to tread carefully!

I should have clarified - we're not just putting an LLM on the other side of the candidate and letting it drive decisions.

Instead think of things use cases like content generation (we don't have a problem library - we create custom problems/modules for each customer of ours), etc. That's where I think you can improve signal a lot, by setting up a better situation to assess the candidate.

[altdataseller]

By content generation, do you mean take home problems or interview questions?

[kenschu]

Both! Generally more of the former.