[stackskipton]

In our remote interviews, I've started pasting the question into meeting chat that I've already fed into ChatGPT. Mainly because some candidates do actually do better with reading and thinking but it's also just pure bait to paste into their open ChatGPT window. Since I've already got input on my side, if they start reading off ChatGPT output, they get a strike, two strikes and interview is ended.

However, I do believe onsite interviews is best solution but finance obviously screams about cost.

[bitzun]

I discovered a new tactic where you ask a vaguely worded question on a niche subject, such that any seemingly off the cuff comprehensive answer must be ChatGPT. Asking something outside the candidate’s declared experience or following up on experience with tech they spoke well to will also reveal discrepancies.

[elashri]

I'm pretty sure the temperature of even GPT4o-mini is not 0 so how would you know it is the something like you have. It would be hard to be reading an answer, it would feel awkward and probably obvious it itself. But I'm just saying that some people would have memorized answers to some standard questions (they apply to many places as you might know).

[stackskipton]

Yea, the newer models wouldn't catch this but there is enough candidates going to chatgpt.com and just pasting in the question.

As always, it's arms race and one I wish I'd didn't have to participate in.

[XenophileJKO]

Alternatively they might also use a different model that has different response traits.

[bdangubic]

it is surprising there isn’t some SaaS bullshit company that solves this problem. we have shit like Pearsons and whatnots when taking exams, I took few certification exams and it was like

- install this thing that takes over my machine

- 360 camera around to show my surroundings

- no phone/watch/…

One would think by now there’d be two Stanford grads with a SaaS shit taking care of this for $899/hr

Last interview I did it was obvious candidate was cheating. Gave him my cell and told him to call me, no speakerphone or bluetooth and hung up Teams meeting - never got a call :)

[Terr_]

Even as we speak, scams are going on where pretend-employers are backdooring the computers of applicants that way.

I fear the only applicants who would agree are also the ones who can't be trusted with any employee access to your corporate resources.

[bdangubic]

a company would run this… Not your company taking over candidate’s computer, an intermediary that candidate and potential employer are using.

candidates are already using Slack/Teams/Zoom/… now they get to use Pouixy or whatever BS name someone in SF comes up with. guarantee you this will be a thing in 2025, some stanfords are on the case

[gray_-_wolf]

If you (the company) send me a company laptop to use for that shit, sure, we can interview that way. It is the same deal with Teams and Zoom. None of that shit is touching my personal devices, it is strictly limited to the work machine.

[bdangubic]

have you ever taken a certification exam remotely from your own computer?

[gray_-_wolf]

No.

[Gigachad]

There's a much simpler solution. You do the interview in your office and watch them answer without typing the question in to chatgpt.

[bdangubic]

too expensive - no one is doing that anymore

[Gigachad]

How is it too expensive? It takes the same amount of time for the interview, and you presumably have a room available in the office to book for the occasional interview.

And it instantly filters out all the spam applicants and chat GPT cheaters.

[pempem]

is it more expensive than what we're dealing with now? have we even tallied the human talent cost?

[jarsin]

Startup idea to truly solve this would be large network of onsite test / interview centers.

I had to do all my certs onsite in test centers in early 2000's. For one I had to drive 2 hours to take the exam.

Seems like those test centers used to be in every mid size city in the country.

[bdangubic]

too expensive mate… we live in year our Lord 2024 - no one is building 2000 buildings that will be vacant as everyone is working from home (or India…) :)

this requires a simple saas solution - someone’s working on this for sure already as it is already a big issue

[jarsin]

I hear you, and yes old school solution sounds absurd, but I suspect interview cheating will be on par with game cheating. Even if you install kernel level cheat protection systems the game cheater's still find ways around them.

These guys already developed an invisible desktop app to help everyone cheat on remote interviews.

https://news.ycombinator.com/item?id=42348147

[bdangubic]

no question there will be cat&mouse here but even more incentive for some stanford grads to charge premium for “unbreakable quantum-proof interview experience” :)

[mdaniel]

I don't believe one needs a startup to solve that problem - there are already a bazillion certification paths for a bazillion tech stacks. The(?) problem is one of trust from the hiring org that the certs mean anything, and that's where the whole discussion devolves into one of (gatekeeping|but muh leetcode|our business problem is special|$other)

[jarsin]

I meant a startup that provides onsite screening / verification of candidates for companies. Only pre-verifed candidates can apply to company jobs. If the candidate is not local, the company can use the test center to do a remote screen in an environment where candidate cannot cheat. Etc.

I just brought up certs because back in the day you could not take those test online due to cheating.

Now in the age of AI you can't do any type of testing remote, imo.

[mdaniel]

I half-way suspected that's what you were going for (testing-as-a-service) but my point still stands: it is a web-of-trust bootstrapping problem. For example, Otherbranch[1] exists, is a startup, and is trying to handle pre-screening candidates, but they seem to have very few companies that are currently using them. One would assume if they were solving a real problem then companies would be beating down their door to get real, verified, actual people and yet.

1: see https://news.ycombinator.com/from?site=otherbranch.com - the folks spun out of Triplebyte

[bdangubic]

this ain’t about pre-screening at all, it is about solving a different kind of problem. if you have experienced it already, you haven’t interviewed anyone recently.