Hacker News new | ask | show | jobs
by ammon 1828 days ago
This is certainly an issue. As you say, it’s a problem on yelp and glassdoor. It’s why most nightclubs have low yelp ratings (people they exclude give them low scores). There are a few things I think we think we can do:

1) Look at relative data, not raw ratings. Written reviews or raw numerical scores are what show the nightclub effect the most. What we care about is a ranking of companies (showing the better companies first in search results). This may not be as impacted by the problem. If sour grapes from people who failed interviews overwhelm other signals, we can only look at the scores from people who pass (or normalize the two groups separately).

2) Ask very specific questions (and maybe provide dummy options to attract sour grapes). I suspect that questions like "did this company say they could meet at $250 salary and then offer you less?" will get more accurate answers than "does this company have a toxic culture?". (We do actually want to get culture data, but I want to be really specific about the culture questions we are asking).

3) Use objective facts, not subject opinions. For example, we can tell when a company ghosts a candidate (because they reply through a proxy email that we control). So we're listing the 'ghost rate' for each company.

4 comments

Addressing ghosting is great! You should add something to Rethinking Triplebyte to indicate you are doing this.
> I suspect that questions like "did this company say they could meet at $250 salary and then offer you less?" will get more accurate answers than "does this company have a toxic culture?".

I'm pretty sure many salty people will just lie anyway, to punish the company. Source: I've been on the internet a long time.

I think this model of 'punishing' companies would've worked when you had a high bar for being on the platform in the first place, but if anyone can get on there, you'll have a lot of low quality candidates who are very mad that nobody will take them, and they'll overwhelm the reviews.

Remember that there's a survivorship bias at work: the lower quality people will take longer to get hired, which means they do a lot more interviews, which means a lot more reviews on your platform. Essentially, it's a reverse meritocracy when it comes to evaluating companies.

IIRC I wrote about 30 custom cover letters to Triplebyte companies... about 2-3 responded. My response rate to cold emailing/applying to ~10 F# companies is literally 100%. To be fair though, the TB applications occurred right at the start of Covid, and my F# job applications well into Covid.

Anyway, a ghost rate would be greatly appreciated.

In my experience toxic companies will essentially force employees to give good feedback through either social pressure, incentives or threat of repercussions. You can see this quite clearly on Glassdoor where a bad review is followed by five very similar good reviews within a week for some companies.