[bitL]

So you are telling us that if we had a PhD, multiple awards from previous companies for actual work and not politicking/backstabbing/brownnosing, Coursera/edX certificates relevant to your area of business with almost 100% success rate on their most difficult courses, can program in 50+ languages, you would still ignore our past success and we have to go through your normal hiring process? I am sure this would bring you plenty proven world-class talent... /s

[grayfox]

I'm glad you brought up the other side of things.

If you were an applicant of such impressive, world renowned stature the answer would be: yes, (sir), you still need to go through the regular hiring process.

It isn't an arbitrary request, like building a JavaScript calculator. The samples we ask that you complete closely resemble the type of work you'd do in the role.

When hiring engineers for example, we take a piece of our application, take a chunk out, then ask you to complete it.

If you're a major talent, it's maybe 2-3 hours of work.

If you were to circumvent this, or feel you "shouldn't have to do this", what message does that send to the rest of the team?

We're a remote, self-managing, and loosely structured group - would it be wise to suggest that you are to be treated differently than the rest of us?

It sends a poor message and reflects on the (entitled) attitude of the candidate.

Team work makes the dream work.

[toomuchtodo]

I think you guys will do great for junior folks (where a resume with little experience would be a hinderance traditionally) or perhaps people who are willing to jump through hoops to work from home, but I don't see it catching on (unfortunately?).

> If you were to circumvent this, or feel you "shouldn't have to do this", what message does that send to the rest of the team?

Does everyone on your team get paid the same? If not, does that not send the same message? Is your HR process willing to let top talent go to a competitor who doesn't require such a test? (All real questions, not rhetorical)

[RangerScience]

Are you paid to write hard code, or are you paid to solve a problem? If solving that problem involves things that aren't challenging or "up to your skill level", will you still do them?

I'm a software developer. But, a few weeks ago, the Most Important Thing for me to do was get some art made and printed onto foam-core. Traditionally, that is not my job, and it doesn't match my skillset, but it needed to be done and I was the person best positioned to do it.

This is definitely situation-dependent. I work for the services part of our organization, where it is more important that you do what is needed than what you enjoy or are good at. However, for the pure engineering part of our organization, I want to hire you to do the thing you're good at and I don't expect you to do anything else.

So it depends. Do I need you to be excellent at a rigid set of things, or do I need you to be excellent at seeing something through to completion, whatever that means?

[mrkurt]

We need people to "be excellent at seeing something through to completion", among other things. That's one of the really nice parts about this process, getting one of these projects done on your own time just because you think it's important is a really good signal.

[grayfox]

We've had no issues attracting excellent and talented people. Most of them would be considered "senior".

You might be interested to hear that Juniors are the group most likely to be deterred by the sample. The (great) majority of candidates have backgrounds and capabilities up to or exceeding what we're asking them to do. We actually get very few under-qualified applicants.

The process appeals to people who appreciate a fair and objective approach to hiring as it demonstrates how we value those traits. We "set the tone" early by giving everyone an open and honest shake at proving their abilities, without the awkwardness of dealing with a biased human filter.

I don't agree with the premise of your salary comparison.

The process is willing to pass on candidates and wish them well if they aren't willing to take a test -- again, if it would be so "beneath" their skill and experience, that's a spooky indicator of attitude.

[Bahamut]

Or it may be an indicator of the attitude/shortsightedness of the hiring company.

From the candidate perspective, one way to assess the viability of the hiring strategy is imagine if most, or a significant number, of companies doing this. This eats significantly into each candidate's time, and edges the job seeking dynamic in favor of the companies, and against the candidate since the candidate is forced to value the cost of opportunity searching versus doing something else. This also dramatically would increase the stress of a job search - I experienced it first hand over the course of last year when a good portion of companies wanted projects done, all which would have totalled maybe 100 hours of extra work on top of everything else normally associated with interviewing.

This is not a sustainable balance for job seekers - ultimately this acts against most job seekers' self-interest. I'm fine with doing project-based tests ability/attitude-wise but this reasoning is why I pass up on them.

[mrkurt]

From first contact to hire, I think we're probably vastly more efficient with candidates' time than most companies. It's exceedingly rare to get as good of glimpse into what you'd be doing at a given job as you see from one of our sample projects. People who aren't great fits (either for desire or skill level reasons) can decide that very quickly. AND if they take it on, it's entirely on their own schedule, no coordination shenanigans.

From there, we do roughly what you'd do if you flew to a company for an interview (or drove, I guess). Rather than running someone through 3-5 different people, we organize it more as a full day project with the appropriate people around.

For most people, I suspect we spend more time pitching the value of the company than we do getting them to do work for us.

It's sustainable, provided companies act like us. :D We do a lot to explain what's going to happen, what we think makes people successful in our org, etc. My guess is most people who apply and make it through the process aren't out talking to 10-20 companies, they're specifically interested in companies like ours.

Based on feedback we've gotten from candidates, even people we passed on, the process is much more relaxing than what they're used to. We've had it called "more human", which is a little ridiculous, but based on how awful most hiring setups are it makes sense. Getting a job sucks and we really want our process to minimize the awfulness.

[frankjaeger]

Anyone who could not only criticize but also resist straight up killing for the opportunity to work with the only and only grayfox is an anomaly. Either you are incredibly unaware, or on the next level of talented to not recognize this. I'll give you the benefit of the doubt and assume the latter, in which case, stop posting on HN, and start writing books. People need to hear your wisdom.

[grayfox]

Fighting was the only thing... the only thing I was good at.

(That made my day, stranger, thank you).

[toomuchtodo]

That's the best part though. We don't have to agree! And that's totally okay.

Are there companies that ask for work samples (like yours)? Yes. Are there companies that rely more on resumes and interviews? Yes. Is the ratio going to change substantially? Possibly! It's an experiment, and like all experiments we're still waiting for the data to come back.

I think interviews and references are far more important than a skills test. You can train or educate almost anyone on most, if not all, skills. You can't train people to be decent coworkers emotionally.

[grayfox]

> It's a an experiment, and like all experiments we're still waiting for the data to come back.

That, my friend, is the long and short of it.

Lookin' for a job? Got a work-sample you could try out... :)

[bitL]

This is a great suggestion - perhaps the guys from Compose can come back in 2 years and tell us how it went?

[mrkurt]

We've actually been doing this for two years already! It's much more sophisticated now, but even the naive version of what we're doing has been tremendously successful.

[bitL]

Your problem would be that such talents don't have time nor need to complete whatever assignment you give to them. What if they programmed a core of enterprise cloud system handling 100,000s threads and millions of messages/second you might be unknowingly using daily, wrote papers about it you might have read already but it didn't occur to you and you are asking them to write a concurrent ring buffer? They would just say you good bye and won't consider ever joining you unless they are in deep troubles, which is exactly state you would like to avoid.

Major talents are usually involved with dozens of side tech & social activities, charity etc. Why should they spend time in proving their worth to you? You are operating on the premise people are equal in capabilities, but they aren't, some may be way ahead of your group specifically in the area you really need, to make yourself competitive. No exceptions rule is IMO a really bad idea - it's like reverse of affirmative action, i.e. penalizing/ignoring visible greatness.

Frankly, 10 years ago I thought what you are doing was a good idea; now I am no longer sure for the aforementioned reasons. Team work is not groupthink/socialism if you want to be successful.

[mrkurt]

If you treat people inconsistently, you open yourself up to tremendous political problems within an organization. _Particularly_ when it comes to hiring, or performance evaluation, or firing.

I think these mythical candidates who have an impressive body of work are probably going to be more thoughtful about a company they join up with than you'd naturally give them credit for. We pitch the heck out of our org, explain why we think it's awesome, and what people can do if they join up. If we can't get someone to see enough value to put time into deciding if it's right for them, I'm not sure they'd ever work out for us.

[snowwrestler]

If you hire someone and they are a talented, hardworking, likable teammate, the other employees will not care what the interview process was.

If you hire someone and they are a poor worker and a pain in the ass, you should get rid of them regardless of the interview process.

I think you're letting the tail wag the dog here.

[mrkurt]

Well ... yes. We work really hard on the process precisely so we can find find people who are capable, easy to work with, and self directed.

Part of doing this is being consistent with people. The people who work here welcome a new hire _knowing_ that they've already proven what they can do, and having witnessed it in action. They don't have to rely on weak signals or someone else's gut feeling.

[sheepmullet]

> and reflects on the (entitled) attitude of the candidate.

It isn't about being entitled. It is about valuing the candidates time.

Almost every company I have worked at has been incredibly picky about work samples. Candidates who did a pretty good job were frequently passed over.

This shows that the company doesn't value the 4-8 hours the candidate has invested. It is the company who is acting entitled.

So now when I get asked to participate in a take home project, I simply move on to the next job. If I participate then I am giving up on 4-5 other jobs for a likely rejection.

Do you publish your acceptance rates? I.e. how many people who complete the requested work end up getting and accepting offers?

If you had a high acceptance rate (say over 70%) I would happily complete a work sample. Most places I've worked at are closer to 10% acceptance rates.

[mrkurt]

We're very, very careful about wasting peoples' time. Most people who complete the sample projects spend an hour or so talking to someone about how the company works, what to expect with hiring, etc. We try and reciprocate on time spent with everyone. Some people don't want that, they'd rather just go off and do the thing, but it's important to us. It _also_ helps us get more completed projects from candidates, so there's a definite benefit beyond warm fuzzies.

That said, we don't have a high acceptance rate. We've noticed that there's a break point for most of these, if you normalize the scores there's a clump of people with >80% and then most are way below that. Depending on the role, and the intensity of the work sample, I think we probably select about 25-30% of completed projects to continue.

[exstudent2]

It sounds like you're optimizing for the happiness of your junior talent. It definitely seems like the more junior members of the team should be mature enough to handle senior people being treated with the respect they deserve. After all, someday that will be them.

By ignoring past success you will filter out most senior candidates. Why would they even apply when other companies will recognize their market value more fairly?

[avn2109]

I think what the GP is asking is this: If Jeff Dean walks through your door tomorrow, are you going to try to make him jump through hoops? Obviously he's a better hacker than statistically ~everyone you've ever met, so it might be silly to not hire him immediately. Plus, it takes some chutzpah to intentionally waste 3 hours of his time.

[mrkurt]

I don't think it makes sense to base a hiring process on outliers. Still, if he were interested, he'd go through the same process as everyone else. There's a fairly good chance most of our positions require more than being a good hacker, be it some UI skills, or operations work, or even "ability to talk to an angry customer".

[bitL]

We all wish you good luck then! ;-)