> but part of the point was to allow candidates to gauge their own abilities and not waste their time interviewing without a chance of being hired.
In my experience this is the wrong game theory. Unemployed people can make job hunting their full time job, so a 20 minute take home doesn't select for "who delivers the highest quality solution in the least amount of time," it selects for "who is the richest applicant who can burn hours on a take home to deliver a higher quality result than people with less time they can afford to spend?"
Also, nobody should ever self-select themselves out of an interview process. Passing a resume review and getting a callback is about 10% likely: for every job hunt, in my experience , candidates get about 10 callbacks for every 100 resume sends. From there, it's about 20% chance to get to final stage, and from there, maybe 50% to get an offer (you're either their first choice or second; if second, your hiring hinges on whether the first choice accepts). Math is right there: once you pass a resume check, in terms of the volume of applications you've sent, it's optimal to spend far more effort into this gig than into firing off ten or twenty more resumes.
Therefore, even if the candidate doesn't think they're a good fit, they should do everything they can to stay in the game, including lying by omission.
After all they might be engaging in imposter syndrome, right? Why assume for the interviewer that your python skills aren't good enough - maybe the interviewer understands perfectly well that you've only used it for scripts and one off tools, but doesn't care because they personally believe your startup experience is more valuable to them and they believe you can up skill! Maybe the take home was designed poorly by someone who was tasked randomly by a lead to shit out a take home, and it's not an accurate indication of what the job would be like. Maybe they sent you the wrong take home? Maybe it's a good take home but you need money so fuck it, if you manage to sneak in despite not being a good fit, you can just bust ass to upskill and make up the difference before anyone notices. Or fuck it twice, it's a shit market and who knows how much longer you'll be able to sell your labor as an engineer, even if you can only fool them for two weeks, that's two weeks of income while you still keep up your job hunt.
People who have really good jobs aren’t applying for jobs below them, so your applicant pool will always be people who are in an equal or worse position than your job.
No one at, Anthropic, for example, is applying to a job at Geico.
I guess, I think there's too large of a pool of companies for anyone to really say what's a meaningfully "equal" or "worse" job. If Geico was opening a new machine learning division to do some really interesting work on the probably shitload of actuarial data they've built over the years, maybe someone from anthropic would be interested in that. Or maybe everyone gets laid off from anthropic because of an AI bubble burst, and now googlers are competing with anthropic people who are competing with walmart labs people, and each hiring team really has no way of knowing who's better than who based on resume alone because they've got fifty in the inbox with FAANG experience.
Also I know plenty of people in startup world who are phenomenal engineers that only have companies I've never heard of on their resumes - startups that for one reason or another simply didn't have a news-grabbing exit.
> If Geico was opening a new machine learning division to do some really interesting work on the probably shitload of actuarial data they've built over the years, maybe someone from anthropic would be interested in that
But they’re not. And they won’t. And that is my point. They’d make a ML Engineer post on LinkedIn and get a bunch of people for whom Geico would be a step up.
There will never be a job opening from Geico that someone at Anthropic would apply to.
That’s my point - your pool will always be people who are in a worse position than your job. Being laid off is a worse position than a job.
You’ll never see Anthropic candidates in a Geico hiring pool, unless they were laid off for being lousy and can’t find anything else.
The market is pretty efficient - people wouldn’t bid for jobs that are worse than their current situation.
> The market is pretty efficient - people wouldn’t bid for jobs that are worse than their current situation.
This still seems like an oversimplification. It's easy to label FAANG, "frontier AI companies," whatever else, but the vast majority of jobs and the vast majority of engineers are in a soup that's maybe able to be split between "startup world" and "enterprise world" but beyond that, difficult to say one is "worse" or "better." And I've worked alongside FAANG people in startup world so, either that isn't a "worse" job and therefore your theory doesn't work because that means it's not really possible to accurately evaluate every single company as objectively worse/better, or, your theory doesn't work because people do apply to "worse" jobs.
> After all they might be engaging in imposter syndrome, right?
GP specifically stated that this was the point of the takehome though. If the person handing it out specifically warns you that struggling with it means you aren't a good fit then if you struggle with it that's not imposter syndrome - you aren't a good fit! Not dropping out at that point is just refusing to acknowledge reality and insisting on wasting everyone's time.
In my experience this is the wrong game theory. Unemployed people can make job hunting their full time job, so a 20 minute take home doesn't select for "who delivers the highest quality solution in the least amount of time," it selects for "who is the richest applicant who can burn hours on a take home to deliver a higher quality result than people with less time they can afford to spend?"
Also, nobody should ever self-select themselves out of an interview process. Passing a resume review and getting a callback is about 10% likely: for every job hunt, in my experience , candidates get about 10 callbacks for every 100 resume sends. From there, it's about 20% chance to get to final stage, and from there, maybe 50% to get an offer (you're either their first choice or second; if second, your hiring hinges on whether the first choice accepts). Math is right there: once you pass a resume check, in terms of the volume of applications you've sent, it's optimal to spend far more effort into this gig than into firing off ten or twenty more resumes.
Therefore, even if the candidate doesn't think they're a good fit, they should do everything they can to stay in the game, including lying by omission.
After all they might be engaging in imposter syndrome, right? Why assume for the interviewer that your python skills aren't good enough - maybe the interviewer understands perfectly well that you've only used it for scripts and one off tools, but doesn't care because they personally believe your startup experience is more valuable to them and they believe you can up skill! Maybe the take home was designed poorly by someone who was tasked randomly by a lead to shit out a take home, and it's not an accurate indication of what the job would be like. Maybe they sent you the wrong take home? Maybe it's a good take home but you need money so fuck it, if you manage to sneak in despite not being a good fit, you can just bust ass to upskill and make up the difference before anyone notices. Or fuck it twice, it's a shit market and who knows how much longer you'll be able to sell your labor as an engineer, even if you can only fool them for two weeks, that's two weeks of income while you still keep up your job hunt.