An invisible desktop application that will help you pass technical interviews

https://github.com/ibttf/interview-coder

by churlee12 • 2 years ago

211 248 2 years ago

So cheat to get a job then get fired when they see you are useless? Genius..

tags2k• 2 years ago

I do agree, however from my experience some folk smart enough to build this kind of system will struggle in an interview situation. Maybe rather than outright cheating, this could be more of a leg-up for those who find interviews difficult. Still wouldn't use it myself.

mog_dev• 2 years ago

Technical interviews are useless and its normal that their victims fight back

vanhakoira• 2 years ago

I heavily disagree with this. Technical interviews are great if done correctly.

Or do you think that technical interviews hold such trait that is always present, that you can label all of them useless?

rvz4• 2 years ago

"Victims"

This just makes it much worse for the industry that is already weeding out frauds or those that claim / lie about their achievements without backing them up when asked very technical tests.

I would say the online technical interview solutions like leetcode, hackerrank, etc are losing their worth given they can be easily cheated but you are just cheating yourself in the on-site interview.

wang_li• 2 years ago

If you don't like technical interviews then what the industry needs is proper and formal certification process akin to the medical, legal, and engineering fields. In the absence of some outside resource to validate that a person has the basic fundamental skills, then you have to ask questions to determine if the applicant knows any of those skills.

cynicalsecurity• 2 years ago

The recruitment process is broken.

tjpnz2• 2 years ago

In tech? Unless you really are useless you'll be more likely to coast.

andai• 2 years ago

Obligatory "I don't agree with this and think it seems like a pretty depressing way to live", but:

A colleague yesterday was telling me about how much he and all his friends lied to get their jobs, and he suggested I do the same, because if I don't, I'm competing against people who do, and said that's unfair (for me).

It wasn't even an office job, but I've seen the same thing there too. (Also at university...)

qwer12343212• 2 years ago

I'm not under pressure so it's easy to say this, but I'd rather not get a job than lie during interview.

bartread• 2 years ago

I’d say chances of getting busted are high as well. The invisibility of the window to common interview software won’t do anything mask candidates’ own suspicious behaviour.

I was doing a 45 minute screener interview with a guy the other day who I could see kept glancing over at another window or screen as he was typing in code. Every couple of characters or so he was pausing looking over, then he’d type a handful more characters, then pause and glance again. He was typing incredibly slowly as well, like a character or two per second, even when he was typing. It was honestly a bit of a weird experience to watch unfolding. His solutions were spot on though.

I didn’t make an issue of it, partly because I already had other concerns as well. I can’t think of a situation where there’s anything to gain by getting into an argument with a candidate: I simply didn’t invite him to the next interview stage.

herghost• 2 years ago

Gong back about 20 years we had to introduce a "pre-screening" interview for infosec roles because of the calbire of candidates we were getting through.

They'd made it through the HR "sift" by having the right words on their CVs but we found that a huge majority of these candidates didn't know even entry-level basics.

There was initially a "quick fire" round where we did some real basic definitions - Confidentiality, Integrity, Availability, risk, etc, etc.

Even back then candidates would hit us with the:

"Hmm, great question"

/tap tap tap tap

[Wikipedia definition of confidentiality]

OutOfHere4• 2 years ago

That is completely ridiculous because the candidate could be looking at a relevant documentation page, which is fair game. Next time, try a voice interview.

OutOfHere4• 2 years ago

Given how poor and assumptive your logical reasoning is, the candidate is lucky for not working with you.

mda• 2 years ago

Since interview process is also flawed in many ways luck based, if you cheat and moderately capable, you can totally stay there and even go up in ranks.

hiAndrewQuinn• 2 years ago

People rarely get fired solely due to technical incompetence, in my experience.

Technical competence happens to be much easier to test for than most of the other factors, and it can compensate to some degree for e.g. bad interpersonal skills. This is indeed part of why tech is such an autism-friendly field. But I've only seen a few people get let go for being great team players, excellent requirements analysts, etc., but just totally unable to code - for better or worse.

(More common is they get shifted to a role which better aligns with their "true" skillset. Why didn't they get this role in the first place? Again: Hard to test for.)

kstenerud• 2 years ago

It's starting to feel more like "cheat the job interview because the cat-and-mouse game has pushed everything to the point where you can't legitimately get an offer for a job you're actually fully qualified for anymore"

That's not quite where things are now, but the initial phases are beginning to show.

pixelsort• 2 years ago

Perception on the degree of severity seems to depend largely upon the size and structure of your social networks. In the post-GPT4 tech economy, your work friends are also the only worthwhile recruiters.

fasthandle• 2 years ago

There's a positive association between 1337code interview hurdles and lack of management competence.

Someone without the confidence to hire someone without going through a bunch of hoops to justify themselves is even less likely to admit humility and say they were wrong. Which makes places that employ these interview techniques terribly passive aggressive places to be.

davedx• 2 years ago

Feels like in some sections of the US like big tech, the talent vetting process has evolved into some adversarial battle of attrition where the idea is to grind down the pool of candidates until only a few are left rather than find some potential new colleagues. Tools like this have emerged as a direct response to that process.

What a bizarre way to begin a working relationship.

stego-tech6• 2 years ago

Sadly, these sorts of “practical interviews” aren’t just limited to Big Tech. There’s been an arms race for thirty years now between applicants and employers, the latter creating new hurdles to overcome and the former finding new ways to bypass unnecessary hurdles.

Employers demanded applications instead of resumes, so candidates used copy machines. Then they wanted block lettering, so candidates used type writers. ATS systems could search for keywords, so candidates flooded their resumes with them. Then employers allowed online applications, and the floodgates opened proper - applications from all over the world, desperate for good employment. So they made you create an account, and applicants wrote or used bots to automate it - which became site features like “Quick Apply” on LinkedIn and Indeed. Practical interviews used to be a single round for only the most senior roles, but then employers wanted everyone to be as qualified as those roles but not pay them that much, which started the cheating arms race.

Ultimately, the problem remains a glut of qualified talent demanding salaries to pay the bills, and employers who want to pay as little as possible. The two sides are adversaries by default, and few companies do the work of mending the relationship into something more cooperative.

dingnuts• 2 years ago

this does NOT match my experience as an interviewer. Our company went through piles of candidates who were not qualified and it took us months to find a good fit after going through hundreds of resumes and scores of interviews.

I hope the folks we hired are paid enough to retain because there were was absolutely no glut of talent. It was hard to find the folks we wound up hiring. There was a glut of applications, yes, but the vast majority were totally unqualified.

eastbound4• 2 years ago

As an employer, I know candidates use LinkedIn’s “Apply in one click” in bulk. When we contact them, half of them notice they don’t even fit the criteria in our ad (be a Java developer, for starters).

dahart8• 2 years ago

This is all fully explained by salaries going up, and the pool of young applicants getting bigger faster than the number of jobs available, while the pool of highly qualified applicants remains small. Jobs at Facebook, Google, Microsoft, Intel, Nvidia, are all legitimately competitive, and because more people are applying, those companies have the freedom to be choosier and the incentive to compete for the good ones. Because salaries have gone up (or even simply the perception of salaries), and because salaries are high compared to other jobs, more and more bright-eyed kids are hoping to punch above their weight in interviews, which is why companies are flooded with low-quality applications and don’t have a choice about needing to sift them efficiently.

This is the natural state of a competitive environment, and interviews will get “better” for candidates when there are more jobs than good candidates. But be careful what you wish for; if the job market gets less competitive for candidates, salaries and benefits and working conditions go with it.

While there might be some truth it to, framing it as an arms race is a mentality that will not help the average candidate, and might do them harm. Employers always have and always will want to pay as little as possible, obviously, that’s the definition of a company. But they do actually compete with each other for good talent, and they do pay a lot relative to other jobs, and some companies’ definitions of pay as little as possible is still to pay enough that employees are well compensated and don’t leave.

treyd• 2 years ago

I have a theory that job search sights have an incentive to make the application/recruiting process so much of a slog due to (1) the hundreds of applications many people have to send out and (2) the hundreds of applications that companies have to sort through, as a way to justify their own existence.

motohagiography• 2 years ago

key insight. the factors influencing this are a couple I can think of. the first is just the sheer volume of applicants made possible by the internet and the mobility of workers, where you get hundreds of profiles to sort through for any job and use a coarse technical funnel to sort them. the second is we can't just pick good colleagues because the regulatory and litigation environment imposes selection criteria where we have to evaluate all these applicants equally.

these aren't justifications for the confrontational interview filter, but some upstream factors that are worth picking at to see if something better could become a solution to them.

CharlieDigital5• 2 years ago

I've recently been studying leetcode (for reasons) and went through an interview process.

It was, by far, the most boring interview I've ever had to participate in. The leetcode problem was easy (detect if two strings are anagrams; solved with O(n) solution in < 10 LOC; then aggregate sets of anagrams). System design was easy because it is to the point that it is largely "formulaic". It feels like those rhythm games where you need to know when the trigger is coming and the pattern to hit those triggers (talk about functional requirements -> talk about non-functional requirements -> write some API routes -> draw a load balancer (because of course, there's always a load balancer) -> draw a service -> draw Redis/Memcached -> draw a database). It's comically laughable how it's just like a rhythm game at this point.

What I don't understand is why teams don't just "get to the point". A lot of times, the assessment is looking for specific notes. Why not just ask about those notes directly? A friend recently went through an interview where he was docked for not using C# `yield` when implementing an `IEnumerable`. But had the interviewer asked "What is `yield` and why would you use it?", the interviewer would have gained the same exact insight in 15 seconds with one question.

I think what's also striking is how slow orgs are to adapt their interview process to account for AI. There's a distinct lack of focus on code reviews as part of the assessment. If the future of coding is AIs for productivity, then teams should be adding code reviews into their process (check for correctness, check for defects, check for performance, check for security, etc).

prisenco2• 2 years ago

| distinct lack of focus on code reviews as part of the assessment

"Writing code is easy, reading code is hard"

An interview based on reading, explaining and critiquing complicated code would give a better window into a candidate's skills than having them solve the kind of coding challenge that can be completed in a short interview.

Also, being able to identify which algorithms would be useful in solving a unique problem and explain what the pros & cons are would go further than implementing an algorithm abstractly.

whimsicalism3• 2 years ago

sounds like you interviewed for too easy a job, the anagram question you described would be significantly easier than interviews i have or give

BeFlatXIII3• 2 years ago

from collections import Counter

if not Counter(str1) - Counter(str2): # success, they are anagrams

tetraodonpuffer• 2 years ago

As somebody that gives systems design interviews most weeks, you’d be surprised how many candidates don’t put the api gateway but magically go from the TCP load balancer to the services inside the cluster, or how basically nobody is ever able to explain how a CDN works (as in, put the CDN behind the API gateway, note I have seen this in a company in production too). Or how some candidates will have redis and Postgres and do magical cross storage transactions.

And these are all candidates with 5+ years experience, sometimes 10+. I hate the leetcode gauntlet, but I also am really surprised how much worse candidates are now on average that they used to be (I’ve been around for about 25 years now), and how the minute you try to dig a little deeper to see if they know how things really work, the more it seems that they have no understanding whatsoever of the basics and somehow treat computers as magical black boxes.

I do understand I am privileged by having grown with the technology, starting in the 8-bit era, through an electronic engineering degree, and now in k8s etc. but with so much educational material available for free you’d think that even people in their 20s/30s now should be able to have a better idea of how things work.

prisenco2• 2 years ago

The move away from on-the-job training has played a role. If a company doesn't provide any early guidance and mentorship (which everyone could use regardless of industry experience), then that has to be replaced by finding the perfect candidate who can immediately be productive.

jamaicahest• 2 years ago

then that has to be replaced by finding the perfect candidate who can immediately be productive.

We're called freelance consultants. And we charge a high price for that service.

heresie-dabord• 2 years ago

The ideal purpose of hiring is to find a skilled candidate who will be a good fit and maybe even bring talent and energy to the role. The hiring entity will ideally provide mentoring and training to ensure a successful investment and relationship.

But the catch is... the people doing the hiring must themselves ideally be talented, energetic, skillful mentors who envisage building a positive culture.

deadbabe3• 2 years ago

Literally all the engineers at the company went through the same process. For all the bitching and complaining an interviewee does, there’s probably a hundred people who just went through the process and got hired.

Suck it up, it’s part of the job. If you can’t do it, you don’t belong. Simple as that.

mdaniel2• 2 years ago

who just went through the process and got hired.

You say that as if there's The One True Interview Routine™ and it doesn't change from team to team, person to person, month to month. I actually would bet that no single organization interviews with the consistency you're describing, not even FAANG with their holier-than-thou grinders

If it wasn't such a monster drain on human productivity, I think it'd be funny if there was "rolling interviews" where each new hire got to send prior hires though "the process" on the yearly anniversary of those prior hires

acheron• 2 years ago

This is called “hazing”.

maxnevermind2• 2 years ago

That's actually a good point. I believe that BigTech these days look for conformists, not superstar SWEs. If you agree to waste your time on preparation to meaningless LeetCode style interview then you are one of them and ready to be a part of the company. I do believe that is actually one of the things that being tested by such an interview, it's not a proxy for IQ, it's a proxy for candidate's readiness to eat dull corporate BS and not complain about it.

dahart8• 2 years ago

On one hand, that’s what it always was, by definition - a company is looking for the best candidates it can get with a given budget, and the best-case scenario for the company is there’s a large pool of candidates to choose from.

On the other hand, from my perspective and experience on both sides of the interview table, to me it seems like the perception that this is adversarial is coming primarily from young candidates whinging on the internet in large numbers about interviews being unfair or “broken” or doing it the wrong way. Every time this comes up on HN, there are hordes of comments demanding we stop whiteboarding in interviews, or claiming anything not exactly in the job description is out of bounds, or decrying the abuse that coding live inflicts. There are blog posts every week about how to fix the problem, where the problem is usually the interviewee’s comfort, and not the company’s efficiency or effectiveness.

The truth is that companies need people, and the employees there do want new colleagues. If you truly understand that, and also that the selection process is unavoidable and working as designed, then it will help you navigate the selection process and appeal to the company, it will help you get the job.

I’m well aware of the fears young candidates have, since I was one. Getting a job can be hard, and it might even be getting harder over time. But to me it’s also funny that software engineers looking for 6-figure salary jobs complain about interviews and competition and having to demo their skills for an hour or two. Don’t forget to look around at other industries and ask whether it’s really better over there. People in music and films and advertising and art have to grind for years, suffer low-wage or historically unpaid internships. Doctors have to do residency, grad school, and get licensed. Most people make less money, many people have to do labor. Most jobs have much bigger downsides than what we have to do in our interviews as software engineers.

We have opportunity and privilege and with the right practice and attitude and with reasonable expectations, it’s really not that hard to do well in interviews and land a good job. Many kids are hearing stories of FAANG and million dollar salaries and expecting to somehow land their first job out of school in one of the top 5 most coveted and competitive companies. I know this because I just spent a day at a university career fair a few weeks ago talking to hundreds of graduating seniors, most of whom are all expecting to shoot the moon for the same 3 jobs, and most of whom are not very eager to consider the idea of starting at a smaller company and working their way up for a few years. FAANG feels adversarial only because it’s actually legitimately super competitive, but as a candidate, figuring out how to have a non-adversarial approach is the key to getting the job. Tools like this are the opposite of what they need.

colinb2• 2 years ago

I’m reasonably certain that I interviewed someone using this or something like it in the last few days.

Lots of eye scanning while looking above the window they’d been typing into. Pauses. Big pastes. One of my excellent colleagues noticed that the candidate made use of exciting C++ casts before ever defining the variable’s types. Complete inability to explain or debug the code just written.

So. Frustrating in two dimensions. First a waste of time for everyone. Second, occasional signs of real ability make me think the candidate might’ve made it work honestly. The fool.

This, and this alone, makes me pine for in-person interviews. But I suspect those won’t be back for some time. (For good reasons that are out of scope here.)

xandrius4• 2 years ago

It sounds like you want sympathy but it just shows that some people just don't understand the power dynamics of an interview.

I believe live coding is a scourge and we should get rid of it altogether.

Get a tiny open ended project, which requires more design/architecture skills than actually finishing the solution. You do it at your own time and shouldn't take more than 1-2h. You submit it and provide your mental process in writing.

We then hop on a call and we can dicuss it further, talking about possible issues and what to do to get it released if a requirement changed last minute.

If you can do that, come across amicable, knowledgeable and experienced enough given the seniority of the role, and feel like you are not reading from an hidden ai window then you pass.

"Exciting casts" are absolutely worthless in real life, everyone has to balance shipping vs code artistry.

4dregress3• 2 years ago

100%

Another one I like was having to code review a repo which had specific issues in it.

Then add some new features.

Then in the final stage of the interview you go through it.

gzer0• 2 years ago

The core issue here is the sheer volume of applicants. Microsoft opened 30 new-grad software engineering positions. Care to guess how many applications they got within 24 hours? 1,000? 10,000?

Nope.

100,000 applications. In under a single day.

With that kind of applicant pool, I’m honestly not sure what the best approach is—even though, in a perfect world, your suggestion would be the more appropriate route. The reality, however, is that these numbers are just absurd.

disgruntledphd22• 2 years ago

Get a tiny open ended project, which requires more design/architecture skills than actually finishing the solution. You do it at your own time and shouldn't take more than 1-2h. You submit it and provide your mental process in writing.

I used to really like the idea of take homes, then I had kids and discovered just how hard it is to find time to do these (particularly for multiple applications while working).

Don't get me wrong, I think that they're generally a better test for the actual role, but they're not perfect, and they're game-able by spending way more time on them.

Interviewing is hard. Like, ideally, we'd just centralise the administration of these tests and you'd do a few every year (so formal CPD rather than an expectation that people do it in their off time) but that is never gonna happen in the tech industry for various good and bad reasons.

szastupov• 2 years ago

I believe live coding is a scourge and we should get rid of it altogether.

I would take an hour of live coding any time over a take-home task that is one hour only on paper and takes you three in reality.

Engineering is collaboration, and it's fair to expect candidates to talk, solve problems, and explain their solutions.

Where we could do better as an industry is the type of problems we give to people. I'm not a fan of LeetCode-style questions, especially when multiple ones are asked. Something closer to Earth would be better. But even if you have to ask something algorithmical, I'd prefer the style of "Advent of Code" exercises where the same problem has variations and multiple levels of complexity.

dahart8• 2 years ago

Your comment is excessively dismissive. The irony is that parent actually did what you’re suggesting, tried to talk about the interviewee’s solution and found that they didn’t come across as knowledgeable and experienced enough even though their code suggested otherwise. Whether it’s live coding or take-home is mostly irrelevant.

Your proposed alternative is absolutely subject to the same problem, AI-written code and LLM-written mental process. Think more carefully about whether it solves anything and exactly what problem it solves, because it does not solve the problem of people trying to game interviews with AI, your suggestion is potentially worse on that axis. The whole point of doing it live is to get to the talking part that you suggested more quickly.

Wouldn’t you rather be discussing your thinking immediately and get a sense for what the real questions are and how you’re doing, and have the opportunity to talk about it, than waste several hours doing it at home trying to write something up without getting clues along the way or being able to ask questions, only to have the next guy get hired because they used AI, or because they’re fine with live coding, or because they’re better at writing than coding, or because they got lucky?

You have to live code on the job. Do take a moment to consider what the hiring manager needs and whether take-home problems are either more effective or more efficient for the company. Managers want to find the best candidates, and best involves more than coding, it involves communication and collaboration skills too. Live coding can give some indicators of those things, and take-home problems cannot.

shepardrtc• 2 years ago

I did that for my previous job and I loved it. Had plenty of time to get over my nerves and then build something cool. And then brag about my choices in writing.

QuadmasterXLII• 2 years ago

Some people want to be hired based on 25 minutes of easy live coding. It’s ok that you’re not one of them but don’t piss in someone else’s cereal.

zabzonk• 2 years ago

made use of exciting C++ casts before ever defining the variable’s types

an example of this, please?

7734128• 2 years ago

Lots of eye scanning while looking above the window they’d been typing into.

Are you expecting people to not reference external material, such as documentation or syntax, and only code from memory?

colinb2• 2 years ago

Absolutely not. In my standard intro material I explicitly say otherwise, tell them that actual work involves checking external references, and that I want the interview to be as near to a collaborative experience as it can be in the odd circumstances.

I also tell them that they should tell me when they're checking external resources (the CPP reference is what I mostly have in mind, but StackOverflow or whatever is fine with me) so that I understand how they go about solving problems. Because that's the actual important bit. All the coding and the questioning is a proxy for that.

pavlov3• 2 years ago

Why bother with this style of interview where the candidate is under extreme time pressure and isn’t allowed to use any of the research tools they would normally use in their job? What is this controlling for?

It barely made sense when these were conducted in person, and it’s completely inane over video meeting.

Instead of grilling people, talk to them. Give them meaningful take-home exercises that you can discuss together during the interview. If they can explain the decisions they made and discuss alternatives and trade-offs, that’s a much better indicator of job performance than pretending to invent a leetcode party trick algorithm in 10 minutes.

CastFX• 2 years ago

I agree but a big problem remains. How do you make it scale for 100k applications?

disgruntledphd22• 2 years ago

Filter people out by requiring them to count the number of s's in sensational.

pavlov3• 2 years ago

Employing someone is renting their labor.

How do you find an apartment rental in a large city with thousands of options?

You can’t expect to visit them all. And you certainly can’t come up with increasingly bizarre torture tests for landlords to pass (“I might rent from you if you can answer enough trick questions about tenant law within 15 minutes”).

To find the apartment, you probably sample enough of the options to form a picture of what’s available, and then make a decision knowing that you didn’t have perfect information but you had to move ahead. The same applies to hiring.

lordnacho7• 2 years ago

How many jobs have you got? 1000?

How about you hire the first 1000 people who seem competent, and then tell everyone else you've filled the roles?

krisgenre• 2 years ago

I let candidates use the Internet (except AI tools) during coding interviews. All I care is if given a problem can they do the necessary research to solve it. It usually involves making them use a library which they are not already familiar with. This is more than enough for most of the programming jobs.

disqard• 2 years ago

I think this is a continuum:

I let candidates use X during coding interviews.

I've personally seen this evolve over the past 20 years

Whiteboard --> Text editor --> IDE --> ...?

Maybe "AI Coding Assistant" is next.

antihero• 2 years ago

Well yeah, it is really bad, which is why I have no qualms with this project.

If a company wants me to do some leetcode crap I decline the job.

toast03• 2 years ago

Live interviews control for wasting the candidate time in a way that take home exercises don't.

Both the candidate and the interviewer need to take time out of their day for the interview. If it's an in-person interview, the candidate also takes travel time etc, which could be more disruptive.

But it takes almost no time to give a take home problem, so there's potential for a significant assymetry in time spent between candidate and employer.

Spivak2• 2 years ago

Huh? I've done take-home problems and they've been fine. I'll take it 100% of the time over live coding.

briandear• 2 years ago

When LeetCode and HackerRacnk shut down, the industry will be a much better place.

tjpnz2• 2 years ago

What options are available for the on-site?

jasode2• 2 years ago

Just in case this repo isn't a joke and some job seekers are seriously thinking of this tactic...

Companies already know about cheat methods like this and candidates still have to demonstrate skills in-person on a whiteboard in a 2nd round of tech interviews.

A high-paying FAANG job isn't going to hire candidates based on just one remote Zoom tech interview.

That still may not deter some folks and they'll try to continue to find some cheating technique to use in front of the whiteboard. In that case, some creativity is going to be required. E.g. : https://www.google.com/search?q=chess+cheating+anal+beads

The issue is that "chess board moves" is very low bandwidth and can be efficiently encoded into pseudo-quasi- Morse Code vibration schemes. However, if you're asked to "invert a binary tree" or any other open-ended random puzzles, it's more difficult to compress a secret 2-way high-bandwidth communication with ChatGPT into a hidden butt plug. (But then again, if a candidate is actually able to fool people with hidden ChatGPT hacks in a face-to-face interview, maybe FAANG should hire them based on that alone.)

Keep on the lookout for a github repo with ChatGPT butt-plug communication.

throwaway71271• 2 years ago

looking at the despair at https://www.reddit.com/r/cscareerquestions i am completely certain people are not above cheating

even if its not an app, everything is so cheap and small now, 1mm camera and microphone, and very tiny ear piece (invisible with longer hair), or even earless headphones, realtime whisper turbo and groq llama3.3 can absolutely pass most interviews and answer most questions

even without the tech, i am sure people are now cheating on face to face interviews as well

i worked at fairly big company, and did maybe 500 interviews, i never knew how the candidate would look in advance, so i dont see why cant someone else shows up to the interview, pass it and then the real person shows up for the job

xandrius4• 2 years ago

The problem today is not that to get into FAANG you've got to jump through hoops and loops like a well-trained cage animal (aka fresh graduate) but that this is getting applied more and more to literally any startup under the sun, even some with 0 funding.

As a first engineer for a tiny startup, show me some past projects and let's grab a (virtual) coffee talking tech, that's all.

Now it's like McDonald's requesting to perform Michelin level dishes under 45 minutes with Gordon Ramsey in the room while still ending up flipping burgers minimum wage at the end of it all.

If this keeps going and getting worse, I wouldn't mind a butt-plug communication, as long as I can pick my favourite AI (I personally kind of prefer Claude right now over ChatGPT.)

eastbound4• 2 years ago

As a first engineer for a tiny startup, show me some

How do you expect startups to make money if you think they aren’t even legitimate to see you program during an interview?

Oh, right, you don’t care about your employer’s finances.

dpb001• 2 years ago

“Flipping burgers…”. This made me laugh because it is so true. My last involvement in interviewing candidates was for a position for an ETL developer. One of the other team members who was part of the interviewer schedule proudly announced that he had discovered a great source of tricky SQL puzzles that he intended to use. My comments were along the lines of “you do you, but I’m more interested in how someone would generally approach the 3 or 4 categories of tasks they will be routinely doing day-to-day”.

sangeeth962• 2 years ago

The in-person whiteboard interviews isn’t always a thing for all SDE rounds, but def there for SDE-2 and above I guess. Still, it’s just a matter of time before this is also solved.

thaumasiotes4• 2 years ago

A high-paying FAANG job isn't going to hire candidates based on just one remote Zoom tech interview.

What do you think they do? One round of interviews was enough for my Google recruiter to congratulate me on getting a job there.

Did I get the job? No. But the process didn't include any other interviews. There's only one round.

jasode2• 2 years ago

What do you think they do? One round of interviews was enough for my Google recruiter to congratulate me on getting a job there.

Your Google interview process might be different because you've previously said you were ex-FAANG from 2000s so your work history and street credibility puts you in the "experienced senior hire" bucket. The interview process may be different for that type of candidate.

My recent college grad friend's process went like this (2022 so post-COVID):

- an offsite remote interview over Google Meet using Google Docs as coding canvas. 45-minutes long

- 5 onsite interviews on same day: 4 technical and 1 behavioral

lordnacho7• 2 years ago

Pardon me, but I don't understand. Was the recruiter mistaken about you getting the job?

turdprincess2• 2 years ago

FAANG jobs absolutely hire engineers over zoom. It’s not just one interview, but the whole process is done remotely over video. It typically includes somewhere between 5 to 10 sessions covering coding, architecture and behavioral.

Source - work at a FANG which engineers exclusively via remote video call.

boredatoms• 2 years ago

Is the option of in-person available to the candidate?, zoom interviews are exhausting

helsinki• 2 years ago

I received an offer from Apple in July after performing six remote interviews. Did this change since July?

shepherdjerred• 2 years ago

A high-paying FAANG job isn't going to hire candidates based on just one remote Zoom tech interview.

Have FAANGs gone back to real onsites? I've only see virtual onsites since the pandemic.

neilv• 2 years ago

One of the few things that I hate more than popular 'technical interview' methods is... lying.

sirwhinesalot5• 2 years ago

I don't get why companies waste time with this sort of interview that just turns into this stupid cat and mouse game. Even ignoring this sort of software, someone cramming leet code exercises is the same thing in my view (they won't remember or use in their work 99% of that stuff).

Just talk to the person, talk about the sorts of problems you expect them to solve. Can they understand the problem? Do they have ideas on how to solve it? Maybe give them a small take home exercise related to the work they'll be doing. Discuss it with them to see if they were the ones that actually wrote it.

Sometimes you don't even need the take home exercise. If they have niche knowledge on the subject you care about they're probably good enough by default (since they are clearly invested and studious in that case).

I only hired a few people in my career but every single one was a huge boon to the team, still around even after I quit as a manager. I didn't even give them a take home exercise. Didn't need to.

xandrius4• 2 years ago

Same! This topic gets me soo irritated. If someone is supposed an expert in a field (hence them being an interviewer) how can an average joe fool them into thinking they know more than they actually do during a conversation?

Even now with LLMs generating almost real time, there is always a slight delay and we all know that LLMs are far from perfect.

It seems the tech community on one hand complains at how bad LLMs are for doing deep tech while at the same time fears them as they can make any candidate pass interviews. So which one is it?

Also, the simplest trick even old-timers professor already know:

1) Prepare an open ended question about X

2) Ask it to ChatGPT, Claude, etc.

3) Take note of the titles, keywords used, etc.

4) Ask it to the candidate

5) Compare responses

jochem9• 2 years ago

Not all interviewers are experts. If you are building out your business you will be hiring roles that don't exist yet. Of course that brings different requirements for that first hire, but judging their skill level might prove very hard.

IshKebab• 2 years ago

I think it's worthwhile doing simple coding tests to check that the interviewee can actually code. It seems crazy but I've interviewed plenty of people that couldn't write a simple for loop.

I agree asking difficult leetcode questions is less useful because it depends so much on whether people have practiced (or now whether they cheat with AI). Often these questions are so difficult there's no way you could come up with a solution in an interview situation if you hadn't already seen it.

Getting rid of all coding interviews is stupid though. Other industries would kill to have such an easy to test skill! We shouldn't throw away such a nice thing just because some people take it too far.

sirwhinesalot5• 2 years ago

There are people who can talk their way out of trouble for sure. That is why I suggested the take home exercise followed by a discussion.

It's only when there's niche knowledge involved that I think it isn't necessary, because you won't be able to answer any hard questions properly without having actually worked on code for that niche at one point or another.

Viliam12343• 2 years ago

Exactly. "Yes to fizzbuzz, no to leetcode" seems like a reasonable position that few companies take; usually it's either both or neither.

In my entire career, I only once had a situation where they gave me a trivial technical problem, I wrote the first line, and they were like "okay, you passed the test, no need to finish this, we just use it to filter out the people who can't even start". And then we talked.

But usually it's either just talking, or some puzzle that requires you to remember some extremely specialized optimization technique which you will never in your life use again if you pass the test.

tamimio4• 2 years ago

Yep, it’s why I stopped looking for software development jobs long ago. It's this die-hard criterion that’s based on very isolated problem-solving issues rather than the big picture or the concept at least. This has resulted in the current outcome of software development nowadays, where you need a ‘wrangler’ (aka product manager) and all sorts of useless methodologies to deliver a product that’s literally identical to hundreds of products out there.

It gets even worse than that, with hiring based on arbitrary values. One of the companies I worked for before had an engineering manager who chose one candidate over another simply because he had a repo with thousands of stars.

Zak• 2 years ago

Creating and maintaining popular open source software seems like a reasonable criterion for deciding between two otherwise-similar candidates for a software development role.

lordnacho7• 2 years ago

I agree. My whole interview technique is just to have a long conversation with the person.

My team was hiring recently. Guy comes on, says he's never used Rust, but has some thoughts on it. We talked about all the pros and cons of it, what the system requirements would be, and so on. He talks us through everything to do with the domain, just two seniors talking to each other at a high level. Very pleasant.

We hire him, and a month later he's making idiomatic Rust.

No need to put people through a ridiculous gauntlet.

ryandrake2• 2 years ago

You got very lucky. Congrats!

This industry is unfortunately full of very charming, polished, smooth talkers who would ace that interview and then 3 months later it would dawn on you that you made a big mistake. There is this growing breed of "LinkedIn thought leader" types who, during character creation, put all their skill points into Charisma. And they're really good at sounding technical, using the right buzzwords, overwhelming the interviewer with word-salad, subtly steering the conversation towards areas where they have crisp, prepared answers, and so on. They look great, speak eloquently, and have those ivy-leaguer mannerisms that allow them to breeze through these kinds of informal chit chat interviews. Doubly so if that kind of interview is conducted by an exec or someone less-technical. Beware!

tokioyoyo• 2 years ago

Every single big corpo knows about it. We just haven’t been able to come up with a better filter for the amount of candidates that are going through the interviews that isn’t extremely subjective.

Small companies that I interviews with had a very simple process (2x talks with upper management, mostly technical talks, also a semi-coding related talk about systems). There are a lot of very well paying (maybe 15-20% less than FAANG) jobs out there, but they’re just that fancy looking.

sirwhinesalot5• 2 years ago

I guess FAANGs in particular have rather messy recruitment due to the amount of applicants, but my experience is from a giant multinational, talking hundreds of thousands of employees globally here, not "small" by any stretch.

qwer12343212• 2 years ago

I might be calling obvious but if candidate uses something like this, is this not lying to potential employer?

I'd rather be rejected than got job I'm not qualified to do, that's why I never prepare for interview above studying the actual company- and that is more to give me proper signal if I want to work for them, I want to be motivated to make move on more than just money.

I also have never done leetcode, though I like competitive programming problems, especially bot programming contests on codingame.com

tamimio4• 2 years ago

that's why I never prepare for interview above studying the actual company

You and me both. I just read a bit about the company before applying for the job. In the interview, I ask the interviewer only two questions: what’s the management style? Is it a servant leadership style with autonomous work, or is it a hierarchical task-based one? The second question is, what does an average day-to-day job look like? Sure, there are few stressful days and others are relaxed, but on average you can tell. Is it chaotic, always running against deadlines and having new tasks thrown at you, or is everything sorted out properly? Sometimes, I also ask about the meetings. I personally don’t like useless meetings. A lot of middle management uses meetings as part of the power dynamics and exerting power rather than actually discussing and solving issues.

pmg101• 2 years ago

Of course I would also want the information from your second question, but it never occurred to me that asking directly would get me that information. I guess if it's a leaf node they might just tell you the truth, but in general you'd expect the interviewer to say what they think you want to hear wouldn't you?

shlant• 2 years ago

I'd rather be rejected than got job I'm not qualified to do

As many people have pointed out, the interview process has diverged from real-world, day-to-day tasks you would be expected to accomplish once you get the job. Not actually being able to do a leetcode test (either due to lacking knowledge or interview stress) might not have any reflection on someones ability to succeed in the role they are interviewing for. How many people are dealing with sorting algorithms or traversing binary trees without access to the internet as part of their job?

vunderba2• 2 years ago

It's a 100% unethical and flagrant cheating.

It's no different than if you had a much more technically competent friend off-screen feeding you the answers.

rvz4• 2 years ago

Never fail an online technical interview again

All these online assessment solutions such as leetcode, hackerrank, etc are essentially close to useless given all these AI based cheaters and LLM products being used by candidates.

On-site interviews it is then, and this time you cannot use those LLMs to save you.

wojciechpolak• 2 years ago

How often do doctors have to prove they can still recall every obscure medical fact when changing hospitals? When a lawyer moves to a new firm, do they have to retake the bar or answer weird hypothetical cases all over again? Aren't their credentials, past cases, and reputation usually enough? Why do we in tech keep forcing experienced professionals to jump through these puzzle-like hoops instead of trusting their track record?

bilvar• 2 years ago

Because it's much easier to get-by faking it as a software engineer compared to a lawyer or doctor. We've all have had these colleagues - and I've seen them jumping to other companies easily.

karaterobot• 2 years ago

I don't know if that's true. I'm not saying software engineers don't fake it, but I think many doctors and lawyers are faking it, too, if we're defining faking it as looking up information, or even assisting with your core job responsibilities. I don't consider that faking it, but I think that's what we're talking about, isn't it?

One time I asked my optometrist what he was doing when he left me in the examination room for 15 minutes. He said he was looking up the details of the medicine he was going to prescribe me. I don't consider that incompetence, and it sounds a lot like what I do when I need to know about some technical issue. Everybody in my industry knows that Googling stuff is a huge part of the job, but you're not allowed to acknowledge that in an interview.

I think it is actually an interesting and relevant question: why don't past performance or job references play more of a role in hiring, compared to technical screens many people hate and think are pointless? Checking references and former calling employers—if it's done at all—is often a pro forma final step, rather than the first step, which might plausibly be a more effective way to screen candidates.

pclmulqdq2• 2 years ago

Doctors and lawyers build up immense amounts of "open-source" work that proves their skill. Almost everything a lawyer writes becomes public at some point. Doctors have patient results and billing records that can be checked on a reference call. Software engineers comparatively work in the dark and rely on softly-defined metrics.

ttyprintk3• 2 years ago

New doctors, conventional engineers, and lawyers only come with analytical status, though. That hiring process focuses on what you’re like to work with as a person. I recommend that formula because those domains know how to layout a firm which can avoid malpractice. Those firms compete on problem solving, where 10x skill or availability might eventually mean 10x salary.

Firms which associate disruption with profit are altogether different. No such thing as malpractice; and if there was, they’d prefer to hire the “risk taker”.

jdlshore• 2 years ago

There’s a lot of doctors in my family. They all carry malpractice insurance. I’m told that malpractice lawsuits have a lot more to do with bedside manner than actual performance.

aithrowawaycomm2• 2 years ago

Doctors and lawyers are licensed, software engineers are not. If a doctor or lawyer screws up they will often face sanctions and lawsuits, whereas a software engineer can just jump ship to a different company and let their resume do the talking. In general it is way easier to get 3 years of experience as a software engineer than it is to go to law school and pass the bar.

I am sympathetic to the argument that software engineers should be licensed, which would reduce the need for dumb technical interviews. But I imagine HN wouldn't like that very much.

ryandrake2• 2 years ago

I am sympathetic to the argument that software engineers should be licensed, which would reduce the need for dumb technical interviews. But I imagine HN wouldn't like that very much.

Oh yea, HN hates this idea, but I'm sure it would cut down on all the screening, FizzBuzz, hazing that happens during interviews. If you had a - basic, barebones - certification or exam, that all software engineers must pass, that at least says "This candidate can function at a very minimal level" it would at the very least filter out the 50-75% of candidates who literally cannot code or even speak coherently about the basics of programming.

I think people here are really in love with the romantic ideal that someone with no college, no credentials, no formal-this or certified-that can (in theory) jump right into a senior FAANG job. Yea, that's great I guess, but in practice does it really work? It seems to me that in practice, it just means every company gets thousands of totally unqualified candidates every time they post a job offer, and this helps nobody.

ThrowawayR22• 2 years ago

"How often do doctors have to prove they can still recall every obscure medical fact when changing hospitals?"

Doctors go through 5-7 years of residency with long hours, low pay, and a full fledged physician watching them who can fail them. And that's after an undergraduate degree and medical school.

If you want to endure a 5 year miserable grind just to avoid interviews, go for it.

fitzn• 2 years ago

Doctors, lawyers, teachers and other licensed professionals do continuing education every two or three years. Software engineers are not licensed professionals, so there is no legal standard of quality that all software engineers are guaranteed to have met (and continue to meet). Hence, the interview is an assessment along with all other parts of the application.

kjkjadksj• 2 years ago

“Continuing education” for doctors could mean someone lectured in the university lecture hall for 45 minutes while you nodded off, then you got your free slice of pizza while signing your name on the continuing education form circulating around the room. It’s a farcry from school.

sangeeth962• 2 years ago

Someone beat my lazy ass to it XD

Had something in the works when I first got to know about multimodal GPT and electron made it super simple to prototype something. Refined it a bit to even do the invisible window thing after feedback from my peers. Didn’t have the ahem courage to do it.

Also recently noticed there are actual companies around this space who are marketing this off as “interview assistance”. Two of them I’m aware of:

1. https://www.senseicopilot.com/

2. https://www.finalroundai.com/

——

I’m sure the knee-jerk reaction from the tech industry to these tools would be:

1. Return to in-person interviews

2. Force install spyware/vanguard like crap to scan your whole personal computer before doing the interview

If you are a tech leader/senior engineer with influence on these matters, I *HOPE*, that this is not the path you take. It’s high time FAANG and others stop gatekeeping with these useless rounds that are equivalent to forcing people to hand-solve complex math equations instead of using calculators. I also partly blame the YT influencers who keep peddling this BS but they will stop if the companies themselves take a stance.

You can rather use the same 1 hour slots to have a conversation, pair program on a realistic problem required for the role you’re hiring for where you and the interviewee can both benefit from the knowledge transfer. I’ve tried this in many of the interviews I’ve conducted and always went away learning something from an excellent candidate or a candidate who didn’t meet the expectations, going out knowing where they fall short.

rvz4• 2 years ago

If you are a tech leader/senior engineer with influence on these matters, I HOPE, that this is not the path you take.

On-site interviews should be the standard path to take to detect the frauds and cheaters before they become potential bad hires.

Online technical assessments now have little added value given that AI tools like finalround.ai, etc just make it easy for frauds to cheat the technical interview.

This is actually a strong argument to a return to on-site interviews and should just draw the line on this and detect the frauds altogether.

ttyprintk3• 2 years ago

The fair compensation to fly someone internationally for a face-to-face might make sense if they stay on for 15 years.

05• 2 years ago

2. Force install spyware/vanguard like crap to scan your whole personal computer before doing the interview

People who professionally cheat on online exams just use an HDMI splitter/capture card to inject whatever image they need using a second computer. It’s a lost game.

For offline interviews there are hidden earpieces etc.

dweekly2• 2 years ago

The long term "solution" here for candidates will devolve to a second device that uses a camera and microphone to monitor the device from which they are being tested and presents feedback on a second monitor visible to the applicant but not interviewer.

For interviewers, the solution will be proctored testing centers with metal detectors and all devices required to be in a locker outside the test area. (This is how the FAA conducts its written exams.)

PartiallyTyped• 2 years ago

This whole thing is getting ridiculous and is a symptom of wealth inequality and our cutthroat society that demands we pay for the privilege of being able to work.

dweekly2• 2 years ago

Maybe?

It's also true that pretty much the most powerful AIs in existence are available to anyone willing to fork over twenty bucks a month and you'd be hard pressed to get better algorithmic outputs as a nation state with $100m to blow.

So there's an angle that suggests that this is not primarily a story about wealth inequality but rather savvy in wielding tools.

tail_exchange2• 2 years ago

This kind of tool is why companies will push back towards on-site interviews, and consequently RTO, given that the people who interviewed are the ones who could easily go to the office to be interviewed.

Honestly, it's hard to blame the company. If the employee is willing to lie and cheat even before they were hired, it's expected that companies will take away their tool to do it: remote calls and WFH. As always, the honest worker gets shafted.

tmpz22• 2 years ago

Yeah tech has always been a meritocracy built on ethics and we need to remember that.

tail_exchange2• 2 years ago

Trust.

Some people think that trust just means a someone blindly trusting another, but of course that's not how it works. People will be trusted to an extent that they can be trusted, and this goes for company-employee relations too. If people prove they cannot be trusted with remote interviews, companies will take remote interviews away. This was a luxury given to us during the pandemic, and it's now being rolled back because of tools like these.

I remember people here on HN complaining about CEOs mandating RTO without data to support it. Well, this certainly doesn't help.

rqtwteye• 2 years ago

For a while my company did aptitude tests that basically are measuring certain types of intelligence. I personally found a very good correlation between somebody doing well on those and them fitting into the team.

For some reason (legal?) we stopped and now we are doing interviews that have a way worse correlation.

codedokode• 2 years ago

I wonder: if a LLM can answer typical interview question better than a human, what kind of questions should we ask so that using a LLM becomes worthless? Something that LLMs are forbidden to talk about? Something that LLM doesn't know well?

In my experience, LLMs are pretty bad with low-level languages like Rust/C when you need to deal with pointers and ownership, avoid extra copies.

Another option is to ask for something impossible, as LLMs usually do not admit inability to solve the problem and prefer to hallucinate a fictional solution.

therealdrag02• 2 years ago

“Forbidden to talk about”. That’s thought provoking and hilarious. I’m just imagining politically incorrect leetcode descriptions.

jarsin• 2 years ago

I expect version 2 to be an AI clone of myself so I don't even have to take the interview.

rahimnathwani4• 2 years ago

Here is the bit that makes it invisible:

https://github.com/ibttf/interview-coder/blob/main/electron%...

vunderba2• 2 years ago

Great job on further eroding the trust from a prospective employer.

Require a formal degree in CS? That's gatekeeping.

Need to pass a whiteboard exam? Not representative of the actual work.

Live coding session? Biased against people who don't perform well under pressure.

Take home project? It's too much work to do for free.

Showcase a personal portfolio? Not fair to people with families or other obligations.

Either you enforce a minimal level of competency upfront in the form of an academic degree, industry-standard exams such as a PE Exam, etc. OR you push the entire responsibility of vetting prospective applicants downstream to the employer—which is exactly why interviews are multiple week long gauntlets.

The tech world likes to complain about all of this but other occupations 100% DO have high standards - it's just that it's paid up-front.

Want to become a lawyer? - You've got to pass the LSAT, get into law school, and pass the bar.

Want to become a doctor? - You've got to pass the MCAT, get into medical school, and do residency.

Want to become a pilot? - You've got to get your PPL, pass your check ride, do your IFR, multi-engine, commercial rating, ATP

God there are some days that I ABSOLUTELY HATE THIS INDUSTRY.

thot_experiment4• 2 years ago

If your hiring process is broken by people using AI then the process is either not evaluating the right things, or maybe it's fine because realistically speaking you're hiring a dev who's going to be using AI anyway.

sgarland• 2 years ago

I work in infra. I don’t want an incident to be the time that I find out my coworkers don’t actually know how anything works, and are frantically posting questions to ChatGPT.

That said, I also don’t know how to adequately test, other than to carefully watch people’s eyes during questions; even that isn’t foolproof.

rich_sasha• 2 years ago

Interview performance used to be correlated to job aptitude, but no longer.

dannyeei• 2 years ago

Unfortunately real life problems involve a lot of context and introducing that to interviews is hard. It either requires a long conversation where someone might lose track, or involve writing a large ish code base and getting them to work on that (which is a lot of work, and once again they don’t have context).

In my experience if a problem simple enough to be completed in an hour, it’s simple enough for AI.

rahimnathwani4• 2 years ago

Interviews seek to estimate long-term job performance. Since they cannot measure this directly, they measure attributes that correlate with performance. If you interfere with these measurements (e.g. through fraud), you break those correlations. This doesn't mean the interviews are measuring the wrong thing, or that people who cheat on the interviews will meet the performance bar in the actual job.

If someone uses AI to defeat a CAPTCHA, does that mean the CAPTCHA was poorly designed because "the bot is just as valid a user as any human"? Of course not - the CAPTCHA's entire purpose was to establish that correlation between "can solve this" and "is human," and breaking that correlation through automated tools defeats its purpose entirely.

hilbert42• 2 years ago

I find this all rather intriguing because to me it says more about the employers/interviewers than the applicants.

Over the years I've interviewed many people for technical positions and there are many ways of getting to the core of a prospective employee's competence.

Of course there are questions about training, past experience, qualifications and those about the work you expect them to perform but other matters also enter the equation and they're almost as important (the person's demeanor, confidence, etc.). By letting the person do most of the talking—explaining things about themselves and their work—you can learn a great deal.

Stating the obvious, interviewers ought to be on top of the job they're hiring for but from this story and from other anecdotal info I know that's not always so. In my case as head of the department I was pretty much up to speed on most aspects of the work, so it was clear to me when an applicant was spinning me BS. If they knew more than I did then they almost certainly got the job (life's easier when you've smart employees, for starters one can ask them questions instead of vice versa).

What's that leading up to? Well, when interviewing it was obvious to me (and to the other interviewers) within just the first few minutes whether the person was worth considering. It's uncanny how good one can become at doing this (and my record speaks for itself, I was pretty pleased with those employees I hired).

Let me illustrate with an example: some decades ago I had an applicant apply for an electronics job. He spoke only Chinese and a few broken words in English and none of us on the interview panel spoke Chinese. BTW, he turned up with a Chinese/English dictionary in hand.

I dispelled with many of the questions I usually asked and showed him a somewhat complex circuit diagram with many subsections that performed very different functions (if I showed this at all then it was usually towards the end of an interview).

Within seconds of looking at the diagram he progressed logically through the processes from beginning to the end (note the processes/stages were not drawn in linear progression and consisted of many branches). He did this mainly by pointing.

It was immediately obvious to both my independent technical assessor and me that this guy knew his subject very well. The only point was a minor objection from the nontechnical employment officer who questioned if we'd manage to communicate adequately with someone who didn't speak English. I didn't see that as a significant issue.

He turned out to be an excellent employee who knew his work very well. And within six months his English was good enough not to be an issue.

In summary, if AI is a problem now then it will be more so in the future and that needs to be tackled. That said, I find it hard to accept that an experienced interviewer can't quickly cut to the core even when an interviewee puts up smoke screens and distracting noise.

Like, Popper's falsifiability it doesn't take much to knock a BS or inconsistent argument off its pedestal when one has enough data, refutability usually works well.

That said, one must always keep in mind that just because an applicant can get some things wrong it doesn't mean that he/she isn't the best person for the job. All that tells me is that I have to probe a little deeper.

Edit: asking awkward or trick questions usually ought to be avoided. An interviewee is usually already under considerable stress and can easily be flummoxed when asked them (even if they know the answers they can bind up and not spell them out).

Usually, it's immediately obvious when an interviewee doesn't know an answer to a question or is struggling with it because of stress—body language alone usually makes that abundantly clear. It's then best to gently segue to another question. If the question is really relevant to the job then one can return to it at the end of the interview when the person is more at ease. By then, it's pretty clear to the panel whether the applicant is in the running or not. If not, then do not return to the question.

pockmarked192• 2 years ago

There’s an argument to be made that by the time your business runs out of vetted candidates to hire you’re already staffed at some of the highest levels by corporate parasites who got there by gaming the system, and you can tolerate adding more elsewhere.

BeFlatXIII3• 2 years ago

The pushback is precisely because paying the high standards up front pulls up the ladder that made tech such an attractive option to people without traditional academic skills who managed to be computer whizzes.

Take home projects and personal portfolios are the options that are the best. Those are the ones where candidates are given the time to show their best work and don't require the debt of a college degree in a specific major (whose knowledge is probably largely irrelevant to your day-to-day coding).

jaredklewis• 2 years ago

I prefer our current system over the industry standards exam system you seem to be advocating for. It’s more flexible. Different companies care about different things. Different employees have different strengths. It all works out.

lhamil64• 2 years ago

I'm a little confused about your reasoning that take home projects are too much work to do for free. Aren't lawyers and doctors expected to spend a ton of time studying and taking the licensing exams without being paid (I assume even having to pay for it)? My gut feeling is that's more work than a take home project.

fragmede• 2 years ago

Licensing exam scores are usable for applying generally to all places. A take home I do for company A isn't useful in applying at company B.

gopher_space• 2 years ago

You're complaining about a process you've implemented yourself. Have you tried hiring in a completely different manner?

At what point do you question an approach so easily gamed, or any derived metric?

RadiozRadioz2• 2 years ago

Biased against people who don't perform well under pressure.

I think performance under pressure is a virtue. An important job is never going to be entirely free from stress - you want somebody reliable who will take that in their stride, you don't want someone who will buckle when things get difficult.

I'm all for in-person live collaborative problem solving, be it on a whiteboard or just a discussion. You see first-hand exactly what the person has in their memory, their problem solving techniques, how quickly they get things, their communication skills, and yes, their ability to work under pressure. If done correctly and collaboratively, you get a dry-run of a real design meeting and have some feeling of what it would be like to work with the person.

rootsofallevil• 2 years ago

I think performance under pressure is a virtue. An important job is never going to be entirely free from stress - you want somebody reliable who will take that in their stride, you don't want someone who will buckle when things get difficult.

Some people experience extraordinary high levels of stress in an interview setting. From your comment, I suspect that you are not one of them and might have trouble imagining what these levels of stress feel like.

kazinator2• 2 years ago

Require a formal degree in CS? That's gatekeeping.

Selecting people for a job is literally gatekeeping. The company has the equivalent of a gate (or perhaps an actual one), and most people are kept out of it by the fact that they are not employees or authorized visitors.

No part of would-be employee screening can be faulted for being gatekeeping; i.e. being that which it is.

medicore_duck• 2 years ago

Shut the fuck up. We'll stop cheating when these corps stop making us solve binary search algorithms to interview for front end React roles. Probably 80% of all technical interviews I've had were completely irrelevant to the actual daily work. They engineered this shitty game, we're just playing the game. No one's making you play this game.

aguaviva2• 2 years ago

Live coding session? Biased against people who don't perform well under pressure.

No, it's biased against people who perform perfectly well (sometimes exceptionally well) under real, actual pressure. But who do not take kindly to the bullshit / theatrical pressure typical of the standard interview context, these days. And to companies that just can't tell the difference (or are under the delusion that performance in the latter category is in some way predictive of performance in the former).

Take home project? It's too much work to do for free.

It's more that the companies simply abuse the process in various callous and careless ways -- either by assigning projects with inadequate specification and/or unknown goalposts (or plainly unrealistic expectations of the actual time required, given these ambiguities); or simply assigning scores of these assignments (often automatically to every candidate who applies) when in fact they have no intention of even looking at the vast majority of the submissions.

Easily ameliorated by simply paying people for their time.

trunnell• 2 years ago

I empathize with new grads. It can be hard to stand out especially at the beginning of your career.

But I predict this won’t do what the authors claim: it won’t fix anything, and it won’t change technical interviews that much. At most it might increase the number of companies that require remote candidates to fly in and interview in person to do the same practical coding problems they used to do online. Which would be the standard from just a few years ago, anyway.

Practical coding problems (also known as work simulation interviews) are the most effective and least biased tools available for evaluating candidates. Not every hiring manager does a good job using these tools, but if you see misuse, take it as a sign that the manager might not be good to work for.

I have trouble understanding the authors thinking here that anything would be worth the cost of this: it’s a trust-busting tool where people are deceiving their potential employer. Trust is foundational to everything, in work and in life. We need more trust in our society, not less.

bastawhiz• 2 years ago

The thing I see people getting wrong with live coding interviews (speaking as an interviewer) is that their code rarely matters. If you write some code, I might ask "So what kinds of failure modes will this code need to account for?" Whether you named your variables well or wrote comments didn't matter. If you can't talk about your work or explain your thinking or discuss tradeoffs or question constraints or show your thought process, that's what's going to fail the interview for you. Getting the exact right solution is bonus points, but the job isn't to consistently get things 100% right writing code by hand.

hnfong4• 2 years ago

What you said is true, but it's much easier to do if you (as the interviewer) have full control over the questions and evaluation of the candidate in your interview.

For larger orgs at scale, often the interviewer needs to stick to a script, ostensibly to avoid personal bias (which probably does happen to a degree), and to make scores between interviewers comparable. In such cases it might be difficult for the interviewer to argue that the candidate has done well despite "not getting the answer correct".

A lot of the grievances people have for the interview process are artifacts of scaling the interview process for the largest tech companies. As for the smaller ones, it's basically good ol' cargo-culting. Small startups that follow FAANG processes probably don't realize they can customize their hiring process to their advantage.

dambi0• 2 years ago

If you wanted a completely invisible system you could do it via audio. Speech to text and back again and use a two pairs of same model wireless headphone with say the left ear connected to a hidden device and the right ear to the interview machine.

Other than a bit of practice it would be completely undetectable visually. It’s extra nice that we encourage thinking out loud.

We should assume people are doing this. The solution is interviews that don’t require information that can be looked up or in-person interviews or permitting the use of AI.

xutopia• 2 years ago

I simply give option of candidates to use AI helpers they want. Still a lot come up short. All you need is a baseline that is the same for every candidate and let them differentiate themselves with the same tools they'd use in real live setting anyway.

hackable_sand• 2 years ago

Tech companies are so tall,

they've become scared of their own shadows.

maxnevermind2• 2 years ago

I'd rather just refuse to have a LeetCode interview style interviews all together.

gtirloni• 2 years ago

In my recent experience, CS courses should incorporate acting classes to help future job seekers. Right now more interviewees than I expected are doing a really bad job at trying to fool interviewers with LLMs and tools like this one. It's blatant obvious and too easy to catch cheaters (and then they are banned from any future positions on ethical grounds).

kazinator2• 2 years ago

I'm thinking: could you just not use second (or third ...) monitor, while only the primary desktop is being recorded?

biggedyb• 2 years ago

:) this took a bit of thought to get the right words..

I am ALL for this, for a number of reasons: - will help people 'find the words' - it's pretty easy to spot someone who doesn't actually know what they are talking about, even if what they are saying is correct and valid - actual technical capability is only a small part of the job.

:D so, 'find the words', interviews can be stressful as all hell for both sides, as someone who assumes the power of the interviewer that's a heavy stick to wield over someone who is trying to explain why they very much want to be paid by you. Communication is _hard_, even if you gel with someone, actually explaining something to them in a way that both people completely grok can be really hard. If someone joined and front and centre said 'I'm using AI to help me with my answers because I find interviews hard' I'd sit up straight and be all 'cool! lets do this!'

'Are you sure about that? what did it feel like?', ok so this one is VERY subjective but it's a pretty solid baseline to go on. Interviews should be a verification that they actually are interested in working with you and that you are interested in working with them. So to be able to make that judgement you and they have to get to a point where the interview can be concluded, and whilst there's a fair chunk of other stuff to go through, technical understanding is important. To be clear, lack of it is fine, that's why different levels exist, you want to be a software engineer but you have no experience or skill? Well ok but you will be starting at the bottom. Now to that, there will sometimes be people who want to 'show a higher level of capability than they have current attained' and that's what my job is, to try and see that when it happens. It's pretty easy to do to be fair, humans experience deeply, computers do not. So if I want to talk about Entity Framework Linq helpers then I'll be looking for the spark of excitement when it suddenly pinged to them that this is WAY easier! And pretty! It makes the queries dance! ..and yes, that's my experience, but it doesn't take much to guide people on sharing their excitement in this stuff, and frankly if you get to the end of the interview and _haven't_ found that excitement or deep interest then skill level aside, you've probably already got your answer.

Finally is around how relevant is a specific level of technical capability? As I said, that's what we have graded levels for (junior, senior etc), and besides this whole bag (for me at least) is much more about how you solve problems than what you specifically know. I've seen people wildly switch careers into software and sure, there's a lot of hand-holding and stuff early on cos it's a proper throw into the deep end, but it's the mind, not the current capability.

edude03• 2 years ago

Honestly I worry more about hiring an oppositional / defiant / insubordinate “asshole” more than the AI use itself because what does it say about an applicant if their first instinct when challenged is to say “your process is invalid, I’m going to cheat instead”?

RecycledEle• 2 years ago

As much as I hate cheating, I wonder if these apps will lead to invisible and ubiquitous AI helping us navigate life.

As a teacher, it is my job to make sure my students control that AI instead if being controlled by the AI.

markgoho• 2 years ago

what interviews get wrong is they typically assess a candidate's lower level thinking skills rather than their higher level thinking skills

cf. https://cft.vanderbilt.edu/guides-sub-pages/blooms-taxonomy/

Typical interview question (lower-level thinking, remember): List the primitives in JavaScript. (remember)

Better interview question (lower-level thinking, apply): When would you use an object instead of an array in JavaScript?

Really good interview question (higher-level thinking, evaluate): Here's some raw data that we'd like to put in a database, what data structures would you recommend and why?

An invisible desktop application that will help you pass technical interviews

Related Stories