You just finished a great interview. The candidate was charming, smart, quick on their feet. You walk out thinking “yes, hire.”
Two months later they’re struggling, and you can’t quite explain why. Welcome to vibes-based hiring, the silent killer of small-team productivity.
Why gut feel fails
Humans are pattern-matching machines, and interviews are the worst possible environment for accurate judgment. We favor candidates who remind us of ourselves, who went to similar schools, who laugh at our jokes.
Google’s Project Oxygen and decades of I/O psychology research point the same direction. Structured interviews predict job performance roughly twice as well as unstructured ones.
Without a scorecard for interviewing candidates, your team ends up arguing about personalities instead of evidence. The loudest voice in the room wins. The quiet candidate who would have crushed the job gets passed over.
A simple 1-to-5 scorecard that actually works
You don’t need fancy software. You need 4 to 6 competencies tied to the role, and a 1-to-5 scale where 3 is “meets bar” and 5 is “exceptional.”
For a mid-level engineer, try: technical depth, ability to design a system under constraint, code quality judgment, communication with non-engineers, ownership and follow-through, and cultural contribution. Each gets a number from 1 to 5, plus one or two lines of evidence from the interview.
The magic is the evidence field. A score without a reason is just a vibe wearing a number. Forcing interviewers to write “scored 4 because they caught the race condition in 3 minutes” pushes thinking toward signal.
Making the scorecard part of the process
Build the scorecard before you write the job description. If you can’t define what “great” looks like across 5 competencies, you don’t know what you’re hiring for.
Before the debrief, every interviewer submits their scorecard independently. No Slack chats, no hallway chats. Independent scoring prevents anchoring, which research suggests can swing group decisions by 30 to 40 percent.
At debrief, you compare numbers first, discussion second. Big gaps are the most useful conversations you’ll have. That’s where hidden assumptions surface.
Sieve handles the upstream work, screening CVs against your role criteria and surfacing the top candidates with reasoning, so your scorecard gets used on people actually worth your time. See how at sievecv.com.