Hiring Scorecard: One Role How-to
Write the scorecard from 6-month outcomes backward. If you cannot describe what great looks like on the job, you will hire for interview polish. Lock must-haves before you see resumes. Do not retrofit a scorecard after you have already fallen for a candidate.
This play drafts one role in 45–60 minutes. It is structured practice for hiring managers and recruiting partners, not legal counsel on discrimination law, and not a claim that any template is “bias-proof.” Follow company policy and qualified counsel for compliance. Deep guide: How to hire as a manager. Literacy hubs: How HR works, HR for humans, New Manager hub.
Play card
| Field | Detail |
|---|---|
| Time box | 45–60 minutes to draft one role scorecard |
| Players | Hiring manager; recruiter/HR partner if available; interview panel (calibrate later) |
| Goal | One-role scorecard + interview question-to-criteria map |
| Done looks like | Must-haves locked before sourcing; panel agrees to score only what is on the card |
When to use
- Before the job posts, or at latest before the first interview.
- First-time hiring managers who need a shared artifact with recruiting.
- Replacing a vague “culture fit” loop with observable evidence.
- When role outcomes are clear enough to borrow from a delegation-style outcome statement.
When not to use
- Do not improvise criteria mid-loop as candidates appear.
- Do not retrofit criteria to justify a favorite.
- Do not include criteria that proxy for protected classes (age, family status, disability, religion, and other inappropriate filters). Education only: never treat this play as a jurisdiction-specific compliance manual.
- Do not invent company-wide leveling systems here. One role, current hire.
Prep before or at the start of the box
Bring: draft req or role notes, 30/60/90 success sketch, known constraints (level, location, comp band if you have them), and names of likely interviewers. If outcomes are fuzzy, spend the first ten minutes writing them. Outcome clarity beats clever rubrics.
Steps inside the time box
- Outcomes backward (10 min). What should be true at 6 months if this hire works? List three to five outcomes.
- Must-haves vs nice-to-haves (10 min). Must-haves are bar-to-hire. Nice-to-haves never rescue a failed must-have.
- Evidence signals (10 min). For each must-have, write what you would see in stories, work samples, or references. Ban vibe words (“rockstar,” “hungry”) unless translated into behavior.
- Rating scale (5 min). Use your company’s scale if one exists. If not, a simple consistent scale (e.g., 1–4 with defined anchors) is enough. Keep anchors short and behavioral.
- Map questions to criteria (10–15 min). Each interview slot owns specific must-haves. No duplicate “tell me about yourself” that scores nothing.
- Panel calibration note (5 min). Draft the script below. Schedule a 15-minute calibration before interviews start.
- Freeze the card. Changes after interviews begin require an explicit team decision, not a silent shift per candidate.
Scorecard template
Role:
Level / team:
6-month outcomes:
1.
2.
3.
Must-haves (bar):
| Criterion | Evidence signals | Interview owner | Question prompts |
| --- | --- | --- | --- |
Nice-to-haves (not bar):
| Criterion | Evidence signals | How we’ll weight |
| --- | --- | --- |
Out of scope / non-criteria (explicitly not scored):
Rating scale + anchors:
Debrief rule: score independently first; discuss evidence; no average of vibes.
Sample (fictional, labeled sample) for Customer Support Lead: 6-month outcomes: stabilize first-response SLA ownership, coach two agents, ship a FAQ refresh with Support + Product. Must-haves: prior ownership of a queue metric; coaching example with behavioral change; clear written escalation judgment. Nice-to-have: SaaS tool familiarity. Non-criteria: “fun energy in the room” as a standalone score.
Scripts
Panel alignment
“We score only what’s on the card. Must-haves are the bar. Nice-to-haves don’t override a failed must-have. Write evidence before the debrief. We don’t move the bar between candidates.”
Debrief discipline
“Independent scores first. Then evidence. If we lack evidence for a must-have, that’s a gap, not a gut yes. Disagreements get resolved with examples, not seniority volume.”
When debriefs get heated, borrow composure habits from Difficult conversation prep: one primary issue, observable examples, no pile-on.
Output artifact
- One-role scorecard (outcomes, must-haves, nice-to-haves, evidence, scale).
- Interview plan: who covers which criteria and with which prompts.
- Short calibration note sent to the panel.
- Empty score sheets ready before candidate one.
Optional: share the outcome section with recruiting so sourcing language matches the job, not a fantasy persona.
Running the debrief with the card
- Silent score against the card.
- Round-robin by criterion, not by overall “I liked them.”
- Flag missing evidence as “unknown,” not “fine.”
- Decide: advance / hold for more signal / reject against must-haves.
- Capture reasons tied to criteria for your record-keeping process as policy requires.
Watch-outs
- Shifting bar per candidate: The silent killer of fairness.
- Affinity bias: Shared hobbies are not must-haves.
- Over-weighting polish: Interview performance is not job performance. Prefer work-relevant evidence.
- Illegal or inappropriate criteria: Do not score medical, age, family planning, or similar. When unsure, ask HR. This play does not replace counsel.
- Consensus theater: Loudest interviewer wins unless you force evidence order.
- Stats theater: No invented validity percentages here. Structured practice is the point.
Education only vs policy
Use this play to think clearly. Company handbooks, approved interview guides, and legal/HR review govern what you may ask and how you retain notes. When topics touch accommodation, leave, or adverse decisions, partner with HR early (When to talk to HR vs manager).
Related hubs and plays
- New Manager hub · How HR works · Recruiting (site area) via hiring literacy on HR for humans
- Delegation without dumping play · Difficult conversation prep
- Hiring: writing a req, interviewing, deciding