Back to Cookbook

Anchored Scorecard Builder

Replace vague ratings with evidence-based scoring

Builds scorecards with behaviorally anchored rating scales so interview feedback becomes comparable, faster to synthesize, and less biased.

CommunityWork5 min

PROMPT

Create a skill called "Anchored Scorecard Builder". Inputs: - Role and competencies (or infer from JD) - Interview stages and who is interviewing Output: 1) Scorecard criteria (6–10) mapped to competencies 2) Rating anchors for each criterion (1–5): - 1 = concerning - 3 = meets bar - 5 = exceptional 3) Required evidence fields (notes must cite examples) 4) "Overall recommendation" rules that prevent halo effects

How It Works

Define the role and competencies. The skill creates a scorecard with

anchored ratings that force interviewers to cite evidence, not vibes.

What You Get

  • 6–10 scorecard criteria mapped to competencies
  • Anchored rating scale (1–5) with descriptions for each level
  • Required evidence fields
  • Overall recommendation rules to prevent halo effects

Setup Steps

  1. Paste the role description and competencies (or let the skill infer from JD)
  2. Map interviewers to stages
  3. Share the scorecard with all interviewers before loops begin
  4. Collect and synthesize results

Tips

  • "Meets bar" anchors (level 3) are the most important — get those right first
  • Required evidence fields are what make this work — no evidence, no score
  • Halo-effect prevention rules catch "great person, can't explain why" ratings
  • Pair with the Interview Debrief Summarizer for synthesis
Tags:#recruiting#interviewing#scorecards#calibration