Skill Tracer
Skills › Knowledge Work Plugins › hiring-screener › rubric.md

rubric.md

122 lines · small-business/skills/hiring-screener/reference/rubric.md at 2574e29

Open on GitHub

Most marks come from matching words in the file, so treat them as pointers.

1# The rubric
2
3The list of things the job actually requires. Everything downstream is measured against it and nothing else.
4
5---
6

The rubric

The list of things the job actually requires. Everything downstream is measured against it and nothing else.


Raw lines 1 to 6
7## Where it comes from
8
9**In order of preference:**
111. **From `job-post-builder`.** That skill produces the post, the structured interview guide, and the scoring rubric together. If it ran, the rubric already exists and is already agreed.
122. **Derived from the job post.** Read the post and pull out every stated requirement, responsibility, and preference. Show it back for correction.
133. **Built with the owner now.** Fifteen minutes of questions. Use this only when there is no post.
15**Do not read resumes before the rubric exists.** Once you have seen the candidates, the rubric gets written to fit whoever looked good, which is exactly backwards and impossible to defend later.
17---

Where it comes from

In order of preference:

  1. **From job-post-builder.** That skill produces the post, the structured interview guide, and the scoring rubric together. If it ran, the rubric already exists and is already agreed.
  2. Derived from the job post. Read the post and pull out every stated requirement, responsibility, and preference. Show it back for correction.
  3. Built with the owner now. Fifteen minutes of questions. Use this only when there is no post.

Do not read resumes before the rubric exists. Once you have seen the candidates, the rubric gets written to fit whoever looked good, which is exactly backwards and impossible to defend later.


Raw lines 7 to 18
Names a skill job-post-builder :11
19## What goes in it
21Three tiers, and the tier matters more than the wording.
23**Must-have.** Absence disqualifies. Keep this list short and honest — three or four items. A must-have that is really a nice-to-have shrinks the field for no reason and disproportionately screens out good candidates from non-traditional paths.
25Examples: the license the work legally requires, a clean driving record for a driving role, availability for the actual shift.
27**Should-have.** The real differentiators. Weighted, scored, and where the ranking comes from.
29Examples: years doing comparable work, specific systems or equipment, scale handled, supervisory experience where the role includes it.
31**Nice-to-have.** Small positive weight. Never disqualifying.
33---

What goes in it

Three tiers, and the tier matters more than the wording.

Must-have. Absence disqualifies. Keep this list short and honest — three or four items. A must-have that is really a nice-to-have shrinks the field for no reason and disproportionately screens out good candidates from non-traditional paths.

Examples: the license the work legally requires, a clean driving record for a driving role, availability for the actual shift.

Should-have. The real differentiators. Weighted, scored, and where the ranking comes from.

Examples: years doing comparable work, specific systems or equipment, scale handled, supervisory experience where the role includes it.

Nice-to-have. Small positive weight. Never disqualifying.


Raw lines 19 to 34
35## Weighting
37Assign weights to the should-have criteria totaling 100. Force the owner to make the trade-off explicitly, because they are making it either way.
39Ask directly: "If one candidate has five years of commercial rooftop work and no supervisory experience, and another has two years plus three years leading a crew — who do you want in the room?" The answer sets the weights faster than any abstract discussion.
41**Cap any single criterion at 40.** Above that the rubric is really a one-question screen, and everything else is decoration.
43---

Weighting

Assign weights to the should-have criteria totaling 100. Force the owner to make the trade-off explicitly, because they are making it either way.

Ask directly: "If one candidate has five years of commercial rooftop work and no supervisory experience, and another has two years plus three years leading a crew — who do you want in the room?" The answer sets the weights faster than any abstract discussion.

Cap any single criterion at 40. Above that the rubric is really a one-question screen, and everything else is decoration.


Raw lines 35 to 44
45## Writing a criterion so it can be scored
47A criterion has to be checkable against a resume. Vague criteria get scored on impressions.
49**Bad:** "Strong communicator." Unmeasurable from a resume, and in practice it becomes a proxy for writing polish, which is a proxy for schooling.
51**Good:** "Has worked directly with commercial customers on site — scheduling, explaining work, handling complaints." Now there is something to look for and quote.
53**Bad:** "Culture fit." Not a criterion. It is the place unexamined preference hides, and it will not survive being read aloud.
55**Good:** Whatever the owner actually means by it, stated as behavior: "Has worked in a small team without a dispatcher, self-directed on route."
57---

Writing a criterion so it can be scored

A criterion has to be checkable against a resume. Vague criteria get scored on impressions.

Bad: "Strong communicator." Unmeasurable from a resume, and in practice it becomes a proxy for writing polish, which is a proxy for schooling.

Good: "Has worked directly with commercial customers on site — scheduling, explaining work, handling complaints." Now there is something to look for and quote.

Bad: "Culture fit." Not a criterion. It is the place unexamined preference hides, and it will not survive being read aloud.

Good: Whatever the owner actually means by it, stated as behavior: "Has worked in a small team without a dispatcher, self-directed on route."


Raw lines 45 to 58
59## The scale
61Four points per criterion. More granularity is false precision from a one-page document.
63| Score | Means |
64|---|---|
65| 3 | Clear evidence, at or above what the role needs |
66| 2 | Evidence of something close or adjacent |
67| 1 | Little evidence, but not contradicted |
68| 0 | Absent, or evidence points the other way |
69| — | Cannot assess from what was submitted |
71**The dash is not a zero.** It routes the candidate to the "cannot assess" band and generates a question, not a rejection.
73---

The scale

Four points per criterion. More granularity is false precision from a one-page document.

ScoreMeans
3Clear evidence, at or above what the role needs
2Evidence of something close or adjacent
1Little evidence, but not contradicted
0Absent, or evidence points the other way
—Cannot assess from what was submitted

The dash is not a zero. It routes the candidate to the "cannot assess" band and generates a question, not a rejection.


Raw lines 59 to 74
75## The scoring math
77One formula, used for every candidate:
79**weighted = sum(score ÷ 3 × weight) over scored criteria; dashes excluded from numerator and denominator; report as % of assessed weight.**
81Read that as three rules:
831. **Each scored criterion contributes score ÷ 3 of its weight.** A 3 earns the full weight, a 2 earns two-thirds, a 1 earns one-third, a 0 earns none.
842. **A dash is excluded from both sides.** It does not earn points and its weight drops out of the total the candidate is measured against. That is what keeps a missing fact from acting like a zero.
853. **Report the result as a percentage of the weight actually assessed**, and say how much weight that was.
87Worked through, for a candidate scoring 3 on rooftop (weight 35), 3 on diagnostics (25), 2 on customer contact (20), and dashes on work orders (15) and controls (5):
89```
9035 × 3/3 = 35.0
9125 × 3/3 = 25.0
9220 × 2/3 = 13.3
93 73.3 points earned
94Assessed weight 80 (100 less the 20 behind the two dashes)
95Reported score 73.3 ÷ 80 = 92
96```
98Always show the assessed weight next to the score. 92 out of 80 assessed weight is a very different candidate from 92 out of 100, and the difference is exactly the questions worth asking them.
100---

The scoring math

One formula, used for every candidate:

weighted = sum(score ÷ 3 × weight) over scored criteria; dashes excluded from numerator and denominator; report as % of assessed weight.

Read that as three rules:

  1. Each scored criterion contributes score ÷ 3 of its weight. A 3 earns the full weight, a 2 earns two-thirds, a 1 earns one-third, a 0 earns none.
  2. A dash is excluded from both sides. It does not earn points and its weight drops out of the total the candidate is measured against. That is what keeps a missing fact from acting like a zero.
  3. Report the result as a percentage of the weight actually assessed, and say how much weight that was.

Worked through, for a candidate scoring 3 on rooftop (weight 35), 3 on diagnostics (25), 2 on customer contact (20), and dashes on work orders (15) and controls (5):

35 × 3/3  = 35.0
25 × 3/3  = 25.0
20 × 2/3  = 13.3
                    73.3 points earned
Assessed weight     80  (100 less the 20 behind the two dashes)
Reported score      73.3 ÷ 80 = 92

Always show the assessed weight next to the score. 92 out of 80 assessed weight is a very different candidate from 92 out of 100, and the difference is exactly the questions worth asking them.


Raw lines 75 to 101
102## Worked example — Okonkwo Mechanical, Commercial Service Tech
104```
105MUST-HAVE
106 EPA 608 Universal certification
107 Valid driver's license, insurable record
108 Available weekdays 7am-4pm, on-call rotation 1 week in 4
110SHOULD-HAVE (weighted to 100)
111 35 Commercial rooftop unit experience — install, service, or both
112 25 Diagnostic depth on packaged units and splits
113 20 Direct customer contact on site
114 15 Documented work orders / service records
115 5 Controls and BAS familiarity
117NICE-TO-HAVE
118 Refrigeration experience beyond HVAC
119 Spanish
120```
122Note what is not there: no degree, no "professional appearance," no minimum years figure that would exclude a strong two-year tech. Everything listed is something Ray would defend out loud to the person he did not hire.

Worked example — Okonkwo Mechanical, Commercial Service Tech

MUST-HAVE
  EPA 608 Universal certification
  Valid driver's license, insurable record
  Available weekdays 7am-4pm, on-call rotation 1 week in 4

SHOULD-HAVE (weighted to 100)
  35  Commercial rooftop unit experience — install, service, or both
  25  Diagnostic depth on packaged units and splits
  20  Direct customer contact on site
  15  Documented work orders / service records
   5  Controls and BAS familiarity

NICE-TO-HAVE
  Refrigeration experience beyond HVAC
  Spanish

Note what is not there: no degree, no "professional appearance," no minimum years figure that would exclude a strong two-year tech. Everything listed is something Ray would defend out loud to the person he did not hire.

Raw lines 102 to 122