Hiring and onboarding

Hiring is deciding who joins, against a bar defined before anyone is interviewed, through a process that measures capability instead of impression. Onboarding is the work that turns a good hire into a contributing one, and its absence is the usual reason a good hire fails. The competency is structured, calibrated evaluation in place of gut feel. Few decisions a manager makes carry more weight. A weak engineering hire costs a team a year, a weak manager appointment costs every person on that team, and a weak executive hire can cost an organisation years it does not get back. The stakes grow with scope, and so does the temptation to skip the structure, because senior hiring feels like a judgment about people more than a process to be run. It is both. The examinations test hiring because its failure modes are so consistent: the bar lowered because the seat has been open too long, the single impressive signal that colours everything, the senior hire left to sink, and the interview that measured which tools a candidate was allowed when it should have measured what they can do.

1. Define the bar before the first interview. Decide what the role must be able to do, and at what level, and write it down before any candidate is seen. A bar defined during the process ends up defined by the candidates in it.
2. Structure beats impression, and it is also fairer. Ask consistent questions mapped to a rubric and score them independently before any discussion. This is one of the better-evidenced claims in management. Structured interviews predict performance markedly better than unstructured ones, and the same structure makes them less biased.
3. Assess what a candidate can do, not which tools they were permitted. What matters is whether the person can reason, design, judge and explain. Whether an assistant was in the room matters only as far as the interview shows what the candidate understood of what it produced.
4. Hold the bar under pressure. A bad hire costs far more than an empty seat, and the pressure of the open seat is when the bar is most at risk. If the process is not finding people, change the process or the sourcing and leave the standard alone.
5. Onboarding is where the hire is activated or wasted. It needs explicit outcomes for the first quarter, an early real contribution, a named guide, and context written down instead of held as tribal knowledge. The more senior the hire, the more onboarding becomes integration into norms, relationships and how decisions really get made, and the more often its absence turns out to be the cause of failure.
6. Intervene early on a hire that is not landing. Three months of thin results and a sceptical team is a signal to diagnose and support now. Waiting politely for certainty at six months is a mistake, and so is concluding on the spot that the hire was wrong.

Hiring is unusual among the competencies in this standard because its central claim has strong empirical support, and the unit grades it to match.

Structured interviews research

Frank L. Schmidt and John E. Hunter, The Validity and Utility of Selection Methods in Personnel Psychology: Practical and Theoretical Implications of 85 Years of Research Findings (1998) is a meta-analysis covering eighty-five years of selection research. It finds that structured interviews are among the most valid predictors of job performance available, well ahead of unstructured interviews, and that combining them with a work sample or an ability measure improves prediction further. They work by reducing noise, through the same questions, a defined rubric and independent scoring before discussion. On its own, though, structure does not remove bias. A rubric written by one person encodes that person's assumptions, and the remedy is deliberate design and a panel whose members do not all share them.

Calibration practice

Calibration means aligning interviewers, and later managers, on what "meets the bar" means, so the same capability earns the same decision whoever assessed it. It has no single provenance. It is the operational partner of structured interviewing and the mechanism that keeps a hiring bar consistent across teams and over time. Without it, structure yields consistent scores that mean different things to different scorers.

The halo effect research

Edward L. Thorndike, A Constant Error in Psychological Ratings (1920) described it and it has been replicated many times since: one salient positive trait colours the assessment of unrelated traits. In hiring it is the impressive credential, the strong first answer or the fluent presentation that lifts every later score. The direct countermeasure is independent scoring on each criterion before discussion. A panel debrief that opens with overall impressions brings back the effect the structure took out. A related bias, affinity (favouring people like oneself), is the reason panels should not resemble the manager.

The first ninety days practice

Michael D. Watkins, The First 90 Days: Critical Success Strategies for New Leaders at All Levels (2003) frames a new role as a transition with work of its own: learning, early wins, and building the relationships the role depends on. For engineers this becomes explicit 30-, 60- and 90-day outcomes with a first shippable task. For senior leaders it is mostly integration. The book's central point holds for both, that a transition left to happen by itself usually goes badly. A plan does not replace a relationship, and no checklist replaces the support behind it.

Hiring as a system practice

At organisational scale hiring is a system with a throughput and a quality, and Will Larson, An Elegant Puzzle: Systems of Engineering Management (2019) treats it as one. That covers sourcing, a bar that survives growth, calibration across many interviewers, and the choice between internal promotion and external hire, which becomes a portfolio decision instead of a series of one-offs. Seen as a system, the failure shows up before it is felt. A bar that drifts one interviewer at a time cannot be seen in any single hire and is obvious over a year.

The role brief and rubric

Before sourcing begins, a one-page brief states what the role must be able to do, the two or three criteria that matter most, and what "meets the bar" looks like for each. The rubric comes from the brief, never from whatever recent candidates happened to show. Every interviewer scores every criterion independently and in writing before the debrief.

The debrief that starts with scores

The panel meets with scores already submitted. The debrief starts with the criterion on which scores diverge most, ahead of anyone's overall impression, and the most senior person speaks last. Divergence is the signal the process exists to surface. Settling early on one strong opinion lets back in the halo the structure removed.

Capability-first exercises

A technical exercise, where one is used, is designed so the candidate's reasoning shows whatever tools they use. They explain the approach, defend the trade-offs and change the result when a requirement changes. An exercise that can be passed by pasting output measures nothing the role needs.

The first-quarter plan

Every hire has a written plan for the first quarter. It sets outcomes at thirty, sixty and ninety days, a first real contribution small enough to ship in the first fortnight, a named guide who is someone other than the manager, and the documents holding the context the team would otherwise carry in its heads. For a senior hire the plan also names the relationships to build and the decisions to watch before making any.

The three-month check

At three months the manager asks themselves two questions. Is this person doing what the brief said the role must do, and does the team think so? If either answer is uncertain, the conversation with the hire happens that week, naming the specific gap and offering support. It is a diagnosis and a repair, and it delivers no verdict.

At team scope the object is an individual hire and their first quarter, and the manager runs the process in person. At organisational scope it becomes the team's hiring bar as a system, calibration across teams so that transfers between them work, and the appointment of managers, which is a hire into a new profession and is onboarded as one. At executive scope the object is the hiring system itself, meaning a bar that survives the organisation doubling in a year, along with the senior and executive appointments. There, choosing between an unproven internal candidate and a proven external one has no formula; the choice must be made consciously and resourced whichever way it goes. The pattern is in How Judgment Scales; who is selected to lead, and why, is PL-6 Leading through leaders.

• Defines the bar first and writes the rubric from it, not from the candidates. team
• Runs structured, calibrated interviews and scores independently before discussion.
• Holds the standard when the seat has been open too long, and changes the sourcing instead. team
• Designs onboarding for an early real contribution, a named guide, and written context. team
• Assesses what a candidate can reason and explain, whatever tools were in the room.
• Failure mode: lowering the bar because the search is dragging. team
• Failure mode: over-indexing on a single impressive signal. team
• Failure mode: "onboarding" that is a week of reading with no real task. team
• Failure mode: assuming a strong hire needs no support. team
• Failure mode: a panel that all resembles the manager, and a rubric nobody has examined for what it assumes.
• Calibrates the hiring bar across several teams so the same capability earns the same decision. org
• Treats a manager appointment as a hire into a new profession, and onboards it as one. org
• Intervenes early and supportively on an external manager hire that is not landing at three months. org
• Failure mode: leaving an external hire to sink or swim, then concluding they "weren't a fit". org
• Failure mode: hiring bars that drift apart team by team until transfers fail. org
• Makes the internal-versus-external bet for a senior seat consciously and resources whichever is chosen. exec
• Treats senior onboarding as where the real risk lies, with norms, sponsorship and early direct feedback before any conclusion. exec
• Runs a hiring system whose bar survives growth. exec
• Failure mode: defaulting to the "safe" external hire and under-supporting them anyway. exec
• Failure mode: concluding a struggling senior hire is not a fit without having integrated them. exec

Speed versus standard. Every week a seat stays open costs the team, and every week of pressure wears down the bar. The answer is never to move the bar. Move everything else instead (sourcing, process latency, which items in the brief are must-haves and which are nice-to-haves) and state openly what the empty seat is costing, so the trade-off can be seen.

Structure versus judgment. Structured interviews predict better, and experienced managers feel that structure suppresses what they know. Both are true. Judgment belongs in designing the rubric and reading the evidence. It does not belong in overriding the scores with an impression, which is the very noise the structure exists to remove.

Capability versus fluency. A candidate who presents well, or who quickly produces a polished artifact with assistance, looks capable. The interview has to tell capability from fluency, and doing so takes time and design effort that pressure argues against.

Internal versus external. The internal candidate knows the organisation and has a visible track record, and has not done the job. The external candidate has done it somewhere else and has to integrate. Neither is safe. The discipline is to choose consciously and then pay for the risk of the choice: coaching and air cover for a promotion, deliberate integration for a hire.

Fit versus sameness. A panel converges fastest on candidates who resemble it and calls the result fit. Part of what passes for fit is real, in the sense of shared standards, and part is affinity. The structure exists to tell them apart, and a panel that never disagrees offers no evidence that it has.

A head of engineering has to fill a vice-president seat leading a third of the organisation, and has two candidates. The internal candidate is a director who has run one strong team of teams for two years, is trusted by their people, and has never operated at the new scope. The external candidate has held the equivalent role at a larger company, interviewed well, and would arrive with no relationships here and a very different working culture behind them. The board's chair has said, informally, that the external hire is "the safe choice".

There is no formula. The first judgment is to reject the idea that either option is safe. The external hire carries integration risk, which is usually underestimated and is usually why such hires fail. The internal promotion carries scope risk, which is visible and for that reason usually given too much weight. The head of engineering writes both risks down in the same terms and asks what each choice would commit the organisation to.

They run the process they would run for any hire, at this scope. The role brief comes first. It names the criteria that matter most for this seat, which here are the ability to hold a strategy steady across several organisations and to develop the directors below. Both candidates are assessed against those criteria with the same structure, by a panel that includes peers the seat will work with. Being known does not exempt the internal candidate from the process, and the external candidate gets no credit for scale they have not yet shown here.

On the criteria that matter most, the evidence favours the internal candidate, and the head of engineering makes the promotion. They then resource the decision as the bet it is. There is an explicit conversation about what the new scope demands and where the director has not yet operated, a coaching arrangement for the first two quarters, and visible air cover: the head of engineering sends questions to the new vice-president in front of the leadership team and does not answer for them. The board chair hears the reasoning, the criteria and what the organisation is doing to make the bet succeed.

Had the evidence pointed the other way, the same discipline would have applied in reverse. The external hire's first ninety days would have been treated as where the risk lay, with explicit norms, a sponsor on the leadership team, and direct feedback in the first month instead of a verdict in the sixth. In neither case does the head of engineering choose by asking which option will be easier to defend if it fails.

• PL-6 Leading through leaders: who is selected to lead, on what evidence, and what they are owed in their first six months.
• CC-3 Inclusive practices and equitable opportunity distribution: affinity, panels that resemble the manager, and the fair distribution of opportunity, which begins at hiring.
• PL-4 Performance management: what happens when a hire is not meeting the bar, with expectations, support and honest consequences.
• PL-5 Career development and growth paths: the growth path a hire is joining, with internal candidates as its product.
• TJ-5 AI-assisted engineering: assessing capability rather than tool access, and what AI assistance changes about the work being hired for.

1. Why are structured interviews both more predictive and more equitable than unstructured ones?
   Answer

   They reduce noise. With the same questions, a defined rubric and independent scoring, the assessment tracks the candidate instead of the interviewer's mood, first impression or affinity. The mechanism that improves prediction also removes much of the room for bias.
2. The seat has been open for four months and the team is exhausted. What changes, and what does not?
   Answer

   Sourcing, process latency and the brief's true must-haves can all change, and the cost of the empty seat should be stated openly. The bar stays where it is, since a bad hire costs more than the empty seat ever did.
3. What is the halo effect and what specific step in the process counters it?
   Answer

   One salient positive trait colouring the assessment of unrelated ones. It is countered by independent scoring on each criterion, submitted before the debrief, and by a debrief that starts with the divergent scores instead of overall impressions.
4. An external manager hire is three months in with thin results and a sceptical team. What do you do, and what are the two mistakes? org
   Answer

   Diagnose specifically what is not working, name the expectations, and support the correction now. The two mistakes are waiting politely for clarity at six months and concluding on the spot that the hire was wrong. Most senior-hire failures are integration failures that nobody addressed.
5. How should an interview establish capability when candidates may use AI assistance?
   Answer

   By making reasoning visible whatever the tools. The candidate explains the approach, defends the trade-offs, and changes the result when a requirement changes. An exercise that can be passed by pasting output measures nothing the role needs.
6. When does an unproven internal candidate beat a proven external one for a senior seat, and what does the choice commit you to either way? exec
   Answer

   When the evidence on the criteria that matter most for the seat favours them; there is no formula. A promotion commits you to coaching and visible air cover for the step up, and an external hire commits you to deliberate integration in the first ninety days. Neither option is safe, and the failure is choosing whichever is easier to defend.
7. A technically strong senior hire from a very different company culture is clashing with their new organisation at two months. What comes before any conclusion? exec
   Answer

   Integration: explicit norms, a sponsor, and early direct feedback. This is usually an integration problem before it is a capability problem, and capability cannot be judged until integration has been attempted.

• Frank L. Schmidt and John E. Hunter, The Validity and Utility of Selection Methods in Personnel Psychology: Practical and Theoretical Implications of 85 Years of Research Findings (1998): the validity of structured interviews and other selection methods.
• Edward L. Thorndike, A Constant Error in Psychological Ratings (1920): the halo effect.
• Michael D. Watkins, The First 90 Days: Critical Success Strategies for New Leaders at All Levels (2003): the transition as its own work; early wins and integration.
• Will Larson, An Elegant Puzzle: Systems of Engineering Management (2019): hiring as a system; bars that survive growth.