Market signal

How to Assess a Leader Beyond Competencies

Competency frameworks assess what a leader can do. They cannot assess who a leader is in relation to your organisation, and that second question is where most senior hires fail. Assessing it requires a different kind of evidence: decisional patterns gathered across several conversations, not a score against a grid.

i. The two registersThe two registers of a senior assessment

Senior assessment is organised around two questions, though the industry rarely separates them.

The first is what can this person do? This concerns capability: technical skill, functional depth, management experience. Capability leaves verifiable traces. It can be benchmarked, referenced against a framework, and confirmed in a single well-run structured interview. It also responds to coaching and practice.

The second is who is this person? This concerns identity: values, motivation, the genuine drivers of their interest in this role at this moment, and how they decide when the situation is unclear. Identity is not on the CV. It is comparatively stable, it does not respond to training in the way capability does, and it is the register a competency framework is not built to reach.

We call this the capability-identity distinction, and it is set out at length in our position paper on the subject. The practical consequence is simple. The two questions concern empirically distinct things, so they require different forms of evidence, and they cannot be answered in the same conversational register.

ii. Why the frameworkWhy the framework alone leaves you exposed

A competency framework is a good instrument doing the job it was designed for. It brings consistency, it reduces obvious bias, and it makes candidates comparable. For capability, use one.

The exposure comes from what it cannot see. Most senior-hire failures are not failures of competence. The people who leave inside eighteen months are usually the ones who could do the work and could not do it here: they could not carry the stakeholder set, could not operate at the organisation's decision speed, or wanted something different from the role than the role could give them. Research on executive transitions has documented this pattern for decades, and the estimates of early senior-hire failure have stayed stubbornly high across that period.

None of those failures would have been caught by a higher score on a competency grid, because the grid was not measuring the thing that broke.

There is a second, subtler exposure. When an interviewer asks a candidate to describe their leadership style, the interviewer usually believes they are surfacing identity. In practice they are surfacing articulation skill: the candidate's fluency in describing a leadership style. The candidate who answers most smoothly is very often the candidate who has rehearsed the answer most often. This is the dominant failure mode in senior assessment, and it is why fluent candidates are systematically overrated and reflective ones underrated.

iii. What identity evidenceWhat identity evidence actually looks like

Identity cannot be self-reported reliably, so it has to be inferred from patterns. Four kinds of evidence carry most of the weight.

Decisional patterns across diverse situations. Not one story about one decision, but the same person's decisions in several different contexts, gathered over more than one conversation. Patterns are much harder to construct than anecdotes.

What the candidate consistently protects and what they consistently sacrifice. Every leader under pressure trades something away. Which thing they protect when the trade is forced tells you more about them than any values statement. Ask about decisions where two things they cared about were in conflict.

The genuine driver of interest in this role, at this time. Distinguishable from the rehearsed answer only by asking about the alternatives: what else they are considering, what would make them stay where they are, what they would need this role to be. Vague enthusiasm is a signal in itself.

Conduct when the room disagrees. How a person behaves when contradicted, especially by someone junior, is durable and rarely performed successfully across several encounters.

The common thread is time and repetition. A single conversation can be performed. The empirical literature on impression management is unambiguous that candidates can and do manage impressions in interview settings. A sequence of structured conversations probing decisional patterns from several angles is much harder to perform, because consistency across contexts is not something a rehearsed narrative supplies.

iv. How to runHow to run it in practice

The method is not complicated. It is just rarely practised, because it takes longer than the process most search timelines allow.

1. Separate the two registers deliberately. Run a capability conversation and an identity conversation as different conversations, with different questions and, where possible, different interviewers. Mixing them produces a blurred verdict in which fluency contaminates the competence read. 2. Calibrate identity against the operating reality of the role, not against your existing team. This is the difference between structured identity assessment and informal cultural matching. Matching against the team reproduces the team. Calibrating against the role asks a different question: what does this specific job, with this specific stakeholder map and this decision speed, actually require of a person? Sometimes the honest answer is someone who differs from the incumbents. 3. Use multiple conversations over time. Two or three encounters spaced apart will surface inconsistency that one long interview will not. 4. Use psychometrics as one input, never as the verdict. A validated instrument adds a useful, structured data point about disposition. It does not know your organisation, and it cannot be answerable for a hiring decision. 5. Reframe references. Most reference calls verify the CV, which is the part you already have evidence for. Use them instead to triangulate identity: ask referees about the same decisions the candidate described, and about what the candidate protected when it was expensive to do so. 6. Write the two evidence layers separately in the shortlist. Present capability evidence and identity evidence as distinct columns and let the hiring group weigh them independently. A single blended fit score hides exactly the judgment the group needs to make.

v. When the competencyWhen the competency framework is enough

This method is not always warranted, and it would be dishonest to imply otherwise.

For high-volume hiring, for junior and mid-level roles, and for well-defined technical positions in regulated environments, a competency framework plus a structured interview is proportionate and often better. The role is clearly specified, the variance between capable candidates is small, and the cost of a mis-hire is recoverable.

The extended method earns its cost in a narrower set of cases: senior roles where the candidate pool is small, where the operating context is unusual or in transition, where the stakeholder environment is complex, and where the cost of a wrong appointment is measured in strategy and team damage rather than in recruitment fees. If your role does not meet that description, the framework is not failing you.

It is also worth saying plainly that no assessment method removes uncertainty. Identity evidence improves the odds and makes the reasoning explicit. It does not produce certainty, and any process that claims to is overselling.

vi. The underlying pointThe underlying point

A profile represents a candidate. It cannot judge one. A competency framework is a formalised profile, and it inherits the same limit: it captures what can be represented, and the thing that decides most senior hires is not fully representable. That argument is developed in The Candidate Is Not the Profile, and the practitioner treatment of assessing across both registers is in Interviewing for Skills and for Identity.

Assessing beyond competencies is not a matter of adding a softer instrument to the process. It is a matter of recognising that you are answering two different questions, and giving the second one the evidence it actually requires.

vii. Frequently askedFrequently asked

Are competency frameworks obsolete for executive hiring?

No. They remain the right instrument for assessing capability, and they bring consistency and comparability to a process that otherwise drifts. The argument is not that they should be replaced, but that they answer only one of the two questions a senior appointment turns on.

Is identity assessment the same as culture fit?

No, and the distinction matters. Informal cultural matching calibrates a candidate against the preferences of the interviewers and the composition of the existing team, which tends to reproduce what is already there. Structured identity assessment calibrates against the operating reality of the role and reads documented decisional patterns. For some roles it correctly identifies a candidate whose identity differs from the current organisation.

How many conversations does an identity assessment need?

In practice two or three, spaced apart, with questions approaching decisional patterns from different angles. The number matters less than the spacing and the diversity of the situations discussed, because it is consistency across contexts that a rehearsed narrative fails to supply.

Can psychometric testing assess identity on its own?

It can contribute a validated, structured data point about disposition, and it is useful as one input among several. It cannot substitute for the judgment, because an instrument has no knowledge of your specific organisation and cannot be answerable for the appointment. Treat the score as evidence to be interpreted, not as a verdict.

What single change improves senior assessment most?

Stop asking candidates to describe themselves and start asking them to describe decisions. Self-description surfaces articulation skill. Decisions, examined across several different situations, surface pattern, and pattern is what you are actually trying to read.

Does this slow the search down?

It lengthens assessment, not the search. Most of the elapsed time in a senior search is spent mapping the market and reaching candidates. Where that mapping is continuous rather than started at the brief, the time recovered is available for the slower assessment work, which is where it belongs.

This article is part of KiTalent's continuous market-intelligence programme.

About the author

KiTalent Research Team

KiTalent's market-intelligence programme. Continuous talent mapping across executive markets, with research-led intelligence shared through this editorial channel.

Read the full profile
Continue reading

Where the argument continues

The analysis and source work this piece depends on.

Hiring against this signal

If this market is shaping your next leadership hire, we should talk

KiTalent runs continuous talent maps across the markets we cover. Bring us the brief, we already hold most of the intelligence.

Discuss a search mandate