Board Cyber Oversight

The Security Metric That Deserves Retirement

Some security metrics fill slides without informing a single decision. A keep-or-retire review ties every surviving metric to the decision it informs.

Disapproved Concept with Pen and Crumpled Paper

Every security dashboard has one: the metric that has been there for years, that nobody questions, and that would change nobody's mind if it moved.

It survives because removing a metric feels like admitting the old reporting was wrong. So the dashboard grows, the audience glazes over, and the two numbers that would actually inform a decision get lost on slide nine.

The fix is not more metrics. It is retiring the ones that no longer earn their place.

TLDR

  • A metric that informs no decision is reporting overhead, not oversight.

  • Test each metric: what decision does it inform, and who makes it?

  • Retirement is a normal hygiene decision, not an admission of failure.

  • Fewer, decision-linked metrics get read; larger decks get skimmed.

  • Review the metric set annually, the same way you review the controls.

The vanity test

One question separates keepers from decoration: if this number moved sharply next quarter, what would we do differently?

"We would want to understand why" is not a decision. A decision sounds like "we would fund the backlog," "we would change the vendor," "we would escalate to the board." If nobody can name the decision and the decision-maker, the metric is a vanity metric - reassuring in shape, empty in effect.

The keep-or-retire review

Run the current dashboard through a short review. The example below is illustrative.

Metric (illustrative) Decision it informs Decision-maker Verdict
Number of blocked attacks None - volume says little about risk - Retire
Patch compliance within 30 days Fund remediation backlog or accept exposure CIO Keep
Phishing report rate Target follow-up training Security lead Keep
Security spend as percent of IT budget Budget allocation against risk tiers CFO / board Keep

NIST's measurement guidance (SP 800-55 Vol. 2) ties measures to decisions and stakeholders throughout. A measure without a decision attached is a program cost with no return.

Why retirement feels risky

Teams worry a retired metric will be missed in an audit or after an incident. The answer is to record the review: what was retired, why, and what replaced it. That record shows the measurement program is managed - which is itself evidence of maturity.

What you get back

Retiring three decorative metrics buys the attention that one decision-linked metric needs. Directors read a five-line dashboard. They skim a thirty-line one. If you are redesigning what reaches the board, the one-page board cyber dashboard specimen shows what a decision-useful page looks like.

Frequently asked questions

How many metrics should reach the board?

Few enough to discuss in the time allotted - usually five to eight, each tied to a decision or a risk the board owns.

Who decides which metrics retire?

The security lead proposes; the audience decides. If the board or executive team would never act on a number, their verdict is the one that counts.

Should operational teams retire metrics too?

Yes, at their own level. Working metrics that no longer drive action crowd out the ones that do.

How often should the review run?

Annually is enough for most organizations, plus a check whenever reporting requirements or the business change materially.

A Defensible Next Step

Take the current security dashboard and ask the vanity test of each line: what decision does this inform? Retire one metric this quarter and record why. Book a Decision-Clarity Call if you would like help running the review.

Next step

Get Board-Ready on AI and Cyber Risk

A 30-minute call. No charge. You'll leave with a clear read on where your oversight stands and what to do about it.

Stop Guessing. Start Scoring
Tyson Martin

Written by Tyson Martin, NACD.DC

Chief Trust, Security & AI Officer. CISO of record at MIO Partners; former CISO & CTO at Lumber Liquidators and Orvis; advisor to 200+ Fortune 500 boards and C-suites at AWS.

See the track record
Keep reading

More on Board Cyber Oversight

All CISO Insights
Board Cyber Oversight

When a Cyber Risk Exception Should Expire

A cyber risk exception without an expiry date is an unrecorded acceptance of risk. Learn when exceptions should expire, renew, or escalate to the board.

Board Cyber Oversight

Year-End Cyber Review: The Six Slides That Matter

A year-end cyber review should set next year's risk decisions, not recap this year's activity. Six slides carry the whole story, end to end.