What Awareness Training Actually Changed This Year: Beyond the Completion Rate

The year-end training report will say completion was ninety-seven percent. That number measures that people clicked through a course. It says nothing about whether anyone behaves differently, which is what the training budget was for.

Behavior leaves different evidence. Before the year closes, the program owes itself a look at the measures that show change, and an honest verdict on the ones that moved.

Key takeaways

• Completion rates measure attendance. They do not measure change.

• Behavior shows up in reporting rates, simulation results over time, and the questions people ask.

• A rising report rate can be success arriving, not failure.

• Measure the few behaviors the program was built to change.

• What you learn decides what next year's training actually needs.

Step 1: Name the behaviors the training was for

Start with intent. The program existed to change a handful of behaviors: report the suspicious message, use the password manager, check the unusual payment request, lock the screen. If the year-end review cannot name them, the training was theater from the start.

Three to five behaviors is the honest count for most programs. Each one needs a measure that exists outside the training platform.

Step 2: Read the behavior evidence

The evidence is in the operational record. How fast are suspicious messages reported, and by how many different people? What did the simulation results do across the year, not in one campaign? How did people handle the real near-misses?

Watch for the friendly confusion: a rising report rate means more people reporting, which is the behavior working. Programs have celebrated falling report numbers that were actually silence.

Step 3: Ask the people, briefly

A five-question pulse tells you what the numbers cannot: whether people know what to do with a suspicious message, whether they believe reporting is safe, which rule they find pointless and why. The last answer is the most useful one in the pile.

This fictional example shows the review. It is an illustration, not a prescription.

The verdict column feeds next year's plan directly.

Step 4: Decide what next year changes

The review earns its budget by changing the plan: drop the module everyone sleeps through, double down on the behavior that is stuck, add the test for the behavior you only assumed. The awareness ideas that outlast October is a good source of replacements, and security champions is how behavior change gets carried between trainings.

Frequently asked questions

Isn't completion still required for compliance?

Completion answers the auditor's question and has its place. It simply cannot be the program's definition of success. Keep the completion number for the audit file and the behavior measures for the management decision.

How do we measure reporting without punishing people?

Measure the system, not the person: report rates and times in aggregate. The moment reporting affects an individual's review, the reporting stops, and the measure eats the behavior it was measuring.

What if the behaviors have not moved?

That is a finding about the training, not the staff. Same-content repetition stalls; the fix is usually different moments, different messengers or different formats, not more of what is not working.

Who should do this review?

Whoever owns the program, with one skeptic reading the same numbers. An hour, once a year, before the training budget is renewed on autopilot.

A Defensible Next Step

Before renewing the training line, answer the question with behavior evidence: what actually changed? Book a Decision-Clarity Call if you want help building the measures.