What Happens When You Measure Comprehension Instead of Completion?

Seat time, course completion, and a satisfaction score at the end are still how most organizations decide whether training worked. None of them confirm that anyone understood the material. The Ebbinghaus forgetting curve suggests roughly 70% of new learning is forgotten within 24 hours. Completion may tell you who finished, but it says little about what they can still understand and apply a week later. Roles are also changing faster than most training calendars can keep up with, which makes attendance a weaker stand-in for skill every year. Frameworks for measuring whether employees actually gained knowledge, developed skills, and applied what they learned have existed for decades, yet most organizations still default to completion because the alternatives are hard to run at scale. The science already told us completion was an incomplete measure of learning, so we used our own workforce as an opportunity to examine what a demonstrated capability score could tell us instead.

What Do Completion Metrics Miss?

Completion metrics miss whether anyone can apply the material after the session ends. A satisfaction score captures how the training felt. A completion record confirms attendance. Neither tells you whether the skill the budget was approved to build now exists. The concept that training evaluation research calls "learning transfer," whether employees can take what they learned and use it in their actual work, goes unmeasured when organizations stop at completion. Develop was built to close the gap between completed and capable, starting with the score. Instead of a completion checkbox, every learner gets a capability score, drawn from the comprehension they demonstrate during the session itself.

How Does Develop Score Comprehension?

Develop's scoring facilitates instruction via Socratic dialogue by requiring learners to:

• Explain: Put the concept into their own words.
• Apply: Relate the concept to their specific role.
• Defend: Respond to follow-up questions that challenge their understanding.

That friction is deliberate. Watching a video asks nothing of you, so little of it survives the week. A learner who has had to put an idea into their own words has already done the hard work that a completion record only assumes.

A Develop course can hold several modules, each with its own objectives, and the system scores overall capability in addition to module by module comprehension. If someone handles three modules well and struggles with the fourth, the report flags exactly where that person needs more work.

Scoring by module also drives how the course adapts. Someone who demonstrates real expertise early moves through faster, so the course does not spend an hour re-teaching what that person already knows and can demonstrate. Someone still working the concept out gets more time and more support, with the agent drawing the learner forward towards true comprehension.

The pacing shifts on its own, so no one has to build two versions of the course to accommodate different learners or expertise levels.

The results come back as a single report per learner containing:

• Overall comprehension across the full course
• A breakdown by module showing where the learner is strong and where gaps remain
• Notes on strengths and development areas with specifics on what the person handled well

Course owners have the same view across everyone who took it, which turns individual results into a picture of where a whole cohort is stuck. A module that much of the company struggles with may point to a design problem in the module itself, or it may signal that the organization needs to build more foundational skills before the course can land effectively. We used the data to work out what needed re-teaching, not to grade anyone.

Why Did We Run the Course on Ourselves First?

We put our own approach into practice. Every employee took a Develop course on the People Activation System, and we pulled the comprehension results afterward. The timing mattered. We had just launched the System and moved more directly into the L&D market with Develop, which changed what Perceptyx offers and how our people talk about what we do. Our customers face this same situation: employees spend months still explaining last year's strategy while leaders have already moved on. We needed to close that gap from the start, not after the year ends.

Our 2025 annual engagement survey had already flagged confidence in the future as a driver of engagement here. We deployed the Develop course company-wide this past May, aimed at helping people to explain our positioning in their own words. The 2026 annual engagement survey went out later that same month, which left about a week between the learning and the measurement.

Our hypothesis was the sort of bet any organization makes when it launches training during a transformation. Teach the change well and people will feel steadier about where the company is going. We believed that employees who understood the People Activation System would report more confidence in the company's future, and that confidence would grow faster than it did among employees with lower levels of comprehension.

What Did the Engagement Survey Show?

Employees with strong comprehension of the course reported a 16-point improvement in confidence about the company's future between 2025 and 2026. The group still building that understanding did not move in the same direction. They had started from a higher 2025 baseline yet trailed by 2026, widening the gap rather than closing it.

Beyond the 16-point gain in confidence, the high-comprehension group showed significant improvements in:

• Pride: Increased pride in working at the company.
• Advocacy: Higher willingness to recommend Perceptyx as an employer.
• Retention: Stronger intent to stay with the organization.

The lower-comprehension group posted no comparable gains in these areas.

The course was not the only thing running that week. Everyone who finished also received custom nudges from Activate tied to what they had just learned. The material kept resurfacing in small doses instead of fading the way a one-off session does.

How Confident Can We Be That the Course Caused This?

We are not claiming the course caused the confidence gain. A true experiment would have meant withholding the training from a control group, which we were not going to do during a strategy launch.

What we do have is a before-and-after measurement design, which evaluation research treats as one of the stronger approaches short of a randomized trial. The 2025 survey set the baseline, the course ran, and the 2026 survey followed about a week later. The movement showed up on confidence in the future, which is conceptually what the course had taught. A general lift spread evenly across unrelated survey categories would have pointed to a rising tide instead. Call the result worth running again on a larger population.

What Did Our Leadership Take From It?

"For L&D leaders, tracking completion records has always been a proxy for impact. We assumed attendance equaled ability. Shifting our focus to true comprehension completely redefines that equation. When you measure demonstrated capability rather than seat time, you stop treating learning as a compliance exercise and start driving business performance. At Perceptyx, watching comprehension directly correlate with higher organizational confidence and retention proved that when employees truly internalize the strategy, they don't just complete training, they own the future of the business."

Lisa Sterling, Chief People Officer

"Confidence in the future is one of the strongest drivers of engagement, and building it takes more than a clear vision from senior leaders. People have to be able to say where the organization is going and what their own part in it is. Practice at that scale has been hard to run until now. When our employees could explain where we were headed, they were more confident in the strategy and more committed to staying. Other organizations trying to strengthen confidence in the future can take this same approach by giving employees the opportunity to make the strategy their own, and then listening again to see what changed."

Lauren Beechly, Ph.D., VP of Leader & Workforce Transformation Consulting, Perceptyx

How Does Develop Fit Into the People Activation System?

Develop did not run on its own. The chain started with Discover. Our 2025 engagement survey told us that confidence in the future drove engagement at Perceptyx. The course, along with the comprehension scores it produced, turned that finding into capability. Activate then kept the material alive with nudges in the flow of work.

Then the loop closed. The 2026 annual survey caught the outcome described above, which makes this evidence about the whole People Activation System rather than Develop alone. Start by listening to understand what needs to change. Build and reinforce the capabilities to address it. A follow-up survey then shows what actually moved. Each cycle starts from better information than the last one did. A one-off training program has no second cycle to improve.

What Does Comprehension Data Do for the Business?

Develop can build skills and demonstrate capability against whatever objectives you set for a course. Here it did more than that. The comprehension scores gave us something completion records never could: evidence that learning transfer had occurred, meaning employees could apply new knowledge back in their actual roles. When the engagement survey confirmed that comprehension tracked with confidence, pride, and retention intent, the scores stopped being a training metric and became a leading indicator of business outcomes.

Any organization rolling out a new strategy can run the same test:

1. Pick the survey item the strategy is supposed to move.
2. Teach the material and score comprehension against explicit objectives.
3. Reinforce the learning where people already work.
4. Measure the item again on the next survey.

How Can You Try This in Your Organization?

For the full business case behind running listening, development, and reinforcement as one loop, read the Perceptyx white paper Beyond Course Completions: From Fragmented HR to an Intelligent Development Engine. Our earlier post covers the build side of this story, including how we built the course in Develop in about fifteen minutes of work.

When you want to see it run against your own content and your own strategy, schedule a meeting with our team.