Interpreting the Program Report

The Program report offers an overview of a pre-defined learning program—like compliance training or new hire training. This guide explains how to interpret the Program report.

Program Report Loading Time

Because of the way they process data, Program Reports typically take longer to generate than tabular reports (such as the Leaderboard Report or the Pie Report). Two major factors in Program Report loading time are:

• the number of statements used to generate the report 
• the number of steps in the report.

Number of Statements

The time to generate a Program Report is proportional to the number of statements it processes. A Program Report that uses 100,000 statements can typically take close to ten times as much time to load as one with just 10,000 statements. This is different from tabular reports where the difference between 10,000 and 100,000 statements is relatively small due to the way these reports process data.

Number of Steps

The number of steps in the Program Report also has an impact on its loading time.  While not as big of a factor as the Number of Statements, each additional step requires additional processing and will increase the time it takes for a Program Report to load.

Milestones

Program report milestones show what percentage of people have completed a configured interaction or set of interactions. Milestones show different numbers depending on if the report has been configured to expect milestones to be complete in a specific order, or if milestones can be completed in any order. This will be indicated by text below the milestones list.

• “Where are currently enrolled people with regard to each program milestone?” means that milestones are expected to be completed in the order shown.
• “What percentage of enrolled people have completed each milestone?” means that milestones can be completed in any order.

Milestones in defined order

If milestones are expected to be completed in the order shown, then the milestone percentages will show the percentage of people working towards each milestone. This is calculated by subtracting the number of people that have completed the milestone from the number of people who have completed the milestone above.

Milestones in any order

If milestones can be completed in any order, then the milestone percentages show the percentage of people who have completed each milestone.

Advanced Milestones and Program Completions

Advanced milestones are marked as complete once a configured number of milestones within then are completed (by default all the milestones within them have to be completed). The program report’s metric of how many people have completed the program is based on the number of people that have completed all milestones.

The calculation of the number of people who completed a set of milestones can sometimes look inaccurate (when it is, in fact, correct) when looking at completion percentages for the individual milestones. This is because it may be that different people completed different milestones.

For example, in a report looking at 100 people with 3 milestones, where the first milestone has 70% completion, the second has 60% and the third has 50%, you might assume that 50% of people have completed the program. However in fact, it might be that anywhere between 0% and 50% of people completed the program.

It could be that the 50% who completed milestone 3 also completed the other milestones as show below.

But it is equally possible that the 50% who completed milestone 3 were either in the 40% that did not yet complete milestone 2, or the 30% who did not complete milestone 1. In this case, nobody completed all three milestones.

The example below has the same levels of milestone completion as above, but nobody has completed all three. 20% of people did milestones 2 and 3, 10% completed no milestones, 30% completed milestones 1 and 3, and 40% completed 1 and 2.

The overall completion only looks at people that completed all three.