What is an Activity Report?

The Activity Report provides in-depth analysis of an activity (such as a course, video, or assessment). Beyond providing insights on how learners perform, this report can perform advanced question analysis to make sure organizations are asking the right questions in their assessments.

Creating and Editing an Activity Report

Use the report builder to create new Activity Reports and to configure existing Activity Reports.

Activity Report Filters and Options

Beyond the typical report configuration filters and options, the Activity Report provides options that are unique to the Activity Report.

Select Activity from the report selection menu and then click Activities in the filter menu:

Then, select an activity in the Activities filter.

Once you've selected an activity, the report will begin to populate with data. If you select more than one activity the report will include all data associated with every selected activity.

Advanced Configuration

Certain settings are only configurable in Advanced Configuration.

{
  "sentence": false,
  "reports": true,
  "leaderboard": true,
  "groupTable": true,
  "scoreDistribution": true,
  "questions": true,
  "completions": true,
  "groupChart": true,
  "averageDuration": true,
  "averageScore": true
}

Check out our Advanced Configuration guide for more information on general Advanced Configuration settings.

Interpreting an Activity Report

The Activity Report has a number of sections (any of which can be hidden using Advanced Configuration):

Completions, Incompletes, Successes, and Failures

The Completions, Incompletes, Successes, and Failures chart shows participation data for an activity:

• Completions are people that have completed the activity.
• Incompletes are people that have started the activity but not finished.
• Successes are people that have completed and been successful at the activity.
• Failures are people that have completed but failed the activity.

If your organization has people organized in groups, you’ll be able to navigate your organization by clicking on group names within the chart. This way, you’ll be able to see how participation data differs across your organization. You can also use the search box at the top of the report to isolate certain parts of your organization.

Leaderboard

The Leaderboard shows data for each person that completes your activity. You can see how many times a person completed your activity, if the person was successful, and how long the person spent with your activity, and the average of all the times a the person completed the activity.

The time range shows the last 28 weeks of activity. Blue circles represent activities made by this person related directly to the activity, and grey circles represent activities made by the person that are not related to this activity.

Scores

The Scores chart shows the breakdown of how all of your people are performing. Your people are grouped into score ranges, and the chart displays the percentage of your users that fall into each range. If people have attempted the activity multiple times, you'll see Score filters, which you can choose whether you want to see all scores, best scores, first scores, or last scores of the activity.

Average Score

Use this graph to see how the average activity score changes over time. You can change the size of groupings using the dropdown in the top right corner of the chart. If people have attempted the activity multiple times, you'll see Score filters, which you can choose whether you want to see all scores, best scores, first scores, or last scores of the activity.

Completions & Successes

Use this graph to compare completions and successes of your activity over time. You can change the size of groupings using the dropdown in the top right corner of the chart.If people have attempted the activity multiple times, you'll see Score filters, which you can choose whether you want to see all scores, best scores, first scores, or last scores of the activity.

Average Time to Complete

Use this graph to see how the average time spent on your activity changes over time. You can change the size of groupings using the dropdown in the top right corner of the chart. If people have attempted the activity multiple times, you'll see Score filters, which you can choose whether you want to see all scores, best scores, first scores, or last scores of the activity.

Questions

In this section, the Activity Report gives you detailed information and insights about each question. Sometimes performance on individual questions is predictive of overall activity performance. Sometimes questions are too easy and everyone gets them correct. This information is surfaced for you so you can improve your activities.

For each question, you’ll be able to see the average time it took people to answer, how people answered, and even view individual answers. If a question has notable insights, they’ll be surfaced with the question results and at the bottom in a section called Question Analysis.

The Activity Report can visualize different types of questions, and depending on the type of question asked, your results will be displayed in a different chart or graph:

Multiple choice

In this multiple choice question, the correct answer is highlighted in blue. Below the chart, you can see that this question is good at predicting who will do well on the activity. The bubble on the left shows the average time it took to answer the question (3 minutes, 15 seconds) and you can view how specific people answered the question with the View Individual Answers link.

True/False

In this true/false question, true is the correct answer and most people answered incorrectly. According to the insights below the chart, this question is good at predicting who will do well on the activity (maybe because it’s a hard question?).

Likert scale

Likert scales ask people to choose one answer on a scale. On this Likert scale, most people answered “Sometimes matches.” You can hover over different sections of this chart to see numbers of people that answered each way, or click View Individual Answers to see how everyone answered this question.

For this visualization to show, the data within the statement must match the specification laid out in the xAPI CMI interactions Likert spec.

Sequence

Sequence questions ask users to place items in order. Results are displayed in a grid where the x-axis represents order and the y-axis represents the items being asked to sequence. Each square in the grid contains the number of people that placed the y-axis item in the x-axis number place. In this example, 39 people placed “Gather diagnostic information” first. As the number in a square increases, the square itself becomes darker. The items are placed on the y-axis in correct order, so the diagonal squares will ideally be the darkest. This would mean most people sequenced your items correctly. You can hover over each square with your mouse to get more information.

Matching

For matching questions, the correct answers are identified with blue lines and text. The chart to the right of the answers shows the percentage of people that answered each way.

Question Analysis

The Question Analysis collects the insights surfaced from each question and shows additional insights: