Introduction 

Docebo has created Docebo Learning Impact that allows you to measure the effectiveness and to prove the impact of learning. With Docebo Learning Impact, you can enable learning measurement for a selection of courses, send evaluation questionnaires, collect responses and check easy-to read reports, all in an automated way. 

As Docebo Learn clients, you have access to a Docebo Learning Impact app found on your Learn platform and a dedicated Learning Impact external platform. From your Docebo Learning Impact app, you are able to perform the following actions

• Enable learning impact measurement for a selection of courses
• Manage evaluation properties for the courses
• Check reports

This article will go through the reports found on your Learn platform. These reports are also available on the Learning Impact external platform. 

Consolidated Report

The Consolidated Report is a great way to get a unique report for several training courses, or in the case of ILT courses several training sessions of the same course. Within the same report, you can capture the performance of the course at a glance.

Building the Report

To access the Consolidated Report from Docebo Learn, go to the Admin Menu, from the gear icon and find the Learning Impact section in Apps & Features. Click on the Manage subsection. On the main Learning Impact management page, go to the Consolidated Reports tab. 

On the left side of the page, you will see the different sections with the following filters available for the Consolidated report: 

Trainings

This is the list of courses for which you have enabled learning measurement. Select the courses you want to include in your analysis. For ILT courses, you can have an analysis of multiple sessions of a course by selecting only this course from this dropdown menu. Training refers to Course on your Learn platform. 

Trainers

Select the trainers you want to include in your analysis. Trainers refers to Instructors on your Learn platform. 

Training Company

If your course was provided by an external training provider you can select the provider for this section.

Field

This lists the different course domains for which learning measurement has been enabled.

Start date and end date

By using the calendar features, select the timeframe you want to cover with your analysis. The timeframe will include:

• ILT/VILT sessions with an end date within this range
• E-learning courses when responses to the evaluation questionnaire were provided within this range

Perimeter

Select the entity for which you want to display the report.  This field can be useful if you have more than one instance connected to the same account. If this field is not relevant for you, simply leave the default value All entities.

Training Type

Select the training type from the dropdown menu. Select E-learning for your e-learning courses and select In Class/Webinar for your ILT and VILT courses. 

Click on More Filters to display the course additional fields and the user additional fields defined in your platform (if any). These fields can be used to narrow down the report perimeter to a specific set of courses and/or a specific population of users.

When you are done choosing your filters, click on the View Analysis button to display the report.

Reading the Report

The Consolidated report is made up of a report header and several parts.  

In the report header you will find the following options:

Display comments

The open-ended comments left by the respondents are hidden by default in the Consolidated Report. Press this icon to display them

Export

Export the report raw data as an Excel spreadsheet  

Hide/Display Benchmark

Hide the Benchmark color code. The color code is displayed by default

Download

Download the report as PDF 

Print

Print the report. 

Scroll down the report to view the following pages: 

Overview

This part displays the average consolidated scores obtained for the different items. You can see the scores for the initial evaluation questionnaire, the follow-up evaluation questionnaire (if you have set-up one) and the manager evaluation questionnaire (if you have involved managers in the evaluation process). 

On top of the Overview section, you will find 3 global indices. They are calculated based on the following details: 

• Impact for company: learners attendance to the course, achievement of objectives, learners progress in their job according to their manager
• Global assessment: training impact for the company and learner perception
• Perception by trainees. level of satisfaction of learners as measured in the initial and follow-up questionnaires, extent to which the experience has benefited them, impact on their work and extent to which learners recommend the course

Detailed Answers by Question

This part displays the detailed consolidated answers to all the questions of the questionnaires. Navigate with the tabs on the right of the page to find the questions in the Initial evaluation questionnaire, the Follow-up evaluation questionnaire (if you have set it up),  the manager’s questionnaire (if you have involved them in the evaluation process) and the trainer’s questionnaire. 

Additional Information

In the last part of the report, you will find a recap with the average response rate for each part of the evaluation process (initial, follow-up) and each type of respondent (learner, manager, trainer) as well as the total number of users involved. 

Results Comparison

The Results Comparison report allows you to compare and list results along a given axis. You can, for example, compare the average satisfaction obtained on all your courses or establish a ranking of the instructors (called trainers in the report filters). This tool is very useful to identify your star programs and determine which ones should be improved. It’s also a great way to gather information on your partners and instructors to be able to give them feedback.

Building the Report

To access the Result Comparison from Docebo Learn, go to the Admin Menu, click on the gear icon and find Learning Impact in the Apps & Features. Click on the Manage subsection. On the main Learning Impact management page, go to the Results Comparison tab. 

On the left side of the page, you will see the different sections with the following filters available for the Results Comparison: 

Consolidation mode

Start by choosing your Consolidation mode. This will determine the items that you will be ranking. For example, if you choose Trainings, you will be able to rank training courses on a selected perimeter and for a given theme or even a specific question of the questionnaire. This filter includes all custom fields that were added to your account. For example, you can rank items using User Additional Fields defined for your account.  (User Additional Fields will be displayed as Participant Data in this dropdown menu and refer to the Learner only, not other types of users).   After choosing your consolidation mode you can apply further filters to narrow down your perimeter.

Trainings

This is the list of courses for which you have enabled learning measurement. Select the courses you want to include in your analysis. You can select all courses or choose a specific course. To select a course, use the drop-down menu or directly type in the name of the course. Training refes to Course on your Learn platform. 

Trainers

Select the trainers you want to include in your analysis.Trainers refer to the Instructors of your courses. 

Start date and end date

By using the calendar features, select the timeframe you want to cover with your analysis. The timeframe will include:

• ILT/VILT sessions with an end date within this range
• E-learning courses when responses to the evaluation questionnaire were provided within this range

Perimeter

Select the entity for which you want to display the report.  This field can be useful if you have more than one instance connected to the same account. If this field is not relevant for you, simply leave the default value All entities.

Training type

Select the training type from the dropdown menu. Select E-learning for your e-learning courses and select In Class/Webinar for your ILT and VILT courses. 

Analysis type

You can perform a Synthesis by theme. Each theme refers to a section of the questionnaire and might contain one or more than one question. If you want to focus on a specific question, choose Synthesis by question.

Evaluation axis

The evaluation axis indicates the criteria along which you want to rank the items you have selected in the Consolidation mode filter. For example, if you select Training in the Consolidation mode filter, and then select Satisfaction in the Evaluation axis, you will see a list of training courses with their Satisfaction score

You will be able to rank them in a number of ways. The options displayed in the Evaluation axis filter depend on whatselect  for the Analysis type filter. If you select Synthesis by theme, you will get a list of themes referring to sections of the questionnaire. If you select Synthesis by question, you will see all the specific questions of the questionnaire.

Exclude results with a number of learners lower than

You can exclude results that are not representative of a minimum number of learners if you think they will distort the overall analysis. 

Click on More Filters to display the course additional fields and the user additional fields defined in your platform (if any). These fields can be used to narrow down the report perimeter to a specific set of courses and/or a specific population of users.

When you are done choosing your filters, click on the View Analysis button to display the report.

Note : If you want to compare courses in terms of the Net Promoter Score (NPS), choose Synthesis by question as the Analysis type and Net promoter score (NPS) as the Evaluation axis.

Reading the report 

The report will allow you to compare at a glance the performance of different training courses, entities, etc. along a given axis. 

Press the Sort by icon at the top right side of the report to sort the items. You can sort them by:

• Title.Rank the items alphabetically by their title
• Average, descending. Rank the items from the one with the highest average score to the lowest average score
• Training sessions count, descending. Rank the items from the one with the highest number of sessions covered in the analysis to the lowest number of sessions
• Trainees count, descending. Rank the items from the one with the highest number of trainees involved in the analysis to the lowest number of trainees

Additional options include:

• Hide/Display Benchmark.Press this icon to hide the Benchmark color-code. The color code is displayed by default. 
• Print.Press this icon to print the report.