Docebo has created Docebo Learning Impact that allows you to measure the effectiveness and to prove the impact of learning. With Docebo Learning Impact, you can enable learning measurement for a selection of courses, send evaluation questionnaires, collect responses and check easy-to read reports, all in an automated way.
As Docebo Learn clients, you have access to a Docebo Learning Impact app found on your Learn platform and a dedicated Learning Impact external platform. From your Docebo Learning Impact app, you are able to perform the following actions
- Enable learning impact measurement for a selection of courses
- Manage evaluation properties for the courses
- Check reports
This article will guide you through the use of the Consolidated Report found on your Learn platform app. This report can also be accessed from the Learning Impact external platform.
Building the report
The Consolidated Report is a great way to get a unique report for several training courses, or in the case of ILT courses several training sessions of the same course. Within the same report, you can capture the performance of the course at a glance.
To access the Consolidated Report from Docebo Learn, go to the Admin menu from the gear icon and find the Learning Impact section in Apps & Features. Click on the Manage subsection. On the main Learning Impact management page, go to the Consolidated Reports tab.
On the left side of the page, you will see the different sections with the following filters available for the Consolidated report:
This is the list of courses for which you have enabled learning measurement. Select the courses you want to include in your analysis. For ILT courses, you can have an analysis of multiple sessions of a course by selecting only this course from this dropdown menu. Training refers to Course on your Learn platform.
Select the trainers you want to include in your analysis. Trainers refers to Instructors on your Learn platform.
If your course was provided by an external training provider you can select the provider for this section.
This lists the different course domains for which learning measurement has been enabled.
Start date and end date
By using the calendar features, select the timeframe you want to cover with your analysis. The timeframe will include:
- ILT/VILT sessions with an end date within this range
- E-learning courses when responses to the evaluation questionnaire were provided within this range
Select the entity for which you want to display the report. This field can be useful if you have more than one instance connected to the same account. If this field is not relevant for you, simply leave the default value All entities.
Select the training type from the dropdown menu. Select E-learning for your e-learning courses and select In Class/Webinar for your ILT and VILT courses.
Click on More filters to display the course additional fields and the user additional fields defined in your platform (if any). These fields can be used to narrow down the report perimeter to a specific set of courses and/or a specific population of users.
When you are done choosing your filters, click on the View Analysis button to display the report.
Reading the report
The Consolidated report is made up of a report header and several parts.
In the report header you will find the following options:
The open-ended comments left by the respondents are hidden by default in the Consolidated Report. Press this icon to display them
Export the report raw data as an Excel spreadsheet
Hide the Benchmark color code. The color code is displayed by default
Download the report as PDF
Print the report.
Scroll down the report to view the following pages:
This part displays the average consolidated scores obtained for the different items. You can see the scores for the initial evaluation questionnaire, the follow-up evaluation questionnaire (if you have set-up one) and the manager evaluation questionnaire (if you have involved managers in the evaluation process).
On top of the Overview section, you will find 3 global indices. They are calculated based on the following details:
Impact for Company:
- Objective achievements (based on all the objective questions included in the Follow-up Evaluation questionnaire sent to learners and managers)
- Actual use (based on all action plan questions included in the Follow-up Evaluation questionnaire sent to learners and managers)
- Impact on quality or efficiency of the learner’s job (based on the Manager’s questionnaire, if available)
- Learner Satisfaction from the Initial Evaluation questionnaire
- Learner Satisfaction from the Follow-up Evaluation questionnaire
- Impact on quality or efficiency of the learner job (from the learner’s questionnaire only)
Average of the two indices
Detailed Answers by Question
This part displays the detailed consolidated answers to all the questions of the questionnaires. Navigate with the tabs on the right of the page to find the questions in the Initial evaluation questionnaire, the Follow-up evaluation questionnaire (if you have set it up), the manager’s questionnaire (if you have involved them in the evaluation process) and the trainer’s questionnaire.
In the last part of the report, you will find a recap with the average response rate for each part of the evaluation process (initial, follow-up) and each type of respondent (learner, manager, trainer) as well as the total number of users involved.