Docebo has created Docebo Learning Impact that allows you to measure the effectiveness and to prove the impact of learning. With Docebo Learning Impact, you can enable learning measurement for a selection of courses, send evaluation questionnaires, collect responses and check easy-to read reports, all in an automated way.
As Docebo Learn clients, you have access to a Docebo Learning Impact app found on your Learn platform and a dedicated Learning Impact external platform. From your Docebo Learning Impact app, you are able to perform the following actions
- Enable learning impact measurement for a selection of courses
- Manage evaluation properties for the courses
- Check reports
This article will guide you through the use of Results Comparison found on your Learn platform app. This report can also be accessed from the Learning Impact external platform.
Building the Report
The Results Comparison report allows you to compare and list results along a given axis. You can, for example, compare the average satisfaction obtained on all your courses or establish a ranking of the instructors (called trainers in the report filters). This tool is very useful to identify your star programs and determine which ones should be improved. It’s also a great way to gather information on your partners and instructors to be able to give them feedback.
To access the Result Comparison from Docebo Learn, go to the Admin Menu, click on the gear icon and find Learning Impact in the Apps & Features. Click on the Manage subsection. On the main Learning Impact management page, go to the Results Comparison tab.
On the left side of the page, you will see the different sections with the following filters available for the Results Comparison:
Start by choosing your Consolidation mode. This will determine the items that you will be ranking. For example, if you choose Trainings, you will be able to rank training courses on a selected perimeter and for a given theme or even a specific question of the questionnaire. This filter includes all custom fields that were added to your account. For example, you can rank items using User Additional Fields defined for your account. (User Additional Fields will be displayed as Participant Data in this dropdown menu and refer to the Learner only, not other types of users). After choosing your consolidation mode you can apply further filters to narrow down your perimeter.
This is the list of courses for which you have enabled learning measurement. Select the courses you want to include in your analysis. You can select all courses or choose a specific course. To select a course, use the drop-down menu or directly type in the name of the course. Training refes to Course on your Learn platform.
Select the trainers you want to include in your analysis.Trainers refer to the Instructors of your courses.
Start date and end date
By using the calendar features, select the timeframe you want to cover with your analysis. The timeframe will include:
- ILT/VILT sessions with an end date within this range
- E-learning courses when responses to the evaluation questionnaire were provided within this range
Select the entity for which you want to display the report. This field can be useful if you have more than one instance connected to the same account. If this field is not relevant for you, simply leave the default value All entities.
Select the training type from the dropdown menu. Select E-learning for your e-learning courses and select In Class/Webinar for your ILT and VILT courses.
You can perform a Synthesis by theme. Each theme refers to a section of the questionnaire and might contain one or more than one question. If you want to focus on a specific question, choose Synthesis by question.
The evaluation axis indicates the criteria along which you want to rank the items you have selected in the Consolidation mode filter. For example, if you select Training in the Consolidation mode filter, and then select Satisfaction in the Evaluation axis, you will see a list of training courses with their Satisfaction score
You will be able to rank them in a number of ways. The options displayed in the Evaluation axis filter depend on whatselect for the Analysis type filter. If you select Synthesis by theme, you will get a list of themes referring to sections of the questionnaire. If you select Synthesis by question, you will see all the specific questions of the questionnaire.
Exclude results with a number of learners lower than
You can exclude results that are not representative of a minimum number of learners if you think they will distort the overall analysis.
Click on More Filters to display the course additional fields and the user additional fields defined in your platform (if any). These fields can be used to narrow down the report perimeter to a specific set of courses and/or a specific population of users.
When you are done choosing your filters, click on the View Analysis button to display the report.
Note : If you want to compare courses in terms of the Net Promoter Score (NPS), choose Synthesis by question as the Analysis type and Net promoter score (NPS) as the Evaluation axis.
Reading the report
The report will allow you to compare at a glance the performance of different training courses, entities, etc. along a given axis.
Press the Sort by icon at the top right side of the report to sort the items. You can sort them by:
- Title.Rank the items alphabetically by their title
- Average, descending. Rank the items from the one with the highest average score to the lowest average score
- Training sessions count, descending. Rank the items from the one with the highest number of sessions covered in the analysis to the lowest number of sessions
- Trainees count, descending. Rank the items from the one with the highest number of trainees involved in the analysis to the lowest number of trainees
Additional options include:
- Hide/Display Benchmark.Press this icon to hide the Benchmark color-code. The color code is displayed by default.
- Print.Press this icon to print the report.