Introduction
Your learning platform allows you to measure the effectiveness and to prove the impact of learning. You can enable learning measurement for a selection of courses, send evaluation questionnaires, collect responses and check easy-to read reports, all in an automated way.
This article will guide you through the use of the Results comparison report.
Accessing the Results comparison report
To access the Results comparison report, follow these steps:
- Connect to your learning platform as a Superadmin or a Power User with the relevant permissions.
- From the Navigation menu, find the Content and delivery (folder icon), then click on Learning evaluation.
- Go to the Results comparison tab.
Using the Results comparison report
The Results comparison report allows you to compare the evaluation results obtained for different courses for a specific metric. You can, for example, compare the average satisfaction obtained on all your courses or establish a ranking of the instructors (called trainers in the report filters). This tool is very useful to identify your star programs and determine which ones should be improved. It’s also a great way to gather information on your partners and instructors to be able to give them feedback.
When you access the Results comparison report, you will find all the filters available to you on the left side of the page. Make your selection for each of the following filters. To select multiple items, click on each of the items you want to select. You can also look for an item by typing its name in the text field. You can modify your selection by removing items in the field.
Consolidation mode
Start by choosing your Consolidation mode. This will determine the items that you will be ranking. For example, if you choose Trainings, you will be able to rank training courses on a selected perimeter and for a given theme or even a specific question of the questionnaire. This filter includes all custom fields that were added to your account. For example, you can rank items using User additional fields defined for your account. (User additional fields will be displayed as Participant data in this drop-down menu and refer to learners only, not other roles). After choosing your consolidation mode you can apply further filters to narrow down your perimeter.
Trainings
This is the list of courses for which you have enabled learning evaluation. Select the courses you want to include in your analysis. You can select all courses or choose a specific course.
Trainers
Select the trainers (instructors) you want to include in your analysis.
Start date and end date
Using the calendar, select the timeframe you want to cover with your analysis. The timeframe will include:
- ILT/VILT sessions with an end date within this range
- E-learning courses when responses to the evaluation questionnaire were provided within this range
Perimeter
Select the entity for which you want to display the report. This field can be useful if you have more than one entity connected to the same account. If this field is not relevant for you, simply leave the default value All entities.
Training type
Select the course type from the drop-down menu. Select E-learning for your e-learning courses, and select In Class/Webinar for your ILT and VILT courses. Both types are selected by default but you can remove either one of them. If you remove both types, the selection will include all course types.
Analysis type
The report can either be:
- A synthesis by theme: Each theme refers to a section of the questionnaire and might contain one or more than one question.
- A synthesis by question: The report will focus on a specific question of the questionnaire.
Evaluation axis
The evaluation axis indicates the criteria along which you want to rank the items you have selected in the Consolidation mode filter. For example, if you select Training in the Consolidation mode filter, and then select Satisfaction in the Evaluation axis filter, you will see a list of training courses with their Satisfaction score. The items found in the report are ranked in alphabetical order by default, but you can choose to rank them differently.
The options displayed in the Evaluation axis filter depend on what you have selected for the Analysis type filter. If you select Synthesis by theme, you will get a list of themes referring to sections of the questionnaire. If you select Synthesis by question, you will see all the specific questions of the questionnaire. When you are done choosing your filters, click on the View Analysis button to display the report.
Note on the NPS and satisfaction questions:
The items you select in the Evaluation axis filter (Synthesis by question option) are drawn from the questions built using the Evaluation designer including:
- How likely is it that you would recommend this training to a friend or a colleague? (NPS)
- Overall, what do you think of the training course? (satisfaction)
As explained in the article Customizing standard questionnaires and creating questionnaires from scratch, three question categories areavailable:
- Suggested questions : Questions included in the questionnaire by default
- Suggested questions edited by you: Suggested questions which labels you have edited
- Questions created by you : Entirely new questions you have built from scratch
Whenever you edit the label of the NPS and/or satisfaction question, their data will not show up in the Results comparison report. To ensure this data is included, you must use the original, unaltered versions of these questions.
Exclude results with a number of learners lower than
You can exclude results that are not representative of a minimum number of learners if you think they will distort the overall analysis.
Click on More Filters to display the course additional fields and the user additional fields defined on your platform (if any). These fields can be used to narrow down the report perimeter to a specific set of courses and/or a specific population of users.
When you are done choosing your filters, click on the View Analysis button to display the report.
Please note! If you want to compare courses by Net Promoter Score (NPS), choose Synthesis by question as the Analysis type and Net promoter score (NPS) as the Evaluation axis.
Reading the report
The report allows you to compare the performance of different items at a glance.
Press the Sort by icon at the top right side of the report to sort the items. You can sort them by:
- Title: Rank the items alphabetically by their title.
- Average, descending: Rank the items starting from the one with the highest average score.
- Training sessions count, descending: Rank the items starting from the one with the highest number of courses/sessions covered in the analysis.
- Trainees count, descending. Rank the items starting from the one with the highest number of learners involved in the report.
Additional options include:
- Hide/display benchmark: Press this icon to hide the benchmark color-code. The color code is displayed by default.
- Print: Press this icon to print the report.