Introduction

Your platform allows you to measure the effectiveness and prove the impact of learning through the use of smart questionnaires.

This article explains how you can enable learning evaluation at course level and set the evaluation properties.

Enabling the learning evaluation for courses

To enable evaluation for one or more courses, click on the gear icon in the top right corner of the platform, look for Learning evaluation in the Apps & features area, and click on the Manage sub-menu.

While on the Courses tab, click on the plus button in the top right corner of the page.
In the Enable learning evaluation on courses right panel, select the courses you would like to enable learning evaluation for. Use the filters and the text search to drill down the courses by type and language.

Press Next to proceed.

Set the evaluation properties of the evaluation process. Superadmins can pre-configure the default evaluation properties in the Evaluation designer, establishing the evaluation options proposed by default when activating the learning evaluation for a course in the Manage menu, where these default settings can be applied or adjusted on a course-by-course basis.

• Evaluation process structure: Configure the evaluation process by enabling or disabling the proposed questionnaire types. Select a questionnaire for every questionnaire type you selected from the dropdown menus. Click on Preview questionnaire to see the respondent's view of the questionnaire. The available questionnaire types are:
  • Learner initial questionnaire: This questionnaire cannot be disabled; it is always part of the evaluation process, for all courses. Select which questionnaire to use for the evaluation process of the selected courses.
  • Instructor initial questionnaire (for Instructor-Led Training (ILT) courses only)
  • Learner follow-up questionnaire
  • Manager follow-up questionnaire (for ILT courses only)

Please note! The ILT standard questionnaire is only available for ILT courses, and the e-learning standard questionnaire is only available for e-learning courses. All the custom questionnaires you created are available for both e-learning and ILT courses.

• Confidential data: Set whether the data collected from questionnaires is confidential or nominative. This setting is available only when enabling Learning Evaluation for a single course in the right panel. When you select more than one course, this setting is hidden and the confidentiality configuration is inherited from the evaluation process properties for the chosen methodology (ILT or e-learning).
  • Confidential: Nobody can identify which respondent has provided a particular answer.
  • Nominative: Superadmins can identify which respondent has provided a particular answer. Power Users with permissions for learning evaluations (Learning impact) can identify which respondents have provided a particular answer for the users assigned to them, meaning respondents' first and last names will be visible in reports.

Click Confirm to finalize the enablement of the learning evaluation for the selected courses, which are now listed in the Courses tab of the Learning evaluation main page.

Please note! The number of enrollments displayed on the Courses tab reflects the total number of users enrolled in the course and can include learners enrolled before learning evaluation was enabled for the course.

Outcome of the learning evaluation enablement

All the learners 

• enrolled in e-learning courses before the evaluation was enabled
• enrolled in ILT sessions created before the evaluation was enabled and having an end date after the evaluation was enabled

will receive an email linking to the learning evaluation questionnaire after they complete the e-learning course or any session of the ILT course for which the evaluation was enabled and according to the timeline set for the questionnaire in the Evaluation designer. 

To exclude specific learners from the evaluation, such as those who did not attend the training, you must unenroll them from the course before enabling the evaluation.

Learning evaluation sending restrictions

The evaluation questionnaire is not sent to: 

• The learners who have completed the e-learning course or ILT session (enrollment status = Completed)  before the evaluation is enabled.
• The learners enrolled in the sessions that ended before the learning evaluation activation. 
• The learners who completed the evaluation included as training material in the course (it is the same questionnaire). 

 Learners can also  access the evaluation questionnaire:

• Through in-platform notifications created after a course completion.
• As course training material, if it was embedded as such (learn more about feedback questionnaires as training material).

Please note! The learning evaluation training material (also known as the feedback questionnaire) may display one of the following error messages to the learner:

• Learning Impact Questionnaire will be available once the course has been synchronized. This means the learning evaluation is not yet enabled for the course. The learner must return later or wait for the email notification.
• Sorry this questionnaire is not available, please contact your administrator for support. The learner's enrollment cannot be found or created when opening this questionnaire. The administrator must review the learner's enrollment. In some cases, opening the feedback questionnaire training material triggers an automatic enrollment based solely on the username. This allows learners who might have encountered an error to still evaluate the course and complete the initial questionnaire. However, for these automatic enrollments, no emails, reminders, or follow-up evaluations will be sent. To prevent these automatic enrollments, ensure that users are not enrolled before the learning evaluation is enabled. Additionally, verify that the previous enrollments apply only to sessions with future end dates and that the feedback questionnaire training material can only be accessed after all previous training materials have been completed.

If user enrolments were missed due to sync issues:

• For e-learning courses, unenroll and re-enroll them in the course, but do not use the Archive and re-enroll option when archiving the enrollment.
• For ILT courses:
  • Unenroll them from the session and enroll them in a session created after the learning evaluation was enabled.
  • Archive the learners enrollments in the ILT course by using the Archive and re-enroll option.

Managing the evaluation properties of a course

When enabling learning evaluation, you can configure the properties as outlined in the previous chapter, Enabling the learning evaluation for courses. However, after the learning evaluation is enabled, the only properties that can be adjusted are the enablement or disablement of questionnaire types (that is, adding or removing the follow-up questionnaire, the manager evaluation or the instructor evaluation). This means that:

• Once a questionnaire is selected for a course, it cannot be replaced with a different questionnaire but you still have the option to modify the questionnaire's content directly through the Evaluation designer. If you do so, the changes will apply to all new enrollments across any course where this questionnaire is selected, and not to existing enrollments.
• You cannot change the confidential or nominative status of the evaluation.

To enable or disable the evaluation questionnaires for a course, from the Courses tab of the Learning evaluation main page click on the ellipsis menu at the end of the course row and select Change properties.

Remember that:

• The learner's initial questionnaire cannot be disabled.
• The changes will apply to all new enrollments across any course where this questionnaire is selected, and not to existing enrollments.
• The evaluation properties on the Manage section can be modified at the process level using the Evaluation designer. However, for adjustments to take effect, properties must be changed directly via the Learning evaluation > Manage submenu and they will only apply to users being enrolled after that change.

Managing multiple courses

You can change the properties of multiple courses with a single action by selecting the checkboxes next to the courses’ names from the main table and clicking on Choose action in the bottom right corner of the page. From the menu that opens, select Change properties.

If you select both e-learning and ILT courses, you will see two different steps in the right panel:

• Properties ILT: Manage the properties of the selected ILT courses.
• Properties e-learning: Manage the properties of the selected e-learning courses.

Best practice. If you need to change the questionnaire for only certain courses that originally used Questionnaire A—while retaining Questionnaire A for other courses that also use it—you will need to create a new questionnaire B and a new course B, and enable the learning evaluation selecting this new questionnaire, for this new course B,  specifically for the courses requiring the update. This approach allows you to implement changes selectively without affecting other courses that continue to use the original Questionnaire A.

Disabling the learning evaluation

At any time, you can disable learning evaluation from the Courses tab of the Learning evaluation main page by clicking on the ellipsis menu at the end of the course row and by selecting the Disable learning evaluation option.

As an option, you can disable the learning evaluation for multiple courses with a single action by selecting the checkboxes next to the courses’ names from the main table and clicking on Choose action in the bottom right corner of the page. From the menu that opens, select Disable learning evaluation.

When you disable the learning evaluation for a course, that course is removed from the table in the Courses tab.

Please note that:

• When you disable evaluation for a course, evaluations will not be proposed for newly enrolled learners. The data collected up to the moment you disable it is kept in the platform, and the planned evaluations continue. To cancel the learners’ evaluation, unenroll them from the session or course while the learning evaluation is enabled for the course.
• You can reactivate learning evaluation for a course where it was previously disabled, which will automatically reinstate the originally selected questionnaires. This means that you will only be able to enable or disable questionnaire types (follow-up, manager, instructor), but you will not be able to change the selected questionnaire,s nor can you alter the evaluation's confidential or nominative status.