Skip to main content
Skip table of contents

Copy of Effectiveness Check Report

This report provides the report executor with a detailed evaluation of the effectiveness check feedback form responses so that he can evaluate the effectiveness of the trainings being conducted.

image-20250306-095611.png

Effectiveness check Evaluation page

image-20250306-095640.png

Effectiveness check Question Evaluation page

Key Performance Indicators

The effectiveness check report analyses the following KPIs in the order mentioned.

image-20250306-095753.png

KPI - Overall average score for all questions on effectiveness by quarter

 This KPI shows the average score for all questions on effectiveness (in percentage) by quarter. Average Score is calculated as follows:

Yes/No - (no. of users who have responded yes / total no. of replies) * 100.

Single response - (average value of the responses/highest value) * 100

Multiple choice - (average value of the responses/highest value) * 100

Free text: no. of participants who have responded positive / total no. of replies) * 100.

Matrix: sum of average values of each row / no of rows

For Arrange feedback form question type, average score is n/a.

image-20250306-095818.png

KPI - Questions with more than 50% discrepancy between supervisor and learner feedback

This KPI displays a count of questions with more than 50% discrepancy between supervisor and learner feedback.

image-20250306-095832.png

KPI - Supervisor feedback

This KPI displays the number of questions with an average score below 50% reflecting the courses which have not been well-received by the participants and need further improvement.

image-20250306-124757.png

Visual - Learners feedback

Also the KPI displays the number of single response questions which have received even a single response lower or equal than 20% of the maximum value and thus helps to identify the outliers.

image-20250306-124830.png

Visual - Questions

This overview displays the question´s name, text, type, published version, no. of addressees (participants (enrolled, in progress, passed, failed, cancelled if response has been submitted) and their supervisor), no. of replies, response rate, avg. response value in % (learner and supervisor combined), avg. response value (supervisor), avg. response value in % (supervisor), avg. response value (learner)

avg. response value in % (learner) and question ID. 

Drill-down Page

The drill-down page analyses the following KPIs in the order mentioned.

image-20250306-124921.png

Feedback question card

This card is shown if the specific question is selected. It displays question text, name, type, minimum value, maximum value, no. of feedback forms, courses, addresses to which have this question has been assigned, no. of replies.

image-20250306-125232.png

Visual - Courses

This overview displays course templates and courses to which the selected feedback question has been assigned, addresses, no. of replies and if feedback evaluation period is over.

image-20250306-125310.png

KPI - Average effectiveness score (in %)

This KPI displays the average effectiveness score (in %) given by the learners and supervisors for the selected feedback question.

image-20250306-125340.png

KPI - Courses with lowest average response score (supervisor + learner)

This KPI displays the courses with lowest average score (in %) given by the learners and supervisors for the selected feedback question.

image-20250306-125422.png

KPI - Courses with top average response score (supervisor + learner)

This KPI displays the courses with top average score (in %) given by the learners and supervisors for the selected feedback question.

image-20250306-125518.png

KPI - Average effectiveness score trend

This KPI displays the trend of the combined average score (in %) by the learner and the supervisor compared by the course templates (including versions) for the selected question.

image-20250306-125550.png

KPI - Results (count of answers)

This KPI displays how many participants have chosen yes and how many have chosen no for the selected Yes/No feedback question and compare it across the courses.

image-20250306-125624.png

KPI - Results (count of answers)

This KPI displays how many participants have chosen the specific option for single response/multiple choice feedback question and compare it across the courses.

image-20250306-125659.png

KPI - Results (absolute)

This KPI displays the number of participants who have chosen the respective option in each row of the selected matrix feedback question and compare it across the courses.

image-20250306-130138.png

KPI - Results (absolute)

This KPI displays the number of participants who have ranked the specific item as first, second and so on for the selected arrange feedback question and compare it across the courses.

image-20250306-130214.png

Visual - Results details by average rank of option

This KPI displays the highest average rank option for the selected arrange question and compare it across the courses.

image-20250306-125742.png

Visual - Results details

This KPI displays responses for the selected free-text feedback question and marks it as positive, negative, or neutral and compares it across the courses.

image-20250306-131007.png

Visual - Overview

This overview displays the course name, response rate, average respondents score, discrepancy in score (learner vs supervisor), average score (supervisor), average % score (supervisor), average score (learner), average % score (learner), course card.

Metrics

The effectiveness check report allows filtering the report results by the following metrics in the listed order.

image-20250306-094706.png

Metric - Feedback submission period

This metric filters the report by the desired feedback submission period when the feedback form was submitted. The default time period is 6 months.

image-20250306-131435.png

Metric - Feedback templates and feedbacks

This metric lists all feedback form templates and feedback forms assigned to the courses the reporter has access rights. The selection of a feedback form template also selects all listed feedback forms of that template. 

image-20250306-094647.png

Metric - Feedback evaluation period is over

When the “Feedback evaluation period is over” is selected, only the questions from the feedback forms assigned to date-dependent courses for which the feedback evaluation period is over are considered.

N/A is shown in case no such feedback question is available.

image-20250306-094540.png

Metric - Course templates and courses

This metric list all courses the reporter has access rights and their course templates. The choice of a course template also selects all listed courses of that template. 

image-20250306-131848.png

Metric - Learning mode

 This metric list all learning modes assigned to the courses the reporter has access rights.

image-20250306-094750.png

Metric - Providers

This metric lists all providers assigned to the courses the reporter has access rights.

image-20250306-094736.png

Metric - Tutors

This metric lists all tutors who have been assigned the tutor role in the course template and courses the reporter has access rights.

image-20250306-132036.png

Metric - Classifications

This metric filters the report by the desired classification assigned to the feedback form question belonging to the effectiveness check feedback form of the courses the user has access to.

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.