Assessment analysis in portfolios (integral assessment)

Summary
Procedure for assessment analysis in portfolio-based assessment (integral assessment)

As part of quality assurance, various educational evaluations are carried out within Fontys ICT. This means that for each unit of study, among other things, an assessment analysis must be carried out by the lecturers. The assessment analysis is a mandatory part of the test file, for which the Project Leader Programme Implementation (PLOU) is responsible.

The purpose of the assessment analysis is to determine whether the assessment was valid, reliable and transparent and to identify possible points of improvement in the assessment for a subsequent implementation. A particular focus is to identify differences between the various implementation variants (course-based teaching methods, demand-based teaching methods and open teaching methods in both Eindhoven, and Tilburg). There has never been a revision of past assessment results as a result of this assessment analysis.

1. The assessment analysis is a calibration in which the findings of the assessment are discussed.
2. The assessment analysis is conducted (shortly) after the assessment.
3. The assessment analysis takes place across (implementation variant and location) with a representation of the assessors of a unit of study. This means that for an assessment analysis at least 1 representative from the course-based teaching method, demand-based teaching method Eindhoven and demand-based teaching method Tilburg participates. If the group becomes too large, a choice can be made to divide this based on the units in that semester. At semester 2 and 3, assessment analysis will also be done for Associate degree.
4. The assessment analysis is timed to a maximum of 1 hour, under the supervision of the chairman.
5. During the assessment analysis, an “Outstanding/Good” , a “Satisfactory” and an “Unsatisfactory” portfolio is re-evaluated by the participants. One portfolio of each implementation variant and location is delivered to the chairman for this purpose.
6. From the assessment analysis minutes are taken with the most striking findings as well as the follow-up actions to be taken to improve the assessment in the next implementation of the unit of study.
7. During the assessment analysis the following form is used: Form Assessment Analysis (docx, version 09-2020) and completed. This form is part of the minutes.
8. The minutes of the assessment analysis are included in the corresponding assessment file, as described in the test policy.
9. It is possible, if desired, to schedule an intervision moment before the assessment to discuss, for example, findings that follow from the preparation of the assessment.