What does inter-rater reliability measure in assessments?

Inter-rater reliability measures the degree of agreement or consistency between different assessors when they evaluate or score the same phenomenon. This concept is essential in assessments to ensure that the measurements are not only consistent but also valid across various evaluators. High inter-rater reliability indicates that the assessors are interpreting and applying the assessment criteria in a similar manner, which enhances the credibility of the results.

The focus on assessors' consistency distinguishes this measure from other aspects of assessments, such as participant comfort, timing, or reactions to the evaluation process. While these factors are important in their own right, they do not pertain to the comparison of different assessors’ evaluations, which is the core of what inter-rater reliability examines.