Assessing measurement equivalence across rating sources: a multitrait-multirater approach.

J Appl Psychol 2005 May;90(3):592-600

Air Force Research Laboratory.

Research examining the structure of multisource performance ratings has demonstrated that ratings are a direct function of both who is doing the rating (rating source) as well as what is being rated (performance dimension). A separate line of research has focused on the extent to which performance ratings are equivalent across sources. To date no research has examined the measurement equivalence of multisource ratings within the context of both dimension and rating source direct effects on ratings. We examine the impact of both performance dimension and rating source as well as the degree of measurement equivalence across sources. Results indicate that (a) the impact of the underlying performance dimension is the same across rating sources, (b) the impact of rating source is substantial and only slightly smaller than the impact of the underlying performance dimension, and (c) the impact of rating source differs substantially depending on the source.

Download full-text PDF

Source
http://dx.doi.org/10.1037/0021-9010.90.3.592DOI Listing
May 2005
2 Reads

Publication Analysis

Top Keywords

rating source
20
performance dimension
16
dimension rating
12
measurement equivalence
12
underlying performance
8
impact underlying
8
source well
8
impact rating
8
performance ratings
8
rating sources
8
rating
8
source
6
performance
6
impact
5
dimension
5
ratings
5
equivalent sources
4
context dimension
4
examined measurement
4
ratings equivalent
4

Similar Publications