TY - JOUR
T1 - Students' evaluation of teaching: Concerns of item diagnosticity
AU - Madden, Thomas J.
AU - Dillon, William R.
AU - Leak, Roland
PY - 2010/12/1
Y1 - 2010/12/1
N2 - The validity and reliability of students' evaluation of teaching effectiveness has been debated since the 1970s. One concern is the extent to which the ratings are influenced by halo, and if so, how does halo affect the interpretation of the ratings? This study seeks to assess the degree to which the halo affects the diagnosticity of individual teaching evaluation items. Statistical methods are used to identify and purge the individual item ratings of halo. Three professors are compared using the observed teaching evaluation scores and the observed scores once the halo has been purged. Results indicate that the halo is present in the scores and that the halo does bias the interpretation of teaching effectiveness, especially when the goal is to compare one professor with another. © The Author(s) 2010.
AB - The validity and reliability of students' evaluation of teaching effectiveness has been debated since the 1970s. One concern is the extent to which the ratings are influenced by halo, and if so, how does halo affect the interpretation of the ratings? This study seeks to assess the degree to which the halo affects the diagnosticity of individual teaching evaluation items. Statistical methods are used to identify and purge the individual item ratings of halo. Three professors are compared using the observed teaching evaluation scores and the observed scores once the halo has been purged. Results indicate that the halo is present in the scores and that the halo does bias the interpretation of teaching effectiveness, especially when the goal is to compare one professor with another. © The Author(s) 2010.
KW - halo bias
KW - halo decomposition
KW - instructor comparison
KW - instructor effectiveness
KW - student evaluations of teaching ratings
UR - https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=78049391918&origin=inward
UR - https://www.scopus.com/inward/citedby.uri?partnerID=HzOxMe3b&scp=78049391918&origin=inward
U2 - 10.1177/0273475310377759
DO - 10.1177/0273475310377759
M3 - Article
SN - 0273-4753
VL - 32
SP - 264
EP - 274
JO - Journal of Marketing Education
JF - Journal of Marketing Education
IS - 3
ER -