Selection bias in students’ evaluation of teaching : causes of student absenteeism and its consequences for course ratings and rankings

Wolbring, Tobias ; Treischl, Edgar

Additional URL:
Document Type: Article
Year of publication: 2016
The title of a journal, publication series: Research in higher education
Volume: 57
Issue number: 1
Page range: 51-71
Place of publication: Dordrecht [u.a.]
Publishing house: Springer Science + Business Media
ISSN: 0361-0365 , 1573-188X
Publication language: English
Institution: School of Social Sciences > Soziologie, insbes. Längsschnittdatenanalyse (Juniorprofessur) (Wolbring 2015-2017)
Außerfakultäre Einrichtungen > Graduate School of Economic and Social Sciences- CDSS (Social Sciences)
School of Social Sciences > Statistik u. Sozialwissenschaftliche Methodenlehre (Kreuter 2014-2020)
Subject: 300 Social sciences, sociology, anthropology
310 Statistics
370 Education
Individual keywords (German): Kursbesuch , Studentische Lehrevaluation , Missing Data , Selbstselektion , Sample Selection Bias
Keywords (English): Class attendance ; Missing data ; Students’ evaluations of teaching (SET) ; Sample selection bias , Self-selection
Abstract: Systematic sampling error due to self-selection is a common topic in methodological research and a key challenge for every empirical study. Since selection bias is often not sufficiently considered as a potential flaw in research on and evaluations in higher education, the aim of this paper is to raise awareness for the topic using the case of students’ evaluations of teaching (SET). First, we describe students’ selection decisions at different points of their studies and elaborate potential biases which they might cause for SET. Then we empirically illustrate the problem and report findings from a design with two measurement points in time showing that approximately one third of the students do not attend class at the second time of measurement, when the regular SET takes place. Furthermore, the results indicate that the probability of absenteeism is influenced by course quality, students’ motivation, course topic, climate among course participants, course- and workload, and timing of the course. Although data are missing not at random, average ratings do not strongly change after adjusting for selection bias. However, we find substantial changes in rankings based on SET. We conclude from this that, at least as regards selection bias, SET are a reliable instrument to assess quality of teaching at the individual level but are not suited for the comparison of courses.

Dieser Eintrag ist Teil der Universitätsbibliographie.

Metadata export


+ Search Authors in

+ Page Views

Hits per month over past year

Detailed information

You have found an error? Please let us know about your desired correction here: E-Mail

Actions (login required)

Show item Show item