The causal effect of survey mode on students’ evaluations of teaching: Empirical evidence from three field experiments


Treischl, Edgar ; Wolbring, Tobias



DOI: https://doi.org/10.1007/s11162-017-9452-4
URL: https://link.springer.com/article/10.1007/s11162-0...
Weitere URL: https://www.researchgate.net/publication/315922236...
Dokumenttyp: Zeitschriftenartikel
Erscheinungsjahr: 2017
Titel einer Zeitschrift oder einer Reihe: Research in higher education
Band/Volume: 58
Heft/Issue: 8
Seitenbereich: 904-921
Ort der Veröffentlichung: Dordrecht [u.a.]
Verlag: Springer Science + Business Media
ISSN: 0361-0365 , 1573-188X
Sprache der Veröffentlichung: Englisch
Einrichtung: Außerfakultäre Einrichtungen > GESS - CDSS (SOWI)
Außerfakultäre Einrichtungen > MZES - Arbeitsbereich A
Fakultät für Sozialwissenschaften > Soziologie, insbes. Längsschnittdatenanalyse (Juniorprofessur) (Wolbring 2015-2017)
Fachgebiet: 300 Sozialwissenschaften, Soziologie, Anthropologie
Abstract: In recent years many universities switched from paper- to online-based student evaluation of teaching (SET) without knowing the consequences for data quality. Based on a series of three consecutive field experiments - a split-half design, twin courses, and pre–post-measurements - this paper examines the effects of survey mode on SET. First, all three studies reveal marked differences in non-response between online- and paper-based SET and systematic, but small differences in the overall course ratings. On average, online SET reveal a slightly less optimistic picture of teaching quality in students’ perception. Similarly, a web survey mode does not impair the reliability of student ratings. Second, we highlight the importance of taking selection and class absenteeism into account when studying survey mode effects and also show that it is necessary and informative to survey the subgroup of no-shows when evaluating teaching. Third, we empirically demonstrate the need to account for contextual setting of the survey (in class vs. after class) and the specific type of the online survey mode (TAN vs. email). Previous research either confounded contextual setting with variation in survey mode or generalized results for a specific online mode to web surveys in general. Our findings suggest that higher response rates in email surveys can be achieved if students are given the opportunity and time to evaluate directly in class.




Dieser Eintrag ist Teil der Universitätsbibliographie.




Metadaten-Export


Zitation


+ Suche Autoren in

+ Aufruf-Statistik

Aufrufe im letzten Jahr

Detaillierte Angaben



Sie haben einen Fehler gefunden? Teilen Sie uns Ihren Korrekturwunsch bitte hier mit: E-Mail


Actions (login required)

Eintrag anzeigen Eintrag anzeigen