Who counts? Survey data quality in the age of AI


von der Heyde, Leah


[img]
Preview
PDF
Dissertation_vonderHeyde_2025.pdf - Published

Download (12MB)

URN: urn:nbn:de:bsz:180-madoc-709769
Document Type: Doctoral dissertation
Year of publication: 2025
Place of publication: Mannheim
University: Universität Mannheim
Evaluator: Prof. Dr. Florian Keusch
Date of oral examination: 2025
Publication language: English
Institution: School of Social Sciences > Social Data Science and Methodology (Keusch 2022-)
Subject: 300 Social sciences, sociology, anthropology
Keywords (English): survey methodology , public opinion , artificial intelligence , LLMs
Abstract: Large language models (LLMs) have been hoped to make survey research more efficient, while also improving survey data quality. However, as they are based on Internet data, LLMs may come with similar potential pitfalls as other digital data sources with regard to making inferences about human attitudes and behavior. As such, they not only have the potential to mitigate, but also to amplify existing biases regarding our understanding of different populations and constructs of interest. In this dissertation, I investigate whether and under which conditions LLMs can be leveraged in survey research by providing empirical evidence of the potentials and limits of two major applications: supplementing survey data with LLM-generated data, and coding open-ended survey responses with LLMs. I test these applications in previously unexamined contexts – European countries and languages. I conclude that LLMs cannot fully replace, but could augment human-powered survey research, given proper supervision and validation.




Dieser Eintrag ist Teil der Universitätsbibliographie.

Das Dokument wird vom Publikationsserver der Universitätsbibliothek Mannheim bereitgestellt.




Metadata export


Citation


+ Search Authors in

+ Download Statistics

Downloads per month over past year

View more statistics



You have found an error? Please let us know about your desired correction here: E-Mail


Actions (login required)

Show item Show item