When probabilities are not enough - A framework for causal explanations of student success models


Cohausz, Lea


[img] PDF
593Cohausz52To75.pdf - Published

Download (493kB)

DOI: https://doi.org/10.5281/zenodo.7304800
URL: https://jedm.educationaldatamining.org/index.php/J...
URN: urn:nbn:de:bsz:180-madoc-636707
Document Type: Article
Year of publication: 2022
The title of a journal, publication series: Journal of Educational Data Mining
Volume: 14
Issue number: 3
Page range: 52-75
Place of publication: Montreal
Publishing house: International Educational Data Mining Society
ISSN: 2157-2100
Publication language: English
Institution: School of Business Informatics and Mathematics > Practical Computer Science II: Artificial Intelligence (Stuckenschmidt 2009-)
Pre-existing license: Creative Commons Attribution, Non-Commercial, No Derivatives 4.0 International (CC BY-NC-ND 4.0)
Subject: 004 Computer science, internet
Abstract: Student success and drop-out predictions have gained increased attention in recent years, connected to the hope that by identifying struggling students, it is possible to intervene and provide early help and design programs based on patterns discovered by the models. Though by now many models exist achieving remarkable accuracy-values, models outputting simple probabilities are not enough to achieve these ambitious goals. In this paper, we argue that they can be a first exploratory step of a pipeline aiming to be capable of reaching the mentioned goals. By using Explainable Artificial Intelligence (XAI) methods, such as SHAP and LIME, we can understand what features matter for the model and make the assumption that features important for successful models are also important in real life. By then additionally connecting this with an analysis of counterfactuals and a theory-driven causal analysis, we can begin to reasonably understand not just if a student will struggle but why and provide fitting help. We evaluate the pipeline on an artificial dataset to show that it can, indeed, recover complex causal mechanisms and on a real-life dataset showing the method’s applicability. We further argue that collaborations with social scientists are mutually beneficial in this area but also discuss the potential negative effects of personal intervention systems and call for careful designs.
Translation of the title: Wenn Wahrscheinlichkeiten nicht Reichen – Eine Methode zur Kausalen Erklärung von Studierenden-Erfolgsmodellen (German)

Dieser Eintrag ist Teil der Universitätsbibliographie.

Das Dokument wird vom Publikationsserver der Universitätsbibliothek Mannheim bereitgestellt.




Metadata export


Citation


+ Search Authors in

BASE: Cohausz, Lea

Google Scholar: Cohausz, Lea

+ Download Statistics

Downloads per month over past year

View more statistics



You have found an error? Please let us know about your desired correction here: E-Mail


Actions (login required)

Show item Show item