Add-remove-confirm: crowdsourcing synset cleansing

DOI:	https://doi.org/10.1109/ICAICT.2015.7338534
URL:	https://www.researchgate.net/publication/308830410...
Weitere URL:	http://ieeexplore.ieee.org/document/7338534/
Dokumenttyp:	Konferenzveröffentlichung
Erscheinungsjahr:	2015
Buchtitel:	2015 9th International Conference on Application of Information and Communication Technologies (AICT 2015) : Rostov-on-Don, Russia, 14 - 16 October 2015
Seitenbereich:	143-147
Veranstaltungstitel:	2015 9th International Conference on Application of Information and Communication Technologies
Veranstaltungsort:	Rostov-on-Don, Russia
Veranstaltungsdatum:	October 14-16, 2015
Herausgeber:	Adamov, Abzetdin
Ort der Veröffentlichung:	Piscataway, NJ ; Red Hook, NJ
Verlag:	IEEE ; Curran
ISBN:	978-1-4673-6857-5 , 978-1-4673-6855-1
Sprache der Veröffentlichung:	Englisch
Einrichtung:	Fakultät für Wirtschaftsinformatik und Wirtschaftsmathematik > Information Systems III: Enterprise Data Analysis (Ponzetto 2016-)
Fachgebiet:	004 Informatik
Abstract:	Thesaurus is a crucial resource for many natural language processing and artificial intelligence problems, which require common sense reasoning. It is becoming highly topical to put special effort to ensure the high quality of synsets when a thesaurus is created collaboratively by non-expert annotators. This paper proposes Add-Remove-Confirm, a novel workflow for crowdsourcing synset cleansing. The present workflow has been empirically evaluated using a Russian thesaurus created through crowdsourcing showing that it does improve the synset quality as according to the expert assessment with high level of agreement.