On the Status of Experimental Research on the Semantic Web

Stuckenschmidt, Heiner ; Schuhmacher, Michael ; Knopp, Johannes ; Meilicke, Christian ; Scherp, Ansgar

DOI:	https://doi.org/10.1007/978-3-642-41335-3_37
URL:	http://dl.acm.org/citation.cfm?id=2717167
Additional URL:	http://publications.wim.uni-mannheim.de/informatik...
Document Type:	Conference or workshop publication
Year of publication:	2013
Book title:	The Semantic Web - ISWC 2013 : 12th International Semantic Web Conference, Sydney, NSW, Australia, October 21-25, 2013, Proceedings, Part I
The title of a journal, publication series:	Lecture Notes in Computer Science
Volume:	8218
Page range:	591-606
Date of the conference:	23.10.2013
Publisher:	Alani, Harith
Place of publication:	Berlin [u.a.]
Publishing house:	Springer
ISBN:	978-3-642-41334-6
ISSN:	0302-9743 , 1611-3349
Publication language:	English
Institution:	School of Business Informatics and Mathematics > Neue Medien in der Wirtschaftsinformatik (Juniorprofessur) (Scherp 2012-2013) School of Business Informatics and Mathematics > Practical Computer Science II: Artificial Intelligence (Stuckenschmidt 2009-)
Subject:	004 Computer science, internet
Abstract:	Experimentation is an important way to validate results of Semantic Web and Computer Science research in general. In this paper, we investigate the development and the current status of experimental work on the Semantic Web. Based on a corpus of 500 papers collected from the International Semantic Web Conferences (ISWC) over the past decade, we analyse the importance and the quality of experimental research conducted and compare it to general Computer Science. We observe that the amount and quality of experiments are steadily increasing over time. Unlike hypothesised, we cannot confirm a statistically significant correlation between a paper’s citations and the amount of experimental work reported. Our analysis, however, shows that papers comparing themselves to other systems are more often cited than other papers.