Probabilistic evaluation of process model matching techniques


Kuss, Elena ; Leopold, Henrik ; Van der Aa, Han ; Stuckenschmidt, Heiner ; Reijers, Hajo A.


[img]
Preview
PDF
KussER16.pdf - Published

Download (432kB)

DOI: https://doi.org/10.1007/978-3-319-46397-1_22
URL: https://ub-madoc.bib.uni-mannheim.de/41112
Additional URL: http://link.springer.com/chapter/10.1007/978-3-319...
URN: urn:nbn:de:bsz:180-madoc-411127
Document Type: Conference or workshop publication
Year of publication: 2016
Book title: Conceptual modeling : 35th international conference, ER 2016, Gifu, Japan, November 14-17, 2016 : proceedings
The title of a journal, publication series: Lecture Notes in Computer Science
Volume: 9974
Page range: 279-292
Date of the conference: November 14-17, 2016
Author/Publisher of the book
(only the first ones mentioned)
:
Comyn-Wattiau, Isabelle
Place of publication: Cham
Publishing house: Springer
ISBN: 978-3-319-46396-4 , 978-3-319-46397-1
ISSN: 0302-9743
Publication language: English
Institution: School of Business Informatics and Mathematics > Praktische Informatik II (Stuckenschmidt 2009-)
Subject: 004 Computer science, internet
Keywords (English): Process Model Matching , Non-binary Evaluation , Matching Performance Assessment
Abstract: Process model matching refers to the automatic identification of corresponding activities between two process models. It represents the basis for many advanced process model analysis techniques such as the identification of similar process parts or process model search. A central problem is how to evaluate the performance of process model matching techniques. Often, not even humans can agree on a set of correct correspondences. Current evaluation methods, however, require a binary gold standard, which clearly defines which correspondences are correct. The disadvantage of this evaluation method is that it does not take the true complexity of the matching problem into account and does not fairly assess the capabilities of a matching technique. In this paper, we propose a novel evaluation method for process model matching techniques. In particular, we build on the assessment of multiple annotators to define probabilistic notions of precision and recall. We use the dataset and the results of the Process Model Matching Contest 2015 to assess and compare our evaluation method. We found that our probabilistic evaluation method assigns different ranks to the matching techniques from the contest and allows to gain more detailed insights into their performance.

Dieser Eintrag ist Teil der Universitätsbibliographie.

Das Dokument wird vom Publikationsserver der Universitätsbibliothek Mannheim bereitgestellt.




+ Citation Example and Export

Kuss, Elena ; Leopold, Henrik ; Van der Aa, Han ; Stuckenschmidt, Heiner ORCID: 0000-0002-0209-3859 ; Reijers, Hajo A. Probabilistic evaluation of process model matching techniques. Open Access Comyn-Wattiau, Isabelle Lecture Notes in Computer Science 9974 279-292 In: Conceptual modeling : 35th international conference, ER 2016, Gifu, Japan, November 14-17, 2016 : proceedings (2016) Cham [Conference or workshop publication]
[img]
Preview


+ Search Authors in

+ Download Statistics

Downloads per month over past year

View more statistics



You have found an error? Please let us know about your desired correction here: E-Mail


Actions (login required)

Show item Show item