The WDC training dataset and gold standard for large-scale product matching

Primpeli, Anna ; Peeters, Ralph ; Bizer, Christian

Additional URL:
Document Type: Conference or workshop publication
Year of publication: 2019
Book title: Companion Proceedings of The 2019 World Wide Web Conference
Page range: 381-386
Conference title: Workshop on e-Commerce and NLP at WWW 2019
Location of the conference venue: San Francisco, CA
Date of the conference: May 13-17, 2019
Publisher: Liu, Ling
Place of publication: New York, NY, USA
Publishing house: ACM
ISBN: 978-1-4503-6675-5
Publication language: English
Institution: School of Business Informatics and Mathematics > Information Systems V: Web-based Systems (Bizer 2012-)
Subject: 004 Computer science, internet
Keywords (English): deep matching , embeddings , entity resolution , evaluation data , product matching , annotations
Abstract: A current research question in the area of entity resolution (also called link discovery or duplicate detection) is whether and in which cases embeddings and deep neural network based matching methods outperform traditional symbolic matching methods. The problem with answering this question is that deep learning based matchers need large amounts of training data. The entity resolution benchmark datasets that are currently available to the public are too small to properly evaluate this new family of matching methods. The WDC Training Dataset for Large-Scale Product Matching fills this gap. The English language subset of the training dataset consists of 20 million pairs of offers referring to the same products. The offers were extracted from 43 thousand e-shops which provide annotations including some form of product ID such as a GTIN or MPN. We also created a gold standard by manually verifying 2200 pairs of offers belonging to four product categories. Using a subset of our training dataset together with this gold standard, we are able to publicly replicate the recent result of Mudgal et al. that embeddings and deep neural network based matching methods outperform traditional symbolic matching methods on less structured data.

Dieser Eintrag ist Teil der Universitätsbibliographie.

Metadata export


+ Search Authors in

+ Page Views

Hits per month over past year

Detailed information

You have found an error? Please let us know about your desired correction here: E-Mail

Actions (login required)

Show item Show item