Overview of the SV-ident 2022 shared task on survey variable identification in social science publications


Tsereteli, Tornike ; Kartal, Yavuz Selim ; Ponzetto, Simone Paolo ; Zielinski, Andrea ; Eckert, Kai ; Mayr, Philipp



URL: https://aclanthology.org/2022.sdp-1.29
Document Type: Conference or workshop publication
Year of publication: 2022
Book title: Proceedings of the Third Workshop on Scholarly Document Processing
The title of a journal, publication series: COLING / International Committee on Computational Linguistics
Volume: 29
Page range: 229-246
Conference title: COLING 2022, The 29th International Conference on Computational Linguistics
Location of the conference venue: Gyeongju, Republic of Korea
Date of the conference: 12.-17.10.2022
Publisher: Cohan, Arman ; Feigenblat, Guy ; Freitag, Dayne ; Ghosal, Tirthankar ; Herrmannova, Drahomira ; Knoth, Petr ; Lo, Kyle ; Mayr, Philipp ; Shmueli-Scheuer, Michal ; de Waard, Anita ; Wang, Lucy Lu
Place of publication: New York, NY
Publishing house: Association for Computational Linguistics
ISBN: 2951-2093
Related URLs:
Publication language: English
Institution: School of Business Informatics and Mathematics > Information Systems III: Enterprise Data Analysis (Ponzetto 2016-)
Subject: 004 Computer science, internet
Abstract: In this paper, we provide an overview of the SV-Ident shared task as part of the 3rd Workshop on Scholarly Document Processing (SDP) at COLING 2022. In the shared task, participants were provided with a sentence and a vocabulary of variables, and asked to identify which variables, if any, are mentioned in individual sentences from scholarly documents in full text. Two teams made a total of 9 submissions to the shared task leaderboard. While none of the teams improve on the baseline systems, we still draw insights from their submissions. Furthermore, we provide a detailed evaluation. Data and baselines for our shared task are freely available at https://github.com/vadis-project/sv-ident.




Dieser Eintrag ist Teil der Universitätsbibliographie.




Metadata export


Citation


+ Search Authors in

BASE: Tsereteli, Tornike ; Kartal, Yavuz Selim ; Ponzetto, Simone Paolo ; Zielinski, Andrea ; Eckert, Kai ; Mayr, Philipp

Google Scholar: Tsereteli, Tornike ; Kartal, Yavuz Selim ; Ponzetto, Simone Paolo ; Zielinski, Andrea ; Eckert, Kai ; Mayr, Philipp

ORCID: Tsereteli, Tornike, Kartal, Yavuz Selim, Ponzetto, Simone Paolo ORCID: https://orcid.org/0000-0001-7484-2049, Zielinski, Andrea, Eckert, Kai and Mayr, Philipp ORCID: https://orcid.org/0000-0002-6656-1658 ["search_editors_ORCID" not defined] Cohan, Arman, Feigenblat, Guy, Freitag, Dayne, Ghosal, Tirthankar, Herrmannova, Drahomira, Knoth, Petr, Lo, Kyle, Mayr, Philipp ORCID: https://orcid.org/0000-0002-6656-1658, Shmueli-Scheuer, Michal, de Waard, Anita and Wang, Lucy Lu

+ Page Views

Hits per month over past year

Detailed information



You have found an error? Please let us know about your desired correction here: E-Mail


Actions (login required)

Show item Show item