|
ReSi: A comprehensive benchmark for representational similarity measures
Klabunde, Max
;
Wald, Tassilo
;
Schumacher, Tobias
;
Maier-Hein, Klaus
;
Strohmaier, Markus
;
Lemmerich, Florian
![[img]](https://madoc.bib.uni-mannheim.de/71342/1.hassmallThumbnailVersion/7022_ReSi_A_Comprehensive_Benc.pdf)  Preview |
|
PDF
7022_ReSi_A_Comprehensive_Benc.pdf
- Published
Download (5MB)
|
|
URL:
|
https://openreview.net/forum?id=PRvdO3nfFi
|
|
URN:
|
urn:nbn:de:bsz:180-madoc-713429
|
|
Document Type:
|
Conference or workshop publication
|
|
Year of publication:
|
2025
|
|
Book title:
|
13th International Conference on Learning Representations (ICLR 2025)
|
|
Page range:
|
1-40
|
|
Conference title:
|
ICLR 2025, The Thirteenth International Conference on Learning Representations
|
|
Location of the conference venue:
|
Singapur, Singapore
|
|
Date of the conference:
|
24.-28.04.2025
|
|
Place of publication:
|
Red Hook, NY
|
|
Publishing house:
|
Curran Associates, Inc.
|
|
ISBN:
|
979-8-3313-2193-2 , 979-8-3313-2085-0
|
|
Related URLs:
|
|
|
Publication language:
|
English
|
|
Institution:
|
Business School > Data Science in the Economic and Social Sciences (Strohmaier, 2022-)
|
|
Pre-existing license:
|
 Creative Commons Attribution 4.0 International (CC BY 4.0)
|
|
Subject:
|
004 Computer science, internet
|
|
Keywords (English):
|
representational similarity , benchmark , grounding , representations
|
|
Abstract:
|
Measuring the similarity of different representations of neural architectures is a fundamental task and an open research challenge for the machine learning community. This paper presents the first comprehensive benchmark for evaluating representational similarity measures based on well-defined groundings of similarity. The representational similarity (ReSi) benchmark consists of (i) six carefully designed tests for similarity measures, (ii) 24 similarity measures, (iii) 14 neural network architectures, and (iv) seven datasets, spanning over the graph, language, and vision domains. The benchmark opens up several important avenues of research on representational similarity that enable novel explorations and applications of neural architectures. We demonstrate the utility of the ReSi benchmark by conducting experiments on various neural network architectures, real world datasets and similarity measures. All components of the benchmark are publicly available and thereby facilitate systematic reproduction and production of research results. The benchmark is extensible, future research can build on and further expand it. We believe that the ReSi benchmark can serve as a sound platform catalyzing future research that aims to systematically evaluate existing and explore novel ways of comparing representations of neural architectures.
|
 | Dieser Eintrag ist Teil der Universitätsbibliographie. |
 | Das Dokument wird vom Publikationsserver der Universitätsbibliothek Mannheim bereitgestellt. |
 Search Authors in
BASE:
Klabunde, Max
;
Wald, Tassilo
;
Schumacher, Tobias
;
Maier-Hein, Klaus
;
Strohmaier, Markus
;
Lemmerich, Florian
Google Scholar:
Klabunde, Max
;
Wald, Tassilo
;
Schumacher, Tobias
;
Maier-Hein, Klaus
;
Strohmaier, Markus
;
Lemmerich, Florian
ORCID:
Klabunde, Max ; Wald, Tassilo ; Schumacher, Tobias  ORCID: 0000-0003-3091-5095 ; Maier-Hein, Klaus ; Strohmaier, Markus ORCID: 0000-0002-5485-5720 ; Lemmerich, Florian
You have found an error? Please let us know about your desired correction here: E-Mail
Actions (login required)
 |
Show item |
|
