I spy with my little eye a minimum cost multicut investigation of dataset frames


Prasse, Katharina ; Bravo, Isaac ; Walter, Stefanie ; Keuper, Margret



DOI: https://doi.org/10.1109/WACV61041.2025.00214
URL: https://ieeexplore.ieee.org/document/10943464
Additional URL: https://openaccess.thecvf.com/content/WACV2025/pap...
Document Type: Conference or workshop publication
Year of publication: 2025
Book title: Proceedings of the Winter Conference on Applications of Computer Vision (WACV)
Page range: 2134-2143
Conference title: WACV 2025, IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
Location of the conference venue: Tucson, AZ
Date of the conference: 28.02.-04.03.2025
Place of publication: Online
Publishing house: Computer Vision Foundation
Publication language: English
Institution: School of Business Informatics and Mathematics > Machine Learning (Keuper 2024-)
Subject: 004 Computer science, internet
Abstract: Visual framing analysis is a key method in social sciences for determining common themes and concepts in a given discourse. To reduce manual effort, image clustering can significantly speed up the annotation process. In this work, we phrase the clustering task as a Minimum Cost Multicut Problem [MP]. Solutions to the MP have been shown to provide clusterings that maximize the posterior probability, solely from provided local, pairwise probabilities of two images belonging to the same cluster. We discuss the efficacy of numerous embedding spaces to detect visual frames and show its superiority over other clustering methods. To this end, we employ the climate change dataset ClimateTV which contains images commonly used for visual frame analysis. For broad visual frames, DINOv2 is a suitable embedding space, while ConvNeXt V2 returns a larger number of clusters which contain fine-grain differences, i.e. speech and protest. Our insights into embedding space differences in combination with the optimal clustering - by definition - advances automated visual frame detection. Our code can be found at https://github. com/KathPra/MP4VisualFrameDetection.




Dieser Eintrag ist Teil der Universitätsbibliographie.




Metadata export


Citation


+ Search Authors in

+ Page Views

Hits per month over past year

Detailed information



You have found an error? Please let us know about your desired correction here: E-Mail


Actions (login required)

Show item Show item