Self-refinement strategies for LLM-based product attribute value extraction

Vorschau

PDF
BTW2025-132.pdf - Veröffentlichte Version
Download (456kB)

DOI:	https://doi.org/10.18420/BTW2025-132
URL:	https://dl.gi.de/items/1c6f9643-a1de-447a-a348-414...
URN:	urn:nbn:de:bsz:180-madoc-708162
Dokumenttyp:	Konferenzveröffentlichung
Erscheinungsjahr:	2025
Buchtitel:	Datenbanksysteme für Business, Technologie und Web (BTW 2025) : Workshopband, 03.-07. März 2025, Bamberg, Deutschland
Titel einer Zeitschrift oder einer Reihe:	GI-Edition : Lecture Notes in Informatics. Proceedings
Band/Volume:	P-363
Seitenbereich:	291-304
Veranstaltungstitel:	BTW 2025, 21st Conference on Database Systems for Business, Technology and Web
Veranstaltungsort:	Bamberg, Germany
Veranstaltungsdatum:	03.-07.03.2025
Herausgeber:	Binnig, Carsten ; Henrich, Andreas ; Nicklas, Daniela ; Schüle, Maximilian E. ; Meyer-Wegener, Klaus
Ort der Veröffentlichung:	Bonn
Verlag:	Gesellschaft für Informatik (GI)
ISSN:	1617-5468 , 2944-7682
Verwandte URLs:	https://btw2025.gi.de/
Sprache der Veröffentlichung:	Englisch
Einrichtung:	Fakultät für Wirtschaftsinformatik und Wirtschaftsmathematik > Information Systems V: Web-based Systems (Bizer 2012-)
Bereits vorhandene Lizenz:	Creative Commons Namensnennung, Weitergabe unter gleichen Bedingungen 4.0 International (CC BY-SA 4.0)
Fachgebiet:	004 Informatik
Freie Schlagwörter (Englisch):	information extraction , product attribute value extraction , self-refinement , Large Language Models , e-commerce
Abstract:	Structured product data, represented as attribute-value pairs, is crucial for e-commerce platforms to enable features such as faceted product search and attribute-based product comparison. However, vendors often supply unstructured product descriptions, necessitating attribute value extraction to ensure data consistency and usability. Large language models (LLMs), including OpenAI's GPT-4o, have demonstrated their potential for product attribute value extraction in few-shot scenarios. Recent research has shown that self-refinement techniques can improve the performance of LLMs on tasks such as code generation and text-to-SQL translation. For other tasks, applying these techniques has only led to increased costs due to the processing of additional tokens, without achieving an improved performance. This paper investigates applying two self-refinement techniques — error-based prompt rewriting and self-correction — to the product attribute value extraction task. The self-refinement techniques are evaluated across zero-shot, few-shot in-context learning, and fine-tuning scenarios. Experimental results reveal that both self-refinement techniques have a marginal impact on the performance of GPT-4o across the different scenarios while significantly increasing processing costs. For attribute value extraction scenarios involving training data, fine-tuning yields the highest performance while the ramp-up costs of fine-tuning are balanced out as the amount of product descriptions grows.