Data-driven prototyping via natural-language-based GUI retrieval

Kolthoff, Kristian ; Bartelt, Christian ; Ponzetto, Simone Paolo

[img] PDF
s10515-023-00377-x.pdf - Published

Download (3MB)

Additional URL:
URN: urn:nbn:de:bsz:180-madoc-643358
Document Type: Article
Year of publication: 2023
The title of a journal, publication series: Automated Software Engineering
Volume: 30
Issue number: 1, Article 13
Page range: 1-34
Place of publication: Dordrecht
Publishing house: Kluwer ; Springer
ISSN: 0928-8910 , 1573-7535
Publication language: English
Institution: Außerfakultäre Einrichtungen > Institut für Enterprise Systems (InES)
School of Business Informatics and Mathematics > Information Systems III: Enterprise Data Analysis (Ponzetto 2016-)
Pre-existing license: Creative Commons Attribution 4.0 International (CC BY 4.0)
Subject: 004 Computer science, internet
Keywords (English): rapid prototyping of graphical user interfaces (GUIs) , information retrieval for GUIs , GUI prototypes from natural language requirements , data- driven GUI prototyping , deriving editable GUI screens
Abstract: Rapid GUI prototyping has evolved into a widely applied technique in early stages of software development to facilitate the clarification and refinement of requirements. Especially high-fidelity GUI prototyping has shown to enable productive discussions with customers and mitigate potential misunderstandings, however, the benefits of applying high-fidelity GUI prototypes are accompanied by the disadvantage of being expensive and time-consuming in development and requiring experience to create. In this work, we show RaWi, a data-driven GUI prototyping approach that effectively retrieves GUIs for reuse from a large-scale semi-automatically created GUI repository for mobile apps on the basis of Natural Language (NL) searches to facilitate GUI prototyping and improve its productivity by leveraging the vast GUI prototyping knowledge embodied in the repository. Retrieved GUIs can directly be reused and adapted in the graphical editor of RaWi. Moreover, we present a comprehensive evaluation methodology to enable (i) the systematic evaluation of NL-based GUI ranking methods through a novel high-quality gold standard and conduct an in-depth evaluation of traditional IR and state-of-the-art BERT-based models for GUI ranking, and (ii) the assessment of GUI prototyping productivity accompanied by an extensive user study in a practical GUI prototyping environment.
Additional information: Korrektur s.

Dieser Eintrag ist Teil der Universitätsbibliographie.

Das Dokument wird vom Publikationsserver der Universitätsbibliothek Mannheim bereitgestellt.

Metadata export


+ Search Authors in

+ Download Statistics

Downloads per month over past year

View more statistics

You have found an error? Please let us know about your desired correction here: E-Mail

Actions (login required)

Show item Show item