On the efficacy of dynamic behavior comparison for judging functional equivalence


Kessel, Marcus ; Atkinson, Colin



DOI: https://doi.org/10.1109/SCAM.2019.00030
URL: https://ieeexplore.ieee.org/document/8930875
Dokumenttyp: Konferenzveröffentlichung
Erscheinungsjahr: 2019
Buchtitel: SCAM 2019 : 19th International Working Conference on Source Code Analysis and Manipulation, September 30 - October 1, 2019, Cleveland, Ohio : proceedings
Seitenbereich: 193-203
Veranstaltungstitel: 19th International Working Conference on Source Code Analysis and Manipulation (SCAM)
Veranstaltungsort: Cleveland, OH
Veranstaltungsdatum: 30.09.-01.10.19
Herausgeber: O'Conner, Lisa
Ort der Veröffentlichung: Los Alamitos, CA [u.a.]
Verlag: IEEE
ISBN: 978-1-7281-4938-7 , 978-1-7281-4937-0
ISSN: 1942-5430 , 2470-6892
Sprache der Veröffentlichung: Englisch
Einrichtung: Fakultät für Wirtschaftsinformatik und Wirtschaftsmathematik > Software Engineering (Atkinson 2003-)
Fachgebiet: 004 Informatik
Abstract: Since it was first proposed in 1992 under the name of "behavior sampling", the idea of judging whether software systems are functionally equivalent by observing their responses to common stimuli (i.e. tests) has been used for a range of tasks such as software retrieval, functional redundancy measurement and semantic clone detection. However, its efficacy has only been studied in one small experiment, with limited generalizability, described in the original paper proposing the approach. The results of that experiment suggest that a relatively small number of randomly generated tests (i.e. 4) is sufficient to recognize non-functional-equivalent software 85% of the time. This number has therefore been adopted as "sufficient" in numerous applications of the approach. In this paper we present a much larger study which suggests at least 39 randomly generated tests are actually needed to achieve this level of effectiveness, but that a far fewer number of tests generated using coverage-based heuristics are sufficient. Since these results are much more generalizable, they have implications for future applications of behavioral sampling for dynamic behavior comparison.




Dieser Eintrag ist Teil der Universitätsbibliographie.




Metadaten-Export


Zitation


+ Suche Autoren in

+ Aufruf-Statistik

Aufrufe im letzten Jahr

Detaillierte Angaben



Sie haben einen Fehler gefunden? Teilen Sie uns Ihren Korrekturwunsch bitte hier mit: E-Mail


Actions (login required)

Eintrag anzeigen Eintrag anzeigen