On the efficacy of dynamic behavior comparison for judging functional equivalence


Kessel, Marcus ; Atkinson, Colin


DOI: https://doi.org/10.1109/SCAM.2019.00030
URL: https://ieeexplore.ieee.org/document/8930875
Document Type: Conference or workshop publication
Year of publication: 2019
Book title: SCAM 2019 : 19th International Working Conference on Source Code Analysis and Manipulation, September 30 - October 1, 2019, Cleveland, Ohio : proceedings
Page range: 193-203
Conference title: 19th International Working Conference on Source Code Analysis and Manipulation (SCAM)
Location of the conference venue: Cleveland, OH
Date of the conference: 30.09.-01.10.19
Author/Publisher of the book
(only the first ones mentioned)
:
O'Conner, Lisa
Place of publication: Los Alamitos, CA [u.a.]
Publishing house: IEEE
ISBN: 978-1-7281-4938-7 , 978-1-7281-4937-0
ISSN: 1942-5430 , 2470-6892
Publication language: English
Institution: School of Business Informatics and Mathematics > Softwaretechnik (Atkinson)
Subject: 004 Computer science, internet
Abstract: Since it was first proposed in 1992 under the name of "behavior sampling", the idea of judging whether software systems are functionally equivalent by observing their responses to common stimuli (i.e. tests) has been used for a range of tasks such as software retrieval, functional redundancy measurement and semantic clone detection. However, its efficacy has only been studied in one small experiment, with limited generalizability, described in the original paper proposing the approach. The results of that experiment suggest that a relatively small number of randomly generated tests (i.e. 4) is sufficient to recognize non-functional-equivalent software 85% of the time. This number has therefore been adopted as "sufficient" in numerous applications of the approach. In this paper we present a much larger study which suggests at least 39 randomly generated tests are actually needed to achieve this level of effectiveness, but that a far fewer number of tests generated using coverage-based heuristics are sufficient. Since these results are much more generalizable, they have implications for future applications of behavioral sampling for dynamic behavior comparison.

Dieser Eintrag ist Teil der Universitätsbibliographie.




+ Citation Example and Export

Kessel, Marcus ; Atkinson, Colin On the efficacy of dynamic behavior comparison for judging functional equivalence. O'Conner, Lisa 193-203 In: SCAM 2019 : 19th International Working Conference on Source Code Analysis and Manipulation, September 30 - October 1, 2019, Cleveland, Ohio : proceedings (2019) Los Alamitos, CA [u.a.] 19th International Working Conference on Source Code Analysis and Manipulation (SCAM) (Cleveland, OH) [Conference or workshop publication]


+ Search Authors in

+ Page Views

Hits per month over past year

Detailed information



You have found an error? Please let us know about your desired correction here: E-Mail


Actions (login required)

Show item Show item