Change search
ReferencesLink to record
Permanent link

Direct link
An Empirical Evaluation & Comparison of Effectiveness & Efficiency of Fault Detection Testing Techniques
Blekinge Institute of Technology, School of Computing.
2013 (English)Independent thesis Advanced level (degree of Master (Two Years))Student thesis
Abstract [en]

Context: The thesis is the analysis work of the replication of software experiment conducted by Natalia and Sira at Technical University of Madrid, SPAIN. The empirical study was conducted for the verification and validation of experimental data, and to evaluate the effectiveness and efficiency of the testing techniques. The analysis blocks, considered for the analysis were observable fault, failure visibility and observed faults. The statistical data analysis involved the ANOVA and Classification package of SPSS. Objective: To evaluate and compare the result obtained from the statistical data analysis. To establish the verification and validation of effectiveness and efficiency of testing techniques by using ANOVA and Classification tree analysis for percentage subject, percentage defect-subject and values (Yes / No) for each of the blocks. RQ1: Empirical evaluation of effectiveness of fault detection testing technique, using data analysis (ANOVA and Classification tree package). For the blocks (observable fault, failure visibility and observed faults) using ANOVA and Classification tree. RQ2: Empirical evaluation of efficiency of fault detection technique, based on time and number of test cases using ANOVA. RQ3: Comparison and inference of the obtained results for both effectiveness and efficiency. Method:The research will be focused on the statistical data analysis to empirically evaluate the effectiveness and efficiency of the fault detection technique for the experimental data collected at UPM (Technical university of Madrid, SPAIN). Empirical Strategy Used: Software Experiment. Results: Based on the planned research work. The analysis result obtained for the observable fault types were standardized (Ch5). Within the observable fault block, both the techniques, functional and structural were equally effective. In the failure visibility block, the results were partially standardized. The program types nametbl and ntree were equally effective in fault detection than cmdline. The result for observed fault block was partially standardized and diverse. The list for significant factors in this blocks were program types, fault types and techniques. In the efficiency block, the subject took less time in isolating the fault in the program type cmdline. Also the efficiency in fault detection was seen in cmdline with the help of generated test cases. Conclusion:This research will help the practitioners in the industry and academic in understanding the factors influencing the effectiveness and efficiency of testing techniques.This work also presents a comprehensive analysis and comparison of results of the blocks observable fault, failure visibility and observed faults. We discuss the factors influencing the efficiency of the fault detection techniques.

Place, publisher, year, edition, pages
2013. , 378 p.
Keyword [en]
Empirical Software Engineering, Software Engineering, Software Experimentation, Verification and validation, Empirical software analysis, Testing techniques, Software experiment analysis, Software evaluation technique , Effectiveness, Efficiency
National Category
Information Systems Software Engineering
URN: urn:nbn:se:bth-4047Local ID: diva2:831366
Note +4917671952062Available from: 2015-04-22 Created: 2013-05-13 Last updated: 2015-06-30Bibliographically approved

Open Access in DiVA

fulltext(5623 kB)60 downloads
File information
File name FULLTEXT01.pdfFile size 5623 kBChecksum SHA-512
Type fulltextMimetype application/pdf

By organisation
School of Computing
Information SystemsSoftware Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 60 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 44 hits
ReferencesLink to record
Permanent link

Direct link