Papers by Giovanni Cantone
This chapter is concerned with experimental comparisons of code reading and functional testing (i... more This chapter is concerned with experimental comparisons of code reading and functional testing (including fault identification) of concurrent event-driven Java software. Our initial idea was that functional-testing is more effective than code reading with respect to concurrent event-driven OO software. A controlled experiment was initially conducted with sophomore students (inexperienced subjects). Subsequently, it was replicated with some changes with junior and senior students (moderately experienced subjects). We also conducted a further replication with Master students, which is not considered in this Chapter. The experiment goal was studied from different perspectives, including effect of techniques on the different types of faults. Results can be overviewed as the following: 1) Concerning the initial, basic experiment: with inexperienced subjects and a strict interval of inspecting time of two hours, there was no statistically significant difference between the techniques under consideration; subjects performance indicator was 62% for code reading and 75% for functional testing. 2) Concerning the (first) replication: with moderately expert subjects, again a strict interval of inspecting time of two hours, and more than twice number of seeded faults, there was no statistically significant difference between the techniques; subjects performance indicator was 100% for code reading and 92% for functional testing; subjects performance indicator shows that more experienced subjects were asking for more inspecting time; however, functional testing performed much better than in the basic experiment. Computation faults were the most detectable for code reading while control faults were the most detectable for functional testing. Moreover, moderately expert subjects were more effective than inexperienced ones in detecting interface and event types of faults. Furthermore moderately expert functional testers detected many preexistent (non-seeded) faults, while both inexperienced subjects, and moderately experienced code readers could not detect non-seeded faults.
Bookmarks Related papers MentionsView impact
This chapter discusses the experimental comparison of two reading techniques, comparing their eff... more This chapter discusses the experimental comparison of two reading techniques, comparing their effectiveness and detection rates with respect to inspecting high-level UML diagrams for defects. Artifact-related checklists drive one technique, and application use cases drive the other. Our initial idea was that the latter is more effective than the former. This experiment was developed at the University of Rome “Tor Vergata”. It was conducted with junior and senior students of object-oriented analysis and design in the university’s Department of Informatics, Systems and Production. The data collected shows that techniques performed differently. Specifically, for effectiveness, CBR in the average performed + 41.6% better than UCDR. CBR detected 15.6% more seeded defects, and +149.3% more new faults, than UCDR. The latter provided 11.6% less false positives than CBR. For detection rate, the checklist-based reading technique’s peak value occurred 25% later, and was 66.7% greater, than the use-case driven reading’s peak value. However, the results were not statistically significant. Because the use-case-driven script turned out to be much more complex than the checklist-driven one, we decided to restructure the former in multiple layers and hence conducted further experiments, the results of which are forthcoming.
Bookmarks Related papers MentionsView impact
We consider convertibility of the elements of the unified modeling language into entities of the ... more We consider convertibility of the elements of the unified modeling language into entities of the function point analysis, introduces a model for establishing the link, and presents a pilot study for comparing the function point counts provided by the model with those provided by a function point certified expert. In order to map the unified modeling language elements to function
Bookmarks Related papers MentionsView impact
Uploads
Papers by Giovanni Cantone