OSS-TMM Guidelines for improving the testing process of open source software

Publication Type:

Journal Article


International Journal of Open Source Software and Processes (IJOSSP), International Journal of Open Source Software and Processes (2011)


<p>Open Source Software (OSS) products do not simply follow the traditional software engineering development paradigms found in textbooks. Speci cally, testing activities in OSS development may be quite di erent from those carried out in Closed Source Software (CSS) development, also due to the fact that OSS processes seem to be less structured than CSS ones. Since testing and, in general, veri cation may require a good deal of resources in OSS, it is necessary to have a means for assessing and improving OSS testing processes. In this paper, we discuss an approach for introducing a Maturity Model for the testing activities of OSS development (OSS-TMM). This approach is based on four maturity levels, which are de ned by taking into account the speci c characteristics of the OSS product under test. We discuss the goals that OSS-TMM helps reach and the issues involved. We demonstrate its applicability by using it on two real-life projects, BusyBox and Apache Httpd. Finally, we correlate the maturity level of a representative set of OSS products with respect to their bug rate to comprehend whether a high maturity of the testing process directly means a high quality of the product.</p>