Empirical Analysis of the Test Maturity Model Integration (TMMi)
Name
Kerli Rungi
Abstract
Testing is an essential part of the software development lifecycle for gaining trust in the quality of the delivered product. Concerns have been raised over the maturity of existing test processes and techniques, and the desire to improve has been acknowledged. Unfortunately, the decisions on how the improvement should be carried out are not straightforward.
This poses a variety of problems because even though there are test process improvement models available on the market, the guidelines on how to use them are unsatisfactory. Furthermore, insufficient information is available on how to choose the best model.
The current paper describes the literature study conducted on existing test process improvement models. As a result of this research, the potentially best model was chosen from the perspective of Playtech Estonia’s Casino unit. To evaluate the choice, we conducted a single-object case study of test process assessment and improvement process based on the selected Test Maturity Model integration (TMMi) in the Casino unit. As part of the assessment process, a survey was carried out and staff interviews were performed to obtain an understanding of test process maturity. Based on the outcome, improvements were proposed to Casino unit’s testing activities.
We provide an overview of the test process maturity concept of the framework and suggest how the described best practices could be considered in the organisation’s improvement process. As a result of the assessment and improvement case study, we show the importance of understanding the reasons and objectives for test process improvement in consideration with the needs of the organisation. Identifying the best model is primarily dependent on defining organisation-side requirements for an improvement framework.
An evaluation on the performance and suitability of TMMi in a software development organisation is presented based on the case study experience, raising also the concerns of its applicability in agile environments. Improvement possibilities for TMMi are described, which have been also forwarded to the model publisher TMMi Foundation, and contribute to the potential enhancement of the framework.
Graduation Thesis language
English
Graduation Thesis type
Master - Computer Science
Supervisor(s)
Raimundas Matulevičius
Defence year
2013