Software Test Management Tool Evaluation Framework
Name
Evari Koppel
Abstract
Software testing has proven its value for software development increasingly over the last
decade. With the recognition of the benefits of software testing, several software test
management tools (TMT) have emerged on the market. Although there exist different
approaches, there is no method for a systematic TMT assessment.
This is a problem because to our knowledge, evaluating TMT is rather a subjective task,
heavily depending on the evaluators’ opinions rather than based on the objective approach.
The same problem applies when test managers are asked to evaluate whether their currently
used TMT meets the company’s expectations.
In order to understand the importance and neccessity of TMT evaluation we perform a
literature study on software testing processes and existing TMT market studies. Then we map
together the identified test activities and test artifacts. The results help us formulate and
design an online questionnaire and perform a TMT survey within the Estonian IT companies.
Based on the survey results, a framework for evaluating TMT software is created. Such a
framework could potentially help companies to measure the TMT suitability to company’s
goals and to decrease subjectivity of the TMT assessment. The framework also provides test
and project managers the understanding whether their current TMTs meet the company’s
expectations. We validate the framework with a case study performed among Quality
Assurance specialists to collect information on the framework usability.
Possibilities for future work based on this thesis are numerous. The framework can be made
into an application for ease of use and wider distribution. Expanding the research onto other
European countries is another viable choice. Also expanding the TMT requirements based on
new trends in testing can be taken into consideration. In conclusion, we believe this thesis
contributes to the testing community with a practical TMT evaluation method.
Graduation Thesis language
English
Graduation Thesis type
Master - Information Technology
Supervisor(s)
Raimundas Matulevicius
Defence year
2012