WCSE

A Case Study of Applying Rigorous Testing in Practice

Abstract— This paper reports on experiences and preliminary results we obtained through a case study, in which we applied a rigorous testing method, namely statistical testing based on a Markov chain usage model, to a real-world testing problem in an industrial setting. Although model-based statistical testing has been around for more than two decades with well-established theory and engineering practices, it remains problem- and application-specific to develop a workable testing solution and framework that enables automatic test case generation-execution-evaluation, to provide meaningful and quantifiable statistics/data to make informed management decisions, and to support software certification. We describe the challenge involved in testing an Interactive Voice Response (IVR) module, and demonstrate our approach to tackle the problem following statistical testing practices, from usage modeling all the way to the test case analysis

Index Terms— Software testing, rigorous testing, statistical testing, model-based testing, Markov chain usage models, software quality

Yufeng Xue, Lan Lin
Department of Computer Science, Ball State University, USA
John C. Tucker, Becky Hammons, Michael Wolfe
Ontario Systems,USA

[Download]

Cite: Yufeng Xue, Lan Lin, John C. Tucker, Becky Hammons, Michael Wolfe, "A Case Study of Applying Rigorous Testing in Practice," Proceedings of 2019 the 9th International Workshop on Computer Science and Engineering, pp. 475-481, Hong Kong, 15-17 June, 2019.