Extending Test-Driven Development for Robust Web Services



Research and practice show that a large number of web services are deployed with robustness problems (i.e., presenting unexpected behaviors in the presence of invalid inputs). Test-driven development, particularly suitable for web service environments, is a software development technique based on predefined test cases that are used during development to validate the desired software improvements or new functionalities. However, building representative test cases is quite difficult and developers often miss the test cases for robustness validation. This paper demonstrates how robustness testing can be integrated in the test driven development process to improve web services robustness. To demonstrate the proposed approach we have invited experienced developers to implement three different versions of the web services specified by the standard TPC-App performance benchmark, two following the standard test-driven development process and the other using the approach proposed in this paper. Results suggest that test-driven development coupled with robustness testing is a practical way to prevent the deployment of services with robustness problems.


web services, test-driven development, robustness


Web Services Testing


International Conference on Dependability (DEPEND 2009), June 2009

Cited by

Year 2013 : 2 citations

 1. Ali Shahrokni, Robert Feldt, “A Systematic Review of Software Robustness”, Information and Software Technology (Elsevier), ISSN 0950-5849, 2013.

 Mohammed Riyad El Khoudary, “Design of a Selective Continuous Test Runner”, MSc Thesis, The Islamic University – Gaza, Palestine, June 2013.

Year 2012 : 3 citations

 2. Abhishek Sharma, Theodore D. Hellmann, Frank Maurer, "Testing of Web Services – A Systematic Mapping", IEEE World Congress on Services, SERVICES 2012, Honolulu, Hawaii, June 2012.

 3. Tim Majchrzak, Andreas Simon, “Using Spring Roo for the Test-Driven Development of Web Applications”, 27th Symposium On Applied Computing, SAC 2012, Trento, Italy, March 2012.

 Hussan Munir and Misagh Moayyed, “Systematic Literature Review and Controlled Pilot Experimental Evaluation of Test Driven Development (TDD) vs. Test-Last Development (TLD)”, PhD Thesis, School of Computing, Blekinge Institute of Technology, Sweden, May 2012.

Year 2011 : 1 citations

 1. Sammer Hanna and Amer AbuAli, “Platform Effect on Web Services Robustness Testing,” Journal of Applied Sciences 11, no. 2, 360-366, 2011.

Year 2010 : 2 citations

 1. Anand Chakravarty, “Issues in Verifying Reliability and Integrity of Data Intensive Web Services”, 28th Annual Pacific Northwest Software Quality Conference, Portland, Oregon, USA, October 18-19, 2010.

 2. Sami Kollanus, “Test-Driven Development - Still a Promising Approach?”, International Conference on the Quality of Information and Communications Technology, Porto, Portugal: 29 September – 2 October, 2010.