Tuli Nivas
ABSTRACT
Scarcity of commercially available testing tools that could support all native or application specific message formats as well as those that cater to non GUI or non web based backend applications leads to creating your own customized traffic generators or scripts. Also the test environment setup may differ from one system to another -- some may use simulators or mocks to stub out complex software, others may just be a scaled down (in terms of number of servers) replica of the production environment. So what are the factors that need to be considered when creating scripts that can be used for native request formats and for non GUI or web based applications? How do we design a script that is easy to maintain and extend when new test scenarios are added to accurately assess the performance of an application? This paper provides (1) the general design principles for a test script that can be used to generate traffic for any request format as well as (2) specific factors to keep in mind when creating a script that will work in a test environment that uses a mock. In addition to this the core activities of testing include not only traffic generation but also setting up the environment, verifying that both the hardware and software configurations are accurate prior to sending traffic and creating a report at the end of the test. Therefore the test script needs to be part of a complete harness that accomplishes these tasks. The paper will address the (3) design and properties of such a harness. It provides a simple framework that can be easily used to complete an end to end testing process -pre test, traffic generation and post test activities.
- Johnson D J, Roselli P, 2003. Using XML as a flexible portable test script language. In Proceedings of IEEE Systems and Readiness Technology Conference (AUTOTESTCON), p 187--192Google Scholar
Cross Ref
- Chongwu Jiang, Bin Liu, Yongfeng Yin, Chang Liu, 2009. Study on real-time test script in automated test equipment. In Proceedings of 8th International Conference on Maintainability and Safety (ICRMS), p 738--742Google ScholarCross Ref
- Grechanik M, Qing Xie, Chen Fu, 2009. Maintaining and evolving GUI-directed test scripts. In Proceedings of 31st International Conference on Software Engineering (ICSE), p 408--418 Google ScholarDigital Library
- Jha A K, 2010. Development of test automation framework for testing avionics systems. In Proceedings of 29th IEEE/AIAA Digital Avionics Systems Conference (DASC), p 6.E.5-1--6.E.5-11Google ScholarCross Ref
- Stefan Berner, Roland Weber, Rudolf K Keller, 2005. Observations and lesions learned from automated testing. In Proceedings of 27th International Conference on Software Engineering (ICSE), p 571--579 Google ScholarDigital Library
- Bahareh Badhan, Martin Franzle, Jan Peleska, Tino Teige, 2006. Test automation for hybrid systems, In Proceedings of 3rd International Workshop on Software Quality Assurance (SOQUA), p 14--21 Google ScholarDigital Library
- Marlon Vieira, Johanne Leduc, Bill Hasling, Rajesh Subramanyan, Juergen Kaszmeir, 2006. Automation of GUI testing using a model-driven approach, In Proceedings of ACM International Workshop on Automation of Software Test (AST), p 9--14 Google ScholarDigital Library
- Alessandro Orso, Bryan Kennedy, 2005. Selective capture and replay of program executions, In Proceedings of ACM 3rd International workshop on Dynamic Analysis (WODA), p 1--7 Google ScholarDigital Library
- Oren Laadan, Ricardo Baratto, Dan Phung, Shaya Potter, Jason Nieh, 2007. DejaView: A Personal Virtual Computer Recorder, In Proceedings of 21st ACM SIGOPS Symposium on Operating System Principles (SOSP), p 279--292 Google ScholarDigital Library
- Melody Ivory, Marti Hearst, 2001. The State of the Art in Automating Usability Evaluation of User Interfaces, In the Proceedings of ACM Computing Surveys (CSUR), p 470--516 Google ScholarDigital Library
Index Terms
- Test harness and script design principles for automated testing of non-GUI or web based applications
Recommendations
Adapting automated test generation to GUI testing of industry applications
ContextAutomated test generation promises to improve the effectiveness of software testing and to reduce the involved manual effort. While automated test generation has been successfully applied for code-level API testing, it has not found widespread ...
Prioritizing User-Session-Based Test Cases for Web Applications Testing
ICST '08: Proceedings of the 2008 International Conference on Software Testing, Verification, and ValidationWeb applications have rapidly become a critical part of business for many organizations. However, increased usage of web applications has not been reciprocated with corresponding increases in reliability. Unique characteristics, such as quick turnaround ...
Improving the effectiveness of test suite reduction for user-session-based testing of web applications
Context: Test suite reduction is the problem of creating and executing a set of test cases that are smaller in size but equivalent in effectiveness to an original test suite. However, reduced suites can still be large and executing all the tests in a ...
Comments