Chunhui Wang
ABSTRACT
In safety critical domains, system test cases are often derived from functional requirements in natural language (NL) and traceability between requirements and their corresponding test cases is usually mandatory. The definition of test cases is therefore time-consuming and error prone, especially so given the quickly rising complexity of embedded systems in many critical domains. Though considerable research has been devoted to automatic generation of system test cases from NL requirements, most of the proposed approaches re- quire significant manual intervention or additional, complex behavioral modelling. This significantly hinders their applicability in practice. In this paper, we propose Use Case Modelling for System Tests Generation (UMTG), an approach that automatically generates executable system test cases from use case spec- ifications and a domain model, the latter including a class diagram and constraints. Our rationale and motivation are that, in many environments, including that of our industry partner in the reported case study, both use case specifica- tions and domain modelling are common and accepted prac- tice, whereas behavioural modelling is considered a difficult and expensive exercise if it is to be complete and precise. In order to extract behavioral information from use cases and enable test automation, UMTG employs Natural Language Processing (NLP), a restricted form of use case specifica- tions, and constraint solving.
- IEE sensing solutions. http://www.iee.lu.Google Scholar
- The Object Constraint Language (OCL). http://www.omg.org/spec/OCL/.Google Scholar
- S. Ali, M. Zohaib Iqbal, A. Arcuri, and L. Briand. Generating test data from OCL constraints with search techniques. IEEE Transactions on Software Engineering, 39(10):1376–1402, Oct 2013. Google ScholarDigital Library
- A. Bandyopadhyay and S. Ghosh. Test input generation using UML sequence and state machines models. In Proceedings of the 2nd International Conference on Software Testing Verification and Validation (ICST’09), pages 121–130, 2009. Google ScholarDigital Library
- A. Bertolino and S. Gnesi. Use case-based testing of product lines. ACM SIGSOFT Software Engineering Notes, 28(5):355–358, 2003. Google ScholarDigital Library
- L. C. Briand and Y. Labiche. A UML-based approach to system testing. Software and Systems Modelling, 1(1):10–42, 2002.Google ScholarCross Ref
- G. Carvalho, D. Falc˜ ao, F. Barros, A. Sampaio, A. Mota, L. Motta, and M. Blackburn. Test case generation from natural language requirements based on SCR specifications. In Proceedings of the 28th Annual ACM Symposium on Applied Computing (SAC’13), pages 1217–1222, 2013. Google ScholarDigital Library
- H. Cunningham, D. Maynard, K. Bontcheva, and V. Tablan. GATE: A Framework and Graphical Development Environment for Robust NLP Tools and Applications. In Proceedings of the 40th Anniversary Meeting of the Association for Computational Linguistics (ACL’02), 2002.Google Scholar
- M. J. Escalona, J. J. Gutierrez, M. Mej´ıas, G. Aragón, I. Ramos, J. Torres, and F. J. Dom´ınguez. An overview on test generation from functional requirements. Journal of System and Software, 84(8):1379–1393, Aug. 2011. Google ScholarDigital Library
- P. Frohlich and J. Link. Automated test case generation from dynamic models. In 14th European Conference on Object Oriented Programming (ECOOP’00), pages 472–491, 2000. Google ScholarDigital Library
- J. Gutiérrez, M. J. Escalona, M. Mej´ıas, and J. Torres. A case study for generating test cases from use cases. In Proceedings of the 2nd International Conference on Research Challenges in Information Science (RCIS’08), pages 83–96, 2008.Google ScholarCross Ref
- M. J. Harrold, G. Rothermel, and S. Sinha. Computation of interprocedural control dependence. In Proceedings of the 1998 ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA’98), pages 11–20, New York, NY, USA, 1998. ACM. Google ScholarDigital Library
- B. Hasling, H. Goetz, and K. Beetz. Model based testing of system requirements using UML use case models. In Proceedings of the 1st international conference on Software Testing, Verification, and Validation (ICST’08), pages 367–376. IEEE, 2008. Google ScholarDigital Library
- ISO. ISO-26262: Road vehicles – functional safety.Google Scholar
- M. Kaplan, T. Klinger, A. M. Paradkar, A. Sinha, C. Williams, and C. Yilmaz. Less is more: A minimalistic approach to UML model-based conformance test generation. In 1st International Conference on Software Testing, Verification, and Validation (ICST’08), pages 82–91, 2008. Google ScholarDigital Library
- M. Katara and A. Kervinen. Making model-based testing more agile: a use case driven approach. In Hardware and Software, Verification and Testing, pages 219–234. Springer, 2007. Google ScholarDigital Library
- C. Larman. Applying UML and Patterns:An Introduction to Object-Oriented Analysis and Design and the Unified Process. Prentice Hall Professional, 2002. Google ScholarDigital Library
- W. Linzhang, Y. Jiesong, Y. Xiaofeng, H. Jun, L. Xuandong, and Z. Guoliang. Generating test cases from UML activity diagram based on gray-box method. In Proceedings of the 11th Asia-Pacific Software Engineering Conference (APSEC’04), 2004. Google ScholarDigital Library
- A. Nayak and D. Samanta. Synthesis of test scenarios using UML activity diagrams. Software and Systems Modelling, 10:63–89, 2011. Google ScholarDigital Library
- C. Nebut, F. Fleurey, Y. Le-Traon, and J.-M. Jezequel. Automatic test generation: a use case driven approach. IEEE Transactions on Software Engineering, 32(3):140–155, March 2006. Google ScholarDigital Library
- M. Riebisch, I. Philippow, and M. Götze. UML-based statistical test case generation. In Objects, Components, Architectures, Services, and Applications for a Networked World, pages 394–411. Springer, 2003. Google ScholarDigital Library
- V. Rus, M. Lintean, R. Banjade, N. Niraula, and D. Stefanescu. SEMILAR: The semantic similarity toolkit. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL), 2013.Google Scholar
- J. Ryser and M. Glinz. A scenario-based approach to validating and testing software systems using statecharts. In Proceedings of the 12th International Conference on Software and Systems Engineering and their Applications (ICSSEA’99), 1999.Google Scholar
- E. Sarmiento, J. C. S. d. P. Leite, and E. Almentero. C&L: Generating model based test cases from natural language requirements descriptions. In 1st International Workshop on Requirements Engineering and Testing (RET’14), pages 32–38, 2014.Google ScholarCross Ref
- M. Shirole and R. Kumar. UML behavioral model based test case generation: a survey. ACM SIGSOFT Software Engineering Notes, 38(4):1–13, 2013. Google ScholarDigital Library
- A. Sinha, S. M. S. Jr., and A. Paradkar. Text2test: Automated inspection of natural language use cases. In Proceedings of the 3rd International Conference on Software Testing, Verification and Validation (ICST’10), pages 155–164. IEEE Computer Society, 2010. Google ScholarDigital Library
- M. Soeken, R. Wille, and R. Drechsler. Assisted behavior driven development using natural language processing. In Proceedings of the 5th International Conference on Objects, Models, Components, Patterns (TOOLS’12), pages 269–287. Springer-Verlag, 2012. Google ScholarDigital Library
- T. Yue, S. Ali, and L. Briand. Automated transition from use cases to UML state machines to support state-based testing. In Proceedings of the 7th European conference on Modelling foundations and applications (ECMFA’11), pages 115–131, 2011. Google ScholarDigital Library
- T. Yue, L. Briand, and Y. Labiche. An automated approach to transform use cases into activity diagrams. In Proceedings of the 6th European conference on Modelling foundations and applications (ECMFA’10), pages 337–353, 2010. Google ScholarDigital Library
- T. Yue, L. C. Briand, and Y. Labiche. Facilitating the transition from use case models to analysis models: Approach and experiments. ACM Transactions on Software Engineering and Methodology, 22(1), 2013. Google ScholarDigital Library
- M. Zhang, T. Yue, S. Ali, H. Zhang, and J. Wu. A systematic approach to automatically derive test cases from use cases specified in restricted natural languages. In Proceedings of the 8th International Conference on System Analysis and Modeling: Models and Reusability (SAM’14), pages 142–157, 2014.Google ScholarCross Ref
Index Terms
- Automatic generation of system test cases from use case specifications
Recommendations
UMTG: a toolset to automatically generate system test cases from use case specifications
ESEC/FSE 2015: Proceedings of the 2015 10th Joint Meeting on Foundations of Software EngineeringWe present UMTG, a toolset for automatically generating executable and traceable system test cases from use case specifications. UMTG employs Natural Language Processing (NLP), a restricted form of use case specifications, and constraint solving. Use ...
A Decompositional Approach to Automatic Test Case Generation Based on Formal Specifications
SSIRI '10: Proceedings of the 2010 Fourth International Conference on Secure Software Integration and Reliability ImprovementAutomatic functional testing is a potentially effective technique for software reliability, but it has been a challenge due to the difficulties in automatically deriving adequate test cases and test oracle from informal or semi-formal specifications that ...
Test cases generation for multiple paths based on PSO algorithm with metamorphic relations
The generation of multiple‐path test cases can greatly enhance the efficiency of path‐wise testing. Various methods adopting meta‐heuristic algorithm to generate multiple‐path test cases have been proposed, but existing methods focus on improving the meta‐...
Comments