Sergio Segura
Antonio Ruiz-Cortés
ABSTRACT
The automated analysis of feature models is a flourishing research topic that has called the attention of both researchers and practitioners during the last two decades. During this time, the number of tools and techniques enabling the analysis of feature models has increased and also their complexity. In this scenario, the lack of specific testing mechanisms to assess the correctness and good performance of analysis tools is becoming a major obstacle hindering the development of tools and affecting their quality and reliability. In this paper, we present BeTTy, a framework for BEnchmarking and TesTing on the analYsis of feature models. Among other features, BeTTy enables the automated detection of faults in feature model analysis tools. Also, it supports the generation of motivating test data to evaluate the performance of analysis tools in both average and pessimistic cases. Part of the functionality of the framework is provided through a web-based interface facilitating the random generation of both classic and attributed feature models.
- D. Benavides, S. Segura, and A. Ruiz-Cortés. Automated analysis of feature models 20 years later: A literature review. Information Systems, 35(6):615--636, 2010. Google Scholar
Digital Library
- D. Benavides, S. Segura, P. Trinidad, and A. Ruiz-Cortés. A first step towards a framework for the automated analysis of feature models. In Managing Variability for Software Product Lines: Working With Variability Mechanisms, 2006.Google Scholar
- FaMa Tool Suite. http://www.isa.us.es/fama/, accessed November 2011.Google Scholar
- J. A. Galindo, D. Benavides, and S. Segura. Debian packages repositories as software product line models. towards automated analysis. In Proceeding of the First International Workshop on Automated Configuration and Tailoring of Applications (ACOTA), 2010.Google Scholar
- Graphviz.. http://www.graphviz.org/, accessed November 2011.Google Scholar
- G. Kapfhammer. The Computer Science Handbook, chapter Software Testing. CRC Press, 2nd edition, June, 2004.Google Scholar
- Apache Math. Apache math. http://commons.apache.org/math/, accessed November 2011.Google Scholar
- M. Mendonca, D. D. Cowan, W. Malyk, and T. Oliveira. Collaborative product configuration: Formalization and efficient algorithms for dependency analysis. Journal of Software, 3(2):69--82, 2008.Google ScholarCross Ref
- S. Segura. Functional and Performance Testing of Feature Model Analysis Tools. Extending the FaMa Ecosystem. PhD thesis, Dept. of Computer Languages and Systems, University of Seville, 2011.Google Scholar
- S. Segura, D. Benavides, and A. Ruiz-Cortés. Functional testing of feature model analysis tools: a test suite. Software, IET, 5(1):70--82, february 2011.Google ScholarCross Ref
- S. Segura, Robert M. Hierons, D. Benavides, and A. Ruiz-Cortés. Automated metamorphic testing on the analyses of feature models. Information and Software Technology, 53(3):245--258, 2011. Google ScholarDigital Library
- S. Segura, Robert M. Hierons, D. Benavides, and A. Ruiz-Cortés. Mutation testing on an object-oriented framework: An experience report. Information and Software Technology Special Issue on Mutation Testing, 2011.Google ScholarCross Ref
- S. Segura, JA. Parejo, Robert M. Hierons, D. Benavides, and A. Ruiz-Cortés. ETHOM: An evolutionary algorithm for optimized feature models generation. Tech Report ISA-2011-TR-03 (v. 1.0), Applied Software Engineering Research Group, 2011.Google Scholar
- S. Segura and A. Ruiz-Cortés. Benchmarking on the automated analyses of feature models: A preliminary roadmap. In Third International Workshop on Variability Modelling of Software-intensive Systems, pages 137--143, Seville, Spain, 2009.Google Scholar
- S. She, R. Lotufo, T. Berger, A. Wasowski, and K. Czarnecki. The variability model of the linux kernel. In Fourth International Workshop on Variability Modelling of Software-intensive Systems (VAMOS'10), Linz, Austria, January 2010.Google Scholar
- S. She, R. Lotufo, T. Berger, A. Wasowski, and K. Czarnecki. Reverse engineering feature models. In Proceedings of the 27th International Conference on Software Engineering, pages 461--470, 2011. Google ScholarDigital Library
- S. P. L. O. T.: Software Product Lines Online Tools. http://www.splot-research.org/, accessed November 2011.Google Scholar
- T. Thüm, D. Batory, and C. Kästner. Reasoning about edits to feature models. In International Conference on Software Engineering, pages 254--264, 2009. Google ScholarDigital Library
- P. Trinidad, A. Ruiz-Cortés, D. Benavides, and S. Segura. Three-dimensional feature diagrams visualization. In 2nd International Workshop on Visualisation in Software Product Line Engineering (ViSPLE 2008), 2008.Google Scholar
- E. J. Weyuker. On testing non-testable programs. The Computer Journal, 25(4):465--470, 1982.Google ScholarCross Ref
- J. White, B. Dougherty, and D. Schmidt. Selecting highly optimal architectural feature sets with filtered cartesian flattening. Journal of Systems and Software, 82(8):1268--1284, 2009. Google ScholarDigital Library
Recommendations
A Python framework for the automated analysis of feature models: A first step to integrate community efforts
SPLC '20: Proceedings of the 24th ACM International Systems and Software Product Line Conference - Volume BFeature modeling is the "de facto" standard to describe the common and variant parts of software product lines. Different tools, approaches, and operations for the automated analysis of feature models (AAFM) have been proposed in the last 20 years. The ...
Automated metamorphic testing on the analyses of feature models
Context: A feature model (FM) represents the valid combinations of features in a domain. The automated extraction of information from FMs is a complex task that involves numerous analysis operations, techniques and tools. Current testing methods in this ...
Testing variability-intensive systems using automated analysis: an application to Android
Software product lines are used to develop a set of software products that, while being different, share a common set of features. Feature models are used as a compact representation of all the products (e.g., possible configurations) of the product ...
Comments