Jan Waller
Wilhelm Hasselbring
Skip Abstract Section
Abstract
The DevOps movement intends to improve communication, collaboration, and integration between software developers (Dev) and IT operations professionals (Ops). Automation of software quality assurance is key to DevOps success. We present how automated performance benchmarks may be included into continuous integration. As an example, we report on regression benchmarks for application monitoring frameworks and illustrate the inclusion of automated benchmarks into continuous integration setups.
- J. Ehlers, A. van Hoorn, J. Waller, and W. Hasselbring. Selfadaptive software system monitoring for performance anomaly localization. In Proceedings of the 8th IEEE/ACM International Conference on Autonomic Computing (ICAC 2011), pages 197--200. ACM, June 2011. Google Scholar
Digital Library
- T. Kalibera, J. Lehotsky, D. Majda, B. Repcek, M. Tomcanyi, A. Tomecek, P. T?uma, and J. Urban. Automated benchmarking and analysis tool. In Proceedings of the 1st International Conference on Performance Evaluation Methodologies and Tools (Valuetools 2006), pages 5--14. ACM, Oct. 2006. Google ScholarDigital Library
- M. Meyer. Continuous integration and its tools. IEEE Software, 31(3):14--16, May 2014.Google ScholarCross Ref
- S. E. Sim, S. Easterbrook, and R. C. Holt. Using benchmarking to advance research: A challenge to software engineering. In Proceedings of the 25th International Conference on Software Engineering (ICSE 2003), pages 74--83. IEEE Computer Society, May 2003. Google ScholarDigital Library
- A. van Hoorn, J. Waller, and W. Hasselbring. Kieker: A framework for application performance monitoring and dynamic software analysis. In Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering (ICPE 2012), pages 247--248. ACM, Apr. 2012. Google ScholarDigital Library
- J. Waller and W. Hasselbring. A benchmark engineering methodology to measure the overhead of application-level monitoring. In Proceedings of the Symposium on Software Performance: Joint Kieker/Palladio Days (KPDays 2013), pages 59--68. CEUR Workshop Proceedings, Nov. 2013.Google Scholar
- C. Weiss, D. Westermann, C. Heger, and M. Moser. Systematic performance evaluation based on tailored benchmark applications. In Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering (ICPE 2013), pages 411--420. ACM, Apr. 2013. Google ScholarDigital Library
Index Terms
- Including Performance Benchmarks into Continuous Integration to Enable DevOps
Comments