Checking Response-Time Properties of Web-Service Applications Under Stochastic User Profiles

Richard Alexander Schumi, Priska Lang, Bernhard K. Aichernig, Willibald Krenn, Rupert Schlick

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

Performance evaluation of critical software is important but also
computationally expensive. It usually involves sophisticated load-testing tools
and demands a large amount of computing resources. Analysing different user
populations requires even more effort, becoming infeasible in most realistic
cases. Therefore, we propose a model-based approach. We apply model-based
test-case generation to generate log-data and learn the associated
distributions of response times. These distributions are added to the
behavioural models on which we perform statistical model checking (SMC) in
order to assess the probabilities of the required response times. Then, we
apply classical hypothesis testing to evaluate if an implementation of the
behavioural model conforms to these timing requirements. This is the first
model-based approach for performance evaluation combining automated test-case
generation, cost learning and SMC for real applications. We realised this
method with a property-based testing tool, extended with SMC functionality,
and evaluate it on an industrial web-service application.
Original languageEnglish
Title of host publication29th IFIP International Conference on Testing, Software and Systems (ICTSS 2017)
PublisherSpringer Verlag
DOIs
Publication statusPublished - 2017
Event29th IFIP WG 6.1 International Conference on Testing Software and Systems, ICTSS 2017 - St. Petersburg, Russian Federation
Duration: 9 Oct 201711 Oct 2017

Conference

Conference29th IFIP WG 6.1 International Conference on Testing Software and Systems, ICTSS 2017
CountryRussian Federation
CitySt. Petersburg
Period9/10/1711/10/17

Fingerprint

Web services
Model checking
Load testing
Testing
Statistical Models
Costs

Fields of Expertise

  • Information, Communication & Computing

Cite this

Schumi, R. A., Lang, P., Aichernig, B. K., Krenn, W., & Schlick, R. (2017). Checking Response-Time Properties of Web-Service Applications Under Stochastic User Profiles. In 29th IFIP International Conference on Testing, Software and Systems (ICTSS 2017) Springer Verlag. https://doi.org/10.1007/978-3-319-67549-7_18

Checking Response-Time Properties of Web-Service Applications Under Stochastic User Profiles. / Schumi, Richard Alexander; Lang, Priska; Aichernig, Bernhard K.; Krenn, Willibald; Schlick, Rupert.

29th IFIP International Conference on Testing, Software and Systems (ICTSS 2017). Springer Verlag, 2017.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Schumi, RA, Lang, P, Aichernig, BK, Krenn, W & Schlick, R 2017, Checking Response-Time Properties of Web-Service Applications Under Stochastic User Profiles. in 29th IFIP International Conference on Testing, Software and Systems (ICTSS 2017). Springer Verlag, 29th IFIP WG 6.1 International Conference on Testing Software and Systems, ICTSS 2017, St. Petersburg, Russian Federation, 9/10/17. https://doi.org/10.1007/978-3-319-67549-7_18
Schumi RA, Lang P, Aichernig BK, Krenn W, Schlick R. Checking Response-Time Properties of Web-Service Applications Under Stochastic User Profiles. In 29th IFIP International Conference on Testing, Software and Systems (ICTSS 2017). Springer Verlag. 2017 https://doi.org/10.1007/978-3-319-67549-7_18
Schumi, Richard Alexander ; Lang, Priska ; Aichernig, Bernhard K. ; Krenn, Willibald ; Schlick, Rupert. / Checking Response-Time Properties of Web-Service Applications Under Stochastic User Profiles. 29th IFIP International Conference on Testing, Software and Systems (ICTSS 2017). Springer Verlag, 2017.
@inproceedings{5c8488202fc6483f88337a69886d1fed,
title = "Checking Response-Time Properties of Web-Service Applications Under Stochastic User Profiles",
abstract = "Performance evaluation of critical software is important but also computationally expensive. It usually involves sophisticated load-testing tools and demands a large amount of computing resources. Analysing different user populations requires even more effort, becoming infeasible in most realistic cases. Therefore, we propose a model-based approach. We apply model-based test-case generation to generate log-data and learn the associated distributions of response times. These distributions are added to the behavioural models on which we perform statistical model checking (SMC) in order to assess the probabilities of the required response times. Then, we apply classical hypothesis testing to evaluate if an implementation of the behavioural model conforms to these timing requirements. This is the first model-based approach for performance evaluation combining automated test-case generation, cost learning and SMC for real applications. We realised this method with a property-based testing tool, extended with SMC functionality, and evaluate it on an industrial web-service application.",
author = "Schumi, {Richard Alexander} and Priska Lang and Aichernig, {Bernhard K.} and Willibald Krenn and Rupert Schlick",
year = "2017",
doi = "10.1007/978-3-319-67549-7_18",
language = "English",
booktitle = "29th IFIP International Conference on Testing, Software and Systems (ICTSS 2017)",
publisher = "Springer Verlag",
address = "Germany",

}

TY - GEN

T1 - Checking Response-Time Properties of Web-Service Applications Under Stochastic User Profiles

AU - Schumi, Richard Alexander

AU - Lang, Priska

AU - Aichernig, Bernhard K.

AU - Krenn, Willibald

AU - Schlick, Rupert

PY - 2017

Y1 - 2017

N2 - Performance evaluation of critical software is important but also computationally expensive. It usually involves sophisticated load-testing tools and demands a large amount of computing resources. Analysing different user populations requires even more effort, becoming infeasible in most realistic cases. Therefore, we propose a model-based approach. We apply model-based test-case generation to generate log-data and learn the associated distributions of response times. These distributions are added to the behavioural models on which we perform statistical model checking (SMC) in order to assess the probabilities of the required response times. Then, we apply classical hypothesis testing to evaluate if an implementation of the behavioural model conforms to these timing requirements. This is the first model-based approach for performance evaluation combining automated test-case generation, cost learning and SMC for real applications. We realised this method with a property-based testing tool, extended with SMC functionality, and evaluate it on an industrial web-service application.

AB - Performance evaluation of critical software is important but also computationally expensive. It usually involves sophisticated load-testing tools and demands a large amount of computing resources. Analysing different user populations requires even more effort, becoming infeasible in most realistic cases. Therefore, we propose a model-based approach. We apply model-based test-case generation to generate log-data and learn the associated distributions of response times. These distributions are added to the behavioural models on which we perform statistical model checking (SMC) in order to assess the probabilities of the required response times. Then, we apply classical hypothesis testing to evaluate if an implementation of the behavioural model conforms to these timing requirements. This is the first model-based approach for performance evaluation combining automated test-case generation, cost learning and SMC for real applications. We realised this method with a property-based testing tool, extended with SMC functionality, and evaluate it on an industrial web-service application.

U2 - 10.1007/978-3-319-67549-7_18

DO - 10.1007/978-3-319-67549-7_18

M3 - Conference contribution

BT - 29th IFIP International Conference on Testing, Software and Systems (ICTSS 2017)

PB - Springer Verlag

ER -