Property-Based Testing with External Test-Case Generators

Bernhard K. Aichernig, Silvio Marcovic, Richard Alexander Schumi

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

Previous work has demonstrated that property-based testing (PBT) is a flexible
random testing technique that facilitates the generation of complex form data.
For example, it has been shown that PBT can be applied to web-service
applications that require various inputs for web-forms. We want to exploit this
data generation feature of PBT and combine it with an external test-case
generator that can generate test cases via model-based mutation testing.
PBT already supports the generation of test cases from stateful models, but it
is limited, because it normally only considers the current state during
exploration of the model. We want to give the tester more control on how to
produce meaningful operation sequences for test cases. By integrating an
external test-case generator into a PBT tool, we can create test cases that
follow certain coverage criteria. This allows us to reduce the test execution
time, because we do not need a large number of random tests to cover certain
model aspects. We demonstrate our approach with a simple example of an external
generator for regular expressions and perform an industrial case study, where
we integrate an existing model-based mutation testing generator.
Original languageEnglish
Title of host publication10th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops 2017, Tokyo, Japan, March 13-17, 2017
PublisherIEEE Computer Society
Pages337-346
DOIs
Publication statusPublished - 2017
Event10th IEEE International Conference on Software Testing, Verification and Validation (ICST 2017) - Tokyo, Japan
Duration: 13 Mar 201717 Mar 2017
http://aster.or.jp/conference/icst2017/

Conference

Conference10th IEEE International Conference on Software Testing, Verification and Validation (ICST 2017)
Abbreviated titleICST 2017
CountryJapan
CityTokyo
Period13/03/1717/03/17
Internet address

Fingerprint

Testing
World Wide Web
Web services

Fields of Expertise

  • Information, Communication & Computing

Cite this

Aichernig, B. K., Marcovic, S., & Schumi, R. A. (2017). Property-Based Testing with External Test-Case Generators. In 10th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops 2017, Tokyo, Japan, March 13-17, 2017 (pp. 337-346). IEEE Computer Society. https://doi.org/10.1109/ICSTW.2017.62

Property-Based Testing with External Test-Case Generators. / Aichernig, Bernhard K.; Marcovic, Silvio; Schumi, Richard Alexander.

10th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops 2017, Tokyo, Japan, March 13-17, 2017. IEEE Computer Society, 2017. p. 337-346.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Aichernig, BK, Marcovic, S & Schumi, RA 2017, Property-Based Testing with External Test-Case Generators. in 10th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops 2017, Tokyo, Japan, March 13-17, 2017. IEEE Computer Society, pp. 337-346, 10th IEEE International Conference on Software Testing, Verification and Validation (ICST 2017), Tokyo, Japan, 13/03/17. https://doi.org/10.1109/ICSTW.2017.62
Aichernig BK, Marcovic S, Schumi RA. Property-Based Testing with External Test-Case Generators. In 10th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops 2017, Tokyo, Japan, March 13-17, 2017. IEEE Computer Society. 2017. p. 337-346 https://doi.org/10.1109/ICSTW.2017.62
Aichernig, Bernhard K. ; Marcovic, Silvio ; Schumi, Richard Alexander. / Property-Based Testing with External Test-Case Generators. 10th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops 2017, Tokyo, Japan, March 13-17, 2017. IEEE Computer Society, 2017. pp. 337-346
@inproceedings{151ee5926537401aa9596f05b4b9cd49,
title = "Property-Based Testing with External Test-Case Generators",
abstract = "Previous work has demonstrated that property-based testing (PBT) is a flexible random testing technique that facilitates the generation of complex form data. For example, it has been shown that PBT can be applied to web-service applications that require various inputs for web-forms. We want to exploit this data generation feature of PBT and combine it with an external test-case generator that can generate test cases via model-based mutation testing. PBT already supports the generation of test cases from stateful models, but it is limited, because it normally only considers the current state during exploration of the model. We want to give the tester more control on how to produce meaningful operation sequences for test cases. By integrating an external test-case generator into a PBT tool, we can create test cases that follow certain coverage criteria. This allows us to reduce the test execution time, because we do not need a large number of random tests to cover certain model aspects. We demonstrate our approach with a simple example of an external generator for regular expressions and perform an industrial case study, where we integrate an existing model-based mutation testing generator.",
author = "Aichernig, {Bernhard K.} and Silvio Marcovic and Schumi, {Richard Alexander}",
year = "2017",
doi = "10.1109/ICSTW.2017.62",
language = "English",
pages = "337--346",
booktitle = "10th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops 2017, Tokyo, Japan, March 13-17, 2017",
publisher = "IEEE Computer Society",
address = "United States",

}

TY - GEN

T1 - Property-Based Testing with External Test-Case Generators

AU - Aichernig, Bernhard K.

AU - Marcovic, Silvio

AU - Schumi, Richard Alexander

PY - 2017

Y1 - 2017

N2 - Previous work has demonstrated that property-based testing (PBT) is a flexible random testing technique that facilitates the generation of complex form data. For example, it has been shown that PBT can be applied to web-service applications that require various inputs for web-forms. We want to exploit this data generation feature of PBT and combine it with an external test-case generator that can generate test cases via model-based mutation testing. PBT already supports the generation of test cases from stateful models, but it is limited, because it normally only considers the current state during exploration of the model. We want to give the tester more control on how to produce meaningful operation sequences for test cases. By integrating an external test-case generator into a PBT tool, we can create test cases that follow certain coverage criteria. This allows us to reduce the test execution time, because we do not need a large number of random tests to cover certain model aspects. We demonstrate our approach with a simple example of an external generator for regular expressions and perform an industrial case study, where we integrate an existing model-based mutation testing generator.

AB - Previous work has demonstrated that property-based testing (PBT) is a flexible random testing technique that facilitates the generation of complex form data. For example, it has been shown that PBT can be applied to web-service applications that require various inputs for web-forms. We want to exploit this data generation feature of PBT and combine it with an external test-case generator that can generate test cases via model-based mutation testing. PBT already supports the generation of test cases from stateful models, but it is limited, because it normally only considers the current state during exploration of the model. We want to give the tester more control on how to produce meaningful operation sequences for test cases. By integrating an external test-case generator into a PBT tool, we can create test cases that follow certain coverage criteria. This allows us to reduce the test execution time, because we do not need a large number of random tests to cover certain model aspects. We demonstrate our approach with a simple example of an external generator for regular expressions and perform an industrial case study, where we integrate an existing model-based mutation testing generator.

U2 - 10.1109/ICSTW.2017.62

DO - 10.1109/ICSTW.2017.62

M3 - Conference contribution

SP - 337

EP - 346

BT - 10th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops 2017, Tokyo, Japan, March 13-17, 2017

PB - IEEE Computer Society

ER -