Adapting unit tests by generating combinatorial test data

Hermann Felbinger, Franz Wotawa, Mihai Nica

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

Conventional unit tests are still mainly handcrafted. Generalizing conventional unit tests to parameterized unit tests supports automatic test data generation. Methods that were introduced to instantiate parameterized unit tests with concrete values as test data are based on search based approaches, dynamic symbolic execution, or property based testing. In this work, we introduce an approach that retrofits existing conventional unit tests into parameterized unit tests by generalization, and generate test data by combinatorial valuation to adapt existing conventional unit test suites. We conduct an empirical study to investigate whether our test suite adaption approach is beneficial in terms of additional fault detection capabilities and code coverage. Our results show that mutation score and condition coverage increase with feasible effort compared to existing conventional unit tests.

Original languageEnglish
Title of host publicationProceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018
PublisherInstitute of Electrical and Electronics Engineers
Pages352-355
Number of pages4
ISBN (Electronic)9781538663523
DOIs
Publication statusPublished - 16 Jul 2018
Event11th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018 - Vasteras, Sweden
Duration: 9 Apr 201813 Apr 2018

Conference

Conference11th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018
CountrySweden
CityVasteras
Period9/04/1813/04/18

Fingerprint

Fault detection
Concretes
Testing

Keywords

  • Code coverage
  • Combinatorial testing
  • Mutation score
  • Parameterized unit test

ASJC Scopus subject areas

  • Software
  • Safety, Risk, Reliability and Quality

Cite this

Felbinger, H., Wotawa, F., & Nica, M. (2018). Adapting unit tests by generating combinatorial test data. In Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018 (pp. 352-355). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICSTW.2018.00072

Adapting unit tests by generating combinatorial test data. / Felbinger, Hermann; Wotawa, Franz; Nica, Mihai.

Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018. Institute of Electrical and Electronics Engineers, 2018. p. 352-355.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Felbinger, H, Wotawa, F & Nica, M 2018, Adapting unit tests by generating combinatorial test data. in Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018. Institute of Electrical and Electronics Engineers, pp. 352-355, 11th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018, Vasteras, Sweden, 9/04/18. https://doi.org/10.1109/ICSTW.2018.00072
Felbinger H, Wotawa F, Nica M. Adapting unit tests by generating combinatorial test data. In Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018. Institute of Electrical and Electronics Engineers. 2018. p. 352-355 https://doi.org/10.1109/ICSTW.2018.00072
Felbinger, Hermann ; Wotawa, Franz ; Nica, Mihai. / Adapting unit tests by generating combinatorial test data. Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018. Institute of Electrical and Electronics Engineers, 2018. pp. 352-355
@inproceedings{05c2564248be464b84390798473f7047,
title = "Adapting unit tests by generating combinatorial test data",
abstract = "Conventional unit tests are still mainly handcrafted. Generalizing conventional unit tests to parameterized unit tests supports automatic test data generation. Methods that were introduced to instantiate parameterized unit tests with concrete values as test data are based on search based approaches, dynamic symbolic execution, or property based testing. In this work, we introduce an approach that retrofits existing conventional unit tests into parameterized unit tests by generalization, and generate test data by combinatorial valuation to adapt existing conventional unit test suites. We conduct an empirical study to investigate whether our test suite adaption approach is beneficial in terms of additional fault detection capabilities and code coverage. Our results show that mutation score and condition coverage increase with feasible effort compared to existing conventional unit tests.",
keywords = "Code coverage, Combinatorial testing, Mutation score, Parameterized unit test",
author = "Hermann Felbinger and Franz Wotawa and Mihai Nica",
year = "2018",
month = "7",
day = "16",
doi = "10.1109/ICSTW.2018.00072",
language = "English",
pages = "352--355",
booktitle = "Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018",
publisher = "Institute of Electrical and Electronics Engineers",
address = "United States",

}

TY - GEN

T1 - Adapting unit tests by generating combinatorial test data

AU - Felbinger, Hermann

AU - Wotawa, Franz

AU - Nica, Mihai

PY - 2018/7/16

Y1 - 2018/7/16

N2 - Conventional unit tests are still mainly handcrafted. Generalizing conventional unit tests to parameterized unit tests supports automatic test data generation. Methods that were introduced to instantiate parameterized unit tests with concrete values as test data are based on search based approaches, dynamic symbolic execution, or property based testing. In this work, we introduce an approach that retrofits existing conventional unit tests into parameterized unit tests by generalization, and generate test data by combinatorial valuation to adapt existing conventional unit test suites. We conduct an empirical study to investigate whether our test suite adaption approach is beneficial in terms of additional fault detection capabilities and code coverage. Our results show that mutation score and condition coverage increase with feasible effort compared to existing conventional unit tests.

AB - Conventional unit tests are still mainly handcrafted. Generalizing conventional unit tests to parameterized unit tests supports automatic test data generation. Methods that were introduced to instantiate parameterized unit tests with concrete values as test data are based on search based approaches, dynamic symbolic execution, or property based testing. In this work, we introduce an approach that retrofits existing conventional unit tests into parameterized unit tests by generalization, and generate test data by combinatorial valuation to adapt existing conventional unit test suites. We conduct an empirical study to investigate whether our test suite adaption approach is beneficial in terms of additional fault detection capabilities and code coverage. Our results show that mutation score and condition coverage increase with feasible effort compared to existing conventional unit tests.

KW - Code coverage

KW - Combinatorial testing

KW - Mutation score

KW - Parameterized unit test

UR - http://www.scopus.com/inward/record.url?scp=85050957828&partnerID=8YFLogxK

U2 - 10.1109/ICSTW.2018.00072

DO - 10.1109/ICSTW.2018.00072

M3 - Conference contribution

SP - 352

EP - 355

BT - Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018

PB - Institute of Electrical and Electronics Engineers

ER -