Adapting unit tests by generating combinatorial test data

Hermann Felbinger, Franz Wotawa, Mihai Nica

Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

Abstract

Conventional unit tests are still mainly handcrafted. Generalizing conventional unit tests to parameterized unit tests supports automatic test data generation. Methods that were introduced to instantiate parameterized unit tests with concrete values as test data are based on search based approaches, dynamic symbolic execution, or property based testing. In this work, we introduce an approach that retrofits existing conventional unit tests into parameterized unit tests by generalization, and generate test data by combinatorial valuation to adapt existing conventional unit test suites. We conduct an empirical study to investigate whether our test suite adaption approach is beneficial in terms of additional fault detection capabilities and code coverage. Our results show that mutation score and condition coverage increase with feasible effort compared to existing conventional unit tests.

Originalspracheenglisch
TitelProceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers
Seiten352-355
Seitenumfang4
ISBN (elektronisch)9781538663523
DOIs
PublikationsstatusVeröffentlicht - 16 Jul 2018
Veranstaltung11th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018 - Vasteras, Schweden
Dauer: 9 Apr 201813 Apr 2018

Konferenz

Konferenz11th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018
LandSchweden
OrtVasteras
Zeitraum9/04/1813/04/18

Fingerprint

Fault detection
Concretes
Testing

Schlagwörter

    ASJC Scopus subject areas

    • Software
    • !!Safety, Risk, Reliability and Quality

    Dies zitieren

    Felbinger, H., Wotawa, F., & Nica, M. (2018). Adapting unit tests by generating combinatorial test data. in Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018 (S. 352-355). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICSTW.2018.00072

    Adapting unit tests by generating combinatorial test data. / Felbinger, Hermann; Wotawa, Franz; Nica, Mihai.

    Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018. Institute of Electrical and Electronics Engineers, 2018. S. 352-355.

    Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

    Felbinger, H, Wotawa, F & Nica, M 2018, Adapting unit tests by generating combinatorial test data. in Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018. Institute of Electrical and Electronics Engineers, S. 352-355, Vasteras, Schweden, 9/04/18. https://doi.org/10.1109/ICSTW.2018.00072
    Felbinger H, Wotawa F, Nica M. Adapting unit tests by generating combinatorial test data. in Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018. Institute of Electrical and Electronics Engineers. 2018. S. 352-355 https://doi.org/10.1109/ICSTW.2018.00072
    Felbinger, Hermann ; Wotawa, Franz ; Nica, Mihai. / Adapting unit tests by generating combinatorial test data. Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018. Institute of Electrical and Electronics Engineers, 2018. S. 352-355
    @inproceedings{05c2564248be464b84390798473f7047,
    title = "Adapting unit tests by generating combinatorial test data",
    abstract = "Conventional unit tests are still mainly handcrafted. Generalizing conventional unit tests to parameterized unit tests supports automatic test data generation. Methods that were introduced to instantiate parameterized unit tests with concrete values as test data are based on search based approaches, dynamic symbolic execution, or property based testing. In this work, we introduce an approach that retrofits existing conventional unit tests into parameterized unit tests by generalization, and generate test data by combinatorial valuation to adapt existing conventional unit test suites. We conduct an empirical study to investigate whether our test suite adaption approach is beneficial in terms of additional fault detection capabilities and code coverage. Our results show that mutation score and condition coverage increase with feasible effort compared to existing conventional unit tests.",
    keywords = "Code coverage, Combinatorial testing, Mutation score, Parameterized unit test",
    author = "Hermann Felbinger and Franz Wotawa and Mihai Nica",
    year = "2018",
    month = "7",
    day = "16",
    doi = "10.1109/ICSTW.2018.00072",
    language = "English",
    pages = "352--355",
    booktitle = "Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018",
    publisher = "Institute of Electrical and Electronics Engineers",
    address = "United States",

    }

    TY - GEN

    T1 - Adapting unit tests by generating combinatorial test data

    AU - Felbinger, Hermann

    AU - Wotawa, Franz

    AU - Nica, Mihai

    PY - 2018/7/16

    Y1 - 2018/7/16

    N2 - Conventional unit tests are still mainly handcrafted. Generalizing conventional unit tests to parameterized unit tests supports automatic test data generation. Methods that were introduced to instantiate parameterized unit tests with concrete values as test data are based on search based approaches, dynamic symbolic execution, or property based testing. In this work, we introduce an approach that retrofits existing conventional unit tests into parameterized unit tests by generalization, and generate test data by combinatorial valuation to adapt existing conventional unit test suites. We conduct an empirical study to investigate whether our test suite adaption approach is beneficial in terms of additional fault detection capabilities and code coverage. Our results show that mutation score and condition coverage increase with feasible effort compared to existing conventional unit tests.

    AB - Conventional unit tests are still mainly handcrafted. Generalizing conventional unit tests to parameterized unit tests supports automatic test data generation. Methods that were introduced to instantiate parameterized unit tests with concrete values as test data are based on search based approaches, dynamic symbolic execution, or property based testing. In this work, we introduce an approach that retrofits existing conventional unit tests into parameterized unit tests by generalization, and generate test data by combinatorial valuation to adapt existing conventional unit test suites. We conduct an empirical study to investigate whether our test suite adaption approach is beneficial in terms of additional fault detection capabilities and code coverage. Our results show that mutation score and condition coverage increase with feasible effort compared to existing conventional unit tests.

    KW - Code coverage

    KW - Combinatorial testing

    KW - Mutation score

    KW - Parameterized unit test

    UR - http://www.scopus.com/inward/record.url?scp=85050957828&partnerID=8YFLogxK

    U2 - 10.1109/ICSTW.2018.00072

    DO - 10.1109/ICSTW.2018.00072

    M3 - Conference contribution

    SP - 352

    EP - 355

    BT - Proceedings - 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2018

    PB - Institute of Electrical and Electronics Engineers

    ER -