SIMULTATE: A Toolset for Fault Injection and Mutation Testing of Simulink Models

Ingo Pill, Ivan Rubil, Franz Wotawa, Mihai Nica

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

The advantages of fault injection techniques and related methodologies like mutation testing have been gaining in attention also from industry, as is evident from the advent of standards like ISO 26262 that suggest to use corresponding approaches for verifying an automotive system's safety aspects. Aside a well-established theoretical background, the availability of tools is a key issue in order to leverage fault injection for the development of industrial, possibly safety-critical applications, e.g., in an automotive context. We propose the corresponding open source toolset SIMULTATE for injecting faults and performing mutation testing for Simulink models. For complementing the provided mutation/fault injection operators, it allows a user to define her own ones within Matlab and further provides a Python interface for easily deriving mutants where she can also focus the scope to desired model parts only. Controlling the activation of individual faults in a derived model, a designer can conveniently conduct mutation tests via a corresponding Python application.

Original languageEnglish
Title of host publicationProceedings - 2016 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2016
PublisherInstitute of Electrical and Electronics Engineers
Pages168-173
Number of pages6
ISBN (Electronic)9781509018260
DOIs
Publication statusPublished - 1 Aug 2016
EventNinth IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops 2016: 13th Workshop on Advances in Model Based Testing (A-MOST 2016) - Chicago, United States
Duration: 11 Apr 201615 Apr 2016

Conference

ConferenceNinth IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops 2016
CountryUnited States
CityChicago
Period11/04/1615/04/16

Fingerprint

Testing
Security systems
Chemical activation
Availability
Industry

ASJC Scopus subject areas

  • Software
  • Safety, Risk, Reliability and Quality

Fields of Expertise

  • Information, Communication & Computing

Cite this

Pill, I., Rubil, I., Wotawa, F., & Nica, M. (2016). SIMULTATE: A Toolset for Fault Injection and Mutation Testing of Simulink Models. In Proceedings - 2016 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2016 (pp. 168-173). [7528959] Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICSTW.2016.21

SIMULTATE : A Toolset for Fault Injection and Mutation Testing of Simulink Models. / Pill, Ingo; Rubil, Ivan; Wotawa, Franz; Nica, Mihai.

Proceedings - 2016 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2016. Institute of Electrical and Electronics Engineers, 2016. p. 168-173 7528959.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Pill, I, Rubil, I, Wotawa, F & Nica, M 2016, SIMULTATE: A Toolset for Fault Injection and Mutation Testing of Simulink Models. in Proceedings - 2016 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2016., 7528959, Institute of Electrical and Electronics Engineers, pp. 168-173, Ninth IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops 2016, Chicago, United States, 11/04/16. https://doi.org/10.1109/ICSTW.2016.21
Pill I, Rubil I, Wotawa F, Nica M. SIMULTATE: A Toolset for Fault Injection and Mutation Testing of Simulink Models. In Proceedings - 2016 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2016. Institute of Electrical and Electronics Engineers. 2016. p. 168-173. 7528959 https://doi.org/10.1109/ICSTW.2016.21
Pill, Ingo ; Rubil, Ivan ; Wotawa, Franz ; Nica, Mihai. / SIMULTATE : A Toolset for Fault Injection and Mutation Testing of Simulink Models. Proceedings - 2016 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2016. Institute of Electrical and Electronics Engineers, 2016. pp. 168-173
@inproceedings{51e40aaf248542cdab6d6f0213ada937,
title = "SIMULTATE: A Toolset for Fault Injection and Mutation Testing of Simulink Models",
abstract = "The advantages of fault injection techniques and related methodologies like mutation testing have been gaining in attention also from industry, as is evident from the advent of standards like ISO 26262 that suggest to use corresponding approaches for verifying an automotive system's safety aspects. Aside a well-established theoretical background, the availability of tools is a key issue in order to leverage fault injection for the development of industrial, possibly safety-critical applications, e.g., in an automotive context. We propose the corresponding open source toolset SIMULTATE for injecting faults and performing mutation testing for Simulink models. For complementing the provided mutation/fault injection operators, it allows a user to define her own ones within Matlab and further provides a Python interface for easily deriving mutants where she can also focus the scope to desired model parts only. Controlling the activation of individual faults in a derived model, a designer can conveniently conduct mutation tests via a corresponding Python application.",
author = "Ingo Pill and Ivan Rubil and Franz Wotawa and Mihai Nica",
year = "2016",
month = "8",
day = "1",
doi = "10.1109/ICSTW.2016.21",
language = "English",
pages = "168--173",
booktitle = "Proceedings - 2016 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2016",
publisher = "Institute of Electrical and Electronics Engineers",
address = "United States",

}

TY - GEN

T1 - SIMULTATE

T2 - A Toolset for Fault Injection and Mutation Testing of Simulink Models

AU - Pill, Ingo

AU - Rubil, Ivan

AU - Wotawa, Franz

AU - Nica, Mihai

PY - 2016/8/1

Y1 - 2016/8/1

N2 - The advantages of fault injection techniques and related methodologies like mutation testing have been gaining in attention also from industry, as is evident from the advent of standards like ISO 26262 that suggest to use corresponding approaches for verifying an automotive system's safety aspects. Aside a well-established theoretical background, the availability of tools is a key issue in order to leverage fault injection for the development of industrial, possibly safety-critical applications, e.g., in an automotive context. We propose the corresponding open source toolset SIMULTATE for injecting faults and performing mutation testing for Simulink models. For complementing the provided mutation/fault injection operators, it allows a user to define her own ones within Matlab and further provides a Python interface for easily deriving mutants where she can also focus the scope to desired model parts only. Controlling the activation of individual faults in a derived model, a designer can conveniently conduct mutation tests via a corresponding Python application.

AB - The advantages of fault injection techniques and related methodologies like mutation testing have been gaining in attention also from industry, as is evident from the advent of standards like ISO 26262 that suggest to use corresponding approaches for verifying an automotive system's safety aspects. Aside a well-established theoretical background, the availability of tools is a key issue in order to leverage fault injection for the development of industrial, possibly safety-critical applications, e.g., in an automotive context. We propose the corresponding open source toolset SIMULTATE for injecting faults and performing mutation testing for Simulink models. For complementing the provided mutation/fault injection operators, it allows a user to define her own ones within Matlab and further provides a Python interface for easily deriving mutants where she can also focus the scope to desired model parts only. Controlling the activation of individual faults in a derived model, a designer can conveniently conduct mutation tests via a corresponding Python application.

UR - http://www.scopus.com/inward/record.url?scp=84992195731&partnerID=8YFLogxK

U2 - 10.1109/ICSTW.2016.21

DO - 10.1109/ICSTW.2016.21

M3 - Conference contribution

SP - 168

EP - 173

BT - Proceedings - 2016 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2016

PB - Institute of Electrical and Electronics Engineers

ER -