Model-Based Testing IoT Communication via Active Automata Learning

Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

Abstract

This paper presents a learning-based approach to detecting failures in reactive systems. The technique is based on inferring models of multiple implementations of a common specification which are pair-wise cross-checked for equivalence. Any counterexample to equivalence is flagged as suspicious and has to be analysed manually. Hence, it is possible to find possible failures in a semi-automatic way without prior modelling. We show that the approach is effective by means of a case study. For this case study, we carried out experiments in which we learned models of five implementations of MQTT brokers/servers, a protocol used in the Internet of Things. Examining these models, we found several violations of the MQTT specification. All but one of the considered implementations showed faulty behaviour. In the analysis, we discuss effectiveness and also issues we faced.
Originalspracheenglisch
Titel2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)
Seiten276-287
Seitenumfang12
DOIs
PublikationsstatusVeröffentlicht - 2017
Veranstaltung10th IEEE International Conference on Software Testing, Verification and Validation - Tokyo, Japan
Dauer: 13 Mär 201717 Mär 2017
http://aster.or.jp/conference/icst2017/

Konferenz

Konferenz10th IEEE International Conference on Software Testing, Verification and Validation
KurztitelICST 2017
LandJapan
OrtTokyo
Zeitraum13/03/1717/03/17
Internetadresse

Fingerprint

Communication
Testing
Specifications
Servers
Network protocols
Internet of things
Experiments

Schlagwörter

    Fields of Expertise

    • Information, Communication & Computing

    Dies zitieren

    Tappler, M., Aichernig, B. K., & Bloem, R. (2017). Model-Based Testing IoT Communication via Active Automata Learning. in 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) (S. 276-287) https://doi.org/10.1109/ICST.2017.32

    Model-Based Testing IoT Communication via Active Automata Learning. / Tappler, M.; Aichernig, B. K.; Bloem, R.

    2017 IEEE International Conference on Software Testing, Verification and Validation (ICST). 2017. S. 276-287.

    Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

    Tappler, M, Aichernig, BK & Bloem, R 2017, Model-Based Testing IoT Communication via Active Automata Learning. in 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST). S. 276-287, 10th IEEE International Conference on Software Testing, Verification and Validation , Tokyo, Japan, 13/03/17. https://doi.org/10.1109/ICST.2017.32
    Tappler M, Aichernig BK, Bloem R. Model-Based Testing IoT Communication via Active Automata Learning. in 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST). 2017. S. 276-287 https://doi.org/10.1109/ICST.2017.32
    Tappler, M. ; Aichernig, B. K. ; Bloem, R. / Model-Based Testing IoT Communication via Active Automata Learning. 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST). 2017. S. 276-287
    @inproceedings{032db6508e6e487ca2aefd4ba7fbe403,
    title = "Model-Based Testing IoT Communication via Active Automata Learning",
    abstract = "This paper presents a learning-based approach to detecting failures in reactive systems. The technique is based on inferring models of multiple implementations of a common specification which are pair-wise cross-checked for equivalence. Any counterexample to equivalence is flagged as suspicious and has to be analysed manually. Hence, it is possible to find possible failures in a semi-automatic way without prior modelling. We show that the approach is effective by means of a case study. For this case study, we carried out experiments in which we learned models of five implementations of MQTT brokers/servers, a protocol used in the Internet of Things. Examining these models, we found several violations of the MQTT specification. All but one of the considered implementations showed faulty behaviour. In the analysis, we discuss effectiveness and also issues we faced.",
    keywords = "Internet of Things, Learning automata, Protocols, Testing, MQTT, automata learning, internet of things, model inference, model-based testing",
    author = "M. Tappler and Aichernig, {B. K.} and R. Bloem",
    year = "2017",
    doi = "10.1109/ICST.2017.32",
    language = "English",
    pages = "276--287",
    booktitle = "2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)",

    }

    TY - GEN

    T1 - Model-Based Testing IoT Communication via Active Automata Learning

    AU - Tappler, M.

    AU - Aichernig, B. K.

    AU - Bloem, R.

    PY - 2017

    Y1 - 2017

    N2 - This paper presents a learning-based approach to detecting failures in reactive systems. The technique is based on inferring models of multiple implementations of a common specification which are pair-wise cross-checked for equivalence. Any counterexample to equivalence is flagged as suspicious and has to be analysed manually. Hence, it is possible to find possible failures in a semi-automatic way without prior modelling. We show that the approach is effective by means of a case study. For this case study, we carried out experiments in which we learned models of five implementations of MQTT brokers/servers, a protocol used in the Internet of Things. Examining these models, we found several violations of the MQTT specification. All but one of the considered implementations showed faulty behaviour. In the analysis, we discuss effectiveness and also issues we faced.

    AB - This paper presents a learning-based approach to detecting failures in reactive systems. The technique is based on inferring models of multiple implementations of a common specification which are pair-wise cross-checked for equivalence. Any counterexample to equivalence is flagged as suspicious and has to be analysed manually. Hence, it is possible to find possible failures in a semi-automatic way without prior modelling. We show that the approach is effective by means of a case study. For this case study, we carried out experiments in which we learned models of five implementations of MQTT brokers/servers, a protocol used in the Internet of Things. Examining these models, we found several violations of the MQTT specification. All but one of the considered implementations showed faulty behaviour. In the analysis, we discuss effectiveness and also issues we faced.

    KW - Internet of Things

    KW - Learning automata

    KW - Protocols

    KW - Testing

    KW - MQTT

    KW - automata learning

    KW - internet of things

    KW - model inference

    KW - model-based testing

    U2 - 10.1109/ICST.2017.32

    DO - 10.1109/ICST.2017.32

    M3 - Conference contribution

    SP - 276

    EP - 287

    BT - 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)

    ER -