Model-Based Testing IoT Communication via Active Automata Learning

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

This paper presents a learning-based approach to detecting failures in reactive systems. The technique is based on inferring models of multiple implementations of a common specification which are pair-wise cross-checked for equivalence. Any counterexample to equivalence is flagged as suspicious and has to be analysed manually. Hence, it is possible to find possible failures in a semi-automatic way without prior modelling. We show that the approach is effective by means of a case study. For this case study, we carried out experiments in which we learned models of five implementations of MQTT brokers/servers, a protocol used in the Internet of Things. Examining these models, we found several violations of the MQTT specification. All but one of the considered implementations showed faulty behaviour. In the analysis, we discuss effectiveness and also issues we faced.
Original languageEnglish
Title of host publication2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)
Pages276-287
Number of pages12
DOIs
Publication statusPublished - 2017
Event10th IEEE International Conference on Software Testing, Verification and Validation (ICST 2017) - Tokyo, Japan
Duration: 13 Mar 201717 Mar 2017
http://aster.or.jp/conference/icst2017/

Conference

Conference10th IEEE International Conference on Software Testing, Verification and Validation (ICST 2017)
Abbreviated titleICST 2017
CountryJapan
CityTokyo
Period13/03/1717/03/17
Internet address

Fingerprint

Communication
Testing
Specifications
Servers
Network protocols
Internet of things
Experiments

Keywords

  • Internet of Things
  • Learning automata
  • Protocols
  • Testing
  • MQTT
  • automata learning
  • internet of things
  • model inference
  • model-based testing

Fields of Expertise

  • Information, Communication & Computing

Cite this

Tappler, M., Aichernig, B. K., & Bloem, R. (2017). Model-Based Testing IoT Communication via Active Automata Learning. In 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) (pp. 276-287) https://doi.org/10.1109/ICST.2017.32

Model-Based Testing IoT Communication via Active Automata Learning. / Tappler, M.; Aichernig, B. K.; Bloem, R.

2017 IEEE International Conference on Software Testing, Verification and Validation (ICST). 2017. p. 276-287.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Tappler, M, Aichernig, BK & Bloem, R 2017, Model-Based Testing IoT Communication via Active Automata Learning. in 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST). pp. 276-287, 10th IEEE International Conference on Software Testing, Verification and Validation (ICST 2017), Tokyo, Japan, 13/03/17. https://doi.org/10.1109/ICST.2017.32
Tappler M, Aichernig BK, Bloem R. Model-Based Testing IoT Communication via Active Automata Learning. In 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST). 2017. p. 276-287 https://doi.org/10.1109/ICST.2017.32
Tappler, M. ; Aichernig, B. K. ; Bloem, R. / Model-Based Testing IoT Communication via Active Automata Learning. 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST). 2017. pp. 276-287
@inproceedings{032db6508e6e487ca2aefd4ba7fbe403,
title = "Model-Based Testing IoT Communication via Active Automata Learning",
abstract = "This paper presents a learning-based approach to detecting failures in reactive systems. The technique is based on inferring models of multiple implementations of a common specification which are pair-wise cross-checked for equivalence. Any counterexample to equivalence is flagged as suspicious and has to be analysed manually. Hence, it is possible to find possible failures in a semi-automatic way without prior modelling. We show that the approach is effective by means of a case study. For this case study, we carried out experiments in which we learned models of five implementations of MQTT brokers/servers, a protocol used in the Internet of Things. Examining these models, we found several violations of the MQTT specification. All but one of the considered implementations showed faulty behaviour. In the analysis, we discuss effectiveness and also issues we faced.",
keywords = "Internet of Things, Learning automata, Protocols, Testing, MQTT, automata learning, internet of things, model inference, model-based testing",
author = "M. Tappler and Aichernig, {B. K.} and R. Bloem",
year = "2017",
doi = "10.1109/ICST.2017.32",
language = "English",
pages = "276--287",
booktitle = "2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)",

}

TY - GEN

T1 - Model-Based Testing IoT Communication via Active Automata Learning

AU - Tappler, M.

AU - Aichernig, B. K.

AU - Bloem, R.

PY - 2017

Y1 - 2017

N2 - This paper presents a learning-based approach to detecting failures in reactive systems. The technique is based on inferring models of multiple implementations of a common specification which are pair-wise cross-checked for equivalence. Any counterexample to equivalence is flagged as suspicious and has to be analysed manually. Hence, it is possible to find possible failures in a semi-automatic way without prior modelling. We show that the approach is effective by means of a case study. For this case study, we carried out experiments in which we learned models of five implementations of MQTT brokers/servers, a protocol used in the Internet of Things. Examining these models, we found several violations of the MQTT specification. All but one of the considered implementations showed faulty behaviour. In the analysis, we discuss effectiveness and also issues we faced.

AB - This paper presents a learning-based approach to detecting failures in reactive systems. The technique is based on inferring models of multiple implementations of a common specification which are pair-wise cross-checked for equivalence. Any counterexample to equivalence is flagged as suspicious and has to be analysed manually. Hence, it is possible to find possible failures in a semi-automatic way without prior modelling. We show that the approach is effective by means of a case study. For this case study, we carried out experiments in which we learned models of five implementations of MQTT brokers/servers, a protocol used in the Internet of Things. Examining these models, we found several violations of the MQTT specification. All but one of the considered implementations showed faulty behaviour. In the analysis, we discuss effectiveness and also issues we faced.

KW - Internet of Things

KW - Learning automata

KW - Protocols

KW - Testing

KW - MQTT

KW - automata learning

KW - internet of things

KW - model inference

KW - model-based testing

U2 - 10.1109/ICST.2017.32

DO - 10.1109/ICST.2017.32

M3 - Conference contribution

SP - 276

EP - 287

BT - 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)

ER -