Extending Automated FLTL Test Oracles With Diagnostic Support

Ingo Pill, Franz Wotawa

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review

Abstract

Testing is a versatile and in practice also dominant technique when it comes to verifying whether a system meets our expectations. After executing a test case, we use test oracles to judge whether the execution should be considered to have failed or passed. Fully automated oracles considering properties in temporal logics like FLTL allow us to derive such a verdict in a fully automated process. In this manuscript, we will show how to extend such an oracle with diagnostic support. In particular, drawing on model-based diagnosis (MBD), we will isolate exactly which parts of the property were violated for a failed test case. Such data are orthogonal to MBD focusing on the system itself and where we isolate faulty system components. With our diagnoses, we thus provide valuable information for the subsequent debugging and repair process in respect of how the test execution violated the property. We show that a corresponding polynomially sized SAT model for deriving our diagnoses can be derived easily.
Original languageEnglish
Title of host publicationProceedings - 2019 IEEE 30th International Symposium on Software Reliability Engineering Workshops, ISSREW 2019
EditorsKatinka Wolter, Ina Schieferdecker, Barbara Gallina, Michel Cukier, Roberto Natella, Naghmeh Ivaki, Nuno Laranjeiro
PublisherInstitute of Electrical and Electronics Engineers
Pages354-361
Number of pages8
ISBN (Electronic)978-1-7281-5138-0
DOIs
Publication statusPublished - Oct 2019
Event2019 IEEE International Symposium on Software Reliability Engineering Workshops: ISSREW 2019 - Berlin, Germany
Duration: 27 Oct 201930 Oct 2019

Publication series

NameProceedings - 2019 IEEE 30th International Symposium on Software Reliability Engineering Workshops, ISSREW 2019

Conference

Conference2019 IEEE International Symposium on Software Reliability Engineering Workshops
Abbreviated titleISSREW 2019
Country/TerritoryGermany
CityBerlin
Period27/10/1930/10/19

Keywords

  • linear temporal logic
  • model-based diagnosis
  • test oracle

ASJC Scopus subject areas

  • Software
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'Extending Automated FLTL Test Oracles With Diagnostic Support'. Together they form a unique fingerprint.

Cite this