Abstract
especially if the system under test is still under
development and its exact behavior is not yet fixed. We propose
a new approach to compute test cases for reactive systems from
a given temporal logic specification. The tests are guaranteed
to reveal certain simple bugs (like occasional bit-flips) in every
realization of the specification and for every behavior of the
uncontrollable part of the system’s environment. We aim at
unveiling faults for the lowest of four fault occurrence frequencies
possible (ranging from a single occurrence to persistence). Based
on well-established hypotheses from fault-based testing, we argue
that such tests are also sensitive for more complex bugs. Since
the specification may not define the system behavior completely,
we use reactive synthesis algorithms (with partial information) to
compute adaptive test strategies that react to behavior at runtime.
We work out the underlying theory and present first experiments
demonstrating that our approach can be applied to industrial
specifications and that the resulting strategies are capable of
detecting bugs that are hard to detect with random testing.
| Original language | English |
|---|---|
| Pages | 17-24 |
| Number of pages | 8 |
| Publication status | Published - 2016 |
| Event | Formal Methods in Computer Aided Design 2016 - Mountain View, Ca., United States Duration: 3 Oct 2016 → 6 Oct 2016 |
Conference
| Conference | Formal Methods in Computer Aided Design 2016 |
|---|---|
| Abbreviated title | FMCAD |
| Country | United States |
| City | Mountain View, Ca. |
| Period | 3/10/16 → 6/10/16 |
Fingerprint
Cite this
Synthesizing Adaptive Test Strategies from Temporal Logic Specifications. / Bloem, Roderick; Könighofer, Robert; Pill, Ingo Hans; Röck, Franz.
2016. 17-24 Paper presented at Formal Methods in Computer Aided Design 2016, Mountain View, Ca., United States.Research output: Contribution to conference › Paper › Research › peer-review
}
TY - CONF
T1 - Synthesizing Adaptive Test Strategies from Temporal Logic Specifications
AU - Bloem, Roderick
AU - Könighofer, Robert
AU - Pill, Ingo Hans
AU - Röck, Franz
PY - 2016
Y1 - 2016
N2 - Constructing good test cases is difficult and timeconsuming,especially if the system under test is still underdevelopment and its exact behavior is not yet fixed. We proposea new approach to compute test cases for reactive systems froma given temporal logic specification. The tests are guaranteedto reveal certain simple bugs (like occasional bit-flips) in everyrealization of the specification and for every behavior of theuncontrollable part of the system’s environment. We aim atunveiling faults for the lowest of four fault occurrence frequenciespossible (ranging from a single occurrence to persistence). Basedon well-established hypotheses from fault-based testing, we arguethat such tests are also sensitive for more complex bugs. Sincethe specification may not define the system behavior completely,we use reactive synthesis algorithms (with partial information) tocompute adaptive test strategies that react to behavior at runtime.We work out the underlying theory and present first experimentsdemonstrating that our approach can be applied to industrialspecifications and that the resulting strategies are capable ofdetecting bugs that are hard to detect with random testing.
AB - Constructing good test cases is difficult and timeconsuming,especially if the system under test is still underdevelopment and its exact behavior is not yet fixed. We proposea new approach to compute test cases for reactive systems froma given temporal logic specification. The tests are guaranteedto reveal certain simple bugs (like occasional bit-flips) in everyrealization of the specification and for every behavior of theuncontrollable part of the system’s environment. We aim atunveiling faults for the lowest of four fault occurrence frequenciespossible (ranging from a single occurrence to persistence). Basedon well-established hypotheses from fault-based testing, we arguethat such tests are also sensitive for more complex bugs. Sincethe specification may not define the system behavior completely,we use reactive synthesis algorithms (with partial information) tocompute adaptive test strategies that react to behavior at runtime.We work out the underlying theory and present first experimentsdemonstrating that our approach can be applied to industrialspecifications and that the resulting strategies are capable ofdetecting bugs that are hard to detect with random testing.
UR - http://www.cs.utexas.edu/users/hunt/FMCAD/FMCAD16/proceedings.html
M3 - Paper
SP - 17
EP - 24
ER -