The second reactive synthesis competition (SYNTCOMP 2015)

Swen Jacobs, Roderick Bloem, Romain Brenguier, Guillermo A. Pérez, Jean François Raskin, Leonid Ryzhyk, Ocan Sankur, Martina Seidl, Leander Tentrup, Adam Walker, Robert Könighofer

Research output: Contribution to journalArticleResearchpeer-review

Abstract

We report on the design and results of the second reactive synthesis competition (SYNTCOMP 2015). We describe our extended benchmark library, with 6 completely new sets of benchmarks, and additional challenging instances for 4 of the benchmark sets that were already used in SYNTCOMP 2014. To enhance the analysis of experimental results, we introduce an extension of our benchmark format with meta-information, including a difficulty rating and a reference size for solutions. Tools are evaluated on a set of 250 benchmarks, selected to provide a good coverage of benchmarks from all classes and difficulties. We report on changes of the evaluation scheme and the experimental setup. Finally, we describe the entrants into SYNTCOMP 2015, as well as the results of our experimental evaluation. In our analysis, we emphasize progress over the tools that participated last year.

Original languageEnglish
Pages (from-to)27-57
Number of pages31
JournalElectronic Proceedings in Theoretical Computer Science
Volume202
DOIs
Publication statusPublished - 2 Feb 2016

ASJC Scopus subject areas

  • Software

Cite this

Jacobs, S., Bloem, R., Brenguier, R., Pérez, G. A., Raskin, J. F., Ryzhyk, L., ... Könighofer, R. (2016). The second reactive synthesis competition (SYNTCOMP 2015). Electronic Proceedings in Theoretical Computer Science, 202, 27-57. https://doi.org/10.4204/EPTCS.202.4