Table of contents

1. Papers related to the model checking contest
2. Results of the past years
3. Some Scientific Papers Mentioning the Model Checking Contest

Papers related to the model checking contest

• E. G. Amparore, B. Berthomieu, G. Ciardo, S. Dal-Zilio, F. Gall`a, L. Hillah, F. Hulin-Hubard, P. G. Jensen, L. Jezequel, F. Kordon, D. L. Botlan, T. Liebke, J. Meijer, A. S. Miner, E. Paviot-Adet, J. Srba, Y. Thierry-Mieg, T. van Dijk, and K. Wolf. Presentation of the 9th edition of the model checking contest. In Tools and Algorithms for the Construction and Analysis of Systems - 25 Years of TACAS: TOOLympics, Held as Part of ETAPS 2019, Prague, Czech Republic, April 6-11, 2019, Proceedings, Part III, volume 11429 of Lecture Notes in Computer Science, pages 50–68. Springer, 2019.

  @inproceedings{abcdg2019,
    author = {Elvio Gilberto Amparore and Bernard Berthomieu and Gianfranco Ciardo and
      Silvano Dal{-}Zilio and Francesco Gall{\`{a}} and Lom{-}Messan Hillah and
      Francis Hulin{-}Hubard and Peter Gj{\o}l Jensen and Lo{\"{\i}}g Jezequel and
      Fabrice Kordon and Didier Le Botlan and Torsten Liebke and
      Jeroen Meijer and Andrew S. Miner and Emmanuel Paviot{-}Adet and
      Jir{\'{\i}} Srba and Yann Thierry{-}Mieg and Tom van Dijk and
      Karsten Wolf},
    title = {Presentation of the 9th Edition of the Model Checking Contest},
    booktitle = {Tools and Algorithms for the Construction and Analysis of Systems
      - 25 Years of {TACAS:} TOOLympics, Held as Part of {ETAPS} 2019, Prague,
      Czech Republic, April 6-11, 2019, Proceedings, Part {III}},
    series = {Lecture Notes in Computer Science},
    volume = {11429},
    publisher = {Springer},
    pages = {50--68},
    year = {2019}}
  

• F. Kordon, H. Garavel, L. Hillah, E. Paviot-Adet, L. Jezequel, F. Hulin-Hubard, E. G. Amparore, M. Beccuti, B. Berthomieu, H. Evrard, P. G. Jensen, D. L. Botlan, T. Liebke, J. Meijer, J. Srba, Y. Thierry-Mieg, J. van de Pol, and K. Wolf. MCC'2017 - the seventh model checking contest. Transactions on Petri Nets and Other Models of Concurrency (ToPNoC), XIII:181-209, 2018.

  @article{kghpjh2019,
    author = {Fabrice Kordon and Hubert Garavel and Lom{-}Messan Hillah and
      Emmanuel Paviot{-}Adet and Lo{\"{\i}}g Jezequel and Francis Hulin{-}Hubard and
      Elvio Gilberto Amparore and Marco Beccuti and Bernard Berthomieu and
      Hugues Evrard and Peter Gj{\o}l Jensen and
      Didier Le Botlan and Torsten Liebke and Jeroen Meijer and
      Jir{\'{\i}} Srba and Yann Thierry{-}Mieg and Jaco van de Pol and
      Karsten Wolf},
    title = {MCC'2017 - The Seventh Model Checking Contest},
    journal = {Transactions on Petri Nets and Other Models of Concurrency (ToPNoC)},
    volume = {XIII},
    pages = {181--209},
    year = {2018},
    publisher = {Springer Verlag}}

• L. Hillah and F. Kordon. Petri Nets Repository: a tool to benchmark and debug Petri Net tools. In 38th International Conference on Petri Nets and Other Models of Concurrency (ICATPN), volume 10258 of Lecture Notes in Computer Science, pages 125-135, Zaragoza, Spain, June 2017. Springer

  @inproceedings{hk2017,
    author = {{L. M.} Hillah and F. Kordon},
    title = {{Petri Nets Repository: a tool to benchmark and debug Petri Net tools}},
    booktitle = {{38th International Conference on Petri Nets and Other Models of Concurrency (Petri Nets)}},
    year = {2017},
    pages = {125-135},
    address = {Zaragoza, Spain},
    volume={10258},
    month={June},
    publisher = {Springer},
    series = {Lecture Notes in Computer Science}}

• F. Kordon, H. Garavel, L. Hillah, E. Paviot-Adet, L. Jezequel, C. Rodriguez, and F. Hulin-Hubard. MCC'2015 - The Fifth Model Checking Contest. Transactions on Petri Nets and Other Models of Concurrency (ToPNoC), XI:262-273, 2016

  @Article{kghpajrhh2016,
    author = {Fabrice Kordon and Hubert Garavel and Lom{-}Messan Hillah and
      Emmanuel Paviot{-}Adet and Lo{\"{\i}}g Jezequel and C{\'{e}}sar
      Rodr{\'{\i}}guez and Francis Hulin{-}Hubard},
    title = {{MCC'2015 - The Fifth Model Checking Contest}},
    journal = {{Transactions on Petri Nets and Other Models of Concurrency (ToPNoC)}},
    volume = {XI},
    year = {2016},
    pages = {262--273},
    publisher = {Springer Verlag}}

• F. Kordon and F. Hulin-Hubard. BenchKit, a Tool for Massive Concurrent Benchmarking. In 14th International Conference on Application of Concurrency to System Design - ACSD, pages 159-165, Tunis, Tunisia, June 2014. IEEE Computer Society

  @inproceedings{khh2014,
    author = {F. Kordon and F. Hulin-Hubard},
    title = {{BenchKit, a Tool for Massive Concurrent Benchmarking}},
    booktitle = {{14$^{th}$ International Conference on Application of Concurrency to System Design -- ACSD}},
    address = {Tunis, Tunisia},
    year = {2014},
    month = {June},
    pages = {159-165},
    publisher = {IEEE Computer Society}}

• F. Kordon, A. Linard, D. Buchs, M. Colange, S. Evangelista, K. Lampka, N. Lohmann, E. Paviot- Adet, Y. Thierry-Mieg, and H. Wimmel. Report on the Model Checking Contest at Petri Nets 2011. Transactions on Petri Nets and Other Models of Concurrency (ToPNoC), VI:169-196, march 2012

  @Article{klbcellpatmw2012,
    author = {F. Kordon and A. Linard and D. Buchs and M. Colange and S. Evangelista and K. Lampka and
      N. Lohmann and E. Paviot-Adet and Y. Thierry-Mieg and H. Wimmel},
    title = {{Report on the Model Checking Contest at Petri Nets 2011}},
    journal = {{Transactions on Petri Nets and Other Models of Concurrency (ToPNoC)}},
    volume = {VI},
    month = {march},
    year = {2012},
    pages = {169-196},
    publisher = {Springer Verlag}}

Results of the past years

• 2019: F. Kordon, H. Garavel, L. M. Hillah, F. Hulin-Hubard, E. Amparore, M. Beccuti, B. Berthomieu, G. Ciardo, S. Dal Zilio, T. Liebke, S. Li, J. Meijer, A. Miner, J. Srba, Y. Thierry-Mieg, J. van de Pol, T. van Dirk, and K. Wolf. Complete Results for the 2019 Edition of the Model Checking Contest. April 2019.

  @misc{mcc:2019,   Author = {F. Kordon and H. Garavel and L. M. Hillah and F. Hulin-Hubard and
      E. Amparore and M. Beccuti and B. Berthomieu and G. Ciardo and S. {Dal Zilio} and
      T. Liebke and S. Li and J. Meijer and A. Miner and J. Srba and
      Y. Thierry-Mieg and J. van de Pol and T. van Dirk and K. Wolf},
    Howpublished = {{http://mcc.lip6.fr/2019/results.php}},
    Lastchecked = 2019,
    Month = {April},
    Title = {{Complete Results for the 2019 Edition of the Model Checking Contest}},
    Urldate = {2019},
    Year = {2019}}

• 2018: F. Kordon and H. Garavel and L. M. Hillah and F. Hulin-Hubard and E. Amparore and M. Beccuti and B. Berthomieu and G. Ciardo and S. {Dal Zilio} and T. Liebke and A. Linard and J. Meijer and A. Miner and J. Srba and Y. Thierry-Mieg and J. van de Pol and K. Wolf. Complete Results for the 2018 Edition of the Model Checking Contest

  @misc{mcc:2018,   Author = {F. Kordon and H. Garavel and L. M. Hillah and F. Hulin-Hubard and
      E. Amparore and M. Beccuti and B. Berthomieu and G. Ciardo and S. {Dal Zilio} and
      T. Liebke and A. Linard and J. Meijer and A. Miner and J. Srba and
      JY. Thierry-Mieg and J. van de Pol and K. Wolf},
    Howpublished = {{http://mcc.lip6.fr/2018/results.php}},
    Lastchecked = {2018},
    Month = {June},
    Title = {{Complete Results for the 2018 Edition of the Model Checking Contest}},
    Urldate = {2018},
    Year = {2018}}
  

• 2017: F. Kordon, H. Garavel, L. M. Hillah, F. Hulin-Hubard, B. Berthomieu, G. Ciardo, M. Colange, S. Dal Zilio, E. Amparore, M. Beccuti, T. Liebke, J. Meijer, A. Miner, C. Rohr, J. Srba, Y. Thierry-Mieg, J. van de Pol, and K. Wolf. Complete Results for the 2017 Edition of the Model Checking Contest

  @misc{mcc:2017,   Author = {F. Kordon and H. Garavel and L. M. Hillah and F. Hulin-Hubard and
      B. Berthomieu and G. Ciardo and M. Colange and S. {Dal Zilio} and
      E. Amparore and M. Beccuti and T. Liebke and J. Meijer and A. Miner and C. Rohr and
      J. Srba and Y. Thierry-Mieg and J. van de Pol and K. Wolf},
    Howpublished = {{http://mcc.lip6.fr/2017/results.php}},
    Lastchecked = {2017},
    Month = {June},
    Title = {{Complete Results for the 2017 Edition of the Model Checking Contest}},
    Urldate = {2017},
    Year = {2017}}
  

• 2016: F. Kordon, H. Garavel, L. M. Hillah, F. Hulin-Hubard, G. Chiardo, A. Hamez, L. Jezequel, A. Miner, J. Meijer, E. Paviot-Adet, D. Racordon, C. Rodriguez, C. Rohr, J. Srba, Y. Thierry- Mieg, G. Tr.inh, and K. Wolf. Complete Results for the 2016 Edition of the Model Checking Contest.

  @misc{mcc:2016,
    Author = {F. Kordon and H. Garavel and L. M. Hillah and F. Hulin-Hubard and
      G. Chiardo and A. Hamez and L. Jezequel and A. Miner and J. Meijer and E. Paviot-Adet
      and D. Racordon and C. Rodriguez and C. Rohr and J. Srba and Y. Thierry-Mieg and
      G. Tr{\d i}nh and K. Wolf},
    Howpublished = {{http://mcc.lip6.fr/2016/results.php}},
    Lastchecked = {2016},
    Urldate = {2016},
    Month = {June},
    Title = {{Complete Results for the 2016 Edition of the Model Checking Contest}},
    Year = {2016}}

• 2015: F. Kordon, H. Garavel, L. M. Hillah, F. Hulin-Hubard, A. Linard, M. Beccuti, A. Hamez, E. Lopez-Bobeda, L. Jezequel, J. Meijer, E. Paviot-Adet, C. Rodriguez, C. Rohr, J. Srba, Y. Thierry-Mieg, and K. Wolf. Complete Results for the 2015 Edition of the Model Checking Contest.

  @misc{mcc:2015,
    Author = {F. Kordon and H. Garavel and L. M. Hillah and F. Hulin-Hubard and A. Linard and
      M. Beccuti and A. Hamez and E. Lopez-Bobeda and L. Jezequel and J. Meijer and E. Paviot-Adet
      and C. Rodriguez and C. Rohr and J. Srba and Y. Thierry-Mieg and K. Wolf},
    Howpublished = {{http://mcc.lip6.fr/2015/results.php}},
    Lastchecked = {2015},
    Title = {{Complete Results for the 2015 Edition of the Model Checking Contest}},
    Urldate = {2015},
    Year = {2015}}

• 2014: F. Kordon, H. Garavel, L.-M. Hillah, F. Hulin-Hubard, A. Linard, M. Beccuti, S. Evangelista, A. Hamez, N. Lohmann, E. Lopez, E. Paviot-Adet, C. Rodriguez, C. Rohr, and J. Srba. HTML results from the Model Checking Contest @ Petri Net (2014 edition).

  @misc{mcc:2014,
    Author = {F. Kordon and H. Garavel and L-M. Hillah and F. Hulin-Hubard and A. Linard and
      M. Beccuti and S. Evangelista and A. Hamez and N. Lohmann and E. Lopez and
      E. Paviot-Adet and C. Rodriguez and C. Rohr and J. Srba},
    Howpublished = {{http://mcc.lip6.fr/2014}},
    Lastchecked = {2014},
    Title = {{HTML results from the Model Checking Contest @ Petri Net (2014 edition)}},
    Urldate = {2014},
    year = {2014}}

• 2013: F. Kordon, A. Linard, M. Beccuti, D. Buchs, L. Fronc, L. Hillah, F. Hulin-Hubard, F. Legond-Aubry, N. Lohmann, A. Marechal, E. Paviot-Adet, F. Pommereau, C. Rodriguez, C. Rohr, Thierry-Mieg, H. Wimmel, and K. Wolf. Model checking contest @ petri nets, report on the 2013 edition. CoRR, abs/1309.2485, 2013.

  @article{mcc:2013,
    author = {Fabrice Kordon and Alban Linard and Marco Beccuti and Didier Buchs and
      Lukasz Fronc and Lom{-}Messan Hillah and Francis Hulin{-}Hubard and
      Fabrice Legond{-}Aubry and Niels Lohmann and Alexis Marechal and
      Emmanuel Paviot{-}Adet and Franck Pommereau and C{\'{e}}sar Rodr{\'{\i}}guez and
      Christian Rohr and Thierry{-}Mieg and Harro Wimmel and Karsten Wolf},
    title = {Model Checking Contest @ Petri Nets, Report on the 2013 edition},
    journal = {CoRR},
    volume = {abs/1309.2485},
    year = {2013},
    url = {http://arxiv.org/abs/1309.2485},
    archivePrefix = {arXiv},
    eprint = {1309.2485}}

• 2012: F. Kordon, A. Linard, D. Buchs, M. Colange, S. Evangelista, L. Fronc, L. Hillah, N. Lohmann, E. Paviot- Adet, F. Pommereau, C. Rohr, Y. Thierry-Mieg, H. Wimmel, and K. Wolf. Raw report on the model checking contest at petri nets 2012. CoRR, abs/1209.2382, 2012.

  @article{mcc:2012,
    author = {Fabrice Kordon and Alban Linard and Didier Buchs and Maximilien Colange and
      Evangelista and Lukasz Fronc and Lom-Messan Hillah and Niels Lohmann
      and Emmanuel Paviot{-}Adet and Franck Pommereau and Christian Rohr and
      Yann Thierry{-}Mieg and Harro Wimmel and Karsten Wolf},
    title = {Raw Report on the Model Checking Contest at Petri Nets 2012},
    journal = {CoRR},
    volume = {abs/1209.2382},
    year = {2012},
    url = {http://arxiv.org/abs/1209.2382},
    archivePrefix = {arXiv},
    eprint = {1209.2382}}

Some Scientific Papers Mentioning the Model Checking Contest

1. Improving Saturation Efficiency with Implicit Relations (2019)
2. Saturation Enhanced with Conditional Locality: Application to Petri Nets (2019)
3. 2018Counting Petri net markings from reduction equations (2019)
4. Binary Decision Diagrams with Edge-Specified Reductions (2019)
5. Stubborn versus structural reductions for Petri nets (2019)
6. Multi-core On-The-Fly Saturation (2019)
7. Experience Report on An Inquiry-Based Course on Model Checking (2019)
8. Abstract Dependency Graphs and Their Application to Model Checking (2019)
9. RERS 2019: Combining Synthesis with Real-World Models (2019)
10. TOOLympics 2019: An Overview of Competitions in Formal Methods (2019)
11. The Rewrite Engines Competitions: A RECtrospective (2019)
12. Nested-unit Petri nets (2019)
13. RERS 2018: CTL, LTL, and Reachability (2018)
14. Synthesizing Subtle Bugs with Known Witnesses (2018)
15. Synthesizing Subtle Bugs with Known Witnesses (2018)
16. Modeling and Analyzing Cyber Physical Systems Using High Level Petri Nets (2018)
17. Petri Net Synthesis with Union/Find (2018)
18. Simplification of CTL Formulae for Efficient Model Checking of Petri Nets (2018)
19. Petri Net Reductions for Counting Markings (2018)
20. Assessing SMT and CLP approaches for workflow nets verification (2018)
21. Generation of Minimum Tree-Like Witnesses for Existential CTL (2018)
22. Towards Reliable Benchmarks of Timed Automata (2018)
23. Decision Diagrams for Petri Nets: A Comparison of Variable Ordering Algorithms (2018), (or here
24. Petri Net Model Checking with LoLA 2 (2018)
25. Self-adaptive Model Checking, the Next Step (2018)
26. A Model Checker Collection for the Model Checking Contest Using Docker and Machine Learning (2018)
27. A Distributed Fixed-Point Algorithm for Extended Dependency Graphs (2018)
28. Start Pruning When Time Gets Urgent: Partial Order Reduction for Timed Systems (2018)
29. Generation of Minimum Tree-Like Witnesses for Existential CTL (2018)
30. Property-Preserving Generation of Tailored Benchmark Petri Nets (2017)
31. Explicit state model checking with generalized Büchi and Rabin automata (2017)
32. A Method to Analyze Predicate Transition Nets Using SPIN Model Checker (2017)
33. Stubborn Versus Structural Reductions for Petri Nets (2017)
34. Property-Preserving Parallel Decomposition (2017)
35. Industrial applications of the PetriDotNet modelling and analysis tool (2017)
36. A hybrid model checking approach to analysing rule conformance applied to HIPAA privacy rules (2017)
37. Petri Nets Repository: A Tool to Benchmark and Debug Petri Net Tools (2017)
38. The physics of software tools: SWOT analysis and vision (2017)
39. Extended Dependency Graphs and Efficient Distributed Fixed-Point Computation (2017)
40. Reduction of Workflow Nets for Generalised Soundness Verification (2017)
41. Faster Simulation of (Coloured) Petri Nets Using Parallel Computing (2017)
42. Decision Diagrams for Petri Nets: which Variable Ordering? (2017)
43. Layered Data: A Modular Formal Definition without Formalisms (2016)
44. TAPAAL and Reachability Analysis of P/T Nets (2016)
45. A toolchain on model checking SPIN via Kalman Decomposition for control system software (2016)
46. A Term Rewriting Approach to Analyze High Level Petri Nets (2016)
47. Multi-core SCC-Based LTL Model Checking (2016)
48. A Symbolic Model Checker for Petri Nets: pnmc (2016)
49. Running LoLA 2.0 in a Model Checking Competition (2016)
50. MARCIE's Secrets of Efficient Model Checking (2016)
51. MCC'2015 - The Fifth Model Checking Contest (2016)
52. Component-wise Incremental LTL Model Checking (2016)
53. A Method of Sample Models of Program Construction in Terms of Petri Nets (2015)
54. Génération de règles de coordination à partir de réseaux de Petri colorés (2015)
55. Nested-Unit Petri Nets: A Structural Means to Increase Efficiency and Scalability of Verification on Elementary Nets (2015)
56. Building a Symbolic Model Checker from Formal Language Description (2015)
57. Saturation-Based Incremental LTL Model Checking with Inductive Proofs (2015)
58. New Search Strategies for the Petri Net CEGAR Approach (2015)
59. Vers l'intégration de paramètres temporels statiques et dynamiques dans les techniques de vérification par ordre partiel (2014)
60. Bounded Model Checking High Level Petri Nets in PIPE+Verifier (2014)
61. PeCAn: Compositional Verification of Petri Nets Made Easy (2014)
62. Formal Modeling and Analysis Techniques for High Level Petri Nets (2014)
63. Teaching formal methods: Experience at UPMC and UP13 with CosyVerif (2014)
64. BenchKit, a Tool for Massive Concurrent Benchmarking (2014)
65. Petri Nets Research at BTU in Cottbus, Germany (2014)
66. Read, Write and Copy Dependencies for Symbolic Model Checking (2014)
67. Compilation de réseaux de Petri : modèles haut niveau et symétries de processus (2014)
68. Formal verification problems in a big data world: towards a mighty synergy (2014)
69. Advanced Saturation-based Model Checking (2014)
70. Distributed CTL Model Checking in the Cloud (2013)
71. Compilation de réseaux de Petri (2013)
72. Verifiable Design of a Satellite-based Train Control System with Petri Nets (2014)
73. Unifying the syntax and semantics of modular extensions of Petri nets (2013)
74. Modeling and Analyzing Wireless Sensor Networks with VeriSensor : An Integrated Workflow (2013)
75. Building Petri nets tools around Neco compiler (2013)
76. LTL Model Checking with Neco (2013)
77. MaRDiGraS : Simplified Building of Reachability Graphs on Large Clusters (2013)
78. CosyVerif: An Open Source Extensible Verification Environment (2013)
79. A Modular Approach for Reusing Formalisms in Verification Tools of Concurrent Systems (2013)
80. Unifying the syntax and semantics of modular extensions of Petri nets (2013)
81. Half a century after Carl Adam Petri's Ph.D. thesis: A perspective on the field (2013)
82. Verification based on unfoldings of Petri nets with read arcs (2013)
83. High-level Petri net model checking : the symbolic way (2012)
84. Stubborn Sets for Simple Linear Time Properties (2012)
85. High-Level Petri Net Model Checking with AlPiNA (2011)
86. Crocodile : A Symbolic/Symbolic Tool for the Analysis of Symmetric Nets with Bag (2011)