Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/data/fkordon/mcc2021-input.r292-tall-162124156900693.qcow2', fmt=qcow2 size=4294967296 backing_file='/data/fkordon/mcc2021-input.qcow2' encryption=off cluster_size=65536 lazy_refcounts=off
Waiting for the VM to be ready (probing ssh)
............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-4028
Executing tool itstools
Input is MultiCrashLeafsetExtension-PT-S24C10, examination is LTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r292-tall-162124156900693
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 35M
-rw-r--r-- 1 mcc users 44K May 15 08:57 CTLCardinality.txt
-rw-r--r-- 1 mcc users 158K May 15 08:57 CTLCardinality.xml
-rw-r--r-- 1 mcc users 33K May 15 08:57 CTLFireability.txt
-rw-r--r-- 1 mcc users 105K May 15 08:57 CTLFireability.xml
-rw-r--r-- 1 mcc users 6.3K May 12 07:59 LTLCardinality.txt
-rw-r--r-- 1 mcc users 28K May 12 07:59 LTLCardinality.xml
-rw-r--r-- 1 mcc users 3.9K May 12 07:59 LTLFireability.txt
-rw-r--r-- 1 mcc users 17K May 12 07:59 LTLFireability.xml
-rw-r--r-- 1 mcc users 1 May 12 08:13 NewModel
-rw-r--r-- 1 mcc users 5.9K May 11 19:05 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 21K May 11 19:05 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 4.8K May 11 16:07 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 17K May 11 16:07 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 2.0K May 12 04:40 UpperBounds.txt
-rw-r--r-- 1 mcc users 4.0K May 12 04:40 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 12 08:13 equiv_col
-rw-r--r-- 1 mcc users 7 May 12 08:13 instance
-rw-r--r-- 1 mcc users 6 May 12 08:13 iscolored
-rw-r--r-- 1 mcc users 34M May 12 08:13 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-00
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-01
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-02
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-03
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-04
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-05
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-06
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-07
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-08
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-09
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-10
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-11
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-12
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-13
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-14
FORMULA_NAME MultiCrashLeafsetExtension-PT-S24C10-15

=== Now, execution of the tool begins

BK_START 1621367843197

Running Version 0
[2021-05-18 19:57:24] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, LTLFireability, -spotpath, /home/mcc/BenchKit/bin//..//ltlfilt, -z3path, /home/mcc/BenchKit/bin//..//z3/bin/z3, -yices2path, /home/mcc/BenchKit/bin//..//yices/bin/yices, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2021-05-18 19:57:24] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2021-05-18 19:57:25] [INFO ] Load time of PNML (sax parser for PT used): 968 ms
[2021-05-18 19:57:25] [INFO ] Transformed 17896 places.
[2021-05-18 19:57:25] [INFO ] Transformed 26071 transitions.
[2021-05-18 19:57:25] [INFO ] Parsed PT model containing 17896 places and 26071 transitions in 1122 ms.
Parsed 16 properties from file /home/mcc/execution/LTLFireability.xml in 15 ms.
Working with output stream class java.io.PrintStream
[2021-05-18 19:57:25] [INFO ] Initial state test concluded for 2 properties.
FORMULA MultiCrashLeafsetExtension-PT-S24C10-01 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Support contains 57 out of 17896 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17896/17896 places, 26071/26071 transitions.
Reduce places removed 48 places and 0 transitions.
Iterating post reduction 0 with 48 rules applied. Total rules applied 48 place count 17848 transition count 26071
Applied a total of 48 rules in 778 ms. Remains 17848 /17896 variables (removed 48) and now considering 26071/26071 (removed 0) transitions.
[2021-05-18 19:57:27] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 19:57:30] [INFO ] Computed 1197 place invariants in 3912 ms
[2021-05-18 19:57:32] [INFO ] Implicit Places using invariants in 5703 ms returned []
Implicit Place search using SMT only with invariants took 5728 ms to find 0 implicit places.
[2021-05-18 19:57:32] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 19:57:36] [INFO ] Computed 1197 place invariants in 3569 ms
[2021-05-18 19:57:37] [INFO ] Dead Transitions using invariants and state equation in 5166 ms returned []
Finished structural reductions, in 1 iterations. Remains : 17848/17896 places, 26071/26071 transitions.
[2021-05-18 19:57:39] [INFO ] Initial state reduction rules for LTL removed 3 formulas.
[2021-05-18 19:57:39] [INFO ] Flatten gal took : 1037 ms
FORMULA MultiCrashLeafsetExtension-PT-S24C10-14 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA MultiCrashLeafsetExtension-PT-S24C10-13 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA MultiCrashLeafsetExtension-PT-S24C10-09 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
[2021-05-18 19:57:40] [INFO ] Flatten gal took : 831 ms
[2021-05-18 19:57:41] [INFO ] Input system was already deterministic with 26071 transitions.
Incomplete random walk after 100000 steps, including 976 resets, run finished after 2532 ms. (steps per millisecond=39 ) properties (out of 27) seen :17
Running SMT prover for 10 properties.
[2021-05-18 19:57:44] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 19:57:47] [INFO ] Computed 1197 place invariants in 3497 ms
[2021-05-18 19:57:52] [INFO ] [Real]Absence check using 47 positive place invariants in 203 ms returned sat
[2021-05-18 19:57:52] [INFO ] [Real]Absence check using 47 positive and 1150 generalized place invariants in 606 ms returned sat
[2021-05-18 19:57:55] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-18 19:58:42] [INFO ] [Real]Absence check using state equation in 46957 ms returned unsat :0 sat :10 real:0
[2021-05-18 19:58:42] [INFO ] State equation strengthened by 8027 read => feed constraints.
[2021-05-18 19:58:42] [INFO ] [Real]Added 8027 Read/Feed constraints in 377 ms returned sat
Attempting to minimize the solution found.
Minimization took 8 ms.
[2021-05-18 19:59:27] [INFO ] SMT Verify possible in real domain returnedunsat :0 sat :5 real:0
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !(X((F(p0)&&F(p1)&&G((X(G(p3))||p2)))))], workingDir=/home/mcc/execution]
Support contains 6 out of 17848 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Applied a total of 0 rules in 729 ms. Remains 17848 /17848 variables (removed 0) and now considering 26071/26071 (removed 0) transitions.
[2021-05-18 19:59:28] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 19:59:32] [INFO ] Computed 1197 place invariants in 3582 ms
[2021-05-18 19:59:33] [INFO ] Implicit Places using invariants in 5140 ms returned []
Implicit Place search using SMT only with invariants took 5145 ms to find 0 implicit places.
[2021-05-18 19:59:33] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 19:59:37] [INFO ] Computed 1197 place invariants in 3584 ms
[2021-05-18 19:59:39] [INFO ] Dead Transitions using invariants and state equation in 5174 ms returned []
Finished structural reductions, in 1 iterations. Remains : 17848/17848 places, 26071/26071 transitions.
Stuttering acceptance computed with spot in 337 ms :[(OR (NOT p0) (NOT p1) (AND (NOT p2) (NOT p3))), (OR (NOT p0) (NOT p1) (AND (NOT p2) (NOT p3))), (NOT p0), (NOT p1), (NOT p3), (AND (NOT p2) (NOT p3)), true]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-00 automaton TGBA [mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=(NOT p0), acceptance={} source=1 dest: 2}, { cond=(NOT p1), acceptance={} source=1 dest: 3}, { cond=(NOT p2), acceptance={} source=1 dest: 4}, { cond=p2, acceptance={} source=1 dest: 5}], [{ cond=(NOT p0), acceptance={0} source=2 dest: 2}], [{ cond=(NOT p1), acceptance={0} source=3 dest: 3}], [{ cond=p3, acceptance={} source=4 dest: 4}, { cond=(NOT p3), acceptance={} source=4 dest: 6}], [{ cond=(NOT p2), acceptance={} source=5 dest: 4}, { cond=p2, acceptance={} source=5 dest: 5}], [{ cond=true, acceptance={0} source=6 dest: 6}]], initial=0, aps=[p0:(AND (GEQ s16100 1) (GEQ s16402 1)), p1:(OR (LT s17252 1) (LT s17585 1)), p2:(OR (LT s16100 1) (LT s16402 1)), p3:(AND (GEQ s3660 1) (GEQ s5907 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null, null, null, null][false, false, false, false, false, false, false]]
Stuttering criterion allowed to conclude after 207 steps with 1 reset in 19 ms.
FORMULA MultiCrashLeafsetExtension-PT-S24C10-00 FALSE TECHNIQUES STUTTER_TEST
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-00 finished in 11539 ms.
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !((G(p0)||(p1 U ((p2 U p3)||G(p1)))))], workingDir=/home/mcc/execution]
Support contains 7 out of 17848 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Drop transitions removed 5975 transitions
Trivial Post-agglo rules discarded 5975 transitions
Performed 5975 trivial Post agglomeration. Transition count delta: 5975
Iterating post reduction 0 with 5975 rules applied. Total rules applied 5975 place count 17848 transition count 20096
Reduce places removed 5975 places and 0 transitions.
Performed 24 Post agglomeration using F-continuation condition.Transition count delta: 24
Iterating post reduction 1 with 5999 rules applied. Total rules applied 11974 place count 11873 transition count 20072
Reduce places removed 24 places and 0 transitions.
Iterating post reduction 2 with 24 rules applied. Total rules applied 11998 place count 11849 transition count 20072
Performed 498 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 3 with 498 Pre rules applied. Total rules applied 11998 place count 11849 transition count 19574
Deduced a syphon composed of 498 places in 18 ms
Reduce places removed 498 places and 0 transitions.
Iterating global reduction 3 with 996 rules applied. Total rules applied 12994 place count 11351 transition count 19574
Discarding 5497 places :
Symmetric choice reduction at 3 with 5497 rule applications. Total rules 18491 place count 5854 transition count 14077
Iterating global reduction 3 with 5497 rules applied. Total rules applied 23988 place count 5854 transition count 14077
Performed 17 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 3 with 17 Pre rules applied. Total rules applied 23988 place count 5854 transition count 14060
Deduced a syphon composed of 17 places in 10 ms
Reduce places removed 17 places and 0 transitions.
Iterating global reduction 3 with 34 rules applied. Total rules applied 24022 place count 5837 transition count 14060
Discarding 547 places :
Symmetric choice reduction at 3 with 547 rule applications. Total rules 24569 place count 5290 transition count 8590
Iterating global reduction 3 with 547 rules applied. Total rules applied 25116 place count 5290 transition count 8590
Performed 25 Post agglomeration using F-continuation condition.Transition count delta: 25
Deduced a syphon composed of 25 places in 9 ms
Reduce places removed 25 places and 0 transitions.
Iterating global reduction 3 with 50 rules applied. Total rules applied 25166 place count 5265 transition count 8565
Applied a total of 25166 rules in 4351 ms. Remains 5265 /17848 variables (removed 12583) and now considering 8565/26071 (removed 17506) transitions.
[2021-05-18 19:59:43] [INFO ] Flow matrix only has 7965 transitions (discarded 600 similar events)
// Phase 1: matrix 7965 rows 5265 cols
[2021-05-18 19:59:44] [INFO ] Computed 1197 place invariants in 297 ms
[2021-05-18 19:59:48] [INFO ] Implicit Places using invariants in 4297 ms returned []
[2021-05-18 19:59:48] [INFO ] Flow matrix only has 7965 transitions (discarded 600 similar events)
// Phase 1: matrix 7965 rows 5265 cols
[2021-05-18 19:59:48] [INFO ] Computed 1197 place invariants in 290 ms
[2021-05-18 19:59:52] [INFO ] Implicit Places using invariants and state equation in 4097 ms returned []
Implicit Place search using SMT with State Equation took 8397 ms to find 0 implicit places.
[2021-05-18 19:59:53] [INFO ] Redundant transitions in 1073 ms returned []
[2021-05-18 19:59:53] [INFO ] Flow matrix only has 7965 transitions (discarded 600 similar events)
// Phase 1: matrix 7965 rows 5265 cols
[2021-05-18 19:59:53] [INFO ] Computed 1197 place invariants in 300 ms
[2021-05-18 19:59:58] [INFO ] Dead Transitions using invariants and state equation in 5090 ms returned []
Finished structural reductions, in 1 iterations. Remains : 5265/17848 places, 8565/26071 transitions.
Stuttering acceptance computed with spot in 146 ms :[true, (NOT p3), (AND (NOT p1) (NOT p3)), (AND (NOT p0) (NOT p1) (NOT p3)), (NOT p0), (AND (NOT p0) (NOT p3))]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-02 automaton TGBA [mat=[[{ cond=true, acceptance={0} source=0 dest: 0}], [{ cond=(AND (NOT p3) (NOT p2)), acceptance={0} source=1 dest: 0}, { cond=(AND (NOT p3) p2), acceptance={0} source=1 dest: 1}], [{ cond=(AND (NOT p3) (NOT p2) (NOT p1)), acceptance={} source=2 dest: 0}, { cond=(AND (NOT p3) p2 (NOT p1)), acceptance={} source=2 dest: 1}, { cond=(AND (NOT p3) p1), acceptance={} source=2 dest: 2}], [{ cond=(AND (NOT p0) (NOT p3) (NOT p2) (NOT p1)), acceptance={} source=3 dest: 0}, { cond=(AND (NOT p0) (NOT p3) p2 (NOT p1)), acceptance={} source=3 dest: 1}, { cond=(AND (NOT p0) (NOT p3) p1), acceptance={} source=3 dest: 2}, { cond=(AND p0 (NOT p3) p1), acceptance={} source=3 dest: 3}, { cond=(AND p0 (NOT p3) (NOT p2) (NOT p1)), acceptance={} source=3 dest: 4}, { cond=(AND p0 (NOT p3) p2 (NOT p1)), acceptance={} source=3 dest: 5}], [{ cond=(NOT p0), acceptance={} source=4 dest: 0}, { cond=p0, acceptance={} source=4 dest: 4}], [{ cond=(AND (NOT p0) (NOT p3) (NOT p2)), acceptance={} source=5 dest: 0}, { cond=(AND (NOT p0) (NOT p3) p2), acceptance={} source=5 dest: 1}, { cond=(AND p0 (NOT p3) (NOT p2)), acceptance={} source=5 dest: 4}, { cond=(AND p0 (NOT p3) p2), acceptance={} source=5 dest: 5}]], initial=3, aps=[p3:(AND (GEQ s640 1) (GEQ s662 1)), p2:(GEQ s2085 1), p1:(AND (GEQ s3319 1) (GEQ s3991 1)), p0:(OR (LT s2534 1) (LT s2601 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null, null, null][true, true, true, true, true, true]]
Entered a terminal (fully accepting) state of product in 670 steps with 8 reset in 14 ms.
FORMULA MultiCrashLeafsetExtension-PT-S24C10-02 FALSE TECHNIQUES STUTTER_TEST
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-02 finished in 19120 ms.
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !(G(F(p0)))], workingDir=/home/mcc/execution]
Support contains 3 out of 17848 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Drop transitions removed 6000 transitions
Trivial Post-agglo rules discarded 6000 transitions
Performed 6000 trivial Post agglomeration. Transition count delta: 6000
Iterating post reduction 0 with 6000 rules applied. Total rules applied 6000 place count 17848 transition count 20071
Reduce places removed 6000 places and 0 transitions.
Iterating post reduction 1 with 6000 rules applied. Total rules applied 12000 place count 11848 transition count 20071
Performed 500 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 2 with 500 Pre rules applied. Total rules applied 12000 place count 11848 transition count 19571
Deduced a syphon composed of 500 places in 18 ms
Reduce places removed 500 places and 0 transitions.
Iterating global reduction 2 with 1000 rules applied. Total rules applied 13000 place count 11348 transition count 19571
Discarding 5500 places :
Symmetric choice reduction at 2 with 5500 rule applications. Total rules 18500 place count 5848 transition count 14071
Iterating global reduction 2 with 5500 rules applied. Total rules applied 24000 place count 5848 transition count 14071
Performed 20 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 2 with 20 Pre rules applied. Total rules applied 24000 place count 5848 transition count 14051
Deduced a syphon composed of 20 places in 10 ms
Reduce places removed 20 places and 0 transitions.
Iterating global reduction 2 with 40 rules applied. Total rules applied 24040 place count 5828 transition count 14051
Discarding 550 places :
Symmetric choice reduction at 2 with 550 rule applications. Total rules 24590 place count 5278 transition count 8551
Iterating global reduction 2 with 550 rules applied. Total rules applied 25140 place count 5278 transition count 8551
Performed 24 Post agglomeration using F-continuation condition.Transition count delta: 24
Deduced a syphon composed of 24 places in 6 ms
Reduce places removed 24 places and 0 transitions.
Iterating global reduction 2 with 48 rules applied. Total rules applied 25188 place count 5254 transition count 8527
Applied a total of 25188 rules in 3200 ms. Remains 5254 /17848 variables (removed 12594) and now considering 8527/26071 (removed 17544) transitions.
[2021-05-18 20:00:01] [INFO ] Flow matrix only has 7927 transitions (discarded 600 similar events)
// Phase 1: matrix 7927 rows 5254 cols
[2021-05-18 20:00:02] [INFO ] Computed 1197 place invariants in 303 ms
[2021-05-18 20:00:05] [INFO ] Implicit Places using invariants in 4110 ms returned []
[2021-05-18 20:00:05] [INFO ] Flow matrix only has 7927 transitions (discarded 600 similar events)
// Phase 1: matrix 7927 rows 5254 cols
[2021-05-18 20:00:06] [INFO ] Computed 1197 place invariants in 304 ms
[2021-05-18 20:00:09] [INFO ] Implicit Places using invariants and state equation in 4047 ms returned []
Implicit Place search using SMT with State Equation took 8158 ms to find 0 implicit places.
[2021-05-18 20:00:10] [INFO ] Redundant transitions in 778 ms returned []
[2021-05-18 20:00:10] [INFO ] Flow matrix only has 7927 transitions (discarded 600 similar events)
// Phase 1: matrix 7927 rows 5254 cols
[2021-05-18 20:00:11] [INFO ] Computed 1197 place invariants in 298 ms
[2021-05-18 20:00:15] [INFO ] Dead Transitions using invariants and state equation in 5192 ms returned []
Finished structural reductions, in 1 iterations. Remains : 5254/17848 places, 8527/26071 transitions.
Stuttering acceptance computed with spot in 47 ms :[(NOT p0), (NOT p0)]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-03 automaton TGBA [mat=[[{ cond=true, acceptance={} source=0 dest: 0}, { cond=(NOT p0), acceptance={} source=0 dest: 1}], [{ cond=(NOT p0), acceptance={0} source=1 dest: 1}]], initial=0, aps=[p0:(AND (GEQ s680 1) (GEQ s683 1) (GEQ s1887 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-invariant, very-weak, weak, inherently-weak], stateDesc=[null, null][true, true]]
Stuttering criterion allowed to conclude after 70 steps with 0 reset in 3 ms.
FORMULA MultiCrashLeafsetExtension-PT-S24C10-03 FALSE TECHNIQUES STUTTER_TEST
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-03 finished in 17416 ms.
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !(X((F((X(p1)&&p0))||(X(p2) U (X(G(p2))&&p3)))))], workingDir=/home/mcc/execution]
Support contains 4 out of 17848 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Applied a total of 0 rules in 472 ms. Remains 17848 /17848 variables (removed 0) and now considering 26071/26071 (removed 0) transitions.
[2021-05-18 20:00:16] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:00:20] [INFO ] Computed 1197 place invariants in 3524 ms
[2021-05-18 20:00:21] [INFO ] Implicit Places using invariants in 5152 ms returned []
Implicit Place search using SMT only with invariants took 5153 ms to find 0 implicit places.
[2021-05-18 20:00:21] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:00:25] [INFO ] Computed 1197 place invariants in 3581 ms
[2021-05-18 20:00:26] [INFO ] Dead Transitions using invariants and state equation in 5138 ms returned []
Finished structural reductions, in 1 iterations. Remains : 17848/17848 places, 26071/26071 transitions.
Stuttering acceptance computed with spot in 235 ms :[(OR (AND (NOT p0) (NOT p3)) (AND (NOT p1) (NOT p3)) (AND (NOT p0) (NOT p2)) (AND (NOT p1) (NOT p2))), (OR (AND (NOT p0) (NOT p2)) (AND (NOT p0) (NOT p3)) (AND (NOT p1) (NOT p2)) (AND (NOT p1) (NOT p3))), (OR (AND (NOT p1) (NOT p2)) (AND (NOT p1) (NOT p3))), (OR (AND (NOT p1) (NOT p2)) (AND (NOT p0) (NOT p2))), (AND (NOT p1) (NOT p2)), (OR (AND (NOT p0) (NOT p3)) (AND (NOT p0) (NOT p2)) (AND (NOT p1) (NOT p3)) (AND (NOT p1) (NOT p2))), (OR (NOT p1) (NOT p0)), (NOT p1)]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-04 automaton TGBA [mat=[[{ cond=(AND (NOT p0) (NOT p3)), acceptance={} source=0 dest: 1}, { cond=(AND p0 (NOT p3)), acceptance={} source=0 dest: 2}, { cond=(AND (NOT p0) p3), acceptance={} source=0 dest: 3}, { cond=(AND p0 p3), acceptance={} source=0 dest: 4}], [{ cond=(AND (NOT p0) (NOT p3) p2), acceptance={0} source=1 dest: 1}, { cond=(AND p0 (NOT p3) p2), acceptance={0} source=1 dest: 2}, { cond=(AND (NOT p0) p3 p2), acceptance={0} source=1 dest: 3}, { cond=(AND p0 p3 p2), acceptance={0} source=1 dest: 4}, { cond=(AND (NOT p0) (NOT p2)), acceptance={0} source=1 dest: 6}, { cond=(AND p0 (NOT p2)), acceptance={0} source=1 dest: 7}], [{ cond=(AND (NOT p0) (NOT p3) (NOT p1) p2), acceptance={0} source=2 dest: 1}, { cond=(AND p0 (NOT p3) (NOT p1) p2), acceptance={0} source=2 dest: 2}, { cond=(AND (NOT p0) p3 (NOT p1) p2), acceptance={0} source=2 dest: 3}, { cond=(AND p0 p3 (NOT p1) p2), acceptance={0} source=2 dest: 4}, { cond=(AND (NOT p0) (NOT p1) (NOT p2)), acceptance={0} source=2 dest: 6}, { cond=(AND p0 (NOT p1) (NOT p2)), acceptance={0} source=2 dest: 7}], [{ cond=(AND (NOT p0) p2), acceptance={} source=3 dest: 3}, { cond=(AND p0 p2), acceptance={} source=3 dest: 4}, { cond=(AND (NOT p0) (NOT p2)), acceptance={} source=3 dest: 6}, { cond=(AND p0 (NOT p2)), acceptance={} source=3 dest: 7}], [{ cond=(AND (NOT p0) (NOT p1) p2), acceptance={} source=4 dest: 3}, { cond=(AND p0 (NOT p1) p2), acceptance={} source=4 dest: 4}, { cond=(AND (NOT p0) (NOT p1) (NOT p2)), acceptance={} source=4 dest: 6}, { cond=(AND p0 (NOT p1) (NOT p2)), acceptance={} source=4 dest: 7}], [{ cond=true, acceptance={} source=5 dest: 0}], [{ cond=(NOT p0), acceptance={0} source=6 dest: 6}, { cond=p0, acceptance={0} source=6 dest: 7}], [{ cond=(AND (NOT p0) (NOT p1)), acceptance={0} source=7 dest: 6}, { cond=(AND p0 (NOT p1)), acceptance={0} source=7 dest: 7}]], initial=5, aps=[p0:(AND (GEQ s806 1) (GEQ s831 1)), p3:(AND (GEQ s806 1) (GEQ s831 1)), p2:(AND (GEQ s806 1) (GEQ s831 1)), p1:(AND (GEQ s16769 1) (GEQ s17259 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, weak, inherently-weak], stateDesc=[null, null, null, null, null, null, null, null][false, false, false, false, false, false, false, false]]
Stuttering criterion allowed to conclude after 104 steps with 0 reset in 3 ms.
FORMULA MultiCrashLeafsetExtension-PT-S24C10-04 FALSE TECHNIQUES STUTTER_TEST
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-04 finished in 11084 ms.
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !(F(G((p0 U p1))))], workingDir=/home/mcc/execution]
Support contains 4 out of 17848 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Drop transitions removed 5976 transitions
Trivial Post-agglo rules discarded 5976 transitions
Performed 5976 trivial Post agglomeration. Transition count delta: 5976
Iterating post reduction 0 with 5976 rules applied. Total rules applied 5976 place count 17848 transition count 20095
Reduce places removed 5976 places and 0 transitions.
Performed 24 Post agglomeration using F-continuation condition.Transition count delta: 24
Iterating post reduction 1 with 6000 rules applied. Total rules applied 11976 place count 11872 transition count 20071
Reduce places removed 24 places and 0 transitions.
Iterating post reduction 2 with 24 rules applied. Total rules applied 12000 place count 11848 transition count 20071
Performed 498 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 3 with 498 Pre rules applied. Total rules applied 12000 place count 11848 transition count 19573
Deduced a syphon composed of 498 places in 18 ms
Reduce places removed 498 places and 0 transitions.
Iterating global reduction 3 with 996 rules applied. Total rules applied 12996 place count 11350 transition count 19573
Discarding 5498 places :
Symmetric choice reduction at 3 with 5498 rule applications. Total rules 18494 place count 5852 transition count 14075
Iterating global reduction 3 with 5498 rules applied. Total rules applied 23992 place count 5852 transition count 14075
Performed 18 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 3 with 18 Pre rules applied. Total rules applied 23992 place count 5852 transition count 14057
Deduced a syphon composed of 18 places in 10 ms
Reduce places removed 18 places and 0 transitions.
Iterating global reduction 3 with 36 rules applied. Total rules applied 24028 place count 5834 transition count 14057
Discarding 548 places :
Symmetric choice reduction at 3 with 548 rule applications. Total rules 24576 place count 5286 transition count 8577
Iterating global reduction 3 with 548 rules applied. Total rules applied 25124 place count 5286 transition count 8577
Performed 25 Post agglomeration using F-continuation condition.Transition count delta: 25
Deduced a syphon composed of 25 places in 5 ms
Reduce places removed 25 places and 0 transitions.
Iterating global reduction 3 with 50 rules applied. Total rules applied 25174 place count 5261 transition count 8552
Applied a total of 25174 rules in 2999 ms. Remains 5261 /17848 variables (removed 12587) and now considering 8552/26071 (removed 17519) transitions.
[2021-05-18 20:00:30] [INFO ] Flow matrix only has 7952 transitions (discarded 600 similar events)
// Phase 1: matrix 7952 rows 5261 cols
[2021-05-18 20:00:30] [INFO ] Computed 1197 place invariants in 295 ms
[2021-05-18 20:00:34] [INFO ] Implicit Places using invariants in 4667 ms returned []
[2021-05-18 20:00:34] [INFO ] Flow matrix only has 7952 transitions (discarded 600 similar events)
// Phase 1: matrix 7952 rows 5261 cols
[2021-05-18 20:00:35] [INFO ] Computed 1197 place invariants in 297 ms
[2021-05-18 20:00:39] [INFO ] Implicit Places using invariants and state equation in 4634 ms returned []
Implicit Place search using SMT with State Equation took 9304 ms to find 0 implicit places.
[2021-05-18 20:00:40] [INFO ] Redundant transitions in 1034 ms returned []
[2021-05-18 20:00:40] [INFO ] Flow matrix only has 7952 transitions (discarded 600 similar events)
// Phase 1: matrix 7952 rows 5261 cols
[2021-05-18 20:00:40] [INFO ] Computed 1197 place invariants in 294 ms
[2021-05-18 20:00:45] [INFO ] Dead Transitions using invariants and state equation in 5296 ms returned []
Finished structural reductions, in 1 iterations. Remains : 5261/17848 places, 8552/26071 transitions.
Stuttering acceptance computed with spot in 52 ms :[(NOT p1), (NOT p1)]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-05 automaton TGBA [mat=[[{ cond=(AND (NOT p1) (NOT p0)), acceptance={0} source=0 dest: 0}, { cond=(OR p1 p0), acceptance={} source=0 dest: 0}, { cond=(AND (NOT p1) p0), acceptance={0} source=0 dest: 1}], [{ cond=(AND (NOT p1) (NOT p0)), acceptance={0} source=1 dest: 0}, { cond=(AND (NOT p1) p0), acceptance={0} source=1 dest: 1}]], initial=0, aps=[p1:(AND (GEQ s325 1) (GEQ s359 1)), p0:(AND (GEQ s1933 1) (GEQ s2005 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-invariant], stateDesc=[null, null][true, true]]
Stuttering criterion allowed to conclude after 70 steps with 0 reset in 2 ms.
FORMULA MultiCrashLeafsetExtension-PT-S24C10-05 FALSE TECHNIQUES STUTTER_TEST
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-05 finished in 18725 ms.
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !((G(p0)&&X(G(p1))))], workingDir=/home/mcc/execution]
Support contains 4 out of 17848 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Applied a total of 0 rules in 420 ms. Remains 17848 /17848 variables (removed 0) and now considering 26071/26071 (removed 0) transitions.
[2021-05-18 20:00:46] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:00:49] [INFO ] Computed 1197 place invariants in 3455 ms
[2021-05-18 20:00:51] [INFO ] Implicit Places using invariants in 5070 ms returned []
Implicit Place search using SMT only with invariants took 5072 ms to find 0 implicit places.
[2021-05-18 20:00:51] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:00:54] [INFO ] Computed 1197 place invariants in 3655 ms
[2021-05-18 20:00:56] [INFO ] Dead Transitions using invariants and state equation in 5270 ms returned []
Finished structural reductions, in 1 iterations. Remains : 17848/17848 places, 26071/26071 transitions.
Stuttering acceptance computed with spot in 60 ms :[(OR (NOT p1) (NOT p0)), (OR (NOT p0) (NOT p1)), true]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-06 automaton TGBA [mat=[[{ cond=p0, acceptance={} source=0 dest: 1}, { cond=(NOT p0), acceptance={} source=0 dest: 2}], [{ cond=(AND p0 p1), acceptance={} source=1 dest: 1}, { cond=(OR (NOT p0) (NOT p1)), acceptance={} source=1 dest: 2}], [{ cond=true, acceptance={0} source=2 dest: 2}]], initial=0, aps=[p0:(OR (LT s13468 1) (LT s17341 1)), p1:(AND (GEQ s12875 1) (GEQ s13360 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, terminal, very-weak, weak, inherently-weak], stateDesc=[null, null, null][false, false, false]]
Entered a terminal (fully accepting) state of product in 1 steps with 0 reset in 2 ms.
FORMULA MultiCrashLeafsetExtension-PT-S24C10-06 FALSE TECHNIQUES STUTTER_TEST
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-06 finished in 10915 ms.
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !(F(G(p0)))], workingDir=/home/mcc/execution]
Support contains 1 out of 17848 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Drop transitions removed 5999 transitions
Trivial Post-agglo rules discarded 5999 transitions
Performed 5999 trivial Post agglomeration. Transition count delta: 5999
Iterating post reduction 0 with 5999 rules applied. Total rules applied 5999 place count 17848 transition count 20072
Reduce places removed 5999 places and 0 transitions.
Iterating post reduction 1 with 5999 rules applied. Total rules applied 11998 place count 11849 transition count 20072
Performed 500 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 2 with 500 Pre rules applied. Total rules applied 11998 place count 11849 transition count 19572
Deduced a syphon composed of 500 places in 22 ms
Reduce places removed 500 places and 0 transitions.
Iterating global reduction 2 with 1000 rules applied. Total rules applied 12998 place count 11349 transition count 19572
Discarding 5499 places :
Symmetric choice reduction at 2 with 5499 rule applications. Total rules 18497 place count 5850 transition count 14073
Iterating global reduction 2 with 5499 rules applied. Total rules applied 23996 place count 5850 transition count 14073
Performed 19 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 2 with 19 Pre rules applied. Total rules applied 23996 place count 5850 transition count 14054
Deduced a syphon composed of 19 places in 11 ms
Reduce places removed 19 places and 0 transitions.
Iterating global reduction 2 with 38 rules applied. Total rules applied 24034 place count 5831 transition count 14054
Discarding 549 places :
Symmetric choice reduction at 2 with 549 rule applications. Total rules 24583 place count 5282 transition count 8564
Iterating global reduction 2 with 549 rules applied. Total rules applied 25132 place count 5282 transition count 8564
Performed 25 Post agglomeration using F-continuation condition.Transition count delta: 25
Deduced a syphon composed of 25 places in 6 ms
Reduce places removed 25 places and 0 transitions.
Iterating global reduction 2 with 50 rules applied. Total rules applied 25182 place count 5257 transition count 8539
Applied a total of 25182 rules in 2896 ms. Remains 5257 /17848 variables (removed 12591) and now considering 8539/26071 (removed 17532) transitions.
[2021-05-18 20:00:59] [INFO ] Flow matrix only has 7939 transitions (discarded 600 similar events)
// Phase 1: matrix 7939 rows 5257 cols
[2021-05-18 20:00:59] [INFO ] Computed 1197 place invariants in 297 ms
[2021-05-18 20:01:03] [INFO ] Implicit Places using invariants in 4012 ms returned []
[2021-05-18 20:01:03] [INFO ] Flow matrix only has 7939 transitions (discarded 600 similar events)
// Phase 1: matrix 7939 rows 5257 cols
[2021-05-18 20:01:03] [INFO ] Computed 1197 place invariants in 301 ms
[2021-05-18 20:01:07] [INFO ] Implicit Places using invariants and state equation in 4232 ms returned []
Implicit Place search using SMT with State Equation took 8245 ms to find 0 implicit places.
[2021-05-18 20:01:09] [INFO ] Redundant transitions in 1245 ms returned []
[2021-05-18 20:01:09] [INFO ] Flow matrix only has 7939 transitions (discarded 600 similar events)
// Phase 1: matrix 7939 rows 5257 cols
[2021-05-18 20:01:09] [INFO ] Computed 1197 place invariants in 318 ms
[2021-05-18 20:01:14] [INFO ] Dead Transitions using invariants and state equation in 5144 ms returned []
Finished structural reductions, in 1 iterations. Remains : 5257/17848 places, 8539/26071 transitions.
Stuttering acceptance computed with spot in 24 ms :[(NOT p0)]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-07 automaton TGBA [mat=[[{ cond=(NOT p0), acceptance={0} source=0 dest: 0}, { cond=p0, acceptance={} source=0 dest: 0}]], initial=0, aps=[p0:(GEQ s2084 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant], stateDesc=[null][true]]
Stuttering criterion allowed to conclude after 75 steps with 0 reset in 2 ms.
FORMULA MultiCrashLeafsetExtension-PT-S24C10-07 FALSE TECHNIQUES STUTTER_TEST
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-07 finished in 17590 ms.
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !(X((p0 U (G(p0)||p1))))], workingDir=/home/mcc/execution]
Support contains 3 out of 17848 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Applied a total of 0 rules in 412 ms. Remains 17848 /17848 variables (removed 0) and now considering 26071/26071 (removed 0) transitions.
[2021-05-18 20:01:14] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:01:18] [INFO ] Computed 1197 place invariants in 3656 ms
[2021-05-18 20:01:19] [INFO ] Implicit Places using invariants in 5267 ms returned []
Implicit Place search using SMT only with invariants took 5268 ms to find 0 implicit places.
[2021-05-18 20:01:20] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:01:23] [INFO ] Computed 1197 place invariants in 3840 ms
[2021-05-18 20:01:25] [INFO ] Dead Transitions using invariants and state equation in 5422 ms returned []
Finished structural reductions, in 1 iterations. Remains : 17848/17848 places, 26071/26071 transitions.
Stuttering acceptance computed with spot in 58 ms :[true, (AND (NOT p1) (NOT p0)), (AND (NOT p1) (NOT p0))]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-08 automaton TGBA [mat=[[{ cond=true, acceptance={0} source=0 dest: 0}], [{ cond=true, acceptance={} source=1 dest: 2}], [{ cond=(AND (NOT p1) (NOT p0)), acceptance={} source=2 dest: 0}, { cond=(AND (NOT p1) p0), acceptance={} source=2 dest: 2}]], initial=1, aps=[p1:(OR (LT s4607 1) (LT s14328 1)), p0:(LT s4060 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, terminal, very-weak, weak, inherently-weak], stateDesc=[null, null, null][false, false, false]]
Product exploration timeout after 78140 steps with 39070 reset in 10001 ms.
Product exploration timeout after 81630 steps with 40815 reset in 10001 ms.
Knowledge obtained : [p1, p0]
Stuttering acceptance computed with spot in 54 ms :[true, (AND (NOT p1) (NOT p0)), (AND (NOT p1) (NOT p0))]
Product exploration timeout after 82680 steps with 41340 reset in 10002 ms.
Product exploration timeout after 83350 steps with 41675 reset in 10001 ms.
Applying partial POR strategy [true, false, true]
Stuttering acceptance computed with spot in 56 ms :[true, (AND (NOT p1) (NOT p0)), (AND (NOT p1) (NOT p0))]
Support contains 3 out of 17848 places. Attempting structural reductions.
Property had overlarge support with respect to TGBA, discarding it for now.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Performed 5999 Post agglomeration using F-continuation condition.Transition count delta: 0
Iterating post reduction 0 with 5999 rules applied. Total rules applied 5999 place count 17848 transition count 26071
Performed 500 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 1 with 500 Pre rules applied. Total rules applied 5999 place count 17848 transition count 31571
Deduced a syphon composed of 6499 places in 39 ms
Iterating global reduction 1 with 500 rules applied. Total rules applied 6499 place count 17848 transition count 31571
Discarding 11478 places :
Symmetric choice reduction at 1 with 11478 rule applications. Total rules 17977 place count 6370 transition count 14594
Deduced a syphon composed of 520 places in 11 ms
Iterating global reduction 1 with 11478 rules applied. Total rules applied 29455 place count 6370 transition count 14594
Discarding 549 places :
Symmetric choice reduction at 1 with 549 rule applications. Total rules 30004 place count 5821 transition count 9104
Deduced a syphon composed of 520 places in 6 ms
Iterating global reduction 1 with 549 rules applied. Total rules applied 30553 place count 5821 transition count 9104
Performed 25 Post agglomeration using F-continuation condition.Transition count delta: 0
Deduced a syphon composed of 545 places in 7 ms
Iterating global reduction 1 with 25 rules applied. Total rules applied 30578 place count 5821 transition count 9104
Deduced a syphon composed of 545 places in 6 ms
Applied a total of 30578 rules in 7407 ms. Remains 5821 /17848 variables (removed 12027) and now considering 9104/26071 (removed 16967) transitions.
[2021-05-18 20:02:14] [INFO ] Redundant transitions in 1175 ms returned []
[2021-05-18 20:02:14] [INFO ] Flow matrix only has 8504 transitions (discarded 600 similar events)
// Phase 1: matrix 8504 rows 5821 cols
[2021-05-18 20:02:14] [INFO ] Computed 1197 place invariants in 374 ms
[2021-05-18 20:02:20] [INFO ] Dead Transitions using invariants and state equation in 5749 ms returned []
Finished structural reductions, in 1 iterations. Remains : 5821/17848 places, 9104/26071 transitions.
Product exploration timeout after 19100 steps with 9550 reset in 10005 ms.
Product exploration timeout after 19330 steps with 9665 reset in 10003 ms.
[2021-05-18 20:02:41] [INFO ] Flatten gal took : 778 ms
[2021-05-18 20:02:42] [INFO ] Flatten gal took : 801 ms
[2021-05-18 20:02:42] [INFO ] Time to serialize gal into /tmp/LTL1298717866041734870.gal : 188 ms
[2021-05-18 20:02:42] [INFO ] Time to serialize properties into /tmp/LTL9690166768883404547.ltl : 1 ms
Invoking ITS tools like this :CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64, --gc-threshold, 2000000, -i, /tmp/LTL1298717866041734870.gal, -t, CGAL, -LTL, /tmp/LTL9690166768883404547.ltl, -c, -stutter-deadlock, --gen-order, FOLLOW], workingDir=/home/mcc/execution]

its-ltl command run as :

/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64 --gc-threshold 2000000 -i /tmp/LTL1298717866041734870.gal -t CGAL -LTL /tmp/LTL9690166768883404547.ltl -c -stutter-deadlock --gen-order FOLLOW
Read 1 LTL properties
Checking formula 0 : !((X(("(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)")U(("((Node6NotifyThatHeIsActive<1)||(Node21ThinksNode6ShouldBeNodeMasterToReplaceNode9<1))")||(G("(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)"))))))
Formula 0 simplified : !X("(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)" U ("((Node6NotifyThatHeIsActive<1)||(Node21ThinksNode6ShouldBeNodeMasterToReplaceNode9<1))" | G"(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)"))
Detected timeout of ITS tools.
[2021-05-18 20:02:58] [INFO ] Flatten gal took : 769 ms
[2021-05-18 20:02:58] [INFO ] Applying decomposition
[2021-05-18 20:02:59] [INFO ] Flatten gal took : 842 ms
Converted graph to binary with : CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.louvain.binaries_1.0.0.202104292328/bin/convert-linux64, -i, /tmp/graph14483952437667285041.txt, -o, /tmp/graph14483952437667285041.bin, -w, /tmp/graph14483952437667285041.weights], workingDir=null]
Built communities with : CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.louvain.binaries_1.0.0.202104292328/bin/louvain-linux64, /tmp/graph14483952437667285041.bin, -l, -1, -v, -w, /tmp/graph14483952437667285041.weights, -q, 0, -e, 0.001], workingDir=null]
[2021-05-18 20:03:01] [INFO ] Decomposing Gal with order
[2021-05-18 20:03:02] [INFO ] Rewriting arrays to variables to allow decomposition.
[2021-05-18 20:03:08] [INFO ] Removed a total of 16632 redundant transitions.
[2021-05-18 20:03:09] [INFO ] Flatten gal took : 3970 ms
[2021-05-18 20:03:10] [INFO ] Fuse similar labels procedure discarded/fused a total of 2469 labels/synchronizations in 671 ms.
[2021-05-18 20:03:10] [INFO ] Time to serialize gal into /tmp/LTL6141653057143255734.gal : 132 ms
[2021-05-18 20:03:10] [INFO ] Time to serialize properties into /tmp/LTL17466258375331005603.ltl : 1 ms
Invoking ITS tools like this :CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64, --gc-threshold, 2000000, -i, /tmp/LTL6141653057143255734.gal, -t, CGAL, -LTL, /tmp/LTL17466258375331005603.ltl, -c, -stutter-deadlock], workingDir=/home/mcc/execution]

its-ltl command run as :

/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64 --gc-threshold 2000000 -i /tmp/LTL6141653057143255734.gal -t CGAL -LTL /tmp/LTL17466258375331005603.ltl -c -stutter-deadlock
Read 1 LTL properties
Checking formula 0 : !((X(("(i7.u393.Node5HasTheLeafSetOfLx6ToReplaceNode6<1)")U(("((i2.u154.Node6NotifyThatHeIsActive<1)||(i2.u277.Node21ThinksNode6ShouldBeNodeMasterToReplaceNode9<1))")||(G("(i7.u393.Node5HasTheLeafSetOfLx6ToReplaceNode6<1)"))))))
Formula 0 simplified : !X("(i7.u393.Node5HasTheLeafSetOfLx6ToReplaceNode6<1)" U ("((i2.u154.Node6NotifyThatHeIsActive<1)||(i2.u277.Node21ThinksNode6ShouldBeNodeMasterToReplaceNode9<1))" | G"(i7.u393.Node5HasTheLeafSetOfLx6ToReplaceNode6<1)"))
Detected timeout of ITS tools.
Built C files in :
/tmp/ltsmin14475838773971378136
[2021-05-18 20:03:25] [INFO ] Built C files in 299ms conformant to PINS (ltsmin variant)in folder :/tmp/ltsmin14475838773971378136
Running compilation step : CommandLine [args=[gcc, -c, -I/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.ltsmin.binaries_1.0.0.202104292328/bin/include/, -I., -std=c99, -fPIC, -O2, model.c], workingDir=/tmp/ltsmin14475838773971378136]
WARNING : LTS min runner thread failed on error :java.lang.RuntimeException: Compilation or link of executable timed out.java.util.concurrent.TimeoutException: Subprocess running CommandLine [args=[gcc, -c, -I/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.ltsmin.binaries_1.0.0.202104292328/bin/include/, -I., -std=c99, -fPIC, -O2, model.c], workingDir=/tmp/ltsmin14475838773971378136] killed by timeout after 1 SECONDS
java.lang.RuntimeException: Compilation or link of executable timed out.java.util.concurrent.TimeoutException: Subprocess running CommandLine [args=[gcc, -c, -I/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.ltsmin.binaries_1.0.0.202104292328/bin/include/, -I., -std=c99, -fPIC, -O2, model.c], workingDir=/tmp/ltsmin14475838773971378136] killed by timeout after 1 SECONDS
at fr.lip6.move.gal.application.LTSminRunner$1.run(LTSminRunner.java:79)
at java.base/java.lang.Thread.run(Thread.java:834)
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-08 finished in 132560 ms.
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !(X(X(F((F(G(p0))&&(p1||X(p2)))))))], workingDir=/home/mcc/execution]
Support contains 5 out of 17848 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Applied a total of 0 rules in 536 ms. Remains 17848 /17848 variables (removed 0) and now considering 26071/26071 (removed 0) transitions.
[2021-05-18 20:03:27] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:03:31] [INFO ] Computed 1197 place invariants in 3656 ms
[2021-05-18 20:03:32] [INFO ] Implicit Places using invariants in 5356 ms returned []
Implicit Place search using SMT only with invariants took 5357 ms to find 0 implicit places.
[2021-05-18 20:03:32] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:03:36] [INFO ] Computed 1197 place invariants in 3517 ms
[2021-05-18 20:03:38] [INFO ] Dead Transitions using invariants and state equation in 5247 ms returned []
Finished structural reductions, in 1 iterations. Remains : 17848/17848 places, 26071/26071 transitions.
Stuttering acceptance computed with spot in 133 ms :[(OR (NOT p0) (AND (NOT p1) (NOT p2))), (OR (NOT p0) (AND (NOT p1) (NOT p2))), (OR (NOT p0) (AND (NOT p1) (NOT p2))), (NOT p0), (AND (NOT p1) (NOT p2))]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-10 automaton TGBA [mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=true, acceptance={} source=1 dest: 2}], [{ cond=true, acceptance={} source=2 dest: 3}, { cond=(NOT p1), acceptance={} source=2 dest: 4}], [{ cond=(NOT p0), acceptance={0} source=3 dest: 3}, { cond=p0, acceptance={} source=3 dest: 3}], [{ cond=(AND (NOT p1) (NOT p2)), acceptance={0} source=4 dest: 4}]], initial=0, aps=[p1:(AND (GEQ s12715 1) (GEQ s17368 1)), p0:(AND (GEQ s3211 1) (GEQ s14298 1)), p2:(GEQ s17727 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch], stateDesc=[null, null, null, null, null][false, false, false, false, false]]
Stuttering criterion allowed to conclude after 104 steps with 0 reset in 3 ms.
FORMULA MultiCrashLeafsetExtension-PT-S24C10-10 FALSE TECHNIQUES STUTTER_TEST
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-10 finished in 11356 ms.
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !(X(X(F(p0))))], workingDir=/home/mcc/execution]
Support contains 2 out of 17848 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Applied a total of 0 rules in 417 ms. Remains 17848 /17848 variables (removed 0) and now considering 26071/26071 (removed 0) transitions.
[2021-05-18 20:03:38] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:03:42] [INFO ] Computed 1197 place invariants in 3567 ms
[2021-05-18 20:03:43] [INFO ] Implicit Places using invariants in 5172 ms returned []
Implicit Place search using SMT only with invariants took 5172 ms to find 0 implicit places.
[2021-05-18 20:03:43] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:03:47] [INFO ] Computed 1197 place invariants in 3652 ms
[2021-05-18 20:03:49] [INFO ] Dead Transitions using invariants and state equation in 5277 ms returned []
Finished structural reductions, in 1 iterations. Remains : 17848/17848 places, 26071/26071 transitions.
Stuttering acceptance computed with spot in 81 ms :[(NOT p0), (NOT p0), (NOT p0)]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-11 automaton TGBA [mat=[[{ cond=(NOT p0), acceptance={0} source=0 dest: 0}], [{ cond=true, acceptance={} source=1 dest: 0}], [{ cond=true, acceptance={} source=2 dest: 1}]], initial=2, aps=[p0:(AND (GEQ s12243 1) (GEQ s17395 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, very-weak, weak, inherently-weak], stateDesc=[null, null, null][false, false, false]]
Stuttering criterion allowed to conclude after 100 steps with 0 reset in 3 ms.
FORMULA MultiCrashLeafsetExtension-PT-S24C10-11 FALSE TECHNIQUES STUTTER_TEST
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-11 finished in 11016 ms.
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !(X(X(F(p0))))], workingDir=/home/mcc/execution]
Support contains 1 out of 17848 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Applied a total of 0 rules in 402 ms. Remains 17848 /17848 variables (removed 0) and now considering 26071/26071 (removed 0) transitions.
[2021-05-18 20:03:49] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:03:53] [INFO ] Computed 1197 place invariants in 3555 ms
[2021-05-18 20:03:54] [INFO ] Implicit Places using invariants in 5138 ms returned []
Implicit Place search using SMT only with invariants took 5139 ms to find 0 implicit places.
[2021-05-18 20:03:54] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:03:58] [INFO ] Computed 1197 place invariants in 3545 ms
[2021-05-18 20:03:59] [INFO ] Dead Transitions using invariants and state equation in 5095 ms returned []
Finished structural reductions, in 1 iterations. Remains : 17848/17848 places, 26071/26071 transitions.
Stuttering acceptance computed with spot in 69 ms :[(NOT p0), (NOT p0), (NOT p0)]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-12 automaton TGBA [mat=[[{ cond=(NOT p0), acceptance={0} source=0 dest: 0}], [{ cond=true, acceptance={} source=1 dest: 0}], [{ cond=true, acceptance={} source=2 dest: 1}]], initial=2, aps=[p0:(LT s2013 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, very-weak, weak, inherently-weak], stateDesc=[null, null, null][false, false, false]]
Product exploration explored 100000 steps with 33333 reset in 9011 ms.
Product exploration explored 100000 steps with 33333 reset in 9019 ms.
Knowledge obtained : [p0]
Stuttering acceptance computed with spot in 69 ms :[(NOT p0), (NOT p0), (NOT p0)]
Product exploration explored 100000 steps with 33333 reset in 9013 ms.
Product exploration explored 100000 steps with 33333 reset in 8900 ms.
Applying partial POR strategy [true, false, false]
Stuttering acceptance computed with spot in 77 ms :[(NOT p0), (NOT p0), (NOT p0)]
Support contains 1 out of 17848 places. Attempting structural reductions.
Property had overlarge support with respect to TGBA, discarding it for now.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Performed 5999 Post agglomeration using F-continuation condition.Transition count delta: 0
Iterating post reduction 0 with 5999 rules applied. Total rules applied 5999 place count 17848 transition count 26071
Performed 500 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 1 with 500 Pre rules applied. Total rules applied 5999 place count 17848 transition count 31571
Deduced a syphon composed of 6499 places in 34 ms
Iterating global reduction 1 with 500 rules applied. Total rules applied 6499 place count 17848 transition count 31571
Discarding 11478 places :
Symmetric choice reduction at 1 with 11478 rule applications. Total rules 17977 place count 6370 transition count 14594
Deduced a syphon composed of 520 places in 11 ms
Iterating global reduction 1 with 11478 rules applied. Total rules applied 29455 place count 6370 transition count 14594
Discarding 549 places :
Symmetric choice reduction at 1 with 549 rule applications. Total rules 30004 place count 5821 transition count 9104
Deduced a syphon composed of 520 places in 6 ms
Iterating global reduction 1 with 549 rules applied. Total rules applied 30553 place count 5821 transition count 9104
Performed 25 Post agglomeration using F-continuation condition.Transition count delta: 0
Deduced a syphon composed of 545 places in 7 ms
Iterating global reduction 1 with 25 rules applied. Total rules applied 30578 place count 5821 transition count 9104
Deduced a syphon composed of 545 places in 6 ms
Applied a total of 30578 rules in 5427 ms. Remains 5821 /17848 variables (removed 12027) and now considering 9104/26071 (removed 16967) transitions.
[2021-05-18 20:04:42] [INFO ] Redundant transitions in 1131 ms returned []
[2021-05-18 20:04:42] [INFO ] Flow matrix only has 8504 transitions (discarded 600 similar events)
// Phase 1: matrix 8504 rows 5821 cols
[2021-05-18 20:04:43] [INFO ] Computed 1197 place invariants in 372 ms
[2021-05-18 20:04:48] [INFO ] Dead Transitions using invariants and state equation in 5722 ms returned []
Finished structural reductions, in 1 iterations. Remains : 5821/17848 places, 9104/26071 transitions.
Product exploration timeout after 27870 steps with 9290 reset in 10001 ms.
Product exploration timeout after 27900 steps with 9300 reset in 10003 ms.
[2021-05-18 20:05:09] [INFO ] Flatten gal took : 857 ms
[2021-05-18 20:05:10] [INFO ] Flatten gal took : 774 ms
[2021-05-18 20:05:10] [INFO ] Time to serialize gal into /tmp/LTL10460968424767718559.gal : 78 ms
[2021-05-18 20:05:10] [INFO ] Time to serialize properties into /tmp/LTL8171330804025004676.ltl : 0 ms
Invoking ITS tools like this :CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64, --gc-threshold, 2000000, -i, /tmp/LTL10460968424767718559.gal, -t, CGAL, -LTL, /tmp/LTL8171330804025004676.ltl, -c, -stutter-deadlock, --gen-order, FOLLOW], workingDir=/home/mcc/execution]

its-ltl command run as :

/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64 --gc-threshold 2000000 -i /tmp/LTL10460968424767718559.gal -t CGAL -LTL /tmp/LTL8171330804025004676.ltl -c -stutter-deadlock --gen-order FOLLOW
Read 1 LTL properties
Checking formula 0 : !((X(X(F("(Node2HasTheLeafSetOfLx3ToReplaceNode11<1)")))))
Formula 0 simplified : !XXF"(Node2HasTheLeafSetOfLx3ToReplaceNode11<1)"
Detected timeout of ITS tools.
[2021-05-18 20:05:26] [INFO ] Flatten gal took : 769 ms
[2021-05-18 20:05:26] [INFO ] Applying decomposition
[2021-05-18 20:05:27] [INFO ] Flatten gal took : 805 ms
Converted graph to binary with : CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.louvain.binaries_1.0.0.202104292328/bin/convert-linux64, -i, /tmp/graph8630394343685230823.txt, -o, /tmp/graph8630394343685230823.bin, -w, /tmp/graph8630394343685230823.weights], workingDir=null]
Built communities with : CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.louvain.binaries_1.0.0.202104292328/bin/louvain-linux64, /tmp/graph8630394343685230823.bin, -l, -1, -v, -w, /tmp/graph8630394343685230823.weights, -q, 0, -e, 0.001], workingDir=null]
[2021-05-18 20:05:29] [INFO ] Decomposing Gal with order
[2021-05-18 20:05:30] [INFO ] Rewriting arrays to variables to allow decomposition.
[2021-05-18 20:05:36] [INFO ] Removed a total of 16747 redundant transitions.
[2021-05-18 20:05:36] [INFO ] Flatten gal took : 3608 ms
[2021-05-18 20:05:37] [INFO ] Fuse similar labels procedure discarded/fused a total of 1453 labels/synchronizations in 389 ms.
[2021-05-18 20:05:37] [INFO ] Time to serialize gal into /tmp/LTL8288326155298469333.gal : 100 ms
[2021-05-18 20:05:37] [INFO ] Time to serialize properties into /tmp/LTL10773185237479390435.ltl : 1 ms
Invoking ITS tools like this :CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64, --gc-threshold, 2000000, -i, /tmp/LTL8288326155298469333.gal, -t, CGAL, -LTL, /tmp/LTL10773185237479390435.ltl, -c, -stutter-deadlock], workingDir=/home/mcc/execution]

its-ltl command run as :

/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64 --gc-threshold 2000000 -i /tmp/LTL8288326155298469333.gal -t CGAL -LTL /tmp/LTL10773185237479390435.ltl -c -stutter-deadlock
Read 1 LTL properties
Checking formula 0 : !((X(X(F("(i4.u418.Node2HasTheLeafSetOfLx3ToReplaceNode11<1)")))))
Formula 0 simplified : !XXF"(i4.u418.Node2HasTheLeafSetOfLx3ToReplaceNode11<1)"
Detected timeout of ITS tools.
Built C files in :
/tmp/ltsmin1879136285345534678
[2021-05-18 20:05:53] [INFO ] Built C files in 217ms conformant to PINS (ltsmin variant)in folder :/tmp/ltsmin1879136285345534678
Running compilation step : CommandLine [args=[gcc, -c, -I/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.ltsmin.binaries_1.0.0.202104292328/bin/include/, -I., -std=c99, -fPIC, -O2, model.c], workingDir=/tmp/ltsmin1879136285345534678]
WARNING : LTS min runner thread failed on error :java.lang.RuntimeException: Compilation or link of executable timed out.java.util.concurrent.TimeoutException: Subprocess running CommandLine [args=[gcc, -c, -I/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.ltsmin.binaries_1.0.0.202104292328/bin/include/, -I., -std=c99, -fPIC, -O2, model.c], workingDir=/tmp/ltsmin1879136285345534678] killed by timeout after 1 SECONDS
java.lang.RuntimeException: Compilation or link of executable timed out.java.util.concurrent.TimeoutException: Subprocess running CommandLine [args=[gcc, -c, -I/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.ltsmin.binaries_1.0.0.202104292328/bin/include/, -I., -std=c99, -fPIC, -O2, model.c], workingDir=/tmp/ltsmin1879136285345534678] killed by timeout after 1 SECONDS
at fr.lip6.move.gal.application.LTSminRunner$1.run(LTSminRunner.java:79)
at java.base/java.lang.Thread.run(Thread.java:834)
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-12 finished in 124804 ms.
Running Spot : CommandLine [args=[/home/mcc/BenchKit/bin//..//ltl2tgba, --hoaf=tv, -f, !(G((X(F(p0))||(p0&&X(G(p1))))))], workingDir=/home/mcc/execution]
Support contains 1 out of 17848 places. Attempting structural reductions.
Property had overlarge support with respect to TGBA, discarding it for now.
Starting structural reductions, iteration 0 : 17848/17848 places, 26071/26071 transitions.
Applied a total of 0 rules in 410 ms. Remains 17848 /17848 variables (removed 0) and now considering 26071/26071 (removed 0) transitions.
[2021-05-18 20:05:54] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:05:58] [INFO ] Computed 1197 place invariants in 3704 ms
[2021-05-18 20:05:59] [INFO ] Implicit Places using invariants in 5317 ms returned []
Implicit Place search using SMT only with invariants took 5318 ms to find 0 implicit places.
[2021-05-18 20:05:59] [INFO ] Flow matrix only has 25471 transitions (discarded 600 similar events)
// Phase 1: matrix 25471 rows 17848 cols
[2021-05-18 20:06:03] [INFO ] Computed 1197 place invariants in 3632 ms
[2021-05-18 20:06:05] [INFO ] Dead Transitions using invariants and state equation in 5295 ms returned []
Finished structural reductions, in 1 iterations. Remains : 17848/17848 places, 26071/26071 transitions.
Stuttering acceptance computed with spot in 48 ms :[(NOT p0), (NOT p0)]
Running random walk in product with property : MultiCrashLeafsetExtension-PT-S24C10-15 automaton TGBA [mat=[[{ cond=true, acceptance={} source=0 dest: 0}, { cond=(NOT p0), acceptance={} source=0 dest: 1}], [{ cond=(NOT p0), acceptance={0} source=1 dest: 1}]], initial=0, aps=[p0:(GEQ s7047 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, very-weak, weak, inherently-weak], stateDesc=[null, null][false, false]]
Stuttering criterion allowed to conclude after 100 steps with 0 reset in 3 ms.
FORMULA MultiCrashLeafsetExtension-PT-S24C10-15 FALSE TECHNIQUES STUTTER_TEST
Treatment of property MultiCrashLeafsetExtension-PT-S24C10-15 finished in 11154 ms.
Using solver Z3 to compute partial order matrices.
Built C files in :
/tmp/ltsmin4326085985426563210
[2021-05-18 20:06:05] [INFO ] Too many transitions (26071) to apply POR reductions. Disabling POR matrices.
[2021-05-18 20:06:06] [INFO ] Built C files in 494ms conformant to PINS (ltsmin variant)in folder :/tmp/ltsmin4326085985426563210
Running compilation step : CommandLine [args=[gcc, -c, -I/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.ltsmin.binaries_1.0.0.202104292328/bin/include/, -I., -std=c99, -fPIC, -O2, model.c], workingDir=/tmp/ltsmin4326085985426563210]
[2021-05-18 20:06:06] [INFO ] Applying decomposition
[2021-05-18 20:06:07] [INFO ] Flatten gal took : 912 ms
Converted graph to binary with : CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.louvain.binaries_1.0.0.202104292328/bin/convert-linux64, -i, /tmp/graph12649776521067760699.txt, -o, /tmp/graph12649776521067760699.bin, -w, /tmp/graph12649776521067760699.weights], workingDir=null]
Built communities with : CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.louvain.binaries_1.0.0.202104292328/bin/louvain-linux64, /tmp/graph12649776521067760699.bin, -l, -1, -v, -w, /tmp/graph12649776521067760699.weights, -q, 0, -e, 0.001], workingDir=null]
[2021-05-18 20:06:09] [INFO ] Decomposing Gal with order
[2021-05-18 20:06:10] [INFO ] Rewriting arrays to variables to allow decomposition.
[2021-05-18 20:06:17] [INFO ] Removed a total of 16579 redundant transitions.
[2021-05-18 20:06:17] [INFO ] Flatten gal took : 3881 ms
[2021-05-18 20:06:18] [INFO ] Fuse similar labels procedure discarded/fused a total of 1622 labels/synchronizations in 481 ms.
[2021-05-18 20:06:18] [INFO ] Time to serialize gal into /tmp/LTLFireability5250786970777419995.gal : 130 ms
[2021-05-18 20:06:18] [INFO ] Time to serialize properties into /tmp/LTLFireability14240266700265753216.ltl : 1 ms
Invoking ITS tools like this :CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64, --gc-threshold, 2000000, -i, /tmp/LTLFireability5250786970777419995.gal, -t, CGAL, -LTL, /tmp/LTLFireability14240266700265753216.ltl, -c, -stutter-deadlock], workingDir=/home/mcc/execution]

its-ltl command run as :

/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64 --gc-threshold 2000000 -i /tmp/LTLFireability5250786970777419995.gal -t CGAL -LTL /tmp/LTLFireability14240266700265753216.ltl -c -stutter-deadlock
Read 2 LTL properties
Checking formula 0 : !((X(("(i13.u376.Node5HasTheLeafSetOfLx6ToReplaceNode6<1)")U((!("((i1.u146.Node6NotifyThatHeIsActive>=1)&&(i1.u266.Node21ThinksNode6ShouldBeNodeMasterToReplaceNode9>=1))"))||(G("(i13.u376.Node5HasTheLeafSetOfLx6ToReplaceNode6<1)"))))))
Formula 0 simplified : !X("(i13.u376.Node5HasTheLeafSetOfLx6ToReplaceNode6<1)" U (!"((i1.u146.Node6NotifyThatHeIsActive>=1)&&(i1.u266.Node21ThinksNode6ShouldBeNodeMasterToReplaceNode9>=1))" | G"(i13.u376.Node5HasTheLeafSetOfLx6ToReplaceNode6<1)"))
WARNING : LTS min runner thread failed on error :java.lang.RuntimeException: Compilation or link of executable timed out.java.util.concurrent.TimeoutException: Subprocess running CommandLine [args=[gcc, -c, -I/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.ltsmin.binaries_1.0.0.202104292328/bin/include/, -I., -std=c99, -fPIC, -O2, model.c], workingDir=/tmp/ltsmin4326085985426563210] killed by timeout after 30 SECONDS
java.lang.RuntimeException: Compilation or link of executable timed out.java.util.concurrent.TimeoutException: Subprocess running CommandLine [args=[gcc, -c, -I/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.ltsmin.binaries_1.0.0.202104292328/bin/include/, -I., -std=c99, -fPIC, -O2, model.c], workingDir=/tmp/ltsmin4326085985426563210] killed by timeout after 30 SECONDS
at fr.lip6.move.gal.application.LTSminRunner$1.run(LTSminRunner.java:79)
at java.base/java.lang.Thread.run(Thread.java:834)
ITS-tools command line returned an error code 137
[2021-05-18 20:17:02] [INFO ] Flatten gal took : 3259 ms
[2021-05-18 20:17:02] [INFO ] Time to serialize gal into /tmp/LTLFireability11351515372598615386.gal : 172 ms
[2021-05-18 20:17:02] [INFO ] Time to serialize properties into /tmp/LTLFireability12319208984103822959.ltl : 7 ms
Invoking ITS tools like this :CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64, --gc-threshold, 2000000, -i, /tmp/LTLFireability11351515372598615386.gal, -t, CGAL, -LTL, /tmp/LTLFireability12319208984103822959.ltl, -c, -stutter-deadlock, --gen-order, FOLLOW], workingDir=/home/mcc/execution]

its-ltl command run as :

/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64 --gc-threshold 2000000 -i /tmp/LTLFireability11351515372598615386.gal -t CGAL -LTL /tmp/LTLFireability12319208984103822959.ltl -c -stutter-deadlock --gen-order FOLLOW
Read 2 LTL properties
Checking formula 0 : !((X(("(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)")U((!("((Node6NotifyThatHeIsActive>=1)&&(Node21ThinksNode6ShouldBeNodeMasterToReplaceNode9>=1))"))||(G("(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)"))))))
Formula 0 simplified : !X("(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)" U (!"((Node6NotifyThatHeIsActive>=1)&&(Node21ThinksNode6ShouldBeNodeMasterToReplaceNode9>=1))" | G"(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)"))
Detected timeout of ITS tools.
[2021-05-18 20:40:03] [INFO ] Flatten gal took : 2434 ms
[2021-05-18 20:40:04] [INFO ] Input system was already deterministic with 26071 transitions.
[2021-05-18 20:40:04] [INFO ] Transformed 17848 places.
[2021-05-18 20:40:05] [INFO ] Transformed 26071 transitions.
Running greatSPN : CommandLine [args=[/home/mcc/BenchKit/bin//..//greatspn//bin/pinvar, /home/mcc/execution/gspn], workingDir=/home/mcc/execution]
P-invariant computation with GreatSPN timed out. Skipping.
Running greatSPN : CommandLine [args=[/home/mcc/BenchKit/bin//..//greatspn//bin/RGMEDD2, /home/mcc/execution/gspn, -META, -varord-only], workingDir=/home/mcc/execution]
Run of greatSPN captured in /home/mcc/execution/outPut.txt
Using order generated by GreatSPN with heuristic : META
[2021-05-18 20:40:40] [INFO ] Time to serialize gal into /tmp/LTLFireability18237500084853483118.gal : 152 ms
[2021-05-18 20:40:40] [INFO ] Time to serialize properties into /tmp/LTLFireability9651202933928255843.ltl : 1 ms
Invoking ITS tools like this :CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64, --gc-threshold, 2000000, -i, /tmp/LTLFireability18237500084853483118.gal, -t, CGAL, -LTL, /tmp/LTLFireability9651202933928255843.ltl, -c, -stutter-deadlock, --load-order, /home/mcc/execution/model.ord, --gen-order, FOLLOW], workingDir=/home/mcc/execution]

its-ltl command run as :

/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-ltl-linux64 --gc-threshold 2000000 -i /tmp/LTLFireability18237500084853483118.gal -t CGAL -LTL /tmp/LTLFireability9651202933928255843.ltl -c -stutter-deadlock --load-order /home/mcc/execution/model.ord --gen-order FOLLOW
Read 2 LTL properties
Successfully loaded order from file /home/mcc/execution/model.ord
Checking formula 0 : !((X(("(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)")U((!("((Node6NotifyThatHeIsActive>=1)&&(Node21ThinksNode6ShouldBeNodeMasterToReplaceNode9>=1))"))||(G("(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)"))))))
Formula 0 simplified : !X("(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)" U (!"((Node6NotifyThatHeIsActive>=1)&&(Node21ThinksNode6ShouldBeNodeMasterToReplaceNode9>=1))" | G"(Node5HasTheLeafSetOfLx6ToReplaceNode6<1)"))

BK_TIME_CONFINEMENT_REACHED

--------------------
content from stderr:

+ export BINDIR=/home/mcc/BenchKit/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ LTLFireability = StateSpace ]]
+ /home/mcc/BenchKit/bin//..//runeclipse.sh /home/mcc/execution LTLFireability -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
++ cut -d . -f 9
++ ls /home/mcc/BenchKit/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202104292328.jar
+ VERSION=0
+ echo 'Running Version 0'
+ /home/mcc/BenchKit/bin//..//itstools/its-tools -data /home/mcc/execution/workspace -pnfolder /home/mcc/execution -examination LTLFireability -spotpath /home/mcc/BenchKit/bin//..//ltlfilt -z3path /home/mcc/BenchKit/bin//..//z3/bin/z3 -yices2path /home/mcc/BenchKit/bin//..//yices/bin/yices -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600 -vmargs -Dosgi.locking=none -Declipse.stateSaveDelayInterval=-1 -Dosgi.configuration.area=/tmp/.eclipse -Xss128m -Xms40m -Xmx16000m

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="MultiCrashLeafsetExtension-PT-S24C10"
export BK_EXAMINATION="LTLFireability"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool itstools"
echo " Input is MultiCrashLeafsetExtension-PT-S24C10, examination is LTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r292-tall-162124156900693"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/MultiCrashLeafsetExtension-PT-S24C10.tgz
mv MultiCrashLeafsetExtension-PT-S24C10 execution
cd execution
if [ "LTLFireability" = "ReachabilityDeadlock" ] || [ "LTLFireability" = "UpperBounds" ] || [ "LTLFireability" = "QuasiLiveness" ] || [ "LTLFireability" = "StableMarking" ] || [ "LTLFireability" = "Liveness" ] || [ "LTLFireability" = "OneSafe" ] || [ "LTLFireability" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "LTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "LTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "LTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property LTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "LTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' LTLFireability.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "LTLFireability" = "ReachabilityDeadlock" ] || [ "LTLFireability" = "QuasiLiveness" ] || [ "LTLFireability" = "StableMarking" ] || [ "LTLFireability" = "Liveness" ] || [ "LTLFireability" = "OneSafe" ] ; then
echo "FORMULA_NAME LTLFireability"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;