fond
Model Checking Contest 2023
13th edition, Paris, France, April 26, 2023 (at TOOLympics II)
Execution of r137-smll-167819418400428
Last Updated
May 14, 2023

About the Execution of LTSMin+red for DiscoveryGPU-PT-15a

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
274.680 12672.00 22471.00 370.90 FFFFFFFFFFFFFFFF normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/data/fkordon/mcc2023-input.r137-smll-167819418400428.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fkordon/mcc2023-input.qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-5348
Executing tool ltsminxred
Input is DiscoveryGPU-PT-15a, examination is LTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r137-smll-167819418400428
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 564K
-rw-r--r-- 1 mcc users 7.1K Feb 25 13:45 CTLCardinality.txt
-rw-r--r-- 1 mcc users 78K Feb 25 13:45 CTLCardinality.xml
-rw-r--r-- 1 mcc users 5.5K Feb 25 13:41 CTLFireability.txt
-rw-r--r-- 1 mcc users 49K Feb 25 13:41 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K Jan 29 11:40 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.6K Jan 29 11:40 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 3.6K Feb 25 16:00 LTLCardinality.txt
-rw-r--r-- 1 mcc users 24K Feb 25 16:00 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.3K Feb 25 16:00 LTLFireability.txt
-rw-r--r-- 1 mcc users 18K Feb 25 16:00 LTLFireability.xml
-rw-r--r-- 1 mcc users 15K Feb 25 13:46 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 162K Feb 25 13:46 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 8.9K Feb 25 13:46 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 79K Feb 25 13:46 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.7K Feb 25 16:00 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K Feb 25 16:00 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 Mar 5 18:22 equiv_col
-rw-r--r-- 1 mcc users 4 Mar 5 18:22 instance
-rw-r--r-- 1 mcc users 6 Mar 5 18:22 iscolored
-rw-r--r-- 1 mcc users 53K Mar 5 18:22 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-00
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-01
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-02
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-03
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-04
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-05
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-06
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-07
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-08
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-09
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-10
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-11
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-12
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-13
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-14
FORMULA_NAME DiscoveryGPU-PT-15a-LTLFireability-15

=== Now, execution of the tool begins

BK_START 1678845371080

bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
Invoking MCC driver with
BK_TOOL=ltsminxred
BK_EXAMINATION=LTLFireability
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=DiscoveryGPU-PT-15a
Applying reductions before tool ltsmin
Invoking reducer
Running Version 202303021504
[2023-03-15 01:56:13] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, LTLFireability, -timeout, 360, -rebuildPNML]
[2023-03-15 01:56:13] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2023-03-15 01:56:13] [INFO ] Load time of PNML (sax parser for PT used): 247 ms
[2023-03-15 01:56:13] [INFO ] Transformed 153 places.
[2023-03-15 01:56:13] [INFO ] Transformed 211 transitions.
[2023-03-15 01:56:13] [INFO ] Found NUPN structural information;
[2023-03-15 01:56:13] [INFO ] Parsed PT model containing 153 places and 211 transitions and 678 arcs in 380 ms.
Parsed 16 properties from file /home/mcc/execution/LTLFireability.xml in 11 ms.
Working with output stream class java.io.PrintStream
Initial state reduction rules removed 3 formulas.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-11 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA DiscoveryGPU-PT-15a-LTLFireability-12 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA DiscoveryGPU-PT-15a-LTLFireability-14 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Support contains 36 out of 153 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 153/153 places, 211/211 transitions.
Discarding 11 places :
Symmetric choice reduction at 0 with 11 rule applications. Total rules 11 place count 142 transition count 200
Iterating global reduction 0 with 11 rules applied. Total rules applied 22 place count 142 transition count 200
Discarding 10 places :
Symmetric choice reduction at 0 with 10 rule applications. Total rules 32 place count 132 transition count 190
Iterating global reduction 0 with 10 rules applied. Total rules applied 42 place count 132 transition count 190
Discarding 8 places :
Symmetric choice reduction at 0 with 8 rule applications. Total rules 50 place count 124 transition count 174
Iterating global reduction 0 with 8 rules applied. Total rules applied 58 place count 124 transition count 174
Drop transitions removed 7 transitions
Redundant transition composition rules discarded 7 transitions
Iterating global reduction 0 with 7 rules applied. Total rules applied 65 place count 124 transition count 167
Applied a total of 65 rules in 48 ms. Remains 124 /153 variables (removed 29) and now considering 167/211 (removed 44) transitions.
// Phase 1: matrix 167 rows 124 cols
[2023-03-15 01:56:14] [INFO ] Computed 2 place invariants in 13 ms
[2023-03-15 01:56:14] [INFO ] Implicit Places using invariants in 268 ms returned []
[2023-03-15 01:56:14] [INFO ] Invariant cache hit.
[2023-03-15 01:56:14] [INFO ] State equation strengthened by 110 read => feed constraints.
[2023-03-15 01:56:14] [INFO ] Implicit Places using invariants and state equation in 256 ms returned []
Implicit Place search using SMT with State Equation took 564 ms to find 0 implicit places.
[2023-03-15 01:56:14] [INFO ] Invariant cache hit.
[2023-03-15 01:56:14] [INFO ] Dead Transitions using invariants and state equation in 225 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 124/153 places, 167/211 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 838 ms. Remains : 124/153 places, 167/211 transitions.
Support contains 36 out of 124 places after structural reductions.
[2023-03-15 01:56:15] [INFO ] Flatten gal took : 50 ms
[2023-03-15 01:56:15] [INFO ] Flatten gal took : 22 ms
[2023-03-15 01:56:15] [INFO ] Input system was already deterministic with 167 transitions.
Support contains 32 out of 124 places (down from 36) after GAL structural reductions.
Finished random walk after 1279 steps, including 8 resets, run visited all 34 properties in 149 ms. (steps per millisecond=8 )
FORMULA DiscoveryGPU-PT-15a-LTLFireability-10 FALSE TECHNIQUES REACHABILITY_KNOWLEDGE
Computed a total of 18 stabilizing places and 16 stable transitions
Graph (complete) has 377 edges and 124 vertex of which 120 are kept as prefixes of interest. Removing 4 places using SCC suffix rule.5 ms
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!((X((((F(p0) U p1)&&X(p1)) U p2)) U p3))'
Support contains 6 out of 124 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Discarding 6 places :
Symmetric choice reduction at 0 with 6 rule applications. Total rules 6 place count 118 transition count 161
Iterating global reduction 0 with 6 rules applied. Total rules applied 12 place count 118 transition count 161
Discarding 4 places :
Symmetric choice reduction at 0 with 4 rule applications. Total rules 16 place count 114 transition count 157
Iterating global reduction 0 with 4 rules applied. Total rules applied 20 place count 114 transition count 157
Discarding 3 places :
Symmetric choice reduction at 0 with 3 rule applications. Total rules 23 place count 111 transition count 154
Iterating global reduction 0 with 3 rules applied. Total rules applied 26 place count 111 transition count 154
Applied a total of 26 rules in 25 ms. Remains 111 /124 variables (removed 13) and now considering 154/167 (removed 13) transitions.
// Phase 1: matrix 154 rows 111 cols
[2023-03-15 01:56:15] [INFO ] Computed 2 place invariants in 3 ms
[2023-03-15 01:56:16] [INFO ] Implicit Places using invariants in 93 ms returned []
[2023-03-15 01:56:16] [INFO ] Invariant cache hit.
[2023-03-15 01:56:16] [INFO ] State equation strengthened by 106 read => feed constraints.
[2023-03-15 01:56:16] [INFO ] Implicit Places using invariants and state equation in 179 ms returned []
Implicit Place search using SMT with State Equation took 276 ms to find 0 implicit places.
[2023-03-15 01:56:16] [INFO ] Invariant cache hit.
[2023-03-15 01:56:16] [INFO ] Dead Transitions using invariants and state equation in 125 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 111/124 places, 154/167 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 431 ms. Remains : 111/124 places, 154/167 transitions.
Stuttering acceptance computed with spot in 429 ms :[(NOT p3), (OR (NOT p3) (NOT p2)), (NOT p0), (NOT p1), (NOT p2), true]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-00 automaton TGBA Formula[mat=[[{ cond=(NOT p3), acceptance={} source=0 dest: 1}], [{ cond=(NOT p3), acceptance={} source=1 dest: 1}, { cond=(AND (NOT p2) (NOT p1) (NOT p0)), acceptance={} source=1 dest: 2}, { cond=(NOT p2), acceptance={} source=1 dest: 3}, { cond=(AND p3 (NOT p2)), acceptance={} source=1 dest: 4}], [{ cond=(NOT p0), acceptance={} source=2 dest: 2}], [{ cond=(NOT p1), acceptance={} source=3 dest: 5}], [{ cond=(AND (NOT p2) (NOT p1) (NOT p0)), acceptance={} source=4 dest: 2}, { cond=(NOT p2), acceptance={} source=4 dest: 3}, { cond=(NOT p2), acceptance={} source=4 dest: 4}], [{ cond=true, acceptance={} source=5 dest: 5}]], initial=0, aps=[p3:(AND (EQ s86 1) (EQ s109 1)), p2:(AND (EQ s52 1) (EQ s109 1) (NOT (AND (EQ s25 1) (EQ s110 1)))), p1:(AND (EQ s25 1) (EQ s110 1)), p0:(AND (EQ s106 1) ...], nbAcceptance=0, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null, null, null][false, false, false, false, false, false]]
Entered a terminal (fully accepting) state of product in 5 steps with 0 reset in 2 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-00 FALSE TECHNIQUES STUTTER_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-00 finished in 944 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!((p0 U X((G(p1)&&F(G(p2))))))'
Support contains 4 out of 124 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Discarding 6 places :
Symmetric choice reduction at 0 with 6 rule applications. Total rules 6 place count 118 transition count 161
Iterating global reduction 0 with 6 rules applied. Total rules applied 12 place count 118 transition count 161
Discarding 4 places :
Symmetric choice reduction at 0 with 4 rule applications. Total rules 16 place count 114 transition count 157
Iterating global reduction 0 with 4 rules applied. Total rules applied 20 place count 114 transition count 157
Discarding 2 places :
Symmetric choice reduction at 0 with 2 rule applications. Total rules 22 place count 112 transition count 155
Iterating global reduction 0 with 2 rules applied. Total rules applied 24 place count 112 transition count 155
Applied a total of 24 rules in 13 ms. Remains 112 /124 variables (removed 12) and now considering 155/167 (removed 12) transitions.
// Phase 1: matrix 155 rows 112 cols
[2023-03-15 01:56:16] [INFO ] Computed 2 place invariants in 3 ms
[2023-03-15 01:56:16] [INFO ] Implicit Places using invariants in 94 ms returned []
[2023-03-15 01:56:16] [INFO ] Invariant cache hit.
[2023-03-15 01:56:17] [INFO ] State equation strengthened by 106 read => feed constraints.
[2023-03-15 01:56:17] [INFO ] Implicit Places using invariants and state equation in 197 ms returned [111]
Discarding 1 places :
Implicit Place search using SMT with State Equation took 294 ms to find 1 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 111/124 places, 155/167 transitions.
Applied a total of 0 rules in 3 ms. Remains 111 /111 variables (removed 0) and now considering 155/155 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 310 ms. Remains : 111/124 places, 155/167 transitions.
Stuttering acceptance computed with spot in 197 ms :[(OR (NOT p1) (NOT p2)), (OR (NOT p1) (NOT p2)), (OR (NOT p2) (NOT p1)), true, (NOT p2)]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-01 automaton TGBA Formula[mat=[[{ cond=(NOT p0), acceptance={} source=0 dest: 1}, { cond=p0, acceptance={} source=0 dest: 2}], [{ cond=p1, acceptance={} source=1 dest: 1}, { cond=(NOT p1), acceptance={} source=1 dest: 3}, { cond=(AND p1 (NOT p2)), acceptance={} source=1 dest: 4}], [{ cond=(NOT p0), acceptance={} source=2 dest: 1}, { cond=(AND p0 p1), acceptance={} source=2 dest: 2}, { cond=(AND p0 (NOT p1)), acceptance={0} source=2 dest: 2}, { cond=(OR (AND p0 p1) (AND p1 (NOT p2))), acceptance={} source=2 dest: 4}], [{ cond=true, acceptance={0} source=3 dest: 3}], [{ cond=p2, acceptance={} source=4 dest: 4}, { cond=(NOT p2), acceptance={0} source=4 dest: 4}]], initial=0, aps=[p0:(EQ s95 1), p1:(AND (EQ s14 1) (EQ s110 1)), p2:(NEQ s96 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, complete, no-univ-branch, stutter-sensitive], stateDesc=[null, null, null, null, null][false, false, false, false, false]]
Entered a terminal (fully accepting) state of product in 1 steps with 0 reset in 0 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-01 FALSE TECHNIQUES STUTTER_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-01 finished in 528 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!((G(p0)||G(p1)||F((G(p2)||G(p3)))))'
Support contains 4 out of 124 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Graph (complete) has 377 edges and 124 vertex of which 120 are kept as prefixes of interest. Removing 4 places using SCC suffix rule.2 ms
Discarding 4 places :
Also discarding 4 output transitions
Drop transitions removed 4 transitions
Performed 5 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 0 with 5 Pre rules applied. Total rules applied 1 place count 120 transition count 158
Deduced a syphon composed of 5 places in 1 ms
Reduce places removed 5 places and 0 transitions.
Iterating global reduction 0 with 10 rules applied. Total rules applied 11 place count 115 transition count 158
Discarding 6 places :
Symmetric choice reduction at 0 with 6 rule applications. Total rules 17 place count 109 transition count 152
Iterating global reduction 0 with 6 rules applied. Total rules applied 23 place count 109 transition count 152
Applied a total of 23 rules in 30 ms. Remains 109 /124 variables (removed 15) and now considering 152/167 (removed 15) transitions.
// Phase 1: matrix 152 rows 109 cols
[2023-03-15 01:56:17] [INFO ] Computed 2 place invariants in 8 ms
[2023-03-15 01:56:17] [INFO ] Implicit Places using invariants in 76 ms returned []
[2023-03-15 01:56:17] [INFO ] Invariant cache hit.
[2023-03-15 01:56:17] [INFO ] State equation strengthened by 106 read => feed constraints.
[2023-03-15 01:56:17] [INFO ] Implicit Places using invariants and state equation in 231 ms returned [108]
Discarding 1 places :
Implicit Place search using SMT with State Equation took 318 ms to find 1 implicit places.
Starting structural reductions in SI_LTL mode, iteration 1 : 108/124 places, 152/167 transitions.
Performed 29 Post agglomeration using F-continuation condition.Transition count delta: 29
Deduced a syphon composed of 29 places in 0 ms
Reduce places removed 29 places and 0 transitions.
Iterating global reduction 0 with 58 rules applied. Total rules applied 58 place count 79 transition count 123
Discarding 14 places :
Symmetric choice reduction at 0 with 14 rule applications. Total rules 72 place count 65 transition count 95
Iterating global reduction 0 with 14 rules applied. Total rules applied 86 place count 65 transition count 95
Discarding 12 places :
Symmetric choice reduction at 0 with 12 rule applications. Total rules 98 place count 53 transition count 71
Iterating global reduction 0 with 12 rules applied. Total rules applied 110 place count 53 transition count 71
Discarding 11 places :
Symmetric choice reduction at 0 with 11 rule applications. Total rules 121 place count 42 transition count 60
Iterating global reduction 0 with 11 rules applied. Total rules applied 132 place count 42 transition count 60
Discarding 11 places :
Symmetric choice reduction at 0 with 11 rule applications. Total rules 143 place count 31 transition count 38
Iterating global reduction 0 with 11 rules applied. Total rules applied 154 place count 31 transition count 38
Discarding 11 places :
Symmetric choice reduction at 0 with 11 rule applications. Total rules 165 place count 20 transition count 27
Iterating global reduction 0 with 11 rules applied. Total rules applied 176 place count 20 transition count 27
Partial Post-agglomeration rule applied 1 times.
Drop transitions removed 1 transitions
Iterating global reduction 0 with 1 rules applied. Total rules applied 177 place count 20 transition count 27
Applied a total of 177 rules in 21 ms. Remains 20 /108 variables (removed 88) and now considering 27/152 (removed 125) transitions.
[2023-03-15 01:56:17] [INFO ] Flow matrix only has 23 transitions (discarded 4 similar events)
// Phase 1: matrix 23 rows 20 cols
[2023-03-15 01:56:17] [INFO ] Computed 1 place invariants in 0 ms
[2023-03-15 01:56:17] [INFO ] Implicit Places using invariants in 30 ms returned []
[2023-03-15 01:56:17] [INFO ] Flow matrix only has 23 transitions (discarded 4 similar events)
[2023-03-15 01:56:17] [INFO ] Invariant cache hit.
[2023-03-15 01:56:17] [INFO ] State equation strengthened by 18 read => feed constraints.
[2023-03-15 01:56:17] [INFO ] Implicit Places using invariants and state equation in 40 ms returned []
Implicit Place search using SMT with State Equation took 71 ms to find 0 implicit places.
Starting structural reductions in SI_LTL mode, iteration 2 : 20/124 places, 27/167 transitions.
Finished structural reductions in SI_LTL mode , in 2 iterations and 442 ms. Remains : 20/124 places, 27/167 transitions.
Stuttering acceptance computed with spot in 184 ms :[(AND (NOT p0) (NOT p1) (NOT p2) (NOT p3)), (AND (NOT p2) (NOT p3)), (AND (NOT p2) (NOT p3) (NOT p1)), (AND (NOT p2) (NOT p3) (NOT p0))]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-02 automaton TGBA Formula[mat=[[{ cond=(AND p0 p1), acceptance={} source=0 dest: 0}, { cond=(AND (NOT p0) (NOT p1)), acceptance={} source=0 dest: 1}, { cond=(AND (NOT p0) p1), acceptance={} source=0 dest: 2}, { cond=(AND p0 (NOT p1)), acceptance={} source=0 dest: 3}], [{ cond=(AND p2 p3), acceptance={} source=1 dest: 1}, { cond=(AND (NOT p2) p3), acceptance={0} source=1 dest: 1}, { cond=(AND p2 (NOT p3)), acceptance={1} source=1 dest: 1}, { cond=(AND (NOT p2) (NOT p3)), acceptance={0, 1} source=1 dest: 1}], [{ cond=(NOT p1), acceptance={} source=2 dest: 1}, { cond=p1, acceptance={} source=2 dest: 2}], [{ cond=(NOT p0), acceptance={} source=3 dest: 1}, { cond=p0, acceptance={} source=3 dest: 3}]], initial=0, aps=[p0:(OR (EQ s11 0) (EQ s19 0)), p1:(OR (EQ s15 0) (EQ s19 0)), p2:(AND (EQ s15 1) (EQ s19 1)), p3:(OR (EQ s7 1) (AND (EQ s15 1) (EQ s19 1)))], nbAcceptance=2, properties=[trans-labels, explicit-labels, trans-acc, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant], stateDesc=[null, null, null, null][true, true, true, true]]
Stuttering criterion allowed to conclude after 30 steps with 0 reset in 1 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-02 FALSE TECHNIQUES STUTTER_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-02 finished in 646 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(F(G(p0)))'
Support contains 1 out of 124 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Graph (complete) has 377 edges and 124 vertex of which 121 are kept as prefixes of interest. Removing 3 places using SCC suffix rule.1 ms
Discarding 3 places :
Also discarding 3 output transitions
Drop transitions removed 3 transitions
Reduce places removed 1 places and 1 transitions.
Reduce places removed 2 places and 0 transitions.
Graph (complete) has 143 edges and 118 vertex of which 108 are kept as prefixes of interest. Removing 10 places using SCC suffix rule.1 ms
Discarding 10 places :
Also discarding 10 output transitions
Drop transitions removed 10 transitions
Graph (trivial) has 122 edges and 108 vertex of which 60 / 108 are part of one of the 30 SCC in 6 ms
Free SCC test removed 30 places
Drop transitions removed 16 transitions
Trivial Post-agglo rules discarded 16 transitions
Performed 16 trivial Post agglomeration. Transition count delta: 16
Iterating post reduction 0 with 20 rules applied. Total rules applied 21 place count 78 transition count 137
Reduce places removed 16 places and 0 transitions.
Ensure Unique test removed 30 transitions
Reduce isomorphic transitions removed 30 transitions.
Iterating post reduction 1 with 46 rules applied. Total rules applied 67 place count 62 transition count 107
Discarding 13 places :
Symmetric choice reduction at 2 with 13 rule applications. Total rules 80 place count 49 transition count 81
Iterating global reduction 2 with 13 rules applied. Total rules applied 93 place count 49 transition count 81
Discarding 13 places :
Symmetric choice reduction at 2 with 13 rule applications. Total rules 106 place count 36 transition count 55
Iterating global reduction 2 with 13 rules applied. Total rules applied 119 place count 36 transition count 55
Discarding 13 places :
Symmetric choice reduction at 2 with 13 rule applications. Total rules 132 place count 23 transition count 29
Iterating global reduction 2 with 13 rules applied. Total rules applied 145 place count 23 transition count 29
Discarding 13 places :
Symmetric choice reduction at 2 with 13 rule applications. Total rules 158 place count 10 transition count 16
Iterating global reduction 2 with 13 rules applied. Total rules applied 171 place count 10 transition count 16
Performed 2 Post agglomeration using F-continuation condition.Transition count delta: 2
Deduced a syphon composed of 2 places in 0 ms
Reduce places removed 2 places and 0 transitions.
Iterating global reduction 2 with 4 rules applied. Total rules applied 175 place count 8 transition count 14
Drop transitions removed 1 transitions
Redundant transition composition rules discarded 1 transitions
Iterating global reduction 2 with 1 rules applied. Total rules applied 176 place count 8 transition count 13
Reduce places removed 2 places and 2 transitions.
Iterating global reduction 2 with 2 rules applied. Total rules applied 178 place count 6 transition count 11
Applied a total of 178 rules in 20 ms. Remains 6 /124 variables (removed 118) and now considering 11/167 (removed 156) transitions.
[2023-03-15 01:56:18] [INFO ] Flow matrix only has 8 transitions (discarded 3 similar events)
// Phase 1: matrix 8 rows 6 cols
[2023-03-15 01:56:18] [INFO ] Computed 0 place invariants in 1 ms
[2023-03-15 01:56:18] [INFO ] Implicit Places using invariants in 19 ms returned []
[2023-03-15 01:56:18] [INFO ] Flow matrix only has 8 transitions (discarded 3 similar events)
[2023-03-15 01:56:18] [INFO ] Invariant cache hit.
[2023-03-15 01:56:18] [INFO ] Implicit Places using invariants and state equation in 20 ms returned []
Implicit Place search using SMT with State Equation took 43 ms to find 0 implicit places.
[2023-03-15 01:56:18] [INFO ] Redundant transitions in 0 ms returned []
[2023-03-15 01:56:18] [INFO ] Flow matrix only has 8 transitions (discarded 3 similar events)
[2023-03-15 01:56:18] [INFO ] Invariant cache hit.
[2023-03-15 01:56:18] [INFO ] Dead Transitions using invariants and state equation in 21 ms found 0 transitions.
Starting structural reductions in SI_LTL mode, iteration 1 : 6/124 places, 11/167 transitions.
Finished structural reductions in SI_LTL mode , in 1 iterations and 91 ms. Remains : 6/124 places, 11/167 transitions.
Stuttering acceptance computed with spot in 39 ms :[(NOT p0)]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-03 automaton TGBA Formula[mat=[[{ cond=p0, acceptance={} source=0 dest: 0}, { cond=(NOT p0), acceptance={0} source=0 dest: 0}]], initial=0, aps=[p0:(NEQ s2 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant], stateDesc=[null][true]]
Stuttering criterion allowed to conclude after 142 steps with 3 reset in 2 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-03 FALSE TECHNIQUES STUTTER_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-03 finished in 145 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(F(p0))'
Support contains 2 out of 124 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Graph (complete) has 377 edges and 124 vertex of which 120 are kept as prefixes of interest. Removing 4 places using SCC suffix rule.8 ms
Discarding 4 places :
Also discarding 4 output transitions
Drop transitions removed 4 transitions
Performed 5 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 0 with 5 Pre rules applied. Total rules applied 1 place count 120 transition count 158
Deduced a syphon composed of 5 places in 0 ms
Reduce places removed 5 places and 0 transitions.
Iterating global reduction 0 with 10 rules applied. Total rules applied 11 place count 115 transition count 158
Discarding 6 places :
Symmetric choice reduction at 0 with 6 rule applications. Total rules 17 place count 109 transition count 152
Iterating global reduction 0 with 6 rules applied. Total rules applied 23 place count 109 transition count 152
Applied a total of 23 rules in 23 ms. Remains 109 /124 variables (removed 15) and now considering 152/167 (removed 15) transitions.
// Phase 1: matrix 152 rows 109 cols
[2023-03-15 01:56:18] [INFO ] Computed 2 place invariants in 1 ms
[2023-03-15 01:56:18] [INFO ] Implicit Places using invariants in 87 ms returned []
[2023-03-15 01:56:18] [INFO ] Invariant cache hit.
[2023-03-15 01:56:18] [INFO ] State equation strengthened by 106 read => feed constraints.
[2023-03-15 01:56:18] [INFO ] Implicit Places using invariants and state equation in 194 ms returned [108]
Discarding 1 places :
Implicit Place search using SMT with State Equation took 286 ms to find 1 implicit places.
Starting structural reductions in SI_LTL mode, iteration 1 : 108/124 places, 152/167 transitions.
Performed 30 Post agglomeration using F-continuation condition.Transition count delta: 30
Deduced a syphon composed of 30 places in 0 ms
Reduce places removed 30 places and 0 transitions.
Iterating global reduction 0 with 60 rules applied. Total rules applied 60 place count 78 transition count 122
Discarding 14 places :
Symmetric choice reduction at 0 with 14 rule applications. Total rules 74 place count 64 transition count 94
Iterating global reduction 0 with 14 rules applied. Total rules applied 88 place count 64 transition count 94
Discarding 13 places :
Symmetric choice reduction at 0 with 13 rule applications. Total rules 101 place count 51 transition count 68
Iterating global reduction 0 with 13 rules applied. Total rules applied 114 place count 51 transition count 68
Discarding 13 places :
Symmetric choice reduction at 0 with 13 rule applications. Total rules 127 place count 38 transition count 55
Iterating global reduction 0 with 13 rules applied. Total rules applied 140 place count 38 transition count 55
Discarding 13 places :
Symmetric choice reduction at 0 with 13 rule applications. Total rules 153 place count 25 transition count 29
Iterating global reduction 0 with 13 rules applied. Total rules applied 166 place count 25 transition count 29
Discarding 13 places :
Symmetric choice reduction at 0 with 13 rule applications. Total rules 179 place count 12 transition count 16
Iterating global reduction 0 with 13 rules applied. Total rules applied 192 place count 12 transition count 16
Applied a total of 192 rules in 13 ms. Remains 12 /108 variables (removed 96) and now considering 16/152 (removed 136) transitions.
[2023-03-15 01:56:18] [INFO ] Flow matrix only has 14 transitions (discarded 2 similar events)
// Phase 1: matrix 14 rows 12 cols
[2023-03-15 01:56:18] [INFO ] Computed 1 place invariants in 0 ms
[2023-03-15 01:56:18] [INFO ] Implicit Places using invariants in 23 ms returned []
[2023-03-15 01:56:18] [INFO ] Flow matrix only has 14 transitions (discarded 2 similar events)
[2023-03-15 01:56:18] [INFO ] Invariant cache hit.
[2023-03-15 01:56:18] [INFO ] State equation strengthened by 11 read => feed constraints.
[2023-03-15 01:56:18] [INFO ] Implicit Places using invariants and state equation in 31 ms returned []
Implicit Place search using SMT with State Equation took 59 ms to find 0 implicit places.
Starting structural reductions in SI_LTL mode, iteration 2 : 12/124 places, 16/167 transitions.
Finished structural reductions in SI_LTL mode , in 2 iterations and 381 ms. Remains : 12/124 places, 16/167 transitions.
Stuttering acceptance computed with spot in 39 ms :[(NOT p0)]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-04 automaton TGBA Formula[mat=[[{ cond=(NOT p0), acceptance={0} source=0 dest: 0}]], initial=0, aps=[p0:(AND (EQ s7 1) (EQ s11 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, colored, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant, very-weak, weak, inherently-weak], stateDesc=[null][true]]
Stuttering criterion allowed to conclude after 2 steps with 0 reset in 0 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-04 FALSE TECHNIQUES STUTTER_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-04 finished in 433 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(F(p0)))'
Support contains 2 out of 124 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Discarding 5 places :
Symmetric choice reduction at 0 with 5 rule applications. Total rules 5 place count 119 transition count 162
Iterating global reduction 0 with 5 rules applied. Total rules applied 10 place count 119 transition count 162
Discarding 4 places :
Symmetric choice reduction at 0 with 4 rule applications. Total rules 14 place count 115 transition count 158
Iterating global reduction 0 with 4 rules applied. Total rules applied 18 place count 115 transition count 158
Discarding 3 places :
Symmetric choice reduction at 0 with 3 rule applications. Total rules 21 place count 112 transition count 155
Iterating global reduction 0 with 3 rules applied. Total rules applied 24 place count 112 transition count 155
Applied a total of 24 rules in 7 ms. Remains 112 /124 variables (removed 12) and now considering 155/167 (removed 12) transitions.
// Phase 1: matrix 155 rows 112 cols
[2023-03-15 01:56:18] [INFO ] Computed 2 place invariants in 1 ms
[2023-03-15 01:56:18] [INFO ] Implicit Places using invariants in 71 ms returned []
[2023-03-15 01:56:18] [INFO ] Invariant cache hit.
[2023-03-15 01:56:18] [INFO ] State equation strengthened by 106 read => feed constraints.
[2023-03-15 01:56:18] [INFO ] Implicit Places using invariants and state equation in 181 ms returned []
Implicit Place search using SMT with State Equation took 254 ms to find 0 implicit places.
[2023-03-15 01:56:18] [INFO ] Invariant cache hit.
[2023-03-15 01:56:18] [INFO ] Dead Transitions using invariants and state equation in 106 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 112/124 places, 155/167 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 367 ms. Remains : 112/124 places, 155/167 transitions.
Stuttering acceptance computed with spot in 73 ms :[(NOT p0), (NOT p0)]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-05 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=(NOT p0), acceptance={0} source=1 dest: 1}]], initial=0, aps=[p0:(AND (EQ s53 1) (EQ s111 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null][false, false]]
Stuttering criterion allowed to conclude after 181 steps with 0 reset in 2 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-05 FALSE TECHNIQUES STUTTER_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-05 finished in 458 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X((G(F((!p0||G(!p1)))) U !p0)))'
Support contains 3 out of 124 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Discarding 6 places :
Symmetric choice reduction at 0 with 6 rule applications. Total rules 6 place count 118 transition count 161
Iterating global reduction 0 with 6 rules applied. Total rules applied 12 place count 118 transition count 161
Discarding 4 places :
Symmetric choice reduction at 0 with 4 rule applications. Total rules 16 place count 114 transition count 157
Iterating global reduction 0 with 4 rules applied. Total rules applied 20 place count 114 transition count 157
Discarding 3 places :
Symmetric choice reduction at 0 with 3 rule applications. Total rules 23 place count 111 transition count 154
Iterating global reduction 0 with 3 rules applied. Total rules applied 26 place count 111 transition count 154
Applied a total of 26 rules in 8 ms. Remains 111 /124 variables (removed 13) and now considering 154/167 (removed 13) transitions.
// Phase 1: matrix 154 rows 111 cols
[2023-03-15 01:56:19] [INFO ] Computed 2 place invariants in 0 ms
[2023-03-15 01:56:19] [INFO ] Implicit Places using invariants in 61 ms returned []
[2023-03-15 01:56:19] [INFO ] Invariant cache hit.
[2023-03-15 01:56:19] [INFO ] State equation strengthened by 106 read => feed constraints.
[2023-03-15 01:56:19] [INFO ] Implicit Places using invariants and state equation in 212 ms returned [110]
Discarding 1 places :
Implicit Place search using SMT with State Equation took 277 ms to find 1 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 110/124 places, 154/167 transitions.
Applied a total of 0 rules in 2 ms. Remains 110 /110 variables (removed 0) and now considering 154/154 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 288 ms. Remains : 110/124 places, 154/167 transitions.
Stuttering acceptance computed with spot in 172 ms :[p0, p0, (AND p0 p1), (AND p0 p1)]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-06 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=p0, acceptance={0} source=1 dest: 1}, { cond=p0, acceptance={} source=1 dest: 2}], [{ cond=true, acceptance={} source=2 dest: 2}, { cond=(AND p0 p1), acceptance={} source=2 dest: 3}], [{ cond=(AND p0 (NOT p1)), acceptance={} source=3 dest: 3}, { cond=(AND p0 p1), acceptance={0} source=3 dest: 3}]], initial=0, aps=[p0:(AND (EQ s31 1) (EQ s109 1)), p1:(AND (EQ s62 1) (EQ s109 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-sensitive], stateDesc=[null, null, null, null][false, false, false, false]]
Product exploration explored 100000 steps with 690 reset in 367 ms.
Stack based approach found an accepted trace after 24974 steps with 171 reset with depth 31 and stack size 31 in 83 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-06 FALSE TECHNIQUES STACK_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-06 finished in 933 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X((G(F(p0))||(G(p1)&&(p2||X(p2))))))'
Support contains 5 out of 124 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Discarding 6 places :
Symmetric choice reduction at 0 with 6 rule applications. Total rules 6 place count 118 transition count 161
Iterating global reduction 0 with 6 rules applied. Total rules applied 12 place count 118 transition count 161
Discarding 4 places :
Symmetric choice reduction at 0 with 4 rule applications. Total rules 16 place count 114 transition count 157
Iterating global reduction 0 with 4 rules applied. Total rules applied 20 place count 114 transition count 157
Discarding 3 places :
Symmetric choice reduction at 0 with 3 rule applications. Total rules 23 place count 111 transition count 154
Iterating global reduction 0 with 3 rules applied. Total rules applied 26 place count 111 transition count 154
Applied a total of 26 rules in 5 ms. Remains 111 /124 variables (removed 13) and now considering 154/167 (removed 13) transitions.
[2023-03-15 01:56:20] [INFO ] Invariant cache hit.
[2023-03-15 01:56:20] [INFO ] Implicit Places using invariants in 59 ms returned []
[2023-03-15 01:56:20] [INFO ] Invariant cache hit.
[2023-03-15 01:56:20] [INFO ] State equation strengthened by 106 read => feed constraints.
[2023-03-15 01:56:20] [INFO ] Implicit Places using invariants and state equation in 143 ms returned []
Implicit Place search using SMT with State Equation took 207 ms to find 0 implicit places.
[2023-03-15 01:56:20] [INFO ] Invariant cache hit.
[2023-03-15 01:56:20] [INFO ] Dead Transitions using invariants and state equation in 113 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 111/124 places, 154/167 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 329 ms. Remains : 111/124 places, 154/167 transitions.
Stuttering acceptance computed with spot in 227 ms :[(OR (AND (NOT p0) (NOT p1)) (AND (NOT p0) (NOT p2))), (OR (AND (NOT p0) (NOT p1)) (AND (NOT p0) (NOT p2))), (NOT p0), (NOT p0), (AND (NOT p0) (NOT p1)), (AND (NOT p0) p1 (NOT p2))]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-07 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=(AND (NOT p0) (NOT p1)), acceptance={} source=1 dest: 2}, { cond=(NOT p1), acceptance={} source=1 dest: 3}, { cond=p1, acceptance={} source=1 dest: 4}, { cond=(AND p1 (NOT p2)), acceptance={} source=1 dest: 5}], [{ cond=(NOT p0), acceptance={0} source=2 dest: 2}], [{ cond=(NOT p0), acceptance={} source=3 dest: 2}, { cond=true, acceptance={} source=3 dest: 3}], [{ cond=(AND (NOT p0) (NOT p1)), acceptance={} source=4 dest: 2}, { cond=(NOT p1), acceptance={} source=4 dest: 3}, { cond=p1, acceptance={} source=4 dest: 4}], [{ cond=(AND (NOT p0) p1 (NOT p2)), acceptance={} source=5 dest: 2}, { cond=(AND p1 (NOT p2)), acceptance={} source=5 dest: 3}]], initial=0, aps=[p0:(AND (EQ s32 1) (EQ s110 1)), p1:(AND (EQ s107 1) (EQ s109 1)), p2:(AND (EQ s47 1) (EQ s109 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null, null, null][false, false, false, false, false, false]]
Stuttering criterion allowed to conclude after 157 steps with 0 reset in 1 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-07 FALSE TECHNIQUES STUTTER_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-07 finished in 581 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(G(F(p0)))'
Support contains 2 out of 124 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Graph (complete) has 377 edges and 124 vertex of which 120 are kept as prefixes of interest. Removing 4 places using SCC suffix rule.1 ms
Discarding 4 places :
Also discarding 4 output transitions
Drop transitions removed 4 transitions
Performed 5 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 0 with 5 Pre rules applied. Total rules applied 1 place count 120 transition count 158
Deduced a syphon composed of 5 places in 0 ms
Reduce places removed 5 places and 0 transitions.
Iterating global reduction 0 with 10 rules applied. Total rules applied 11 place count 115 transition count 158
Discarding 6 places :
Symmetric choice reduction at 0 with 6 rule applications. Total rules 17 place count 109 transition count 152
Iterating global reduction 0 with 6 rules applied. Total rules applied 23 place count 109 transition count 152
Applied a total of 23 rules in 17 ms. Remains 109 /124 variables (removed 15) and now considering 152/167 (removed 15) transitions.
// Phase 1: matrix 152 rows 109 cols
[2023-03-15 01:56:20] [INFO ] Computed 2 place invariants in 0 ms
[2023-03-15 01:56:20] [INFO ] Implicit Places using invariants in 76 ms returned []
[2023-03-15 01:56:20] [INFO ] Invariant cache hit.
[2023-03-15 01:56:20] [INFO ] State equation strengthened by 106 read => feed constraints.
[2023-03-15 01:56:20] [INFO ] Implicit Places using invariants and state equation in 214 ms returned [108]
Discarding 1 places :
Implicit Place search using SMT with State Equation took 296 ms to find 1 implicit places.
Starting structural reductions in SI_LTL mode, iteration 1 : 108/124 places, 152/167 transitions.
Performed 29 Post agglomeration using F-continuation condition.Transition count delta: 29
Deduced a syphon composed of 29 places in 0 ms
Reduce places removed 29 places and 0 transitions.
Iterating global reduction 0 with 58 rules applied. Total rules applied 58 place count 79 transition count 123
Discarding 13 places :
Symmetric choice reduction at 0 with 13 rule applications. Total rules 71 place count 66 transition count 97
Iterating global reduction 0 with 13 rules applied. Total rules applied 84 place count 66 transition count 97
Discarding 13 places :
Symmetric choice reduction at 0 with 13 rule applications. Total rules 97 place count 53 transition count 71
Iterating global reduction 0 with 13 rules applied. Total rules applied 110 place count 53 transition count 71
Discarding 13 places :
Symmetric choice reduction at 0 with 13 rule applications. Total rules 123 place count 40 transition count 58
Iterating global reduction 0 with 13 rules applied. Total rules applied 136 place count 40 transition count 58
Discarding 13 places :
Symmetric choice reduction at 0 with 13 rule applications. Total rules 149 place count 27 transition count 32
Iterating global reduction 0 with 13 rules applied. Total rules applied 162 place count 27 transition count 32
Discarding 13 places :
Symmetric choice reduction at 0 with 13 rule applications. Total rules 175 place count 14 transition count 19
Iterating global reduction 0 with 13 rules applied. Total rules applied 188 place count 14 transition count 19
Partial Post-agglomeration rule applied 1 times.
Drop transitions removed 1 transitions
Iterating global reduction 0 with 1 rules applied. Total rules applied 189 place count 14 transition count 19
Applied a total of 189 rules in 16 ms. Remains 14 /108 variables (removed 94) and now considering 19/152 (removed 133) transitions.
[2023-03-15 01:56:20] [INFO ] Flow matrix only has 17 transitions (discarded 2 similar events)
// Phase 1: matrix 17 rows 14 cols
[2023-03-15 01:56:20] [INFO ] Computed 1 place invariants in 0 ms
[2023-03-15 01:56:20] [INFO ] Implicit Places using invariants in 25 ms returned []
[2023-03-15 01:56:20] [INFO ] Flow matrix only has 17 transitions (discarded 2 similar events)
[2023-03-15 01:56:20] [INFO ] Invariant cache hit.
[2023-03-15 01:56:20] [INFO ] State equation strengthened by 13 read => feed constraints.
[2023-03-15 01:56:20] [INFO ] Implicit Places using invariants and state equation in 31 ms returned []
Implicit Place search using SMT with State Equation took 57 ms to find 0 implicit places.
Starting structural reductions in SI_LTL mode, iteration 2 : 14/124 places, 19/167 transitions.
Finished structural reductions in SI_LTL mode , in 2 iterations and 390 ms. Remains : 14/124 places, 19/167 transitions.
Stuttering acceptance computed with spot in 72 ms :[(NOT p0), (NOT p0)]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-08 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 0}, { cond=(NOT p0), acceptance={} source=0 dest: 1}], [{ cond=(NOT p0), acceptance={0} source=1 dest: 1}]], initial=0, aps=[p0:(AND (EQ s8 1) (EQ s13 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-invariant, very-weak, weak, inherently-weak], stateDesc=[null, null][true, true]]
Stuttering criterion allowed to conclude after 2 steps with 0 reset in 1 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-08 FALSE TECHNIQUES STUTTER_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-08 finished in 482 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!((G(F(p0))||G((F(p1)&&F(G((p2 U p3)))))))'
Support contains 4 out of 124 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Graph (complete) has 377 edges and 124 vertex of which 121 are kept as prefixes of interest. Removing 3 places using SCC suffix rule.1 ms
Discarding 3 places :
Also discarding 3 output transitions
Drop transitions removed 3 transitions
Performed 5 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 0 with 5 Pre rules applied. Total rules applied 1 place count 121 transition count 159
Deduced a syphon composed of 5 places in 0 ms
Reduce places removed 5 places and 0 transitions.
Iterating global reduction 0 with 10 rules applied. Total rules applied 11 place count 116 transition count 159
Discarding 5 places :
Symmetric choice reduction at 0 with 5 rule applications. Total rules 16 place count 111 transition count 154
Iterating global reduction 0 with 5 rules applied. Total rules applied 21 place count 111 transition count 154
Applied a total of 21 rules in 16 ms. Remains 111 /124 variables (removed 13) and now considering 154/167 (removed 13) transitions.
// Phase 1: matrix 154 rows 111 cols
[2023-03-15 01:56:21] [INFO ] Computed 2 place invariants in 1 ms
[2023-03-15 01:56:21] [INFO ] Implicit Places using invariants in 73 ms returned []
[2023-03-15 01:56:21] [INFO ] Invariant cache hit.
[2023-03-15 01:56:21] [INFO ] State equation strengthened by 107 read => feed constraints.
[2023-03-15 01:56:21] [INFO ] Implicit Places using invariants and state equation in 176 ms returned [110]
Discarding 1 places :
Implicit Place search using SMT with State Equation took 252 ms to find 1 implicit places.
Starting structural reductions in SI_LTL mode, iteration 1 : 110/124 places, 154/167 transitions.
Performed 29 Post agglomeration using F-continuation condition.Transition count delta: 29
Deduced a syphon composed of 29 places in 0 ms
Reduce places removed 29 places and 0 transitions.
Iterating global reduction 0 with 58 rules applied. Total rules applied 58 place count 81 transition count 125
Discarding 13 places :
Symmetric choice reduction at 0 with 13 rule applications. Total rules 71 place count 68 transition count 99
Iterating global reduction 0 with 13 rules applied. Total rules applied 84 place count 68 transition count 99
Discarding 12 places :
Symmetric choice reduction at 0 with 12 rule applications. Total rules 96 place count 56 transition count 75
Iterating global reduction 0 with 12 rules applied. Total rules applied 108 place count 56 transition count 75
Discarding 12 places :
Symmetric choice reduction at 0 with 12 rule applications. Total rules 120 place count 44 transition count 63
Iterating global reduction 0 with 12 rules applied. Total rules applied 132 place count 44 transition count 63
Discarding 11 places :
Symmetric choice reduction at 0 with 11 rule applications. Total rules 143 place count 33 transition count 41
Iterating global reduction 0 with 11 rules applied. Total rules applied 154 place count 33 transition count 41
Discarding 11 places :
Symmetric choice reduction at 0 with 11 rule applications. Total rules 165 place count 22 transition count 30
Iterating global reduction 0 with 11 rules applied. Total rules applied 176 place count 22 transition count 30
Partial Post-agglomeration rule applied 1 times.
Drop transitions removed 1 transitions
Iterating global reduction 0 with 1 rules applied. Total rules applied 177 place count 22 transition count 30
Applied a total of 177 rules in 18 ms. Remains 22 /110 variables (removed 88) and now considering 30/154 (removed 124) transitions.
[2023-03-15 01:56:21] [INFO ] Flow matrix only has 26 transitions (discarded 4 similar events)
// Phase 1: matrix 26 rows 22 cols
[2023-03-15 01:56:21] [INFO ] Computed 1 place invariants in 1 ms
[2023-03-15 01:56:21] [INFO ] Implicit Places using invariants in 28 ms returned []
[2023-03-15 01:56:21] [INFO ] Flow matrix only has 26 transitions (discarded 4 similar events)
[2023-03-15 01:56:21] [INFO ] Invariant cache hit.
[2023-03-15 01:56:21] [INFO ] State equation strengthened by 20 read => feed constraints.
[2023-03-15 01:56:21] [INFO ] Implicit Places using invariants and state equation in 43 ms returned []
Implicit Place search using SMT with State Equation took 82 ms to find 0 implicit places.
Starting structural reductions in SI_LTL mode, iteration 2 : 22/124 places, 30/167 transitions.
Finished structural reductions in SI_LTL mode , in 2 iterations and 369 ms. Remains : 22/124 places, 30/167 transitions.
Stuttering acceptance computed with spot in 159 ms :[(OR (AND (NOT p0) (NOT p1)) (AND (NOT p0) (NOT p3))), (AND (NOT p0) (NOT p1)), (AND (NOT p0) (NOT p3)), (AND (NOT p0) (NOT p3))]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-09 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 0}, { cond=(AND (NOT p0) (NOT p1)), acceptance={} source=0 dest: 1}, { cond=(AND (NOT p0) (NOT p3) (NOT p2)), acceptance={} source=0 dest: 2}, { cond=(AND (NOT p0) (NOT p3) p2), acceptance={} source=0 dest: 3}], [{ cond=(AND (NOT p0) (NOT p1)), acceptance={0} source=1 dest: 1}], [{ cond=(OR (AND (NOT p0) p3) (AND (NOT p0) p2)), acceptance={} source=2 dest: 2}, { cond=(AND (NOT p0) (NOT p3) (NOT p2)), acceptance={0} source=2 dest: 2}, { cond=(AND (NOT p0) (NOT p3) p2), acceptance={0} source=2 dest: 3}], [{ cond=(AND (NOT p0) (NOT p3) (NOT p2)), acceptance={0} source=3 dest: 2}, { cond=(AND (NOT p0) (NOT p3) p2), acceptance={0} source=3 dest: 3}]], initial=0, aps=[p0:(AND (EQ s8 1) (EQ s21 1)), p1:(OR (AND (EQ s8 1) (EQ s21 1)) (EQ s10 0)), p3:(EQ s10 1), p2:(EQ s17 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-invariant], stateDesc=[null, null, null, null][true, true, true, true]]
Stuttering criterion allowed to conclude after 2 steps with 0 reset in 0 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-09 FALSE TECHNIQUES STUTTER_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-09 finished in 555 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(G(((p0||X(p1))&&(X(G(p3))||p2)))))'
Support contains 6 out of 124 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Discarding 5 places :
Symmetric choice reduction at 0 with 5 rule applications. Total rules 5 place count 119 transition count 162
Iterating global reduction 0 with 5 rules applied. Total rules applied 10 place count 119 transition count 162
Discarding 4 places :
Symmetric choice reduction at 0 with 4 rule applications. Total rules 14 place count 115 transition count 158
Iterating global reduction 0 with 4 rules applied. Total rules applied 18 place count 115 transition count 158
Discarding 3 places :
Symmetric choice reduction at 0 with 3 rule applications. Total rules 21 place count 112 transition count 155
Iterating global reduction 0 with 3 rules applied. Total rules applied 24 place count 112 transition count 155
Applied a total of 24 rules in 14 ms. Remains 112 /124 variables (removed 12) and now considering 155/167 (removed 12) transitions.
// Phase 1: matrix 155 rows 112 cols
[2023-03-15 01:56:21] [INFO ] Computed 2 place invariants in 1 ms
[2023-03-15 01:56:21] [INFO ] Implicit Places using invariants in 61 ms returned []
[2023-03-15 01:56:21] [INFO ] Invariant cache hit.
[2023-03-15 01:56:21] [INFO ] State equation strengthened by 106 read => feed constraints.
[2023-03-15 01:56:21] [INFO ] Implicit Places using invariants and state equation in 149 ms returned []
Implicit Place search using SMT with State Equation took 235 ms to find 0 implicit places.
[2023-03-15 01:56:21] [INFO ] Invariant cache hit.
[2023-03-15 01:56:21] [INFO ] Dead Transitions using invariants and state equation in 116 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 112/124 places, 155/167 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 367 ms. Remains : 112/124 places, 155/167 transitions.
Stuttering acceptance computed with spot in 189 ms :[(OR (AND (NOT p0) (NOT p1)) (AND (NOT p2) (NOT p3))), (OR (AND (NOT p0) (NOT p1)) (AND (NOT p2) (NOT p3))), (NOT p1), (NOT p3), true]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-13 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=true, acceptance={} source=1 dest: 1}, { cond=(NOT p0), acceptance={} source=1 dest: 2}, { cond=(NOT p2), acceptance={} source=1 dest: 3}], [{ cond=(NOT p1), acceptance={} source=2 dest: 4}], [{ cond=(AND p2 p3), acceptance={} source=3 dest: 3}, { cond=(NOT p3), acceptance={} source=3 dest: 4}], [{ cond=true, acceptance={0} source=4 dest: 4}]], initial=0, aps=[p0:(EQ s83 1), p2:(OR (AND (EQ s108 1) (EQ s110 1)) (AND (EQ s21 1) (EQ s110 1))), p1:(AND (EQ s102 1) (EQ s111 1)), p3:(AND (EQ s21 1) (EQ s110 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-sensitive, terminal, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null, null][false, false, false, false, false]]
Entered a terminal (fully accepting) state of product in 2 steps with 0 reset in 1 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-13 FALSE TECHNIQUES STUTTER_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-13 finished in 576 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(F((X(F(p0))||(X(p2)&&p1)))))'
Support contains 4 out of 124 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 124/124 places, 167/167 transitions.
Discarding 6 places :
Symmetric choice reduction at 0 with 6 rule applications. Total rules 6 place count 118 transition count 161
Iterating global reduction 0 with 6 rules applied. Total rules applied 12 place count 118 transition count 161
Discarding 4 places :
Symmetric choice reduction at 0 with 4 rule applications. Total rules 16 place count 114 transition count 157
Iterating global reduction 0 with 4 rules applied. Total rules applied 20 place count 114 transition count 157
Discarding 3 places :
Symmetric choice reduction at 0 with 3 rule applications. Total rules 23 place count 111 transition count 154
Iterating global reduction 0 with 3 rules applied. Total rules applied 26 place count 111 transition count 154
Applied a total of 26 rules in 5 ms. Remains 111 /124 variables (removed 13) and now considering 154/167 (removed 13) transitions.
// Phase 1: matrix 154 rows 111 cols
[2023-03-15 01:56:22] [INFO ] Computed 2 place invariants in 1 ms
[2023-03-15 01:56:22] [INFO ] Implicit Places using invariants in 70 ms returned []
[2023-03-15 01:56:22] [INFO ] Invariant cache hit.
[2023-03-15 01:56:22] [INFO ] State equation strengthened by 106 read => feed constraints.
[2023-03-15 01:56:22] [INFO ] Implicit Places using invariants and state equation in 144 ms returned []
Implicit Place search using SMT with State Equation took 215 ms to find 0 implicit places.
[2023-03-15 01:56:22] [INFO ] Invariant cache hit.
[2023-03-15 01:56:22] [INFO ] Dead Transitions using invariants and state equation in 120 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 111/124 places, 154/167 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 342 ms. Remains : 111/124 places, 154/167 transitions.
Stuttering acceptance computed with spot in 154 ms :[(OR (AND (NOT p0) (NOT p1)) (AND (NOT p0) (NOT p2))), (AND (NOT p0) (NOT p2)), (OR (AND (NOT p0) (NOT p1)) (AND (NOT p0) (NOT p2))), (OR (AND (NOT p0) (NOT p1)) (AND (NOT p0) (NOT p2)))]
Running random walk in product with property : DiscoveryGPU-PT-15a-LTLFireability-15 automaton TGBA Formula[mat=[[{ cond=(AND (NOT p1) (NOT p0)), acceptance={0} source=0 dest: 0}, { cond=(AND p1 (NOT p0)), acceptance={0} source=0 dest: 1}], [{ cond=(AND (NOT p1) (NOT p0) (NOT p2)), acceptance={0} source=1 dest: 0}, { cond=(AND p1 (NOT p0) (NOT p2)), acceptance={0} source=1 dest: 1}], [{ cond=true, acceptance={} source=2 dest: 3}], [{ cond=(NOT p1), acceptance={} source=3 dest: 0}, { cond=p1, acceptance={} source=3 dest: 1}]], initial=2, aps=[p1:(AND (EQ s99 1) (EQ s110 1)), p0:(AND (EQ s53 1) (EQ s110 1)), p2:(EQ s85 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, weak, inherently-weak], stateDesc=[null, null, null, null][false, false, false, false]]
Stuttering criterion allowed to conclude after 273 steps with 1 reset in 1 ms.
FORMULA DiscoveryGPU-PT-15a-LTLFireability-15 FALSE TECHNIQUES STUTTER_TEST
Treatment of property DiscoveryGPU-PT-15a-LTLFireability-15 finished in 514 ms.
All properties solved by simple procedures.
Total runtime 9273 ms.
ITS solved all properties within timeout

BK_STOP 1678845383752

--------------------
content from stderr:

+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
+ export PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ export LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
+ LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//../reducer/bin//../../itstools//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202303021504.jar
+ VERSION=202303021504
+ echo 'Running Version 202303021504'
+ /home/mcc/BenchKit/bin//../reducer/bin//../../itstools//itstools/its-tools -pnfolder /home/mcc/execution -examination LTLFireability -timeout 360 -rebuildPNML

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="DiscoveryGPU-PT-15a"
export BK_EXAMINATION="LTLFireability"
export BK_TOOL="ltsminxred"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5348"
echo " Executing tool ltsminxred"
echo " Input is DiscoveryGPU-PT-15a, examination is LTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r137-smll-167819418400428"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/DiscoveryGPU-PT-15a.tgz
mv DiscoveryGPU-PT-15a execution
cd execution
if [ "LTLFireability" = "ReachabilityDeadlock" ] || [ "LTLFireability" = "UpperBounds" ] || [ "LTLFireability" = "QuasiLiveness" ] || [ "LTLFireability" = "StableMarking" ] || [ "LTLFireability" = "Liveness" ] || [ "LTLFireability" = "OneSafe" ] || [ "LTLFireability" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "LTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "LTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "LTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property LTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "LTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' LTLFireability.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "LTLFireability" = "ReachabilityDeadlock" ] || [ "LTLFireability" = "QuasiLiveness" ] || [ "LTLFireability" = "StableMarking" ] || [ "LTLFireability" = "Liveness" ] || [ "LTLFireability" = "OneSafe" ] ; then
echo "FORMULA_NAME LTLFireability"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;