About the Execution of 2023-gold for NQueens-PT-25
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
375.768 | 1364207.00 | 1384479.00 | 2974.30 | FTFFFFFFTFFFTFTF | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/data/fkordon/mcc2024-input.r263-tall-171654372400242.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fkordon/mcc2024-input.qcow2 backing_fmt=qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
.......................................................................
=====================================================================
Generated by BenchKit 2-5568
Executing tool gold2023
Input is NQueens-PT-25, examination is LTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r263-tall-171654372400242
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 1.1M
-rw-r--r-- 1 mcc users 7.5K May 14 13:22 CTLCardinality.txt
-rw-r--r-- 1 mcc users 81K May 14 13:22 CTLCardinality.xml
-rw-r--r-- 1 mcc users 6.4K May 14 13:22 CTLFireability.txt
-rw-r--r-- 1 mcc users 53K May 14 13:22 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K May 18 16:43 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.5K May 18 16:43 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 3.8K May 19 07:12 LTLCardinality.txt
-rw-r--r-- 1 mcc users 26K May 19 16:10 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.3K May 19 07:23 LTLFireability.txt
-rw-r--r-- 1 mcc users 17K May 19 18:42 LTLFireability.xml
-rw-r--r-- 1 mcc users 17K Apr 12 03:19 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 181K Apr 12 03:19 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 14K Apr 12 03:17 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 103K Apr 12 03:17 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K Apr 23 07:40 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.6K Apr 23 07:40 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 18 16:43 equiv_col
-rw-r--r-- 1 mcc users 3 May 18 16:43 instance
-rw-r--r-- 1 mcc users 6 May 18 16:43 iscolored
-rw-r--r-- 1 mcc users 534K May 18 16:43 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME NQueens-PT-25-LTLCardinality-00
FORMULA_NAME NQueens-PT-25-LTLCardinality-01
FORMULA_NAME NQueens-PT-25-LTLCardinality-02
FORMULA_NAME NQueens-PT-25-LTLCardinality-03
FORMULA_NAME NQueens-PT-25-LTLCardinality-04
FORMULA_NAME NQueens-PT-25-LTLCardinality-05
FORMULA_NAME NQueens-PT-25-LTLCardinality-06
FORMULA_NAME NQueens-PT-25-LTLCardinality-07
FORMULA_NAME NQueens-PT-25-LTLCardinality-08
FORMULA_NAME NQueens-PT-25-LTLCardinality-09
FORMULA_NAME NQueens-PT-25-LTLCardinality-10
FORMULA_NAME NQueens-PT-25-LTLCardinality-11
FORMULA_NAME NQueens-PT-25-LTLCardinality-12
FORMULA_NAME NQueens-PT-25-LTLCardinality-13
FORMULA_NAME NQueens-PT-25-LTLCardinality-14
FORMULA_NAME NQueens-PT-25-LTLCardinality-15
=== Now, execution of the tool begins
BK_START 1716683212916
bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
Invoking MCC driver with
BK_TOOL=gold2023
BK_EXAMINATION=LTLCardinality
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=NQueens-PT-25
Not applying reductions.
Model is PT
LTLCardinality PT
Running Version 202304061127
[2024-05-26 00:26:54] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, LTLCardinality, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2024-05-26 00:26:54] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2024-05-26 00:26:54] [INFO ] Load time of PNML (sax parser for PT used): 102 ms
[2024-05-26 00:26:54] [INFO ] Transformed 775 places.
[2024-05-26 00:26:54] [INFO ] Transformed 625 transitions.
[2024-05-26 00:26:54] [INFO ] Found NUPN structural information;
[2024-05-26 00:26:54] [INFO ] Parsed PT model containing 775 places and 625 transitions and 3125 arcs in 171 ms.
Parsed 16 properties from file /home/mcc/execution/LTLCardinality.xml in 8 ms.
Working with output stream class java.io.PrintStream
Initial state reduction rules removed 4 formulas.
Reduce places removed 2 places and 0 transitions.
FORMULA NQueens-PT-25-LTLCardinality-01 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-25-LTLCardinality-04 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-25-LTLCardinality-05 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-25-LTLCardinality-12 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-25-LTLCardinality-14 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-25-LTLCardinality-08 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-25-LTLCardinality-13 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Support contains 24 out of 773 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 773/773 places, 625/625 transitions.
Reduce places removed 608 places and 0 transitions.
Iterating post reduction 0 with 608 rules applied. Total rules applied 608 place count 165 transition count 625
Applied a total of 608 rules in 30 ms. Remains 165 /773 variables (removed 608) and now considering 625/625 (removed 0) transitions.
// Phase 1: matrix 625 rows 165 cols
[2024-05-26 00:26:55] [INFO ] Invariants computation overflowed in 114 ms
[2024-05-26 00:26:55] [INFO ] Implicit Places using invariants in 486 ms returned []
// Phase 1: matrix 625 rows 165 cols
[2024-05-26 00:26:55] [INFO ] Invariants computation overflowed in 59 ms
[2024-05-26 00:28:05] [INFO ] Performed 114/165 implicitness test of which 1 returned IMPLICIT in 69 seconds.
[2024-05-26 00:29:35] [INFO ] Implicit Places using invariants and state equation in 160073 ms returned [67]
Discarding 1 places :
Implicit Place search using SMT with State Equation took 160592 ms to find 1 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 164/773 places, 625/625 transitions.
Applied a total of 0 rules in 9 ms. Remains 164 /164 variables (removed 0) and now considering 625/625 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 160633 ms. Remains : 164/773 places, 625/625 transitions.
Support contains 24 out of 164 places after structural reductions.
[2024-05-26 00:29:35] [INFO ] Flatten gal took : 91 ms
[2024-05-26 00:29:35] [INFO ] Flatten gal took : 56 ms
[2024-05-26 00:29:36] [INFO ] Input system was already deterministic with 625 transitions.
Support contains 20 out of 164 places (down from 24) after GAL structural reductions.
Finished random walk after 3300 steps, including 142 resets, run visited all 15 properties in 316 ms. (steps per millisecond=10 )
Parikh walk visited 0 properties in 0 ms.
Computed a total of 164 stabilizing places and 625 stable transitions
Complete graph has no SCC; deadlocks are unavoidable. place count 164 transition count 625
Detected that all paths lead to deadlock. Applying this knowledge to assert that all AP eventually converge (and all enablings converge to false).
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X((p0||G(F((G(!p1)||(!p1&&F(!p2))))))))'
Support contains 4 out of 164 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 164/164 places, 625/625 transitions.
Reduce places removed 14 places and 0 transitions.
Iterating post reduction 0 with 14 rules applied. Total rules applied 14 place count 150 transition count 625
Applied a total of 14 rules in 5 ms. Remains 150 /164 variables (removed 14) and now considering 625/625 (removed 0) transitions.
// Phase 1: matrix 625 rows 150 cols
[2024-05-26 00:29:36] [INFO ] Invariants computation overflowed in 63 ms
[2024-05-26 00:29:36] [INFO ] Implicit Places using invariants in 284 ms returned []
// Phase 1: matrix 625 rows 150 cols
[2024-05-26 00:29:37] [INFO ] Invariants computation overflowed in 44 ms
[2024-05-26 00:30:41] [INFO ] Performed 53/150 implicitness test of which 0 returned IMPLICIT in 54 seconds.
[2024-05-26 00:31:23] [INFO ] Performed 99/150 implicitness test of which 0 returned IMPLICIT in 96 seconds.
[2024-05-26 00:32:17] [INFO ] Performed 100/150 implicitness test of which 0 returned IMPLICIT in 150 seconds.
[2024-05-26 00:32:17] [INFO ] Timeout of Implicit test with SMT after 150 seconds.
[2024-05-26 00:32:17] [INFO ] Implicit Places using invariants and state equation in 160057 ms returned []
Implicit Place search using SMT with State Equation took 160342 ms to find 0 implicit places.
// Phase 1: matrix 625 rows 150 cols
[2024-05-26 00:32:17] [INFO ] Invariants computation overflowed in 67 ms
[2024-05-26 00:32:17] [INFO ] Dead Transitions using invariants and state equation in 458 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 150/164 places, 625/625 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 160807 ms. Remains : 150/164 places, 625/625 transitions.
ANTLR Tool version 4.9.3 used for code generation does not match the current runtime version 4.7.2ANTLR Runtime version 4.9.3 used for parser compilation does not match the current runtime version 4.7.2ANTLR Tool version 4.9.3 used for code generation does not match the current runtime version 4.7.2ANTLR Runtime version 4.9.3 used for parser compilation does not match the current runtime version 4.7.2Stuttering acceptance computed with spot in 316 ms :[(AND (NOT p0) p1), p1, (AND p2 p1), p1, (AND (NOT p0) p1)]
Running random walk in product with property : NQueens-PT-25-LTLCardinality-00 automaton TGBA Formula[mat=[[{ cond=(NOT p0), acceptance={} source=0 dest: 1}, { cond=(AND (NOT p0) p2 p1), acceptance={} source=0 dest: 2}, { cond=(AND (NOT p0) p1), acceptance={} source=0 dest: 3}], [{ cond=true, acceptance={} source=1 dest: 1}, { cond=(AND p2 p1), acceptance={} source=1 dest: 2}, { cond=p1, acceptance={} source=1 dest: 3}], [{ cond=(AND p2 (NOT p1)), acceptance={} source=2 dest: 2}, { cond=(AND p2 p1), acceptance={0} source=2 dest: 2}], [{ cond=p1, acceptance={0} source=3 dest: 3}], [{ cond=true, acceptance={} source=4 dest: 0}]], initial=4, aps=[p0:(AND (EQ s143 0) (EQ s1 1)), p2:(OR (EQ s1 0) (EQ s143 1)), p1:(OR (EQ s0 0) (EQ s2 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-sensitive], stateDesc=[null, null, null, null, null][false, false, false, false, false]]
Stuttering criterion allowed to conclude after 22 steps with 0 reset in 6 ms.
FORMULA NQueens-PT-25-LTLCardinality-00 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-25-LTLCardinality-00 finished in 161192 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(F(G(p0)))'
Support contains 1 out of 164 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 164/164 places, 625/625 transitions.
Graph (complete) has 68 edges and 164 vertex of which 146 are kept as prefixes of interest. Removing 18 places using SCC suffix rule.2 ms
Discarding 18 places :
Also discarding 0 output transitions
Applied a total of 1 rules in 15 ms. Remains 146 /164 variables (removed 18) and now considering 625/625 (removed 0) transitions.
// Phase 1: matrix 625 rows 146 cols
[2024-05-26 00:32:17] [INFO ] Invariants computation overflowed in 38 ms
[2024-05-26 00:32:18] [INFO ] Implicit Places using invariants in 240 ms returned []
// Phase 1: matrix 625 rows 146 cols
[2024-05-26 00:32:18] [INFO ] Invariants computation overflowed in 40 ms
[2024-05-26 00:34:16] [INFO ] Performed 96/146 implicitness test of which 1 returned IMPLICIT in 117 seconds.
[2024-05-26 00:34:51] [INFO ] Performed 97/146 implicitness test of which 2 returned IMPLICIT in 153 seconds.
[2024-05-26 00:34:58] [INFO ] Implicit Places using invariants and state equation in 160062 ms returned [96, 97]
Discarding 2 places :
Implicit Place search using SMT with State Equation took 160319 ms to find 2 implicit places.
Starting structural reductions in SI_LTL mode, iteration 1 : 144/164 places, 625/625 transitions.
Applied a total of 0 rules in 12 ms. Remains 144 /144 variables (removed 0) and now considering 625/625 (removed 0) transitions.
Finished structural reductions in SI_LTL mode , in 2 iterations and 160346 ms. Remains : 144/164 places, 625/625 transitions.
Stuttering acceptance computed with spot in 31 ms :[(NOT p0)]
Running random walk in product with property : NQueens-PT-25-LTLCardinality-02 automaton TGBA Formula[mat=[[{ cond=p0, acceptance={} source=0 dest: 0}, { cond=(NOT p0), acceptance={0} source=0 dest: 0}]], initial=0, aps=[p0:(EQ s0 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant], stateDesc=[null][true]]
Stuttering criterion allowed to conclude after 22 steps with 0 reset in 3 ms.
FORMULA NQueens-PT-25-LTLCardinality-02 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-25-LTLCardinality-02 finished in 160398 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(G((F(G(p0)) U p0)))'
Support contains 1 out of 164 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 164/164 places, 625/625 transitions.
Graph (complete) has 68 edges and 164 vertex of which 147 are kept as prefixes of interest. Removing 17 places using SCC suffix rule.1 ms
Discarding 17 places :
Also discarding 0 output transitions
Applied a total of 1 rules in 8 ms. Remains 147 /164 variables (removed 17) and now considering 625/625 (removed 0) transitions.
// Phase 1: matrix 625 rows 147 cols
[2024-05-26 00:34:58] [INFO ] Invariants computation overflowed in 37 ms
[2024-05-26 00:34:58] [INFO ] Implicit Places using invariants in 215 ms returned []
// Phase 1: matrix 625 rows 147 cols
[2024-05-26 00:34:58] [INFO ] Invariants computation overflowed in 36 ms
[2024-05-26 00:36:01] [INFO ] Performed 96/147 implicitness test of which 0 returned IMPLICIT in 63 seconds.
[2024-05-26 00:36:49] [INFO ] Performed 97/147 implicitness test of which 1 returned IMPLICIT in 110 seconds.
[2024-05-26 00:37:38] [INFO ] Performed 145/147 implicitness test of which 2 returned IMPLICIT in 159 seconds.
[2024-05-26 00:37:38] [INFO ] Implicit Places using invariants and state equation in 160047 ms returned [97, 98]
Discarding 2 places :
Implicit Place search using SMT with State Equation took 160264 ms to find 2 implicit places.
Starting structural reductions in SI_LTL mode, iteration 1 : 145/164 places, 625/625 transitions.
Applied a total of 0 rules in 7 ms. Remains 145 /145 variables (removed 0) and now considering 625/625 (removed 0) transitions.
Finished structural reductions in SI_LTL mode , in 2 iterations and 160279 ms. Remains : 145/164 places, 625/625 transitions.
Stuttering acceptance computed with spot in 36 ms :[(NOT p0)]
Running random walk in product with property : NQueens-PT-25-LTLCardinality-03 automaton TGBA Formula[mat=[[{ cond=p0, acceptance={} source=0 dest: 0}, { cond=(NOT p0), acceptance={0} source=0 dest: 0}]], initial=0, aps=[p0:(EQ s139 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant], stateDesc=[null][true]]
Stuttering criterion allowed to conclude after 351 steps with 14 reset in 27 ms.
FORMULA NQueens-PT-25-LTLCardinality-03 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-25-LTLCardinality-03 finished in 160360 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!((X((X(p0) U !p1))||G(X(p1))))'
Support contains 4 out of 164 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 164/164 places, 625/625 transitions.
Reduce places removed 14 places and 0 transitions.
Iterating post reduction 0 with 14 rules applied. Total rules applied 14 place count 150 transition count 625
Applied a total of 14 rules in 5 ms. Remains 150 /164 variables (removed 14) and now considering 625/625 (removed 0) transitions.
// Phase 1: matrix 625 rows 150 cols
[2024-05-26 00:37:38] [INFO ] Invariants computation overflowed in 41 ms
[2024-05-26 00:37:38] [INFO ] Implicit Places using invariants in 223 ms returned []
// Phase 1: matrix 625 rows 150 cols
[2024-05-26 00:37:38] [INFO ] Invariants computation overflowed in 38 ms
[2024-05-26 00:39:10] [INFO ] Performed 99/150 implicitness test of which 0 returned IMPLICIT in 91 seconds.
[2024-05-26 00:40:18] [INFO ] Performed 100/150 implicitness test of which 1 returned IMPLICIT in 159 seconds.
[2024-05-26 00:40:18] [INFO ] Implicit Places using invariants and state equation in 160047 ms returned [100]
Discarding 1 places :
Implicit Place search using SMT with State Equation took 160272 ms to find 1 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 149/164 places, 625/625 transitions.
Applied a total of 0 rules in 3 ms. Remains 149 /149 variables (removed 0) and now considering 625/625 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 160281 ms. Remains : 149/164 places, 625/625 transitions.
Stuttering acceptance computed with spot in 152 ms :[true, false, false, (AND (NOT p1) (NOT p0)), (NOT p1)]
Running random walk in product with property : NQueens-PT-25-LTLCardinality-06 automaton TGBA Formula[mat=[[{ cond=true, acceptance={0} source=0 dest: 0}], [{ cond=true, acceptance={} source=1 dest: 2}], [{ cond=p1, acceptance={} source=2 dest: 3}], [{ cond=(AND (NOT p1) (NOT p0)), acceptance={} source=3 dest: 0}, { cond=(AND p1 p0), acceptance={} source=3 dest: 3}, { cond=(AND p1 (NOT p0)), acceptance={} source=3 dest: 4}], [{ cond=(NOT p1), acceptance={} source=4 dest: 0}, { cond=p1, acceptance={} source=4 dest: 4}]], initial=1, aps=[p1:(OR (EQ s2 0) (EQ s1 1)), p0:(OR (EQ s0 0) (EQ s31 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null, null][false, false, false, false, false]]
Product exploration explored 100000 steps with 4385 reset in 3940 ms.
Entered a terminal (fully accepting) state of product in 8422 steps with 370 reset in 331 ms.
FORMULA NQueens-PT-25-LTLCardinality-06 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-25-LTLCardinality-06 finished in 164722 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(X(F(p0))))'
Support contains 2 out of 164 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 164/164 places, 625/625 transitions.
Reduce places removed 15 places and 0 transitions.
Iterating post reduction 0 with 15 rules applied. Total rules applied 15 place count 149 transition count 625
Applied a total of 15 rules in 5 ms. Remains 149 /164 variables (removed 15) and now considering 625/625 (removed 0) transitions.
// Phase 1: matrix 625 rows 149 cols
[2024-05-26 00:40:23] [INFO ] Invariants computation overflowed in 46 ms
[2024-05-26 00:40:23] [INFO ] Implicit Places using invariants in 223 ms returned []
// Phase 1: matrix 625 rows 149 cols
[2024-05-26 00:40:23] [INFO ] Invariants computation overflowed in 57 ms
[2024-05-26 00:42:16] [INFO ] Performed 98/149 implicitness test of which 0 returned IMPLICIT in 113 seconds.
[2024-05-26 00:43:03] [INFO ] Performed 147/149 implicitness test of which 2 returned IMPLICIT in 159 seconds.
[2024-05-26 00:43:03] [INFO ] Implicit Places using invariants and state equation in 160072 ms returned [99, 100]
Discarding 2 places :
Implicit Place search using SMT with State Equation took 160298 ms to find 2 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 147/164 places, 625/625 transitions.
Applied a total of 0 rules in 9 ms. Remains 147 /147 variables (removed 0) and now considering 625/625 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 160313 ms. Remains : 147/164 places, 625/625 transitions.
Stuttering acceptance computed with spot in 96 ms :[(NOT p0), (NOT p0), (NOT p0)]
Running random walk in product with property : NQueens-PT-25-LTLCardinality-07 automaton TGBA Formula[mat=[[{ cond=(NOT p0), acceptance={0} source=0 dest: 0}], [{ cond=true, acceptance={} source=1 dest: 0}], [{ cond=true, acceptance={} source=2 dest: 1}]], initial=2, aps=[p0:(AND (EQ s0 0) (EQ s1 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null, null][false, false, false]]
Stuttering criterion allowed to conclude after 23 steps with 0 reset in 3 ms.
FORMULA NQueens-PT-25-LTLCardinality-07 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-25-LTLCardinality-07 finished in 160433 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(X(X(G(p0)))))'
Support contains 2 out of 164 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 164/164 places, 625/625 transitions.
Reduce places removed 15 places and 0 transitions.
Iterating post reduction 0 with 15 rules applied. Total rules applied 15 place count 149 transition count 625
Applied a total of 15 rules in 6 ms. Remains 149 /164 variables (removed 15) and now considering 625/625 (removed 0) transitions.
// Phase 1: matrix 625 rows 149 cols
[2024-05-26 00:43:03] [INFO ] Invariants computation overflowed in 40 ms
[2024-05-26 00:43:03] [INFO ] Implicit Places using invariants in 220 ms returned []
// Phase 1: matrix 625 rows 149 cols
[2024-05-26 00:43:04] [INFO ] Invariants computation overflowed in 42 ms
[2024-05-26 00:43:55] [INFO ] Performed 147/149 implicitness test of which 2 returned IMPLICIT in 51 seconds.
[2024-05-26 00:43:55] [INFO ] Implicit Places using invariants and state equation in 51761 ms returned [99, 100, 148]
Discarding 3 places :
Implicit Place search using SMT with State Equation took 51982 ms to find 3 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 146/164 places, 625/625 transitions.
Applied a total of 0 rules in 3 ms. Remains 146 /146 variables (removed 0) and now considering 625/625 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 51991 ms. Remains : 146/164 places, 625/625 transitions.
Stuttering acceptance computed with spot in 149 ms :[true, (NOT p0), (NOT p0), (NOT p0), (NOT p0)]
Running random walk in product with property : NQueens-PT-25-LTLCardinality-09 automaton TGBA Formula[mat=[[{ cond=true, acceptance={0} source=0 dest: 0}], [{ cond=(NOT p0), acceptance={} source=1 dest: 0}, { cond=p0, acceptance={} source=1 dest: 1}], [{ cond=true, acceptance={} source=2 dest: 1}], [{ cond=true, acceptance={} source=3 dest: 4}], [{ cond=true, acceptance={} source=4 dest: 2}]], initial=3, aps=[p0:(AND (EQ s1 0) (EQ s0 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, terminal, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null, null][false, false, false, false, false]]
Entered a terminal (fully accepting) state of product in 3 steps with 0 reset in 1 ms.
FORMULA NQueens-PT-25-LTLCardinality-09 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-25-LTLCardinality-09 finished in 52156 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(G(p0)))'
Support contains 2 out of 164 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 164/164 places, 625/625 transitions.
Reduce places removed 16 places and 0 transitions.
Iterating post reduction 0 with 16 rules applied. Total rules applied 16 place count 148 transition count 625
Applied a total of 16 rules in 6 ms. Remains 148 /164 variables (removed 16) and now considering 625/625 (removed 0) transitions.
// Phase 1: matrix 625 rows 148 cols
[2024-05-26 00:43:55] [INFO ] Invariants computation overflowed in 43 ms
[2024-05-26 00:43:56] [INFO ] Implicit Places using invariants in 212 ms returned []
// Phase 1: matrix 625 rows 148 cols
[2024-05-26 00:43:56] [INFO ] Invariants computation overflowed in 40 ms
[2024-05-26 00:45:42] [INFO ] Performed 97/148 implicitness test of which 0 returned IMPLICIT in 106 seconds.
[2024-05-26 00:46:36] [INFO ] Performed 98/148 implicitness test of which 0 returned IMPLICIT in 159 seconds.
[2024-05-26 00:46:36] [INFO ] Timeout of Implicit test with SMT after 159 seconds.
[2024-05-26 00:46:36] [INFO ] Implicit Places using invariants and state equation in 160059 ms returned []
Implicit Place search using SMT with State Equation took 160274 ms to find 0 implicit places.
// Phase 1: matrix 625 rows 148 cols
[2024-05-26 00:46:36] [INFO ] Invariants computation overflowed in 43 ms
[2024-05-26 00:46:36] [INFO ] Dead Transitions using invariants and state equation in 226 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 148/164 places, 625/625 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 160508 ms. Remains : 148/164 places, 625/625 transitions.
Stuttering acceptance computed with spot in 82 ms :[true, (NOT p0), (NOT p0)]
Running random walk in product with property : NQueens-PT-25-LTLCardinality-10 automaton TGBA Formula[mat=[[{ cond=true, acceptance={0} source=0 dest: 0}], [{ cond=true, acceptance={} source=1 dest: 2}], [{ cond=(NOT p0), acceptance={} source=2 dest: 0}, { cond=p0, acceptance={} source=2 dest: 2}]], initial=1, aps=[p0:(OR (EQ s34 0) (EQ s0 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, terminal, very-weak, weak, inherently-weak], stateDesc=[null, null, null][false, false, false]]
Entered a terminal (fully accepting) state of product in 1 steps with 0 reset in 1 ms.
FORMULA NQueens-PT-25-LTLCardinality-10 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-25-LTLCardinality-10 finished in 160611 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(G((F(p1)&&p0))))'
Support contains 3 out of 164 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 164/164 places, 625/625 transitions.
Reduce places removed 15 places and 0 transitions.
Iterating post reduction 0 with 15 rules applied. Total rules applied 15 place count 149 transition count 625
Applied a total of 15 rules in 5 ms. Remains 149 /164 variables (removed 15) and now considering 625/625 (removed 0) transitions.
// Phase 1: matrix 625 rows 149 cols
[2024-05-26 00:46:36] [INFO ] Invariants computation overflowed in 39 ms
[2024-05-26 00:46:36] [INFO ] Implicit Places using invariants in 217 ms returned []
// Phase 1: matrix 625 rows 149 cols
[2024-05-26 00:46:36] [INFO ] Invariants computation overflowed in 47 ms
[2024-05-26 00:47:17] [INFO ] Performed 98/149 implicitness test of which 0 returned IMPLICIT in 40 seconds.
[2024-05-26 00:47:50] [INFO ] Performed 99/149 implicitness test of which 1 returned IMPLICIT in 73 seconds.
[2024-05-26 00:49:16] [INFO ] Performed 100/149 implicitness test of which 2 returned IMPLICIT in 159 seconds.
[2024-05-26 00:49:16] [INFO ] Implicit Places using invariants and state equation in 160063 ms returned [99, 100]
Discarding 2 places :
Implicit Place search using SMT with State Equation took 160285 ms to find 2 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 147/164 places, 625/625 transitions.
Applied a total of 0 rules in 7 ms. Remains 147 /147 variables (removed 0) and now considering 625/625 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 160298 ms. Remains : 147/164 places, 625/625 transitions.
Stuttering acceptance computed with spot in 131 ms :[(OR (NOT p0) (NOT p1)), (OR (NOT p0) (NOT p1)), true, (NOT p1)]
Running random walk in product with property : NQueens-PT-25-LTLCardinality-11 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=p0, acceptance={} source=1 dest: 1}, { cond=(NOT p0), acceptance={} source=1 dest: 2}, { cond=(AND p0 (NOT p1)), acceptance={} source=1 dest: 3}], [{ cond=true, acceptance={0} source=2 dest: 2}], [{ cond=(NOT p1), acceptance={0} source=3 dest: 3}]], initial=0, aps=[p0:(AND (EQ s27 0) (EQ s0 1)), p1:(OR (EQ s0 0) (EQ s27 1) (EQ s1 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null][false, false, false, false]]
Entered a terminal (fully accepting) state of product in 1 steps with 0 reset in 1 ms.
FORMULA NQueens-PT-25-LTLCardinality-11 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-25-LTLCardinality-11 finished in 160452 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!((G((G(p1)||p0))||X((G(p1) U p2))))'
Support contains 3 out of 164 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 164/164 places, 625/625 transitions.
Reduce places removed 15 places and 0 transitions.
Iterating post reduction 0 with 15 rules applied. Total rules applied 15 place count 149 transition count 625
Applied a total of 15 rules in 6 ms. Remains 149 /164 variables (removed 15) and now considering 625/625 (removed 0) transitions.
// Phase 1: matrix 625 rows 149 cols
[2024-05-26 00:49:17] [INFO ] Computed 6 invariants in 47 ms
[2024-05-26 00:49:18] [INFO ] Implicit Places using invariants in 1533 ms returned []
[2024-05-26 00:49:18] [INFO ] Invariant cache hit.
[2024-05-26 00:49:35] [INFO ] Implicit Places using invariants and state equation in 16578 ms returned []
Implicit Place search using SMT with State Equation took 18112 ms to find 0 implicit places.
[2024-05-26 00:49:35] [INFO ] Invariant cache hit.
[2024-05-26 00:49:35] [INFO ] Dead Transitions using invariants and state equation in 715 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 149/164 places, 625/625 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 18836 ms. Remains : 149/164 places, 625/625 transitions.
Stuttering acceptance computed with spot in 241 ms :[(AND (NOT p0) (NOT p1) (NOT p2)), (NOT p2), (AND (NOT p1) (NOT p2)), (AND (NOT p0) (NOT p1) (NOT p2)), true, (NOT p1), (AND (NOT p1) (NOT p0))]
Running random walk in product with property : NQueens-PT-25-LTLCardinality-15 automaton TGBA Formula[mat=[[{ cond=(AND (NOT p0) (NOT p1)), acceptance={} source=0 dest: 1}, { cond=(AND (NOT p0) p1), acceptance={} source=0 dest: 2}, { cond=p0, acceptance={} source=0 dest: 3}], [{ cond=(AND p1 (NOT p2)), acceptance={0} source=1 dest: 1}, { cond=(AND (NOT p1) (NOT p2)), acceptance={0} source=1 dest: 4}, { cond=(AND p1 (NOT p2)), acceptance={0} source=1 dest: 5}], [{ cond=(AND (NOT p1) (NOT p2)), acceptance={} source=2 dest: 4}, { cond=(AND p1 (NOT p2)), acceptance={} source=2 dest: 5}], [{ cond=(AND (NOT p0) (NOT p1) (NOT p2)), acceptance={} source=3 dest: 4}, { cond=(AND (NOT p0) p1 (NOT p2)), acceptance={} source=3 dest: 5}, { cond=(AND p0 (NOT p2)), acceptance={} source=3 dest: 6}], [{ cond=true, acceptance={0} source=4 dest: 4}], [{ cond=(NOT p1), acceptance={} source=5 dest: 4}, { cond=p1, acceptance={} source=5 dest: 5}], [{ cond=(AND (NOT p0) (NOT p1)), acceptance={} source=6 dest: 4}, { cond=(AND (NOT p0) p1), acceptance={} source=6 dest: 5}, { cond=p0, acceptance={} source=6 dest: 6}]], initial=0, aps=[p0:(OR (EQ s1 0) (EQ s0 1)), p1:(OR (EQ s1 0) (EQ s0 1)), p2:(EQ s62 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null, null, null, null][false, false, false, false, false, false, false]]
Entered a terminal (fully accepting) state of product in 2065 steps with 892 reset in 137 ms.
FORMULA NQueens-PT-25-LTLCardinality-15 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-25-LTLCardinality-15 finished in 19242 ms.
All properties solved by simple procedures.
Total runtime 1361710 ms.
BK_STOP 1716684577123
--------------------
content from stderr:
+ export BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ LTLCardinality = StateSpace ]]
+ /home/mcc/BenchKit/bin//../itstools/bin//..//runeclipse.sh /home/mcc/execution LTLCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
+ export PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ export LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
+ LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202304061127.jar
+ VERSION=202304061127
+ echo 'Running Version 202304061127'
+ /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/its-tools -pnfolder /home/mcc/execution -examination LTLCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="NQueens-PT-25"
export BK_EXAMINATION="LTLCardinality"
export BK_TOOL="gold2023"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5568"
echo " Executing tool gold2023"
echo " Input is NQueens-PT-25, examination is LTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r263-tall-171654372400242"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/NQueens-PT-25.tgz
mv NQueens-PT-25 execution
cd execution
if [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "UpperBounds" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] || [ "LTLCardinality" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "LTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "LTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "LTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property LTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "LTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] ; then
echo "FORMULA_NAME LTLCardinality"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;