fond
Model Checking Contest 2024
14th edition, Geneva, Switzerland, June 25, 2024
Execution of r263-tall-171654372400237
Last Updated
July 7, 2024

About the Execution of 2023-gold for NQueens-PT-20

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
328.560 597766.00 610980.00 1701.80 FTFFFFFTFFFTFFTF normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/data/fkordon/mcc2024-input.r263-tall-171654372400237.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fkordon/mcc2024-input.qcow2 backing_fmt=qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-5568
Executing tool gold2023
Input is NQueens-PT-20, examination is LTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r263-tall-171654372400237
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 784K
-rw-r--r-- 1 mcc users 7.5K May 14 13:22 CTLCardinality.txt
-rw-r--r-- 1 mcc users 78K May 14 13:22 CTLCardinality.xml
-rw-r--r-- 1 mcc users 4.3K May 14 13:22 CTLFireability.txt
-rw-r--r-- 1 mcc users 31K May 14 13:22 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K May 18 16:43 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.5K May 18 16:43 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 3.6K Apr 23 07:40 LTLCardinality.txt
-rw-r--r-- 1 mcc users 26K Apr 23 07:40 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.6K May 19 07:23 LTLFireability.txt
-rw-r--r-- 1 mcc users 19K May 19 18:41 LTLFireability.xml
-rw-r--r-- 1 mcc users 12K Apr 12 03:29 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 122K Apr 12 03:29 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 8.8K Apr 12 03:26 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 63K Apr 12 03:26 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K Apr 23 07:40 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.6K Apr 23 07:40 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 18 16:43 equiv_col
-rw-r--r-- 1 mcc users 3 May 18 16:43 instance
-rw-r--r-- 1 mcc users 6 May 18 16:43 iscolored
-rw-r--r-- 1 mcc users 349K May 18 16:43 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME NQueens-PT-20-LTLCardinality-00
FORMULA_NAME NQueens-PT-20-LTLCardinality-01
FORMULA_NAME NQueens-PT-20-LTLCardinality-02
FORMULA_NAME NQueens-PT-20-LTLCardinality-03
FORMULA_NAME NQueens-PT-20-LTLCardinality-04
FORMULA_NAME NQueens-PT-20-LTLCardinality-05
FORMULA_NAME NQueens-PT-20-LTLCardinality-06
FORMULA_NAME NQueens-PT-20-LTLCardinality-07
FORMULA_NAME NQueens-PT-20-LTLCardinality-08
FORMULA_NAME NQueens-PT-20-LTLCardinality-09
FORMULA_NAME NQueens-PT-20-LTLCardinality-10
FORMULA_NAME NQueens-PT-20-LTLCardinality-11
FORMULA_NAME NQueens-PT-20-LTLCardinality-12
FORMULA_NAME NQueens-PT-20-LTLCardinality-13
FORMULA_NAME NQueens-PT-20-LTLCardinality-14
FORMULA_NAME NQueens-PT-20-LTLCardinality-15

=== Now, execution of the tool begins

BK_START 1716682576809

bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
Invoking MCC driver with
BK_TOOL=gold2023
BK_EXAMINATION=LTLCardinality
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=NQueens-PT-20
Not applying reductions.
Model is PT
LTLCardinality PT
Running Version 202304061127
[2024-05-26 00:16:18] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, LTLCardinality, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2024-05-26 00:16:18] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2024-05-26 00:16:18] [INFO ] Load time of PNML (sax parser for PT used): 77 ms
[2024-05-26 00:16:18] [INFO ] Transformed 520 places.
[2024-05-26 00:16:18] [INFO ] Transformed 400 transitions.
[2024-05-26 00:16:18] [INFO ] Found NUPN structural information;
[2024-05-26 00:16:18] [INFO ] Parsed PT model containing 520 places and 400 transitions and 2000 arcs in 143 ms.
Parsed 16 properties from file /home/mcc/execution/LTLCardinality.xml in 7 ms.
Working with output stream class java.io.PrintStream
Initial state reduction rules removed 3 formulas.
Reduce places removed 2 places and 0 transitions.
Initial state reduction rules removed 2 formulas.
FORMULA NQueens-PT-20-LTLCardinality-00 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-20-LTLCardinality-01 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-20-LTLCardinality-03 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-20-LTLCardinality-07 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-20-LTLCardinality-10 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-20-LTLCardinality-11 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-20-LTLCardinality-13 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-20-LTLCardinality-14 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-20-LTLCardinality-08 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Support contains 20 out of 518 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 518/518 places, 400/400 transitions.
Reduce places removed 385 places and 0 transitions.
Iterating post reduction 0 with 385 rules applied. Total rules applied 385 place count 133 transition count 400
Applied a total of 385 rules in 21 ms. Remains 133 /518 variables (removed 385) and now considering 400/400 (removed 0) transitions.
// Phase 1: matrix 400 rows 133 cols
[2024-05-26 00:16:18] [INFO ] Invariants computation overflowed in 70 ms
[2024-05-26 00:16:18] [INFO ] Implicit Places using invariants in 402 ms returned []
// Phase 1: matrix 400 rows 133 cols
[2024-05-26 00:16:19] [INFO ] Invariants computation overflowed in 45 ms
[2024-05-26 00:17:17] [INFO ] Performed 92/133 implicitness test of which 1 returned IMPLICIT in 58 seconds.
[2024-05-26 00:18:29] [INFO ] Performed 93/133 implicitness test of which 2 returned IMPLICIT in 130 seconds.
[2024-05-26 00:18:56] [INFO ] Implicit Places using invariants and state equation in 157216 ms returned [55, 93, 94, 132]
Discarding 4 places :
Implicit Place search using SMT with State Equation took 157649 ms to find 4 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 129/518 places, 400/400 transitions.
Applied a total of 0 rules in 11 ms. Remains 129 /129 variables (removed 0) and now considering 400/400 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 157681 ms. Remains : 129/518 places, 400/400 transitions.
Support contains 20 out of 129 places after structural reductions.
[2024-05-26 00:18:56] [INFO ] Flatten gal took : 69 ms
[2024-05-26 00:18:56] [INFO ] Flatten gal took : 41 ms
[2024-05-26 00:18:56] [INFO ] Input system was already deterministic with 400 transitions.
Finished random walk after 1152 steps, including 62 resets, run visited all 12 properties in 91 ms. (steps per millisecond=12 )
Parikh walk visited 0 properties in 1 ms.
Computed a total of 129 stabilizing places and 400 stable transitions
Complete graph has no SCC; deadlocks are unavoidable. place count 129 transition count 400
Detected that all paths lead to deadlock. Applying this knowledge to assert that all AP eventually converge (and all enablings converge to false).
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(F(G(((p1 U X(G(p1)))&&p0))))'
Support contains 2 out of 129 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 129/129 places, 400/400 transitions.
Graph (complete) has 60 edges and 129 vertex of which 116 are kept as prefixes of interest. Removing 13 places using SCC suffix rule.2 ms
Discarding 13 places :
Also discarding 0 output transitions
Applied a total of 1 rules in 14 ms. Remains 116 /129 variables (removed 13) and now considering 400/400 (removed 0) transitions.
// Phase 1: matrix 400 rows 116 cols
[2024-05-26 00:18:56] [INFO ] Invariants computation overflowed in 33 ms
[2024-05-26 00:18:57] [INFO ] Implicit Places using invariants in 247 ms returned []
// Phase 1: matrix 400 rows 116 cols
[2024-05-26 00:18:57] [INFO ] Invariants computation overflowed in 21 ms
[2024-05-26 00:19:34] [INFO ] Performed 78/116 implicitness test of which 0 returned IMPLICIT in 37 seconds.
[2024-05-26 00:19:52] [INFO ] Implicit Places using invariants and state equation in 55089 ms returned []
Implicit Place search using SMT with State Equation took 55342 ms to find 0 implicit places.
[2024-05-26 00:19:52] [INFO ] Redundant transitions in 25 ms returned []
// Phase 1: matrix 400 rows 116 cols
[2024-05-26 00:19:52] [INFO ] Invariants computation overflowed in 30 ms
[2024-05-26 00:19:52] [INFO ] Dead Transitions using invariants and state equation in 168 ms found 0 transitions.
Starting structural reductions in SI_LTL mode, iteration 1 : 116/129 places, 400/400 transitions.
Finished structural reductions in SI_LTL mode , in 1 iterations and 55566 ms. Remains : 116/129 places, 400/400 transitions.
ANTLR Tool version 4.9.3 used for code generation does not match the current runtime version 4.7.2ANTLR Runtime version 4.9.3 used for parser compilation does not match the current runtime version 4.7.2ANTLR Tool version 4.9.3 used for code generation does not match the current runtime version 4.7.2ANTLR Runtime version 4.9.3 used for parser compilation does not match the current runtime version 4.7.2Stuttering acceptance computed with spot in 185 ms :[(OR (NOT p0) (NOT p1)), (OR (NOT p0) (NOT p1))]
Running random walk in product with property : NQueens-PT-20-LTLCardinality-02 automaton TGBA Formula[mat=[[{ cond=(AND p0 p1), acceptance={} source=0 dest: 0}, { cond=(NOT p0), acceptance={0} source=0 dest: 0}, { cond=(AND p0 (NOT p1)), acceptance={} source=0 dest: 1}], [{ cond=(NOT p0), acceptance={0} source=1 dest: 0}, { cond=(AND p0 p1), acceptance={} source=1 dest: 1}, { cond=(AND p0 (NOT p1)), acceptance={0} source=1 dest: 1}]], initial=0, aps=[p0:(AND (EQ s1 1) (EQ s0 0)), p1:(EQ s1 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant], stateDesc=[null, null][true, true]]
Stuttering criterion allowed to conclude after 18 steps with 0 reset in 3 ms.
FORMULA NQueens-PT-20-LTLCardinality-02 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-20-LTLCardinality-02 finished in 55814 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(F(p0)))'
Support contains 2 out of 129 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 129/129 places, 400/400 transitions.
Reduce places removed 14 places and 0 transitions.
Iterating post reduction 0 with 14 rules applied. Total rules applied 14 place count 115 transition count 400
Applied a total of 14 rules in 7 ms. Remains 115 /129 variables (removed 14) and now considering 400/400 (removed 0) transitions.
// Phase 1: matrix 400 rows 115 cols
[2024-05-26 00:19:52] [INFO ] Invariants computation overflowed in 26 ms
[2024-05-26 00:19:52] [INFO ] Implicit Places using invariants in 302 ms returned []
// Phase 1: matrix 400 rows 115 cols
[2024-05-26 00:19:53] [INFO ] Invariants computation overflowed in 25 ms
[2024-05-26 00:20:47] [INFO ] Performed 114/115 implicitness test of which 0 returned IMPLICIT in 54 seconds.
[2024-05-26 00:20:47] [INFO ] Implicit Places using invariants and state equation in 54983 ms returned []
Implicit Place search using SMT with State Equation took 55290 ms to find 0 implicit places.
// Phase 1: matrix 400 rows 115 cols
[2024-05-26 00:20:47] [INFO ] Invariants computation overflowed in 24 ms
[2024-05-26 00:20:48] [INFO ] Dead Transitions using invariants and state equation in 169 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 115/129 places, 400/400 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 55474 ms. Remains : 115/129 places, 400/400 transitions.
Stuttering acceptance computed with spot in 80 ms :[(NOT p0), (NOT p0)]
Running random walk in product with property : NQueens-PT-20-LTLCardinality-04 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=(NOT p0), acceptance={0} source=1 dest: 1}]], initial=0, aps=[p0:(OR (EQ s36 0) (EQ s0 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null][false, false]]
Stuttering criterion allowed to conclude after 227 steps with 21 reset in 18 ms.
FORMULA NQueens-PT-20-LTLCardinality-04 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-20-LTLCardinality-04 finished in 55589 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(F(X(G(X(F((X(p0) U !p1)))))))'
Support contains 2 out of 129 places. Attempting structural reductions.
Property had overlarge support with respect to TGBA, discarding it for now.
Starting structural reductions in SI_LTL mode, iteration 0 : 129/129 places, 400/400 transitions.
Graph (complete) has 60 edges and 129 vertex of which 117 are kept as prefixes of interest. Removing 12 places using SCC suffix rule.1 ms
Discarding 12 places :
Also discarding 0 output transitions
Applied a total of 1 rules in 6 ms. Remains 117 /129 variables (removed 12) and now considering 400/400 (removed 0) transitions.
// Phase 1: matrix 400 rows 117 cols
[2024-05-26 00:20:48] [INFO ] Invariants computation overflowed in 27 ms
[2024-05-26 00:20:48] [INFO ] Implicit Places using invariants in 153 ms returned []
// Phase 1: matrix 400 rows 117 cols
[2024-05-26 00:20:48] [INFO ] Invariants computation overflowed in 19 ms
[2024-05-26 00:21:18] [INFO ] Performed 91/117 implicitness test of which 0 returned IMPLICIT in 30 seconds.
[2024-05-26 00:21:34] [INFO ] Implicit Places using invariants and state equation in 46235 ms returned []
Implicit Place search using SMT with State Equation took 46397 ms to find 0 implicit places.
[2024-05-26 00:21:34] [INFO ] Redundant transitions in 9 ms returned []
// Phase 1: matrix 400 rows 117 cols
[2024-05-26 00:21:34] [INFO ] Invariants computation overflowed in 24 ms
[2024-05-26 00:21:34] [INFO ] Dead Transitions using invariants and state equation in 164 ms found 0 transitions.
Starting structural reductions in SI_LTL mode, iteration 1 : 117/129 places, 400/400 transitions.
Finished structural reductions in SI_LTL mode , in 1 iterations and 46588 ms. Remains : 117/129 places, 400/400 transitions.
Stuttering acceptance computed with spot in 161 ms :[p1, p1]
Running random walk in product with property : NQueens-PT-20-LTLCardinality-05 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 0}, { cond=p1, acceptance={} source=0 dest: 1}], [{ cond=p1, acceptance={0} source=1 dest: 1}]], initial=0, aps=[p1:(OR (EQ s1 0) (EQ s0 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-invariant, very-weak, weak, inherently-weak], stateDesc=[null, null][true, true]]
Stuttering criterion allowed to conclude after 18 steps with 0 reset in 4 ms.
FORMULA NQueens-PT-20-LTLCardinality-05 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-20-LTLCardinality-05 finished in 46766 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(X(F((F(G(p1))&&p0)))))'
Support contains 3 out of 129 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 129/129 places, 400/400 transitions.
Reduce places removed 13 places and 0 transitions.
Iterating post reduction 0 with 13 rules applied. Total rules applied 13 place count 116 transition count 400
Applied a total of 13 rules in 9 ms. Remains 116 /129 variables (removed 13) and now considering 400/400 (removed 0) transitions.
// Phase 1: matrix 400 rows 116 cols
[2024-05-26 00:21:35] [INFO ] Invariants computation overflowed in 29 ms
[2024-05-26 00:21:35] [INFO ] Implicit Places using invariants in 173 ms returned []
// Phase 1: matrix 400 rows 116 cols
[2024-05-26 00:21:35] [INFO ] Invariants computation overflowed in 26 ms
[2024-05-26 00:22:03] [INFO ] Implicit Places using invariants and state equation in 27843 ms returned []
Implicit Place search using SMT with State Equation took 28029 ms to find 0 implicit places.
// Phase 1: matrix 400 rows 116 cols
[2024-05-26 00:22:03] [INFO ] Invariants computation overflowed in 27 ms
[2024-05-26 00:22:03] [INFO ] Dead Transitions using invariants and state equation in 168 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 116/129 places, 400/400 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 28207 ms. Remains : 116/129 places, 400/400 transitions.
Stuttering acceptance computed with spot in 213 ms :[(OR (NOT p0) (NOT p1)), (OR (NOT p0) (NOT p1)), (OR (NOT p0) (NOT p1)), (NOT p1), (NOT p0)]
Running random walk in product with property : NQueens-PT-20-LTLCardinality-06 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=true, acceptance={} source=1 dest: 2}], [{ cond=true, acceptance={} source=2 dest: 3}, { cond=(NOT p0), acceptance={} source=2 dest: 4}], [{ cond=p1, acceptance={} source=3 dest: 3}, { cond=(NOT p1), acceptance={0} source=3 dest: 3}], [{ cond=(NOT p0), acceptance={0} source=4 dest: 4}]], initial=0, aps=[p0:(AND (EQ s1 0) (EQ s86 1)), p1:(EQ s0 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-sensitive], stateDesc=[null, null, null, null, null][false, false, false, false, false]]
Stuttering criterion allowed to conclude after 17 steps with 0 reset in 3 ms.
FORMULA NQueens-PT-20-LTLCardinality-06 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-20-LTLCardinality-06 finished in 28448 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(F(p0)))'
Support contains 2 out of 129 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 129/129 places, 400/400 transitions.
Reduce places removed 13 places and 0 transitions.
Iterating post reduction 0 with 13 rules applied. Total rules applied 13 place count 116 transition count 400
Applied a total of 13 rules in 4 ms. Remains 116 /129 variables (removed 13) and now considering 400/400 (removed 0) transitions.
// Phase 1: matrix 400 rows 116 cols
[2024-05-26 00:22:03] [INFO ] Invariants computation overflowed in 21 ms
[2024-05-26 00:22:03] [INFO ] Implicit Places using invariants in 157 ms returned []
// Phase 1: matrix 400 rows 116 cols
[2024-05-26 00:22:03] [INFO ] Invariants computation overflowed in 26 ms
[2024-05-26 00:22:41] [INFO ] Performed 78/116 implicitness test of which 0 returned IMPLICIT in 38 seconds.
[2024-05-26 00:22:52] [INFO ] Implicit Places using invariants and state equation in 48498 ms returned []
Implicit Place search using SMT with State Equation took 48658 ms to find 0 implicit places.
// Phase 1: matrix 400 rows 116 cols
[2024-05-26 00:22:52] [INFO ] Invariants computation overflowed in 18 ms
[2024-05-26 00:22:52] [INFO ] Dead Transitions using invariants and state equation in 165 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 116/129 places, 400/400 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 48830 ms. Remains : 116/129 places, 400/400 transitions.
Stuttering acceptance computed with spot in 84 ms :[(NOT p0), (NOT p0)]
Running random walk in product with property : NQueens-PT-20-LTLCardinality-09 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=(NOT p0), acceptance={0} source=1 dest: 1}]], initial=0, aps=[p0:(AND (EQ s0 0) (EQ s1 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null][false, false]]
Stuttering criterion allowed to conclude after 17 steps with 0 reset in 2 ms.
FORMULA NQueens-PT-20-LTLCardinality-09 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-20-LTLCardinality-09 finished in 48936 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!((F(p0)&&G((F(G(p1))&&F(p2)))))'
Support contains 4 out of 129 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 129/129 places, 400/400 transitions.
Graph (complete) has 60 edges and 129 vertex of which 117 are kept as prefixes of interest. Removing 12 places using SCC suffix rule.2 ms
Discarding 12 places :
Also discarding 0 output transitions
Applied a total of 1 rules in 14 ms. Remains 117 /129 variables (removed 12) and now considering 400/400 (removed 0) transitions.
// Phase 1: matrix 400 rows 117 cols
[2024-05-26 00:22:52] [INFO ] Invariants computation overflowed in 24 ms
[2024-05-26 00:22:52] [INFO ] Implicit Places using invariants in 156 ms returned []
// Phase 1: matrix 400 rows 117 cols
[2024-05-26 00:22:52] [INFO ] Invariants computation overflowed in 21 ms
[2024-05-26 00:23:24] [INFO ] Performed 79/117 implicitness test of which 0 returned IMPLICIT in 32 seconds.
[2024-05-26 00:23:43] [INFO ] Implicit Places using invariants and state equation in 50642 ms returned []
Implicit Place search using SMT with State Equation took 50801 ms to find 0 implicit places.
[2024-05-26 00:23:43] [INFO ] Redundant transitions in 3 ms returned []
// Phase 1: matrix 400 rows 117 cols
[2024-05-26 00:23:43] [INFO ] Invariants computation overflowed in 23 ms
[2024-05-26 00:23:43] [INFO ] Dead Transitions using invariants and state equation in 162 ms found 0 transitions.
Starting structural reductions in SI_LTL mode, iteration 1 : 117/129 places, 400/400 transitions.
Finished structural reductions in SI_LTL mode , in 1 iterations and 50993 ms. Remains : 117/129 places, 400/400 transitions.
Stuttering acceptance computed with spot in 190 ms :[(OR (NOT p0) (NOT p1) (NOT p2)), (NOT p0), (NOT p1), (NOT p2), (OR (NOT p1) (NOT p2))]
Running random walk in product with property : NQueens-PT-20-LTLCardinality-12 automaton TGBA Formula[mat=[[{ cond=(NOT p0), acceptance={} source=0 dest: 1}, { cond=(NOT p1), acceptance={} source=0 dest: 2}, { cond=(NOT p2), acceptance={} source=0 dest: 3}, { cond=true, acceptance={} source=0 dest: 4}], [{ cond=(NOT p0), acceptance={0} source=1 dest: 1}], [{ cond=p1, acceptance={} source=2 dest: 2}, { cond=(NOT p1), acceptance={0} source=2 dest: 2}], [{ cond=(NOT p2), acceptance={0} source=3 dest: 3}], [{ cond=(NOT p1), acceptance={} source=4 dest: 2}, { cond=(NOT p2), acceptance={} source=4 dest: 3}, { cond=true, acceptance={} source=4 dest: 4}]], initial=0, aps=[p0:(OR (EQ s31 1) (EQ s0 0) (EQ s2 1)), p1:(EQ s1 0), p2:(EQ s31 1)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-invariant], stateDesc=[null, null, null, null, null][true, true, true, true, true]]
Stuttering criterion allowed to conclude after 18 steps with 0 reset in 1 ms.
FORMULA NQueens-PT-20-LTLCardinality-12 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-20-LTLCardinality-12 finished in 51210 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202304061127/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(X(G(p0))))'
Support contains 3 out of 129 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 129/129 places, 400/400 transitions.
Reduce places removed 13 places and 0 transitions.
Iterating post reduction 0 with 13 rules applied. Total rules applied 13 place count 116 transition count 400
Applied a total of 13 rules in 2 ms. Remains 116 /129 variables (removed 13) and now considering 400/400 (removed 0) transitions.
// Phase 1: matrix 400 rows 116 cols
[2024-05-26 00:23:43] [INFO ] Computed 3 invariants in 18 ms
[2024-05-26 00:23:43] [INFO ] Implicit Places using invariants in 335 ms returned []
[2024-05-26 00:23:43] [INFO ] Invariant cache hit.
[2024-05-26 00:26:13] [INFO ] Performed 115/116 implicitness test of which 0 returned IMPLICIT in 149 seconds.
[2024-05-26 00:26:13] [INFO ] Timeout of Implicit test with SMT after 149 seconds.
[2024-05-26 00:26:13] [INFO ] Implicit Places using invariants and state equation in 149359 ms returned []
Implicit Place search using SMT with State Equation took 149699 ms to find 0 implicit places.
[2024-05-26 00:26:13] [INFO ] Invariant cache hit.
[2024-05-26 00:26:13] [INFO ] Dead Transitions using invariants and state equation in 170 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 116/129 places, 400/400 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 149878 ms. Remains : 116/129 places, 400/400 transitions.
Stuttering acceptance computed with spot in 126 ms :[true, (NOT p0), (NOT p0), (NOT p0)]
Running random walk in product with property : NQueens-PT-20-LTLCardinality-15 automaton TGBA Formula[mat=[[{ cond=true, acceptance={0} source=0 dest: 0}], [{ cond=(NOT p0), acceptance={} source=1 dest: 0}, { cond=p0, acceptance={} source=1 dest: 1}], [{ cond=true, acceptance={} source=2 dest: 1}], [{ cond=true, acceptance={} source=3 dest: 2}]], initial=3, aps=[p0:(AND (NEQ s1 1) (EQ s0 0) (EQ s61 1))], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, terminal, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null][false, false, false, false]]
Entered a terminal (fully accepting) state of product in 26 steps with 1 reset in 2 ms.
FORMULA NQueens-PT-20-LTLCardinality-15 FALSE TECHNIQUES STUTTER_TEST
Treatment of property NQueens-PT-20-LTLCardinality-15 finished in 150020 ms.
All properties solved by simple procedures.
Total runtime 595375 ms.

BK_STOP 1716683174575

--------------------
content from stderr:

+ export BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ LTLCardinality = StateSpace ]]
+ /home/mcc/BenchKit/bin//../itstools/bin//..//runeclipse.sh /home/mcc/execution LTLCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
+ export PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ export LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
+ LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202304061127.jar
+ VERSION=202304061127
+ echo 'Running Version 202304061127'
+ /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/its-tools -pnfolder /home/mcc/execution -examination LTLCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="NQueens-PT-20"
export BK_EXAMINATION="LTLCardinality"
export BK_TOOL="gold2023"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5568"
echo " Executing tool gold2023"
echo " Input is NQueens-PT-20, examination is LTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r263-tall-171654372400237"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/NQueens-PT-20.tgz
mv NQueens-PT-20 execution
cd execution
if [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "UpperBounds" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] || [ "LTLCardinality" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "LTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "LTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "LTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property LTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "LTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' LTLCardinality.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] ; then
echo "FORMULA_NAME LTLCardinality"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;