About the Execution of ITS-Tools for AirplaneLD-PT-4000
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
2783.203 | 77068.00 | 115077.00 | 579.50 | TFFTTFTFFFFTFFFF | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/data/fkordon/mcc2023-input.r005-oct2-167813592900307.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=4294967296 backing_file=/data/fkordon/mcc2023-input.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
....................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-5348
Executing tool itstools
Input is AirplaneLD-PT-4000, examination is LTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r005-oct2-167813592900307
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 89M
-rw-r--r-- 1 mcc users 2.8M Feb 26 15:13 CTLCardinality.txt
-rw-r--r-- 1 mcc users 8.9M Feb 26 15:13 CTLCardinality.xml
-rw-r--r-- 1 mcc users 1.6M Feb 26 13:29 CTLFireability.txt
-rw-r--r-- 1 mcc users 8.7M Feb 26 13:29 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K Jan 29 11:40 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.5K Jan 29 11:40 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 734K Feb 25 15:31 LTLCardinality.txt
-rw-r--r-- 1 mcc users 1.7M Feb 25 15:31 LTLCardinality.xml
-rw-r--r-- 1 mcc users 1.1M Feb 25 15:31 LTLFireability.txt
-rw-r--r-- 1 mcc users 4.1M Feb 25 15:31 LTLFireability.xml
-rw-r--r-- 1 mcc users 5.3M Feb 26 19:56 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 17M Feb 26 19:56 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 3.0M Feb 26 17:42 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 17M Feb 26 17:42 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 191K Feb 25 15:31 UpperBounds.txt
-rw-r--r-- 1 mcc users 358K Feb 25 15:31 UpperBounds.xml
-rw-r--r-- 1 mcc users 5 Mar 5 18:22 equiv_col
-rw-r--r-- 1 mcc users 5 Mar 5 18:22 instance
-rw-r--r-- 1 mcc users 6 Mar 5 18:22 iscolored
-rw-r--r-- 1 mcc users 18M Mar 5 18:22 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-00
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-01
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-02
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-03
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-04
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-05
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-06
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-07
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-08
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-09
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-10
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-11
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-12
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-13
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-14
FORMULA_NAME AirplaneLD-PT-4000-LTLCardinality-15
=== Now, execution of the tool begins
BK_START 1678508614398
bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
Invoking MCC driver with
BK_TOOL=itstools
BK_EXAMINATION=LTLCardinality
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=AirplaneLD-PT-4000
Not applying reductions.
Model is PT
LTLCardinality PT
Running Version 202303021504
[2023-03-11 04:23:38] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, LTLCardinality, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2023-03-11 04:23:38] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2023-03-11 04:23:38] [INFO ] Load time of PNML (sax parser for PT used): 808 ms
[2023-03-11 04:23:38] [INFO ] Transformed 28019 places.
[2023-03-11 04:23:39] [INFO ] Transformed 32008 transitions.
[2023-03-11 04:23:39] [INFO ] Parsed PT model containing 28019 places and 32008 transitions and 122028 arcs in 1075 ms.
Parsed 16 properties from file /home/mcc/execution/LTLCardinality.xml in 2347 ms.
Working with output stream class java.io.PrintStream
Initial state reduction rules removed 3 formulas.
Reduce places removed 12002 places and 0 transitions.
FORMULA AirplaneLD-PT-4000-LTLCardinality-01 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA AirplaneLD-PT-4000-LTLCardinality-05 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA AirplaneLD-PT-4000-LTLCardinality-09 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA AirplaneLD-PT-4000-LTLCardinality-13 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Support contains 8017 out of 16017 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 16017/16017 places, 32008/32008 transitions.
Discarding 7997 places :
Symmetric choice reduction at 0 with 7997 rule applications. Total rules 7997 place count 8020 transition count 24011
Iterating global reduction 0 with 7997 rules applied. Total rules applied 15994 place count 8020 transition count 24011
Ensure Unique test removed 7997 transitions
Reduce isomorphic transitions removed 7997 transitions.
Iterating post reduction 0 with 7997 rules applied. Total rules applied 23991 place count 8020 transition count 16014
Applied a total of 23991 rules in 688 ms. Remains 8020 /16017 variables (removed 7997) and now considering 16014/32008 (removed 15994) transitions.
// Phase 1: matrix 16014 rows 8020 cols
[2023-03-11 04:23:50] [INFO ] Computed 3 place invariants in 8004 ms
[2023-03-11 04:23:51] [INFO ] Implicit Places using invariants in 9028 ms returned []
Implicit Place search using SMT only with invariants took 9068 ms to find 0 implicit places.
[2023-03-11 04:23:51] [INFO ] Invariant cache hit.
[2023-03-11 04:24:10] [INFO ] Dead Transitions using invariants and state equation in 18817 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 8020/16017 places, 16014/32008 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 28582 ms. Remains : 8020/16017 places, 16014/32008 transitions.
Support contains 8017 out of 8020 places after structural reductions.
[2023-03-11 04:24:11] [INFO ] Flatten gal took : 853 ms
[2023-03-11 04:24:12] [INFO ] Flatten gal took : 519 ms
[2023-03-11 04:24:13] [INFO ] Input system was already deterministic with 16014 transitions.
Support contains 8016 out of 8020 places (down from 8017) after GAL structural reductions.
Incomplete random walk after 10000 steps, including 1265 resets, run finished after 13170 ms. (steps per millisecond=0 ) properties (out of 20) seen :14
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 20 ms. (steps per millisecond=500 ) properties (out of 6) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 15 ms. (steps per millisecond=666 ) properties (out of 6) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 13 ms. (steps per millisecond=769 ) properties (out of 6) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 570 ms. (steps per millisecond=17 ) properties (out of 6) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 41 ms. (steps per millisecond=243 ) properties (out of 6) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 19 ms. (steps per millisecond=526 ) properties (out of 6) seen :0
Running SMT prover for 6 properties.
[2023-03-11 04:24:27] [INFO ] Invariant cache hit.
[2023-03-11 04:24:30] [INFO ] [Real]Absence check using 2 positive place invariants in 5 ms returned sat
[2023-03-11 04:24:30] [INFO ] [Real]Absence check using 2 positive and 1 generalized place invariants in 2 ms returned sat
[2023-03-11 04:24:45] [INFO ] After 17160ms SMT Verify possible using all constraints in real domain returned unsat :6 sat :0
Fused 6 Parikh solutions to 0 different solutions.
Parikh walk visited 0 properties in 1 ms.
Successfully simplified 6 atomic propositions for a total of 12 simplifications.
Initial state reduction rules removed 1 formulas.
FORMULA AirplaneLD-PT-4000-LTLCardinality-00 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA AirplaneLD-PT-4000-LTLCardinality-03 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA AirplaneLD-PT-4000-LTLCardinality-06 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA AirplaneLD-PT-4000-LTLCardinality-07 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA AirplaneLD-PT-4000-LTLCardinality-11 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Computed a total of 8020 stabilizing places and 16014 stable transitions
Complete graph has no SCC; deadlocks are unavoidable. place count 8020 transition count 16014
Detected that all paths lead to deadlock. Applying this knowledge to assert that all AP eventually converge (and all enablings converge to false).
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(X(F((p0||G((F(p0)&&F(G(p1)))))))))'
Support contains 1 out of 8020 places. Attempting structural reductions.
Property had overlarge support with respect to TGBA, discarding it for now.
Starting structural reductions in LTL mode, iteration 0 : 8020/8020 places, 16014/16014 transitions.
Reduce places removed 1 places and 0 transitions.
Iterating post reduction 0 with 1 rules applied. Total rules applied 1 place count 8019 transition count 16014
Discarding 7997 places :
Symmetric choice reduction at 1 with 7997 rule applications. Total rules 7998 place count 22 transition count 8017
Iterating global reduction 1 with 7997 rules applied. Total rules applied 15995 place count 22 transition count 8017
Ensure Unique test removed 7997 transitions
Reduce isomorphic transitions removed 7997 transitions.
Iterating post reduction 1 with 7997 rules applied. Total rules applied 23992 place count 22 transition count 20
Applied a total of 23992 rules in 230 ms. Remains 22 /8020 variables (removed 7998) and now considering 20/16014 (removed 15994) transitions.
// Phase 1: matrix 20 rows 22 cols
[2023-03-11 04:24:46] [INFO ] Computed 2 place invariants in 0 ms
[2023-03-11 04:24:46] [INFO ] Implicit Places using invariants in 53 ms returned []
[2023-03-11 04:24:46] [INFO ] Invariant cache hit.
[2023-03-11 04:24:46] [INFO ] Implicit Places using invariants and state equation in 44 ms returned []
Implicit Place search using SMT with State Equation took 103 ms to find 0 implicit places.
[2023-03-11 04:24:46] [INFO ] Invariant cache hit.
[2023-03-11 04:24:46] [INFO ] Dead Transitions using invariants and state equation in 35 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 22/8020 places, 20/16014 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 370 ms. Remains : 22/8020 places, 20/16014 transitions.
Stuttering acceptance computed with spot in 370 ms :[(NOT p0), (NOT p0), (NOT p0)]
Running random walk in product with property : AirplaneLD-PT-4000-LTLCardinality-02 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 2}], [{ cond=true, acceptance={} source=1 dest: 0}], [{ cond=(NOT p0), acceptance={0} source=2 dest: 2}]], initial=1, aps=[p0:(LEQ 1 s0)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null, null][false, false, false]]
Stuttering criterion allowed to conclude after 10 steps with 1 reset in 3 ms.
FORMULA AirplaneLD-PT-4000-LTLCardinality-02 FALSE TECHNIQUES STUTTER_TEST
Treatment of property AirplaneLD-PT-4000-LTLCardinality-02 finished in 844 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(F(G(p0)))'
Support contains 1 out of 8020 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 8020/8020 places, 16014/16014 transitions.
Graph (complete) has 22032 edges and 8020 vertex of which 1 are kept as prefixes of interest. Removing 8019 places using SCC suffix rule.56 ms
Discarding 8019 places :
Also discarding 12014 output transitions
Drop transitions removed 12014 transitions
Ensure Unique test removed 3999 transitions
Reduce isomorphic transitions removed 3999 transitions.
Iterating post reduction 0 with 3999 rules applied. Total rules applied 4000 place count 1 transition count 1
Applied a total of 4000 rules in 108 ms. Remains 1 /8020 variables (removed 8019) and now considering 1/16014 (removed 16013) transitions.
// Phase 1: matrix 1 rows 1 cols
[2023-03-11 04:24:46] [INFO ] Computed 0 place invariants in 1 ms
[2023-03-11 04:24:46] [INFO ] Implicit Places using invariants in 28 ms returned []
[2023-03-11 04:24:46] [INFO ] Invariant cache hit.
[2023-03-11 04:24:46] [INFO ] Implicit Places using invariants and state equation in 26 ms returned []
Implicit Place search using SMT with State Equation took 56 ms to find 0 implicit places.
[2023-03-11 04:24:46] [INFO ] Redundant transitions in 0 ms returned []
[2023-03-11 04:24:46] [INFO ] Invariant cache hit.
[2023-03-11 04:24:47] [INFO ] Dead Transitions using invariants and state equation in 27 ms found 0 transitions.
Starting structural reductions in SI_LTL mode, iteration 1 : 1/8020 places, 1/16014 transitions.
Finished structural reductions in SI_LTL mode , in 1 iterations and 199 ms. Remains : 1/8020 places, 1/16014 transitions.
Stuttering acceptance computed with spot in 65 ms :[(NOT p0)]
Running random walk in product with property : AirplaneLD-PT-4000-LTLCardinality-04 automaton TGBA Formula[mat=[[{ cond=p0, acceptance={} source=0 dest: 0}, { cond=(NOT p0), acceptance={0} source=0 dest: 0}]], initial=0, aps=[p0:(GT 1 s0)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant], stateDesc=[null][true]]
Product exploration explored 100000 steps with 50000 reset in 157 ms.
Product exploration explored 100000 steps with 50000 reset in 88 ms.
Computed a total of 1 stabilizing places and 1 stable transitions
Complete graph has no SCC; deadlocks are unavoidable. place count 1 transition count 1
Detected that all paths lead to deadlock. Applying this knowledge to assert that all AP eventually converge (and all enablings converge to false).
Detected that all paths lead to deadlock. Applying this knowledge to assert that all AP eventually converge : F ( (Ga|G!a) & (Gb|G!b)...)
Knowledge obtained : [(NOT p0), (X p0), (X (X p0)), (F (G p0))]
False Knowledge obtained : []
Property proved to be true thanks to knowledge :(F (G p0))
Knowledge based reduction with 4 factoid took 136 ms. Reduced automaton from 1 states, 2 edges and 1 AP (stutter insensitive) to 1 states, 0 edges and 0 AP (stutter insensitive).
FORMULA AirplaneLD-PT-4000-LTLCardinality-04 TRUE TECHNIQUES KNOWLEDGE
Treatment of property AirplaneLD-PT-4000-LTLCardinality-04 finished in 732 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!((X(X(G((p0||X(p1)))))&&F(p1)))'
Support contains 3 out of 8020 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 8020/8020 places, 16014/16014 transitions.
Reduce places removed 3 places and 0 transitions.
Iterating post reduction 0 with 3 rules applied. Total rules applied 3 place count 8017 transition count 16014
Discarding 7998 places :
Symmetric choice reduction at 1 with 7998 rule applications. Total rules 8001 place count 19 transition count 8016
Iterating global reduction 1 with 7998 rules applied. Total rules applied 15999 place count 19 transition count 8016
Ensure Unique test removed 7998 transitions
Reduce isomorphic transitions removed 7998 transitions.
Iterating post reduction 1 with 7998 rules applied. Total rules applied 23997 place count 19 transition count 18
Applied a total of 23997 rules in 274 ms. Remains 19 /8020 variables (removed 8001) and now considering 18/16014 (removed 15996) transitions.
// Phase 1: matrix 18 rows 19 cols
[2023-03-11 04:24:47] [INFO ] Computed 1 place invariants in 1 ms
[2023-03-11 04:24:47] [INFO ] Implicit Places using invariants in 38 ms returned [18]
Discarding 1 places :
Implicit Place search using SMT only with invariants took 43 ms to find 1 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 18/8020 places, 18/16014 transitions.
Applied a total of 0 rules in 0 ms. Remains 18 /18 variables (removed 0) and now considering 18/18 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 317 ms. Remains : 18/8020 places, 18/16014 transitions.
Stuttering acceptance computed with spot in 351 ms :[(NOT p1), (AND (NOT p1) (NOT p0)), (NOT p1), (AND (NOT p0) (NOT p1)), (NOT p1), true]
Running random walk in product with property : AirplaneLD-PT-4000-LTLCardinality-08 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 1}, { cond=(NOT p1), acceptance={} source=0 dest: 2}], [{ cond=true, acceptance={} source=1 dest: 3}], [{ cond=(NOT p1), acceptance={0} source=2 dest: 2}], [{ cond=true, acceptance={} source=3 dest: 3}, { cond=(NOT p0), acceptance={} source=3 dest: 4}], [{ cond=(NOT p1), acceptance={} source=4 dest: 5}], [{ cond=true, acceptance={0} source=5 dest: 5}]], initial=0, aps=[p1:(GT 1 s14), p0:(GT s9 s16)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null, null, null][false, false, false, false, false, false]]
Entered a terminal (fully accepting) state of product in 18628 steps with 3347 reset in 69 ms.
FORMULA AirplaneLD-PT-4000-LTLCardinality-08 FALSE TECHNIQUES STUTTER_TEST
Treatment of property AirplaneLD-PT-4000-LTLCardinality-08 finished in 769 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(X(X(F((p0&&X((p1&&X(p1)))))))))'
Support contains 3 out of 8020 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 8020/8020 places, 16014/16014 transitions.
Reduce places removed 2 places and 0 transitions.
Iterating post reduction 0 with 2 rules applied. Total rules applied 2 place count 8018 transition count 16014
Discarding 7998 places :
Symmetric choice reduction at 1 with 7998 rule applications. Total rules 8000 place count 20 transition count 8016
Iterating global reduction 1 with 7998 rules applied. Total rules applied 15998 place count 20 transition count 8016
Ensure Unique test removed 7998 transitions
Reduce isomorphic transitions removed 7998 transitions.
Iterating post reduction 1 with 7998 rules applied. Total rules applied 23996 place count 20 transition count 18
Applied a total of 23996 rules in 312 ms. Remains 20 /8020 variables (removed 8000) and now considering 18/16014 (removed 15996) transitions.
// Phase 1: matrix 18 rows 20 cols
[2023-03-11 04:24:48] [INFO ] Computed 2 place invariants in 1 ms
[2023-03-11 04:24:48] [INFO ] Implicit Places using invariants in 56 ms returned [19]
Discarding 1 places :
Implicit Place search using SMT only with invariants took 57 ms to find 1 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 19/8020 places, 18/16014 transitions.
Applied a total of 0 rules in 0 ms. Remains 19 /19 variables (removed 0) and now considering 18/18 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 370 ms. Remains : 19/8020 places, 18/16014 transitions.
Stuttering acceptance computed with spot in 381 ms :[(NOT p1), (NOT p1), (OR (NOT p0) (NOT p1)), (OR (NOT p0) (NOT p1)), (OR (NOT p1) (NOT p0)), (OR (NOT p1) (NOT p0))]
Running random walk in product with property : AirplaneLD-PT-4000-LTLCardinality-10 automaton TGBA Formula[mat=[[{ cond=(AND p0 (NOT p1)), acceptance={0} source=0 dest: 1}, { cond=(AND (NOT p0) (NOT p1)), acceptance={0} source=0 dest: 2}], [{ cond=p1, acceptance={0} source=1 dest: 0}, { cond=(AND p0 (NOT p1)), acceptance={0} source=1 dest: 1}, { cond=(AND (NOT p0) (NOT p1)), acceptance={0} source=1 dest: 2}], [{ cond=p0, acceptance={0} source=2 dest: 1}, { cond=(NOT p0), acceptance={0} source=2 dest: 2}], [{ cond=true, acceptance={} source=3 dest: 2}], [{ cond=true, acceptance={} source=4 dest: 5}], [{ cond=true, acceptance={} source=5 dest: 3}]], initial=4, aps=[p0:(GT 1 s5), p1:(GT s18 s15)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, weak, inherently-weak], stateDesc=[null, null, null, null, null, null][false, false, false, false, false, false]]
Stuttering criterion allowed to conclude after 6 steps with 0 reset in 0 ms.
FORMULA AirplaneLD-PT-4000-LTLCardinality-10 FALSE TECHNIQUES STUTTER_TEST
Treatment of property AirplaneLD-PT-4000-LTLCardinality-10 finished in 797 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(X((G(p0) U G(p1)))))'
Support contains 3 out of 8020 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 8020/8020 places, 16014/16014 transitions.
Reduce places removed 3 places and 0 transitions.
Iterating post reduction 0 with 3 rules applied. Total rules applied 3 place count 8017 transition count 16014
Discarding 7997 places :
Symmetric choice reduction at 1 with 7997 rule applications. Total rules 8000 place count 20 transition count 8017
Iterating global reduction 1 with 7997 rules applied. Total rules applied 15997 place count 20 transition count 8017
Ensure Unique test removed 7997 transitions
Reduce isomorphic transitions removed 7997 transitions.
Iterating post reduction 1 with 7997 rules applied. Total rules applied 23994 place count 20 transition count 20
Applied a total of 23994 rules in 267 ms. Remains 20 /8020 variables (removed 8000) and now considering 20/16014 (removed 15994) transitions.
// Phase 1: matrix 20 rows 20 cols
[2023-03-11 04:24:49] [INFO ] Computed 1 place invariants in 1 ms
[2023-03-11 04:24:49] [INFO ] Implicit Places using invariants in 56 ms returned [19]
Discarding 1 places :
Implicit Place search using SMT only with invariants took 59 ms to find 1 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 19/8020 places, 20/16014 transitions.
Applied a total of 0 rules in 0 ms. Remains 19 /19 variables (removed 0) and now considering 20/20 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 326 ms. Remains : 19/8020 places, 20/16014 transitions.
Stuttering acceptance computed with spot in 343 ms :[(NOT p1), (NOT p1), (NOT p1), true, (AND p1 (NOT p0)), (NOT p1)]
Running random walk in product with property : AirplaneLD-PT-4000-LTLCardinality-12 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=true, acceptance={} source=1 dest: 2}], [{ cond=(AND p1 p0), acceptance={} source=2 dest: 2}, { cond=(AND (NOT p1) p0), acceptance={0} source=2 dest: 2}, { cond=(AND (NOT p1) (NOT p0)), acceptance={} source=2 dest: 3}, { cond=(AND (NOT p1) p0), acceptance={} source=2 dest: 4}, { cond=(AND p1 (NOT p0)), acceptance={} source=2 dest: 5}], [{ cond=true, acceptance={0} source=3 dest: 3}], [{ cond=(AND p1 (NOT p0)), acceptance={} source=4 dest: 3}, { cond=(AND p1 p0), acceptance={} source=4 dest: 4}], [{ cond=(NOT p1), acceptance={} source=5 dest: 3}, { cond=p1, acceptance={} source=5 dest: 5}]], initial=0, aps=[p1:(LEQ 1 s3), p0:(GT s6 s16)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-sensitive], stateDesc=[null, null, null, null, null, null][false, false, false, false, false, false]]
Entered a terminal (fully accepting) state of product in 2 steps with 0 reset in 0 ms.
FORMULA AirplaneLD-PT-4000-LTLCardinality-12 FALSE TECHNIQUES STUTTER_TEST
Treatment of property AirplaneLD-PT-4000-LTLCardinality-12 finished in 718 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(X(F(p0)))'
Support contains 1 out of 8020 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 8020/8020 places, 16014/16014 transitions.
Reduce places removed 3 places and 0 transitions.
Iterating post reduction 0 with 3 rules applied. Total rules applied 3 place count 8017 transition count 16014
Discarding 7998 places :
Symmetric choice reduction at 1 with 7998 rule applications. Total rules 8001 place count 19 transition count 8016
Iterating global reduction 1 with 7998 rules applied. Total rules applied 15999 place count 19 transition count 8016
Ensure Unique test removed 7998 transitions
Reduce isomorphic transitions removed 7998 transitions.
Iterating post reduction 1 with 7998 rules applied. Total rules applied 23997 place count 19 transition count 18
Applied a total of 23997 rules in 221 ms. Remains 19 /8020 variables (removed 8001) and now considering 18/16014 (removed 15996) transitions.
// Phase 1: matrix 18 rows 19 cols
[2023-03-11 04:24:50] [INFO ] Computed 1 place invariants in 0 ms
[2023-03-11 04:24:50] [INFO ] Implicit Places using invariants in 101 ms returned [18]
Discarding 1 places :
Implicit Place search using SMT only with invariants took 103 ms to find 1 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 18/8020 places, 18/16014 transitions.
Applied a total of 0 rules in 0 ms. Remains 18 /18 variables (removed 0) and now considering 18/18 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 324 ms. Remains : 18/8020 places, 18/16014 transitions.
Stuttering acceptance computed with spot in 128 ms :[(NOT p0), (NOT p0)]
Running random walk in product with property : AirplaneLD-PT-4000-LTLCardinality-14 automaton TGBA Formula[mat=[[{ cond=true, acceptance={} source=0 dest: 1}], [{ cond=(NOT p0), acceptance={0} source=1 dest: 1}]], initial=0, aps=[p0:(LEQ 1 s16)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-sensitive, very-weak, weak, inherently-weak], stateDesc=[null, null][false, false]]
Stuttering criterion allowed to conclude after 6 steps with 0 reset in 0 ms.
FORMULA AirplaneLD-PT-4000-LTLCardinality-14 FALSE TECHNIQUES STUTTER_TEST
Treatment of property AirplaneLD-PT-4000-LTLCardinality-14 finished in 488 ms.
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!((F(p0)&&G(F(p1))))'
Support contains 5 out of 8020 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 8020/8020 places, 16014/16014 transitions.
Graph (complete) has 22032 edges and 8020 vertex of which 4015 are kept as prefixes of interest. Removing 4005 places using SCC suffix rule.21 ms
Discarding 4005 places :
Also discarding 8000 output transitions
Drop transitions removed 8000 transitions
Discarding 3998 places :
Symmetric choice reduction at 0 with 3998 rule applications. Total rules 3999 place count 17 transition count 4016
Iterating global reduction 0 with 3998 rules applied. Total rules applied 7997 place count 17 transition count 4016
Ensure Unique test removed 3998 transitions
Reduce isomorphic transitions removed 3998 transitions.
Iterating post reduction 0 with 3998 rules applied. Total rules applied 11995 place count 17 transition count 18
Applied a total of 11995 rules in 191 ms. Remains 17 /8020 variables (removed 8003) and now considering 18/16014 (removed 15996) transitions.
// Phase 1: matrix 18 rows 17 cols
[2023-03-11 04:24:50] [INFO ] Computed 1 place invariants in 3 ms
[2023-03-11 04:24:50] [INFO ] Implicit Places using invariants in 48 ms returned [16]
Discarding 1 places :
Implicit Place search using SMT only with invariants took 49 ms to find 1 implicit places.
Starting structural reductions in SI_LTL mode, iteration 1 : 16/8020 places, 18/16014 transitions.
Graph (complete) has 14 edges and 16 vertex of which 15 are kept as prefixes of interest. Removing 1 places using SCC suffix rule.1 ms
Discarding 1 places :
Also discarding 1 output transitions
Drop transitions removed 1 transitions
Applied a total of 1 rules in 3 ms. Remains 15 /16 variables (removed 1) and now considering 17/18 (removed 1) transitions.
// Phase 1: matrix 17 rows 15 cols
[2023-03-11 04:24:50] [INFO ] Computed 0 place invariants in 1 ms
[2023-03-11 04:24:50] [INFO ] Implicit Places using invariants in 30 ms returned []
[2023-03-11 04:24:50] [INFO ] Invariant cache hit.
[2023-03-11 04:24:50] [INFO ] Implicit Places using invariants and state equation in 41 ms returned []
Implicit Place search using SMT with State Equation took 73 ms to find 0 implicit places.
Starting structural reductions in SI_LTL mode, iteration 2 : 15/8020 places, 17/16014 transitions.
Finished structural reductions in SI_LTL mode , in 2 iterations and 316 ms. Remains : 15/8020 places, 17/16014 transitions.
Stuttering acceptance computed with spot in 207 ms :[(OR (NOT p0) (NOT p1)), (NOT p0), (NOT p1), (NOT p1)]
Running random walk in product with property : AirplaneLD-PT-4000-LTLCardinality-15 automaton TGBA Formula[mat=[[{ cond=(NOT p0), acceptance={} source=0 dest: 1}, { cond=(NOT p1), acceptance={} source=0 dest: 2}, { cond=true, acceptance={} source=0 dest: 3}], [{ cond=(NOT p0), acceptance={0} source=1 dest: 1}], [{ cond=(NOT p1), acceptance={0} source=2 dest: 2}], [{ cond=(NOT p1), acceptance={} source=3 dest: 2}, { cond=true, acceptance={} source=3 dest: 3}]], initial=0, aps=[p0:(OR (LEQ s13 s11) (LEQ s13 s2)), p1:(LEQ s5 s0)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, no-univ-branch, stutter-invariant, very-weak, weak, inherently-weak], stateDesc=[null, null, null, null][true, true, true, true]]
Stuttering criterion allowed to conclude after 18 steps with 2 reset in 1 ms.
FORMULA AirplaneLD-PT-4000-LTLCardinality-15 FALSE TECHNIQUES STUTTER_TEST
Treatment of property AirplaneLD-PT-4000-LTLCardinality-15 finished in 562 ms.
All properties solved by simple procedures.
Total runtime 72835 ms.
BK_STOP 1678508691466
--------------------
content from stderr:
+ export BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ LTLCardinality = StateSpace ]]
+ /home/mcc/BenchKit/bin//../itstools/bin//..//runeclipse.sh /home/mcc/execution LTLCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
+ export PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ export LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
+ LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202303021504.jar
+ VERSION=202303021504
+ echo 'Running Version 202303021504'
+ /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/its-tools -pnfolder /home/mcc/execution -examination LTLCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AirplaneLD-PT-4000"
export BK_EXAMINATION="LTLCardinality"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5348"
echo " Executing tool itstools"
echo " Input is AirplaneLD-PT-4000, examination is LTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r005-oct2-167813592900307"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/AirplaneLD-PT-4000.tgz
mv AirplaneLD-PT-4000 execution
cd execution
if [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "UpperBounds" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] || [ "LTLCardinality" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "LTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "LTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "LTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property LTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "LTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] ; then
echo "FORMULA_NAME LTLCardinality"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;