About the Execution of LTSMin+red for NQueens-PT-08
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
231.951 | 4468.00 | 7939.00 | 60.20 | ????T???TF?T??T? | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/data/fkordon/mcc2024-input.r508-tall-171654351400345.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fkordon/mcc2024-input.qcow2 backing_fmt=qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
..................
=====================================================================
Generated by BenchKit 2-5568
Executing tool ltsminxred
Input is NQueens-PT-08, examination is CTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r508-tall-171654351400345
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 460K
-rw-r--r-- 1 mcc users 6.9K May 14 13:22 CTLCardinality.txt
-rw-r--r-- 1 mcc users 75K May 14 13:22 CTLCardinality.xml
-rw-r--r-- 1 mcc users 5.5K May 14 13:22 CTLFireability.txt
-rw-r--r-- 1 mcc users 45K May 14 13:22 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K May 18 16:43 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.5K May 18 16:43 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 3.5K Apr 23 07:40 LTLCardinality.txt
-rw-r--r-- 1 mcc users 22K Apr 23 07:40 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.6K Apr 23 07:40 LTLFireability.txt
-rw-r--r-- 1 mcc users 18K Apr 23 07:40 LTLFireability.xml
-rw-r--r-- 1 mcc users 12K Apr 12 03:20 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 116K Apr 12 03:20 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 4.6K Apr 12 03:19 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 27K Apr 12 03:19 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K Apr 23 07:40 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.6K Apr 23 07:40 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 18 16:43 equiv_col
-rw-r--r-- 1 mcc users 3 May 18 16:43 instance
-rw-r--r-- 1 mcc users 6 May 18 16:43 iscolored
-rw-r--r-- 1 mcc users 65K May 18 16:43 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-00
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-01
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-02
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-03
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-04
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-05
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-06
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-07
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-08
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-09
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-10
FORMULA_NAME NQueens-PT-08-CTLCardinality-2024-11
FORMULA_NAME NQueens-PT-08-CTLCardinality-2023-12
FORMULA_NAME NQueens-PT-08-CTLCardinality-2023-13
FORMULA_NAME NQueens-PT-08-CTLCardinality-2023-14
FORMULA_NAME NQueens-PT-08-CTLCardinality-2023-15
=== Now, execution of the tool begins
BK_START 1717236220183
Invoking MCC driver with
BK_TOOL=ltsminxred
BK_EXAMINATION=CTLCardinality
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=NQueens-PT-08
BK_MEMORY_CONFINEMENT=16384
Applying reductions before tool ltsmin
Invoking reducer
Running Version 202405141337
[2024-06-01 10:03:41] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, CTLCardinality, -timeout, 360, -rebuildPNML]
[2024-06-01 10:03:41] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2024-06-01 10:03:41] [INFO ] Load time of PNML (sax parser for PT used): 67 ms
[2024-06-01 10:03:41] [INFO ] Transformed 112 places.
[2024-06-01 10:03:41] [INFO ] Transformed 64 transitions.
[2024-06-01 10:03:41] [INFO ] Found NUPN structural information;
[2024-06-01 10:03:41] [INFO ] Parsed PT model containing 112 places and 64 transitions and 320 arcs in 166 ms.
Parsed 16 properties from file /home/mcc/execution/CTLCardinality.xml in 15 ms.
Reduce places removed 2 places and 0 transitions.
FORMULA NQueens-PT-08-CTLCardinality-2024-04 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NQueens-PT-08-CTLCardinality-2024-09 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Support contains 62 out of 110 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 110/110 places, 64/64 transitions.
Reduce places removed 26 places and 0 transitions.
Iterating post reduction 0 with 26 rules applied. Total rules applied 26 place count 84 transition count 64
Applied a total of 26 rules in 17 ms. Remains 84 /110 variables (removed 26) and now considering 64/64 (removed 0) transitions.
// Phase 1: matrix 64 rows 84 cols
[2024-06-01 10:03:41] [INFO ] Computed 20 invariants in 10 ms
[2024-06-01 10:03:42] [INFO ] Implicit Places using invariants in 361 ms returned []
[2024-06-01 10:03:42] [INFO ] Invariant cache hit.
[2024-06-01 10:03:43] [INFO ] Implicit Places using invariants and state equation in 1481 ms returned [69, 83]
Discarding 2 places :
Implicit Place search using SMT with State Equation took 1876 ms to find 2 implicit places.
Starting structural reductions in LTL mode, iteration 1 : 82/110 places, 64/64 transitions.
Applied a total of 0 rules in 3 ms. Remains 82 /82 variables (removed 0) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in LTL mode , in 2 iterations and 1919 ms. Remains : 82/110 places, 64/64 transitions.
Support contains 62 out of 82 places after structural reductions.
[2024-06-01 10:03:43] [INFO ] Initial state reduction rules for CTL removed 1 formulas.
[2024-06-01 10:03:43] [INFO ] Flatten gal took : 31 ms
FORMULA NQueens-PT-08-CTLCardinality-2023-14 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
[2024-06-01 10:03:43] [INFO ] Flatten gal took : 11 ms
[2024-06-01 10:03:43] [INFO ] Input system was already deterministic with 64 transitions.
Support contains 60 out of 82 places (down from 62) after GAL structural reductions.
Reduction of identical properties reduced properties to check from 46 to 45
RANDOM walk for 1416 steps (184 resets) in 176 ms. (8 steps per ms) remains 0/45 properties
Initial state reduction rules removed 1 formulas.
FORMULA NQueens-PT-08-CTLCardinality-2024-11 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
[2024-06-01 10:03:43] [INFO ] Flatten gal took : 7 ms
[2024-06-01 10:03:43] [INFO ] Flatten gal took : 7 ms
[2024-06-01 10:03:43] [INFO ] Input system was already deterministic with 64 transitions.
Computed a total of 82 stabilizing places and 64 stable transitions
Complete graph has no SCC; deadlocks are unavoidable. place count 82 transition count 64
Detected that all paths lead to deadlock. Applying this knowledge to assert that all AP eventually converge (and all enablings converge to false).
AF dead knowledge conclusive for 1 formulas.
FORMULA NQueens-PT-08-CTLCardinality-2024-08 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Starting structural reductions in LTL mode, iteration 0 : 82/82 places, 64/64 transitions.
Reduce places removed 35 places and 0 transitions.
Iterating post reduction 0 with 35 rules applied. Total rules applied 35 place count 47 transition count 64
Applied a total of 35 rules in 2 ms. Remains 47 /82 variables (removed 35) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 2 ms. Remains : 47/82 places, 64/64 transitions.
[2024-06-01 10:03:43] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:43] [INFO ] Flatten gal took : 6 ms
[2024-06-01 10:03:44] [INFO ] Input system was already deterministic with 64 transitions.
Starting structural reductions in LTL mode, iteration 0 : 82/82 places, 64/64 transitions.
Reduce places removed 33 places and 0 transitions.
Iterating post reduction 0 with 33 rules applied. Total rules applied 33 place count 49 transition count 64
Applied a total of 33 rules in 2 ms. Remains 49 /82 variables (removed 33) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 2 ms. Remains : 49/82 places, 64/64 transitions.
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 6 ms
[2024-06-01 10:03:44] [INFO ] Input system was already deterministic with 64 transitions.
Starting structural reductions in SI_CTL mode, iteration 0 : 82/82 places, 64/64 transitions.
Graph (complete) has 150 edges and 82 vertex of which 48 are kept as prefixes of interest. Removing 34 places using SCC suffix rule.1 ms
Discarding 34 places :
Also discarding 0 output transitions
Applied a total of 1 rules in 10 ms. Remains 48 /82 variables (removed 34) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in SI_CTL mode , in 1 iterations and 11 ms. Remains : 48/82 places, 64/64 transitions.
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Input system was already deterministic with 64 transitions.
Starting structural reductions in SI_CTL mode, iteration 0 : 82/82 places, 64/64 transitions.
Graph (complete) has 150 edges and 82 vertex of which 44 are kept as prefixes of interest. Removing 38 places using SCC suffix rule.1 ms
Discarding 38 places :
Also discarding 0 output transitions
Applied a total of 1 rules in 4 ms. Remains 44 /82 variables (removed 38) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in SI_CTL mode , in 1 iterations and 4 ms. Remains : 44/82 places, 64/64 transitions.
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Input system was already deterministic with 64 transitions.
Starting structural reductions in LTL mode, iteration 0 : 82/82 places, 64/64 transitions.
Reduce places removed 32 places and 0 transitions.
Iterating post reduction 0 with 32 rules applied. Total rules applied 32 place count 50 transition count 64
Applied a total of 32 rules in 2 ms. Remains 50 /82 variables (removed 32) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 2 ms. Remains : 50/82 places, 64/64 transitions.
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Input system was already deterministic with 64 transitions.
Starting structural reductions in LTL mode, iteration 0 : 82/82 places, 64/64 transitions.
Reduce places removed 29 places and 0 transitions.
Iterating post reduction 0 with 29 rules applied. Total rules applied 29 place count 53 transition count 64
Applied a total of 29 rules in 2 ms. Remains 53 /82 variables (removed 29) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 2 ms. Remains : 53/82 places, 64/64 transitions.
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 4 ms
[2024-06-01 10:03:44] [INFO ] Input system was already deterministic with 64 transitions.
Starting structural reductions in SI_CTL mode, iteration 0 : 82/82 places, 64/64 transitions.
Graph (complete) has 150 edges and 82 vertex of which 46 are kept as prefixes of interest. Removing 36 places using SCC suffix rule.1 ms
Discarding 36 places :
Also discarding 0 output transitions
Applied a total of 1 rules in 3 ms. Remains 46 /82 variables (removed 36) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in SI_CTL mode , in 1 iterations and 3 ms. Remains : 46/82 places, 64/64 transitions.
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 4 ms
[2024-06-01 10:03:44] [INFO ] Input system was already deterministic with 64 transitions.
Starting structural reductions in LTL mode, iteration 0 : 82/82 places, 64/64 transitions.
Reduce places removed 36 places and 0 transitions.
Iterating post reduction 0 with 36 rules applied. Total rules applied 36 place count 46 transition count 64
Applied a total of 36 rules in 1 ms. Remains 46 /82 variables (removed 36) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 2 ms. Remains : 46/82 places, 64/64 transitions.
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 4 ms
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Input system was already deterministic with 64 transitions.
Starting structural reductions in LTL mode, iteration 0 : 82/82 places, 64/64 transitions.
Reduce places removed 33 places and 0 transitions.
Iterating post reduction 0 with 33 rules applied. Total rules applied 33 place count 49 transition count 64
Applied a total of 33 rules in 1 ms. Remains 49 /82 variables (removed 33) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 2 ms. Remains : 49/82 places, 64/64 transitions.
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 4 ms
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 4 ms
[2024-06-01 10:03:44] [INFO ] Input system was already deterministic with 64 transitions.
Starting structural reductions in LTL mode, iteration 0 : 82/82 places, 64/64 transitions.
Reduce places removed 34 places and 0 transitions.
Iterating post reduction 0 with 34 rules applied. Total rules applied 34 place count 48 transition count 64
Applied a total of 34 rules in 1 ms. Remains 48 /82 variables (removed 34) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 1 ms. Remains : 48/82 places, 64/64 transitions.
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 4 ms
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Input system was already deterministic with 64 transitions.
Starting structural reductions in SI_CTL mode, iteration 0 : 82/82 places, 64/64 transitions.
Graph (complete) has 150 edges and 82 vertex of which 43 are kept as prefixes of interest. Removing 39 places using SCC suffix rule.1 ms
Discarding 39 places :
Also discarding 0 output transitions
Applied a total of 1 rules in 3 ms. Remains 43 /82 variables (removed 39) and now considering 64/64 (removed 0) transitions.
Finished structural reductions in SI_CTL mode , in 1 iterations and 3 ms. Remains : 43/82 places, 64/64 transitions.
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 4 ms
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 5 ms
[2024-06-01 10:03:44] [INFO ] Input system was already deterministic with 64 transitions.
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 4 ms
[2024-06-01 10:03:44] [INFO ] Flatten gal took : 4 ms
[2024-06-01 10:03:44] [INFO ] Export to MCC of 11 properties in file /home/mcc/execution/CTLCardinality.sr.xml took 2 ms.
[2024-06-01 10:03:44] [INFO ] Export to PNML in file /home/mcc/execution/model.sr.pnml of net with 82 places, 64 transitions and 292 arcs took 1 ms.
Total runtime 2916 ms.
There are residual formulas that ITS could not solve within timeout
Usage: pnml2lts-sym [-gvqh] [--order=
[--mu-opt] [--saturation=
[--sat-granularity=
[--guidance=
[--action=
[--trace=
[--mu=
[--ctl=
[--save-levels=STRING] [--pg-solve] [--attr=
[--saturating-attractor] [--write-strategy=
[--check-strategy] [--interactive-play] [--player]
[--pg-write=
[--edge-label=
[--mucalc=
[--allow-undefined-edges] [--allow-undefined-values]
[-p|--por=
[--weak=[valmari] (default: uses stronger left-commutativity)]
[--leap] [-r|--regroup=<(T,)+>] [--sloan-w1=
[--cw-max-cols=
[--mh-timeout=
[--graph-metrics] [--regroup-exit] [--regroup-time]
[-g|--pins-guards] [--vset=
[--ldd32-cache=
[--cache-ratio=
[--min-free-nodes=
[--fdd-reorder=
[--vset-cache-diff=
[--next-union] [--peak-nodes] [--maxsum=
[--block-size=
[--debug=
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="NQueens-PT-08"
export BK_EXAMINATION="CTLCardinality"
export BK_TOOL="ltsminxred"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5568"
echo " Executing tool ltsminxred"
echo " Input is NQueens-PT-08, examination is CTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r508-tall-171654351400345"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/NQueens-PT-08.tgz
mv NQueens-PT-08 execution
cd execution
if [ "CTLCardinality" = "ReachabilityDeadlock" ] || [ "CTLCardinality" = "UpperBounds" ] || [ "CTLCardinality" = "QuasiLiveness" ] || [ "CTLCardinality" = "StableMarking" ] || [ "CTLCardinality" = "Liveness" ] || [ "CTLCardinality" = "OneSafe" ] || [ "CTLCardinality" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "CTLCardinality" = "ReachabilityDeadlock" ] || [ "CTLCardinality" = "QuasiLiveness" ] || [ "CTLCardinality" = "StableMarking" ] || [ "CTLCardinality" = "Liveness" ] || [ "CTLCardinality" = "OneSafe" ] ; then
echo "FORMULA_NAME CTLCardinality"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;