About the Execution of ITS-Tools for SmartHome-PT-09
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
271.731 | 10084.00 | 22723.00 | 147.40 | TTTFTFTTTFTTFFTT | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/data/fkordon/mcc2022-input.r240-smll-165303241600263.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fkordon/mcc2022-input.qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-4028
Executing tool itstools
Input is SmartHome-PT-09, examination is ReachabilityFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r240-smll-165303241600263
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 560K
-rw-r--r-- 1 mcc users 6.5K Apr 29 15:35 CTLCardinality.txt
-rw-r--r-- 1 mcc users 72K Apr 29 15:35 CTLCardinality.xml
-rw-r--r-- 1 mcc users 5.4K Apr 29 15:34 CTLFireability.txt
-rw-r--r-- 1 mcc users 52K Apr 29 15:34 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K May 10 09:34 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.8K May 10 09:34 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 3.8K May 9 09:07 LTLCardinality.txt
-rw-r--r-- 1 mcc users 27K May 9 09:07 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.2K May 9 09:07 LTLFireability.txt
-rw-r--r-- 1 mcc users 17K May 9 09:07 LTLFireability.xml
-rw-r--r-- 1 mcc users 14K Apr 29 15:36 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 155K Apr 29 15:36 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 8.8K Apr 29 15:36 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 79K Apr 29 15:36 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K May 9 09:07 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.6K May 9 09:07 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 10 09:34 equiv_col
-rw-r--r-- 1 mcc users 3 May 10 09:34 instance
-rw-r--r-- 1 mcc users 6 May 10 09:34 iscolored
-rw-r--r-- 1 mcc users 64K May 10 09:34 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-00
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-01
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-02
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-03
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-04
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-05
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-06
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-07
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-08
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-09
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-10
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-11
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-12
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-13
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-14
FORMULA_NAME SmartHome-PT-09-ReachabilityFireability-15
=== Now, execution of the tool begins
BK_START 1654241921858
Running Version 202205111006
[2022-06-03 07:38:44] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, ReachabilityFireability, -spotpath, /home/mcc/BenchKit/bin//..//ltlfilt, -z3path, /home/mcc/BenchKit/bin//..//z3/bin/z3, -yices2path, /home/mcc/BenchKit/bin//..//yices/bin/yices, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2022-06-03 07:38:44] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2022-06-03 07:38:44] [INFO ] Load time of PNML (sax parser for PT used): 144 ms
[2022-06-03 07:38:44] [INFO ] Transformed 253 places.
[2022-06-03 07:38:44] [INFO ] Transformed 293 transitions.
[2022-06-03 07:38:44] [INFO ] Found NUPN structural information;
[2022-06-03 07:38:44] [INFO ] Parsed PT model containing 253 places and 293 transitions in 312 ms.
Parsed 16 properties from file /home/mcc/execution/ReachabilityFireability.xml in 23 ms.
Working with output stream class java.io.PrintStream
Deduced a syphon composed of 29 places in 6 ms
Reduce places removed 29 places and 30 transitions.
FORMULA SmartHome-PT-09-ReachabilityFireability-03 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SmartHome-PT-09-ReachabilityFireability-05 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SmartHome-PT-09-ReachabilityFireability-14 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Incomplete random walk after 10000 steps, including 56 resets, run finished after 1098 ms. (steps per millisecond=9 ) properties (out of 13) seen :6
FORMULA SmartHome-PT-09-ReachabilityFireability-13 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SmartHome-PT-09-ReachabilityFireability-12 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SmartHome-PT-09-ReachabilityFireability-08 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SmartHome-PT-09-ReachabilityFireability-06 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SmartHome-PT-09-ReachabilityFireability-04 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SmartHome-PT-09-ReachabilityFireability-02 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 118 ms. (steps per millisecond=84 ) properties (out of 7) seen :0
Incomplete Best-First random walk after 10001 steps, including 8 resets, run finished after 97 ms. (steps per millisecond=103 ) properties (out of 7) seen :0
Incomplete Best-First random walk after 10001 steps, including 9 resets, run finished after 81 ms. (steps per millisecond=123 ) properties (out of 7) seen :1
FORMULA SmartHome-PT-09-ReachabilityFireability-07 TRUE TECHNIQUES TOPOLOGICAL BESTFIRST_WALK
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 160 ms. (steps per millisecond=62 ) properties (out of 6) seen :1
FORMULA SmartHome-PT-09-ReachabilityFireability-09 FALSE TECHNIQUES TOPOLOGICAL BESTFIRST_WALK
Incomplete Best-First random walk after 10001 steps, including 10 resets, run finished after 66 ms. (steps per millisecond=151 ) properties (out of 5) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 94 ms. (steps per millisecond=106 ) properties (out of 5) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 89 ms. (steps per millisecond=112 ) properties (out of 5) seen :0
Running SMT prover for 5 properties.
// Phase 1: matrix 263 rows 224 cols
[2022-06-03 07:38:46] [INFO ] Computed 10 place invariants in 17 ms
[2022-06-03 07:38:47] [INFO ] After 403ms SMT Verify possible using all constraints in real domain returned unsat :0 sat :0 real:5
[2022-06-03 07:38:47] [INFO ] [Nat]Absence check using 10 positive place invariants in 10 ms returned sat
[2022-06-03 07:38:47] [INFO ] After 286ms SMT Verify possible using state equation in natural domain returned unsat :2 sat :3
[2022-06-03 07:38:47] [INFO ] Deduced a trap composed of 56 places in 159 ms of which 9 ms to minimize.
[2022-06-03 07:38:48] [INFO ] Deduced a trap composed of 34 places in 142 ms of which 2 ms to minimize.
[2022-06-03 07:38:48] [INFO ] Deduced a trap composed of 26 places in 86 ms of which 1 ms to minimize.
[2022-06-03 07:38:48] [INFO ] Deduced a trap composed of 52 places in 84 ms of which 2 ms to minimize.
[2022-06-03 07:38:48] [INFO ] Deduced a trap composed of 40 places in 43 ms of which 2 ms to minimize.
[2022-06-03 07:38:48] [INFO ] Trap strengthening (SAT) tested/added 6/5 trap constraints in 648 ms
[2022-06-03 07:38:48] [INFO ] Deduced a trap composed of 50 places in 86 ms of which 1 ms to minimize.
[2022-06-03 07:38:48] [INFO ] Deduced a trap composed of 30 places in 53 ms of which 0 ms to minimize.
[2022-06-03 07:38:48] [INFO ] Trap strengthening (SAT) tested/added 3/2 trap constraints in 201 ms
[2022-06-03 07:38:48] [INFO ] After 1244ms SMT Verify possible using trap constraints in natural domain returned unsat :2 sat :3
Attempting to minimize the solution found.
Minimization took 94 ms.
[2022-06-03 07:38:48] [INFO ] After 1551ms SMT Verify possible using all constraints in natural domain returned unsat :2 sat :3
FORMULA SmartHome-PT-09-ReachabilityFireability-15 TRUE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
FORMULA SmartHome-PT-09-ReachabilityFireability-00 TRUE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
Fused 5 Parikh solutions to 3 different solutions.
FORMULA SmartHome-PT-09-ReachabilityFireability-01 TRUE TECHNIQUES TOPOLOGICAL PARIKH_WALK
FORMULA SmartHome-PT-09-ReachabilityFireability-11 TRUE TECHNIQUES TOPOLOGICAL PARIKH_WALK
Parikh walk visited 2 properties in 333 ms.
Support contains 14 out of 224 places. Attempting structural reductions.
Starting structural reductions in SAFETY mode, iteration 0 : 224/224 places, 263/263 transitions.
Graph (trivial) has 174 edges and 224 vertex of which 45 / 224 are part of one of the 4 SCC in 12 ms
Free SCC test removed 41 places
Drop transitions removed 54 transitions
Reduce isomorphic transitions removed 54 transitions.
Graph (complete) has 282 edges and 183 vertex of which 176 are kept as prefixes of interest. Removing 7 places using SCC suffix rule.4 ms
Discarding 7 places :
Also discarding 0 output transitions
Drop transitions removed 4 transitions
Reduce isomorphic transitions removed 4 transitions.
Drop transitions removed 63 transitions
Trivial Post-agglo rules discarded 63 transitions
Performed 63 trivial Post agglomeration. Transition count delta: 63
Iterating post reduction 0 with 67 rules applied. Total rules applied 69 place count 176 transition count 142
Reduce places removed 63 places and 0 transitions.
Ensure Unique test removed 6 transitions
Reduce isomorphic transitions removed 6 transitions.
Drop transitions removed 7 transitions
Trivial Post-agglo rules discarded 7 transitions
Performed 7 trivial Post agglomeration. Transition count delta: 7
Iterating post reduction 1 with 76 rules applied. Total rules applied 145 place count 113 transition count 129
Reduce places removed 7 places and 0 transitions.
Performed 7 Post agglomeration using F-continuation condition.Transition count delta: 7
Iterating post reduction 2 with 14 rules applied. Total rules applied 159 place count 106 transition count 122
Reduce places removed 7 places and 0 transitions.
Iterating post reduction 3 with 7 rules applied. Total rules applied 166 place count 99 transition count 122
Performed 6 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 4 with 6 Pre rules applied. Total rules applied 166 place count 99 transition count 116
Deduced a syphon composed of 6 places in 1 ms
Reduce places removed 6 places and 0 transitions.
Iterating global reduction 4 with 12 rules applied. Total rules applied 178 place count 93 transition count 116
Discarding 33 places :
Symmetric choice reduction at 4 with 33 rule applications. Total rules 211 place count 60 transition count 83
Iterating global reduction 4 with 33 rules applied. Total rules applied 244 place count 60 transition count 83
Ensure Unique test removed 9 transitions
Reduce isomorphic transitions removed 9 transitions.
Performed 2 Post agglomeration using F-continuation condition.Transition count delta: 2
Iterating post reduction 4 with 11 rules applied. Total rules applied 255 place count 60 transition count 72
Reduce places removed 2 places and 0 transitions.
Ensure Unique test removed 2 transitions
Reduce isomorphic transitions removed 2 transitions.
Iterating post reduction 5 with 4 rules applied. Total rules applied 259 place count 58 transition count 70
Performed 15 Post agglomeration using F-continuation condition.Transition count delta: 15
Deduced a syphon composed of 15 places in 0 ms
Reduce places removed 15 places and 0 transitions.
Iterating global reduction 6 with 30 rules applied. Total rules applied 289 place count 43 transition count 55
Drop transitions removed 3 transitions
Reduce isomorphic transitions removed 3 transitions.
Graph (complete) has 82 edges and 43 vertex of which 42 are kept as prefixes of interest. Removing 1 places using SCC suffix rule.1 ms
Discarding 1 places :
Also discarding 0 output transitions
Iterating post reduction 6 with 4 rules applied. Total rules applied 293 place count 42 transition count 52
Drop transitions removed 1 transitions
Reduce isomorphic transitions removed 1 transitions.
Iterating post reduction 7 with 1 rules applied. Total rules applied 294 place count 42 transition count 51
Drop transitions removed 3 transitions
Redundant transition composition rules discarded 3 transitions
Iterating global reduction 8 with 3 rules applied. Total rules applied 297 place count 42 transition count 48
Free-agglomeration rule applied 1 times.
Iterating global reduction 8 with 1 rules applied. Total rules applied 298 place count 42 transition count 47
Reduce places removed 1 places and 0 transitions.
Iterating post reduction 8 with 1 rules applied. Total rules applied 299 place count 41 transition count 47
Drop transitions removed 1 transitions
Redundant transition composition rules discarded 1 transitions
Iterating global reduction 9 with 1 rules applied. Total rules applied 300 place count 41 transition count 46
Reduce places removed 1 places and 1 transitions.
Iterating global reduction 9 with 1 rules applied. Total rules applied 301 place count 40 transition count 45
Reduce places removed 1 places and 0 transitions.
Iterating post reduction 9 with 1 rules applied. Total rules applied 302 place count 39 transition count 45
Applied a total of 302 rules in 124 ms. Remains 39 /224 variables (removed 185) and now considering 45/263 (removed 218) transitions.
Finished structural reductions, in 1 iterations. Remains : 39/224 places, 45/263 transitions.
Incomplete random walk after 1000000 steps, including 2 resets, run finished after 1741 ms. (steps per millisecond=574 ) properties (out of 1) seen :0
Incomplete Best-First random walk after 1000001 steps, including 2 resets, run finished after 831 ms. (steps per millisecond=1203 ) properties (out of 1) seen :0
Finished probabilistic random walk after 13898 steps, run visited all 1 properties in 33 ms. (steps per millisecond=421 )
Probabilistic random walk after 13898 steps, saw 3449 distinct states, run finished after 33 ms. (steps per millisecond=421 ) properties seen :1
FORMULA SmartHome-PT-09-ReachabilityFireability-10 TRUE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
All properties solved without resorting to model-checking.
Total runtime 7467 ms.
BK_STOP 1654241931942
--------------------
content from stderr:
+ export LANG=C
+ LANG=C
+ export BINDIR=/home/mcc/BenchKit/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ ReachabilityFireability = StateSpace ]]
+ /home/mcc/BenchKit/bin//..//runeclipse.sh /home/mcc/execution ReachabilityFireability -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ export PYTHONPATH=/usr/lib/python3.9/site-packages/
+ PYTHONPATH=/usr/lib/python3.9/site-packages/
+ export LD_LIBRARY_PATH=/usr/local/lib:
+ LD_LIBRARY_PATH=/usr/local/lib:
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202205111006.jar
+ VERSION=202205111006
+ echo 'Running Version 202205111006'
+ /home/mcc/BenchKit/bin//..//itstools/its-tools -data @none -pnfolder /home/mcc/execution -examination ReachabilityFireability -spotpath /home/mcc/BenchKit/bin//..//ltlfilt -z3path /home/mcc/BenchKit/bin//..//z3/bin/z3 -yices2path /home/mcc/BenchKit/bin//..//yices/bin/yices -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600 -vmargs -Dosgi.locking=none -Declipse.stateSaveDelayInterval=-1 -Dosgi.configuration.area=@none -Xss128m -Xms40m -Xmx8192m
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="SmartHome-PT-09"
export BK_EXAMINATION="ReachabilityFireability"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool itstools"
echo " Input is SmartHome-PT-09, examination is ReachabilityFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r240-smll-165303241600263"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/SmartHome-PT-09.tgz
mv SmartHome-PT-09 execution
cd execution
if [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "UpperBounds" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] || [ "ReachabilityFireability" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "ReachabilityFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "ReachabilityFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "ReachabilityFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property ReachabilityFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "ReachabilityFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] ; then
echo "FORMULA_NAME ReachabilityFireability"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;