About the Execution of ITS-Tools for FlexibleBarrier-PT-20b
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
2352.880 | 93149.00 | 166171.00 | 337.20 | F | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/data/fkordon/mcc2022-input.r103-smll-165260579100088.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fkordon/mcc2022-input.qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-4028
Executing tool itstools
Input is FlexibleBarrier-PT-20b, examination is StableMarking
Time confinement is 1800 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r103-smll-165260579100088
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 1.7M
-rw-r--r-- 1 mcc users 6.2K Apr 29 13:14 CTLCardinality.txt
-rw-r--r-- 1 mcc users 62K Apr 29 13:14 CTLCardinality.xml
-rw-r--r-- 1 mcc users 5.8K Apr 29 13:13 CTLFireability.txt
-rw-r--r-- 1 mcc users 52K Apr 29 13:13 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K May 10 09:33 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 3.8K May 9 07:52 LTLCardinality.txt
-rw-r--r-- 1 mcc users 25K May 9 07:52 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.4K May 9 07:52 LTLFireability.txt
-rw-r--r-- 1 mcc users 18K May 9 07:52 LTLFireability.xml
-rw-r--r-- 1 mcc users 1.7K May 9 07:52 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.8K May 9 07:52 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 10 09:33 equiv_col
-rw-r--r-- 1 mcc users 4 May 10 09:33 instance
-rw-r--r-- 1 mcc users 6 May 10 09:33 iscolored
-rw-r--r-- 1 mcc users 1.5M May 10 09:33 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
FORMULA_NAME StableMarking
=== Now, execution of the tool begins
BK_START 1652629896538
Running Version 202205111006
[2022-05-15 15:51:39] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, StableMarking, -spotpath, /home/mcc/BenchKit/bin//..//ltlfilt, -z3path, /home/mcc/BenchKit/bin//..//z3/bin/z3, -yices2path, /home/mcc/BenchKit/bin//..//yices/bin/yices, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 1800]
[2022-05-15 15:51:39] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2022-05-15 15:51:40] [INFO ] Load time of PNML (sax parser for PT used): 719 ms
[2022-05-15 15:51:40] [INFO ] Transformed 5372 places.
[2022-05-15 15:51:40] [INFO ] Transformed 6193 transitions.
[2022-05-15 15:51:40] [INFO ] Found NUPN structural information;
[2022-05-15 15:51:40] [INFO ] Parsed PT model containing 5372 places and 6193 transitions in 1016 ms.
Graph (trivial) has 5310 edges and 5372 vertex of which 122 / 5372 are part of one of the 20 SCC in 30 ms
Free SCC test removed 102 places
Structural test allowed to assert that 1354 places are NOT stable. Took 92 ms.
Ensure Unique test removed 103 transitions
Reduce redundant transitions removed 103 transitions.
Incomplete random walk after 10000 steps, including 105 resets, run finished after 3953 ms. (steps per millisecond=2 ) properties (out of 4018) seen :114
Probabilistic random walk after 30001 steps, saw 13741 distinct states, run finished after 8275 ms. (steps per millisecond=3 ) properties seen :0
Running SMT prover for 3904 properties.
[2022-05-15 15:51:53] [INFO ] Flow matrix only has 6071 transitions (discarded 19 similar events)
// Phase 1: matrix 6071 rows 5270 cols
[2022-05-15 15:51:53] [INFO ] Computed 22 place invariants in 432 ms
[2022-05-15 15:52:22] [WARNING] SMT solver failed with error :SMT solver raised an error when submitting script.... while checking expressions.
[2022-05-15 15:52:22] [INFO ] After 25080ms SMT Verify possible using all constraints in real domain returned unsat :0 sat :0
Fused 3904 Parikh solutions to 1 different solutions.
Parikh walk visited 0 properties in 2 ms.
Support contains 3904 out of 5270 places. Attempting structural reductions.
Starting structural reductions in SAFETY mode, iteration 0 : 5270/5270 places, 6090/6090 transitions.
Drop transitions removed 20 transitions
Reduce isomorphic transitions removed 20 transitions.
Drop transitions removed 106 transitions
Trivial Post-agglo rules discarded 106 transitions
Performed 106 trivial Post agglomeration. Transition count delta: 106
Iterating post reduction 0 with 126 rules applied. Total rules applied 126 place count 5270 transition count 5964
Reduce places removed 106 places and 0 transitions.
Iterating post reduction 1 with 106 rules applied. Total rules applied 232 place count 5164 transition count 5964
Discarding 9 places :
Symmetric choice reduction at 2 with 9 rule applications. Total rules 241 place count 5155 transition count 5955
Iterating global reduction 2 with 9 rules applied. Total rules applied 250 place count 5155 transition count 5955
Performed 50 Post agglomeration using F-continuation condition.Transition count delta: 50
Deduced a syphon composed of 50 places in 4 ms
Reduce places removed 50 places and 0 transitions.
Iterating global reduction 2 with 100 rules applied. Total rules applied 350 place count 5105 transition count 5905
Drop transitions removed 1 transitions
Reduce isomorphic transitions removed 1 transitions.
Iterating post reduction 2 with 1 rules applied. Total rules applied 351 place count 5105 transition count 5904
Free-agglomeration rule applied 1123 times.
Iterating global reduction 3 with 1123 rules applied. Total rules applied 1474 place count 5105 transition count 4781
Reduce places removed 1123 places and 0 transitions.
Iterating post reduction 3 with 1123 rules applied. Total rules applied 2597 place count 3982 transition count 4781
Free-agglomeration rule (complex) applied 1 times.
Iterating global reduction 4 with 1 rules applied. Total rules applied 2598 place count 3982 transition count 4780
Reduce places removed 1 places and 0 transitions.
Drop transitions removed 1 transitions
Reduce isomorphic transitions removed 1 transitions.
Iterating post reduction 4 with 2 rules applied. Total rules applied 2600 place count 3981 transition count 4779
Partial Free-agglomeration rule applied 12 times.
Drop transitions removed 12 transitions
Iterating global reduction 5 with 12 rules applied. Total rules applied 2612 place count 3981 transition count 4779
Drop transitions removed 2 transitions
Reduce isomorphic transitions removed 2 transitions.
Iterating post reduction 5 with 2 rules applied. Total rules applied 2614 place count 3981 transition count 4777
Partial Post-agglomeration rule applied 2 times.
Drop transitions removed 2 transitions
Iterating global reduction 6 with 2 rules applied. Total rules applied 2616 place count 3981 transition count 4777
Reduce places removed 1 places and 1 transitions.
Iterating global reduction 6 with 1 rules applied. Total rules applied 2617 place count 3980 transition count 4776
Applied a total of 2617 rules in 2140 ms. Remains 3980 /5270 variables (removed 1290) and now considering 4776/6090 (removed 1314) transitions.
Finished structural reductions, in 1 iterations. Remains : 3980/5270 places, 4776/6090 transitions.
Interrupted random walk after 185502 steps, including 0 resets, run timeout after 30001 ms. (steps per millisecond=6 ) properties seen 3828
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 640 ms. (steps per millisecond=156 ) properties (out of 76) seen :8
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 636 ms. (steps per millisecond=157 ) properties (out of 68) seen :7
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 476 ms. (steps per millisecond=210 ) properties (out of 61) seen :0
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 429 ms. (steps per millisecond=233 ) properties (out of 61) seen :7
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 445 ms. (steps per millisecond=224 ) properties (out of 54) seen :13
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 415 ms. (steps per millisecond=240 ) properties (out of 41) seen :7
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 391 ms. (steps per millisecond=255 ) properties (out of 34) seen :12
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 374 ms. (steps per millisecond=267 ) properties (out of 22) seen :4
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 351 ms. (steps per millisecond=284 ) properties (out of 18) seen :4
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 400 ms. (steps per millisecond=250 ) properties (out of 14) seen :0
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 379 ms. (steps per millisecond=263 ) properties (out of 14) seen :3
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 463 ms. (steps per millisecond=215 ) properties (out of 11) seen :4
Incomplete Best-First random walk after 100001 steps, including 2 resets, run finished after 234 ms. (steps per millisecond=427 ) properties (out of 7) seen :4
Running SMT prover for 3 properties.
// Phase 1: matrix 4776 rows 3980 cols
[2022-05-15 15:53:00] [INFO ] Computed 22 place invariants in 51 ms
[2022-05-15 15:53:01] [INFO ] After 1019ms SMT Verify possible using all constraints in real domain returned unsat :0 sat :0 real:3
[2022-05-15 15:53:02] [INFO ] [Nat]Absence check using 22 positive place invariants in 53 ms returned sat
[2022-05-15 15:53:06] [INFO ] After 4271ms SMT Verify possible using state equation in natural domain returned unsat :0 sat :3
[2022-05-15 15:53:08] [INFO ] After 5996ms SMT Verify possible using trap constraints in natural domain returned unsat :0 sat :3
Attempting to minimize the solution found.
Minimization took 898 ms.
[2022-05-15 15:53:09] [INFO ] After 8147ms SMT Verify possible using all constraints in natural domain returned unsat :0 sat :3
Fused 3 Parikh solutions to 2 different solutions.
Finished Parikh walk after 6 steps, including 1 resets, run visited all 1 properties in 2 ms. (steps per millisecond=3 )
Parikh walk visited 3 properties in 118 ms.
Able to resolve query StableMarking after proving 4020 properties.
FORMULA StableMarking FALSE TECHNIQUES RANDOM_WALK PARIKH_WALK MARKED_SUFFIX_TEST TRIVIAL_UNMARKED_SCC_TEST BESTFIRST_WALK TOPOLOGICAL
Total runtime 90535 ms.
BK_STOP 1652629989687
--------------------
content from stderr:
+ export LANG=C
+ LANG=C
+ export BINDIR=/home/mcc/BenchKit/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ StableMarking = StateSpace ]]
+ /home/mcc/BenchKit/bin//..//runeclipse.sh /home/mcc/execution StableMarking -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 1800
+ ulimit -s 65536
+ export PYTHONPATH=/usr/lib/python3.9/site-packages/
+ PYTHONPATH=/usr/lib/python3.9/site-packages/
+ export LD_LIBRARY_PATH=/usr/local/lib:
+ LD_LIBRARY_PATH=/usr/local/lib:
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202205111006.jar
+ VERSION=202205111006
+ echo 'Running Version 202205111006'
+ /home/mcc/BenchKit/bin//..//itstools/its-tools -data @none -pnfolder /home/mcc/execution -examination StableMarking -spotpath /home/mcc/BenchKit/bin//..//ltlfilt -z3path /home/mcc/BenchKit/bin//..//z3/bin/z3 -yices2path /home/mcc/BenchKit/bin//..//yices/bin/yices -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 1800 -vmargs -Dosgi.locking=none -Declipse.stateSaveDelayInterval=-1 -Dosgi.configuration.area=@none -Xss128m -Xms40m -Xmx8192m
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="FlexibleBarrier-PT-20b"
export BK_EXAMINATION="StableMarking"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="1800"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool itstools"
echo " Input is FlexibleBarrier-PT-20b, examination is StableMarking"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r103-smll-165260579100088"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/FlexibleBarrier-PT-20b.tgz
mv FlexibleBarrier-PT-20b execution
cd execution
if [ "StableMarking" = "ReachabilityDeadlock" ] || [ "StableMarking" = "UpperBounds" ] || [ "StableMarking" = "QuasiLiveness" ] || [ "StableMarking" = "StableMarking" ] || [ "StableMarking" = "Liveness" ] || [ "StableMarking" = "OneSafe" ] || [ "StableMarking" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "StableMarking" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "StableMarking" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "StableMarking.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property StableMarking.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "StableMarking.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "StableMarking" = "ReachabilityDeadlock" ] || [ "StableMarking" = "QuasiLiveness" ] || [ "StableMarking" = "StableMarking" ] || [ "StableMarking" = "Liveness" ] || [ "StableMarking" = "OneSafe" ] ; then
echo "FORMULA_NAME StableMarking"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;