About the Execution of ITS-Tools for BART-PT-040
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
738.628 | 17677.00 | 38890.00 | 571.90 | TFFTFFFFFFFFTFFT | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/mnt/tpsp/fkordon/mcc2022-input.r006-tajo-165245689600635.qcow2', fmt=qcow2 size=4294967296 backing_file='/mnt/tpsp/fkordon/mcc2022-input.qcow2' encryption=off cluster_size=65536 lazy_refcounts=off
Waiting for the VM to be ready (probing ssh)
.....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-4028
Executing tool itstools
Input is BART-PT-040, examination is LTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r006-tajo-165245689600635
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 38M
-rw-r--r-- 1 mcc users 2.1M Apr 29 21:51 CTLCardinality.txt
-rw-r--r-- 1 mcc users 7.1M Apr 29 21:51 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.3M Apr 29 20:20 CTLFireability.txt
-rw-r--r-- 1 mcc users 7.3M Apr 29 20:20 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K May 10 09:33 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.4K May 10 09:33 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 1.5M May 9 07:06 LTLCardinality.txt
-rw-r--r-- 1 mcc users 3.8M May 9 07:06 LTLCardinality.xml
-rw-r--r-- 1 mcc users 909K May 9 07:06 LTLFireability.txt
-rw-r--r-- 1 mcc users 2.5M May 9 07:06 LTLFireability.xml
-rw-r--r-- 1 mcc users 326K May 9 07:06 UpperBounds.txt
-rw-r--r-- 1 mcc users 658K May 9 07:06 UpperBounds.xml
-rw-r--r-- 1 mcc users 5 May 10 09:33 equiv_col
-rw-r--r-- 1 mcc users 4 May 10 09:33 instance
-rw-r--r-- 1 mcc users 6 May 10 09:33 iscolored
-rw-r--r-- 1 mcc users 9.5M May 10 09:33 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME BART-PT-040-LTLCardinality-00
FORMULA_NAME BART-PT-040-LTLCardinality-01
FORMULA_NAME BART-PT-040-LTLCardinality-02
FORMULA_NAME BART-PT-040-LTLCardinality-03
FORMULA_NAME BART-PT-040-LTLCardinality-04
FORMULA_NAME BART-PT-040-LTLCardinality-05
FORMULA_NAME BART-PT-040-LTLCardinality-06
FORMULA_NAME BART-PT-040-LTLCardinality-07
FORMULA_NAME BART-PT-040-LTLCardinality-08
FORMULA_NAME BART-PT-040-LTLCardinality-09
FORMULA_NAME BART-PT-040-LTLCardinality-10
FORMULA_NAME BART-PT-040-LTLCardinality-11
FORMULA_NAME BART-PT-040-LTLCardinality-12
FORMULA_NAME BART-PT-040-LTLCardinality-13
FORMULA_NAME BART-PT-040-LTLCardinality-14
FORMULA_NAME BART-PT-040-LTLCardinality-15
=== Now, execution of the tool begins
BK_START 1652667997589
Running Version 202205111006
[2022-05-16 02:26:38] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, LTLCardinality, -spotpath, /home/mcc/BenchKit/bin//..//ltlfilt, -z3path, /home/mcc/BenchKit/bin//..//z3/bin/z3, -yices2path, /home/mcc/BenchKit/bin//..//yices/bin/yices, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2022-05-16 02:26:38] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2022-05-16 02:26:39] [INFO ] Load time of PNML (sax parser for PT used): 701 ms
[2022-05-16 02:26:39] [INFO ] Transformed 5490 places.
[2022-05-16 02:26:39] [INFO ] Transformed 8080 transitions.
[2022-05-16 02:26:39] [INFO ] Found NUPN structural information;
[2022-05-16 02:26:39] [INFO ] Parsed PT model containing 5490 places and 8080 transitions in 904 ms.
Parsed 16 properties from file /home/mcc/execution/LTLCardinality.xml in 855 ms.
Working with output stream class java.io.PrintStream
Initial state reduction rules removed 4 formulas.
Reduce places removed 210 places and 0 transitions.
FORMULA BART-PT-040-LTLCardinality-02 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-03 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-04 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-07 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-09 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-10 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-11 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-12 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-13 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-08 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Support contains 3 out of 5280 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 5280/5280 places, 8080/8080 transitions.
Discarding 1279 places :
Symmetric choice reduction at 0 with 1279 rule applications. Total rules 1279 place count 4001 transition count 6801
Iterating global reduction 0 with 1279 rules applied. Total rules applied 2558 place count 4001 transition count 6801
Discarding 1078 places :
Symmetric choice reduction at 0 with 1078 rule applications. Total rules 3636 place count 2923 transition count 5723
Iterating global reduction 0 with 1078 rules applied. Total rules applied 4714 place count 2923 transition count 5723
Discarding 160 places :
Symmetric choice reduction at 0 with 160 rule applications. Total rules 4874 place count 2763 transition count 5563
Iterating global reduction 0 with 160 rules applied. Total rules applied 5034 place count 2763 transition count 5563
Discarding 120 places :
Symmetric choice reduction at 0 with 120 rule applications. Total rules 5154 place count 2643 transition count 5443
Iterating global reduction 0 with 120 rules applied. Total rules applied 5274 place count 2643 transition count 5443
Discarding 120 places :
Symmetric choice reduction at 0 with 120 rule applications. Total rules 5394 place count 2523 transition count 5323
Iterating global reduction 0 with 120 rules applied. Total rules applied 5514 place count 2523 transition count 5323
Discarding 120 places :
Symmetric choice reduction at 0 with 120 rule applications. Total rules 5634 place count 2403 transition count 5203
Iterating global reduction 0 with 120 rules applied. Total rules applied 5754 place count 2403 transition count 5203
Discarding 120 places :
Symmetric choice reduction at 0 with 120 rule applications. Total rules 5874 place count 2283 transition count 5083
Iterating global reduction 0 with 120 rules applied. Total rules applied 5994 place count 2283 transition count 5083
Discarding 119 places :
Symmetric choice reduction at 0 with 119 rule applications. Total rules 6113 place count 2164 transition count 4964
Iterating global reduction 0 with 119 rules applied. Total rules applied 6232 place count 2164 transition count 4964
Discarding 80 places :
Symmetric choice reduction at 0 with 80 rule applications. Total rules 6312 place count 2084 transition count 4884
Iterating global reduction 0 with 80 rules applied. Total rules applied 6392 place count 2084 transition count 4884
Discarding 79 places :
Symmetric choice reduction at 0 with 79 rule applications. Total rules 6471 place count 2005 transition count 4805
Iterating global reduction 0 with 79 rules applied. Total rules applied 6550 place count 2005 transition count 4805
Discarding 40 places :
Symmetric choice reduction at 0 with 40 rule applications. Total rules 6590 place count 1965 transition count 4765
Iterating global reduction 0 with 40 rules applied. Total rules applied 6630 place count 1965 transition count 4765
Applied a total of 6630 rules in 3354 ms. Remains 1965 /5280 variables (removed 3315) and now considering 4765/8080 (removed 3315) transitions.
// Phase 1: matrix 4765 rows 1965 cols
[2022-05-16 02:26:44] [INFO ] Computed 40 place invariants in 83 ms
[2022-05-16 02:26:45] [INFO ] Implicit Places using invariants in 958 ms returned []
// Phase 1: matrix 4765 rows 1965 cols
[2022-05-16 02:26:45] [INFO ] Computed 40 place invariants in 31 ms
[2022-05-16 02:26:47] [INFO ] Implicit Places using invariants and state equation in 1801 ms returned []
Implicit Place search using SMT with State Equation took 2804 ms to find 0 implicit places.
// Phase 1: matrix 4765 rows 1965 cols
[2022-05-16 02:26:47] [INFO ] Computed 40 place invariants in 13 ms
[2022-05-16 02:26:49] [INFO ] Dead Transitions using invariants and state equation in 2529 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 1965/5280 places, 4765/8080 transitions.
Finished structural reductions, in 1 iterations. Remains : 1965/5280 places, 4765/8080 transitions.
Support contains 3 out of 1965 places after structural reductions.
[2022-05-16 02:26:50] [INFO ] Initial state reduction rules for LTL removed 3 formulas.
[2022-05-16 02:26:50] [INFO ] Flatten gal took : 205 ms
[2022-05-16 02:26:50] [INFO ] Initial state reduction rules for LTL removed 1 formulas.
FORMULA BART-PT-040-LTLCardinality-06 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-05 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-01 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BART-PT-040-LTLCardinality-00 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
[2022-05-16 02:26:50] [INFO ] Flatten gal took : 116 ms
[2022-05-16 02:26:50] [INFO ] Input system was already deterministic with 4765 transitions.
Incomplete random walk after 10000 steps, including 2 resets, run finished after 438 ms. (steps per millisecond=22 ) properties (out of 3) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 14 ms. (steps per millisecond=714 ) properties (out of 3) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 11 ms. (steps per millisecond=909 ) properties (out of 3) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 11 ms. (steps per millisecond=909 ) properties (out of 3) seen :0
Probabilistic random walk after 167398 steps, saw 167205 distinct states, run finished after 3008 ms. (steps per millisecond=55 ) properties seen :0
Running SMT prover for 3 properties.
// Phase 1: matrix 4765 rows 1965 cols
[2022-05-16 02:26:54] [INFO ] Computed 40 place invariants in 16 ms
[2022-05-16 02:26:54] [INFO ] After 348ms SMT Verify possible using all constraints in real domain returned unsat :0 sat :0 real:3
[2022-05-16 02:26:55] [INFO ] [Nat]Absence check using 40 positive place invariants in 17 ms returned sat
[2022-05-16 02:26:55] [INFO ] After 266ms SMT Verify possible using all constraints in natural domain returned unsat :3 sat :0
Fused 3 Parikh solutions to 0 different solutions.
Parikh walk visited 0 properties in 0 ms.
Successfully simplified 3 atomic propositions for a total of 2 simplifications.
FORMULA BART-PT-040-LTLCardinality-15 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Computed a total of 0 stabilizing places and 0 stable transitions
Running Spot : cd /home/mcc/execution;'/home/mcc/BenchKit/bin//..//ltl2tgba' '--check=stutter' '--hoaf=tv' '-f' '!(X((true U false)))'
Support contains 0 out of 1965 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 1965/1965 places, 4765/4765 transitions.
Graph (trivial) has 4765 edges and 1965 vertex of which 1965 / 1965 are part of one of the 40 SCC in 10 ms
Free SCC test removed 1925 places
Ensure Unique test removed 4725 transitions
Reduce isomorphic transitions removed 4725 transitions.
Reduce places removed 40 places and 0 transitions.
Ensure Unique test removed 39 transitions
Reduce isomorphic transitions removed 39 transitions.
Iterating post reduction 0 with 39 rules applied. Total rules applied 40 place count 0 transition count 1
Applied a total of 40 rules in 31 ms. Remains 0 /1965 variables (removed 1965) and now considering 1/4765 (removed 4764) transitions.
[2022-05-16 02:26:55] [INFO ] Computed 0 place invariants in 0 ms
[2022-05-16 02:26:55] [INFO ] Implicit Places using invariants in 8 ms returned []
[2022-05-16 02:26:55] [INFO ] Computed 0 place invariants in 0 ms
[2022-05-16 02:26:55] [INFO ] Implicit Places using invariants and state equation in 18 ms returned []
Implicit Place search using SMT with State Equation took 28 ms to find 0 implicit places.
[2022-05-16 02:26:55] [INFO ] Redundant transitions in 0 ms returned []
[2022-05-16 02:26:55] [INFO ] Computed 0 place invariants in 0 ms
[2022-05-16 02:26:55] [INFO ] Dead Transitions using invariants and state equation in 13 ms found 0 transitions.
Starting structural reductions in SI_LTL mode, iteration 1 : 0/1965 places, 1/4765 transitions.
Finished structural reductions, in 1 iterations. Remains : 0/1965 places, 1/4765 transitions.
Stuttering acceptance computed with spot in 34 ms :[true]
Running random walk in product with property : BART-PT-040-LTLCardinality-14 automaton TGBA Formula[mat=[[{ cond=true, acceptance={0} source=0 dest: 0}]], initial=0, aps=[], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, colored, complete, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant, terminal, very-weak, weak, inherently-weak], stateDesc=[null][true]]
Entered a terminal (fully accepting) state of product in 0 steps with 0 reset in 1 ms.
FORMULA BART-PT-040-LTLCardinality-14 FALSE TECHNIQUES STUTTER_TEST
Treatment of property BART-PT-040-LTLCardinality-14 finished in 167 ms.
All properties solved by simple procedures.
Total runtime 16290 ms.
BK_STOP 1652668015266
--------------------
content from stderr:
+ export LANG=C
+ LANG=C
+ export BINDIR=/home/mcc/BenchKit/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ LTLCardinality = StateSpace ]]
+ /home/mcc/BenchKit/bin//..//runeclipse.sh /home/mcc/execution LTLCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ export PYTHONPATH=/usr/lib/python3.9/site-packages/
+ PYTHONPATH=/usr/lib/python3.9/site-packages/
+ export LD_LIBRARY_PATH=/usr/local/lib:
+ LD_LIBRARY_PATH=/usr/local/lib:
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202205111006.jar
+ VERSION=202205111006
+ echo 'Running Version 202205111006'
+ /home/mcc/BenchKit/bin//..//itstools/its-tools -data @none -pnfolder /home/mcc/execution -examination LTLCardinality -spotpath /home/mcc/BenchKit/bin//..//ltlfilt -z3path /home/mcc/BenchKit/bin//..//z3/bin/z3 -yices2path /home/mcc/BenchKit/bin//..//yices/bin/yices -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600 -vmargs -Dosgi.locking=none -Declipse.stateSaveDelayInterval=-1 -Dosgi.configuration.area=@none -Xss128m -Xms40m -Xmx8192m
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="BART-PT-040"
export BK_EXAMINATION="LTLCardinality"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool itstools"
echo " Input is BART-PT-040, examination is LTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r006-tajo-165245689600635"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/BART-PT-040.tgz
mv BART-PT-040 execution
cd execution
if [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "UpperBounds" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] || [ "LTLCardinality" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "LTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "LTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "LTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property LTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "LTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] ; then
echo "FORMULA_NAME LTLCardinality"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;