fond
Model Checking Contest 2023
13th edition, Paris, France, April 26, 2023 (at TOOLympics II)
Execution of r421-tajo-167905975300467
Last Updated
May 14, 2023

About the Execution of ITS-Tools for SieveSingleMsgMbox-PT-d2m18

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
287.567 6695.00 12792.00 361.20 FTFFFTFFTFFTFFFF normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/mnt/tpsp/fkordon/mcc2023-input.r421-tajo-167905975300467.qcow2', fmt=qcow2 size=4294967296 backing_file='/mnt/tpsp/fkordon/mcc2023-input.qcow2' encryption=off cluster_size=65536 lazy_refcounts=off
Waiting for the VM to be ready (probing ssh)
......................
=====================================================================
Generated by BenchKit 2-5348
Executing tool itstools
Input is SieveSingleMsgMbox-PT-d2m18, examination is LTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r421-tajo-167905975300467
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 1.5M
-rw-r--r-- 1 mcc users 7.1K Feb 26 10:33 CTLCardinality.txt
-rw-r--r-- 1 mcc users 74K Feb 26 10:33 CTLCardinality.xml
-rw-r--r-- 1 mcc users 5.1K Feb 26 10:32 CTLFireability.txt
-rw-r--r-- 1 mcc users 43K Feb 26 10:32 CTLFireability.xml
-rw-r--r-- 1 mcc users 3.8K Feb 25 17:06 LTLCardinality.txt
-rw-r--r-- 1 mcc users 24K Feb 25 17:06 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.3K Feb 25 17:06 LTLFireability.txt
-rw-r--r-- 1 mcc users 15K Feb 25 17:06 LTLFireability.xml
-rw-r--r-- 1 mcc users 8.3K Feb 26 10:34 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 79K Feb 26 10:34 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 6.7K Feb 26 10:33 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 51K Feb 26 10:33 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.8K Feb 25 17:06 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.8K Feb 25 17:06 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 Mar 5 18:23 equiv_col
-rw-r--r-- 1 mcc users 6 Mar 5 18:23 instance
-rw-r--r-- 1 mcc users 6 Mar 5 18:23 iscolored
-rw-r--r-- 1 mcc users 1.1M Mar 5 18:23 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-00
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-01
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-02
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-03
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-04
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-05
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-06
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-07
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-08
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-09
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-10
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-11
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-12
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-13
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-14
FORMULA_NAME SieveSingleMsgMbox-PT-d2m18-LTLCardinality-15

=== Now, execution of the tool begins

BK_START 1679180798625

bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
Invoking MCC driver with
BK_TOOL=itstools
BK_EXAMINATION=LTLCardinality
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=SieveSingleMsgMbox-PT-d2m18
Not applying reductions.
Model is PT
LTLCardinality PT
Running Version 202303021504
[2023-03-18 23:06:41] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, LTLCardinality, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2023-03-18 23:06:41] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2023-03-18 23:06:41] [INFO ] Load time of PNML (sax parser for PT used): 201 ms
[2023-03-18 23:06:41] [INFO ] Transformed 2398 places.
[2023-03-18 23:06:41] [INFO ] Transformed 1954 transitions.
[2023-03-18 23:06:41] [INFO ] Parsed PT model containing 2398 places and 1954 transitions and 7816 arcs in 407 ms.
Parsed 16 properties from file /home/mcc/execution/LTLCardinality.xml in 9 ms.
Working with output stream class java.io.PrintStream
Initial state reduction rules removed 2 formulas.
Deduced a syphon composed of 1984 places in 28 ms
Reduce places removed 1984 places and 0 transitions.
Initial state reduction rules removed 2 formulas.
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-00 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-01 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-03 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-04 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-05 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-07 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-08 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-09 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-10 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-11 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-12 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-13 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-15 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-02 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Support contains 2 out of 414 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 414/414 places, 1954/1954 transitions.
Reduce places removed 25 places and 0 transitions.
Ensure Unique test removed 828 transitions
Reduce isomorphic transitions removed 828 transitions.
Iterating post reduction 0 with 853 rules applied. Total rules applied 853 place count 389 transition count 1126
Discarding 119 places :
Symmetric choice reduction at 1 with 119 rule applications. Total rules 972 place count 270 transition count 374
Iterating global reduction 1 with 119 rules applied. Total rules applied 1091 place count 270 transition count 374
Ensure Unique test removed 10 transitions
Reduce isomorphic transitions removed 10 transitions.
Iterating post reduction 1 with 10 rules applied. Total rules applied 1101 place count 270 transition count 364
Discarding 93 places :
Symmetric choice reduction at 2 with 93 rule applications. Total rules 1194 place count 177 transition count 271
Iterating global reduction 2 with 93 rules applied. Total rules applied 1287 place count 177 transition count 271
Ensure Unique test removed 36 transitions
Reduce isomorphic transitions removed 36 transitions.
Iterating post reduction 2 with 36 rules applied. Total rules applied 1323 place count 177 transition count 235
Discarding 38 places :
Symmetric choice reduction at 3 with 38 rule applications. Total rules 1361 place count 139 transition count 183
Iterating global reduction 3 with 38 rules applied. Total rules applied 1399 place count 139 transition count 183
Ensure Unique test removed 23 transitions
Reduce isomorphic transitions removed 23 transitions.
Iterating post reduction 3 with 23 rules applied. Total rules applied 1422 place count 139 transition count 160
Discarding 9 places :
Symmetric choice reduction at 4 with 9 rule applications. Total rules 1431 place count 130 transition count 146
Iterating global reduction 4 with 9 rules applied. Total rules applied 1440 place count 130 transition count 146
Discarding 8 places :
Symmetric choice reduction at 4 with 8 rule applications. Total rules 1448 place count 122 transition count 138
Iterating global reduction 4 with 8 rules applied. Total rules applied 1456 place count 122 transition count 138
Discarding 4 places :
Symmetric choice reduction at 4 with 4 rule applications. Total rules 1460 place count 118 transition count 134
Iterating global reduction 4 with 4 rules applied. Total rules applied 1464 place count 118 transition count 134
Ensure Unique test removed 1 transitions
Reduce isomorphic transitions removed 1 transitions.
Iterating post reduction 4 with 1 rules applied. Total rules applied 1465 place count 118 transition count 133
Discarding 4 places :
Symmetric choice reduction at 5 with 4 rule applications. Total rules 1469 place count 114 transition count 129
Iterating global reduction 5 with 4 rules applied. Total rules applied 1473 place count 114 transition count 129
Discarding 3 places :
Symmetric choice reduction at 5 with 3 rule applications. Total rules 1476 place count 111 transition count 126
Iterating global reduction 5 with 3 rules applied. Total rules applied 1479 place count 111 transition count 126
Discarding 1 places :
Symmetric choice reduction at 5 with 1 rule applications. Total rules 1480 place count 110 transition count 123
Iterating global reduction 5 with 1 rules applied. Total rules applied 1481 place count 110 transition count 123
Discarding 1 places :
Symmetric choice reduction at 5 with 1 rule applications. Total rules 1482 place count 109 transition count 122
Iterating global reduction 5 with 1 rules applied. Total rules applied 1483 place count 109 transition count 122
Discarding 1 places :
Symmetric choice reduction at 5 with 1 rule applications. Total rules 1484 place count 108 transition count 121
Iterating global reduction 5 with 1 rules applied. Total rules applied 1485 place count 108 transition count 121
Applied a total of 1485 rules in 155 ms. Remains 108 /414 variables (removed 306) and now considering 121/1954 (removed 1833) transitions.
// Phase 1: matrix 121 rows 108 cols
[2023-03-18 23:06:42] [INFO ] Computed 5 place invariants in 17 ms
[2023-03-18 23:06:42] [INFO ] Implicit Places using invariants in 289 ms returned []
[2023-03-18 23:06:42] [INFO ] Invariant cache hit.
[2023-03-18 23:06:42] [INFO ] State equation strengthened by 47 read => feed constraints.
[2023-03-18 23:06:43] [INFO ] Implicit Places using invariants and state equation in 461 ms returned []
Implicit Place search using SMT with State Equation took 793 ms to find 0 implicit places.
[2023-03-18 23:06:43] [INFO ] Invariant cache hit.
[2023-03-18 23:06:43] [INFO ] Dead Transitions using invariants and state equation in 124 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 108/414 places, 121/1954 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 1074 ms. Remains : 108/414 places, 121/1954 transitions.
Support contains 2 out of 108 places after structural reductions.
[2023-03-18 23:06:43] [INFO ] Flatten gal took : 47 ms
[2023-03-18 23:06:43] [INFO ] Flatten gal took : 30 ms
[2023-03-18 23:06:43] [INFO ] Input system was already deterministic with 121 transitions.
Incomplete random walk after 10000 steps, including 2243 resets, run finished after 305 ms. (steps per millisecond=32 ) properties (out of 2) seen :0
Incomplete Best-First random walk after 10000 steps, including 1076 resets, run finished after 96 ms. (steps per millisecond=104 ) properties (out of 2) seen :0
Incomplete Best-First random walk after 10001 steps, including 1082 resets, run finished after 78 ms. (steps per millisecond=128 ) properties (out of 2) seen :0
Finished probabilistic random walk after 237 steps, run visited all 2 properties in 37 ms. (steps per millisecond=6 )
Probabilistic random walk after 237 steps, saw 159 distinct states, run finished after 37 ms. (steps per millisecond=6 ) properties seen :2
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-14 FALSE TECHNIQUES REACHABILITY_KNOWLEDGE
Computed a total of 27 stabilizing places and 32 stable transitions
Graph (complete) has 342 edges and 108 vertex of which 107 are kept as prefixes of interest. Removing 1 places using SCC suffix rule.2 ms
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(F(p0))'
Support contains 1 out of 108 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 108/108 places, 121/121 transitions.
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 1 place count 107 transition count 120
Iterating global reduction 0 with 1 rules applied. Total rules applied 2 place count 107 transition count 120
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 3 place count 106 transition count 118
Iterating global reduction 0 with 1 rules applied. Total rules applied 4 place count 106 transition count 118
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 5 place count 105 transition count 117
Iterating global reduction 0 with 1 rules applied. Total rules applied 6 place count 105 transition count 117
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 7 place count 104 transition count 116
Iterating global reduction 0 with 1 rules applied. Total rules applied 8 place count 104 transition count 116
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 9 place count 103 transition count 115
Iterating global reduction 0 with 1 rules applied. Total rules applied 10 place count 103 transition count 115
Applied a total of 10 rules in 38 ms. Remains 103 /108 variables (removed 5) and now considering 115/121 (removed 6) transitions.
// Phase 1: matrix 115 rows 103 cols
[2023-03-18 23:06:44] [INFO ] Computed 5 place invariants in 2 ms
[2023-03-18 23:06:44] [INFO ] Implicit Places using invariants in 170 ms returned []
[2023-03-18 23:06:44] [INFO ] Invariant cache hit.
[2023-03-18 23:06:44] [INFO ] State equation strengthened by 45 read => feed constraints.
[2023-03-18 23:06:44] [INFO ] Implicit Places using invariants and state equation in 186 ms returned []
Implicit Place search using SMT with State Equation took 362 ms to find 0 implicit places.
[2023-03-18 23:06:44] [INFO ] Redundant transitions in 2 ms returned []
[2023-03-18 23:06:44] [INFO ] Invariant cache hit.
[2023-03-18 23:06:44] [INFO ] Dead Transitions using invariants and state equation in 74 ms found 0 transitions.
Starting structural reductions in SI_LTL mode, iteration 1 : 103/108 places, 115/121 transitions.
Finished structural reductions in SI_LTL mode , in 1 iterations and 492 ms. Remains : 103/108 places, 115/121 transitions.
Stuttering acceptance computed with spot in 290 ms :[(NOT p0)]
Running random walk in product with property : SieveSingleMsgMbox-PT-d2m18-LTLCardinality-06 automaton TGBA Formula[mat=[[{ cond=(NOT p0), acceptance={0} source=0 dest: 0}]], initial=0, aps=[p0:(LEQ 1 s94)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, colored, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant, very-weak, weak, inherently-weak], stateDesc=[null][true]]
Stuttering criterion allowed to conclude after 2 steps with 0 reset in 2 ms.
FORMULA SieveSingleMsgMbox-PT-d2m18-LTLCardinality-06 FALSE TECHNIQUES STUTTER_TEST
Treatment of property SieveSingleMsgMbox-PT-d2m18-LTLCardinality-06 finished in 884 ms.
All properties solved by simple procedures.
Total runtime 3642 ms.

BK_STOP 1679180805320

--------------------
content from stderr:

+ export BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ LTLCardinality = StateSpace ]]
+ /home/mcc/BenchKit/bin//../itstools/bin//..//runeclipse.sh /home/mcc/execution LTLCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
+ export PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ export LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
+ LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202303021504.jar
+ VERSION=202303021504
+ echo 'Running Version 202303021504'
+ /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/its-tools -pnfolder /home/mcc/execution -examination LTLCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="SieveSingleMsgMbox-PT-d2m18"
export BK_EXAMINATION="LTLCardinality"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5348"
echo " Executing tool itstools"
echo " Input is SieveSingleMsgMbox-PT-d2m18, examination is LTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r421-tajo-167905975300467"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/SieveSingleMsgMbox-PT-d2m18.tgz
mv SieveSingleMsgMbox-PT-d2m18 execution
cd execution
if [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "UpperBounds" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] || [ "LTLCardinality" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "LTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "LTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "LTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property LTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "LTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' LTLCardinality.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] ; then
echo "FORMULA_NAME LTLCardinality"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;