fond
Model Checking Contest 2023
13th edition, Paris, France, April 26, 2023 (at TOOLympics II)
Execution of r421-tajo-167905975200411
Last Updated
May 14, 2023

About the Execution of ITS-Tools for SieveSingleMsgMbox-PT-d1m06

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
315.699 6280.00 13632.00 127.80 FTFTFFFTFFTTTFTT normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/mnt/tpsp/fkordon/mcc2023-input.r421-tajo-167905975200411.qcow2', fmt=qcow2 size=4294967296 backing_file='/mnt/tpsp/fkordon/mcc2023-input.qcow2' encryption=off cluster_size=65536 lazy_refcounts=off
Waiting for the VM to be ready (probing ssh)
.........................
=====================================================================
Generated by BenchKit 2-5348
Executing tool itstools
Input is SieveSingleMsgMbox-PT-d1m06, examination is LTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r421-tajo-167905975200411
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 868K
-rw-r--r-- 1 mcc users 6.6K Feb 26 10:26 CTLCardinality.txt
-rw-r--r-- 1 mcc users 67K Feb 26 10:26 CTLCardinality.xml
-rw-r--r-- 1 mcc users 5.4K Feb 26 10:25 CTLFireability.txt
-rw-r--r-- 1 mcc users 47K Feb 26 10:25 CTLFireability.xml
-rw-r--r-- 1 mcc users 3.3K Feb 25 17:05 LTLCardinality.txt
-rw-r--r-- 1 mcc users 21K Feb 25 17:05 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.5K Feb 25 17:05 LTLFireability.txt
-rw-r--r-- 1 mcc users 18K Feb 25 17:05 LTLFireability.xml
-rw-r--r-- 1 mcc users 12K Feb 26 10:27 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 120K Feb 26 10:27 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 8.1K Feb 26 10:27 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 68K Feb 26 10:27 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.8K Feb 25 17:05 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.8K Feb 25 17:05 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 Mar 5 18:23 equiv_col
-rw-r--r-- 1 mcc users 6 Mar 5 18:23 instance
-rw-r--r-- 1 mcc users 6 Mar 5 18:23 iscolored
-rw-r--r-- 1 mcc users 450K Mar 5 18:23 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-00
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-01
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-02
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-03
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-04
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-05
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-06
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-07
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-08
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-09
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-10
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-11
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-12
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-13
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-14
FORMULA_NAME SieveSingleMsgMbox-PT-d1m06-LTLCardinality-15

=== Now, execution of the tool begins

BK_START 1679178591572

bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
Invoking MCC driver with
BK_TOOL=itstools
BK_EXAMINATION=LTLCardinality
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=SieveSingleMsgMbox-PT-d1m06
Not applying reductions.
Model is PT
LTLCardinality PT
Running Version 202303021504
[2023-03-18 22:29:53] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, LTLCardinality, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2023-03-18 22:29:53] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2023-03-18 22:29:53] [INFO ] Load time of PNML (sax parser for PT used): 109 ms
[2023-03-18 22:29:53] [INFO ] Transformed 1295 places.
[2023-03-18 22:29:53] [INFO ] Transformed 749 transitions.
[2023-03-18 22:29:53] [INFO ] Parsed PT model containing 1295 places and 749 transitions and 2996 arcs in 236 ms.
Parsed 16 properties from file /home/mcc/execution/LTLCardinality.xml in 9 ms.
Working with output stream class java.io.PrintStream
Initial state reduction rules removed 4 formulas.
Deduced a syphon composed of 1036 places in 10 ms
Reduce places removed 1036 places and 0 transitions.
Initial state reduction rules removed 1 formulas.
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-00 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-01 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-02 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-03 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-04 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-07 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-08 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-11 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-12 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-13 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-14 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-15 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-05 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-10 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Support contains 2 out of 259 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 259/259 places, 749/749 transitions.
Reduce places removed 17 places and 0 transitions.
Ensure Unique test removed 240 transitions
Reduce isomorphic transitions removed 240 transitions.
Iterating post reduction 0 with 257 rules applied. Total rules applied 257 place count 242 transition count 509
Discarding 60 places :
Symmetric choice reduction at 1 with 60 rule applications. Total rules 317 place count 182 transition count 233
Iterating global reduction 1 with 60 rules applied. Total rules applied 377 place count 182 transition count 233
Ensure Unique test removed 6 transitions
Reduce isomorphic transitions removed 6 transitions.
Iterating post reduction 1 with 6 rules applied. Total rules applied 383 place count 182 transition count 227
Discarding 43 places :
Symmetric choice reduction at 2 with 43 rule applications. Total rules 426 place count 139 transition count 184
Iterating global reduction 2 with 43 rules applied. Total rules applied 469 place count 139 transition count 184
Ensure Unique test removed 15 transitions
Reduce isomorphic transitions removed 15 transitions.
Iterating post reduction 2 with 15 rules applied. Total rules applied 484 place count 139 transition count 169
Discarding 26 places :
Symmetric choice reduction at 3 with 26 rule applications. Total rules 510 place count 113 transition count 141
Iterating global reduction 3 with 26 rules applied. Total rules applied 536 place count 113 transition count 141
Ensure Unique test removed 16 transitions
Reduce isomorphic transitions removed 16 transitions.
Iterating post reduction 3 with 16 rules applied. Total rules applied 552 place count 113 transition count 125
Discarding 6 places :
Symmetric choice reduction at 4 with 6 rule applications. Total rules 558 place count 107 transition count 117
Iterating global reduction 4 with 6 rules applied. Total rules applied 564 place count 107 transition count 117
Discarding 6 places :
Symmetric choice reduction at 4 with 6 rule applications. Total rules 570 place count 101 transition count 111
Iterating global reduction 4 with 6 rules applied. Total rules applied 576 place count 101 transition count 111
Discarding 3 places :
Symmetric choice reduction at 4 with 3 rule applications. Total rules 579 place count 98 transition count 108
Iterating global reduction 4 with 3 rules applied. Total rules applied 582 place count 98 transition count 108
Ensure Unique test removed 2 transitions
Reduce isomorphic transitions removed 2 transitions.
Iterating post reduction 4 with 2 rules applied. Total rules applied 584 place count 98 transition count 106
Discarding 3 places :
Symmetric choice reduction at 5 with 3 rule applications. Total rules 587 place count 95 transition count 103
Iterating global reduction 5 with 3 rules applied. Total rules applied 590 place count 95 transition count 103
Discarding 1 places :
Symmetric choice reduction at 5 with 1 rule applications. Total rules 591 place count 94 transition count 102
Iterating global reduction 5 with 1 rules applied. Total rules applied 592 place count 94 transition count 102
Applied a total of 592 rules in 126 ms. Remains 94 /259 variables (removed 165) and now considering 102/749 (removed 647) transitions.
// Phase 1: matrix 102 rows 94 cols
[2023-03-18 22:29:54] [INFO ] Computed 5 place invariants in 10 ms
[2023-03-18 22:29:54] [INFO ] Implicit Places using invariants in 202 ms returned []
[2023-03-18 22:29:54] [INFO ] Invariant cache hit.
[2023-03-18 22:29:54] [INFO ] State equation strengthened by 40 read => feed constraints.
[2023-03-18 22:29:54] [INFO ] Implicit Places using invariants and state equation in 310 ms returned []
Implicit Place search using SMT with State Equation took 542 ms to find 0 implicit places.
[2023-03-18 22:29:54] [INFO ] Invariant cache hit.
[2023-03-18 22:29:54] [INFO ] Dead Transitions using invariants and state equation in 146 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 94/259 places, 102/749 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 816 ms. Remains : 94/259 places, 102/749 transitions.
Support contains 2 out of 94 places after structural reductions.
[2023-03-18 22:29:54] [INFO ] Flatten gal took : 32 ms
[2023-03-18 22:29:54] [INFO ] Flatten gal took : 14 ms
[2023-03-18 22:29:55] [INFO ] Input system was already deterministic with 102 transitions.
Incomplete random walk after 10000 steps, including 2212 resets, run finished after 245 ms. (steps per millisecond=40 ) properties (out of 2) seen :0
Incomplete Best-First random walk after 10001 steps, including 1033 resets, run finished after 54 ms. (steps per millisecond=185 ) properties (out of 2) seen :0
Incomplete Best-First random walk after 10001 steps, including 1066 resets, run finished after 60 ms. (steps per millisecond=166 ) properties (out of 2) seen :0
Probably explored full state space saw : 52233 states, properties seen :1
Probabilistic random walk after 130300 steps, saw 52233 distinct states, run finished after 747 ms. (steps per millisecond=174 ) properties seen :1
Explored full state space saw : 52233 states, properties seen :0
Exhaustive walk after 130300 steps, saw 52233 distinct states, run finished after 109 ms. (steps per millisecond=1195 ) properties seen :0
Successfully simplified 1 atomic propositions for a total of 2 simplifications.
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-06 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Computed a total of 30 stabilizing places and 37 stable transitions
Graph (complete) has 294 edges and 94 vertex of which 93 are kept as prefixes of interest. Removing 1 places using SCC suffix rule.3 ms
Running Spot : '/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.ltl.spot.binaries_1.0.0.202303021504/bin/ltl2tgba-linux64' '--check=stutter' '--hoaf=tv' '-f' '!(F(p0))'
Support contains 1 out of 94 places. Attempting structural reductions.
Starting structural reductions in SI_LTL mode, iteration 0 : 94/94 places, 102/102 transitions.
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 1 place count 93 transition count 101
Iterating global reduction 0 with 1 rules applied. Total rules applied 2 place count 93 transition count 101
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 3 place count 92 transition count 100
Iterating global reduction 0 with 1 rules applied. Total rules applied 4 place count 92 transition count 100
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 5 place count 91 transition count 99
Iterating global reduction 0 with 1 rules applied. Total rules applied 6 place count 91 transition count 99
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 7 place count 90 transition count 98
Iterating global reduction 0 with 1 rules applied. Total rules applied 8 place count 90 transition count 98
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 9 place count 89 transition count 96
Iterating global reduction 0 with 1 rules applied. Total rules applied 10 place count 89 transition count 96
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 11 place count 88 transition count 95
Iterating global reduction 0 with 1 rules applied. Total rules applied 12 place count 88 transition count 95
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 13 place count 87 transition count 94
Iterating global reduction 0 with 1 rules applied. Total rules applied 14 place count 87 transition count 94
Applied a total of 14 rules in 48 ms. Remains 87 /94 variables (removed 7) and now considering 94/102 (removed 8) transitions.
// Phase 1: matrix 94 rows 87 cols
[2023-03-18 22:29:56] [INFO ] Computed 5 place invariants in 13 ms
[2023-03-18 22:29:56] [INFO ] Implicit Places using invariants in 145 ms returned []
[2023-03-18 22:29:56] [INFO ] Invariant cache hit.
[2023-03-18 22:29:56] [INFO ] State equation strengthened by 37 read => feed constraints.
[2023-03-18 22:29:56] [INFO ] Implicit Places using invariants and state equation in 190 ms returned []
Implicit Place search using SMT with State Equation took 360 ms to find 0 implicit places.
[2023-03-18 22:29:56] [INFO ] Redundant transitions in 2 ms returned []
[2023-03-18 22:29:56] [INFO ] Invariant cache hit.
[2023-03-18 22:29:56] [INFO ] Dead Transitions using invariants and state equation in 142 ms found 0 transitions.
Starting structural reductions in SI_LTL mode, iteration 1 : 87/94 places, 94/102 transitions.
Finished structural reductions in SI_LTL mode , in 1 iterations and 590 ms. Remains : 87/94 places, 94/102 transitions.
Stuttering acceptance computed with spot in 249 ms :[(NOT p0)]
Running random walk in product with property : SieveSingleMsgMbox-PT-d1m06-LTLCardinality-09 automaton TGBA Formula[mat=[[{ cond=(NOT p0), acceptance={0} source=0 dest: 0}]], initial=0, aps=[p0:(LEQ 1 s10)], nbAcceptance=1, properties=[trans-labels, explicit-labels, trans-acc, colored, deterministic, no-univ-branch, unambiguous, semi-deterministic, stutter-invariant, very-weak, weak, inherently-weak], stateDesc=[null][true]]
Stuttering criterion allowed to conclude after 11 steps with 0 reset in 2 ms.
FORMULA SieveSingleMsgMbox-PT-d1m06-LTLCardinality-09 FALSE TECHNIQUES STUTTER_TEST
Treatment of property SieveSingleMsgMbox-PT-d1m06-LTLCardinality-09 finished in 934 ms.
All properties solved by simple procedures.
Total runtime 3670 ms.

BK_STOP 1679178597852

--------------------
content from stderr:

+ export BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ LTLCardinality = StateSpace ]]
+ /home/mcc/BenchKit/bin//../itstools/bin//..//runeclipse.sh /home/mcc/execution LTLCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
+ export PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ export LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
+ LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202303021504.jar
+ VERSION=202303021504
+ echo 'Running Version 202303021504'
+ /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/its-tools -pnfolder /home/mcc/execution -examination LTLCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="SieveSingleMsgMbox-PT-d1m06"
export BK_EXAMINATION="LTLCardinality"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5348"
echo " Executing tool itstools"
echo " Input is SieveSingleMsgMbox-PT-d1m06, examination is LTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r421-tajo-167905975200411"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/SieveSingleMsgMbox-PT-d1m06.tgz
mv SieveSingleMsgMbox-PT-d1m06 execution
cd execution
if [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "UpperBounds" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] || [ "LTLCardinality" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "LTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "LTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "LTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property LTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "LTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' LTLCardinality.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] ; then
echo "FORMULA_NAME LTLCardinality"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;