fond
Model Checking Contest 2021
11th edition, Paris, France, June 23, 2021
Execution of r242-smll-162106584700168
Last Updated
Jun 28, 2021

About the Execution of ITS-Tools for ShieldRVt-PT-010B

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
233.436 19619.00 40817.00 486.80 F normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/data/fkordon/mcc2021-input.r242-smll-162106584700168.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fkordon/mcc2021-input.qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
...................................................................................................................
=====================================================================
Generated by BenchKit 2-4028
Executing tool itstools
Input is ShieldRVt-PT-010B, examination is StableMarking
Time confinement is 1800 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r242-smll-162106584700168
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 476K
-rw-r--r-- 1 mcc users 11K May 5 16:58 CTLCardinality.txt
-rw-r--r-- 1 mcc users 102K May 10 09:44 CTLCardinality.xml
-rw-r--r-- 1 mcc users 9.5K May 5 16:58 CTLFireability.txt
-rw-r--r-- 1 mcc users 91K May 10 09:44 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K May 6 14:48 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 3.1K Mar 28 16:41 LTLCardinality.txt
-rw-r--r-- 1 mcc users 22K Mar 28 16:41 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.0K Mar 28 16:41 LTLFireability.txt
-rw-r--r-- 1 mcc users 17K Mar 28 16:41 LTLFireability.xml
-rw-r--r-- 1 mcc users 4.1K Mar 27 12:56 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 22K Mar 27 12:56 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 2.7K Mar 25 19:01 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 17K Mar 25 19:01 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K Mar 22 08:16 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K Mar 22 08:16 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 5 16:52 equiv_col
-rw-r--r-- 1 mcc users 5 May 5 16:52 instance
-rw-r--r-- 1 mcc users 6 May 5 16:52 iscolored
-rw-r--r-- 1 mcc users 119K May 5 16:52 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

FORMULA_NAME StableMarking

=== Now, execution of the tool begins

BK_START 1621237061817

Running Version 0
[2021-05-17 07:37:46] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, StableMarking, -spotpath, /home/mcc/BenchKit/bin//..//ltlfilt, -z3path, /home/mcc/BenchKit/bin//..//z3/bin/z3, -yices2path, /home/mcc/BenchKit/bin//..//yices/bin/yices, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 1800]
[2021-05-17 07:37:46] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2021-05-17 07:37:46] [INFO ] Load time of PNML (sax parser for PT used): 167 ms
[2021-05-17 07:37:46] [INFO ] Transformed 503 places.
[2021-05-17 07:37:46] [INFO ] Transformed 503 transitions.
[2021-05-17 07:37:46] [INFO ] Found NUPN structural information;
[2021-05-17 07:37:46] [INFO ] Parsed PT model containing 503 places and 503 transitions in 266 ms.
Structural test allowed to assert that 201 places are NOT stable. Took 24 ms.
Incomplete random walk after 10000 steps, including 2 resets, run finished after 189 ms. (steps per millisecond=52 ) properties (out of 302) seen :300
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 32 ms. (steps per millisecond=312 ) properties (out of 2) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 18 ms. (steps per millisecond=555 ) properties (out of 2) seen :0
Running SMT prover for 2 properties.
// Phase 1: matrix 503 rows 503 cols
[2021-05-17 07:37:47] [INFO ] Computed 41 place invariants in 34 ms
[2021-05-17 07:37:47] [INFO ] [Real]Absence check using 41 positive place invariants in 42 ms returned sat
[2021-05-17 07:37:47] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-17 07:37:47] [INFO ] [Real]Absence check using state equation in 357 ms returned sat
[2021-05-17 07:37:47] [INFO ] Solution in real domain found non-integer solution.
[2021-05-17 07:37:48] [INFO ] [Nat]Absence check using 41 positive place invariants in 37 ms returned sat
[2021-05-17 07:37:48] [INFO ] [Nat]Adding state equation constraints to refine reachable states.
[2021-05-17 07:37:48] [INFO ] [Nat]Absence check using state equation in 322 ms returned sat
[2021-05-17 07:37:48] [INFO ] Deduced a trap composed of 31 places in 271 ms of which 9 ms to minimize.
[2021-05-17 07:37:49] [INFO ] Deduced a trap composed of 29 places in 238 ms of which 3 ms to minimize.
[2021-05-17 07:37:49] [INFO ] Deduced a trap composed of 20 places in 221 ms of which 2 ms to minimize.
[2021-05-17 07:37:49] [INFO ] Deduced a trap composed of 23 places in 217 ms of which 5 ms to minimize.
[2021-05-17 07:37:49] [INFO ] Deduced a trap composed of 66 places in 184 ms of which 1 ms to minimize.
[2021-05-17 07:37:50] [INFO ] Deduced a trap composed of 41 places in 162 ms of which 1 ms to minimize.
[2021-05-17 07:37:50] [INFO ] Deduced a trap composed of 29 places in 144 ms of which 0 ms to minimize.
[2021-05-17 07:37:50] [INFO ] Deduced a trap composed of 21 places in 157 ms of which 1 ms to minimize.
[2021-05-17 07:37:50] [INFO ] Deduced a trap composed of 31 places in 181 ms of which 1 ms to minimize.
[2021-05-17 07:37:50] [INFO ] Deduced a trap composed of 25 places in 167 ms of which 2 ms to minimize.
[2021-05-17 07:37:51] [INFO ] Deduced a trap composed of 28 places in 144 ms of which 1 ms to minimize.
[2021-05-17 07:37:51] [INFO ] Deduced a trap composed of 26 places in 159 ms of which 1 ms to minimize.
[2021-05-17 07:37:51] [INFO ] Deduced a trap composed of 30 places in 118 ms of which 1 ms to minimize.
[2021-05-17 07:37:51] [INFO ] Deduced a trap composed of 37 places in 142 ms of which 1 ms to minimize.
[2021-05-17 07:37:51] [INFO ] Deduced a trap composed of 34 places in 125 ms of which 0 ms to minimize.
[2021-05-17 07:37:52] [INFO ] Deduced a trap composed of 37 places in 217 ms of which 1 ms to minimize.
[2021-05-17 07:37:52] [INFO ] Deduced a trap composed of 48 places in 110 ms of which 0 ms to minimize.
[2021-05-17 07:37:52] [INFO ] Deduced a trap composed of 31 places in 106 ms of which 1 ms to minimize.
[2021-05-17 07:37:52] [INFO ] Deduced a trap composed of 38 places in 102 ms of which 0 ms to minimize.
[2021-05-17 07:37:52] [INFO ] Trap strengthening (SAT) tested/added 20/19 trap constraints in 3960 ms
[2021-05-17 07:37:52] [INFO ] Computed and/alt/rep : 502/743/502 causal constraints (skipped 0 transitions) in 71 ms.
[2021-05-17 07:37:52] [WARNING] SMT solver failed with error :java.lang.RuntimeException: SMT solver raised an error when submitting script. Raised (error "Failed to assert expression: java.io.IOException: Stream close... while checking expression at index 0
[2021-05-17 07:37:53] [INFO ] [Real]Absence check using 41 positive place invariants in 34 ms returned sat
[2021-05-17 07:37:53] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-17 07:37:53] [INFO ] [Real]Absence check using state equation in 313 ms returned sat
[2021-05-17 07:37:53] [INFO ] Solution in real domain found non-integer solution.
[2021-05-17 07:37:53] [INFO ] [Nat]Absence check using 41 positive place invariants in 36 ms returned sat
[2021-05-17 07:37:53] [INFO ] [Nat]Adding state equation constraints to refine reachable states.
[2021-05-17 07:37:54] [INFO ] [Nat]Absence check using state equation in 373 ms returned sat
[2021-05-17 07:37:54] [INFO ] Deduced a trap composed of 52 places in 275 ms of which 2 ms to minimize.
[2021-05-17 07:37:54] [INFO ] Deduced a trap composed of 21 places in 253 ms of which 1 ms to minimize.
[2021-05-17 07:37:54] [INFO ] Deduced a trap composed of 20 places in 227 ms of which 1 ms to minimize.
[2021-05-17 07:37:55] [INFO ] Deduced a trap composed of 23 places in 145 ms of which 1 ms to minimize.
[2021-05-17 07:37:55] [INFO ] Deduced a trap composed of 18 places in 150 ms of which 0 ms to minimize.
[2021-05-17 07:37:55] [INFO ] Deduced a trap composed of 28 places in 145 ms of which 1 ms to minimize.
[2021-05-17 07:37:55] [INFO ] Deduced a trap composed of 25 places in 153 ms of which 1 ms to minimize.
[2021-05-17 07:37:55] [INFO ] Deduced a trap composed of 30 places in 134 ms of which 1 ms to minimize.
[2021-05-17 07:37:56] [INFO ] Deduced a trap composed of 38 places in 165 ms of which 0 ms to minimize.
[2021-05-17 07:37:56] [INFO ] Deduced a trap composed of 47 places in 138 ms of which 1 ms to minimize.
[2021-05-17 07:37:56] [INFO ] Deduced a trap composed of 35 places in 117 ms of which 1 ms to minimize.
[2021-05-17 07:37:56] [INFO ] Deduced a trap composed of 32 places in 263 ms of which 0 ms to minimize.
[2021-05-17 07:37:57] [INFO ] Deduced a trap composed of 39 places in 703 ms of which 1 ms to minimize.
[2021-05-17 07:37:57] [INFO ] Deduced a trap composed of 30 places in 513 ms of which 1 ms to minimize.
[2021-05-17 07:37:58] [INFO ] Deduced a trap composed of 39 places in 94 ms of which 1 ms to minimize.
[2021-05-17 07:37:58] [INFO ] Deduced a trap composed of 32 places in 128 ms of which 9 ms to minimize.
[2021-05-17 07:37:58] [INFO ] Deduced a trap composed of 28 places in 113 ms of which 1 ms to minimize.
[2021-05-17 07:37:58] [INFO ] Deduced a trap composed of 35 places in 160 ms of which 2 ms to minimize.
[2021-05-17 07:37:58] [WARNING] SMT solver failed with error :java.lang.RuntimeException: SMT solver raised an error when submitting script. Raised (error "Failed to assert expression: java.io.IOException: Stream close... while checking expression at index 1
Fused 2 Parikh solutions to 1 different solutions.
Support contains 2 out of 503 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 503/503 places, 503/503 transitions.
Drop transitions removed 160 transitions
Trivial Post-agglo rules discarded 160 transitions
Performed 160 trivial Post agglomeration. Transition count delta: 160
Iterating post reduction 0 with 160 rules applied. Total rules applied 160 place count 503 transition count 343
Reduce places removed 160 places and 0 transitions.
Ensure Unique test removed 1 transitions
Reduce isomorphic transitions removed 1 transitions.
Drop transitions removed 1 transitions
Trivial Post-agglo rules discarded 1 transitions
Performed 1 trivial Post agglomeration. Transition count delta: 1
Iterating post reduction 1 with 162 rules applied. Total rules applied 322 place count 343 transition count 341
Reduce places removed 1 places and 0 transitions.
Iterating post reduction 2 with 1 rules applied. Total rules applied 323 place count 342 transition count 341
Performed 40 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 3 with 40 Pre rules applied. Total rules applied 323 place count 342 transition count 301
Deduced a syphon composed of 40 places in 20 ms
Reduce places removed 40 places and 0 transitions.
Iterating global reduction 3 with 80 rules applied. Total rules applied 403 place count 302 transition count 301
Discarding 70 places :
Symmetric choice reduction at 3 with 70 rule applications. Total rules 473 place count 232 transition count 231
Iterating global reduction 3 with 70 rules applied. Total rules applied 543 place count 232 transition count 231
Performed 30 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 3 with 30 Pre rules applied. Total rules applied 543 place count 232 transition count 201
Deduced a syphon composed of 30 places in 2 ms
Reduce places removed 30 places and 0 transitions.
Iterating global reduction 3 with 60 rules applied. Total rules applied 603 place count 202 transition count 201
Performed 88 Post agglomeration using F-continuation condition.Transition count delta: 88
Deduced a syphon composed of 88 places in 17 ms
Reduce places removed 88 places and 0 transitions.
Iterating global reduction 3 with 176 rules applied. Total rules applied 779 place count 114 transition count 113
Performed 28 Post agglomeration using F-continuation condition.Transition count delta: -26
Deduced a syphon composed of 28 places in 14 ms
Reduce places removed 28 places and 0 transitions.
Iterating global reduction 3 with 56 rules applied. Total rules applied 835 place count 86 transition count 139
Drop transitions removed 1 transitions
Reduce isomorphic transitions removed 1 transitions.
Iterating post reduction 3 with 1 rules applied. Total rules applied 836 place count 86 transition count 138
Free-agglomeration rule applied 2 times.
Iterating global reduction 4 with 2 rules applied. Total rules applied 838 place count 86 transition count 136
Reduce places removed 2 places and 0 transitions.
Iterating post reduction 4 with 2 rules applied. Total rules applied 840 place count 84 transition count 136
Drop transitions removed 1 transitions
Redundant transition composition rules discarded 1 transitions
Iterating global reduction 5 with 1 rules applied. Total rules applied 841 place count 84 transition count 135
Reduce places removed 1 places and 1 transitions.
Iterating global reduction 5 with 1 rules applied. Total rules applied 842 place count 83 transition count 134
Reduce places removed 1 places and 0 transitions.
Iterating post reduction 5 with 1 rules applied. Total rules applied 843 place count 82 transition count 134
Applied a total of 843 rules in 355 ms. Remains 82 /503 variables (removed 421) and now considering 134/503 (removed 369) transitions.
Finished structural reductions, in 1 iterations. Remains : 82/503 places, 134/503 transitions.
[2021-05-17 07:37:59] [INFO ] Flatten gal took : 141 ms
[2021-05-17 07:37:59] [INFO ] Flatten gal took : 37 ms
[2021-05-17 07:37:59] [INFO ] Time to serialize gal into /tmp/ReachabilityCardinality5329668502128373877.gal : 24 ms
[2021-05-17 07:37:59] [INFO ] Time to serialize properties into /tmp/ReachabilityCardinality9520384236740122766.prop : 1 ms
Invoking ITS tools like this :CommandLine [args=[/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-reach-linux64, --gc-threshold, 2000000, --quiet, -i, /tmp/ReachabilityCardinality5329668502128373877.gal, -t, CGAL, -reachable-file, /tmp/ReachabilityCardinality9520384236740122766.prop, --nowitness, --gen-order, FOLLOW], workingDir=/home/mcc/execution]

its-reach command run as :

/home/mcc/BenchKit/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202104292328/bin/its-reach-linux64 --gc-threshold 2000000 --quiet -i /tmp/ReachabilityCardinality5329668502128373877.gal -t CGAL -reachable-file /tmp/ReachabilityCardinality9520384236740122766.prop --nowitness --gen-order FOLLOW
Loading property file /tmp/ReachabilityCardinality9520384236740122766.prop.
SDD proceeding with computation,2 properties remain. new max is 4
SDD size :1 after 11
SDD proceeding with computation,2 properties remain. new max is 8
SDD size :11 after 26
Invariant property smplace_30 does not hold.
Invariant property smplace_19 does not hold.
Found states matching all0 target predicate
Will report total states built up to this point. Computation was interrupted after 9 fixpoint passes
Model ,|S| ,Time ,Mem(kb) ,fin. SDD ,fin. DDD ,peak SDD ,peak DDD ,SDD Hom ,SDD cache peak ,DDD Hom ,DDD cachepeak ,SHom cache
petri\_inst\_inst,41,0.089546,5756,2,225,9,997,6,0,465,363,0
Total reachable state count : 41

Verifying 2 reachability properties.
Invariant property smplace_19 does not hold.

Model ,|S| ,Time ,Mem(kb) ,fin. SDD ,fin. DDD ,peak SDD ,peak DDD ,SDD Hom ,SDD cache peak ,DDD Hom ,DDD cachepeak ,SHom cache
smplace\_19,1,0.090298,5756,2,83,9,997,7,0,468,363,0
Invariant property smplace_30 does not hold.

Model ,|S| ,Time ,Mem(kb) ,fin. SDD ,fin. DDD ,peak SDD ,peak DDD ,SDD Hom ,SDD cache peak ,DDD Hom ,DDD cachepeak ,SHom cache
smplace\_30,1,0.09081,5756,2,83,9,997,8,0,470,363,0
Able to resolve query StableMarking after proving 303 properties.
FORMULA StableMarking FALSE TECHNIQUES RANDOM_WALK MARKED_SUFFIX_TEST DECISION_DIAGRAMS COLLATERAL_PROCESSING TOPOLOGICAL

BK_STOP 1621237081436

--------------------
content from stderr:

+ export BINDIR=/home/mcc/BenchKit/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ StableMarking = StateSpace ]]
+ /home/mcc/BenchKit/bin//..//runeclipse.sh /home/mcc/execution StableMarking -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 1800
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
++ cut -d . -f 9
++ ls /home/mcc/BenchKit/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202104292328.jar
+ VERSION=0
+ echo 'Running Version 0'
+ /home/mcc/BenchKit/bin//..//itstools/its-tools -data /home/mcc/execution/workspace -pnfolder /home/mcc/execution -examination StableMarking -spotpath /home/mcc/BenchKit/bin//..//ltlfilt -z3path /home/mcc/BenchKit/bin//..//z3/bin/z3 -yices2path /home/mcc/BenchKit/bin//..//yices/bin/yices -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 1800 -vmargs -Dosgi.locking=none -Declipse.stateSaveDelayInterval=-1 -Dosgi.configuration.area=/tmp/.eclipse -Xss128m -Xms40m -Xmx16000m

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="ShieldRVt-PT-010B"
export BK_EXAMINATION="StableMarking"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="1800"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool itstools"
echo " Input is ShieldRVt-PT-010B, examination is StableMarking"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r242-smll-162106584700168"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/ShieldRVt-PT-010B.tgz
mv ShieldRVt-PT-010B execution
cd execution
if [ "StableMarking" = "ReachabilityDeadlock" ] || [ "StableMarking" = "UpperBounds" ] || [ "StableMarking" = "QuasiLiveness" ] || [ "StableMarking" = "StableMarking" ] || [ "StableMarking" = "Liveness" ] || [ "StableMarking" = "OneSafe" ] || [ "StableMarking" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "StableMarking" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "StableMarking" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "StableMarking.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property StableMarking.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "StableMarking.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' StableMarking.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "StableMarking" = "ReachabilityDeadlock" ] || [ "StableMarking" = "QuasiLiveness" ] || [ "StableMarking" = "StableMarking" ] || [ "StableMarking" = "Liveness" ] || [ "StableMarking" = "OneSafe" ] ; then
echo "FORMULA_NAME StableMarking"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;