fond
Model Checking Contest 2018
8th edition, Bratislava, Slovakia, June 26, 2018
Execution of r162-smll-152705514100172
Last Updated
June 26, 2018

About the Execution of Irma.full for Solitaire-PT-SqrNC5x5

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
6995.290 915269.00 927327.00 4527.70 FTFTFFFTFTTFFFFT normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Waiting for the VM to be ready (probing ssh)
..................
/home/mcc/execution
total 244K
-rw-r--r-- 1 mcc users 4.2K May 15 18:54 CTLCardinality.txt
-rw-r--r-- 1 mcc users 26K May 15 18:54 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.4K May 15 18:54 CTLFireability.txt
-rw-r--r-- 1 mcc users 15K May 15 18:54 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K May 15 18:50 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.3K May 15 18:50 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 2.5K May 15 18:54 LTLCardinality.txt
-rw-r--r-- 1 mcc users 12K May 15 18:54 LTLCardinality.xml
-rw-r--r-- 1 mcc users 1.9K May 15 18:54 LTLFireability.txt
-rw-r--r-- 1 mcc users 8.0K May 15 18:54 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.6K May 15 18:54 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 18K May 15 18:54 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 112 May 15 18:54 ReachabilityDeadlock.txt
-rw-r--r-- 1 mcc users 350 May 15 18:54 ReachabilityDeadlock.xml
-rw-r--r-- 1 mcc users 3.4K May 15 18:54 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 22K May 15 18:54 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.7K May 15 18:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K May 15 18:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 15 18:50 equiv_col
-rw-r--r-- 1 mcc users 9 May 15 18:50 instance
-rw-r--r-- 1 mcc users 6 May 15 18:50 iscolored
-rw-r--r-- 1 mcc users 66K May 15 18:50 model.pnml
=====================================================================
Generated by BenchKit 2-3637
Executing tool irma4mcc-full
Input is Solitaire-PT-SqrNC5x5, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r162-smll-152705514100172
=====================================================================


--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-00
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-01
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-02
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-03
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-04
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-05
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-06
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-07
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-08
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-09
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-10
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-11
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-12
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-13
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-14
FORMULA_NAME Solitaire-PT-SqrNC5x5-CTLFireability-15

=== Now, execution of the tool begins

BK_START 1527070401428


BK_STOP 1527071316697

--------------------
content from stderr:

Prefix is 65b80f64.
Reading known information in /usr/share/mcc4mcc/65b80f64-known.json.
Reading learned information in /usr/share/mcc4mcc/65b80f64-learned.json.
Reading value translations in /usr/share/mcc4mcc/65b80f64-values.json.
Using directory /home/mcc/execution for input, as it contains a model.pnml file.
Using Solitaire-PT-SqrNC5x5 as instance name.
Using Solitaire as model name.
Using algorithm or tool voting-classifier.
Model characteristics are: {'Examination': 'CTLFireability', 'Place/Transition': True, 'Colored': False, 'Relative-Time': 1, 'Relative-Memory': 1, 'Ordinary': True, 'Simple Free Choice': False, 'Extended Free Choice': False, 'State Machine': False, 'Marked Graph': False, 'Connected': True, 'Strongly Connected': None, 'Source Place': None, 'Sink Place': False, 'Source Transition': False, 'Sink Transition': False, 'Loop Free': True, 'Conservative': None, 'Sub-Conservative': True, 'Nested Units': False, 'Safe': None, 'Deadlock': True, 'Reversible': False, 'Quasi Live': True, 'Live': False}.
/usr/local/lib/python3.6/dist-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty.
if diff:
Known tools are: [{'Time': 1158914, 'Memory': 6661.72, 'Tool': 'marcie'}, {'Time': 1204903, 'Memory': 6662.1, 'Tool': 'marcie'}, {'Time': 2028957, 'Memory': 2729.5, 'Tool': 'lola'}, {'Time': 2122620, 'Memory': 2770.27, 'Tool': 'lola'}, {'Time': 3511863, 'Memory': 14792.26, 'Tool': 'itstools'}, {'Time': 3512124, 'Memory': 14814.98, 'Tool': 'itstools'}].
Learned tools are: [{'Tool': 'lola'}].
Learned tool lola is 1.7507399168531919x far from the best tool marcie.
CTLFireability marcie Solitaire-PT-SqrNC5x5...
timeout --kill-after=10s --signal=SIGINT 1m for testing only

Marcie rev. 8852M (built: crohr on 2017-05-03)
A model checker for Generalized Stochastic Petri nets

authors: Alex Tovchigrechko (IDD package and CTL model checking)

Martin Schwarick (Symbolic numerical analysis and CSL model checking)

Christian Rohr (Simulative and approximative numerical model checking)

marcie@informatik.tu-cottbus.de

called as: marcie --net-file=model.pnml --mcc-file=CTLFireability.xml --memory=6

parse successfull
net created successfully

Net: Solitaire_PT_SqrNC5x5
(NrP: 50 NrTr: 84 NrArc: 456)

check for maximal unmarked siphon
ok
check for constant places
ok
parse formulas
formulas created successfully
place and transition orderings generation:0m 0.001sec
check if there are places and transitions
ok
check if there are transitions without pre-places
ok
check if at least one transition is enabled in m0
ok
check if there are transitions that can never fire
ok


net check time: 0m 0.000sec

init dd package: 0m 1.583sec


after gc: zbdd nodes used:62340, unused:18687660
RS generation: 0m12.084sec


-> reachability set: #nodes 41095 (4.1e+04) #states 16,098,428 (7)



starting MCC model checker
--------------------------

checking: AF [~ [EX [IS_FIREABLE [down25]]]]
normalized: ~ [EG [EX [IS_FIREABLE [down25]]]]

...........10:65661..
after gc: zbdd nodes used:845853, unused:36654147........20:91953..
after gc: zbdd nodes used:751803, unused:74248197........30:19897..........40:64....
EG iterations: 44
-> the formula is TRUE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-03 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 1m29.833sec

checking: EG [IS_FIREABLE [right32]]
normalized: EG [IS_FIREABLE [right32]]

..........10:39809..........20:64352..........30:14799..........40:154.....
EG iterations: 45
-> the formula is FALSE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-08 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m51.411sec

checking: EF [AG [IS_FIREABLE [left55]]]
normalized: E [true U ~ [E [true U ~ [IS_FIREABLE [left55]]]]]

-> the formula is FALSE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-11 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 2.779sec

checking: AF [EF [AG [IS_FIREABLE [up63]]]]
normalized: ~ [EG [~ [E [true U ~ [E [true U ~ [IS_FIREABLE [up63]]]]]]]]


EG iterations: 0
-> the formula is FALSE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-12 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.178sec

checking: AF [[IS_FIREABLE [right36] | IS_FIREABLE [down55]]]
normalized: ~ [EG [~ [[IS_FIREABLE [right36] | IS_FIREABLE [down55]]]]]

.
EG iterations: 1
-> the formula is FALSE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-00 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 2.029sec

checking: AX [[AF [~ [IS_FIREABLE [down55]]] | ~ [EX [IS_FIREABLE [right56]]]]]
normalized: ~ [EX [~ [[~ [EX [IS_FIREABLE [right56]]] | ~ [EG [IS_FIREABLE [down55]]]]]]]

..........10:23088.......
after gc: zbdd nodes used:70531, unused:149929469...20:28712..........30:2719.........
EG iterations: 39
..-> the formula is TRUE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-01 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m21.602sec

checking: ~ [[~ [~ [EX [IS_FIREABLE [right35]]]] & ~ [EG [IS_FIREABLE [up63]]]]]
normalized: ~ [[~ [EG [IS_FIREABLE [up63]]] & EX [IS_FIREABLE [right35]]]]

...........10:31745..........20:50860..........30:13167..........40:122.....
EG iterations: 45
-> the formula is FALSE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-04 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m40.607sec

checking: AF [AF [[IS_FIREABLE [left44] & IS_FIREABLE [left33]]]]
normalized: ~ [EG [EG [~ [[IS_FIREABLE [left44] & IS_FIREABLE [left33]]]]]]

.
EG iterations: 1
.
EG iterations: 1
-> the formula is FALSE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-13 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 3.533sec

checking: ~ [[AX [EX [IS_FIREABLE [right64]]] | AF [AF [IS_FIREABLE [up56]]]]]
normalized: ~ [[~ [EG [EG [~ [IS_FIREABLE [up56]]]]] | ~ [EX [~ [EX [IS_FIREABLE [right64]]]]]]]

...
EG iterations: 1
.
EG iterations: 1
-> the formula is TRUE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-15 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 2.736sec

checking: [[EF [AF [IS_FIREABLE [right45]]] | IS_FIREABLE [up64]] & AG [AF [IS_FIREABLE [down55]]]]
normalized: [~ [E [true U EG [~ [IS_FIREABLE [down55]]]]] & [IS_FIREABLE [up64] | E [true U ~ [EG [~ [IS_FIREABLE [right45]]]]]]]

.
EG iterations: 1
.
EG iterations: 1
-> the formula is FALSE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-05 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m10.303sec

checking: ~ [[[AF [IS_FIREABLE [down44]] | AG [IS_FIREABLE [up44]]] & EF [IS_FIREABLE [right53]]]]
normalized: ~ [[E [true U IS_FIREABLE [right53]] & [~ [E [true U ~ [IS_FIREABLE [up44]]]] | ~ [EG [~ [IS_FIREABLE [down44]]]]]]]

......
EG iterations: 6
-> the formula is TRUE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-07 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 9.676sec

checking: A [~ [AG [IS_FIREABLE [down44]]] U ~ [[IS_FIREABLE [left56] | [IS_FIREABLE [right35] | IS_FIREABLE [right64]]]]]
normalized: [~ [EG [[IS_FIREABLE [left56] | [IS_FIREABLE [right35] | IS_FIREABLE [right64]]]]] & ~ [E [[IS_FIREABLE [left56] | [IS_FIREABLE [right35] | IS_FIREABLE [right64]]] U [~ [E [true U ~ [IS_FIREABLE [down44]]]] & [IS_FIREABLE [left56] | [IS_FIREABLE [right35] | IS_FIREABLE [right64]]]]]]]

..........10:65341..........20:86704..........30:22349..........40:167.....
EG iterations: 45
-> the formula is TRUE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-09 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 1m48.360sec

checking: [A [AF [IS_FIREABLE [right63]] U [IS_FIREABLE [right64] & IS_FIREABLE [down55]]] & AG [AF [[IS_FIREABLE [right34] & IS_FIREABLE [left55]]]]]
normalized: [~ [E [true U EG [~ [[IS_FIREABLE [right34] & IS_FIREABLE [left55]]]]]] & [~ [EG [~ [[IS_FIREABLE [right64] & IS_FIREABLE [down55]]]]] & ~ [E [~ [[IS_FIREABLE [right64] & IS_FIREABLE [down55]]] U [EG [~ [IS_FIREABLE [right63]]] & ~ [[IS_FIREABLE [right64] & IS_FIREABLE [down55]]]]]]]]

.
EG iterations: 1
.
EG iterations: 1
.
EG iterations: 1
-> the formula is FALSE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-02 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m12.038sec

checking: [EG [EF [[IS_FIREABLE [right23] | IS_FIREABLE [up42]]]] | A [[[IS_FIREABLE [down52] & IS_FIREABLE [left36]] | ~ [IS_FIREABLE [down46]]] U AX [IS_FIREABLE [down44]]]]
normalized: [[~ [EG [EX [~ [IS_FIREABLE [down44]]]]] & ~ [E [EX [~ [IS_FIREABLE [down44]]] U [~ [[~ [IS_FIREABLE [down46]] | [IS_FIREABLE [down52] & IS_FIREABLE [left36]]]] & EX [~ [IS_FIREABLE [down44]]]]]]] | EG [E [true U [IS_FIREABLE [right23] | IS_FIREABLE [up42]]]]]

....
after gc: zbdd nodes used:2322767, unused:297677233......10:153235..........20:112109..........30:20605..........40:67....
EG iterations: 44
.............10:65780..........20:87706..........30:48848..........40:746.......
EG iterations: 47
-> the formula is FALSE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-06 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 6m57.107sec

checking: [[[IS_FIREABLE [up63] & AG [[IS_FIREABLE [up35] | IS_FIREABLE [right36]]]] | EG [EG [IS_FIREABLE [down25]]]] | ~ [~ [E [IS_FIREABLE [left53] U IS_FIREABLE [right43]]]]]
normalized: [E [IS_FIREABLE [left53] U IS_FIREABLE [right43]] | [EG [EG [IS_FIREABLE [down25]]] | [IS_FIREABLE [up63] & ~ [E [true U ~ [[IS_FIREABLE [up35] | IS_FIREABLE [right36]]]]]]]]

..........10:36785..........20:58178..........30:15031..........40:150.....
EG iterations: 45
.
EG iterations: 1
-> the formula is FALSE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-14 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 1m14.068sec

checking: [[~ [[[IS_FIREABLE [up24] & [IS_FIREABLE [down44] | IS_FIREABLE [right53]]] | [[IS_FIREABLE [down46] | IS_FIREABLE [down46]] & ~ [IS_FIREABLE [down32]]]]] | EG [AF [IS_FIREABLE [down34]]]] | IS_FIREABLE [left25]]
normalized: [IS_FIREABLE [left25] | [EG [~ [EG [~ [IS_FIREABLE [down34]]]]] | ~ [[[~ [IS_FIREABLE [down32]] & [IS_FIREABLE [down46] | IS_FIREABLE [down46]]] | [IS_FIREABLE [up24] & [IS_FIREABLE [down44] | IS_FIREABLE [right53]]]]]]]

......
EG iterations: 6
..........10:23526..........20:33153..........30:5120..........40:0
EG iterations: 40
-> the formula is TRUE

FORMULA Solitaire-PT-SqrNC5x5-CTLFireability-10 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m36.438sec

totally nodes used: 526168724(5.3e+08)
number of garbage collections: 5
fire ops cache: hits/miss/sum: 114895776 238581526 353477302
used/not used/entry size/cache size: 50759420 16349444 16 1024MB
basic ops cache: hits/miss/sum: 657317586 1359106914 2016424500
used/not used/entry size/cache size: 16777216 0 12 192MB
unary ops cache: hits/miss/sum: 0 300 300
used/not used/entry size/cache size: 0 8388608 8 64MB
abstract ops cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 12 96MB
state nr cache: hits/miss/sum: 27048 41141 68189
used/not used/entry size/cache size: 0 2097152 32 64MB
max state cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 32 256MB
uniqueHash elements/entry size/size: 67108864 4 256MB
0 2566655
1 7711419
2 12094467
3 13293401
4 11570533
5 8494883
6 5437634
7 3105990
8 1592650
9 741299
>= 10 499933

Total processing time: 15m10.436sec

.........10 41287..................10 64503.............10 49391.................................

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="Solitaire-PT-SqrNC5x5"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="irma4mcc-full"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

tar xzf /home/mcc/BenchKit/INPUTS/Solitaire-PT-SqrNC5x5.tgz
mv Solitaire-PT-SqrNC5x5 execution
cd execution
pwd
ls -lh

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-3637"
echo " Executing tool irma4mcc-full"
echo " Input is Solitaire-PT-SqrNC5x5, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r162-smll-152705514100172"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' CTLFireability.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;