fond
Model Checking Contest 2018
8th edition, Bratislava, Slovakia, June 26, 2018
Execution of r018-qhx1-152646242800060
Last Updated
June 26, 2018

About the Execution of Irma.full for AutoFlight-PT-01b

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
2966.180 138060.00 149516.00 2981.90 FTFTTFTFFFFFTTFF normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Waiting for the VM to be ready (probing ssh)
.............................................................................................................................
/home/mcc/execution
total 192K
-rw-r--r-- 1 mcc users 3.5K May 15 18:54 CTLCardinality.txt
-rw-r--r-- 1 mcc users 21K May 15 18:54 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.3K May 15 18:54 CTLFireability.txt
-rw-r--r-- 1 mcc users 16K May 15 18:54 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K May 15 18:49 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.2K May 15 18:49 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 2.2K May 15 18:54 LTLCardinality.txt
-rw-r--r-- 1 mcc users 11K May 15 18:54 LTLCardinality.xml
-rw-r--r-- 1 mcc users 1.8K May 15 18:54 LTLFireability.txt
-rw-r--r-- 1 mcc users 8.9K May 15 18:54 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.0K May 15 18:54 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 15K May 15 18:54 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 108 May 15 18:54 ReachabilityDeadlock.txt
-rw-r--r-- 1 mcc users 346 May 15 18:54 ReachabilityDeadlock.xml
-rw-r--r-- 1 mcc users 2.7K May 15 18:54 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 17K May 15 18:54 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K May 15 18:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.6K May 15 18:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 15 18:49 equiv_col
-rw-r--r-- 1 mcc users 4 May 15 18:49 instance
-rw-r--r-- 1 mcc users 6 May 15 18:49 iscolored
-rw-r--r-- 1 mcc users 26K May 15 18:49 model.pnml
=====================================================================
Generated by BenchKit 2-3637
Executing tool irma4mcc-full
Input is AutoFlight-PT-01b, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r018-qhx1-152646242800060
=====================================================================


--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-00
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-01
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-02
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-03
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-04
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-05
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-06
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-07
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-08
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-09
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-10
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-11
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-12
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-13
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-14
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-15

=== Now, execution of the tool begins

BK_START 1526765299534


BK_STOP 1526765437594

--------------------
content from stderr:

Prefix is 65b80f64.
Reading known information in /usr/share/mcc4mcc/65b80f64-known.json.
Reading learned information in /usr/share/mcc4mcc/65b80f64-learned.json.
Reading value translations in /usr/share/mcc4mcc/65b80f64-values.json.
Using directory /home/mcc/execution for input, as it contains a model.pnml file.
Using AutoFlight-PT-01b as instance name.
Using AutoFlight as model name.
Using algorithm or tool voting-classifier.
Model characteristics are: {'Examination': 'CTLFireability', 'Place/Transition': True, 'Colored': False, 'Relative-Time': 1, 'Relative-Memory': 1, 'Ordinary': True, 'Simple Free Choice': False, 'Extended Free Choice': False, 'State Machine': False, 'Marked Graph': False, 'Connected': True, 'Strongly Connected': False, 'Source Place': True, 'Sink Place': False, 'Source Transition': False, 'Sink Transition': False, 'Loop Free': None, 'Conservative': False, 'Sub-Conservative': False, 'Nested Units': True, 'Safe': True, 'Deadlock': None, 'Reversible': None, 'Quasi Live': None, 'Live': None}.
/usr/local/lib/python3.6/dist-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty.
if diff:
Known tools are: [{'Time': 21759, 'Memory': 2350.84, 'Tool': 'marcie'}, {'Time': 23928, 'Memory': 2350.32, 'Tool': 'marcie'}, {'Time': 54061, 'Memory': 1079.43, 'Tool': 'gspn'}, {'Time': 55296, 'Memory': 1103.78, 'Tool': 'gspn'}, {'Time': 148691, 'Memory': 1920.75, 'Tool': 'lola'}, {'Time': 149149, 'Memory': 1924.82, 'Tool': 'lola'}, {'Time': 635897, 'Memory': 3172.56, 'Tool': 'itstools'}, {'Time': 730363, 'Memory': 3178.99, 'Tool': 'itstools'}].
Learned tools are: [{'Tool': 'lola'}].
Learned tool lola is 6.8335401443081025x far from the best tool marcie.
CTLFireability marcie AutoFlight-PT-01b...
timeout --kill-after=10s --signal=SIGINT 1m for testing only
check for maximal unmarked siphon

Marcie rev. 8852M (built: crohr on 2017-05-03)
A model checker for Generalized Stochastic Petri nets

authors: Alex Tovchigrechko (IDD package and CTL model checking)

Martin Schwarick (Symbolic numerical analysis and CSL model checking)

Christian Rohr (Simulative and approximative numerical model checking)

marcie@informatik.tu-cottbus.de

called as: marcie --net-file=model.pnml --mcc-file=CTLFireability.xml --memory=6

parse successfull
net created successfully

Net: AutoFlight_PT_01b
(NrP: 114 NrTr: 112 NrArc: 264)

ok
check for constant places
ok
check if there are places and transitions
ok
check if there are transitions without pre-places
ok
check if at least one transition is enabled in m0
ok
check if there are transitions that can never fire
parse formulas
formulas created successfully
place and transition orderings generation:0m 0.001sec

ok

net check time: 0m 0.000sec

init dd package: 0m26.925sec


initing FirstDep: 0m 0.000sec


iterations count:3544 (31), effective:400 (3)

initing FirstDep: 0m 0.000sec


RS generation: 0m 0.344sec


-> reachability set: #nodes 3431 (3.4e+03) #states 48,881,955 (7)



starting MCC model checker
--------------------------

checking: EG [AF [AX [IS_FIREABLE [t88]]]]
normalized: EG [~ [EG [EX [~ [IS_FIREABLE [t88]]]]]]

........................................................
EG iterations: 55
.....
EG iterations: 5
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLFireability-00 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 7.596sec

checking: EF [AX [AG [IS_FIREABLE [t101]]]]
normalized: E [true U ~ [EX [E [true U ~ [IS_FIREABLE [t101]]]]]]


iterations count:205 (1), effective:1 (0)

iterations count:1699 (15), effective:185 (1)

iterations count:2661 (23), effective:261 (2)
.-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLFireability-01 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.568sec

checking: EF [IS_FIREABLE [t1]]
normalized: E [true U IS_FIREABLE [t1]]

-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLFireability-03 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.698sec

checking: ~ [AF [IS_FIREABLE [t19]]]
normalized: EG [~ [IS_FIREABLE [t19]]]

....................................
EG iterations: 36
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLFireability-08 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.969sec

checking: [E [IS_FIREABLE [t34] U AF [IS_FIREABLE [t1]]] & EF [AX [IS_FIREABLE [t45]]]]
normalized: [E [true U ~ [EX [~ [IS_FIREABLE [t45]]]]] & E [IS_FIREABLE [t34] U ~ [EG [~ [IS_FIREABLE [t1]]]]]]

.
EG iterations: 1

iterations count:112 (1), effective:0 (0)

iterations count:1697 (15), effective:184 (1)
.-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLFireability-10 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.093sec

checking: E [EG [~ [IS_FIREABLE [t32]]] U [EX [IS_FIREABLE [t65]] | EF [IS_FIREABLE [t96]]]]
normalized: E [EG [~ [IS_FIREABLE [t32]]] U [E [true U IS_FIREABLE [t96]] | EX [IS_FIREABLE [t65]]]]


iterations count:1394 (12), effective:125 (1)

iterations count:116 (1), effective:2 (0)
.........................................................
EG iterations: 56
-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLFireability-12 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

iterations count:956 (8), effective:83 (0)

MC time: 0m 5.165sec

checking: [AF [IS_FIREABLE [t68]] | E [~ [[IS_FIREABLE [t83] | IS_FIREABLE [t59]]] U IS_FIREABLE [t93]]]
normalized: [E [~ [[IS_FIREABLE [t83] | IS_FIREABLE [t59]]] U IS_FIREABLE [t93]] | ~ [EG [~ [IS_FIREABLE [t68]]]]]

......................
after gc: zbdd nodes used:85638, unused:18664362.......................................
EG iterations: 61

iterations count:1359 (12), effective:122 (1)
-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLFireability-06 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m13.538sec

checking: [[~ [EF [IS_FIREABLE [t10]]] | ~ [EX [~ [IS_FIREABLE [t61]]]]] | EG [[~ [IS_FIREABLE [t108]] & AG [IS_FIREABLE [t24]]]]]
normalized: [EG [[~ [E [true U ~ [IS_FIREABLE [t24]]]] & ~ [IS_FIREABLE [t108]]]] | [~ [EX [~ [IS_FIREABLE [t61]]]] | ~ [E [true U IS_FIREABLE [t10]]]]]


iterations count:114 (1), effective:1 (0)

iterations count:114 (1), effective:1 (0)
..
EG iterations: 1
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLFireability-07 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.700sec

checking: [AF [IS_FIREABLE [t101]] & ~ [[IS_FIREABLE [t43] & A [IS_FIREABLE [t26] U IS_FIREABLE [t51]]]]]
normalized: [~ [[IS_FIREABLE [t43] & [~ [EG [~ [IS_FIREABLE [t51]]]] & ~ [E [~ [IS_FIREABLE [t51]] U [~ [IS_FIREABLE [t26]] & ~ [IS_FIREABLE [t51]]]]]]]] & ~ [EG [~ [IS_FIREABLE [t101]]]]]

.............................................
EG iterations: 45
..............................................
EG iterations: 46
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLFireability-09 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 8.152sec

checking: [E [AF [IS_FIREABLE [t16]] U EX [IS_FIREABLE [t21]]] | [IS_FIREABLE [t111] & IS_FIREABLE [t26]]]
normalized: [[IS_FIREABLE [t111] & IS_FIREABLE [t26]] | E [~ [EG [~ [IS_FIREABLE [t16]]]] U EX [IS_FIREABLE [t21]]]]

.......................................................
EG iterations: 54

iterations count:146 (1), effective:6 (0)
-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLFireability-13 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 5.962sec

checking: A [~ [~ [~ [IS_FIREABLE [t102]]]] U [[IS_FIREABLE [t38] | [IS_FIREABLE [t57] | IS_FIREABLE [t110]]] | AG [IS_FIREABLE [t101]]]]
normalized: [~ [EG [~ [[~ [E [true U ~ [IS_FIREABLE [t101]]]] | [IS_FIREABLE [t38] | [IS_FIREABLE [t57] | IS_FIREABLE [t110]]]]]]] & ~ [E [~ [[~ [E [true U ~ [IS_FIREABLE [t101]]]] | [IS_FIREABLE [t38] | [IS_FIREABLE [t57] | IS_FIREABLE [t110]]]]] U [IS_FIREABLE [t102] & ~ [[~ [E [true U ~ [IS_FIREABLE [t101]]]] | [IS_FIREABLE [t38] | [IS_FIREABLE [t57] | IS_FIREABLE [t110]]]]]]]]]


iterations count:205 (1), effective:1 (0)

iterations count:205 (1), effective:1 (0)

iterations count:1251 (11), effective:119 (1)

iterations count:205 (1), effective:1 (0)

iterations count:212 (1), effective:1 (0)
.....................................
after gc: zbdd nodes used:50287, unused:37449713....................................
EG iterations: 73
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLFireability-02 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m21.797sec

checking: EF [[~ [IS_FIREABLE [t50]] & [AG [IS_FIREABLE [t50]] | [~ [IS_FIREABLE [t2]] & [IS_FIREABLE [t10] & IS_FIREABLE [t55]]]]]]
normalized: E [true U [[[[IS_FIREABLE [t10] & IS_FIREABLE [t55]] & ~ [IS_FIREABLE [t2]]] | ~ [E [true U ~ [IS_FIREABLE [t50]]]]] & ~ [IS_FIREABLE [t50]]]]


iterations count:706 (6), effective:57 (0)
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLFireability-05 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.281sec

checking: E [[IS_FIREABLE [t70] & ~ [[IS_FIREABLE [t11] | IS_FIREABLE [t85]]]] U AF [[IS_FIREABLE [t28] | IS_FIREABLE [t77]]]]
normalized: E [[IS_FIREABLE [t70] & ~ [[IS_FIREABLE [t11] | IS_FIREABLE [t85]]]] U ~ [EG [~ [[IS_FIREABLE [t28] | IS_FIREABLE [t77]]]]]]

......................................................
EG iterations: 54
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLFireability-11 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 6.178sec

checking: [AF [E [IS_FIREABLE [t50] U IS_FIREABLE [t79]]] | A [[IS_FIREABLE [t81] & IS_FIREABLE [t62]] U ~ [~ [IS_FIREABLE [t26]]]]]
normalized: [[~ [EG [~ [IS_FIREABLE [t26]]]] & ~ [E [~ [IS_FIREABLE [t26]] U [~ [[IS_FIREABLE [t81] & IS_FIREABLE [t62]]] & ~ [IS_FIREABLE [t26]]]]]] | ~ [EG [~ [E [IS_FIREABLE [t50] U IS_FIREABLE [t79]]]]]]


iterations count:852 (7), effective:67 (0)
..........................................................
EG iterations: 58

iterations count:114 (1), effective:1 (0)
.........................................
EG iterations: 41

iterations count:1718 (15), effective:150 (1)
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLFireability-14 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 8.519sec

checking: [A [[~ [IS_FIREABLE [t35]] | [IS_FIREABLE [t72] | IS_FIREABLE [t78]]] U ~ [~ [IS_FIREABLE [t109]]]] | EG [IS_FIREABLE [t16]]]
normalized: [EG [IS_FIREABLE [t16]] | [~ [EG [~ [IS_FIREABLE [t109]]]] & ~ [E [~ [IS_FIREABLE [t109]] U [~ [[[IS_FIREABLE [t72] | IS_FIREABLE [t78]] | ~ [IS_FIREABLE [t35]]]] & ~ [IS_FIREABLE [t109]]]]]]]

.........................................
EG iterations: 41
..................................................................
EG iterations: 66
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLFireability-15 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m14.431sec

checking: [[IS_FIREABLE [t74] & [AG [[IS_FIREABLE [t6] | IS_FIREABLE [t39]]] & E [IS_FIREABLE [t89] U IS_FIREABLE [t32]]]] | EF [IS_FIREABLE [t27]]]
normalized: [E [true U IS_FIREABLE [t27]] | [IS_FIREABLE [t74] & [E [IS_FIREABLE [t89] U IS_FIREABLE [t32]] & ~ [E [true U ~ [[IS_FIREABLE [t6] | IS_FIREABLE [t39]]]]]]]]


iterations count:120 (1), effective:2 (0)

iterations count:171 (1), effective:4 (0)

iterations count:1369 (12), effective:122 (1)
-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLFireability-04 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.688sec

totally nodes used: 46067213(4.6e+07)
number of garbage collections: 2
fire ops cache: hits/miss/sum: 36370250 44476197 80846447
used/not used/entry size/cache size: 14382289 52726575 16 1024MB
basic ops cache: hits/miss/sum: 37013951 64534734 101548685
used/not used/entry size/cache size: 16216438 560778 12 192MB
unary ops cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 8 64MB
abstract ops cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 12 96MB
state nr cache: hits/miss/sum: 3050 3431 6481
used/not used/entry size/cache size: 0 2097152 32 64MB
max state cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 32 256MB
uniqueHash elements/entry size/size: 67108864 4 256MB
0 51263194
1 13804644
2 1862063
3 167139
4 11196
5 602
6 25
7 1
8 0
9 0
>= 10 0

Total processing time: 2m 6.748sec

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AutoFlight-PT-01b"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="irma4mcc-full"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

tar xzf /home/mcc/BenchKit/INPUTS/AutoFlight-PT-01b.tgz
mv AutoFlight-PT-01b execution
cd execution
pwd
ls -lh

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-3637"
echo " Executing tool irma4mcc-full"
echo " Input is AutoFlight-PT-01b, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r018-qhx1-152646242800060"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' CTLFireability.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;