fond
Model Checking Contest 2018
8th edition, Bratislava, Slovakia, June 26, 2018
Execution of r018-qhx1-152646242800059
Last Updated
June 26, 2018

About the Execution of Irma.full for AutoFlight-PT-01b

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
2663.460 65484.00 70160.00 1209.20 FTFTFFTFTFTTFFFF normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Waiting for the VM to be ready (probing ssh)
........................
/home/mcc/execution
total 192K
-rw-r--r-- 1 mcc users 3.5K May 15 18:54 CTLCardinality.txt
-rw-r--r-- 1 mcc users 21K May 15 18:54 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.3K May 15 18:54 CTLFireability.txt
-rw-r--r-- 1 mcc users 16K May 15 18:54 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K May 15 18:49 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.2K May 15 18:49 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 2.2K May 15 18:54 LTLCardinality.txt
-rw-r--r-- 1 mcc users 11K May 15 18:54 LTLCardinality.xml
-rw-r--r-- 1 mcc users 1.8K May 15 18:54 LTLFireability.txt
-rw-r--r-- 1 mcc users 8.9K May 15 18:54 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.0K May 15 18:54 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 15K May 15 18:54 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 108 May 15 18:54 ReachabilityDeadlock.txt
-rw-r--r-- 1 mcc users 346 May 15 18:54 ReachabilityDeadlock.xml
-rw-r--r-- 1 mcc users 2.7K May 15 18:54 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 17K May 15 18:54 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K May 15 18:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.6K May 15 18:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 15 18:49 equiv_col
-rw-r--r-- 1 mcc users 4 May 15 18:49 instance
-rw-r--r-- 1 mcc users 6 May 15 18:49 iscolored
-rw-r--r-- 1 mcc users 26K May 15 18:49 model.pnml
=====================================================================
Generated by BenchKit 2-3637
Executing tool irma4mcc-full
Input is AutoFlight-PT-01b, examination is CTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r018-qhx1-152646242800059
=====================================================================


--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-00
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-01
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-02
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-03
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-04
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-05
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-06
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-07
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-08
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-09
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-10
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-11
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-12
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-13
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-14
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-15

=== Now, execution of the tool begins

BK_START 1526765193597


BK_STOP 1526765259081

--------------------
content from stderr:

Prefix is 65b80f64.
Reading known information in /usr/share/mcc4mcc/65b80f64-known.json.
Reading learned information in /usr/share/mcc4mcc/65b80f64-learned.json.
Reading value translations in /usr/share/mcc4mcc/65b80f64-values.json.
Using directory /home/mcc/execution for input, as it contains a model.pnml file.
Using AutoFlight-PT-01b as instance name.
Using AutoFlight as model name.
Using algorithm or tool bmdt.
Model characteristics are: {'Examination': 'CTLCardinality', 'Place/Transition': True, 'Colored': False, 'Relative-Time': 1, 'Relative-Memory': 1, 'Ordinary': True, 'Simple Free Choice': False, 'Extended Free Choice': False, 'State Machine': False, 'Marked Graph': False, 'Connected': True, 'Strongly Connected': False, 'Source Place': True, 'Sink Place': False, 'Source Transition': False, 'Sink Transition': False, 'Loop Free': None, 'Conservative': False, 'Sub-Conservative': False, 'Nested Units': True, 'Safe': True, 'Deadlock': None, 'Reversible': None, 'Quasi Live': None, 'Live': None}.
Known tools are: [{'Time': 18440, 'Memory': 2351.3, 'Tool': 'marcie'}, {'Time': 19265, 'Memory': 2351.31, 'Tool': 'marcie'}, {'Time': 48450, 'Memory': 1053.04, 'Tool': 'gspn'}, {'Time': 48522, 'Memory': 1080.89, 'Tool': 'gspn'}, {'Time': 82305, 'Memory': 745.89, 'Tool': 'lola'}, {'Time': 82578, 'Memory': 762.17, 'Tool': 'lola'}, {'Time': 553276, 'Memory': 3856.27, 'Tool': 'itstools'}, {'Time': 706514, 'Memory': 3876.12, 'Tool': 'itstools'}].
Learned tools are: [{'Tool': 'lola'}].
Learned tool lola is 4.4633947939262475x far from the best tool marcie.
CTLCardinality marcie AutoFlight-PT-01b...
timeout --kill-after=10s --signal=SIGINT 1m for testing only

Marcie rev. 8852M (built: crohr on 2017-05-03)
A model checker for Generalized Stochastic Petri nets

authors: Alex Tovchigrechko (IDD package and CTL model checking)

Martin Schwarick (Symbolic numerical analysis and CSL model checking)

check for maximal unmarked siphon
ok
Christian Rohr (Simulative and approximative numerical model checking)

marcie@informatik.tu-cottbus.de

called as: marcie --net-file=model.pnml --mcc-file=CTLCardinality.xml --memory=6

parse successfull
net created successfully

Net: AutoFlight_PT_01b
(NrP: 114 NrTr: 112 NrArc: 264)

check for constant places
ok
parse formulas
formulas created successfully
check if there are places and transitions
place and transition orderings generation:0m 0.001sec

ok
check if there are transitions without pre-places
ok
check if at least one transition is enabled in m0
ok
check if there are transitions that can never fire
ok

net check time: 0m 0.001sec

init dd package: 0m25.676sec


initing FirstDep: 0m 0.000sec


iterations count:3544 (31), effective:400 (3)

initing FirstDep: 0m 0.000sec


RS generation: 0m 0.286sec


-> reachability set: #nodes 3431 (3.4e+03) #states 48,881,955 (7)



starting MCC model checker
--------------------------

checking: EG [EG [~ [2<=p84]]]
normalized: EG [EG [~ [2<=p84]]]

abstracting: (2<=p84)
states: 0

EG iterations: 0

EG iterations: 0
-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLCardinality-06 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.001sec

checking: AG [AF [~ [2<=p20]]]
normalized: ~ [E [true U EG [2<=p20]]]

abstracting: (2<=p20)
states: 0
.
EG iterations: 1
-> the formula is TRUE


FORMULA AutoFlight-PT-01b-CTLCardinality-10 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.315sec

checking: AF [2<=p70]
normalized: ~ [EG [~ [2<=p70]]]
iterations count:1396 (12), effective:123 (1)

abstracting: (2<=p70)
states: 0

EG iterations: 0
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-13 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.000sec

checking: EF [~ [AX [p8<=p99]]]
normalized: E [true U EX [~ [p8<=p99]]]

abstracting: (p8<=p99)
states: 44,580,451 (7)
.-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLCardinality-03 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.727sec

checking: ~ [AF [AG [p83<=p11]]]
normalized: EG [E [true U ~ [p83<=p11]]]

abstracting: (p83<=p11)
states: 42,155,555 (7)

iterations count:1921 (17), effective:182 (1)
...................................................
EG iterations: 51
-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLCardinality-11 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 4.325sec

checking: ~ [[~ [3<=p94] & ~ [AF [1<=p62]]]]
normalized: ~ [[EG [~ [1<=p62]] & ~ [3<=p94]]]

abstracting: (3<=p94)
states: 0
abstracting: (1<=p62)
states: 17,343,180 (7)
...................................................
EG iterations: 51
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-15 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 6.477sec

checking: AF [[EX [1<=p14] & p55<=p68]]
normalized: ~ [EG [~ [[p55<=p68 & EX [1<=p14]]]]]

abstracting: (1<=p14)
states: 2,862,816 (6)
.abstracting: (p55<=p68)
states: 44,586,135 (7)
.................................
EG iterations: 33
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-05 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.445sec

checking: AG [[EF [3<=p61] & EF [p8<=p98]]]
normalized: ~ [E [true U ~ [[E [true U p8<=p98] & E [true U 3<=p61]]]]]

abstracting: (3<=p61)
states: 0
abstracting: (p8<=p98)
states: 44,580,451 (7)

iterations count:116 (1), effective:1 (0)

iterations count:112 (1), effective:0 (0)
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-07 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.102sec

checking: A [AX [p61<=p93] U AG [3<=p66]]
normalized: [~ [EG [E [true U ~ [3<=p66]]]] & ~ [E [E [true U ~ [3<=p66]] U [EX [~ [p61<=p93]] & E [true U ~ [3<=p66]]]]]]

abstracting: (3<=p66)
states: 0

iterations count:112 (1), effective:0 (0)
abstracting: (p61<=p93)
states: 41,784,371 (7)
.abstracting: (3<=p66)
states: 0

iterations count:112 (1), effective:0 (0)

abstracting: (3<=p66)
states: 0
iterations count:1384 (12), effective:126 (1)

iterations count:112 (1), effective:0 (0)

EG iterations: 0
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-09 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 1.144sec

checking: E [EX [p27<=p83] U ~ [p67<=p35]]
normalized: E [EX [p27<=p83] U ~ [p67<=p35]]

abstracting: (p67<=p35)
states: 44,253,163 (7)
abstracting: (p27<=p83)
states: 43,640,831 (7)

iterations count:1700 (15), effective:150 (1)
.-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLCardinality-08 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.880sec

checking: E [[[p5<=p69 & 1<=p24] | 2<=p54] U EF [3<=p86]]
normalized: E [[2<=p54 | [p5<=p69 & 1<=p24]] U E [true U 3<=p86]]

abstracting: (3<=p86)
states: 0
abstracting: (1<=p24)
states: 2,689,456 (6)
abstracting: (p5<=p69)
states: 48,866,819 (7)
abstracting: (2<=p54)
states: 0
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-00 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.006sec

checking: [A [[2<=p83 & p90<=p25] U [3<=p84 | 1<=p104]] | AF [1<=p20]]
normalized: [~ [EG [~ [1<=p20]]] | [~ [E [~ [[3<=p84 | 1<=p104]] U [~ [[2<=p83 & p90<=p25]] & ~ [[3<=p84 | 1<=p104]]]]] & ~ [EG [~ [[3<=p84 | 1<=p104]]]]]]

abstracting: (1<=p104)
states: 2,388,556 (6)
abstracting: (3<=p84)
states: 0
.......
after gc: zbdd nodes used:24977, unused:18725023.................................
EG iterations: 40
abstracting: (1<=p104)
states: 2,388,556 (6)
abstracting: (3<=p84)
states: 0
abstracting: (p90<=p25)
states: 45,665,761 (7)
abstracting: (2<=p83)
states: 0
abstracting: (1<=p104)
states: 2,388,556 (6)
abstracting: (3<=p84)
states: 0

iterations count:112 (1), effective:0 (0)
abstracting: (1<=p20)
states: 6,203,540 (6)
.
EG iterations: 1
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-12 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 5.788sec

checking: [EG [EF [1<=p90]] & E [p82<=p36 U [p75<=p92 | p27<=p33]]]
normalized: [E [p82<=p36 U [p75<=p92 | p27<=p33]] & EG [E [true U 1<=p90]]]

abstracting: (1<=p90)
states: 3,357,346 (6)

iterations count:1255 (11), effective:107 (0)
.....................................

iterations count:218 (1), effective:12 (0)
EG iterations: 37
abstracting: (p27<=p33)
states: 43,346,179 (7)
abstracting: (p75<=p92)
states: 47,486,007 (7)
abstracting: (p82<=p36)
states: 41,554,142 (7)
-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLCardinality-01 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 2.266sec

checking: [[E [2<=p52 U 1<=p113] | AF [[1<=p7 & p52<=p93]]] & [[AX [2<=p102] | AF [1<=p19]] & AG [p74<=p106]]]
normalized: [[~ [EG [~ [[1<=p7 & p52<=p93]]]] | E [2<=p52 U 1<=p113]] & [~ [E [true U ~ [p74<=p106]]] & [~ [EX [~ [2<=p102]]] | ~ [EG [~ [1<=p19]]]]]]

abstracting: (1<=p19)
states: 5,318,584 (6)
........................................................
EG iterations: 56
abstracting: (2<=p102)
states: 0
.abstracting: (p74<=p106)
states: 47,477,699 (7)

iterations count:1328 (11), effective:119 (1)

iterations count:112 (1), effective:0 (0)
abstracting: (1<=p113)
states: 19,955,784 (7)
abstracting: (2<=p52)
states: 0

iterations count:215 (1), effective:8 (0)
abstracting: (p52<=p93)
states: 44,707,001 (7)
abstracting: (1<=p7)
states: 2,681,734 (6)
..........................
EG iterations: 26
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-14 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 4.363sec

checking: E [[[3<=p16 | p21<=p60] | ~ [p73<=p26]] U [[p80<=p14 & 3<=p93] & [p22<=p109 & p20<=p9]]]
normalized: E [[~ [p73<=p26] | [3<=p16 | p21<=p60]] U [[p22<=p109 & p20<=p9] & [p80<=p14 & 3<=p93]]]

abstracting: (3<=p93)
states: 0
abstracting: (p80<=p14)
states: 44,590,450 (7)
abstracting: (p20<=p9)
states: 43,456,255 (7)
abstracting: (p22<=p109)
states: 43,005,225 (7)
abstracting: (p21<=p60)
states: 45,762,739 (7)
abstracting: (3<=p16)
states: 0
abstracting: (p73<=p26)
states: 48,154,011 (7)
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-04 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.016sec

checking: [[E [p14<=p49 U 3<=p8] & AX [~ [3<=p2]]] & [[~ [~ [1<=p54]] | [[3<=p2 & p79<=p73] & p99<=p46]] | A [p26<=p44 U p111<=p65]]]
normalized: [[[1<=p54 | [p99<=p46 & [3<=p2 & p79<=p73]]] | [~ [EG [~ [p111<=p65]]] & ~ [E [~ [p111<=p65] U [~ [p26<=p44] & ~ [p111<=p65]]]]]] & [~ [EX [3<=p2]] & E [p14<=p49 U 3<=p8]]]

abstracting: (3<=p8)
states: 0
abstracting: (p14<=p49)
states: 46,279,395 (7)
abstracting: (3<=p2)
states: 0
.abstracting: (p111<=p65)
states: 45,244,651 (7)
abstracting: (p26<=p44)
states: 42,945,947 (7)
abstracting: (p111<=p65)
states: 45,244,651 (7)
abstracting: (p111<=p65)
states: 45,244,651 (7)
..........................................
EG iterations: 42
abstracting: (p79<=p73)
states: 44,262,562 (7)
abstracting: (3<=p2)
states: 0
abstracting: (p99<=p46)
states: 46,275,747 (7)
abstracting: (1<=p54)
states: 4,392,084 (6)
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-02 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 1.330sec

totally nodes used: 15530023(1.6e+07)
number of garbage collections: 1
fire ops cache: hits/miss/sum: 12761793 15466597 28228390
used/not used/entry size/cache size: 5405352 61703512 16 1024MB
basic ops cache: hits/miss/sum: 13202182 21890308 35092490
used/not used/entry size/cache size: 11239376 5537840 12 192MB
unary ops cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 8 64MB
abstract ops cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 12 96MB
state nr cache: hits/miss/sum: 33644 36648 70292
used/not used/entry size/cache size: 20906 2076246 32 64MB
max state cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 32 256MB
uniqueHash elements/entry size/size: 67108864 4 256MB
0 61206064
1 5634105
2 260399
3 8091
4 201
5 4
6 0
7 0
8 0
9 0
>= 10 0

Total processing time: 0m56.803sec

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AutoFlight-PT-01b"
export BK_EXAMINATION="CTLCardinality"
export BK_TOOL="irma4mcc-full"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

tar xzf /home/mcc/BenchKit/INPUTS/AutoFlight-PT-01b.tgz
mv AutoFlight-PT-01b execution
cd execution
pwd
ls -lh

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-3637"
echo " Executing tool irma4mcc-full"
echo " Input is AutoFlight-PT-01b, examination is CTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r018-qhx1-152646242800059"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' CTLCardinality.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;