fond
Model Checking Contest 2018
8th edition, Bratislava, Slovakia, June 26, 2018
Execution of r019-qhx1-152646243500059
Last Updated
June 26, 2018

About the Execution of Irma.struct for AutoFlight-PT-01b

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
2663.860 69504.00 80165.00 1318.80 FTFTFFTFTFTTFFFF normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Waiting for the VM to be ready (probing ssh)
....................................................................................
/home/mcc/execution
total 192K
-rw-r--r-- 1 mcc users 3.5K May 15 18:54 CTLCardinality.txt
-rw-r--r-- 1 mcc users 21K May 15 18:54 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.3K May 15 18:54 CTLFireability.txt
-rw-r--r-- 1 mcc users 16K May 15 18:54 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K May 15 18:49 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.2K May 15 18:49 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 2.2K May 15 18:54 LTLCardinality.txt
-rw-r--r-- 1 mcc users 11K May 15 18:54 LTLCardinality.xml
-rw-r--r-- 1 mcc users 1.8K May 15 18:54 LTLFireability.txt
-rw-r--r-- 1 mcc users 8.9K May 15 18:54 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.0K May 15 18:54 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 15K May 15 18:54 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 108 May 15 18:54 ReachabilityDeadlock.txt
-rw-r--r-- 1 mcc users 346 May 15 18:54 ReachabilityDeadlock.xml
-rw-r--r-- 1 mcc users 2.7K May 15 18:54 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 17K May 15 18:54 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K May 15 18:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.6K May 15 18:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 15 18:49 equiv_col
-rw-r--r-- 1 mcc users 4 May 15 18:49 instance
-rw-r--r-- 1 mcc users 6 May 15 18:49 iscolored
-rw-r--r-- 1 mcc users 26K May 15 18:49 model.pnml
=====================================================================
Generated by BenchKit 2-3637
Executing tool irma4mcc-structural
Input is AutoFlight-PT-01b, examination is CTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r019-qhx1-152646243500059
=====================================================================


--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-00
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-01
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-02
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-03
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-04
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-05
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-06
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-07
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-08
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-09
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-10
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-11
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-12
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-13
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-14
FORMULA_NAME AutoFlight-PT-01b-CTLCardinality-15

=== Now, execution of the tool begins

BK_START 1526802033267


BK_STOP 1526802102771

--------------------
content from stderr:

Prefix is 75f5f979.
Reading known information in /usr/share/mcc4mcc/75f5f979-known.json.
Reading learned information in /usr/share/mcc4mcc/75f5f979-learned.json.
Reading value translations in /usr/share/mcc4mcc/75f5f979-values.json.
Using directory /home/mcc/execution for input, as it contains a model.pnml file.
Using AutoFlight-PT-01b as instance name.
Using AutoFlight as model name.
Using algorithm or tool bmdt.
Model characteristics are: {'Examination': 'CTLCardinality', 'Place/Transition': True, 'Colored': False, 'Relative-Time': 1, 'Relative-Memory': 1, 'Ordinary': True, 'Simple Free Choice': False, 'Extended Free Choice': False, 'State Machine': False, 'Marked Graph': False, 'Connected': True, 'Strongly Connected': False, 'Source Place': True, 'Sink Place': False, 'Source Transition': False, 'Sink Transition': False, 'Loop Free': None, 'Conservative': False, 'Sub-Conservative': False, 'Nested Units': True, 'Safe': True, 'Deadlock': None, 'Reversible': None, 'Quasi Live': None, 'Live': None}.
Known tools are: [{'Time': 18440, 'Memory': 2351.3, 'Tool': 'marcie'}, {'Time': 19265, 'Memory': 2351.31, 'Tool': 'marcie'}, {'Time': 48450, 'Memory': 1053.04, 'Tool': 'gspn'}, {'Time': 48522, 'Memory': 1080.89, 'Tool': 'gspn'}, {'Time': 82305, 'Memory': 745.89, 'Tool': 'lola'}, {'Time': 82578, 'Memory': 762.17, 'Tool': 'lola'}, {'Time': 553276, 'Memory': 3856.27, 'Tool': 'itstools'}, {'Time': 706514, 'Memory': 3876.12, 'Tool': 'itstools'}].
Learned tools are: [{'Tool': 'lola'}].
Learned tool lola is 4.4633947939262475x far from the best tool marcie.
CTLCardinality marcie AutoFlight-PT-01b...
timeout --kill-after=10s --signal=SIGINT 1m for testing only
check for maximal unmarked siphon
ok
check for constant places

Marcie rev. 8852M (built: crohr on 2017-05-03)
A model checker for Generalized Stochastic Petri nets

authors: Alex Tovchigrechko (IDD package and CTL model checking)

Martin Schwarick (Symbolic numerical analysis and CSL model checking)

Christian Rohr (Simulative and approximative numerical model checking)

marcie@informatik.tu-cottbus.de

called as: marcie --net-file=model.pnml --mcc-file=CTLCardinality.xml --memory=6

parse successfull
net created successfully

Net: AutoFlight_PT_01b
(NrP: 114 NrTr: 112 NrArc: 264)

ok
parse formulas
formulas created successfully
place and transition orderings generation:0m 0.003sec

check if there are places and transitions
ok
check if there are transitions without pre-places
ok
check if at least one transition is enabled in m0
ok
check if there are transitions that can never fire
ok


initing FirstDep: 0m 0.000sec

net check time: 0m 0.000sec

init dd package: 0m26.371sec


iterations count:3544 (31), effective:400 (3)

RS generation: 0m 0.319sec


-> reachability set: #nodes 3431 (3.4e+03) #states 48,881,955 (7)



starting MCC model checker
--------------------------


initing FirstDep: 0m 0.000sec


iterations count:1396 (12), effective:123 (1)
checking: EG [EG [~ [2<=p84]]]
normalized: EG [EG [~ [2<=p84]]]

abstracting: (2<=p84)
states: 0

EG iterations: 0

EG iterations: 0
-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLCardinality-06 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.000sec

checking: AG [AF [~ [2<=p20]]]
normalized: ~ [E [true U EG [2<=p20]]]

abstracting: (2<=p20)
states: 0
.
EG iterations: 1
-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLCardinality-10 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.353sec

checking: AF [2<=p70]
normalized: ~ [EG [~ [2<=p70]]]

abstracting: (2<=p70)
states: 0

EG iterations: 0
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-13 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.000sec

checking: EF [~ [AX [p8<=p99]]]
normalized: E [true U EX [~ [p8<=p99]]]

abstracting: (p8<=p99)
states: 44,580,451 (7)

iterations count:1921 (17), effective:182 (1)
.-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLCardinality-03 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.845sec

checking: ~ [AF [AG [p83<=p11]]]
normalized: EG [E [true U ~ [p83<=p11]]]

abstracting: (p83<=p11)
states: 42,155,555 (7)

iterations count:116 (1), effective:1 (0)
...................................................
EG iterations: 51
-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLCardinality-11 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 4.935sec

checking: ~ [[~ [3<=p94] & ~ [AF [1<=p62]]]]
normalized: ~ [[EG [~ [1<=p62]] & ~ [3<=p94]]]

abstracting: (3<=p94)
states: 0
abstracting: (1<=p62)
states: 17,343,180 (7)
...................................................
EG iterations: 51
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-15 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 7.213sec

checking: AF [[EX [1<=p14] & p55<=p68]]
normalized: ~ [EG [~ [[p55<=p68 & EX [1<=p14]]]]]

abstracting: (1<=p14)
states: 2,862,816 (6)
.abstracting: (p55<=p68)
states: 44,586,135 (7)
.................................
EG iterations: 33
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-05 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.540sec

checking: AG [[EF [3<=p61] & EF [p8<=p98]]]
normalized: ~ [E [true U ~ [[E [true U p8<=p98] & E [true U 3<=p61]]]]]

abstracting: (3<=p61)
states: 0
abstracting: (p8<=p98)
states: 44,580,451 (7)

iterations count:112 (1), effective:0 (0)

iterations count:112 (1), effective:0 (0)
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-07 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.116sec

checking: A [AX [p61<=p93] U AG [3<=p66]]
normalized: [~ [EG [E [true U ~ [3<=p66]]]] & ~ [E [E [true U ~ [3<=p66]] U [EX [~ [p61<=p93]] & E [true U ~ [3<=p66]]]]]]

abstracting: (3<=p66)
states: 0
abstracting: (p61<=p93)
states: 41,784,371 (7)
.abstracting: (3<=p66)
states: 0

iterations count:112 (1), effective:0 (0)

iterations count:1384 (12), effective:126 (1)
abstracting: (3<=p66)
states: 0

iterations count:112 (1), effective:0 (0)

iterations count:1700 (15), effective:150 (1)

EG iterations: 0
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-09 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 1.284sec

checking: E [EX [p27<=p83] U ~ [p67<=p35]]
normalized: E [EX [p27<=p83] U ~ [p67<=p35]]

abstracting: (p67<=p35)
states: 44,253,163 (7)
abstracting: (p27<=p83)
states: 43,640,831 (7)
.-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLCardinality-08 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 1.015sec

checking: E [[[p5<=p69 & 1<=p24] | 2<=p54] U EF [3<=p86]]
normalized: E [[2<=p54 | [p5<=p69 & 1<=p24]] U E [true U 3<=p86]]

abstracting: (3<=p86)
states: 0
abstracting: (1<=p24)
states: 2,689,456 (6)
abstracting: (p5<=p69)
states: 48,866,819 (7)
abstracting: (2<=p54)
states: 0
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-00 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.007sec

checking: [A [[2<=p83 & p90<=p25] U [3<=p84 | 1<=p104]] | AF [1<=p20]]
normalized: [~ [EG [~ [1<=p20]]] | [~ [E [~ [[3<=p84 | 1<=p104]] U [~ [[2<=p83 & p90<=p25]] & ~ [[3<=p84 | 1<=p104]]]]] & ~ [EG [~ [[3<=p84 | 1<=p104]]]]]]

abstracting: (1<=p104)
states: 2,388,556 (6)
abstracting: (3<=p84)
states: 0
.......
after gc: zbdd nodes used:24977, unused:18725023.................................
EG iterations: 40
abstracting: (1<=p104)
states: 2,388,556 (6)
abstracting: (3<=p84)
states: 0
abstracting: (p90<=p25)
states: 45,665,761 (7)
abstracting: (2<=p83)
states: 0
abstracting: (1<=p104)
states: 2,388,556 (6)
abstracting: (3<=p84)
states: 0

iterations count:112 (1), effective:0 (0)
abstracting: (1<=p20)
states: 6,203,540 (6)
.
EG iterations: 1
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-12 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 6.219sec

checking: [EG [EF [1<=p90]] & E [p82<=p36 U [p75<=p92 | p27<=p33]]]
normalized: [E [p82<=p36 U [p75<=p92 | p27<=p33]] & EG [E [true U 1<=p90]]]

abstracting: (1<=p90)
states: 3,357,346 (6)

iterations count:1255 (11), effective:107 (0)
.....................................
EG iterations: 37
abstracting: (p27<=p33)
states: 43,346,179 (7)
abstracting: (p75<=p92)
states: 47,486,007 (7)
abstracting: (p82<=p36)
states: 41,554,142 (7)

iterations count:218 (1), effective:12 (0)
-> the formula is TRUE

FORMULA AutoFlight-PT-01b-CTLCardinality-01 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 2.388sec

checking: [[E [2<=p52 U 1<=p113] | AF [[1<=p7 & p52<=p93]]] & [[AX [2<=p102] | AF [1<=p19]] & AG [p74<=p106]]]
normalized: [[~ [EG [~ [[1<=p7 & p52<=p93]]]] | E [2<=p52 U 1<=p113]] & [~ [E [true U ~ [p74<=p106]]] & [~ [EX [~ [2<=p102]]] | ~ [EG [~ [1<=p19]]]]]]

abstracting: (1<=p19)
states: 5,318,584 (6)
........................................................
EG iterations: 56
abstracting: (2<=p102)
states: 0
.abstracting: (p74<=p106)
states: 47,477,699 (7)

iterations count:1328 (11), effective:119 (1)
abstracting: (1<=p113)
states: 19,955,784 (7)
abstracting: (2<=p52)
states: 0

iterations count:112 (1), effective:0 (0)
abstracting: (p52<=p93)
states: 44,707,001 (7)
abstracting: (1<=p7)
states: 2,681,734 (6)
..........................
EG iterations: 26
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-14 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 4.306sec

iterations count:215 (1), effective:8 (0)

checking: E [[[3<=p16 | p21<=p60] | ~ [p73<=p26]] U [[p80<=p14 & 3<=p93] & [p22<=p109 & p20<=p9]]]
normalized: E [[~ [p73<=p26] | [3<=p16 | p21<=p60]] U [[p22<=p109 & p20<=p9] & [p80<=p14 & 3<=p93]]]

abstracting: (3<=p93)
states: 0
abstracting: (p80<=p14)
states: 44,590,450 (7)
abstracting: (p20<=p9)
states: 43,456,255 (7)
abstracting: (p22<=p109)
states: 43,005,225 (7)
abstracting: (p21<=p60)
states: 45,762,739 (7)
abstracting: (3<=p16)
states: 0
abstracting: (p73<=p26)
states: 48,154,011 (7)
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-04 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 0.017sec

checking: [[E [p14<=p49 U 3<=p8] & AX [~ [3<=p2]]] & [[~ [~ [1<=p54]] | [[3<=p2 & p79<=p73] & p99<=p46]] | A [p26<=p44 U p111<=p65]]]
normalized: [[[1<=p54 | [p99<=p46 & [3<=p2 & p79<=p73]]] | [~ [EG [~ [p111<=p65]]] & ~ [E [~ [p111<=p65] U [~ [p26<=p44] & ~ [p111<=p65]]]]]] & [~ [EX [3<=p2]] & E [p14<=p49 U 3<=p8]]]

abstracting: (3<=p8)
states: 0
abstracting: (p14<=p49)
states: 46,279,395 (7)
abstracting: (3<=p2)
states: 0
.abstracting: (p111<=p65)
states: 45,244,651 (7)
abstracting: (p26<=p44)
states: 42,945,947 (7)
abstracting: (p111<=p65)
states: 45,244,651 (7)
abstracting: (p111<=p65)
states: 45,244,651 (7)
..........................................
EG iterations: 42
abstracting: (p79<=p73)
states: 44,262,562 (7)
abstracting: (3<=p2)
states: 0
abstracting: (p99<=p46)
states: 46,275,747 (7)
abstracting: (1<=p54)
states: 4,392,084 (6)
-> the formula is FALSE

FORMULA AutoFlight-PT-01b-CTLCardinality-02 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT

MC time: 0m 1.327sec

totally nodes used: 15530023(1.6e+07)
number of garbage collections: 1
fire ops cache: hits/miss/sum: 12761793 15466597 28228390
used/not used/entry size/cache size: 5405352 61703512 16 1024MB
basic ops cache: hits/miss/sum: 13202182 21890308 35092490
used/not used/entry size/cache size: 11239376 5537840 12 192MB
unary ops cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 8 64MB
abstract ops cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 12 96MB
state nr cache: hits/miss/sum: 33644 36648 70292
used/not used/entry size/cache size: 20906 2076246 32 64MB
max state cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 32 256MB
uniqueHash elements/entry size/size: 67108864 4 256MB
0 61206064
1 5634105
2 260399
3 8091
4 201
5 4
6 0
7 0
8 0
9 0
>= 10 0

Total processing time: 0m59.750sec

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AutoFlight-PT-01b"
export BK_EXAMINATION="CTLCardinality"
export BK_TOOL="irma4mcc-structural"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

tar xzf /home/mcc/BenchKit/INPUTS/AutoFlight-PT-01b.tgz
mv AutoFlight-PT-01b execution
cd execution
pwd
ls -lh

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-3637"
echo " Executing tool irma4mcc-structural"
echo " Input is AutoFlight-PT-01b, examination is CTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r019-qhx1-152646243500059"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' CTLCardinality.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;