About the Execution of Irma.full for AutoFlight-PT-01b
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
2966.180 | 138060.00 | 149516.00 | 2981.90 | FTFTTFTFFFFFTTFF | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Waiting for the VM to be ready (probing ssh)
.............................................................................................................................
/home/mcc/execution
total 192K
-rw-r--r-- 1 mcc users 3.5K May 15 18:54 CTLCardinality.txt
-rw-r--r-- 1 mcc users 21K May 15 18:54 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.3K May 15 18:54 CTLFireability.txt
-rw-r--r-- 1 mcc users 16K May 15 18:54 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K May 15 18:49 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.2K May 15 18:49 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 2.2K May 15 18:54 LTLCardinality.txt
-rw-r--r-- 1 mcc users 11K May 15 18:54 LTLCardinality.xml
-rw-r--r-- 1 mcc users 1.8K May 15 18:54 LTLFireability.txt
-rw-r--r-- 1 mcc users 8.9K May 15 18:54 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.0K May 15 18:54 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 15K May 15 18:54 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 108 May 15 18:54 ReachabilityDeadlock.txt
-rw-r--r-- 1 mcc users 346 May 15 18:54 ReachabilityDeadlock.xml
-rw-r--r-- 1 mcc users 2.7K May 15 18:54 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 17K May 15 18:54 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K May 15 18:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.6K May 15 18:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 15 18:49 equiv_col
-rw-r--r-- 1 mcc users 4 May 15 18:49 instance
-rw-r--r-- 1 mcc users 6 May 15 18:49 iscolored
-rw-r--r-- 1 mcc users 26K May 15 18:49 model.pnml
=====================================================================
Generated by BenchKit 2-3637
Executing tool irma4mcc-full
Input is AutoFlight-PT-01b, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r018-qhx1-152646242800060
=====================================================================
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-00
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-01
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-02
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-03
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-04
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-05
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-06
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-07
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-08
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-09
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-10
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-11
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-12
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-13
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-14
FORMULA_NAME AutoFlight-PT-01b-CTLFireability-15
=== Now, execution of the tool begins
BK_START 1526765299534
BK_STOP 1526765437594
--------------------
content from stderr:
Prefix is 65b80f64.
Reading known information in /usr/share/mcc4mcc/65b80f64-known.json.
Reading learned information in /usr/share/mcc4mcc/65b80f64-learned.json.
Reading value translations in /usr/share/mcc4mcc/65b80f64-values.json.
Using directory /home/mcc/execution for input, as it contains a model.pnml file.
Using AutoFlight-PT-01b as instance name.
Using AutoFlight as model name.
Using algorithm or tool voting-classifier.
Model characteristics are: {'Examination': 'CTLFireability', 'Place/Transition': True, 'Colored': False, 'Relative-Time': 1, 'Relative-Memory': 1, 'Ordinary': True, 'Simple Free Choice': False, 'Extended Free Choice': False, 'State Machine': False, 'Marked Graph': False, 'Connected': True, 'Strongly Connected': False, 'Source Place': True, 'Sink Place': False, 'Source Transition': False, 'Sink Transition': False, 'Loop Free': None, 'Conservative': False, 'Sub-Conservative': False, 'Nested Units': True, 'Safe': True, 'Deadlock': None, 'Reversible': None, 'Quasi Live': None, 'Live': None}.
/usr/local/lib/python3.6/dist-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty.
if diff:
Known tools are: [{'Time': 21759, 'Memory': 2350.84, 'Tool': 'marcie'}, {'Time': 23928, 'Memory': 2350.32, 'Tool': 'marcie'}, {'Time': 54061, 'Memory': 1079.43, 'Tool': 'gspn'}, {'Time': 55296, 'Memory': 1103.78, 'Tool': 'gspn'}, {'Time': 148691, 'Memory': 1920.75, 'Tool': 'lola'}, {'Time': 149149, 'Memory': 1924.82, 'Tool': 'lola'}, {'Time': 635897, 'Memory': 3172.56, 'Tool': 'itstools'}, {'Time': 730363, 'Memory': 3178.99, 'Tool': 'itstools'}].
Learned tools are: [{'Tool': 'lola'}].
Learned tool lola is 6.8335401443081025x far from the best tool marcie.
CTLFireability marcie AutoFlight-PT-01b...
timeout --kill-after=10s --signal=SIGINT 1m for testing only
check for maximal unmarked siphon
Marcie rev. 8852M (built: crohr on 2017-05-03)
A model checker for Generalized Stochastic Petri nets
authors: Alex Tovchigrechko (IDD package and CTL model checking)
Martin Schwarick (Symbolic numerical analysis and CSL model checking)
Christian Rohr (Simulative and approximative numerical model checking)
marcie@informatik.tu-cottbus.de
called as: marcie --net-file=model.pnml --mcc-file=CTLFireability.xml --memory=6
parse successfull
net created successfully
Net: AutoFlight_PT_01b
(NrP: 114 NrTr: 112 NrArc: 264)
ok
check for constant places
ok
check if there are places and transitions
ok
check if there are transitions without pre-places
ok
check if at least one transition is enabled in m0
ok
check if there are transitions that can never fire
parse formulas
formulas created successfully
place and transition orderings generation:0m 0.001sec
ok
net check time: 0m 0.000sec
init dd package: 0m26.925sec
initing FirstDep: 0m 0.000sec
iterations count:3544 (31), effective:400 (3)
initing FirstDep: 0m 0.000sec
RS generation: 0m 0.344sec
-> reachability set: #nodes 3431 (3.4e+03) #states 48,881,955 (7)
starting MCC model checker
--------------------------
checking: EG [AF [AX [IS_FIREABLE [t88]]]]
normalized: EG [~ [EG [EX [~ [IS_FIREABLE [t88]]]]]]
........................................................
EG iterations: 55
.....
EG iterations: 5
-> the formula is FALSE
FORMULA AutoFlight-PT-01b-CTLFireability-00 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 7.596sec
checking: EF [AX [AG [IS_FIREABLE [t101]]]]
normalized: E [true U ~ [EX [E [true U ~ [IS_FIREABLE [t101]]]]]]
iterations count:205 (1), effective:1 (0)
iterations count:1699 (15), effective:185 (1)
iterations count:2661 (23), effective:261 (2)
.-> the formula is TRUE
FORMULA AutoFlight-PT-01b-CTLFireability-01 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 0.568sec
checking: EF [IS_FIREABLE [t1]]
normalized: E [true U IS_FIREABLE [t1]]
-> the formula is TRUE
FORMULA AutoFlight-PT-01b-CTLFireability-03 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 0.698sec
checking: ~ [AF [IS_FIREABLE [t19]]]
normalized: EG [~ [IS_FIREABLE [t19]]]
....................................
EG iterations: 36
-> the formula is FALSE
FORMULA AutoFlight-PT-01b-CTLFireability-08 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 0.969sec
checking: [E [IS_FIREABLE [t34] U AF [IS_FIREABLE [t1]]] & EF [AX [IS_FIREABLE [t45]]]]
normalized: [E [true U ~ [EX [~ [IS_FIREABLE [t45]]]]] & E [IS_FIREABLE [t34] U ~ [EG [~ [IS_FIREABLE [t1]]]]]]
.
EG iterations: 1
iterations count:112 (1), effective:0 (0)
iterations count:1697 (15), effective:184 (1)
.-> the formula is FALSE
FORMULA AutoFlight-PT-01b-CTLFireability-10 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 0.093sec
checking: E [EG [~ [IS_FIREABLE [t32]]] U [EX [IS_FIREABLE [t65]] | EF [IS_FIREABLE [t96]]]]
normalized: E [EG [~ [IS_FIREABLE [t32]]] U [E [true U IS_FIREABLE [t96]] | EX [IS_FIREABLE [t65]]]]
iterations count:1394 (12), effective:125 (1)
iterations count:116 (1), effective:2 (0)
.........................................................
EG iterations: 56
-> the formula is TRUE
FORMULA AutoFlight-PT-01b-CTLFireability-12 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
iterations count:956 (8), effective:83 (0)
MC time: 0m 5.165sec
checking: [AF [IS_FIREABLE [t68]] | E [~ [[IS_FIREABLE [t83] | IS_FIREABLE [t59]]] U IS_FIREABLE [t93]]]
normalized: [E [~ [[IS_FIREABLE [t83] | IS_FIREABLE [t59]]] U IS_FIREABLE [t93]] | ~ [EG [~ [IS_FIREABLE [t68]]]]]
......................
after gc: zbdd nodes used:85638, unused:18664362.......................................
EG iterations: 61
iterations count:1359 (12), effective:122 (1)
-> the formula is TRUE
FORMULA AutoFlight-PT-01b-CTLFireability-06 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m13.538sec
checking: [[~ [EF [IS_FIREABLE [t10]]] | ~ [EX [~ [IS_FIREABLE [t61]]]]] | EG [[~ [IS_FIREABLE [t108]] & AG [IS_FIREABLE [t24]]]]]
normalized: [EG [[~ [E [true U ~ [IS_FIREABLE [t24]]]] & ~ [IS_FIREABLE [t108]]]] | [~ [EX [~ [IS_FIREABLE [t61]]]] | ~ [E [true U IS_FIREABLE [t10]]]]]
iterations count:114 (1), effective:1 (0)
iterations count:114 (1), effective:1 (0)
..
EG iterations: 1
-> the formula is FALSE
FORMULA AutoFlight-PT-01b-CTLFireability-07 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 0.700sec
checking: [AF [IS_FIREABLE [t101]] & ~ [[IS_FIREABLE [t43] & A [IS_FIREABLE [t26] U IS_FIREABLE [t51]]]]]
normalized: [~ [[IS_FIREABLE [t43] & [~ [EG [~ [IS_FIREABLE [t51]]]] & ~ [E [~ [IS_FIREABLE [t51]] U [~ [IS_FIREABLE [t26]] & ~ [IS_FIREABLE [t51]]]]]]]] & ~ [EG [~ [IS_FIREABLE [t101]]]]]
.............................................
EG iterations: 45
..............................................
EG iterations: 46
-> the formula is FALSE
FORMULA AutoFlight-PT-01b-CTLFireability-09 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 8.152sec
checking: [E [AF [IS_FIREABLE [t16]] U EX [IS_FIREABLE [t21]]] | [IS_FIREABLE [t111] & IS_FIREABLE [t26]]]
normalized: [[IS_FIREABLE [t111] & IS_FIREABLE [t26]] | E [~ [EG [~ [IS_FIREABLE [t16]]]] U EX [IS_FIREABLE [t21]]]]
.......................................................
EG iterations: 54
iterations count:146 (1), effective:6 (0)
-> the formula is TRUE
FORMULA AutoFlight-PT-01b-CTLFireability-13 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 5.962sec
checking: A [~ [~ [~ [IS_FIREABLE [t102]]]] U [[IS_FIREABLE [t38] | [IS_FIREABLE [t57] | IS_FIREABLE [t110]]] | AG [IS_FIREABLE [t101]]]]
normalized: [~ [EG [~ [[~ [E [true U ~ [IS_FIREABLE [t101]]]] | [IS_FIREABLE [t38] | [IS_FIREABLE [t57] | IS_FIREABLE [t110]]]]]]] & ~ [E [~ [[~ [E [true U ~ [IS_FIREABLE [t101]]]] | [IS_FIREABLE [t38] | [IS_FIREABLE [t57] | IS_FIREABLE [t110]]]]] U [IS_FIREABLE [t102] & ~ [[~ [E [true U ~ [IS_FIREABLE [t101]]]] | [IS_FIREABLE [t38] | [IS_FIREABLE [t57] | IS_FIREABLE [t110]]]]]]]]]
iterations count:205 (1), effective:1 (0)
iterations count:205 (1), effective:1 (0)
iterations count:1251 (11), effective:119 (1)
iterations count:205 (1), effective:1 (0)
iterations count:212 (1), effective:1 (0)
.....................................
after gc: zbdd nodes used:50287, unused:37449713....................................
EG iterations: 73
-> the formula is FALSE
FORMULA AutoFlight-PT-01b-CTLFireability-02 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m21.797sec
checking: EF [[~ [IS_FIREABLE [t50]] & [AG [IS_FIREABLE [t50]] | [~ [IS_FIREABLE [t2]] & [IS_FIREABLE [t10] & IS_FIREABLE [t55]]]]]]
normalized: E [true U [[[[IS_FIREABLE [t10] & IS_FIREABLE [t55]] & ~ [IS_FIREABLE [t2]]] | ~ [E [true U ~ [IS_FIREABLE [t50]]]]] & ~ [IS_FIREABLE [t50]]]]
iterations count:706 (6), effective:57 (0)
-> the formula is FALSE
FORMULA AutoFlight-PT-01b-CTLFireability-05 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 0.281sec
checking: E [[IS_FIREABLE [t70] & ~ [[IS_FIREABLE [t11] | IS_FIREABLE [t85]]]] U AF [[IS_FIREABLE [t28] | IS_FIREABLE [t77]]]]
normalized: E [[IS_FIREABLE [t70] & ~ [[IS_FIREABLE [t11] | IS_FIREABLE [t85]]]] U ~ [EG [~ [[IS_FIREABLE [t28] | IS_FIREABLE [t77]]]]]]
......................................................
EG iterations: 54
-> the formula is FALSE
FORMULA AutoFlight-PT-01b-CTLFireability-11 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 6.178sec
checking: [AF [E [IS_FIREABLE [t50] U IS_FIREABLE [t79]]] | A [[IS_FIREABLE [t81] & IS_FIREABLE [t62]] U ~ [~ [IS_FIREABLE [t26]]]]]
normalized: [[~ [EG [~ [IS_FIREABLE [t26]]]] & ~ [E [~ [IS_FIREABLE [t26]] U [~ [[IS_FIREABLE [t81] & IS_FIREABLE [t62]]] & ~ [IS_FIREABLE [t26]]]]]] | ~ [EG [~ [E [IS_FIREABLE [t50] U IS_FIREABLE [t79]]]]]]
iterations count:852 (7), effective:67 (0)
..........................................................
EG iterations: 58
iterations count:114 (1), effective:1 (0)
.........................................
EG iterations: 41
iterations count:1718 (15), effective:150 (1)
-> the formula is FALSE
FORMULA AutoFlight-PT-01b-CTLFireability-14 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 8.519sec
checking: [A [[~ [IS_FIREABLE [t35]] | [IS_FIREABLE [t72] | IS_FIREABLE [t78]]] U ~ [~ [IS_FIREABLE [t109]]]] | EG [IS_FIREABLE [t16]]]
normalized: [EG [IS_FIREABLE [t16]] | [~ [EG [~ [IS_FIREABLE [t109]]]] & ~ [E [~ [IS_FIREABLE [t109]] U [~ [[[IS_FIREABLE [t72] | IS_FIREABLE [t78]] | ~ [IS_FIREABLE [t35]]]] & ~ [IS_FIREABLE [t109]]]]]]]
.........................................
EG iterations: 41
..................................................................
EG iterations: 66
-> the formula is FALSE
FORMULA AutoFlight-PT-01b-CTLFireability-15 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m14.431sec
checking: [[IS_FIREABLE [t74] & [AG [[IS_FIREABLE [t6] | IS_FIREABLE [t39]]] & E [IS_FIREABLE [t89] U IS_FIREABLE [t32]]]] | EF [IS_FIREABLE [t27]]]
normalized: [E [true U IS_FIREABLE [t27]] | [IS_FIREABLE [t74] & [E [IS_FIREABLE [t89] U IS_FIREABLE [t32]] & ~ [E [true U ~ [[IS_FIREABLE [t6] | IS_FIREABLE [t39]]]]]]]]
iterations count:120 (1), effective:2 (0)
iterations count:171 (1), effective:4 (0)
iterations count:1369 (12), effective:122 (1)
-> the formula is TRUE
FORMULA AutoFlight-PT-01b-CTLFireability-04 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS UNFOLDING_TO_PT
MC time: 0m 0.688sec
totally nodes used: 46067213(4.6e+07)
number of garbage collections: 2
fire ops cache: hits/miss/sum: 36370250 44476197 80846447
used/not used/entry size/cache size: 14382289 52726575 16 1024MB
basic ops cache: hits/miss/sum: 37013951 64534734 101548685
used/not used/entry size/cache size: 16216438 560778 12 192MB
unary ops cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 8 64MB
abstract ops cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 12 96MB
state nr cache: hits/miss/sum: 3050 3431 6481
used/not used/entry size/cache size: 0 2097152 32 64MB
max state cache: hits/miss/sum: 0 0 0
used/not used/entry size/cache size: 0 8388608 32 256MB
uniqueHash elements/entry size/size: 67108864 4 256MB
0 51263194
1 13804644
2 1862063
3 167139
4 11196
5 602
6 25
7 1
8 0
9 0
>= 10 0
Total processing time: 2m 6.748sec
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AutoFlight-PT-01b"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="irma4mcc-full"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
tar xzf /home/mcc/BenchKit/INPUTS/AutoFlight-PT-01b.tgz
mv AutoFlight-PT-01b execution
cd execution
pwd
ls -lh
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-3637"
echo " Executing tool irma4mcc-full"
echo " Input is AutoFlight-PT-01b, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r018-qhx1-152646242800060"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;