fond
Model Checking Contest 2018
8th edition, Bratislava, Slovakia, June 26, 2018
Execution of r022-qhx1-152646247300137
Last Updated
June 26, 2018

About the Execution of M4M.full for AutoFlight-PT-12a

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
1652.530 235378.00 253501.00 2117.20 ???????????????? normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Waiting for the VM to be ready (probing ssh)
...........................................................................................
/home/mcc/execution
total 256K
-rw-r--r-- 1 mcc users 3.7K May 15 18:54 CTLCardinality.txt
-rw-r--r-- 1 mcc users 21K May 15 18:54 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.2K May 15 18:54 CTLFireability.txt
-rw-r--r-- 1 mcc users 14K May 15 18:54 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K May 15 18:49 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.2K May 15 18:49 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 2.3K May 15 18:54 LTLCardinality.txt
-rw-r--r-- 1 mcc users 11K May 15 18:54 LTLCardinality.xml
-rw-r--r-- 1 mcc users 1.9K May 15 18:54 LTLFireability.txt
-rw-r--r-- 1 mcc users 9.5K May 15 18:54 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.4K May 15 18:54 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 18K May 15 18:54 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 108 May 15 18:54 ReachabilityDeadlock.txt
-rw-r--r-- 1 mcc users 346 May 15 18:54 ReachabilityDeadlock.xml
-rw-r--r-- 1 mcc users 2.9K May 15 18:54 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 19K May 15 18:54 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K May 15 18:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K May 15 18:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 15 18:49 equiv_col
-rw-r--r-- 1 mcc users 4 May 15 18:49 instance
-rw-r--r-- 1 mcc users 6 May 15 18:49 iscolored
-rw-r--r-- 1 mcc users 85K May 15 18:49 model.pnml
=====================================================================
Generated by BenchKit 2-3637
Executing tool mcc4mcc-full
Input is AutoFlight-PT-12a, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r022-qhx1-152646247300137
=====================================================================


--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-00
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-01
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-02
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-03
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-04
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-05
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-06
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-07
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-08
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-09
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-10
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-11
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-12
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-13
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-14
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-15

=== Now, execution of the tool begins

BK_START 1526891699887


BK_STOP 1526891935265

--------------------
content from stderr:

Prefix is 65b80f64.
Reading known information in /usr/share/mcc4mcc/65b80f64-known.json.
Reading learned information in /usr/share/mcc4mcc/65b80f64-learned.json.
Reading value translations in /usr/share/mcc4mcc/65b80f64-values.json.
Using directory /home/mcc/execution for input, as it contains a model.pnml file.
Using AutoFlight-PT-12a as instance name.
Using AutoFlight as model name.
Using algorithm or tool voting-classifier.
Model characteristics are: {'Examination': 'CTLFireability', 'Place/Transition': True, 'Colored': False, 'Relative-Time': 1, 'Relative-Memory': 1, 'Ordinary': True, 'Simple Free Choice': False, 'Extended Free Choice': False, 'State Machine': False, 'Marked Graph': False, 'Connected': True, 'Strongly Connected': False, 'Source Place': True, 'Sink Place': False, 'Source Transition': False, 'Sink Transition': False, 'Loop Free': None, 'Conservative': False, 'Sub-Conservative': False, 'Nested Units': True, 'Safe': True, 'Deadlock': None, 'Reversible': None, 'Quasi Live': None, 'Live': None}.
/usr/local/lib/python3.6/dist-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty.
if diff:
Known tools are: [{'Time': 613385, 'Memory': 3712.62, 'Tool': 'itstools'}, {'Time': 625217, 'Memory': 3701.73, 'Tool': 'itstools'}, {'Time': 3540135, 'Memory': 10358.18, 'Tool': 'lola'}, {'Time': 3540242, 'Memory': 10064.31, 'Tool': 'lola'}].
Learned tools are: [{'Tool': 'lola'}].
Learned tool lola is 5.771473055258932x far from the best tool itstools.
CTLFireability lola AutoFlight-PT-12a...

Time: 3600 - MCC
----- Start make prepare stdout -----
----- Start make prepare stderr -----
===========================================================================================
AutoFlight-PT-12a: translating PT Petri net model.pnml into LoLA format
===========================================================================================
translating PT Petri net complete


checking for too many tokens
===========================================================================================
AutoFlight-PT-12a: translating PT formula CTLFireability into LoLA format
===========================================================================================
translating formula complete
touch formulae;
----- Start make result stdout -----
----- Start make result stderr -----
CTLFireability @ AutoFlight-PT-12a @ 3538 seconds
make: [verify] Error 134 (ignored)
Makefile:222: recipe for target 'verify' failed
----- Start make result stderr -----
----- Start make result stdout -----
lola: LoLA will run for 3538 seconds at most (--timelimit)
lola: NET
lola: reading net from model.pnml.lola
lola: finished parsing
lola: closed net file model.pnml.lola
lola: 612/65536 symbol table entries, 0 collisions
lola: preprocessing...
lola: finding significant places
lola: 307 places, 305 transitions, 231 significant places
lola: computing forward-conflicting sets
lola: computing back-conflicting sets
lola: 296 transition conflict sets
lola: TASK
lola: reading formula from AutoFlight-PT-12a-CTLFireability.task
lola: A ((FIREABLE(t164) U NOT(E (F (FIREABLE(t218)))))) : E ((A (F (FIREABLE(t12))) U FIREABLE(t19))) : NOT(A (F (FIREABLE(t146)))) : (NOT FIREABLE(t74) AND A (F (FIREABLE(t16)))) : (NOT(E (F (E (G (FIREABLE(t186)))))) OR A (X (E (X (FIREABLE(t20)))))) : (E (F (A ((FIREABLE(t266) U FIREABLE(t255))))) OR (NOT FIREABLE(t191) AND NOT(NOT(E (G (FIREABLE(t209))))))) : A (F (E (((FIREABLE(t148) AND FIREABLE(t275)) U FIREABLE(t141))))) : A (F ((((NOT FIREABLE(t173) OR NOT FIREABLE(t200)) AND A (X (FIREABLE(t219)))) OR (A (X (FIREABLE(t300))) AND FIREABLE(t120))))) : E (F (FIREABLE(t237))) : A (F (FIREABLE(t202))) : NOT(E (F (A (G (NOT FIREABLE(t300)))))) : (A (F (((FIREABLE(t131) AND FIREABLE(t182) AND (FIREABLE(t24) OR FIREABLE(t121))) OR FIREABLE(t91)))) OR ((FIREABLE(t192) OR FIREABLE(t42)) AND FIREABLE(t244) AND (FIREABLE(t109) OR FIREABLE(t11)) AND FIREABLE(t194))) : A (F (E (F (A (X (FIREABLE(t124))))))) : A (X (E (G (FIREABLE(t294))))) : E (G (E (F ((NOT FIREABLE(t53) AND NOT FIREABLE(t137)))))) : NOT(((E ((FIREABLE(t45) U FIREABLE(t147))) AND (FIREABLE(t131) OR (FIREABLE(t84) AND NOT FIREABLE(t263)))) OR (A (G (FIREABLE(t253))) OR ((NOT FIREABLE(t104) AND NOT FIREABLE(t153)) AND E (F (FIREABLE(t5)))))))
lola: computing a collection of formulas
lola: RUNNING
lola: subprocess 0 will run for 221 seconds at most (--localtimelimit=-1)
lola: ========================================
lola: ...considering subproblem: A ((FIREABLE(t164) U NOT(E (F (FIREABLE(t218))))))
lola: ========================================
lola: SUBTASK
lola: checking LTL
lola: transforming LTL-Formula into a B\xfcchi-Automaton
lola: processed formula: A ((FIREABLE(t164) U A (G (NOT FIREABLE(t218)))))
lola: processed formula: A ((FIREABLE(t164) U A (G (NOT FIREABLE(t218)))))
lola: processed formula length: 49
lola: 3 rewrites
lola: formula mentions 0 of 307 places; total mentions: 0
lola: closed formula file AutoFlight-PT-12a-CTLFireability.task
lola: the resulting B\xfcchi automaton has 4 states
lola: STORE
lola: using a bit-perfect encoder (--encoder=bit)
lola: using 32 bytes per marking, with 22 unused bits
lola: using a prefix tree store (--store=prefix)
lola: using ltl preserving stubborn set method (--stubborn)
lola: SEARCH
lola: RUNNING
lola: 160253 markings, 1923353 edges, 32051 markings/sec, 0 secs
lola: 307613 markings, 3875908 edges, 29472 markings/sec, 5 secs
lola: 448310 markings, 5844752 edges, 28139 markings/sec, 10 secs
lola: 586891 markings, 7828739 edges, 27716 markings/sec, 15 secs
lola: 723869 markings, 9771914 edges, 27396 markings/sec, 20 secs
lola: 856742 markings, 11743585 edges, 26575 markings/sec, 25 secs
lola: 979941 markings, 13685731 edges, 24640 markings/sec, 30 secs
lola: 1118290 markings, 15645752 edges, 27670 markings/sec, 35 secs
lola: 1270649 markings, 17758206 edges, 30472 markings/sec, 40 secs
lola: 1421532 markings, 19914822 edges, 30177 markings/sec, 45 secs
lola: 1555901 markings, 22041256 edges, 26874 markings/sec, 50 secs
lola: 1700394 markings, 24222142 edges, 28899 markings/sec, 55 secs
lola: 1833964 markings, 26289991 edges, 26714 markings/sec, 60 secs
lola: 1969577 markings, 28469601 edges, 27123 markings/sec, 65 secs
lola: 2090222 markings, 30514366 edges, 24129 markings/sec, 70 secs
lola: 2247438 markings, 32583167 edges, 31443 markings/sec, 75 secs
lola: 2395008 markings, 34685031 edges, 29514 markings/sec, 80 secs
lola: 2531090 markings, 36709125 edges, 27216 markings/sec, 85 secs
lola: 2654231 markings, 38614202 edges, 24628 markings/sec, 90 secs
lola: 2781604 markings, 40544789 edges, 25475 markings/sec, 95 secs
lola: 2900853 markings, 42397172 edges, 23850 markings/sec, 100 secs
lola: 3020051 markings, 44343257 edges, 23840 markings/sec, 105 secs
lola: 3129638 markings, 46200801 edges, 21917 markings/sec, 110 secs
lola: 3258226 markings, 48020164 edges, 25718 markings/sec, 115 secs
lola: 3374632 markings, 49788274 edges, 23281 markings/sec, 120 secs
lola: 3493597 markings, 51580570 edges, 23793 markings/sec, 125 secs
lola: 3609762 markings, 53496215 edges, 23233 markings/sec, 130 secs
lola: 3733669 markings, 55507683 edges, 24781 markings/sec, 135 secs
lola: 3855151 markings, 57467459 edges, 24296 markings/sec, 140 secs
lola: 3972458 markings, 59427027 edges, 23461 markings/sec, 145 secs
lola: 4087490 markings, 61439753 edges, 23006 markings/sec, 150 secs
lola: 4193669 markings, 63367375 edges, 21236 markings/sec, 155 secs
lola: 4380841 markings, 65826220 edges, 37434 markings/sec, 160 secs
lola: 4550285 markings, 68242235 edges, 33889 markings/sec, 165 secs
lola: 4700275 markings, 70601617 edges, 29998 markings/sec, 170 secs
lola: 4861387 markings, 73024201 edges, 32222 markings/sec, 175 secs
lola: 5009831 markings, 75313609 edges, 29689 markings/sec, 180 secs
lola: 5147423 markings, 77588312 edges, 27518 markings/sec, 185 secs
lola: 5284320 markings, 79748543 edges, 27379 markings/sec, 190 secs
lola: 5427356 markings, 81826965 edges, 28607 markings/sec, 195 secs
lola: 5562093 markings, 83898163 edges, 26947 markings/sec, 200 secs
lola: 5689597 markings, 85940279 edges, 25501 markings/sec, 205 secs
lola: 5816210 markings, 88004731 edges, 25323 markings/sec, 210 secs
lola: 5943218 markings, 90061482 edges, 25402 markings/sec, 215 secs
lola: local time limit reached - aborting
lola: Child process aborted or communication problem between parent and child process
terminate called after throwing an instance of 'std::runtime_error'
what(): parse error at position 0: unexpected character, last read: ''
Aborted (core dumped)
FORMULA AutoFlight-PT-12a-CTLFireability-0 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-1 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-2 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-3 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-4 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-5 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-6 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-7 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-8 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-9 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-10 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-11 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-12 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-13 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-14 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-15 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
----- Kill lola and sara stderr -----
----- Kill lola and sara stdout -----
----- Finished stderr -----
----- Finished stdout -----

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AutoFlight-PT-12a"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="mcc4mcc-full"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

tar xzf /home/mcc/BenchKit/INPUTS/AutoFlight-PT-12a.tgz
mv AutoFlight-PT-12a execution
cd execution
pwd
ls -lh

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-3637"
echo " Executing tool mcc4mcc-full"
echo " Input is AutoFlight-PT-12a, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r022-qhx1-152646247300137"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' CTLFireability.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;