About the Execution of M4M.full for AutoFlight-PT-12a
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
1652.530 | 235378.00 | 253501.00 | 2117.20 | ???????????????? | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Waiting for the VM to be ready (probing ssh)
...........................................................................................
/home/mcc/execution
total 256K
-rw-r--r-- 1 mcc users 3.7K May 15 18:54 CTLCardinality.txt
-rw-r--r-- 1 mcc users 21K May 15 18:54 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.2K May 15 18:54 CTLFireability.txt
-rw-r--r-- 1 mcc users 14K May 15 18:54 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K May 15 18:49 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.2K May 15 18:49 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 2.3K May 15 18:54 LTLCardinality.txt
-rw-r--r-- 1 mcc users 11K May 15 18:54 LTLCardinality.xml
-rw-r--r-- 1 mcc users 1.9K May 15 18:54 LTLFireability.txt
-rw-r--r-- 1 mcc users 9.5K May 15 18:54 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.4K May 15 18:54 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 18K May 15 18:54 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 108 May 15 18:54 ReachabilityDeadlock.txt
-rw-r--r-- 1 mcc users 346 May 15 18:54 ReachabilityDeadlock.xml
-rw-r--r-- 1 mcc users 2.9K May 15 18:54 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 19K May 15 18:54 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K May 15 18:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K May 15 18:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 15 18:49 equiv_col
-rw-r--r-- 1 mcc users 4 May 15 18:49 instance
-rw-r--r-- 1 mcc users 6 May 15 18:49 iscolored
-rw-r--r-- 1 mcc users 85K May 15 18:49 model.pnml
=====================================================================
Generated by BenchKit 2-3637
Executing tool mcc4mcc-full
Input is AutoFlight-PT-12a, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r022-qhx1-152646247300137
=====================================================================
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-00
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-01
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-02
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-03
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-04
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-05
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-06
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-07
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-08
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-09
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-10
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-11
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-12
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-13
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-14
FORMULA_NAME AutoFlight-PT-12a-CTLFireability-15
=== Now, execution of the tool begins
BK_START 1526891699887
BK_STOP 1526891935265
--------------------
content from stderr:
Prefix is 65b80f64.
Reading known information in /usr/share/mcc4mcc/65b80f64-known.json.
Reading learned information in /usr/share/mcc4mcc/65b80f64-learned.json.
Reading value translations in /usr/share/mcc4mcc/65b80f64-values.json.
Using directory /home/mcc/execution for input, as it contains a model.pnml file.
Using AutoFlight-PT-12a as instance name.
Using AutoFlight as model name.
Using algorithm or tool voting-classifier.
Model characteristics are: {'Examination': 'CTLFireability', 'Place/Transition': True, 'Colored': False, 'Relative-Time': 1, 'Relative-Memory': 1, 'Ordinary': True, 'Simple Free Choice': False, 'Extended Free Choice': False, 'State Machine': False, 'Marked Graph': False, 'Connected': True, 'Strongly Connected': False, 'Source Place': True, 'Sink Place': False, 'Source Transition': False, 'Sink Transition': False, 'Loop Free': None, 'Conservative': False, 'Sub-Conservative': False, 'Nested Units': True, 'Safe': True, 'Deadlock': None, 'Reversible': None, 'Quasi Live': None, 'Live': None}.
/usr/local/lib/python3.6/dist-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty.
if diff:
Known tools are: [{'Time': 613385, 'Memory': 3712.62, 'Tool': 'itstools'}, {'Time': 625217, 'Memory': 3701.73, 'Tool': 'itstools'}, {'Time': 3540135, 'Memory': 10358.18, 'Tool': 'lola'}, {'Time': 3540242, 'Memory': 10064.31, 'Tool': 'lola'}].
Learned tools are: [{'Tool': 'lola'}].
Learned tool lola is 5.771473055258932x far from the best tool itstools.
CTLFireability lola AutoFlight-PT-12a...
Time: 3600 - MCC
----- Start make prepare stdout -----
----- Start make prepare stderr -----
===========================================================================================
AutoFlight-PT-12a: translating PT Petri net model.pnml into LoLA format
===========================================================================================
translating PT Petri net complete
checking for too many tokens
===========================================================================================
AutoFlight-PT-12a: translating PT formula CTLFireability into LoLA format
===========================================================================================
translating formula complete
touch formulae;
----- Start make result stdout -----
----- Start make result stderr -----
CTLFireability @ AutoFlight-PT-12a @ 3538 seconds
make: [verify] Error 134 (ignored)
Makefile:222: recipe for target 'verify' failed
----- Start make result stderr -----
----- Start make result stdout -----
lola: LoLA will run for 3538 seconds at most (--timelimit)
lola: NET
lola: reading net from model.pnml.lola
lola: finished parsing
lola: closed net file model.pnml.lola
lola: 612/65536 symbol table entries, 0 collisions
lola: preprocessing...
lola: finding significant places
lola: 307 places, 305 transitions, 231 significant places
lola: computing forward-conflicting sets
lola: computing back-conflicting sets
lola: 296 transition conflict sets
lola: TASK
lola: reading formula from AutoFlight-PT-12a-CTLFireability.task
lola: A ((FIREABLE(t164) U NOT(E (F (FIREABLE(t218)))))) : E ((A (F (FIREABLE(t12))) U FIREABLE(t19))) : NOT(A (F (FIREABLE(t146)))) : (NOT FIREABLE(t74) AND A (F (FIREABLE(t16)))) : (NOT(E (F (E (G (FIREABLE(t186)))))) OR A (X (E (X (FIREABLE(t20)))))) : (E (F (A ((FIREABLE(t266) U FIREABLE(t255))))) OR (NOT FIREABLE(t191) AND NOT(NOT(E (G (FIREABLE(t209))))))) : A (F (E (((FIREABLE(t148) AND FIREABLE(t275)) U FIREABLE(t141))))) : A (F ((((NOT FIREABLE(t173) OR NOT FIREABLE(t200)) AND A (X (FIREABLE(t219)))) OR (A (X (FIREABLE(t300))) AND FIREABLE(t120))))) : E (F (FIREABLE(t237))) : A (F (FIREABLE(t202))) : NOT(E (F (A (G (NOT FIREABLE(t300)))))) : (A (F (((FIREABLE(t131) AND FIREABLE(t182) AND (FIREABLE(t24) OR FIREABLE(t121))) OR FIREABLE(t91)))) OR ((FIREABLE(t192) OR FIREABLE(t42)) AND FIREABLE(t244) AND (FIREABLE(t109) OR FIREABLE(t11)) AND FIREABLE(t194))) : A (F (E (F (A (X (FIREABLE(t124))))))) : A (X (E (G (FIREABLE(t294))))) : E (G (E (F ((NOT FIREABLE(t53) AND NOT FIREABLE(t137)))))) : NOT(((E ((FIREABLE(t45) U FIREABLE(t147))) AND (FIREABLE(t131) OR (FIREABLE(t84) AND NOT FIREABLE(t263)))) OR (A (G (FIREABLE(t253))) OR ((NOT FIREABLE(t104) AND NOT FIREABLE(t153)) AND E (F (FIREABLE(t5)))))))
lola: computing a collection of formulas
lola: RUNNING
lola: subprocess 0 will run for 221 seconds at most (--localtimelimit=-1)
lola: ========================================
lola: ...considering subproblem: A ((FIREABLE(t164) U NOT(E (F (FIREABLE(t218))))))
lola: ========================================
lola: SUBTASK
lola: checking LTL
lola: transforming LTL-Formula into a B\xfcchi-Automaton
lola: processed formula: A ((FIREABLE(t164) U A (G (NOT FIREABLE(t218)))))
lola: processed formula: A ((FIREABLE(t164) U A (G (NOT FIREABLE(t218)))))
lola: processed formula length: 49
lola: 3 rewrites
lola: formula mentions 0 of 307 places; total mentions: 0
lola: closed formula file AutoFlight-PT-12a-CTLFireability.task
lola: the resulting B\xfcchi automaton has 4 states
lola: STORE
lola: using a bit-perfect encoder (--encoder=bit)
lola: using 32 bytes per marking, with 22 unused bits
lola: using a prefix tree store (--store=prefix)
lola: using ltl preserving stubborn set method (--stubborn)
lola: SEARCH
lola: RUNNING
lola: 160253 markings, 1923353 edges, 32051 markings/sec, 0 secs
lola: 307613 markings, 3875908 edges, 29472 markings/sec, 5 secs
lola: 448310 markings, 5844752 edges, 28139 markings/sec, 10 secs
lola: 586891 markings, 7828739 edges, 27716 markings/sec, 15 secs
lola: 723869 markings, 9771914 edges, 27396 markings/sec, 20 secs
lola: 856742 markings, 11743585 edges, 26575 markings/sec, 25 secs
lola: 979941 markings, 13685731 edges, 24640 markings/sec, 30 secs
lola: 1118290 markings, 15645752 edges, 27670 markings/sec, 35 secs
lola: 1270649 markings, 17758206 edges, 30472 markings/sec, 40 secs
lola: 1421532 markings, 19914822 edges, 30177 markings/sec, 45 secs
lola: 1555901 markings, 22041256 edges, 26874 markings/sec, 50 secs
lola: 1700394 markings, 24222142 edges, 28899 markings/sec, 55 secs
lola: 1833964 markings, 26289991 edges, 26714 markings/sec, 60 secs
lola: 1969577 markings, 28469601 edges, 27123 markings/sec, 65 secs
lola: 2090222 markings, 30514366 edges, 24129 markings/sec, 70 secs
lola: 2247438 markings, 32583167 edges, 31443 markings/sec, 75 secs
lola: 2395008 markings, 34685031 edges, 29514 markings/sec, 80 secs
lola: 2531090 markings, 36709125 edges, 27216 markings/sec, 85 secs
lola: 2654231 markings, 38614202 edges, 24628 markings/sec, 90 secs
lola: 2781604 markings, 40544789 edges, 25475 markings/sec, 95 secs
lola: 2900853 markings, 42397172 edges, 23850 markings/sec, 100 secs
lola: 3020051 markings, 44343257 edges, 23840 markings/sec, 105 secs
lola: 3129638 markings, 46200801 edges, 21917 markings/sec, 110 secs
lola: 3258226 markings, 48020164 edges, 25718 markings/sec, 115 secs
lola: 3374632 markings, 49788274 edges, 23281 markings/sec, 120 secs
lola: 3493597 markings, 51580570 edges, 23793 markings/sec, 125 secs
lola: 3609762 markings, 53496215 edges, 23233 markings/sec, 130 secs
lola: 3733669 markings, 55507683 edges, 24781 markings/sec, 135 secs
lola: 3855151 markings, 57467459 edges, 24296 markings/sec, 140 secs
lola: 3972458 markings, 59427027 edges, 23461 markings/sec, 145 secs
lola: 4087490 markings, 61439753 edges, 23006 markings/sec, 150 secs
lola: 4193669 markings, 63367375 edges, 21236 markings/sec, 155 secs
lola: 4380841 markings, 65826220 edges, 37434 markings/sec, 160 secs
lola: 4550285 markings, 68242235 edges, 33889 markings/sec, 165 secs
lola: 4700275 markings, 70601617 edges, 29998 markings/sec, 170 secs
lola: 4861387 markings, 73024201 edges, 32222 markings/sec, 175 secs
lola: 5009831 markings, 75313609 edges, 29689 markings/sec, 180 secs
lola: 5147423 markings, 77588312 edges, 27518 markings/sec, 185 secs
lola: 5284320 markings, 79748543 edges, 27379 markings/sec, 190 secs
lola: 5427356 markings, 81826965 edges, 28607 markings/sec, 195 secs
lola: 5562093 markings, 83898163 edges, 26947 markings/sec, 200 secs
lola: 5689597 markings, 85940279 edges, 25501 markings/sec, 205 secs
lola: 5816210 markings, 88004731 edges, 25323 markings/sec, 210 secs
lola: 5943218 markings, 90061482 edges, 25402 markings/sec, 215 secs
lola: local time limit reached - aborting
lola: Child process aborted or communication problem between parent and child process
terminate called after throwing an instance of 'std::runtime_error'
what(): parse error at position 0: unexpected character, last read: ''
Aborted (core dumped)
FORMULA AutoFlight-PT-12a-CTLFireability-0 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-1 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-2 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-3 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-4 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-5 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-6 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-7 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-8 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-9 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-10 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-11 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-12 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-13 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-14 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-12a-CTLFireability-15 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
----- Kill lola and sara stderr -----
----- Kill lola and sara stdout -----
----- Finished stderr -----
----- Finished stdout -----
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AutoFlight-PT-12a"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="mcc4mcc-full"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
tar xzf /home/mcc/BenchKit/INPUTS/AutoFlight-PT-12a.tgz
mv AutoFlight-PT-12a execution
cd execution
pwd
ls -lh
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-3637"
echo " Executing tool mcc4mcc-full"
echo " Input is AutoFlight-PT-12a, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r022-qhx1-152646247300137"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;