About the Execution of M4M.full for Raft-PT-08
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
3374.770 | 233251.00 | 247825.00 | 1334.70 | ???????????????? | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Waiting for the VM to be ready (probing ssh)
.................................................................................
/home/mcc/execution
total 332K
-rw-r--r-- 1 mcc users 3.2K May 15 18:54 CTLCardinality.txt
-rw-r--r-- 1 mcc users 19K May 15 18:54 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.6K May 15 18:54 CTLFireability.txt
-rw-r--r-- 1 mcc users 19K May 15 18:54 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K May 15 18:50 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 5.8K May 15 18:50 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 2.1K May 26 09:27 LTLCardinality.txt
-rw-r--r-- 1 mcc users 9.1K May 26 09:27 LTLCardinality.xml
-rw-r--r-- 1 mcc users 1.8K May 26 09:27 LTLFireability.txt
-rw-r--r-- 1 mcc users 9.9K May 26 09:27 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.9K May 15 18:54 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 22K May 15 18:54 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 101 May 15 18:54 ReachabilityDeadlock.txt
-rw-r--r-- 1 mcc users 339 May 15 18:54 ReachabilityDeadlock.xml
-rw-r--r-- 1 mcc users 3.3K May 15 18:54 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 24K May 15 18:54 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.5K May 15 18:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.5K May 15 18:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 15 18:50 equiv_col
-rw-r--r-- 1 mcc users 3 May 15 18:50 instance
-rw-r--r-- 1 mcc users 6 May 15 18:50 iscolored
-rw-r--r-- 1 mcc users 156K May 15 18:50 model.pnml
=====================================================================
Generated by BenchKit 2-3637
Executing tool mcc4mcc-full
Input is Raft-PT-08, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r142-qhx2-152673583700151
=====================================================================
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME Raft-PT-08-CTLFireability-00
FORMULA_NAME Raft-PT-08-CTLFireability-01
FORMULA_NAME Raft-PT-08-CTLFireability-02
FORMULA_NAME Raft-PT-08-CTLFireability-03
FORMULA_NAME Raft-PT-08-CTLFireability-04
FORMULA_NAME Raft-PT-08-CTLFireability-05
FORMULA_NAME Raft-PT-08-CTLFireability-06
FORMULA_NAME Raft-PT-08-CTLFireability-07
FORMULA_NAME Raft-PT-08-CTLFireability-08
FORMULA_NAME Raft-PT-08-CTLFireability-09
FORMULA_NAME Raft-PT-08-CTLFireability-10
FORMULA_NAME Raft-PT-08-CTLFireability-11
FORMULA_NAME Raft-PT-08-CTLFireability-12
FORMULA_NAME Raft-PT-08-CTLFireability-13
FORMULA_NAME Raft-PT-08-CTLFireability-14
FORMULA_NAME Raft-PT-08-CTLFireability-15
=== Now, execution of the tool begins
BK_START 1527955023824
BK_STOP 1527955257075
--------------------
content from stderr:
Prefix is 65b80f64.
Reading known information in /usr/share/mcc4mcc/65b80f64-known.json.
Reading learned information in /usr/share/mcc4mcc/65b80f64-learned.json.
Reading value translations in /usr/share/mcc4mcc/65b80f64-values.json.
Using directory /home/mcc/execution for input, as it contains a model.pnml file.
Using Raft-PT-08 as instance name.
Using Raft as model name.
Using algorithm or tool voting-classifier.
Model characteristics are: {'Examination': 'CTLFireability', 'Place/Transition': True, 'Colored': False, 'Relative-Time': 1, 'Relative-Memory': 1, 'Ordinary': True, 'Simple Free Choice': False, 'Extended Free Choice': False, 'State Machine': False, 'Marked Graph': False, 'Connected': True, 'Strongly Connected': False, 'Source Place': True, 'Sink Place': False, 'Source Transition': False, 'Sink Transition': True, 'Loop Free': False, 'Conservative': False, 'Sub-Conservative': False, 'Nested Units': True, 'Safe': True, 'Deadlock': None, 'Reversible': None, 'Quasi Live': None, 'Live': None}.
/usr/local/lib/python3.6/dist-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty.
if diff:
Known tools are: [{'Time': 72875, 'Memory': 2337.54, 'Tool': 'itstools'}, {'Time': 83912, 'Memory': 2307.33, 'Tool': 'itstools'}, {'Time': 142509, 'Memory': 3212.99, 'Tool': 'marcie'}, {'Time': 166918, 'Memory': 3212.98, 'Tool': 'marcie'}, {'Time': 1816711, 'Memory': 15952.07, 'Tool': 'lola'}, {'Time': 1820936, 'Memory': 15952.64, 'Tool': 'lola'}].
Learned tools are: [{'Tool': 'lola'}].
Learned tool lola is 24.929138936535164x far from the best tool itstools.
CTLFireability lola Raft-PT-08...
----- Start make prepare stderr -----
Time: 3600 - MCC
----- Start make prepare stdout -----
===========================================================================================
Raft-PT-08: translating PT Petri net model.pnml into LoLA format
===========================================================================================
translating PT Petri net complete
checking for too many tokens
===========================================================================================
Raft-PT-08: translating PT formula CTLFireability into LoLA format
===========================================================================================
translating formula complete
touch formulae;
----- Start make result stdout -----
----- Start make result stderr -----
CTLFireability @ Raft-PT-08 @ 3538 seconds
Makefile:222: recipe for target 'verify' failed
----- Start make result stdout -----
make: [verify] Error 134 (ignored)
----- Start make result stderr -----
lola: LoLA will run for 3538 seconds at most (--timelimit)
lola: NET
lola: reading net from model.pnml.lola
lola: finished parsing
lola: closed net file model.pnml.lola
lola: 896/65536 symbol table entries, 0 collisions
lola: preprocessing...
lola: finding significant places
lola: 328 places, 568 transitions, 264 significant places
lola: computing forward-conflicting sets
lola: computing back-conflicting sets
lola: 559 transition conflict sets
lola: TASK
lola: reading formula from Raft-PT-08-CTLFireability.task
lola: E (F (A (F (A (G (FIREABLE(t338))))))) : (A (F (E (X (NOT FIREABLE(t348))))) AND A ((NOT FIREABLE(t20) U E (F (FIREABLE(t2)))))) : E ((NOT(E (G (FIREABLE(t562)))) U ((FIREABLE(t513) OR FIREABLE(t21) OR NOT FIREABLE(t247)) AND A (G (FIREABLE(t475)))))) : E ((E (X ((FIREABLE(t311) AND FIREABLE(t217)))) U (((FIREABLE(t385) AND FIREABLE(t10)) OR (FIREABLE(t38) AND FIREABLE(t73))) AND FIREABLE(t167)))) : (FIREABLE(t271) OR NOT(E (F (FIREABLE(t26))))) : (E (F ((A (F (FIREABLE(t38))) OR FIREABLE(t80)))) OR FIREABLE(t126)) : (E (F (E (G ((FIREABLE(t547) AND FIREABLE(t311)))))) OR ((E (X (NOT FIREABLE(t454))) OR (A (G (FIREABLE(t13))) AND (NOT FIREABLE(t376) AND FIREABLE(t147)))) AND A ((FIREABLE(t229) U FIREABLE(t399))))) : ((((E (F (FIREABLE(t178))) AND FIREABLE(t245)) AND A (X (NOT FIREABLE(t516)))) OR (NOT FIREABLE(t10) AND (A (F (FIREABLE(t184))) AND (FIREABLE(t364) AND NOT FIREABLE(t101))))) OR E ((A (F (FIREABLE(t412))) U A (G (FIREABLE(t198)))))) : (NOT(A (G ((NOT FIREABLE(t452) OR NOT FIREABLE(t550))))) AND (E ((NOT FIREABLE(t396) U (FIREABLE(t298) AND FIREABLE(t413)))) OR (((FIREABLE(t409) AND FIREABLE(t271)) OR FIREABLE(t513) OR FIREABLE(t430) OR FIREABLE(t557) OR (FIREABLE(t450) AND FIREABLE(t436))) AND FIREABLE(t375)))) : E (F (E (G (FIREABLE(t555))))) : E (F (E (X (A (X (FIREABLE(t477))))))) : (((FIREABLE(t392) AND FIREABLE(t529)) OR FIREABLE(t325)) OR (A (G (E (F (FIREABLE(t341))))) AND ((A (X (FIREABLE(t152))) OR (FIREABLE(t557) AND FIREABLE(t279) AND (FIREABLE(t227) OR FIREABLE(t167)))) AND NOT(E (X (FIREABLE(t487))))))) : (FIREABLE(t234) AND E (G (NOT(E (F (FIREABLE(t365))))))) : E ((FIREABLE(t84) U E (G ((FIREABLE(t329) OR FIREABLE(t453)))))) : NOT(E (G (A ((FIREABLE(t169) U FIREABLE(t527)))))) : ((FIREABLE(t154) OR ((FIREABLE(t391) OR A (F (FIREABLE(t432)))) OR FIREABLE(t553))) AND E (G (FIREABLE(t501))))
lola: computing a collection of formulas
lola: RUNNING
lola: subprocess 0 will run for 221 seconds at most (--localtimelimit=-1)
lola: ========================================
lola: ...considering subproblem: E (F (A (F (A (G (FIREABLE(t338)))))))
lola: ========================================
lola: SUBTASK
lola: checking CTL
lola: processed formula: E(TRUE U A(TRUE U NOT(E(TRUE U NOT FIREABLE(t338)))))
lola: processed formula length: 53
lola: 4 rewrites
lola: formula mentions 0 of 328 places; total mentions: 0
lola: closed formula file Raft-PT-08-CTLFireability.task
lola: STORE
lola: using a bit-perfect encoder (--encoder=bit)
lola: using 36 bytes per marking, with 24 unused bits
lola: using a prefix tree store (--store=prefix)
lola: Using CTL preserving stubborn sets
lola: RUNNING
lola: CTL formula contains 3 significant temporal operators and needs 13 bytes of payload
lola: Ignoring fairness constraints (--fair).
lola: 308629 markings, 1853148 edges, 3689348869717491712 markings/sec, 0 secs
lola: 623881 markings, 3751070 edges, 63050 markings/sec, 5 secs
lola: 928270 markings, 5582487 edges, 60878 markings/sec, 10 secs
lola: 1232854 markings, 7416663 edges, 60917 markings/sec, 15 secs
lola: 1535955 markings, 9243033 edges, 60620 markings/sec, 20 secs
lola: 1833757 markings, 11033464 edges, 59560 markings/sec, 25 secs
lola: 2135327 markings, 12852039 edges, 60314 markings/sec, 30 secs
lola: 2431942 markings, 14640977 edges, 59323 markings/sec, 35 secs
lola: 2726518 markings, 16414912 edges, 58915 markings/sec, 40 secs
lola: 3026996 markings, 18222956 edges, 60096 markings/sec, 45 secs
lola: 3335705 markings, 20079513 edges, 61742 markings/sec, 50 secs
lola: 3642306 markings, 21921840 edges, 61320 markings/sec, 55 secs
lola: 3947307 markings, 23756459 edges, 61000 markings/sec, 60 secs
lola: 4247557 markings, 25564954 edges, 60050 markings/sec, 65 secs
lola: 4544940 markings, 27353772 edges, 59477 markings/sec, 70 secs
lola: 4838801 markings, 29121897 edges, 58772 markings/sec, 75 secs
lola: 5124814 markings, 30847397 edges, 57203 markings/sec, 80 secs
lola: 5406952 markings, 32544748 edges, 56428 markings/sec, 85 secs
lola: 5695540 markings, 34280453 edges, 57718 markings/sec, 90 secs
lola: 5984306 markings, 36015508 edges, 57753 markings/sec, 95 secs
lola: 6288685 markings, 37851795 edges, 60876 markings/sec, 100 secs
lola: 6591288 markings, 39669055 edges, 60521 markings/sec, 105 secs
lola: 6888147 markings, 41454772 edges, 59372 markings/sec, 110 secs
lola: 7185616 markings, 43244713 edges, 59494 markings/sec, 115 secs
lola: 7476778 markings, 44996420 edges, 58232 markings/sec, 120 secs
lola: 7769843 markings, 46761081 edges, 58613 markings/sec, 125 secs
lola: 8048262 markings, 48435625 edges, 55684 markings/sec, 130 secs
lola: 8324992 markings, 50097926 edges, 55346 markings/sec, 135 secs
lola: 8608468 markings, 51806016 edges, 56695 markings/sec, 140 secs
lola: 8903613 markings, 53581117 edges, 59029 markings/sec, 145 secs
lola: 9198180 markings, 55356412 edges, 58913 markings/sec, 150 secs
lola: 9492823 markings, 57125720 edges, 58929 markings/sec, 155 secs
lola: 9798620 markings, 58964162 edges, 61159 markings/sec, 160 secs
lola: 10084039 markings, 60682537 edges, 57084 markings/sec, 165 secs
lola: 10378048 markings, 62451069 edges, 58802 markings/sec, 170 secs
lola: 10673936 markings, 64234326 edges, 59178 markings/sec, 175 secs
lola: 10966806 markings, 65996409 edges, 58574 markings/sec, 180 secs
lola: 11255021 markings, 67728198 edges, 57643 markings/sec, 185 secs
lola: 11539839 markings, 69443065 edges, 56964 markings/sec, 190 secs
lola: 11827128 markings, 71172536 edges, 57458 markings/sec, 195 secs
lola: 12117063 markings, 72915166 edges, 57987 markings/sec, 200 secs
lola: 12402288 markings, 74634927 edges, 57045 markings/sec, 205 secs
lola: 12693888 markings, 76387305 edges, 58320 markings/sec, 210 secs
lola: 12983480 markings, 78130137 edges, 57918 markings/sec, 215 secs
lola: local time limit reached - aborting
lola: Child process aborted or communication problem between parent and child process
terminate called after throwing an instance of 'std::runtime_error'
what(): parse error at position 0: unexpected character, last read: '\ufffd'
Aborted (core dumped)
FORMULA Raft-PT-08-CTLFireability-0 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-1 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-2 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-3 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-4 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-5 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-6 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-7 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-8 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-9 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-10 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-11 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-12 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-13 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-14 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA Raft-PT-08-CTLFireability-15 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
----- Kill lola and sara stdout -----
----- Kill lola and sara stderr -----
----- Finished stdout -----
----- Finished stderr -----
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="Raft-PT-08"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="mcc4mcc-full"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
tar xzf /home/mcc/BenchKit/INPUTS/Raft-PT-08.tgz
mv Raft-PT-08 execution
cd execution
pwd
ls -lh
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-3637"
echo " Executing tool mcc4mcc-full"
echo " Input is Raft-PT-08, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r142-qhx2-152673583700151"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;