About the Execution of Irma.full for AutoFlight-PT-96b
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
1215.920 | 235729.00 | 262037.00 | 4875.30 | ???????????????? | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Waiting for the VM to be ready (probing ssh)
...................................................................................................................................................................................................
/home/mcc/execution
total 2.1M
-rw-r--r-- 1 mcc users 3.6K May 15 18:54 CTLCardinality.txt
-rw-r--r-- 1 mcc users 20K May 15 18:54 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.2K May 15 18:54 CTLFireability.txt
-rw-r--r-- 1 mcc users 13K May 15 18:54 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K May 15 18:49 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.2K May 15 18:49 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 2.2K May 15 18:54 LTLCardinality.txt
-rw-r--r-- 1 mcc users 9.5K May 15 18:54 LTLCardinality.xml
-rw-r--r-- 1 mcc users 1.9K May 15 18:54 LTLFireability.txt
-rw-r--r-- 1 mcc users 9.3K May 15 18:54 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.2K May 15 18:54 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 15K May 15 18:54 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 108 May 15 18:54 ReachabilityDeadlock.txt
-rw-r--r-- 1 mcc users 346 May 15 18:54 ReachabilityDeadlock.xml
-rw-r--r-- 1 mcc users 2.7K May 15 18:54 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 16K May 15 18:54 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K May 15 18:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K May 15 18:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 15 18:49 equiv_col
-rw-r--r-- 1 mcc users 4 May 15 18:49 instance
-rw-r--r-- 1 mcc users 6 May 15 18:49 iscolored
-rw-r--r-- 1 mcc users 1.9M May 15 18:49 model.pnml
=====================================================================
Generated by BenchKit 2-3637
Executing tool irma4mcc-full
Input is AutoFlight-PT-96b, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r018-qhx1-152646242900186
=====================================================================
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-00
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-01
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-02
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-03
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-04
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-05
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-06
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-07
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-08
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-09
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-10
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-11
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-12
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-13
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-14
FORMULA_NAME AutoFlight-PT-96b-CTLFireability-15
=== Now, execution of the tool begins
BK_START 1526776105946
BK_STOP 1526776341675
--------------------
content from stderr:
Prefix is 65b80f64.
Reading known information in /usr/share/mcc4mcc/65b80f64-known.json.
Reading learned information in /usr/share/mcc4mcc/65b80f64-learned.json.
Reading value translations in /usr/share/mcc4mcc/65b80f64-values.json.
Using directory /home/mcc/execution for input, as it contains a model.pnml file.
Using AutoFlight-PT-96b as instance name.
Using AutoFlight as model name.
Using algorithm or tool voting-classifier.
Model characteristics are: {'Examination': 'CTLFireability', 'Place/Transition': True, 'Colored': False, 'Relative-Time': 1, 'Relative-Memory': 1, 'Ordinary': True, 'Simple Free Choice': False, 'Extended Free Choice': False, 'State Machine': False, 'Marked Graph': False, 'Connected': True, 'Strongly Connected': False, 'Source Place': True, 'Sink Place': False, 'Source Transition': False, 'Sink Transition': False, 'Loop Free': None, 'Conservative': False, 'Sub-Conservative': False, 'Nested Units': True, 'Safe': True, 'Deadlock': None, 'Reversible': None, 'Quasi Live': None, 'Live': None}.
/usr/local/lib/python3.6/dist-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty.
if diff:
Known tools are: [{'Time': 3539530, 'Memory': 5011.79, 'Tool': 'lola'}, {'Time': 3539818, 'Memory': 5084.15, 'Tool': 'lola'}].
Learned tools are: [{'Tool': 'lola'}].
Learned tool lola is 1.0x far from the best tool lola.
CTLFireability lola AutoFlight-PT-96b...
Time: 3600 - MCC
----- Start make prepare stdout -----
----- Start make prepare stderr -----
===========================================================================================
AutoFlight-PT-96b: translating PT Petri net model.pnml into LoLA format
===========================================================================================
translating PT Petri net complete
checking for too many tokens
===========================================================================================
AutoFlight-PT-96b: translating PT formula CTLFireability into LoLA format
===========================================================================================
translating formula complete
touch formulae;
----- Start make result stdout -----
----- Start make result stderr -----
CTLFireability @ AutoFlight-PT-96b @ 3538 seconds
Makefile:222: recipe for target 'verify' failed
----- Start make result stdout -----
make: [verify] Error 134 (ignored)
----- Start make result stderr -----
lola: LoLA will run for 3538 seconds at most (--timelimit)
lola: NET
lola: reading net from model.pnml.lola
lola: finished parsing
lola: closed net file model.pnml.lola
lola: 15762/65536 symbol table entries, 5176 collisions
lola: preprocessing...
lola: finding significant places
lola: 7894 places, 7868 transitions, 7380 significant places
lola: computing forward-conflicting sets
lola: computing back-conflicting sets
lola: 8694 transition conflict sets
lola: TASK
lola: reading formula from AutoFlight-PT-96b-CTLFireability.task
lola: (A (F (E ((FIREABLE(t327) U FIREABLE(t3025))))) OR (E (((FIREABLE(t728) AND FIREABLE(t6651)) U NOT FIREABLE(t1466))) AND NOT(((NOT FIREABLE(t3094) OR NOT FIREABLE(t6695)) OR A (X (FIREABLE(t3996))))))) : A (F ((FIREABLE(t3481) AND E (X ((FIREABLE(t2118) OR FIREABLE(t2289))))))) : A (F (NOT(NOT(A (F (FIREABLE(t7572))))))) : A (F (E (F ((FIREABLE(t6873) AND FIREABLE(t5129) AND FIREABLE(t3596) AND FIREABLE(t4750)))))) : A (F (FIREABLE(t4026))) : A (G (E (F ((NOT FIREABLE(t1052) AND NOT FIREABLE(t719)))))) : NOT((A (X (FIREABLE(t1942))) OR A (F (E (X (FIREABLE(t6013))))))) : NOT(E (G ((FIREABLE(t4383) OR A (F (FIREABLE(t7634))))))) : NOT(E (G (NOT FIREABLE(t3212)))) : E (F ((FIREABLE(t999) AND FIREABLE(t3671) AND (FIREABLE(t3914) OR (NOT FIREABLE(t4726) AND NOT FIREABLE(t3190)))))) : A (X (E (F (E (X (FIREABLE(t4708))))))) : NOT(E (F (E (F ((FIREABLE(t5096) OR FIREABLE(t366))))))) : NOT(NOT(A ((NOT FIREABLE(t1892) U (FIREABLE(t2993) OR FIREABLE(t4971)))))) : A ((A (F (NOT FIREABLE(t6279))) U A ((FIREABLE(t5637) U FIREABLE(t646))))) : A (G ((E (X (FIREABLE(t7580))) OR NOT(A (G (FIREABLE(t269))))))) : E (G (A (F ((NOT FIREABLE(t6056) AND NOT FIREABLE(t5768))))))
lola: computing a collection of formulas
lola: RUNNING
lola: subprocess 0 will run for 221 seconds at most (--localtimelimit=-1)
lola: ========================================
lola: ...considering subproblem: (A (F (E ((FIREABLE(t327) U FIREABLE(t3025))))) OR (E (((FIREABLE(t728) AND FIREABLE(t6651)) U NOT FIREABLE(t1466))) AND NOT(((NOT FIREABLE(t3094) OR NOT FIREABLE(t6695)) OR A (X (FIREABLE(t3996)))))))
lola: ========================================
lola: SUBTASK
lola: checking a Boolean combination of formulas
lola: RUNNING
lola: subprocess 0 will run for 221 seconds at most (--localtimelimit=-1)
lola: ========================================
lola: ...considering subproblem: A (F (E ((FIREABLE(t327) U FIREABLE(t3025)))))
lola: ========================================
lola: SUBTASK
lola: checking CTL
lola: processed formula: A(TRUE U E(FIREABLE(t327) U FIREABLE(t3025)))
lola: processed formula length: 45
lola: 7 rewrites
lola: formula mentions 0 of 7894 places; total mentions: 0
lola: closed formula file AutoFlight-PT-96b-CTLFireability.task
lola: STORE
lola: using a bit-perfect encoder (--encoder=bit)
lola: using 924 bytes per marking, with 12 unused bits
lola: using a prefix tree store (--store=prefix)
lola: Using CTL preserving stubborn sets
lola: RUNNING
lola: CTL formula contains 2 significant temporal operators and needs 9 bytes of payload
lola: Ignoring fairness constraints (--fair).
lola: 62629 markings, 206076 edges, 12526 markings/sec, 0 secs
lola: 120613 markings, 415573 edges, 11597 markings/sec, 5 secs
lola: 177672 markings, 624256 edges, 11412 markings/sec, 10 secs
lola: 229834 markings, 833511 edges, 10432 markings/sec, 15 secs
lola: 286737 markings, 1054432 edges, 11381 markings/sec, 20 secs
lola: 343411 markings, 1278107 edges, 11335 markings/sec, 25 secs
lola: 399230 markings, 1502470 edges, 11164 markings/sec, 30 secs
lola: 452342 markings, 1725993 edges, 10622 markings/sec, 35 secs
lola: 505953 markings, 1953208 edges, 10722 markings/sec, 40 secs
lola: 563480 markings, 2182755 edges, 11505 markings/sec, 45 secs
lola: 618234 markings, 2412769 edges, 10951 markings/sec, 50 secs
lola: 675643 markings, 2641911 edges, 11482 markings/sec, 55 secs
lola: 731682 markings, 2871025 edges, 11208 markings/sec, 60 secs
lola: 784885 markings, 3100783 edges, 10641 markings/sec, 65 secs
lola: 839221 markings, 3329961 edges, 10867 markings/sec, 70 secs
lola: 891085 markings, 3559397 edges, 10373 markings/sec, 75 secs
lola: 938918 markings, 3787118 edges, 9567 markings/sec, 80 secs
lola: 988990 markings, 4016793 edges, 10014 markings/sec, 85 secs
lola: 1047773 markings, 4246342 edges, 11757 markings/sec, 90 secs
lola: 1106045 markings, 4476241 edges, 11654 markings/sec, 95 secs
lola: 1161283 markings, 4704346 edges, 11048 markings/sec, 100 secs
lola: 1212043 markings, 4934098 edges, 10152 markings/sec, 105 secs
lola: 1267062 markings, 5164910 edges, 11004 markings/sec, 110 secs
lola: 1320813 markings, 5395070 edges, 10750 markings/sec, 115 secs
lola: 1372977 markings, 5625502 edges, 10433 markings/sec, 120 secs
lola: 1421514 markings, 5854765 edges, 9707 markings/sec, 125 secs
lola: 1472499 markings, 6084730 edges, 10197 markings/sec, 130 secs
lola: 1525205 markings, 6314613 edges, 10541 markings/sec, 135 secs
lola: 1575922 markings, 6544600 edges, 10143 markings/sec, 140 secs
lola: 1628667 markings, 6775055 edges, 10549 markings/sec, 145 secs
lola: 1679472 markings, 7004783 edges, 10161 markings/sec, 150 secs
lola: 1730448 markings, 7234697 edges, 10195 markings/sec, 155 secs
lola: 1780274 markings, 7464503 edges, 9965 markings/sec, 160 secs
lola: 1826591 markings, 7693061 edges, 9263 markings/sec, 165 secs
lola: 1874517 markings, 7921323 edges, 9585 markings/sec, 170 secs
lola: 1915898 markings, 8151653 edges, 8276 markings/sec, 175 secs
lola: 1972205 markings, 8380830 edges, 11261 markings/sec, 180 secs
lola: 2030627 markings, 8610545 edges, 11684 markings/sec, 185 secs
lola: 2087661 markings, 8839791 edges, 11407 markings/sec, 190 secs
lola: 2141443 markings, 9069878 edges, 10756 markings/sec, 195 secs
lola: 2193763 markings, 9300065 edges, 10464 markings/sec, 200 secs
lola: 2247658 markings, 9529146 edges, 10779 markings/sec, 205 secs
lola: 2300908 markings, 9759014 edges, 10650 markings/sec, 210 secs
lola: 2351271 markings, 9987949 edges, 10073 markings/sec, 215 secs
lola: local time limit reached - aborting
lola: caught signal User defined signal 1 - aborting LoLA
lola: Child process aborted or communication problem between parent and child process
terminate called after throwing an instance of 'std::runtime_error'
what(): parse error at position 0: unexpected character, last read: '
Aborted (core dumped)
FORMULA AutoFlight-PT-96b-CTLFireability-0 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-1 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-2 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-3 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-4 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-5 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-6 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-7 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-8 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-9 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-10 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-11 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-12 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-13 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-14 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA AutoFlight-PT-96b-CTLFireability-15 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
----- Kill lola and sara stderr -----
----- Kill lola and sara stdout -----
----- Finished stderr -----
----- Finished stdout -----
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AutoFlight-PT-96b"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="irma4mcc-full"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
tar xzf /home/mcc/BenchKit/INPUTS/AutoFlight-PT-96b.tgz
mv AutoFlight-PT-96b execution
cd execution
pwd
ls -lh
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-3637"
echo " Executing tool irma4mcc-full"
echo " Input is AutoFlight-PT-96b, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r018-qhx1-152646242900186"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;