fond
Model Checking Contest 2018
8th edition, Bratislava, Slovakia, June 26, 2018
Execution of r150-smll-152685548800046
Last Updated
June 26, 2018

About the Execution of Irma.full for RobotManipulation-PT-00100

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
10843.780 303390.00 263419.00 1306.90 ???????????????? normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Waiting for the VM to be ready (probing ssh)
...................
/home/mcc/execution
total 180K
-rw-r--r-- 1 mcc users 3.7K May 15 18:54 CTLCardinality.txt
-rw-r--r-- 1 mcc users 20K May 15 18:54 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.8K May 15 18:54 CTLFireability.txt
-rw-r--r-- 1 mcc users 16K May 15 18:54 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K May 15 18:50 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.2K May 15 18:50 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 2.5K May 15 18:54 LTLCardinality.txt
-rw-r--r-- 1 mcc users 9.7K May 15 18:54 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.1K May 15 18:54 LTLFireability.txt
-rw-r--r-- 1 mcc users 9.0K May 15 18:54 LTLFireability.xml
-rw-r--r-- 1 mcc users 4.4K May 15 18:54 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 23K May 15 18:54 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 117 May 15 18:54 ReachabilityDeadlock.txt
-rw-r--r-- 1 mcc users 355 May 15 18:54 ReachabilityDeadlock.xml
-rw-r--r-- 1 mcc users 3.1K May 15 18:54 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 18K May 15 18:54 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.8K May 15 18:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.8K May 15 18:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 15 18:50 equiv_col
-rw-r--r-- 1 mcc users 6 May 15 18:50 instance
-rw-r--r-- 1 mcc users 6 May 15 18:50 iscolored
-rw-r--r-- 1 mcc users 6.4K May 15 18:50 model.pnml
=====================================================================
Generated by BenchKit 2-3637
Executing tool irma4mcc-full
Input is RobotManipulation-PT-00100, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r150-smll-152685548800046
=====================================================================


--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-00
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-01
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-02
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-03
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-04
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-05
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-06
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-07
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-08
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-09
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-10
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-11
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-12
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-13
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-14
FORMULA_NAME RobotManipulation-PT-00100-CTLFireability-15

=== Now, execution of the tool begins

BK_START 1526897672506


BK_STOP 1526897975896

--------------------
content from stderr:

Prefix is 65b80f64.
Reading known information in /usr/share/mcc4mcc/65b80f64-known.json.
Reading learned information in /usr/share/mcc4mcc/65b80f64-learned.json.
Reading value translations in /usr/share/mcc4mcc/65b80f64-values.json.
Using directory /home/mcc/execution for input, as it contains a model.pnml file.
Using RobotManipulation-PT-00100 as instance name.
Using RobotManipulation as model name.
Using algorithm or tool voting-classifier.
Model characteristics are: {'Examination': 'CTLFireability', 'Place/Transition': True, 'Colored': False, 'Relative-Time': 1, 'Relative-Memory': 1, 'Ordinary': True, 'Simple Free Choice': False, 'Extended Free Choice': False, 'State Machine': False, 'Marked Graph': False, 'Connected': True, 'Strongly Connected': True, 'Source Place': False, 'Sink Place': False, 'Source Transition': False, 'Sink Transition': False, 'Loop Free': True, 'Conservative': False, 'Sub-Conservative': False, 'Nested Units': False, 'Safe': False, 'Deadlock': False, 'Reversible': True, 'Quasi Live': True, 'Live': True}.
/usr/local/lib/python3.6/dist-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty.
if diff:
Known tools are: [{'Time': 585921, 'Memory': 15936.41, 'Tool': 'lola'}].
Learned tools are: [{'Tool': 'lola'}].
Learned tool lola is 1.0x far from the best tool lola.
CTLFireability lola RobotManipulation-PT-00100...

Time: 3600 - MCC
----- Start make prepare stdout -----
----- Start make prepare stderr -----
===========================================================================================
RobotManipulation-PT-00100: translating PT Petri net model.pnml into LoLA format
===========================================================================================
translating PT Petri net complete


checking for too many tokens
===========================================================================================
RobotManipulation-PT-00100: translating PT formula CTLFireability into LoLA format
===========================================================================================
translating formula complete
touch formulae;
----- Start make result stderr -----
----- Start make result stdout -----
CTLFireability @ RobotManipulation-PT-00100 @ 3539 seconds
make: [verify] Error 2 (ignored)
Makefile:222: recipe for target 'verify' failed
----- Start make result stdout -----
----- Start make result stderr -----
lola: LoLA will run for 3539 seconds at most (--timelimit)
lola: NET
lola: reading net from model.pnml.lola
lola: finished parsing
lola: closed net file model.pnml.lola
lola: 26/65536 symbol table entries, 0 collisions
lola: preprocessing...
lola: finding significant places
lola: 15 places, 11 transitions, 9 significant places
lola: computing forward-conflicting sets
lola: computing back-conflicting sets
lola: 14 transition conflict sets
lola: TASK
lola: reading formula from RobotManipulation-PT-00100-CTLFireability.task
lola: ((FIREABLE(p_intoSC) OR A (G (E (F (FIREABLE(p_moved)))))) OR ((NOT FIREABLE(r_end_move) OR NOT FIREABLE(p_sop) OR (FIREABLE(r_starts) AND FIREABLE(p_started)) OR NOT FIREABLE(p_start) OR NOT FIREABLE(p_move) OR NOT FIREABLE(p_start) OR (NOT FIREABLE(r_starts) AND NOT FIREABLE(p_started))) AND A (F (FIREABLE(r_stops))))) : A (F (FIREABLE(p_sop))) : A ((FIREABLE(p_start) U A (F ((FIREABLE(p_sop) OR FIREABLE(r_end_move)))))) : E ((() U (A (G (FIREABLE(r_stops))) OR A (G (FIREABLE(p_started)))))) : E (F ((FIREABLE(p_moved) AND A (G (FIREABLE(p_sop)))))) : E (F (A (X ((FIREABLE(p_moved) AND FIREABLE(p_relSC) AND FIREABLE(p_move) AND FIREABLE(p_intoSC)))))) : (A (F (E ((FIREABLE(p_sop) U FIREABLE(p_move))))) AND NOT(A (X (E (G (FIREABLE(r_stops))))))) : E (X ((A (G ((FIREABLE(p_moved) OR FIREABLE(p_start)))) OR E (X (NOT FIREABLE(p_start)))))) : ((FIREABLE(p_move) OR A ((NOT FIREABLE(p_move) U FIREABLE(p_intoSC)))) AND E (F (FIREABLE(p_intoSC)))) : (E (G (E (G (NOT FIREABLE(p_started))))) AND (E (G ((FIREABLE(r_begin_move) OR FIREABLE(r_starts) OR FIREABLE(p_started)))) OR E (F (FIREABLE(p_start))))) : E (F (E (((FIREABLE(r_stops) OR FIREABLE(p_moved)) U NOT FIREABLE(p_start))))) : A (F (FIREABLE(p_sop))) : NOT(NOT(A (F ((FIREABLE(p_sop) OR FIREABLE(p_moved) OR (FIREABLE(p_moved) AND FIREABLE(r_stops))))))) : NOT(A (G (NOT(A (G (FIREABLE(p_move))))))) : A (G (E (G ((FIREABLE(p_sop) OR FIREABLE(r_starts) OR FIREABLE(p_start)))))) : A (((E (F (FIREABLE(p_move))) OR A (F (FIREABLE(r_starts)))) U FIREABLE(p_intoSC)))
lola: computing a collection of formulas
lola: RUNNING
lola: subprocess 0 will run for 221 seconds at most (--localtimelimit=-1)
lola: ========================================
lola: ...considering subproblem: ((FIREABLE(p_intoSC) OR A (G (E (F (FIREABLE(p_moved)))))) OR ((NOT FIREABLE(r_end_move) OR NOT FIREABLE(p_sop) OR (FIREABLE(r_starts) AND FIREABLE(p_started)) OR NOT FIREABLE(p_start) OR NOT FIREABLE(p_move) OR NOT FIREABLE(p_start) OR (NOT FIREABLE(r_starts) AND NOT FIREABLE(p_started))) AND A (F (FIREABLE(r_stops)))))
lola: ========================================
lola: SUBTASK
lola: checking a Boolean combination of formulas
lola: RUNNING
lola: subprocess 0 will run for 221 seconds at most (--localtimelimit=-1)
lola: ========================================
lola: ...considering subproblem: FIREABLE(p_intoSC)
lola: ========================================
lola: SUBTASK
lola: checking initial satisfaction
lola: processed formula: FIREABLE(p_intoSC)
lola: processed formula length: 18
lola: 1 rewrites
lola: formula mentions 0 of 15 places; total mentions: 0
lola: closed formula file RobotManipulation-PT-00100-CTLFireability.task
lola: processed formula with 0 atomic propositions
lola: RUNNING
lola: SUBRESULT
lola: result: no
lola: produced by: preprocessing
lola: The net violates the given property already in its initial state.
lola: 0 markings, 0 edges
lola: ========================================
lola: subprocess 1 will run for 235 seconds at most (--localtimelimit=-1)
lola: ========================================
lola: ...considering subproblem: A (G (E (F (FIREABLE(p_moved)))))
lola: ========================================
lola: SUBTASK
lola: checking liveness
lola: liveness not yet implemented, converting to CTL...
lola: processed formula: NOT(E(TRUE U NOT(E(TRUE U FIREABLE(p_moved)))))
lola: processed formula length: 47
lola: 3 rewrites
lola: formula mentions 0 of 15 places; total mentions: 0
lola: closed formula file RobotManipulation-PT-00100-CTLFireability.task
lola: STORE
lola: using a bit-perfect encoder (--encoder=bit)
lola: using 36 bytes per marking, with 0 unused bits
lola: using a prefix tree store (--store=prefix)
lola: Using CTL preserving stubborn sets
lola: RUNNING
lola: CTL formula contains 2 significant temporal operators and needs 9 bytes of payload
lola: Ignoring fairness constraints (--fair).
lola: 1928673 markings, 5762782 edges, 2011398055902838784 markings/sec, 0 secs
lola: 3841437 markings, 11398908 edges, 382553 markings/sec, 5 secs
lola: 5700213 markings, 16858511 edges, 371755 markings/sec, 10 secs
lola: 7527127 markings, 22225234 edges, 365383 markings/sec, 15 secs
lola: 9317372 markings, 27475557 edges, 358049 markings/sec, 20 secs
lola: 11090759 markings, 32669708 edges, 354677 markings/sec, 25 secs
lola: 12861923 markings, 37852137 edges, 354233 markings/sec, 30 secs
lola: 14607150 markings, 42965556 edges, 349045 markings/sec, 35 secs
lola: 16342315 markings, 48037063 edges, 347033 markings/sec, 40 secs
lola: 18060465 markings, 53062404 edges, 343630 markings/sec, 45 secs
lola: 19768116 markings, 58052189 edges, 341530 markings/sec, 50 secs
lola: 21473775 markings, 63043055 edges, 341132 markings/sec, 55 secs
lola: 23164220 markings, 67984328 edges, 338089 markings/sec, 60 secs
lola: 24841625 markings, 72886223 edges, 335481 markings/sec, 65 secs
lola: 26503533 markings, 77750397 edges, 332382 markings/sec, 70 secs
lola: 28181213 markings, 82646205 edges, 335536 markings/sec, 75 secs
lola: 29849325 markings, 87517327 edges, 333622 markings/sec, 80 secs
lola: 31504019 markings, 92348579 edges, 330939 markings/sec, 85 secs
lola: 33137913 markings, 97118773 edges, 326779 markings/sec, 90 secs
lola: 34798221 markings, 101963600 edges, 332062 markings/sec, 95 secs
lola: 36433219 markings, 106730134 edges, 327000 markings/sec, 100 secs
lola: 38061388 markings, 111471334 edges, 325634 markings/sec, 105 secs
lola: 39690955 markings, 116227661 edges, 325913 markings/sec, 110 secs
lola: 41310079 markings, 120949777 edges, 323825 markings/sec, 115 secs
lola: 42930685 markings, 125670021 edges, 324121 markings/sec, 120 secs
lola: 44545239 markings, 130382986 edges, 322911 markings/sec, 125 secs
lola: 46145425 markings, 135054218 edges, 320037 markings/sec, 130 secs
lola: 47740954 markings, 139706365 edges, 319106 markings/sec, 135 secs
lola: 49338047 markings, 144356870 edges, 319419 markings/sec, 140 secs
lola: 50913585 markings, 148942782 edges, 315108 markings/sec, 145 secs
lola: 52513302 markings, 153612956 edges, 319943 markings/sec, 150 secs
lola: 54087044 markings, 158190453 edges, 314748 markings/sec, 155 secs
lola: 55665603 markings, 162795638 edges, 315712 markings/sec, 160 secs
lola: 57252813 markings, 167423609 edges, 317442 markings/sec, 165 secs
lola: 58827225 markings, 172016320 edges, 314882 markings/sec, 170 secs
lola: 60399557 markings, 176597189 edges, 314466 markings/sec, 175 secs
lola: 61966617 markings, 181171149 edges, 313412 markings/sec, 180 secs
lola: 63523697 markings, 185708199 edges, 311416 markings/sec, 185 secs
lola: 65077199 markings, 190227800 edges, 310700 markings/sec, 190 secs
lola: 66626861 markings, 194737582 edges, 309932 markings/sec, 195 secs
lola: 68160247 markings, 199195453 edges, 306677 markings/sec, 200 secs
lola: 69673500 markings, 203597827 edges, 302651 markings/sec, 205 secs
lola: 71178155 markings, 207978079 edges, 300931 markings/sec, 210 secs
lola: 72685067 markings, 212368040 edges, 301382 markings/sec, 215 secs
lola: local time limit reached - aborting
lola: caught signal User defined signal 1 - aborting LoLA
lola: Child process aborted or communication problem between parent and child process
lola: memory allocation failed
lola:
preliminary result: unknown
FORMULA RobotManipulation-PT-00100-CTLFireability-0 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-1 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-2 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-3 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-4 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-5 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-6 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-7 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-8 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-9 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-10 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-11 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-12 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-13 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-14 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
FORMULA RobotManipulation-PT-00100-CTLFireability-15 CANNOT_COMPUTE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STATE_COMPRESSION STUBBORN_SETS TOPOLOGICAL USE_NUPN
----- Kill lola and sara stderr -----
----- Kill lola and sara stdout -----
----- Finished stderr -----
----- Finished stdout -----

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="RobotManipulation-PT-00100"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="irma4mcc-full"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

tar xzf /home/mcc/BenchKit/INPUTS/RobotManipulation-PT-00100.tgz
mv RobotManipulation-PT-00100 execution
cd execution
pwd
ls -lh

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-3637"
echo " Executing tool irma4mcc-full"
echo " Input is RobotManipulation-PT-00100, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r150-smll-152685548800046"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' CTLFireability.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;