fond
Model Checking Contest 2020
10th edition, Paris, France, June 23, 2020
Execution of r166-smll-158987787800479
Last Updated
Jun 28, 2020

About the Execution of ITS-LoLa for AutoFlight-PT-12b

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
15747.090 3600000.00 44229.00 453.50 FFFTTFFTTFTFFTFT normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/data/fkordon/mcc2020-input.r166-smll-158987787800479.qcow2', fmt=qcow2 size=4294967296 backing_file='/data/fkordon/mcc2020-input.qcow2' encryption=off cluster_size=65536 lazy_refcounts=off
Waiting for the VM to be ready (probing ssh)
......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-4028
Executing tool itslola
Input is AutoFlight-PT-12b, examination is ReachabilityFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r166-smll-158987787800479
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 444K
-rw-r--r-- 1 mcc users 3.4K Mar 25 23:23 CTLCardinality.txt
-rw-r--r-- 1 mcc users 19K Mar 25 23:23 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.4K Mar 25 18:35 CTLFireability.txt
-rw-r--r-- 1 mcc users 16K Mar 25 18:35 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K Mar 24 05:37 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.2K Mar 24 05:37 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 3.0K Apr 8 14:42 LTLCardinality.txt
-rw-r--r-- 1 mcc users 21K Apr 28 14:00 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.0K Apr 8 14:42 LTLFireability.txt
-rw-r--r-- 1 mcc users 18K Apr 28 14:00 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.7K Mar 25 15:04 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 19K Mar 25 15:04 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 2.8K Mar 25 10:47 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 17K Mar 25 10:47 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K Mar 25 17:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K Mar 25 17:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 Mar 24 05:37 equiv_col
-rw-r--r-- 1 mcc users 4 Mar 24 05:37 instance
-rw-r--r-- 1 mcc users 6 Mar 24 05:37 iscolored
-rw-r--r-- 1 mcc users 266K Mar 24 05:37 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-00
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-01
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-02
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-03
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-04
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-05
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-06
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-07
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-08
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-09
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-10
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-11
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-12
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-13
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-14
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-15

=== Now, execution of the tool begins

BK_START 1591504174799

bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
[2020-06-07 04:29:37] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, ReachabilityFireability, -z3path, /home/mcc/BenchKit//z3/bin/z3, -yices2path, /home/mcc/BenchKit//yices/bin/yices, -timeout, 3600, -rebuildPNML]
[2020-06-07 04:29:37] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2020-06-07 04:29:38] [INFO ] Load time of PNML (sax parser for PT used): 181 ms
[2020-06-07 04:29:38] [INFO ] Transformed 1126 places.
[2020-06-07 04:29:38] [INFO ] Transformed 1124 transitions.
[2020-06-07 04:29:38] [INFO ] Found NUPN structural information;
[2020-06-07 04:29:38] [INFO ] Parsed PT model containing 1126 places and 1124 transitions in 253 ms.
Parsed 16 properties from file /home/mcc/execution/ReachabilityFireability.xml in 76 ms.
Working with output stream class java.io.PrintStream
Incomplete random walk after 10000 steps, including 18 resets, run finished after 122 ms. (steps per millisecond=81 ) properties seen :[1, 1, 0, 1, 1, 0, 1, 0, 0, 1, 0, 0, 1, 0, 0, 1]
FORMULA AutoFlight-PT-12b-ReachabilityFireability-15 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-12 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-09 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-06 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-04 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-03 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-01 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-00 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
Incomplete Best-First random walk after 10001 steps, including 1 resets, run finished after 30 ms. (steps per millisecond=333 ) properties seen :[1, 0, 0, 0, 0, 0, 0, 0]
FORMULA AutoFlight-PT-12b-ReachabilityFireability-02 FALSE TECHNIQUES TOPOLOGICAL BESTFIRST_WALK
Incomplete Best-First random walk after 10001 steps, including 0 resets, run finished after 38 ms. (steps per millisecond=263 ) properties seen :[0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 1 resets, run finished after 32 ms. (steps per millisecond=312 ) properties seen :[0, 1, 0, 0, 0, 0, 0]
FORMULA AutoFlight-PT-12b-ReachabilityFireability-07 TRUE TECHNIQUES TOPOLOGICAL BESTFIRST_WALK
Incomplete Best-First random walk after 10001 steps, including 1 resets, run finished after 25 ms. (steps per millisecond=400 ) properties seen :[0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 1 resets, run finished after 19 ms. (steps per millisecond=526 ) properties seen :[0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 1 resets, run finished after 31 ms. (steps per millisecond=322 ) properties seen :[0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 1 resets, run finished after 15 ms. (steps per millisecond=666 ) properties seen :[0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 24 ms. (steps per millisecond=416 ) properties seen :[0, 0, 0, 0, 0, 1]
FORMULA AutoFlight-PT-12b-ReachabilityFireability-14 FALSE TECHNIQUES TOPOLOGICAL BESTFIRST_WALK
// Phase 1: matrix 1124 rows 1126 cols
[2020-06-07 04:29:38] [INFO ] Computed 76 place invariants in 45 ms
[2020-06-07 04:29:39] [INFO ] [Real]Absence check using 75 positive place invariants in 131 ms returned unsat
[2020-06-07 04:29:39] [INFO ] [Real]Absence check using 75 positive place invariants in 138 ms returned sat
[2020-06-07 04:29:39] [INFO ] [Real]Absence check using 75 positive and 1 generalized place invariants in 8 ms returned sat
[2020-06-07 04:29:39] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-07 04:29:44] [INFO ] [Real]Absence check using state equation in 4499 ms returned (error "Solver has unexpectedly terminated")
[2020-06-07 04:29:44] [INFO ] [Real]Absence check using 75 positive place invariants in 166 ms returned sat
[2020-06-07 04:29:44] [INFO ] [Real]Absence check using 75 positive and 1 generalized place invariants in 18 ms returned sat
[2020-06-07 04:29:44] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-07 04:29:49] [INFO ] [Real]Absence check using state equation in 4511 ms returned (error "Solver has unexpectedly terminated")
[2020-06-07 04:29:49] [INFO ] [Real]Absence check using 75 positive place invariants in 175 ms returned sat
[2020-06-07 04:29:49] [INFO ] [Real]Absence check using 75 positive and 1 generalized place invariants in 8 ms returned sat
[2020-06-07 04:29:49] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-07 04:29:54] [INFO ] SMT solver returned unknown. Retrying;
[2020-06-07 04:29:54] [INFO ] [Real]Absence check using state equation in 4525 ms returned (error "Failed to check-sat")
[2020-06-07 04:29:54] [INFO ] [Real]Absence check using 75 positive place invariants in 153 ms returned sat
[2020-06-07 04:29:54] [INFO ] [Real]Absence check using 75 positive and 1 generalized place invariants in 7 ms returned sat
[2020-06-07 04:29:54] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-07 04:29:59] [INFO ] SMT solver returned unknown. Retrying;
[2020-06-07 04:29:59] [INFO ] [Real]Absence check using state equation in 4558 ms returned (error "Failed to check-sat")
FORMULA AutoFlight-PT-12b-ReachabilityFireability-05 FALSE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
Support contains 15 out of 1126 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 1126/1126 places, 1124/1124 transitions.
Performed 437 Post agglomeration using F-continuation condition.Transition count delta: 437
Iterating post reduction 0 with 437 rules applied. Total rules applied 437 place count 1126 transition count 687
Reduce places removed 437 places and 0 transitions.
Ensure Unique test removed 59 transitions
Reduce isomorphic transitions removed 59 transitions.
Performed 23 Post agglomeration using F-continuation condition.Transition count delta: 23
Iterating post reduction 1 with 519 rules applied. Total rules applied 956 place count 689 transition count 605
Reduce places removed 23 places and 0 transitions.
Iterating post reduction 2 with 23 rules applied. Total rules applied 979 place count 666 transition count 605
Performed 145 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 3 with 145 Pre rules applied. Total rules applied 979 place count 666 transition count 460
Deduced a syphon composed of 145 places in 4 ms
Reduce places removed 145 places and 0 transitions.
Iterating global reduction 3 with 290 rules applied. Total rules applied 1269 place count 521 transition count 460
Symmetric choice reduction at 3 with 115 rule applications. Total rules 1384 place count 521 transition count 460
Deduced a syphon composed of 115 places in 3 ms
Reduce places removed 115 places and 115 transitions.
Iterating global reduction 3 with 230 rules applied. Total rules applied 1614 place count 406 transition count 345
Performed 34 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 3 with 34 Pre rules applied. Total rules applied 1614 place count 406 transition count 311
Deduced a syphon composed of 34 places in 3 ms
Reduce places removed 34 places and 0 transitions.
Iterating global reduction 3 with 68 rules applied. Total rules applied 1682 place count 372 transition count 311
Performed 88 Post agglomeration using F-continuation condition.Transition count delta: 88
Deduced a syphon composed of 88 places in 0 ms
Reduce places removed 88 places and 0 transitions.
Iterating global reduction 3 with 176 rules applied. Total rules applied 1858 place count 284 transition count 223
Free-agglomeration rule applied 47 times.
Iterating global reduction 3 with 47 rules applied. Total rules applied 1905 place count 284 transition count 176
Reduce places removed 47 places and 0 transitions.
Iterating post reduction 3 with 47 rules applied. Total rules applied 1952 place count 237 transition count 176
Partial Post-agglomeration rule applied 1 times.
Drop transitions removed 1 transitions
Iterating global reduction 4 with 1 rules applied. Total rules applied 1953 place count 237 transition count 176
Reduce places removed 1 places and 1 transitions.
Iterating global reduction 4 with 1 rules applied. Total rules applied 1954 place count 236 transition count 175
Reduce places removed 28 places and 0 transitions.
Performed 23 Post agglomeration using F-continuation condition.Transition count delta: 23
Iterating post reduction 4 with 51 rules applied. Total rules applied 2005 place count 208 transition count 152
Reduce places removed 23 places and 0 transitions.
Iterating post reduction 5 with 23 rules applied. Total rules applied 2028 place count 185 transition count 152
Performed 17 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 6 with 17 Pre rules applied. Total rules applied 2028 place count 185 transition count 135
Deduced a syphon composed of 17 places in 0 ms
Reduce places removed 17 places and 0 transitions.
Iterating global reduction 6 with 34 rules applied. Total rules applied 2062 place count 168 transition count 135
Applied a total of 2062 rules in 423 ms. Remains 168 /1126 variables (removed 958) and now considering 135/1124 (removed 989) transitions.
Finished structural reductions, in 1 iterations. Remains : 168/1126 places, 135/1124 transitions.
Incomplete random walk after 1000000 steps, including 13865 resets, run finished after 3254 ms. (steps per millisecond=307 ) properties seen :[1, 0, 1, 1]
FORMULA AutoFlight-PT-12b-ReachabilityFireability-13 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-11 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-08 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
Incomplete Best-First random walk after 1000001 steps, including 2714 resets, run finished after 1211 ms. (steps per millisecond=825 ) properties seen :[0]
// Phase 1: matrix 135 rows 168 cols
[2020-06-07 04:30:04] [INFO ] Computed 48 place invariants in 2 ms
[2020-06-07 04:30:04] [INFO ] [Real]Absence check using 46 positive place invariants in 20 ms returned sat
[2020-06-07 04:30:04] [INFO ] [Real]Absence check using 46 positive and 2 generalized place invariants in 3 ms returned sat
[2020-06-07 04:30:04] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-07 04:30:04] [INFO ] [Real]Absence check using state equation in 117 ms returned sat
[2020-06-07 04:30:04] [INFO ] State equation strengthened by 68 read => feed constraints.
[2020-06-07 04:30:04] [INFO ] [Real]Added 68 Read/Feed constraints in 10 ms returned unsat
FORMULA AutoFlight-PT-12b-ReachabilityFireability-10 TRUE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
All properties solved without resorting to model-checking.

--------------------
content from stderr:

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AutoFlight-PT-12b"
export BK_EXAMINATION="ReachabilityFireability"
export BK_TOOL="itslola"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool itslola"
echo " Input is AutoFlight-PT-12b, examination is ReachabilityFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r166-smll-158987787800479"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/AutoFlight-PT-12b.tgz
mv AutoFlight-PT-12b execution
cd execution
if [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "UpperBounds" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] || [ "ReachabilityFireability" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "ReachabilityFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "ReachabilityFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "ReachabilityFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property ReachabilityFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "ReachabilityFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' ReachabilityFireability.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] ; then
echo "FORMULA_NAME ReachabilityFireability"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;