fond
Model Checking Contest 2020
10th edition, Paris, France, June 23, 2020
Execution of r006-smll-158897516100480
Last Updated
Jun 28, 2020

About the Execution of ITS-Tools for AutoFlight-PT-12b

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
15743.630 48910.00 53244.00 8162.90 FFFTTFFTTFTFFTFT normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/data/fkordon/mcc2020-input.r006-smll-158897516100480.qcow2', fmt=qcow2 size=4294967296 backing_file='/data/fkordon/mcc2020-input.qcow2' encryption=off cluster_size=65536 lazy_refcounts=off
Waiting for the VM to be ready (probing ssh)
.......................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-4028
Executing tool itstools
Input is AutoFlight-PT-12b, examination is ReachabilityFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r006-smll-158897516100480
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 444K
-rw-r--r-- 1 mcc users 3.4K Mar 25 23:23 CTLCardinality.txt
-rw-r--r-- 1 mcc users 19K Mar 25 23:23 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.4K Mar 25 18:35 CTLFireability.txt
-rw-r--r-- 1 mcc users 16K Mar 25 18:35 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K Mar 24 05:37 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.2K Mar 24 05:37 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 3.0K Apr 8 14:42 LTLCardinality.txt
-rw-r--r-- 1 mcc users 21K Apr 28 14:00 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.0K Apr 8 14:42 LTLFireability.txt
-rw-r--r-- 1 mcc users 18K Apr 28 14:00 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.7K Mar 25 15:04 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 19K Mar 25 15:04 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 2.8K Mar 25 10:47 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 17K Mar 25 10:47 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K Mar 25 17:54 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K Mar 25 17:54 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 Mar 24 05:37 equiv_col
-rw-r--r-- 1 mcc users 4 Mar 24 05:37 instance
-rw-r--r-- 1 mcc users 6 Mar 24 05:37 iscolored
-rw-r--r-- 1 mcc users 266K Mar 24 05:37 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-00
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-01
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-02
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-03
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-04
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-05
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-06
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-07
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-08
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-09
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-10
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-11
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-12
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-13
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-14
FORMULA_NAME AutoFlight-PT-12b-ReachabilityFireability-15

=== Now, execution of the tool begins

BK_START 1589577548741

[2020-05-15 21:19:15] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, ReachabilityFireability, -z3path, /home/mcc/BenchKit//z3/bin/z3, -yices2path, /home/mcc/BenchKit//yices/bin/yices, -its, -ltsminpath, /home/mcc/BenchKit//lts_install_dir/, -greatspnpath, /home/mcc/BenchKit//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2020-05-15 21:19:15] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2020-05-15 21:19:16] [INFO ] Load time of PNML (sax parser for PT used): 188 ms
[2020-05-15 21:19:16] [INFO ] Transformed 1126 places.
[2020-05-15 21:19:16] [INFO ] Transformed 1124 transitions.
[2020-05-15 21:19:16] [INFO ] Found NUPN structural information;
[2020-05-15 21:19:16] [INFO ] Parsed PT model containing 1126 places and 1124 transitions in 262 ms.
Parsed 16 properties from file /home/mcc/execution/ReachabilityFireability.xml in 69 ms.
Working with output stream class java.io.PrintStream
Incomplete random walk after 10000 steps, including 18 resets, run finished after 126 ms. (steps per millisecond=79 ) properties seen :[1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 0, 0, 1, 0, 0, 1]
FORMULA AutoFlight-PT-12b-ReachabilityFireability-15 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-12 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-09 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-07 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-06 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-04 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-03 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-01 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-00 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
Incomplete Best-First random walk after 10001 steps, including 1 resets, run finished after 40 ms. (steps per millisecond=250 ) properties seen :[0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10000 steps, including 1 resets, run finished after 55 ms. (steps per millisecond=181 ) properties seen :[0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 1 resets, run finished after 42 ms. (steps per millisecond=238 ) properties seen :[0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 1 resets, run finished after 30 ms. (steps per millisecond=333 ) properties seen :[0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 1 resets, run finished after 49 ms. (steps per millisecond=204 ) properties seen :[0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 1 resets, run finished after 27 ms. (steps per millisecond=370 ) properties seen :[0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 58 ms. (steps per millisecond=172 ) properties seen :[0, 0, 0, 0, 0, 0, 1]
FORMULA AutoFlight-PT-12b-ReachabilityFireability-14 FALSE TECHNIQUES TOPOLOGICAL BESTFIRST_WALK
// Phase 1: matrix 1124 rows 1126 cols
[2020-05-15 21:19:16] [INFO ] Computed 76 place invariants in 73 ms
[2020-05-15 21:19:17] [INFO ] [Real]Absence check using 75 positive place invariants in 211 ms returned sat
[2020-05-15 21:19:17] [INFO ] [Real]Absence check using 75 positive and 1 generalized place invariants in 8 ms returned sat
[2020-05-15 21:19:17] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-05-15 21:19:21] [INFO ] [Real]Absence check using state equation in 4234 ms returned (error "Solver has unexpectedly terminated")
[2020-05-15 21:19:25] [INFO ] [Real]Absence check using 75 positive place invariants in 2808 ms returned unsat
[2020-05-15 21:19:25] [INFO ] [Real]Absence check using 75 positive place invariants in 197 ms returned sat
[2020-05-15 21:19:25] [INFO ] [Real]Absence check using 75 positive and 1 generalized place invariants in 8 ms returned sat
[2020-05-15 21:19:25] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-05-15 21:19:30] [INFO ] SMT solver returned unknown. Retrying;
[2020-05-15 21:19:30] [INFO ] [Real]Absence check using state equation in 4433 ms returned (error "Failed to check-sat")
[2020-05-15 21:19:30] [INFO ] [Real]Absence check using 75 positive place invariants in 184 ms returned sat
[2020-05-15 21:19:30] [INFO ] [Real]Absence check using 75 positive and 1 generalized place invariants in 9 ms returned sat
[2020-05-15 21:19:30] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-05-15 21:19:35] [WARNING] SMT solver failed with error :java.lang.RuntimeException: SMT solver raised an error when submitting script. Raised (error "Failed to assert expression: java.io.IOException: Broken pipe (= s1117 (- t155 t156))") while checking expression at index 3
[2020-05-15 21:19:35] [INFO ] [Real]Absence check using 75 positive place invariants in 179 ms returned sat
[2020-05-15 21:19:35] [INFO ] [Real]Absence check using 75 positive and 1 generalized place invariants in 9 ms returned sat
[2020-05-15 21:19:35] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-05-15 21:19:40] [INFO ] SMT solver returned unknown. Retrying;
[2020-05-15 21:19:40] [INFO ] [Real]Absence check using state equation in 4552 ms returned (error "Failed to check-sat")
[2020-05-15 21:19:40] [INFO ] [Real]Absence check using 75 positive place invariants in 152 ms returned sat
[2020-05-15 21:19:40] [INFO ] [Real]Absence check using 75 positive and 1 generalized place invariants in 8 ms returned sat
[2020-05-15 21:19:40] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-05-15 21:19:44] [INFO ] [Real]Absence check using state equation in 4176 ms returned sat
[2020-05-15 21:19:50] [INFO ] Deduced a trap composed of 25 places in 5067 ms
[2020-05-15 21:19:50] [WARNING] SMT solver failed with error :java.lang.RuntimeException: SMT solver raised an error when submitting script. Raised (error "Failed to assert expression: java.io.IOException: Stream closed (> (+ s0 s1 s2 s734 s735 s736 s737 s738 s1054 s1055 s1056 s1057 s1058 s1059 s1060 s1061 s1062 s1063 s1064 s1065 s1066 s1067 s1068 s1069 s1070) 0)") while checking expression at index 5
FORMULA AutoFlight-PT-12b-ReachabilityFireability-05 FALSE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
Support contains 19 out of 1126 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 1126/1126 places, 1124/1124 transitions.
Performed 431 Post agglomeration using F-continuation condition.Transition count delta: 431
Iterating post reduction 0 with 431 rules applied. Total rules applied 431 place count 1126 transition count 693
Reduce places removed 431 places and 0 transitions.
Ensure Unique test removed 57 transitions
Reduce isomorphic transitions removed 57 transitions.
Performed 21 Post agglomeration using F-continuation condition.Transition count delta: 21
Iterating post reduction 1 with 509 rules applied. Total rules applied 940 place count 695 transition count 615
Reduce places removed 21 places and 0 transitions.
Iterating post reduction 2 with 21 rules applied. Total rules applied 961 place count 674 transition count 615
Performed 145 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 3 with 145 Pre rules applied. Total rules applied 961 place count 674 transition count 470
Deduced a syphon composed of 145 places in 7 ms
Reduce places removed 145 places and 0 transitions.
Iterating global reduction 3 with 290 rules applied. Total rules applied 1251 place count 529 transition count 470
Symmetric choice reduction at 3 with 115 rule applications. Total rules 1366 place count 529 transition count 470
Deduced a syphon composed of 115 places in 5 ms
Reduce places removed 115 places and 115 transitions.
Iterating global reduction 3 with 230 rules applied. Total rules applied 1596 place count 414 transition count 355
Performed 34 Pre agglomeration using Quasi-Persistent + Divergent Free condition..
Pre-agglomeration after 3 with 34 Pre rules applied. Total rules applied 1596 place count 414 transition count 321
Deduced a syphon composed of 34 places in 4 ms
Reduce places removed 34 places and 0 transitions.
Iterating global reduction 3 with 68 rules applied. Total rules applied 1664 place count 380 transition count 321
Performed 88 Post agglomeration using F-continuation condition.Transition count delta: 88
Deduced a syphon composed of 88 places in 1 ms
Reduce places removed 88 places and 0 transitions.
Iterating global reduction 3 with 176 rules applied. Total rules applied 1840 place count 292 transition count 233
Performed 1 Post agglomeration using F-continuation condition.Transition count delta: 0
Deduced a syphon composed of 1 places in 1 ms
Reduce places removed 1 places and 0 transitions.
Iterating global reduction 3 with 2 rules applied. Total rules applied 1842 place count 291 transition count 233
Free-agglomeration rule applied 46 times.
Iterating global reduction 3 with 46 rules applied. Total rules applied 1888 place count 291 transition count 187
Reduce places removed 46 places and 0 transitions.
Iterating post reduction 3 with 46 rules applied. Total rules applied 1934 place count 245 transition count 187
Partial Free-agglomeration rule applied 1 times.
Drop transitions removed 1 transitions
Iterating global reduction 4 with 1 rules applied. Total rules applied 1935 place count 245 transition count 187
Partial Post-agglomeration rule applied 1 times.
Drop transitions removed 1 transitions
Iterating global reduction 4 with 1 rules applied. Total rules applied 1936 place count 245 transition count 187
Applied a total of 1936 rules in 601 ms. Remains 245 /1126 variables (removed 881) and now considering 187/1124 (removed 937) transitions.
Finished structural reductions, in 1 iterations. Remains : 245/1126 places, 187/1124 transitions.
Incomplete random walk after 1000000 steps, including 12641 resets, run finished after 3562 ms. (steps per millisecond=280 ) properties seen :[1, 1, 0, 1, 1]
FORMULA AutoFlight-PT-12b-ReachabilityFireability-13 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-11 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-08 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-12b-ReachabilityFireability-02 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
Incomplete Best-First random walk after 1000001 steps, including 2278 resets, run finished after 1616 ms. (steps per millisecond=618 ) properties seen :[0]
// Phase 1: matrix 187 rows 245 cols
[2020-05-15 21:19:55] [INFO ] Computed 76 place invariants in 5 ms
[2020-05-15 21:19:56] [INFO ] [Real]Absence check using 74 positive place invariants in 53 ms returned sat
[2020-05-15 21:19:56] [INFO ] [Real]Absence check using 74 positive and 2 generalized place invariants in 5 ms returned sat
[2020-05-15 21:19:56] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-05-15 21:19:56] [INFO ] [Real]Absence check using state equation in 316 ms returned sat
[2020-05-15 21:19:56] [INFO ] State equation strengthened by 108 read => feed constraints.
[2020-05-15 21:19:56] [INFO ] [Real]Added 108 Read/Feed constraints in 16 ms returned unsat
FORMULA AutoFlight-PT-12b-ReachabilityFireability-10 TRUE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
All properties solved without resorting to model-checking.

BK_STOP 1589577597651

--------------------
content from stderr:

+ export BINDIR=/home/mcc/BenchKit/
+ BINDIR=/home/mcc/BenchKit/
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ ReachabilityFireability = StateSpace ]]
+ /home/mcc/BenchKit//runeclipse.sh /home/mcc/execution ReachabilityFireability -its -ltsminpath /home/mcc/BenchKit//lts_install_dir/ -greatspnpath /home/mcc/BenchKit//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
+ /home/mcc/BenchKit//itstools/its-tools -data /home/mcc/execution/workspace -pnfolder /home/mcc/execution -examination ReachabilityFireability -z3path /home/mcc/BenchKit//z3/bin/z3 -yices2path /home/mcc/BenchKit//yices/bin/yices -its -ltsminpath /home/mcc/BenchKit//lts_install_dir/ -greatspnpath /home/mcc/BenchKit//greatspn/ -order META -manyOrder -smt -timeout 3600 -vmargs -Dosgi.locking=none -Declipse.stateSaveDelayInterval=-1 -Dosgi.configuration.area=/tmp/.eclipse -Xss128m -Xms40m -Xmx16000m -Dfile.encoding=UTF-8 -Dosgi.requiredJavaVersion=1.6

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AutoFlight-PT-12b"
export BK_EXAMINATION="ReachabilityFireability"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool itstools"
echo " Input is AutoFlight-PT-12b, examination is ReachabilityFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r006-smll-158897516100480"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/AutoFlight-PT-12b.tgz
mv AutoFlight-PT-12b execution
cd execution
if [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "UpperBounds" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] || [ "ReachabilityFireability" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "ReachabilityFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "ReachabilityFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "ReachabilityFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property ReachabilityFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "ReachabilityFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' ReachabilityFireability.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] ; then
echo "FORMULA_NAME ReachabilityFireability"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;