fond
Model Checking Contest 2021
11th edition, Paris, France, June 23, 2021
Execution of r007-tall-162037990000398
Last Updated
Jun 28, 2021

About the Execution of ITS-Tools for AutoFlight-PT-02b

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
234.300 5782.00 10844.00 97.50 FFTFTTFFFFFTFFFT normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/data/fkordon/mcc2021-input.r007-tall-162037990000398.qcow2', fmt=qcow2 size=4294967296 backing_file='/data/fkordon/mcc2021-input.qcow2' encryption=off cluster_size=65536 lazy_refcounts=off
Waiting for the VM to be ready (probing ssh)
..................
=====================================================================
Generated by BenchKit 2-4028
Executing tool itstools
Input is AutoFlight-PT-02b, examination is ReachabilityCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r007-tall-162037990000398
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 436K
-rw-r--r-- 1 mcc users 14K May 5 16:58 CTLCardinality.txt
-rw-r--r-- 1 mcc users 131K May 5 16:58 CTLCardinality.xml
-rw-r--r-- 1 mcc users 11K May 5 16:58 CTLFireability.txt
-rw-r--r-- 1 mcc users 102K May 5 16:58 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K May 6 14:48 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.6K May 6 14:48 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 3.1K Mar 28 15:44 LTLCardinality.txt
-rw-r--r-- 1 mcc users 24K Mar 28 15:44 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.0K Mar 28 15:44 LTLFireability.txt
-rw-r--r-- 1 mcc users 19K Mar 28 15:44 LTLFireability.xml
-rw-r--r-- 1 mcc users 2.5K Mar 23 01:46 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 11K Mar 23 01:46 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 2.5K Mar 22 10:15 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 15K Mar 22 10:15 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K Mar 22 09:09 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K Mar 22 09:09 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 5 16:51 equiv_col
-rw-r--r-- 1 mcc users 4 May 5 16:51 instance
-rw-r--r-- 1 mcc users 6 May 5 16:51 iscolored
-rw-r--r-- 1 mcc users 48K May 5 16:51 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-00
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-01
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-02
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-03
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-04
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-05
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-06
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-07
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-08
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-09
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-10
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-11
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-12
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-13
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-14
FORMULA_NAME AutoFlight-PT-02b-ReachabilityCardinality-15

=== Now, execution of the tool begins

BK_START 1620466904259

Running Version 0
[2021-05-08 09:41:45] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, ReachabilityCardinality, -spotpath, /home/mcc/BenchKit/bin//..//ltlfilt, -z3path, /home/mcc/BenchKit/bin//..//z3/bin/z3, -yices2path, /home/mcc/BenchKit/bin//..//yices/bin/yices, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2021-05-08 09:41:45] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2021-05-08 09:41:45] [INFO ] Load time of PNML (sax parser for PT used): 50 ms
[2021-05-08 09:41:45] [INFO ] Transformed 206 places.
[2021-05-08 09:41:45] [INFO ] Transformed 204 transitions.
[2021-05-08 09:41:45] [INFO ] Found NUPN structural information;
[2021-05-08 09:41:45] [INFO ] Parsed PT model containing 206 places and 204 transitions in 89 ms.
Parsed 16 properties from file /home/mcc/execution/ReachabilityCardinality.xml in 8 ms.
Working with output stream class java.io.PrintStream
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-01 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-03 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-06 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-08 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-14 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Incomplete random walk after 10000 steps, including 87 resets, run finished after 70 ms. (steps per millisecond=142 ) properties (out of 11) seen :4
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-15 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-13 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-09 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-07 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
Incomplete Best-First random walk after 10001 steps, including 11 resets, run finished after 19 ms. (steps per millisecond=526 ) properties (out of 7) seen :0
Incomplete Best-First random walk after 10001 steps, including 11 resets, run finished after 17 ms. (steps per millisecond=588 ) properties (out of 7) seen :0
Incomplete Best-First random walk after 10001 steps, including 11 resets, run finished after 15 ms. (steps per millisecond=666 ) properties (out of 7) seen :0
Incomplete Best-First random walk after 10001 steps, including 11 resets, run finished after 18 ms. (steps per millisecond=555 ) properties (out of 7) seen :0
Incomplete Best-First random walk after 10001 steps, including 15 resets, run finished after 15 ms. (steps per millisecond=666 ) properties (out of 7) seen :0
Incomplete Best-First random walk after 10001 steps, including 11 resets, run finished after 15 ms. (steps per millisecond=666 ) properties (out of 7) seen :1
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-04 TRUE TECHNIQUES TOPOLOGICAL BESTFIRST_WALK
Incomplete Best-First random walk after 10000 steps, including 11 resets, run finished after 10 ms. (steps per millisecond=1000 ) properties (out of 6) seen :0
Running SMT prover for 6 properties.
// Phase 1: matrix 204 rows 206 cols
[2021-05-08 09:41:46] [INFO ] Computed 16 place invariants in 15 ms
[2021-05-08 09:41:46] [INFO ] [Real]Absence check using 15 positive place invariants in 8 ms returned sat
[2021-05-08 09:41:46] [INFO ] [Real]Absence check using 15 positive and 1 generalized place invariants in 1 ms returned sat
[2021-05-08 09:41:46] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-08 09:41:46] [INFO ] [Real]Absence check using state equation in 57 ms returned sat
[2021-05-08 09:41:46] [INFO ] Solution in real domain found non-integer solution.
[2021-05-08 09:41:46] [INFO ] [Nat]Absence check using 15 positive place invariants in 6 ms returned sat
[2021-05-08 09:41:46] [INFO ] [Nat]Absence check using 15 positive and 1 generalized place invariants in 1 ms returned sat
[2021-05-08 09:41:46] [INFO ] [Nat]Adding state equation constraints to refine reachable states.
[2021-05-08 09:41:46] [INFO ] [Nat]Absence check using state equation in 52 ms returned sat
[2021-05-08 09:41:46] [INFO ] Deduced a trap composed of 29 places in 72 ms of which 3 ms to minimize.
[2021-05-08 09:41:46] [INFO ] Deduced a trap composed of 38 places in 54 ms of which 1 ms to minimize.
[2021-05-08 09:41:46] [INFO ] Trap strengthening (SAT) tested/added 3/2 trap constraints in 163 ms
[2021-05-08 09:41:46] [INFO ] Computed and/alt/rep : 203/275/203 causal constraints (skipped 0 transitions) in 12 ms.
[2021-05-08 09:41:47] [INFO ] Added : 192 causal constraints over 39 iterations in 525 ms. Result :sat
Attempting to minimize the solution found.
Minimization took 4 ms.
[2021-05-08 09:41:47] [INFO ] [Real]Absence check using 15 positive place invariants in 5 ms returned sat
[2021-05-08 09:41:47] [INFO ] [Real]Absence check using 15 positive and 1 generalized place invariants in 1 ms returned sat
[2021-05-08 09:41:47] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-08 09:41:47] [INFO ] [Real]Absence check using state equation in 49 ms returned sat
[2021-05-08 09:41:47] [INFO ] Solution in real domain found non-integer solution.
[2021-05-08 09:41:47] [INFO ] [Real]Absence check using 15 positive place invariants in 6 ms returned sat
[2021-05-08 09:41:47] [INFO ] [Real]Absence check using 15 positive and 1 generalized place invariants in 1 ms returned sat
[2021-05-08 09:41:47] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-08 09:41:47] [INFO ] [Real]Absence check using state equation in 48 ms returned sat
[2021-05-08 09:41:47] [INFO ] Solution in real domain found non-integer solution.
[2021-05-08 09:41:47] [INFO ] [Real]Absence check using 15 positive place invariants in 5 ms returned sat
[2021-05-08 09:41:47] [INFO ] [Real]Absence check using 15 positive and 1 generalized place invariants in 1 ms returned sat
[2021-05-08 09:41:47] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-08 09:41:47] [INFO ] [Real]Absence check using state equation in 49 ms returned sat
[2021-05-08 09:41:47] [INFO ] Solution in real domain found non-integer solution.
[2021-05-08 09:41:47] [INFO ] [Nat]Absence check using 15 positive place invariants in 5 ms returned sat
[2021-05-08 09:41:47] [INFO ] [Nat]Absence check using 15 positive and 1 generalized place invariants in 0 ms returned sat
[2021-05-08 09:41:47] [INFO ] [Nat]Adding state equation constraints to refine reachable states.
[2021-05-08 09:41:47] [INFO ] [Nat]Absence check using state equation in 45 ms returned sat
[2021-05-08 09:41:47] [INFO ] Computed and/alt/rep : 203/275/203 causal constraints (skipped 0 transitions) in 12 ms.
[2021-05-08 09:41:48] [INFO ] Deduced a trap composed of 31 places in 33 ms of which 1 ms to minimize.
[2021-05-08 09:41:48] [INFO ] Trap strengthening (SAT) tested/added 2/1 trap constraints in 58 ms
[2021-05-08 09:41:48] [INFO ] Added : 194 causal constraints over 39 iterations in 523 ms. Result :sat
Attempting to minimize the solution found.
Minimization took 3 ms.
[2021-05-08 09:41:48] [INFO ] [Real]Absence check using 15 positive place invariants in 5 ms returned sat
[2021-05-08 09:41:48] [INFO ] [Real]Absence check using 15 positive and 1 generalized place invariants in 0 ms returned sat
[2021-05-08 09:41:48] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-08 09:41:48] [INFO ] [Real]Absence check using state equation in 49 ms returned sat
[2021-05-08 09:41:48] [INFO ] Deduced a trap composed of 47 places in 35 ms of which 1 ms to minimize.
[2021-05-08 09:41:48] [INFO ] Deduced a trap composed of 51 places in 35 ms of which 1 ms to minimize.
[2021-05-08 09:41:48] [INFO ] Deduced a trap composed of 28 places in 29 ms of which 0 ms to minimize.
[2021-05-08 09:41:48] [INFO ] Trap strengthening (SAT) tested/added 4/3 trap constraints in 129 ms
[2021-05-08 09:41:48] [INFO ] Solution in real domain found non-integer solution.
[2021-05-08 09:41:48] [INFO ] [Nat]Absence check using 15 positive place invariants in 6 ms returned sat
[2021-05-08 09:41:48] [INFO ] [Nat]Absence check using 15 positive and 1 generalized place invariants in 0 ms returned sat
[2021-05-08 09:41:48] [INFO ] [Nat]Adding state equation constraints to refine reachable states.
[2021-05-08 09:41:48] [INFO ] [Nat]Absence check using state equation in 47 ms returned sat
[2021-05-08 09:41:48] [INFO ] Deduced a trap composed of 47 places in 36 ms of which 1 ms to minimize.
[2021-05-08 09:41:48] [INFO ] Deduced a trap composed of 51 places in 32 ms of which 0 ms to minimize.
[2021-05-08 09:41:48] [INFO ] Deduced a trap composed of 28 places in 29 ms of which 1 ms to minimize.
[2021-05-08 09:41:48] [INFO ] Trap strengthening (SAT) tested/added 4/3 trap constraints in 131 ms
[2021-05-08 09:41:48] [INFO ] Computed and/alt/rep : 203/275/203 causal constraints (skipped 0 transitions) in 11 ms.
[2021-05-08 09:41:48] [INFO ] Added : 178 causal constraints over 36 iterations in 399 ms. Result :sat
Attempting to minimize the solution found.
Minimization took 2 ms.
[2021-05-08 09:41:48] [INFO ] [Real]Absence check using 15 positive place invariants in 4 ms returned unsat
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-12 FALSE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-05 TRUE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-02 TRUE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
Fused 6 Parikh solutions to 3 different solutions.
Finished Parikh walk after 1357 steps, including 10 resets, run visited all 3 properties in 7 ms. (steps per millisecond=193 )
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-11 TRUE TECHNIQUES TOPOLOGICAL PARIKH_WALK
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-10 FALSE TECHNIQUES TOPOLOGICAL PARIKH_WALK
FORMULA AutoFlight-PT-02b-ReachabilityCardinality-00 FALSE TECHNIQUES TOPOLOGICAL PARIKH_WALK
All properties solved without resorting to model-checking.

BK_STOP 1620466910041

--------------------
content from stderr:

+ export BINDIR=/home/mcc/BenchKit/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ ReachabilityCardinality = StateSpace ]]
+ /home/mcc/BenchKit/bin//..//runeclipse.sh /home/mcc/execution ReachabilityCardinality -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
++ cut -d . -f 9
++ ls /home/mcc/BenchKit/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202104292328.jar
+ VERSION=0
+ echo 'Running Version 0'
+ /home/mcc/BenchKit/bin//..//itstools/its-tools -data /home/mcc/execution/workspace -pnfolder /home/mcc/execution -examination ReachabilityCardinality -spotpath /home/mcc/BenchKit/bin//..//ltlfilt -z3path /home/mcc/BenchKit/bin//..//z3/bin/z3 -yices2path /home/mcc/BenchKit/bin//..//yices/bin/yices -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600 -vmargs -Dosgi.locking=none -Declipse.stateSaveDelayInterval=-1 -Dosgi.configuration.area=/tmp/.eclipse -Xss128m -Xms40m -Xmx16000m

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AutoFlight-PT-02b"
export BK_EXAMINATION="ReachabilityCardinality"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool itstools"
echo " Input is AutoFlight-PT-02b, examination is ReachabilityCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r007-tall-162037990000398"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/AutoFlight-PT-02b.tgz
mv AutoFlight-PT-02b execution
cd execution
if [ "ReachabilityCardinality" = "ReachabilityDeadlock" ] || [ "ReachabilityCardinality" = "UpperBounds" ] || [ "ReachabilityCardinality" = "QuasiLiveness" ] || [ "ReachabilityCardinality" = "StableMarking" ] || [ "ReachabilityCardinality" = "Liveness" ] || [ "ReachabilityCardinality" = "OneSafe" ] || [ "ReachabilityCardinality" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "ReachabilityCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "ReachabilityCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "ReachabilityCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property ReachabilityCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "ReachabilityCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' ReachabilityCardinality.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "ReachabilityCardinality" = "ReachabilityDeadlock" ] || [ "ReachabilityCardinality" = "QuasiLiveness" ] || [ "ReachabilityCardinality" = "StableMarking" ] || [ "ReachabilityCardinality" = "Liveness" ] || [ "ReachabilityCardinality" = "OneSafe" ] ; then
echo "FORMULA_NAME ReachabilityCardinality"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;