fond
Model Checking Contest 2020
10th edition, Paris, France, June 23, 2020
Execution of r176-tajo-158987872300767
Last Updated
Jun 28, 2020

About the Execution of ITS-LoLa for QuasiCertifProtocol-COL-28

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
15742.310 3600000.00 253079.00 142.90 TTTFFFTTTTTTTTFT normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/mnt/tpsp/fkordon/mcc2020-input.r176-tajo-158987872300767.qcow2', fmt=qcow2 size=4294967296 backing_file='/mnt/tpsp/fkordon/mcc2020-input.qcow2' encryption=off cluster_size=65536 lazy_refcounts=off
Waiting for the VM to be ready (probing ssh)
...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-4028
Executing tool itslola
Input is QuasiCertifProtocol-COL-28, examination is ReachabilityFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r176-tajo-158987872300767
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 300K
-rw-r--r-- 1 mcc users 3.7K Apr 12 07:02 CTLCardinality.txt
-rw-r--r-- 1 mcc users 21K Apr 12 07:02 CTLCardinality.xml
-rw-r--r-- 1 mcc users 2.9K Apr 11 07:58 CTLFireability.txt
-rw-r--r-- 1 mcc users 18K Apr 11 07:58 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.0K Mar 24 05:37 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.4K Mar 24 05:37 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 3.3K Apr 14 12:47 LTLCardinality.txt
-rw-r--r-- 1 mcc users 21K Apr 28 14:02 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.3K Apr 14 12:47 LTLFireability.txt
-rw-r--r-- 1 mcc users 18K Apr 28 14:02 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.6K Apr 10 13:55 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 17K Apr 10 13:55 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 2.7K Apr 9 20:26 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 14K Apr 9 20:26 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.8K Apr 10 22:24 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.8K Apr 10 22:24 UpperBounds.xml
-rw-r--r-- 1 mcc users 5 Mar 24 05:37 equiv_pt
-rw-r--r-- 1 mcc users 3 Mar 24 05:37 instance
-rw-r--r-- 1 mcc users 5 Mar 24 05:37 iscolored
-rw-r--r-- 1 mcc users 120K Mar 24 05:37 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-00
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-01
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-02
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-03
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-04
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-05
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-06
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-07
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-08
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-09
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-10
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-11
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-12
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-13
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-14
FORMULA_NAME QuasiCertifProtocol-COL-28-ReachabilityFireability-15

=== Now, execution of the tool begins

BK_START 1591181047979

bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
[2020-06-03 10:44:10] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, ReachabilityFireability, -z3path, /home/mcc/BenchKit//z3/bin/z3, -yices2path, /home/mcc/BenchKit//yices/bin/yices, -timeout, 3600, -rebuildPNML]
[2020-06-03 10:44:10] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2020-06-03 10:44:10] [INFO ] Detected file is not PT type :http://www.pnml.org/version-2009/grammar/symmetricnet
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[2020-06-03 10:44:10] [INFO ] Load time of PNML (colored model parsed with PNMLFW) : 620 ms
[2020-06-03 10:44:10] [INFO ] sort/places :
tsidxtsid->n9,n8,n7,
Dot->malicious_reservoir,CstopAbort,SstopAbort,AstopAbort,a5,a4,a3,a2,a1,Astart,AstopOK,
tsid->n6,n5,n4,n3,n2,n1,c1,Cstart,Sstart,s2,s3,s4,s5,s6,SstopOK,CstopOK,

[2020-06-03 10:44:11] [INFO ] Imported 30 HL places and 26 HL transitions for a total of 2998 PT places and 446.0 transition bindings in 152 ms.
[2020-06-03 10:44:11] [INFO ] Computed order based on color domains.
[2020-06-03 10:44:11] [INFO ] Unfolded HLPN to a Petri net with 2998 places and 446 transitions in 81 ms.
[2020-06-03 10:44:11] [INFO ] Unfolded HLPN properties in 0 ms.
Parsed 16 properties from file /home/mcc/execution/ReachabilityFireability.xml in 129 ms.
Working with output stream class java.io.PrintStream
Incomplete random walk after 10000 steps, including 300 resets, run finished after 280 ms. (steps per millisecond=35 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 7 resets, run finished after 287 ms. (steps per millisecond=34 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 12 resets, run finished after 83 ms. (steps per millisecond=120 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 12 resets, run finished after 71 ms. (steps per millisecond=140 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 15 resets, run finished after 80 ms. (steps per millisecond=125 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 11 resets, run finished after 582 ms. (steps per millisecond=17 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 8 resets, run finished after 272 ms. (steps per millisecond=36 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 11 resets, run finished after 31 ms. (steps per millisecond=322 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 11 resets, run finished after 29 ms. (steps per millisecond=344 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 15 resets, run finished after 19 ms. (steps per millisecond=526 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 15 resets, run finished after 32 ms. (steps per millisecond=312 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 12 resets, run finished after 22 ms. (steps per millisecond=454 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 13 resets, run finished after 30 ms. (steps per millisecond=333 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 11 resets, run finished after 240 ms. (steps per millisecond=41 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 15 resets, run finished after 164 ms. (steps per millisecond=60 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 14 resets, run finished after 25 ms. (steps per millisecond=400 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Incomplete Best-First random walk after 10001 steps, including 15 resets, run finished after 19 ms. (steps per millisecond=526 ) properties seen :[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
Probabilistic random walk after 10000001 steps, saw 1148680 distinct states, run finished after 27001 ms. (steps per millisecond=370 ) properties seen :[0, 0, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1]
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-15 TRUE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-14 FALSE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-13 TRUE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-11 TRUE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-10 TRUE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-09 TRUE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-08 TRUE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-07 TRUE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-06 TRUE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-04 FALSE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-03 FALSE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-02 TRUE TECHNIQUES TOPOLOGICAL PROBABILISTIC_WALK
// Phase 1: matrix 446 rows 2998 cols
[2020-06-03 10:44:40] [INFO ] Computed 2553 place invariants in 176 ms
[2020-06-03 10:44:41] [INFO ] [Real]Absence check using 4 positive place invariants in 77 ms returned sat
[2020-06-03 10:44:45] [INFO ] SMT solver returned unknown. Retrying;
[2020-06-03 10:44:45] [INFO ] [Real]Absence check using 4 positive and 2549 generalized place invariants in 4482 ms returned (error "Failed to check-sat")
[2020-06-03 10:44:45] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-03 10:44:45] [WARNING] SMT solver failed with error :java.lang.RuntimeException: SMT solver raised an error when submitting script. Raised (error "Error writing to Z3 solver: java.io.IOException: Broken pipe") while checking expression at index 0
[2020-06-03 10:44:46] [INFO ] [Real]Absence check using 4 positive place invariants in 63 ms returned sat
[2020-06-03 10:44:50] [INFO ] [Real]Absence check using 4 positive and 2549 generalized place invariants in 4441 ms returned (error "Solver has unexpectedly terminated")
[2020-06-03 10:44:50] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-03 10:44:50] [WARNING] SMT solver failed with error :java.lang.RuntimeException: SMT solver raised an error when submitting script. Raised (error "Error writing to Z3 solver: java.io.IOException: Stream closed") while checking expression at index 1
[2020-06-03 10:44:51] [INFO ] [Real]Absence check using 4 positive place invariants in 51 ms returned sat
[2020-06-03 10:44:55] [INFO ] SMT solver returned unknown. Retrying;
[2020-06-03 10:44:55] [INFO ] [Real]Absence check using 4 positive and 2549 generalized place invariants in 4480 ms returned (error "Failed to check-sat")
[2020-06-03 10:44:55] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-03 10:44:55] [WARNING] SMT solver failed with error :java.lang.RuntimeException: SMT solver raised an error when submitting script. Raised (error "Error writing to Z3 solver: java.io.IOException: Broken pipe") while checking expression at index 2
[2020-06-03 10:44:56] [INFO ] [Real]Absence check using 4 positive place invariants in 78 ms returned sat
[2020-06-03 10:45:00] [WARNING] SMT solver failed with error :java.lang.RuntimeException: SMT solver raised an error when submitting script. Raised (error "Failed to assert expression: java.io.IOException: Broken pipe (= (+ s1453 s2758) (+ s1448 s2753))") while checking expression at index 3
Support contains 1136 out of 2998 places. Attempting structural reductions.
Starting structural reductions, iteration 0 : 2998/2998 places, 446/446 transitions.
Discarding 92 places :
Also discarding 2 output transitions
Drop transitions removed 2 transitions
Graph (complete) has 30318 edges and 2998 vertex of which 2906 are kept as prefixes of interest. Removing 92 places using SCC suffix rule.47 ms
Applied a total of 1 rules in 292 ms. Remains 2906 /2998 variables (removed 92) and now considering 444/446 (removed 2) transitions.
Finished structural reductions, in 1 iterations. Remains : 2906/2998 places, 444/446 transitions.
Incomplete random walk after 1000000 steps, including 30259 resets, run finished after 6049 ms. (steps per millisecond=165 ) properties seen :[0, 0, 0, 0]
Interrupted Best-First random walk after 221580 steps, including 184 resets, run timeout after 5001 ms. (steps per millisecond=44 ) properties seen :[0, 0, 0, 0]
Interrupted Best-First random walk after 533126 steps, including 634 resets, run timeout after 5001 ms. (steps per millisecond=106 ) properties seen :[0, 0, 0, 0]
Incomplete Best-First random walk after 1000001 steps, including 834 resets, run finished after 4775 ms. (steps per millisecond=209 ) properties seen :[0, 0, 0, 0]
Interrupted Best-First random walk after 187730 steps, including 219 resets, run timeout after 5001 ms. (steps per millisecond=37 ) properties seen :[0, 0, 0, 0]
Interrupted probabilistic random walk after 11829897 steps, run timeout after 30001 ms. (steps per millisecond=394 ) properties seen :[0, 0, 0, 0]
Probabilistic random walk after 11829897 steps, saw 1332034 distinct states, run finished after 30003 ms. (steps per millisecond=394 ) properties seen :[0, 0, 0, 0]
// Phase 1: matrix 444 rows 2906 cols
[2020-06-03 10:45:57] [INFO ] Computed 2464 place invariants in 198 ms
[2020-06-03 10:46:04] [INFO ] [Real]Absence check using 0 positive and 2464 generalized place invariants in 6596 ms returned sat
[2020-06-03 10:46:04] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-03 10:46:27] [INFO ] [Real]Absence check using state equation in 23685 ms returned unsat
[2020-06-03 10:46:33] [INFO ] [Real]Absence check using 0 positive and 2464 generalized place invariants in 5500 ms returned sat
[2020-06-03 10:46:33] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-03 10:46:52] [INFO ] [Real]Absence check using state equation in 18766 ms returned unsat
[2020-06-03 10:46:58] [INFO ] [Real]Absence check using 0 positive and 2464 generalized place invariants in 4866 ms returned sat
[2020-06-03 10:46:58] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-03 10:47:13] [INFO ] [Real]Absence check using state equation in 15864 ms returned unsat
[2020-06-03 10:47:19] [INFO ] [Real]Absence check using 0 positive and 2464 generalized place invariants in 5433 ms returned sat
[2020-06-03 10:47:19] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2020-06-03 10:47:41] [INFO ] [Real]Absence check using state equation in 21567 ms returned unsat
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-12 TRUE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-05 FALSE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-01 TRUE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
FORMULA QuasiCertifProtocol-COL-28-ReachabilityFireability-00 TRUE TECHNIQUES STRUCTURAL_REDUCTION TOPOLOGICAL SAT_SMT
All properties solved without resorting to model-checking.

--------------------
content from stderr:

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="QuasiCertifProtocol-COL-28"
export BK_EXAMINATION="ReachabilityFireability"
export BK_TOOL="itslola"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool itslola"
echo " Input is QuasiCertifProtocol-COL-28, examination is ReachabilityFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r176-tajo-158987872300767"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/QuasiCertifProtocol-COL-28.tgz
mv QuasiCertifProtocol-COL-28 execution
cd execution
if [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "UpperBounds" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] || [ "ReachabilityFireability" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "ReachabilityFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "ReachabilityFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "ReachabilityFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property ReachabilityFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "ReachabilityFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' ReachabilityFireability.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] ; then
echo "FORMULA_NAME ReachabilityFireability"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;