About the Execution of 2020-gold for NoC3x3-PT-3B
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
4334.235 | 3600000.00 | 3624842.00 | 21639.20 | F?FFT?FT?FFTT??F | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/data/fkordon/mcc2021-input.r151-tall-162089151100133.qcow2', fmt=qcow2 size=4294967296 backing_file='/data/fkordon/mcc2021-input.qcow2' encryption=off cluster_size=65536 lazy_refcounts=off
Waiting for the VM to be ready (probing ssh)
...................
=====================================================================
Generated by BenchKit 2-4028
Executing tool gold2020
Input is NoC3x3-PT-3B, examination is LTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r151-tall-162089151100133
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 980K
-rw-r--r-- 1 mcc users 15K May 5 16:58 CTLCardinality.txt
-rw-r--r-- 1 mcc users 142K May 10 09:43 CTLCardinality.xml
-rw-r--r-- 1 mcc users 11K May 5 16:58 CTLFireability.txt
-rw-r--r-- 1 mcc users 92K May 10 09:43 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K May 6 14:48 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.1K May 6 14:48 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 3.3K Mar 28 16:22 LTLCardinality.txt
-rw-r--r-- 1 mcc users 26K Mar 28 16:22 LTLCardinality.xml
-rw-r--r-- 1 mcc users 1.9K Mar 28 16:22 LTLFireability.txt
-rw-r--r-- 1 mcc users 17K Mar 28 16:22 LTLFireability.xml
-rw-r--r-- 1 mcc users 3.2K Mar 27 06:30 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 16K Mar 27 06:30 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 2.5K Mar 25 07:50 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 15K Mar 25 07:50 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K Mar 22 09:15 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.6K Mar 22 09:15 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 5 16:51 equiv_col
-rw-r--r-- 1 mcc users 3 May 5 16:51 instance
-rw-r--r-- 1 mcc users 6 May 5 16:51 iscolored
-rw-r--r-- 1 mcc users 581K May 5 16:51 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME NoC3x3-PT-3B-00
FORMULA_NAME NoC3x3-PT-3B-01
FORMULA_NAME NoC3x3-PT-3B-02
FORMULA_NAME NoC3x3-PT-3B-03
FORMULA_NAME NoC3x3-PT-3B-04
FORMULA_NAME NoC3x3-PT-3B-05
FORMULA_NAME NoC3x3-PT-3B-06
FORMULA_NAME NoC3x3-PT-3B-07
FORMULA_NAME NoC3x3-PT-3B-08
FORMULA_NAME NoC3x3-PT-3B-09
FORMULA_NAME NoC3x3-PT-3B-10
FORMULA_NAME NoC3x3-PT-3B-11
FORMULA_NAME NoC3x3-PT-3B-12
FORMULA_NAME NoC3x3-PT-3B-13
FORMULA_NAME NoC3x3-PT-3B-14
FORMULA_NAME NoC3x3-PT-3B-15
=== Now, execution of the tool begins
BK_START 1620993718001
bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
[2021-05-14 12:01:59] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, LTLCardinality, -z3path, /home/mcc/BenchKit//z3/bin/z3, -yices2path, /home/mcc/BenchKit//yices/bin/yices, -timeout, 3600, -rebuildPNML]
[2021-05-14 12:01:59] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2021-05-14 12:01:59] [INFO ] Load time of PNML (sax parser for PT used): 122 ms
[2021-05-14 12:01:59] [INFO ] Transformed 2117 places.
[2021-05-14 12:01:59] [INFO ] Transformed 2435 transitions.
[2021-05-14 12:01:59] [INFO ] Found NUPN structural information;
[2021-05-14 12:01:59] [INFO ] Parsed PT model containing 2117 places and 2435 transitions in 237 ms.
Parsed 16 properties from file /home/mcc/execution/LTLCardinality.xml in 106 ms.
Working with output stream class java.io.PrintStream
Incomplete random walk after 100000 steps, including 169 resets, run finished after 532 ms. (steps per millisecond=187 ) properties seen :[1, 1, 1, 0, 1, 1, 0, 1, 0, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 0, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1]
// Phase 1: matrix 2435 rows 2117 cols
[2021-05-14 12:02:00] [INFO ] Computed 66 place invariants in 55 ms
[2021-05-14 12:02:01] [INFO ] [Real]Absence check using 66 positive place invariants in 146 ms returned sat
[2021-05-14 12:02:01] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-14 12:02:10] [INFO ] [Real]Absence check using state equation in 8657 ms returned sat
[2021-05-14 12:02:10] [INFO ] Solution in real domain found non-integer solution.
[2021-05-14 12:02:10] [INFO ] [Nat]Absence check using 66 positive place invariants in 146 ms returned unsat
[2021-05-14 12:02:11] [INFO ] [Real]Absence check using 66 positive place invariants in 125 ms returned sat
[2021-05-14 12:02:11] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-14 12:02:12] [INFO ] [Real]Absence check using state equation in 885 ms returned unsat
[2021-05-14 12:02:12] [INFO ] [Real]Absence check using 66 positive place invariants in 123 ms returned sat
[2021-05-14 12:02:12] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-14 12:02:20] [INFO ] [Real]Absence check using state equation in 8476 ms returned sat
[2021-05-14 12:02:20] [INFO ] Solution in real domain found non-integer solution.
[2021-05-14 12:02:27] [INFO ] SMT solver returned unknown. Retrying;
[2021-05-14 12:02:30] [INFO ] [Nat]Absence check using 66 positive place invariants in 9233 ms returned unknown
[2021-05-14 12:02:30] [INFO ] [Real]Absence check using 66 positive place invariants in 137 ms returned sat
[2021-05-14 12:02:30] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-14 12:02:38] [INFO ] [Real]Absence check using state equation in 8177 ms returned sat
[2021-05-14 12:02:39] [INFO ] Solution in real domain found non-integer solution.
[2021-05-14 12:02:42] [INFO ] [Nat]Absence check using 66 positive place invariants in 3159 ms returned sat
[2021-05-14 12:02:42] [INFO ] [Nat]Adding state equation constraints to refine reachable states.
[2021-05-14 12:02:50] [INFO ] [Nat]Absence check using state equation in 7988 ms returned sat
[2021-05-14 12:02:51] [INFO ] Deduced a trap composed of 35 places in 997 ms
[2021-05-14 12:02:52] [INFO ] Deduced a trap composed of 77 places in 908 ms
[2021-05-14 12:02:53] [INFO ] Deduced a trap composed of 158 places in 770 ms
[2021-05-14 12:02:54] [INFO ] Deduced a trap composed of 100 places in 724 ms
[2021-05-14 12:02:54] [INFO ] Deduced a trap composed of 139 places in 697 ms
[2021-05-14 12:02:55] [INFO ] Deduced a trap composed of 70 places in 686 ms
[2021-05-14 12:02:56] [INFO ] Deduced a trap composed of 70 places in 631 ms
[2021-05-14 12:02:57] [INFO ] Deduced a trap composed of 111 places in 614 ms
[2021-05-14 12:02:57] [INFO ] Deduced a trap composed of 91 places in 594 ms
[2021-05-14 12:02:58] [INFO ] Deduced a trap composed of 81 places in 576 ms
[2021-05-14 12:02:58] [INFO ] Deduced a trap composed of 100 places in 562 ms
[2021-05-14 12:02:59] [INFO ] Deduced a trap composed of 128 places in 348 ms
[2021-05-14 12:02:59] [WARNING] SMT solver failed with error :java.lang.RuntimeException: SMT solver raised an error when submitting script. Raised (error "Failed to assert expression: java.io.IOException: Stream closed (> (+ s0 s1 s2 s3 s4 s5 s6 s7 s8 s9 s10 s11 s12 s13 s14 s15 s16 s17 s18 s19 s20 s21 s22 s23 s24 s25 s26 s27 s28 s29 s30 s31 s32 s33 s34 s35 s36 s37 s38 s39 s40 s41 s42 s43 s44 s45 s46 s47 s48 s49 s50 s51 s52 s53 s54 s55 s56 s57 s58 s59 s60 s71 s73 s74 s75 s86 s124 s125 s126 s127 s136 s137 s138 s141 s148 s149 s150 s151 s152 s153 s154 s155 s156 s157 s176 s193 s194 s195 s196 s197 s198 s204 s205 s206 s207 s208 s214 s215 s216 s218 s219 s220 s221 s222 s225 s226 s227 s228 s230 s231 s232 s233 s234 s237 s238 s239 s240 s241 s242 s247 s248 s249 s250 s251 s252 s253 s254 s255) 0)") while checking expression at index 3
[2021-05-14 12:02:59] [INFO ] [Real]Absence check using 66 positive place invariants in 123 ms returned sat
[2021-05-14 12:02:59] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-14 12:03:08] [INFO ] [Real]Absence check using state equation in 8403 ms returned sat
[2021-05-14 12:03:08] [INFO ] Solution in real domain found non-integer solution.
[2021-05-14 12:03:14] [INFO ] SMT solver returned unknown. Retrying;
[2021-05-14 12:03:17] [INFO ] [Nat]Absence check using 66 positive place invariants in 9237 ms returned unknown
[2021-05-14 12:03:18] [INFO ] [Real]Absence check using 66 positive place invariants in 119 ms returned sat
[2021-05-14 12:03:18] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-14 12:03:26] [INFO ] [Real]Absence check using state equation in 8221 ms returned sat
[2021-05-14 12:03:26] [INFO ] Solution in real domain found non-integer solution.
[2021-05-14 12:03:26] [INFO ] [Nat]Absence check using 66 positive place invariants in 135 ms returned unsat
[2021-05-14 12:03:27] [INFO ] [Real]Absence check using 66 positive place invariants in 137 ms returned sat
[2021-05-14 12:03:27] [INFO ] [Real]Adding state equation constraints to refine reachable states.
[2021-05-14 12:03:35] [INFO ] [Real]Absence check using state equation in 8059 ms returned sat
[2021-05-14 12:03:36] [INFO ] Deduced a trap composed of 45 places in 1028 ms
[2021-05-14 12:03:37] [INFO ] Deduced a trap composed of 69 places in 982 ms
[2021-05-14 12:03:38] [INFO ] Deduced a trap composed of 67 places in 933 ms
[2021-05-14 12:03:39] [INFO ] Deduced a trap composed of 126 places in 885 ms
[2021-05-14 12:03:40] [INFO ] Deduced a trap composed of 72 places in 814 ms
[2021-05-14 12:03:41] [INFO ] Deduced a trap composed of 51 places in 752 ms
[2021-05-14 12:03:41] [INFO ] Deduced a trap composed of 69 places in 701 ms
[2021-05-14 12:03:42] [INFO ] Deduced a trap composed of 71 places in 633 ms
[2021-05-14 12:03:43] [INFO ] Deduced a trap composed of 105 places in 511 ms
[2021-05-14 12:03:43] [INFO ] Deduced a trap composed of 155 places in 535 ms
[2021-05-14 12:03:44] [INFO ] Deduced a trap composed of 181 places in 488 ms
[2021-05-14 12:03:44] [INFO ] Deduced a trap composed of 156 places in 457 ms
[2021-05-14 12:03:45] [INFO ] Deduced a trap composed of 128 places in 327 ms
[2021-05-14 12:03:45] [INFO ] Deduced a trap composed of 103 places in 312 ms
[2021-05-14 12:03:45] [INFO ] Trap strengthening (SAT) tested/added 15/14 trap constraints in 10444 ms
[2021-05-14 12:03:45] [INFO ] Solution in real domain found non-integer solution.
[2021-05-14 12:03:52] [INFO ] SMT solver returned unknown. Retrying;
[2021-05-14 12:03:55] [INFO ] [Nat]Absence check using 66 positive place invariants in 8999 ms returned sat
[2021-05-14 12:03:55] [INFO ] [Nat]Adding state equation constraints to refine reachable states.
[2021-05-14 12:04:02] [INFO ] [Nat]Absence check using state equation in 7753 ms returned sat
[2021-05-14 12:04:03] [INFO ] Deduced a trap composed of 76 places in 1182 ms
[2021-05-14 12:04:05] [INFO ] Deduced a trap composed of 56 places in 1010 ms
[2021-05-14 12:04:06] [INFO ] Deduced a trap composed of 97 places in 1037 ms
[2021-05-14 12:04:06] [WARNING] SMT solver failed with error :java.lang.RuntimeException: SMT solver raised an error when submitting script. Raised (error "Failed to assert expression: java.io.IOException: Stream closed (> (+ s0 s1 s2 s3 s4 s5 s6 s7 s8 s9 s10 s11 s12 s13 s14 s15 s16 s17 s18 s19 s20 s21 s22 s23 s24 s25 s26 s27 s28 s29 s30 s31 s32 s33 s34 s35 s36 s37 s38 s39 s40 s41 s42 s43 s44 s45 s46 s47 s48 s49 s50 s76 s77 s78 s79 s81 s82 s83 s84 s85 s86 s91 s92 s93 s102 s103 s104 s105 s106 s107 s108 s185 s186 s302 s303 s304 s305 s306 s307 s308 s309 s310 s311 s312 s313 s314 s320 s321 s322 s323 s324 s325 s401 s403 s404 s406 s407) 0)") while checking expression at index 6
Successfully simplified 3 atomic propositions for a total of 3 simplifications.
[2021-05-14 12:04:06] [INFO ] Initial state reduction rules for CTL removed 5 formulas.
[2021-05-14 12:04:06] [INFO ] Flatten gal took : 263 ms
FORMULA NoC3x3-PT-3B-12 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NoC3x3-PT-3B-09 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NoC3x3-PT-3B-07 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NoC3x3-PT-3B-04 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA NoC3x3-PT-3B-02 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
[2021-05-14 12:04:06] [INFO ] Applying decomposition
[2021-05-14 12:04:06] [INFO ] Flatten gal took : 97 ms
[2021-05-14 12:04:06] [INFO ] Decomposing Gal with order
[2021-05-14 12:04:06] [INFO ] Rewriting arrays to variables to allow decomposition.
[2021-05-14 12:04:07] [INFO ] Removed a total of 435 redundant transitions.
[2021-05-14 12:04:07] [INFO ] Flatten gal took : 190 ms
[2021-05-14 12:04:07] [INFO ] Fuse similar labels procedure discarded/fused a total of 1494 labels/synchronizations in 134 ms.
[2021-05-14 12:04:07] [INFO ] Export to MCC properties in file /home/mcc/execution/LTLCardinality.sr.xml took 4 ms.
[2021-05-14 12:04:07] [INFO ] Export to PNML in file /home/mcc/execution/model.sr.pnml took 18 ms.
info: Time: 3600 - MCC
vrfy: Checking LTLCardinality @ NoC3x3-PT-3B @ 3570 seconds
FORMULA NoC3x3-PT-3B-00 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT TOPOLOGICAL STATE_COMPRESSION STUBBORN_SETS USE_NUPN UNFOLDING_TO_PT
FORMULA NoC3x3-PT-3B-06 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT TOPOLOGICAL STATE_COMPRESSION STUBBORN_SETS USE_NUPN UNFOLDING_TO_PT
FORMULA NoC3x3-PT-3B-11 TRUE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT TOPOLOGICAL STATE_COMPRESSION STUBBORN_SETS USE_NUPN UNFOLDING_TO_PT
FORMULA NoC3x3-PT-3B-15 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT TOPOLOGICAL STATE_COMPRESSION STUBBORN_SETS USE_NUPN UNFOLDING_TO_PT
FORMULA NoC3x3-PT-3B-03 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT TOPOLOGICAL STATE_COMPRESSION STUBBORN_SETS USE_NUPN UNFOLDING_TO_PT
FORMULA NoC3x3-PT-3B-10 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT TOPOLOGICAL STATE_COMPRESSION STUBBORN_SETS USE_NUPN UNFOLDING_TO_PT
TIME LIMIT: Killed by timeout after 3600 seconds
MemTotal: 16427332 kB
MemFree: 13019580 kB
After kill :
MemTotal: 16427332 kB
MemFree: 16133412 kB
--------------------
content from stderr:
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="NoC3x3-PT-3B"
export BK_EXAMINATION="LTLCardinality"
export BK_TOOL="gold2020"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool gold2020"
echo " Input is NoC3x3-PT-3B, examination is LTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r151-tall-162089151100133"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/NoC3x3-PT-3B.tgz
mv NoC3x3-PT-3B execution
cd execution
if [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "UpperBounds" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] || [ "LTLCardinality" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "LTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "LTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "LTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property LTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "LTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "LTLCardinality" = "ReachabilityDeadlock" ] || [ "LTLCardinality" = "QuasiLiveness" ] || [ "LTLCardinality" = "StableMarking" ] || [ "LTLCardinality" = "Liveness" ] || [ "LTLCardinality" = "OneSafe" ] ; then
echo "FORMULA_NAME LTLCardinality"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;