About the Execution of 2023-gold for AutoFlight-PT-12a
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
369.724 | 10543.00 | 25011.00 | 397.40 | F | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/data/fkordon/mcc2024-input.r044-smll-171620180800098.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fkordon/mcc2024-input.qcow2 backing_fmt=qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
....................................................................................
=====================================================================
Generated by BenchKit 2-5568
Executing tool gold2023
Input is AutoFlight-PT-12a, examination is StableMarking
Time confinement is 1800 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r044-smll-171620180800098
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 584K
-rw-r--r-- 1 mcc users 7.9K May 14 13:22 CTLCardinality.txt
-rw-r--r-- 1 mcc users 89K May 14 13:22 CTLCardinality.xml
-rw-r--r-- 1 mcc users 5.7K May 14 13:22 CTLFireability.txt
-rw-r--r-- 1 mcc users 54K May 14 13:22 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K May 18 16:42 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 3.7K Apr 22 14:28 LTLCardinality.txt
-rw-r--r-- 1 mcc users 26K Apr 22 14:28 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.1K May 19 07:12 LTLFireability.txt
-rw-r--r-- 1 mcc users 18K May 19 17:51 LTLFireability.xml
-rw-r--r-- 1 mcc users 14K Apr 12 23:00 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 161K Apr 12 23:00 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 7.1K Apr 12 22:52 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 59K Apr 12 22:52 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K Apr 22 14:28 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K Apr 22 14:28 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 18 16:42 equiv_col
-rw-r--r-- 1 mcc users 4 May 18 16:42 instance
-rw-r--r-- 1 mcc users 6 May 18 16:42 iscolored
-rw-r--r-- 1 mcc users 85K May 18 16:42 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
FORMULA_NAME StableMarking
=== Now, execution of the tool begins
BK_START 1716271661022
bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
Invoking MCC driver with
BK_TOOL=gold2023
BK_EXAMINATION=StableMarking
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=1800
BK_INPUT=AutoFlight-PT-12a
Not applying reductions.
Model is PT
StableMarking PT
Running Version 202304061127
[2024-05-21 06:07:44] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, StableMarking, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 1800]
[2024-05-21 06:07:44] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2024-05-21 06:07:44] [INFO ] Load time of PNML (sax parser for PT used): 160 ms
[2024-05-21 06:07:44] [INFO ] Transformed 307 places.
[2024-05-21 06:07:44] [INFO ] Transformed 305 transitions.
[2024-05-21 06:07:44] [INFO ] Found NUPN structural information;
[2024-05-21 06:07:44] [INFO ] Parsed PT model containing 307 places and 305 transitions and 980 arcs in 326 ms.
Structural test allowed to assert that 112 places are NOT stable. Took 15 ms.
Ensure Unique test removed 60 transitions
Reduce redundant transitions removed 60 transitions.
[2024-05-21 06:07:45] [INFO ] Flatten gal took : 320 ms
Incomplete random walk after 10000 steps, including 193 resets, run finished after 1021 ms. (steps per millisecond=9 ) properties (out of 195) seen :167
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 7 ms. (steps per millisecond=143 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 14 ms. (steps per millisecond=71 ) properties (out of 28) seen :0
[2024-05-21 06:07:46] [INFO ] Flatten gal took : 146 ms
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 7 ms. (steps per millisecond=143 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 7 ms. (steps per millisecond=143 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 7 ms. (steps per millisecond=143 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 5 ms. (steps per millisecond=200 ) properties (out of 28) seen :0
[2024-05-21 06:07:46] [INFO ] Time to serialize gal into /tmp/ReachabilityCardinality17219947574770684761.gal : 32 ms
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 7 ms. (steps per millisecond=143 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
[2024-05-21 06:07:46] [INFO ] Time to serialize properties into /tmp/ReachabilityCardinality10359488819201047325.prop : 6 ms
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Invoking ITS tools like this :cd /home/mcc/execution;'/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202304061127/bin/its-reach-linux64' '--gc-threshold' '2000000' '--quiet' '-i' '/tmp/ReachabilityCardinality17219947574770684761.gal' '-t' 'CGAL' '-reachable-file' '/tmp/ReachabilityCardinality10359488819201047325.prop' '--nowitness' '--gen-order' 'FOLLOW'
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 6 ms. (steps per millisecond=166 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 7 ms. (steps per millisecond=143 ) properties (out of 28) seen :0
Incomplete Best-First random walk after 1001 steps, including 2 resets, run finished after 7 ms. (steps per millisecond=143 ) properties (out of 28) seen :0
its-reach command run as :
/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202304061127/bin/its-reach-linux64 --gc-threshold 2000000 --quiet ...330
Running SMT prover for 28 properties.
Loading property file /tmp/ReachabilityCardinality10359488819201047325.prop.
// Phase 1: matrix 245 rows 307 cols
[2024-05-21 06:07:46] [INFO ] Computed 76 invariants in 30 ms
SDD proceeding with computation,195 properties remain. new max is 4
SDD size :1 after 3
SDD proceeding with computation,195 properties remain. new max is 8
SDD size :3 after 33
SDD proceeding with computation,195 properties remain. new max is 16
SDD size :33 after 513
SDD proceeding with computation,195 properties remain. new max is 32
SDD size :513 after 65537
SDD proceeding with computation,195 properties remain. new max is 64
SDD size :65537 after 8.38861e+06
Invariant property smplace_306 does not hold.
Invariant property smplace_279 does not hold.
Invariant property smplace_273 does not hold.
Invariant property smplace_267 does not hold.
Invariant property smplace_261 does not hold.
Invariant property smplace_255 does not hold.
Invariant property smplace_249 does not hold.
Invariant property smplace_243 does not hold.
Invariant property smplace_237 does not hold.
Invariant property smplace_236 does not hold.
Invariant property smplace_235 does not hold.
Invariant property smplace_234 does not hold.
Invariant property smplace_5 does not hold.
SDD proceeding with computation,182 properties remain. new max is 64
SDD size :8.38861e+06 after 1.59565e+08
SDD proceeding with computation,182 properties remain. new max is 128
SDD size :1.59565e+08 after 1.59614e+08
SDD proceeding with computation,182 properties remain. new max is 256
SDD size :1.59614e+08 after 1.59711e+08
Invariant property smplace_233 does not hold.
Invariant property smplace_2 does not hold.
SDD proceeding with computation,180 properties remain. new max is 256
SDD size :1.59711e+08 after 1.85074e+08
Invariant property smplace_254 does not hold.
Invariant property smplace_253 does not hold.
Invariant property smplace_252 does not hold.
[2024-05-21 06:07:47] [INFO ] After 781ms SMT Verify possible using all constraints in real domain returned unsat :0 sat :0 real:28
Invariant property smplace_26 does not hold.
SDD proceeding with computation,176 properties remain. new max is 256
SDD size :1.85074e+08 after 2.07749e+08
SDD proceeding with computation,176 properties remain. new max is 512
SDD size :2.07749e+08 after 2.07934e+08
Invariant property smplace_251 does not hold.
[2024-05-21 06:07:47] [INFO ] [Nat]Absence check using 75 positive place invariants in 24 ms returned sat
[2024-05-21 06:07:47] [INFO ] [Nat]Absence check using 75 positive and 1 generalized place invariants in 3 ms returned sat
Invariant property smplace_23 does not hold.
SDD proceeding with computation,174 properties remain. new max is 512
SDD size :2.07934e+08 after 2.30949e+08
Invariant property smplace_242 does not hold.
Invariant property smplace_241 does not hold.
Invariant property smplace_240 does not hold.
Invariant property smplace_12 does not hold.
SDD proceeding with computation,170 properties remain. new max is 512
SDD size :2.30949e+08 after 2.51791e+08
Invariant property smplace_248 does not hold.
Invariant property smplace_247 does not hold.
Invariant property smplace_246 does not hold.
Invariant property smplace_239 does not hold.
Invariant property smplace_19 does not hold.
Invariant property smplace_9 does not hold.
SDD proceeding with computation,164 properties remain. new max is 512
SDD size :2.51791e+08 after 3.28237e+08
SDD proceeding with computation,164 properties remain. new max is 1024
SDD size :3.28237e+08 after 3.28282e+08
Invariant property smplace_260 does not hold.
Invariant property smplace_259 does not hold.
Invariant property smplace_258 does not hold.
Invariant property smplace_245 does not hold.
Invariant property smplace_33 does not hold.
Invariant property smplace_16 does not hold.
SDD proceeding with computation,158 properties remain. new max is 1024
SDD size :3.28282e+08 after 3.76996e+08
Invariant property smplace_266 does not hold.
Invariant property smplace_265 does not hold.
Invariant property smplace_264 does not hold.
Invariant property smplace_257 does not hold.
[2024-05-21 06:07:48] [INFO ] After 511ms SMT Verify possible using state equation in natural domain returned unsat :0 sat :28
[2024-05-21 06:07:48] [INFO ] State equation strengthened by 60 read => feed constraints.
Invariant property smplace_40 does not hold.
Invariant property smplace_30 does not hold.
SDD proceeding with computation,152 properties remain. new max is 1024
SDD size :3.76996e+08 after 6.52739e+08
Invariant property smplace_278 does not hold.
Invariant property smplace_277 does not hold.
Invariant property smplace_276 does not hold.
Invariant property smplace_275 does not hold.
Invariant property smplace_272 does not hold.
Invariant property smplace_271 does not hold.
Invariant property smplace_270 does not hold.
Invariant property smplace_269 does not hold.
Invariant property smplace_263 does not hold.
[2024-05-21 06:07:48] [INFO ] After 405ms SMT Verify possible using 60 Read/Feed constraints in natural domain returned unsat :0 sat :28
Invariant property smplace_54 does not hold.
Invariant property smplace_51 does not hold.
Invariant property smplace_47 does not hold.
Invariant property smplace_44 does not hold.
Invariant property smplace_37 does not hold.
SDD proceeding with computation,138 properties remain. new max is 1024
SDD size :6.52739e+08 after 2.53269e+09
SDD proceeding with computation,138 properties remain. new max is 2048
SDD size :2.53269e+09 after 2.94538e+09
[2024-05-21 06:07:49] [INFO ] After 1263ms SMT Verify possible using trap constraints in natural domain returned unsat :0 sat :28
Attempting to minimize the solution found.
SDD proceeding with computation,138 properties remain. new max is 4096
SDD size :2.94538e+09 after 3.30846e+09
Minimization took 464 ms.
[2024-05-21 06:07:49] [INFO ] After 2812ms SMT Verify possible using all constraints in natural domain returned unsat :0 sat :28
Fused 28 Parikh solutions to 14 different solutions.
Finished Parikh walk after 2349 steps, including 68 resets, run visited all 2 properties in 48 ms. (steps per millisecond=48 )
Parikh walk visited 12 properties in 310 ms.
ITS runner failed with exception null
java.lang.InterruptedException
at java.base/java.lang.Object.wait(Native Method)
at java.base/java.lang.Thread.join(Thread.java:1304)
at java.base/java.lang.Thread.join(Thread.java:1372)
at fr.lip6.move.gal.application.runner.AbstractRunner.join(AbstractRunner.java:27)
at fr.lip6.move.gal.application.runner.its.ITSRunner.join(ITSRunner.java:177)
at fr.lip6.move.gal.application.solver.global.GlobalPropertySolver.verifyWithSDD(GlobalPropertySolver.java:675)
at fr.lip6.move.gal.application.solver.ReachabilitySolver.lambda$2(ReachabilitySolver.java:63)
at java.base/java.lang.Thread.run(Thread.java:833)
Able to resolve query StableMarking after proving 196 properties.
FORMULA StableMarking FALSE TECHNIQUES RANDOM_WALK PARIKH_WALK MARKED_SUFFIX_TEST DECISION_DIAGRAMS COLLATERAL_PROCESSING TOPOLOGICAL
Total runtime 5711 ms.
SDD proceeding with computation,138 properties remain. new max is 8192
SDD size :3.30846e+09 after 5.01193e+09
BK_STOP 1716271671565
--------------------
content from stderr:
+ export BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ StableMarking = StateSpace ]]
+ /home/mcc/BenchKit/bin//../itstools/bin//..//runeclipse.sh /home/mcc/execution StableMarking -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 1800
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
+ export PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ export LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
+ LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202304061127.jar
+ VERSION=202304061127
+ echo 'Running Version 202304061127'
+ /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/its-tools -pnfolder /home/mcc/execution -examination StableMarking -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 1800
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="AutoFlight-PT-12a"
export BK_EXAMINATION="StableMarking"
export BK_TOOL="gold2023"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="1800"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5568"
echo " Executing tool gold2023"
echo " Input is AutoFlight-PT-12a, examination is StableMarking"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r044-smll-171620180800098"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/AutoFlight-PT-12a.tgz
mv AutoFlight-PT-12a execution
cd execution
if [ "StableMarking" = "ReachabilityDeadlock" ] || [ "StableMarking" = "UpperBounds" ] || [ "StableMarking" = "QuasiLiveness" ] || [ "StableMarking" = "StableMarking" ] || [ "StableMarking" = "Liveness" ] || [ "StableMarking" = "OneSafe" ] || [ "StableMarking" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "StableMarking" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "StableMarking" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "StableMarking.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property StableMarking.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "StableMarking.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "StableMarking" = "ReachabilityDeadlock" ] || [ "StableMarking" = "QuasiLiveness" ] || [ "StableMarking" = "StableMarking" ] || [ "StableMarking" = "Liveness" ] || [ "StableMarking" = "OneSafe" ] ; then
echo "FORMULA_NAME StableMarking"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;