About the Execution of LTSMin+red for BugTracking-PT-q3m008
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
900.447 | 3588026.00 | 14309347.00 | 75.70 | ?FFFTTFFFF?FFFTT | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/mnt/tpsp/fkordon/mcc2023-input.r041-tajo-167813694600338.qcow2', fmt=qcow2 size=4294967296 backing_file='/mnt/tpsp/fkordon/mcc2023-input.qcow2' encryption=off cluster_size=65536 lazy_refcounts=off
Waiting for the VM to be ready (probing ssh)
........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-5348
Executing tool ltsminxred
Input is BugTracking-PT-q3m008, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r041-tajo-167813694600338
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 16M
-rw-r--r-- 1 mcc users 13K Feb 26 06:24 CTLCardinality.txt
-rw-r--r-- 1 mcc users 117K Feb 26 06:24 CTLCardinality.xml
-rw-r--r-- 1 mcc users 5.9K Feb 26 06:07 CTLFireability.txt
-rw-r--r-- 1 mcc users 50K Feb 26 06:07 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.3K Feb 25 15:37 LTLCardinality.txt
-rw-r--r-- 1 mcc users 25K Feb 25 15:37 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.3K Feb 25 15:37 LTLFireability.txt
-rw-r--r-- 1 mcc users 17K Feb 25 15:37 LTLFireability.xml
-rw-r--r-- 1 mcc users 15K Feb 26 07:02 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 124K Feb 26 07:02 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 9.3K Feb 26 06:43 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 79K Feb 26 06:43 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.8K Feb 25 15:37 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.8K Feb 25 15:37 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 Mar 5 18:22 equiv_col
-rw-r--r-- 1 mcc users 7 Mar 5 18:22 instance
-rw-r--r-- 1 mcc users 6 Mar 5 18:22 iscolored
-rw-r--r-- 1 mcc users 16M Mar 5 18:22 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-00
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-01
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-02
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-03
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-04
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-05
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-06
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-07
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-08
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-09
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-10
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-11
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-12
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-13
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-14
FORMULA_NAME BugTracking-PT-q3m008-CTLFireability-15
=== Now, execution of the tool begins
BK_START 1678627284691
bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
Invoking MCC driver with
BK_TOOL=ltsminxred
BK_EXAMINATION=CTLFireability
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=BugTracking-PT-q3m008
Applying reductions before tool ltsmin
Invoking reducer
Running Version 202303021504
[2023-03-12 13:21:26] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, CTLFireability, -timeout, 360, -rebuildPNML]
[2023-03-12 13:21:26] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2023-03-12 13:21:26] [INFO ] Load time of PNML (sax parser for PT used): 671 ms
[2023-03-12 13:21:27] [INFO ] Transformed 754 places.
[2023-03-12 13:21:27] [INFO ] Transformed 27370 transitions.
[2023-03-12 13:21:27] [INFO ] Parsed PT model containing 754 places and 27370 transitions and 136172 arcs in 869 ms.
Parsed 16 properties from file /home/mcc/execution/CTLFireability.xml in 19 ms.
Deduced a syphon composed of 514 places in 129 ms
Reduce places removed 514 places and 24601 transitions.
FORMULA BugTracking-PT-q3m008-CTLFireability-02 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m008-CTLFireability-11 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m008-CTLFireability-14 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Support contains 13 out of 240 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 240/240 places, 2769/2769 transitions.
Reduce places removed 2 places and 0 transitions.
Iterating post reduction 0 with 2 rules applied. Total rules applied 2 place count 238 transition count 2769
Applied a total of 2 rules in 52 ms. Remains 238 /240 variables (removed 2) and now considering 2769/2769 (removed 0) transitions.
[2023-03-12 13:21:27] [INFO ] Flow matrix only has 2642 transitions (discarded 127 similar events)
// Phase 1: matrix 2642 rows 238 cols
[2023-03-12 13:21:27] [INFO ] Computed 8 place invariants in 43 ms
[2023-03-12 13:21:27] [INFO ] Implicit Places using invariants in 454 ms returned []
[2023-03-12 13:21:27] [INFO ] Flow matrix only has 2642 transitions (discarded 127 similar events)
[2023-03-12 13:21:27] [INFO ] Invariant cache hit.
[2023-03-12 13:21:28] [INFO ] State equation strengthened by 255 read => feed constraints.
[2023-03-12 13:21:29] [INFO ] Implicit Places using invariants and state equation in 2059 ms returned []
Implicit Place search using SMT with State Equation took 2537 ms to find 0 implicit places.
[2023-03-12 13:21:29] [INFO ] Flow matrix only has 2642 transitions (discarded 127 similar events)
[2023-03-12 13:21:29] [INFO ] Invariant cache hit.
[2023-03-12 13:21:30] [INFO ] Dead Transitions using invariants and state equation in 773 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 238/240 places, 2769/2769 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 3365 ms. Remains : 238/240 places, 2769/2769 transitions.
Support contains 13 out of 238 places after structural reductions.
[2023-03-12 13:21:31] [INFO ] Initial state reduction rules for CTL removed 6 formulas.
[2023-03-12 13:21:31] [INFO ] Flatten gal took : 239 ms
[2023-03-12 13:21:31] [INFO ] Initial state reduction rules for CTL removed 3 formulas.
FORMULA BugTracking-PT-q3m008-CTLFireability-15 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m008-CTLFireability-12 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m008-CTLFireability-09 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m008-CTLFireability-08 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m008-CTLFireability-07 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m008-CTLFireability-05 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m008-CTLFireability-04 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m008-CTLFireability-03 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m008-CTLFireability-01 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
[2023-03-12 13:21:31] [INFO ] Flatten gal took : 164 ms
[2023-03-12 13:21:31] [INFO ] Input system was already deterministic with 2769 transitions.
Support contains 5 out of 238 places (down from 13) after GAL structural reductions.
Incomplete random walk after 10000 steps, including 54 resets, run finished after 230 ms. (steps per millisecond=43 ) properties (out of 2) seen :0
Incomplete Best-First random walk after 10001 steps, including 13 resets, run finished after 48 ms. (steps per millisecond=208 ) properties (out of 2) seen :0
Incomplete Best-First random walk after 10001 steps, including 13 resets, run finished after 37 ms. (steps per millisecond=270 ) properties (out of 2) seen :0
Interrupted probabilistic random walk after 159563 steps, run timeout after 3001 ms. (steps per millisecond=53 ) properties seen :{}
Probabilistic random walk after 159563 steps, saw 92404 distinct states, run finished after 3003 ms. (steps per millisecond=53 ) properties seen :0
Running SMT prover for 2 properties.
[2023-03-12 13:21:35] [INFO ] Flow matrix only has 2642 transitions (discarded 127 similar events)
[2023-03-12 13:21:35] [INFO ] Invariant cache hit.
[2023-03-12 13:21:35] [INFO ] [Real]Absence check using 8 positive place invariants in 2 ms returned sat
[2023-03-12 13:21:35] [INFO ] After 527ms SMT Verify possible using all constraints in real domain returned unsat :0 sat :0 real:2
[2023-03-12 13:21:35] [INFO ] [Nat]Absence check using 8 positive place invariants in 2 ms returned sat
[2023-03-12 13:21:36] [INFO ] After 540ms SMT Verify possible using state equation in natural domain returned unsat :0 sat :2
[2023-03-12 13:21:36] [INFO ] State equation strengthened by 255 read => feed constraints.
[2023-03-12 13:21:37] [INFO ] After 1705ms SMT Verify possible using 255 Read/Feed constraints in natural domain returned unsat :0 sat :2
[2023-03-12 13:21:38] [INFO ] Deduced a trap composed of 8 places in 264 ms of which 6 ms to minimize.
[2023-03-12 13:21:38] [INFO ] Deduced a trap composed of 20 places in 352 ms of which 1 ms to minimize.
[2023-03-12 13:21:38] [INFO ] Trap strengthening procedure managed to obtain unsat after adding 2 trap constraints in 731 ms
[2023-03-12 13:21:38] [INFO ] Deduced a trap composed of 27 places in 239 ms of which 1 ms to minimize.
[2023-03-12 13:21:39] [INFO ] Deduced a trap composed of 27 places in 284 ms of which 2 ms to minimize.
[2023-03-12 13:21:39] [INFO ] Deduced a trap composed of 11 places in 286 ms of which 1 ms to minimize.
[2023-03-12 13:21:39] [INFO ] Trap strengthening procedure managed to obtain unsat after adding 3 trap constraints in 1003 ms
[2023-03-12 13:21:39] [INFO ] After 3476ms SMT Verify possible using trap constraints in natural domain returned unsat :2 sat :0
[2023-03-12 13:21:39] [INFO ] After 4096ms SMT Verify possible using all constraints in natural domain returned unsat :2 sat :0
Fused 2 Parikh solutions to 0 different solutions.
Parikh walk visited 0 properties in 0 ms.
Successfully simplified 2 atomic propositions for a total of 2 simplifications.
FORMULA BugTracking-PT-q3m008-CTLFireability-06 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
[2023-03-12 13:21:39] [INFO ] Initial state reduction rules for CTL removed 1 formulas.
[2023-03-12 13:21:39] [INFO ] Flatten gal took : 139 ms
FORMULA BugTracking-PT-q3m008-CTLFireability-13 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
[2023-03-12 13:21:39] [INFO ] Flatten gal took : 139 ms
[2023-03-12 13:21:40] [INFO ] Input system was already deterministic with 2769 transitions.
Computed a total of 6 stabilizing places and 111 stable transitions
Starting structural reductions in LTL mode, iteration 0 : 238/238 places, 2769/2769 transitions.
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 1 place count 237 transition count 2750
Iterating global reduction 0 with 1 rules applied. Total rules applied 2 place count 237 transition count 2750
Applied a total of 2 rules in 35 ms. Remains 237 /238 variables (removed 1) and now considering 2750/2769 (removed 19) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 36 ms. Remains : 237/238 places, 2750/2769 transitions.
[2023-03-12 13:21:40] [INFO ] Flatten gal took : 95 ms
[2023-03-12 13:21:40] [INFO ] Flatten gal took : 95 ms
[2023-03-12 13:21:40] [INFO ] Input system was already deterministic with 2750 transitions.
Starting structural reductions in LTL mode, iteration 0 : 238/238 places, 2769/2769 transitions.
Discarding 1 places :
Symmetric choice reduction at 0 with 1 rule applications. Total rules 1 place count 237 transition count 2750
Iterating global reduction 0 with 1 rules applied. Total rules applied 2 place count 237 transition count 2750
Applied a total of 2 rules in 24 ms. Remains 237 /238 variables (removed 1) and now considering 2750/2769 (removed 19) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 25 ms. Remains : 237/238 places, 2750/2769 transitions.
[2023-03-12 13:21:40] [INFO ] Flatten gal took : 84 ms
[2023-03-12 13:21:40] [INFO ] Flatten gal took : 107 ms
[2023-03-12 13:21:41] [INFO ] Input system was already deterministic with 2750 transitions.
[2023-03-12 13:21:41] [INFO ] Flatten gal took : 102 ms
[2023-03-12 13:21:41] [INFO ] Flatten gal took : 86 ms
[2023-03-12 13:21:41] [INFO ] Export to MCC of 2 properties in file /home/mcc/execution/CTLFireability.sr.xml took 2 ms.
[2023-03-12 13:21:41] [INFO ] Export to PNML in file /home/mcc/execution/model.sr.pnml of net with 238 places, 2769 transitions and 13572 arcs took 17 ms.
Total runtime 15173 ms.
There are residual formulas that ITS could not solve within timeout
pnml2lts-sym model.pnml --lace-workers=4 --vset=lddmc --saturation=sat -rbs,w2W,ru,hf --sylvan-sizes=20,28,20,28 --ctl=/tmp/504/ctl_0_ --ctl=/tmp/504/ctl_1_ --mu-par --mu-opt
TIME LIMIT: Killed by timeout after 3570 seconds
MemTotal: 16393340 kB
MemFree: 15586648 kB
After kill :
MemTotal: 16393340 kB
MemFree: 16078824 kB
Could not compute solution for formula : BugTracking-PT-q3m008-CTLFireability-00
Could not compute solution for formula : BugTracking-PT-q3m008-CTLFireability-10
BK_STOP 1678630872717
--------------------
content from stderr:
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
+ export PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ export LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
+ LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//../reducer/bin//../../itstools//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202303021504.jar
+ VERSION=202303021504
+ echo 'Running Version 202303021504'
+ /home/mcc/BenchKit/bin//../reducer/bin//../../itstools//itstools/its-tools -pnfolder /home/mcc/execution -examination CTLFireability -timeout 360 -rebuildPNML
mcc2023
ctl formula name BugTracking-PT-q3m008-CTLFireability-00
ctl formula formula --ctl=/tmp/504/ctl_0_
ctl formula name BugTracking-PT-q3m008-CTLFireability-10
ctl formula formula --ctl=/tmp/504/ctl_1_
pnml2lts-sym: Exploration order is bfs-prev
pnml2lts-sym: Saturation strategy is sat
pnml2lts-sym: Guided search strategy is unguided
pnml2lts-sym: Attractor strategy is default
pnml2lts-sym: opening model.pnml
pnml2lts-sym: Edge label is id
Warning: program compiled against libxml 210 using older 209
pnml2lts-sym: Petri net has 238 places, 2769 transitions and 13572 arcs
pnml2lts-sym: Petri net Petri analyzed
pnml2lts-sym: There are no safe places
pnml2lts-sym: Loading Petri net took 0.020 real 0.020 user 0.000 sys
pnml2lts-sym: Initializing regrouping layer
pnml2lts-sym: Regroup specification: bs,w2W,ru,hf
pnml2lts-sym: Regroup Boost's Sloan
pnml2lts-sym: Regroup over-approximate must-write to may-write
pnml2lts-sym: Regroup Row sUbsume
pnml2lts-sym: Reqroup Horizontal Flip
pnml2lts-sym: Regrouping: 2769->2637 groups
pnml2lts-sym: Regrouping took 1.240 real 1.250 user 0.000 sys
pnml2lts-sym: state vector length is 238; there are 2637 groups
pnml2lts-sym: Creating a multi-core ListDD domain.
pnml2lts-sym: Sylvan allocates 15.000 GB virtual memory for nodes table and operation cache.
pnml2lts-sym: Initial nodes table and operation cache requires 60.00 MB.
pnml2lts-sym: Using GBgetTransitionsShortR2W as next-state function
pnml2lts-sym: got initial state
pnml2lts-sym: parsing CTL formula
pnml2lts-sym: converting CTL to mu-calculus...
pnml2lts-sym: parsing CTL formula
pnml2lts-sym: converting CTL to mu-calculus...
pnml2lts-sym: vset_sylvan: starting garbage collection
pnml2lts-sym: vset_sylvan: garbage collection done
Killing (15) : 510
Killing (9) : 510
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="BugTracking-PT-q3m008"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="ltsminxred"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5348"
echo " Executing tool ltsminxred"
echo " Input is BugTracking-PT-q3m008, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r041-tajo-167813694600338"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/BugTracking-PT-q3m008.tgz
mv BugTracking-PT-q3m008 execution
cd execution
if [ "CTLFireability" = "ReachabilityDeadlock" ] || [ "CTLFireability" = "UpperBounds" ] || [ "CTLFireability" = "QuasiLiveness" ] || [ "CTLFireability" = "StableMarking" ] || [ "CTLFireability" = "Liveness" ] || [ "CTLFireability" = "OneSafe" ] || [ "CTLFireability" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "CTLFireability" = "ReachabilityDeadlock" ] || [ "CTLFireability" = "QuasiLiveness" ] || [ "CTLFireability" = "StableMarking" ] || [ "CTLFireability" = "Liveness" ] || [ "CTLFireability" = "OneSafe" ] ; then
echo "FORMULA_NAME CTLFireability"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;