About the Execution of LTSMin+red for BugTracking-PT-q3m002
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
736.331 | 3582576.00 | 14283577.00 | 115.50 | TFFTTTF?FFTT??FT | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/mnt/tpsp/fkordon/mcc2023-input.r041-tajo-167813694500322.qcow2', fmt=qcow2 size=4294967296 backing_file='/mnt/tpsp/fkordon/mcc2023-input.qcow2' encryption=off cluster_size=65536 lazy_refcounts=off
Waiting for the VM to be ready (probing ssh)
.......................
=====================================================================
Generated by BenchKit 2-5348
Executing tool ltsminxred
Input is BugTracking-PT-q3m002, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r041-tajo-167813694500322
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 16M
-rw-r--r-- 1 mcc users 10K Feb 26 07:51 CTLCardinality.txt
-rw-r--r-- 1 mcc users 93K Feb 26 07:51 CTLCardinality.xml
-rw-r--r-- 1 mcc users 5.4K Feb 26 07:34 CTLFireability.txt
-rw-r--r-- 1 mcc users 47K Feb 26 07:34 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.1K Feb 25 15:37 LTLCardinality.txt
-rw-r--r-- 1 mcc users 23K Feb 25 15:37 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.3K Feb 25 15:37 LTLFireability.txt
-rw-r--r-- 1 mcc users 17K Feb 25 15:37 LTLFireability.xml
-rw-r--r-- 1 mcc users 13K Feb 26 08:44 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 102K Feb 26 08:44 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 7.3K Feb 26 08:27 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 56K Feb 26 08:27 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.8K Feb 25 15:37 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.9K Feb 25 15:37 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 Mar 5 18:22 equiv_col
-rw-r--r-- 1 mcc users 7 Mar 5 18:22 instance
-rw-r--r-- 1 mcc users 6 Mar 5 18:22 iscolored
-rw-r--r-- 1 mcc users 16M Mar 5 18:22 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-00
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-01
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-02
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-03
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-04
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-05
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-06
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-07
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-08
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-09
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-10
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-11
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-12
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-13
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-14
FORMULA_NAME BugTracking-PT-q3m002-CTLFireability-15
=== Now, execution of the tool begins
BK_START 1678625195766
bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
Invoking MCC driver with
BK_TOOL=ltsminxred
BK_EXAMINATION=CTLFireability
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=BugTracking-PT-q3m002
Applying reductions before tool ltsmin
Invoking reducer
Running Version 202303021504
[2023-03-12 12:46:37] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, CTLFireability, -timeout, 360, -rebuildPNML]
[2023-03-12 12:46:37] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2023-03-12 12:46:38] [INFO ] Load time of PNML (sax parser for PT used): 634 ms
[2023-03-12 12:46:38] [INFO ] Transformed 754 places.
[2023-03-12 12:46:38] [INFO ] Transformed 27370 transitions.
[2023-03-12 12:46:38] [INFO ] Parsed PT model containing 754 places and 27370 transitions and 136172 arcs in 792 ms.
Parsed 16 properties from file /home/mcc/execution/CTLFireability.xml in 15 ms.
Deduced a syphon composed of 514 places in 115 ms
Reduce places removed 514 places and 24601 transitions.
Initial state reduction rules removed 1 formulas.
FORMULA BugTracking-PT-q3m002-CTLFireability-00 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m002-CTLFireability-03 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m002-CTLFireability-04 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m002-CTLFireability-10 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m002-CTLFireability-14 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Support contains 15 out of 240 places. Attempting structural reductions.
Starting structural reductions in LTL mode, iteration 0 : 240/240 places, 2769/2769 transitions.
Reduce places removed 2 places and 0 transitions.
Iterating post reduction 0 with 2 rules applied. Total rules applied 2 place count 238 transition count 2769
Discarding 1 places :
Symmetric choice reduction at 1 with 1 rule applications. Total rules 3 place count 237 transition count 2750
Iterating global reduction 1 with 1 rules applied. Total rules applied 4 place count 237 transition count 2750
Applied a total of 4 rules in 67 ms. Remains 237 /240 variables (removed 3) and now considering 2750/2769 (removed 19) transitions.
[2023-03-12 12:46:38] [INFO ] Flow matrix only has 2626 transitions (discarded 124 similar events)
// Phase 1: matrix 2626 rows 237 cols
[2023-03-12 12:46:38] [INFO ] Computed 8 place invariants in 41 ms
[2023-03-12 12:46:39] [INFO ] Implicit Places using invariants in 480 ms returned []
[2023-03-12 12:46:39] [INFO ] Flow matrix only has 2626 transitions (discarded 124 similar events)
[2023-03-12 12:46:39] [INFO ] Invariant cache hit.
[2023-03-12 12:46:39] [INFO ] State equation strengthened by 240 read => feed constraints.
[2023-03-12 12:46:40] [INFO ] Implicit Places using invariants and state equation in 1518 ms returned []
Implicit Place search using SMT with State Equation took 2023 ms to find 0 implicit places.
[2023-03-12 12:46:40] [INFO ] Flow matrix only has 2626 transitions (discarded 124 similar events)
[2023-03-12 12:46:40] [INFO ] Invariant cache hit.
[2023-03-12 12:46:41] [INFO ] Dead Transitions using invariants and state equation in 750 ms found 0 transitions.
Starting structural reductions in LTL mode, iteration 1 : 237/240 places, 2750/2769 transitions.
Finished structural reductions in LTL mode , in 1 iterations and 2847 ms. Remains : 237/240 places, 2750/2769 transitions.
Support contains 15 out of 237 places after structural reductions.
[2023-03-12 12:46:41] [INFO ] Initial state reduction rules for CTL removed 6 formulas.
[2023-03-12 12:46:41] [INFO ] Flatten gal took : 235 ms
[2023-03-12 12:46:41] [INFO ] Initial state reduction rules for CTL removed 1 formulas.
FORMULA BugTracking-PT-q3m002-CTLFireability-11 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m002-CTLFireability-09 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m002-CTLFireability-08 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m002-CTLFireability-06 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m002-CTLFireability-05 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m002-CTLFireability-02 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA BugTracking-PT-q3m002-CTLFireability-01 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
[2023-03-12 12:46:41] [INFO ] Flatten gal took : 154 ms
[2023-03-12 12:46:42] [INFO ] Input system was already deterministic with 2750 transitions.
Support contains 8 out of 237 places (down from 15) after GAL structural reductions.
FORMULA BugTracking-PT-q3m002-CTLFireability-15 TRUE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Incomplete random walk after 10000 steps, including 202 resets, run finished after 250 ms. (steps per millisecond=40 ) properties (out of 3) seen :1
Incomplete Best-First random walk after 10001 steps, including 67 resets, run finished after 78 ms. (steps per millisecond=128 ) properties (out of 2) seen :0
Incomplete Best-First random walk after 10001 steps, including 56 resets, run finished after 55 ms. (steps per millisecond=181 ) properties (out of 2) seen :0
Running SMT prover for 2 properties.
[2023-03-12 12:46:42] [INFO ] Flow matrix only has 2626 transitions (discarded 124 similar events)
[2023-03-12 12:46:42] [INFO ] Invariant cache hit.
[2023-03-12 12:46:42] [INFO ] [Real]Absence check using 8 positive place invariants in 2 ms returned sat
[2023-03-12 12:46:43] [INFO ] After 551ms SMT Verify possible using all constraints in real domain returned unsat :0 sat :0 real:2
[2023-03-12 12:46:43] [INFO ] [Nat]Absence check using 8 positive place invariants in 2 ms returned sat
[2023-03-12 12:46:43] [INFO ] After 476ms SMT Verify possible using state equation in natural domain returned unsat :0 sat :2
[2023-03-12 12:46:43] [INFO ] State equation strengthened by 240 read => feed constraints.
[2023-03-12 12:46:44] [INFO ] After 246ms SMT Verify possible using 240 Read/Feed constraints in natural domain returned unsat :0 sat :2
[2023-03-12 12:46:44] [INFO ] Deduced a trap composed of 17 places in 298 ms of which 6 ms to minimize.
[2023-03-12 12:46:44] [INFO ] Deduced a trap composed of 12 places in 292 ms of which 1 ms to minimize.
[2023-03-12 12:46:44] [INFO ] Trap strengthening procedure managed to obtain unsat after adding 2 trap constraints in 717 ms
[2023-03-12 12:46:44] [INFO ] After 1016ms SMT Verify possible using trap constraints in natural domain returned unsat :2 sat :0
[2023-03-12 12:46:44] [INFO ] After 1569ms SMT Verify possible using all constraints in natural domain returned unsat :2 sat :0
Fused 2 Parikh solutions to 0 different solutions.
Parikh walk visited 0 properties in 1 ms.
Successfully simplified 2 atomic propositions for a total of 1 simplifications.
[2023-03-12 12:46:44] [INFO ] Flatten gal took : 108 ms
[2023-03-12 12:46:45] [INFO ] Flatten gal took : 103 ms
[2023-03-12 12:46:45] [INFO ] Input system was already deterministic with 2750 transitions.
Computed a total of 6 stabilizing places and 111 stable transitions
Starting structural reductions in LTL mode, iteration 0 : 237/237 places, 2750/2750 transitions.
Applied a total of 0 rules in 11 ms. Remains 237 /237 variables (removed 0) and now considering 2750/2750 (removed 0) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 11 ms. Remains : 237/237 places, 2750/2750 transitions.
[2023-03-12 12:46:45] [INFO ] Flatten gal took : 96 ms
[2023-03-12 12:46:45] [INFO ] Flatten gal took : 113 ms
[2023-03-12 12:46:45] [INFO ] Input system was already deterministic with 2750 transitions.
Starting structural reductions in LTL mode, iteration 0 : 237/237 places, 2750/2750 transitions.
Applied a total of 0 rules in 9 ms. Remains 237 /237 variables (removed 0) and now considering 2750/2750 (removed 0) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 10 ms. Remains : 237/237 places, 2750/2750 transitions.
[2023-03-12 12:46:45] [INFO ] Flatten gal took : 93 ms
[2023-03-12 12:46:45] [INFO ] Flatten gal took : 85 ms
[2023-03-12 12:46:46] [INFO ] Input system was already deterministic with 2750 transitions.
Starting structural reductions in LTL mode, iteration 0 : 237/237 places, 2750/2750 transitions.
Applied a total of 0 rules in 9 ms. Remains 237 /237 variables (removed 0) and now considering 2750/2750 (removed 0) transitions.
Finished structural reductions in LTL mode , in 1 iterations and 10 ms. Remains : 237/237 places, 2750/2750 transitions.
[2023-03-12 12:46:46] [INFO ] Flatten gal took : 79 ms
[2023-03-12 12:46:46] [INFO ] Flatten gal took : 87 ms
[2023-03-12 12:46:46] [INFO ] Input system was already deterministic with 2750 transitions.
[2023-03-12 12:46:46] [INFO ] Flatten gal took : 116 ms
[2023-03-12 12:46:46] [INFO ] Flatten gal took : 121 ms
[2023-03-12 12:46:46] [INFO ] Export to MCC of 3 properties in file /home/mcc/execution/CTLFireability.sr.xml took 1 ms.
[2023-03-12 12:46:46] [INFO ] Export to PNML in file /home/mcc/execution/model.sr.pnml of net with 237 places, 2750 transitions and 13477 arcs took 24 ms.
Total runtime 9439 ms.
There are residual formulas that ITS could not solve within timeout
pnml2lts-sym model.pnml --lace-workers=4 --vset=lddmc --saturation=sat -rbs,w2W,ru,hf --sylvan-sizes=20,28,20,28 --ctl=/tmp/498/ctl_0_ --ctl=/tmp/498/ctl_1_ --ctl=/tmp/498/ctl_2_ --mu-par --mu-opt
TIME LIMIT: Killed by timeout after 3570 seconds
MemTotal: 16393356 kB
MemFree: 15464600 kB
After kill :
MemTotal: 16393356 kB
MemFree: 16079920 kB
Could not compute solution for formula : BugTracking-PT-q3m002-CTLFireability-07
Could not compute solution for formula : BugTracking-PT-q3m002-CTLFireability-12
Could not compute solution for formula : BugTracking-PT-q3m002-CTLFireability-13
BK_STOP 1678628778342
--------------------
content from stderr:
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
+ export PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ export LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
+ LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//../reducer/bin//../../itstools//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202303021504.jar
+ VERSION=202303021504
+ echo 'Running Version 202303021504'
+ /home/mcc/BenchKit/bin//../reducer/bin//../../itstools//itstools/its-tools -pnfolder /home/mcc/execution -examination CTLFireability -timeout 360 -rebuildPNML
mcc2023
ctl formula name BugTracking-PT-q3m002-CTLFireability-07
ctl formula formula --ctl=/tmp/498/ctl_0_
ctl formula name BugTracking-PT-q3m002-CTLFireability-12
ctl formula formula --ctl=/tmp/498/ctl_1_
ctl formula name BugTracking-PT-q3m002-CTLFireability-13
ctl formula formula --ctl=/tmp/498/ctl_2_
pnml2lts-sym: Exploration order is bfs-prev
pnml2lts-sym: Saturation strategy is sat
pnml2lts-sym: Guided search strategy is unguided
pnml2lts-sym: Attractor strategy is default
pnml2lts-sym: opening model.pnml
pnml2lts-sym: Edge label is id
Warning: program compiled against libxml 210 using older 209
pnml2lts-sym: Petri net has 237 places, 2750 transitions and 13477 arcs
pnml2lts-sym: Petri net Petri analyzed
pnml2lts-sym: There are no safe places
pnml2lts-sym: Loading Petri net took 0.020 real 0.010 user 0.010 sys
pnml2lts-sym: Initializing regrouping layer
pnml2lts-sym: Regroup specification: bs,w2W,ru,hf
pnml2lts-sym: Regroup Boost's Sloan
pnml2lts-sym: Regroup over-approximate must-write to may-write
pnml2lts-sym: Regroup Row sUbsume
pnml2lts-sym: Reqroup Horizontal Flip
pnml2lts-sym: Regrouping: 2750->2618 groups
pnml2lts-sym: Regrouping took 1.140 real 1.140 user 0.000 sys
pnml2lts-sym: state vector length is 237; there are 2618 groups
pnml2lts-sym: Creating a multi-core ListDD domain.
pnml2lts-sym: Sylvan allocates 15.000 GB virtual memory for nodes table and operation cache.
pnml2lts-sym: Initial nodes table and operation cache requires 60.00 MB.
pnml2lts-sym: Using GBgetTransitionsShortR2W as next-state function
pnml2lts-sym: got initial state
pnml2lts-sym: parsing CTL formula
pnml2lts-sym: converting CTL to mu-calculus...
pnml2lts-sym: parsing CTL formula
pnml2lts-sym: converting CTL to mu-calculus...
pnml2lts-sym: parsing CTL formula
pnml2lts-sym: converting CTL to mu-calculus...
pnml2lts-sym: vset_sylvan: starting garbage collection
pnml2lts-sym: vset_sylvan: garbage collection done
Killing (15) : 506
Killing (9) : 506
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="BugTracking-PT-q3m002"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="ltsminxred"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5348"
echo " Executing tool ltsminxred"
echo " Input is BugTracking-PT-q3m002, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r041-tajo-167813694500322"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/BugTracking-PT-q3m002.tgz
mv BugTracking-PT-q3m002 execution
cd execution
if [ "CTLFireability" = "ReachabilityDeadlock" ] || [ "CTLFireability" = "UpperBounds" ] || [ "CTLFireability" = "QuasiLiveness" ] || [ "CTLFireability" = "StableMarking" ] || [ "CTLFireability" = "Liveness" ] || [ "CTLFireability" = "OneSafe" ] || [ "CTLFireability" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "CTLFireability" = "ReachabilityDeadlock" ] || [ "CTLFireability" = "QuasiLiveness" ] || [ "CTLFireability" = "StableMarking" ] || [ "CTLFireability" = "Liveness" ] || [ "CTLFireability" = "OneSafe" ] ; then
echo "FORMULA_NAME CTLFireability"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;