fond
Model Checking Contest 2025
15th edition, Paris, France, June 24, 2025
Execution of r058-smll-174854064700719
Last Updated
June 24, 2025

About the Execution of ITS-Tools for DiscoveryGPU-PT-12b

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
0.000 9953.00 0.00 0.00 TFFFFTFTTTTTTFTT normal

Execution Chart

Sorry, for this execution, no execution chart could be reported.

Trace from the execution

Formatting '/data/fkordon/mcc2025-input.r058-smll-174854064700719.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fkordon/mcc2025-input.qcow2 backing_fmt=qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-5832
Executing tool itstools
Input is DiscoveryGPU-PT-12b, examination is ReachabilityFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r058-smll-174854064700719
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 540K
-rw-r--r-- 1 mcc users 8.4K May 29 14:47 CTLCardinality.txt
-rw-r--r-- 1 mcc users 96K May 29 14:47 CTLCardinality.xml
-rw-r--r-- 1 mcc users 5.6K May 29 14:47 CTLFireability.txt
-rw-r--r-- 1 mcc users 51K May 29 14:47 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K May 29 14:32 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 6.6K May 29 14:32 GenericPropertiesVerdict.xml
-rw-r--r-- 1 mcc users 3.4K May 29 14:47 LTLCardinality.txt
-rw-r--r-- 1 mcc users 24K May 29 14:47 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.2K May 29 14:47 LTLFireability.txt
-rw-r--r-- 1 mcc users 17K May 29 14:47 LTLFireability.xml
-rw-r--r-- 1 mcc users 8.6K May 29 14:47 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 85K May 29 14:47 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 9.1K May 29 14:47 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 80K May 29 14:47 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.6K May 29 14:47 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K May 29 14:47 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 May 29 14:32 equiv_col
-rw-r--r-- 1 mcc users 4 May 29 14:32 instance
-rw-r--r-- 1 mcc users 6 May 29 14:32 iscolored
-rw-r--r-- 1 mcc users 89K May 29 14:32 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

echo here is the order used to build the result vector(from xml file)
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-00
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-01
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-02
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-03
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-04
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-05
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-06
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-07
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-08
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-09
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-10
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-11
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-12
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-13
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-14
FORMULA_NAME DiscoveryGPU-PT-12b-ReachabilityFireability-2025-15

=== Now, execution of the tool begins

BK_START 1748942815786

Invoking MCC driver with
BK_TOOL=itstools
BK_EXAMINATION=ReachabilityFireability
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=DiscoveryGPU-PT-12b
BK_MEMORY_CONFINEMENT=16384
Not applying reductions.
Model is PT
ReachabilityFireability PT
Running Version 202505121319
[2025-06-03 09:26:57] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, ReachabilityFireability, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2025-06-03 09:26:57] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2025-06-03 09:26:58] [INFO ] Load time of PNML (sax parser for PT used): 132 ms
[2025-06-03 09:26:58] [INFO ] Transformed 352 places.
[2025-06-03 09:26:58] [INFO ] Transformed 374 transitions.
[2025-06-03 09:26:58] [INFO ] Found NUPN structural information;
[2025-06-03 09:26:58] [INFO ] Parsed PT model containing 352 places and 374 transitions and 977 arcs in 303 ms.
Parsed 16 properties from file /home/mcc/execution/ReachabilityFireability.xml in 26 ms.
Working with output stream class java.io.PrintStream
RANDOM walk for 40000 steps (102 resets) in 2093 ms. (19 steps per ms) remains 8/16 properties
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-14 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-13 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-09 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-08 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-07 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-03 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-02 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-00 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
[2025-06-03 09:26:59] [INFO ] Flatten gal took : 206 ms
[2025-06-03 09:26:59] [INFO ] Flatten gal took : 156 ms
[2025-06-03 09:26:59] [INFO ] Time to serialize gal into /tmp/ReachabilityCardinality8569989613258669152.gal : 67 ms
BEST_FIRST walk for 40003 steps (14 resets) in 1637 ms. (24 steps per ms) remains 8/8 properties
[2025-06-03 09:26:59] [INFO ] Time to serialize properties into /tmp/ReachabilityCardinality17806531911435862623.prop : 29 ms
Invoking ITS tools like this :cd /home/mcc/execution;'/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202505121319/bin/its-reach-linux64' '--gc-threshold' '2000000' '--quiet' '-i' '/tmp/ReachabilityCardinality8569989613258669152.gal' '-t' 'CGAL' '-reachable-file' '/tmp/ReachabilityCardinality17806531911435862623.prop' '--nowitness' '--gen-order' 'FOLLOW'

its-reach command run as :

/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202505121319/bin/its-reach-linux64 --gc-threshold 2000000 --quiet ...329
Loading property file /tmp/ReachabilityCardinality17806531911435862623.prop.
BEST_FIRST walk for 40004 steps (12 resets) in 601 ms. (66 steps per ms) remains 8/8 properties
SDD proceeding with computation,8 properties remain. new max is 4
SDD size :1 after 5
SDD proceeding with computation,8 properties remain. new max is 8
SDD size :5 after 10
SDD proceeding with computation,8 properties remain. new max is 16
SDD size :10 after 13
SDD proceeding with computation,8 properties remain. new max is 32
SDD size :13 after 32
BEST_FIRST walk for 40003 steps (8 resets) in 478 ms. (83 steps per ms) remains 8/8 properties
BEST_FIRST walk for 40003 steps (16 resets) in 399 ms. (100 steps per ms) remains 8/8 properties
BEST_FIRST walk for 40003 steps (14 resets) in 391 ms. (102 steps per ms) remains 8/8 properties
BEST_FIRST walk for 40004 steps (12 resets) in 78 ms. (506 steps per ms) remains 7/8 properties
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-11 TRUE TECHNIQUES TOPOLOGICAL BESTFIRST_WALK
BEST_FIRST walk for 40004 steps (14 resets) in 265 ms. (150 steps per ms) remains 7/7 properties
BEST_FIRST walk for 40003 steps (8 resets) in 166 ms. (239 steps per ms) remains 7/7 properties
// Phase 1: matrix 374 rows 352 cols
[2025-06-03 09:27:00] [INFO ] Computed 14 invariants in 36 ms
Excessive predecessor constraint size, skipping predecessor.
SDD proceeding with computation,8 properties remain. new max is 64
SDD size :32 after 771
SDD proceeding with computation,8 properties remain. new max is 128
SDD size :771 after 6144
Starting Z3 with timeout 5.0 s and query timeout 500.0 ms
SDD proceeding with computation,8 properties remain. new max is 256
SDD size :6144 after 77462
All remaining problems are real, not stopping.
At refinement iteration 0 (INCLUDED_ONLY) 0/128 variables, 128/128 constraints. Problems are: Problem set: 0 solved, 7 unsolved
At refinement iteration 1 (INCLUDED_ONLY) 0/128 variables, 0/128 constraints. Problems are: Problem set: 0 solved, 7 unsolved
Problem DiscoveryGPU-PT-12b-ReachabilityFireability-2025-01 is UNSAT
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-01 FALSE TECHNIQUES SMT_REFINEMENT
At refinement iteration 2 (OVERLAPS) 224/352 variables, 14/142 constraints. Problems are: Problem set: 1 solved, 6 unsolved
At refinement iteration 3 (INCLUDED_ONLY) 0/352 variables, 224/366 constraints. Problems are: Problem set: 1 solved, 6 unsolved
SDD proceeding with computation,8 properties remain. new max is 512
SDD size :77462 after 79670
At refinement iteration 4 (INCLUDED_ONLY) 0/352 variables, 0/366 constraints. Problems are: Problem set: 1 solved, 6 unsolved
SDD proceeding with computation,8 properties remain. new max is 1024
SDD size :79670 after 101142
At refinement iteration 5 (OVERLAPS) 374/726 variables, 352/718 constraints. Problems are: Problem set: 1 solved, 6 unsolved
At refinement iteration 6 (INCLUDED_ONLY) 0/726 variables, 0/718 constraints. Problems are: Problem set: 1 solved, 6 unsolved
At refinement iteration 7 (OVERLAPS) 0/726 variables, 0/718 constraints. Problems are: Problem set: 1 solved, 6 unsolved
No progress, stopping.
After SMT solving in domain Real declared 726/726 variables, and 718 constraints, problems are : Problem set: 1 solved, 6 unsolved in 1643 ms.
Refiners :[Domain max(s): 352/352 constraints, Positive P Invariants (semi-flows): 14/14 constraints, State Equation: 352/352 constraints, PredecessorRefiner: 7/0 constraints, Known Traps: 0/0 constraints, Known Traps Along Path: 0/0 constraints]
Escalating to Integer solving :Problem set: 1 solved, 6 unsolved
Starting Z3 with timeout 5.0 s and query timeout 500.0 ms
At refinement iteration 0 (INCLUDED_ONLY) 0/108 variables, 108/108 constraints. Problems are: Problem set: 1 solved, 6 unsolved
At refinement iteration 1 (INCLUDED_ONLY) 0/108 variables, 0/108 constraints. Problems are: Problem set: 1 solved, 6 unsolved
Problem DiscoveryGPU-PT-12b-ReachabilityFireability-2025-10 is UNSAT
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-10 TRUE TECHNIQUES SMT_REFINEMENT
Problem DiscoveryGPU-PT-12b-ReachabilityFireability-2025-12 is UNSAT
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-12 TRUE TECHNIQUES SMT_REFINEMENT
At refinement iteration 2 (OVERLAPS) 244/352 variables, 14/122 constraints. Problems are: Problem set: 3 solved, 4 unsolved
At refinement iteration 3 (INCLUDED_ONLY) 0/352 variables, 244/366 constraints. Problems are: Problem set: 3 solved, 4 unsolved
Starting Z3 with timeout 120.0 s and query timeout 12000.0 ms
[2025-06-03 09:27:02] [INFO ] Deduced a trap composed of 54 places in 267 ms of which 32 ms to minimize.
Starting Z3 with timeout 120.0 s and query timeout 12000.0 ms
[2025-06-03 09:27:02] [INFO ] Deduced a trap composed of 10 places in 197 ms of which 11 ms to minimize.
At refinement iteration 4 (INCLUDED_ONLY) 0/352 variables, 2/368 constraints. Problems are: Problem set: 3 solved, 4 unsolved
Starting Z3 with timeout 120.0 s and query timeout 12000.0 ms
[2025-06-03 09:27:03] [INFO ] Deduced a trap composed of 56 places in 236 ms of which 23 ms to minimize.
At refinement iteration 5 (INCLUDED_ONLY) 0/352 variables, 1/369 constraints. Problems are: Problem set: 3 solved, 4 unsolved
SDD proceeding with computation,8 properties remain. new max is 2048
SDD size :101142 after 223666
Starting Z3 with timeout 120.0 s and query timeout 12000.0 ms
[2025-06-03 09:27:03] [INFO ] Deduced a trap composed of 11 places in 185 ms of which 10 ms to minimize.
At refinement iteration 6 (INCLUDED_ONLY) 0/352 variables, 1/370 constraints. Problems are: Problem set: 3 solved, 4 unsolved
At refinement iteration 7 (INCLUDED_ONLY) 0/352 variables, 0/370 constraints. Problems are: Problem set: 3 solved, 4 unsolved
At refinement iteration 8 (OVERLAPS) 374/726 variables, 352/722 constraints. Problems are: Problem set: 3 solved, 4 unsolved
At refinement iteration 9 (INCLUDED_ONLY) 0/726 variables, 0/722 constraints. Problems are: Problem set: 3 solved, 4 unsolved
At refinement iteration 10 (OVERLAPS) 0/726 variables, 0/722 constraints. Problems are: Problem set: 3 solved, 4 unsolved
No progress, stopping.
After SMT solving in domain Int declared 726/726 variables, and 722 constraints, problems are : Problem set: 3 solved, 4 unsolved in 3013 ms.
Refiners :[Domain max(s): 352/352 constraints, Positive P Invariants (semi-flows): 14/14 constraints, State Equation: 352/352 constraints, PredecessorRefiner: 6/0 constraints, Known Traps: 4/4 constraints, Known Traps Along Path: 0/0 constraints]
After SMT, in 4862ms problems are : Problem set: 3 solved, 4 unsolved
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-04 FALSE TECHNIQUES PARIKH_WALK
SDD proceeding with computation,8 properties remain. new max is 4096
SDD size :223666 after 229904
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-05 TRUE TECHNIQUES PARIKH_WALK
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-06 FALSE TECHNIQUES PARIKH_WALK
Finished Parikh walk after 144 steps, including 0 resets, run visited all 1 properties in 1 ms. (steps per millisecond=144 )
FORMULA DiscoveryGPU-PT-12b-ReachabilityFireability-2025-15 TRUE TECHNIQUES PARIKH_WALK
Parikh walk visited 4 properties in 620 ms.
ITS runner timed out or was interrupted.
ITS tools runner thread asked to quit. Dying gracefully.
All properties solved without resorting to model-checking.
Total runtime 7898 ms.

BK_STOP 1748942825739

--------------------
content from stderr:

+ export BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ ReachabilityFireability = StateSpace ]]
+ /home/mcc/BenchKit/bin//../itstools/bin//..//runeclipse.sh /home/mcc/execution ReachabilityFireability -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202505121319.jar
+ VERSION=202505121319
+ echo 'Running Version 202505121319'
+ /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/its-tools -pnfolder /home/mcc/execution -examination ReachabilityFireability -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="DiscoveryGPU-PT-12b"
export BK_EXAMINATION="ReachabilityFireability"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5832"
echo " Executing tool itstools"
echo " Input is DiscoveryGPU-PT-12b, examination is ReachabilityFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r058-smll-174854064700719"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/DiscoveryGPU-PT-12b.tgz
mv DiscoveryGPU-PT-12b execution
cd execution
if [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "UpperBounds" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] || [ "ReachabilityFireability" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "ReachabilityFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "ReachabilityFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "ReachabilityFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' ReachabilityFireability.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] ; then
echo "FORMULA_NAME ReachabilityFireability"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;