fond
Model Checking Contest 2023
13th edition, Paris, France, April 26, 2023 (at TOOLympics II)
Execution of r483-tall-167912695300184
Last Updated
May 14, 2023

About the Execution of Smart for Sudoku-PT-AN03

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
155.731 1685.00 1808.00 323.20 11776 56619 1 27 normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/data/fkordon/mcc2023-input.r483-tall-167912695300184.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fkordon/mcc2023-input.qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
.................
=====================================================================
Generated by BenchKit 2-5348
Executing tool smart
Input is Sudoku-PT-AN03, examination is StateSpace
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 1
Run identifier is r483-tall-167912695300184
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 924K
-rw-r--r-- 1 mcc users 15K Feb 26 09:36 CTLCardinality.txt
-rw-r--r-- 1 mcc users 97K Feb 26 09:36 CTLCardinality.xml
-rw-r--r-- 1 mcc users 26K Feb 26 09:35 CTLFireability.txt
-rw-r--r-- 1 mcc users 143K Feb 26 09:35 CTLFireability.xml
-rw-r--r-- 1 mcc users 4.2K Jan 29 11:41 GenericPropertiesDefinition.xml
-rw-r--r-- 1 mcc users 9.9K Feb 25 17:16 LTLCardinality.txt
-rw-r--r-- 1 mcc users 47K Feb 25 17:16 LTLCardinality.xml
-rw-r--r-- 1 mcc users 14K Feb 25 17:16 LTLFireability.txt
-rw-r--r-- 1 mcc users 53K Feb 25 17:16 LTLFireability.xml
-rw-r--r-- 1 mcc users 25K Feb 26 09:38 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 145K Feb 26 09:38 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 44K Feb 26 09:37 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 225K Feb 26 09:37 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 3.0K Feb 25 17:16 UpperBounds.txt
-rw-r--r-- 1 mcc users 7.0K Feb 25 17:16 UpperBounds.xml
-rw-r--r-- 1 mcc users 5 Mar 5 18:23 equiv_col
-rw-r--r-- 1 mcc users 5 Mar 5 18:23 instance
-rw-r--r-- 1 mcc users 6 Mar 5 18:23 iscolored
-rw-r--r-- 1 mcc users 21K Mar 5 18:23 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

no data necessary for post analysis


=== Now, execution of the tool begins

BK_START 1679153615836

bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
Invoking MCC driver with
BK_TOOL=smart
BK_EXAMINATION=StateSpace
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=Sudoku-PT-AN03
Not applying reductions.
Model is PT
StateSpace PT
======================================================
========== this is Smart for the MCC'2018 ============
======================================================
Running Sudoku (PT), instance AN03
Examination StateSpace
Parser /home/mcc/BenchKit/bin//../smart/bin//parser/StateSpaceParse.jar
Model checker /home/mcc/BenchKit/bin//../smart/bin//main//smart

Filename model.pnml
Petri model created: 54 places, 27 transitions, 108 arcs.
AT ITER 0 NEW BEST:: SOT 1004 SOS 557 HAS SOPS 557 HAS SOUS 557 HAS SOUPS 557 WITH SCORE 557.557
AT ITER 9 NEW BEST:: SOT 1001 SOS 556 HAS SOPS 556 HAS SOUS 556 HAS SOUPS 556 WITH SCORE 556.556
AT ITER 20 NEW BEST:: SOT 994 SOS 566 HAS SOPS 566 HAS SOUS 553 HAS SOUPS 553 WITH SCORE 553.566
AT ITER 22 NEW BEST:: SOT 994 SOS 561 HAS SOPS 561 HAS SOUS 548 HAS SOUPS 548 WITH SCORE 548.561
AT ITER 24 NEW BEST:: SOT 988 SOS 558 HAS SOPS 558 HAS SOUS 545 HAS SOUPS 545 WITH SCORE 545.558
AT ITER 30 NEW BEST:: SOT 988 SOS 556 HAS SOPS 556 HAS SOUS 545 HAS SOUPS 545 WITH SCORE 545.556
AT ITER 32 NEW BEST:: SOT 987 SOS 555 HAS SOPS 555 HAS SOUS 544 HAS SOUPS 544 WITH SCORE 544.555
AT ITER 36 NEW BEST:: SOT 1002 SOS 554 HAS SOPS 554 HAS SOUS 544 HAS SOUPS 544 WITH SCORE 544.554
AT ITER 42 NEW BEST:: SOT 1002 SOS 547 HAS SOPS 547 HAS SOUS 537 HAS SOUPS 537 WITH SCORE 537.547
AT ITER 45 NEW BEST:: SOT 1002 SOS 545 HAS SOPS 545 HAS SOUS 537 HAS SOUPS 537 WITH SCORE 537.545
AT ITER 48 NEW BEST:: SOT 1005 SOS 544 HAS SOPS 544 HAS SOUS 536 HAS SOUPS 536 WITH SCORE 536.544
AT ITER 63 NEW BEST:: SOT 1012 SOS 541 HAS SOPS 541 HAS SOUS 535 HAS SOUPS 535 WITH SCORE 535.541
AT ITER 64 NEW BEST:: SOT 1011 SOS 540 HAS SOPS 540 HAS SOUS 534 HAS SOUPS 534 WITH SCORE 534.54
AT ITER 75 NEW BEST:: SOT 1007 SOS 533 HAS SOPS 533 HAS SOUS 527 HAS SOUPS 527 WITH SCORE 527.533
AT ITER 104 NEW BEST:: SOT 1006 SOS 532 HAS SOPS 532 HAS SOUS 526 HAS SOUPS 526 WITH SCORE 526.532
AT ITER 130 NEW BEST:: SOT 1005 SOS 531 HAS SOPS 531 HAS SOUS 525 HAS SOUPS 525 WITH SCORE 525.531
AT ITER 142 NEW BEST:: SOT 1005 SOS 530 HAS SOPS 530 HAS SOUS 525 HAS SOUPS 525 WITH SCORE 525.53
AT ITER 154 NEW BEST:: SOT 1005 SOS 529 HAS SOPS 529 HAS SOUS 525 HAS SOUPS 525 WITH SCORE 525.529
AT ITER 155 NEW BEST:: SOT 1003 SOS 527 HAS SOPS 527 HAS SOUS 523 HAS SOUPS 523 WITH SCORE 523.527
AT ITER 157 NEW BEST:: SOT 1003 SOS 526 HAS SOPS 526 HAS SOUS 518 HAS SOUPS 518 WITH SCORE 518.526
AT ITER 170 NEW BEST:: SOT 1000 SOS 529 HAS SOPS 529 HAS SOUS 517 HAS SOUPS 517 WITH SCORE 517.529
AT ITER 190 NEW BEST:: SOT 1000 SOS 523 HAS SOPS 523 HAS SOUS 513 HAS SOUPS 513 WITH SCORE 513.523
AT ITER 200 NEW BEST:: SOT 999 SOS 522 HAS SOPS 522 HAS SOUS 512 HAS SOUPS 512 WITH SCORE 512.522
AT ITER 226 NEW BEST:: SOT 993 SOS 520 HAS SOPS 520 HAS SOUS 510 HAS SOUPS 510 WITH SCORE 510.52
AT ITER 234 NEW BEST:: SOT 990 SOS 519 HAS SOPS 519 HAS SOUS 509 HAS SOUPS 509 WITH SCORE 509.519
AT ITER 242 NEW BEST:: SOT 990 SOS 520 HAS SOPS 520 HAS SOUS 508 HAS SOUPS 508 WITH SCORE 508.52
AT ITER 251 NEW BEST:: SOT 990 SOS 516 HAS SOPS 516 HAS SOUS 506 HAS SOUPS 506 WITH SCORE 506.516
AT ITER 261 NEW BEST:: SOT 991 SOS 511 HAS SOPS 511 HAS SOUS 506 HAS SOUPS 506 WITH SCORE 506.511
AT ITER 270 NEW BEST:: SOT 991 SOS 509 HAS SOPS 509 HAS SOUS 505 HAS SOUPS 505 WITH SCORE 505.509
AT ITER 281 NEW BEST:: SOT 983 SOS 506 HAS SOPS 506 HAS SOUS 502 HAS SOUPS 502 WITH SCORE 502.506
AT ITER 290 NEW BEST:: SOT 979 SOS 505 HAS SOPS 505 HAS SOUS 501 HAS SOUPS 501 WITH SCORE 501.505
AT ITER 321 NEW BEST:: SOT 980 SOS 503 HAS SOPS 503 HAS SOUS 500 HAS SOUPS 500 WITH SCORE 500.503
AT ITER 328 NEW BEST:: SOT 980 SOS 502 HAS SOPS 502 HAS SOUS 499 HAS SOUPS 499 WITH SCORE 499.502
AT ITER 357 NEW BEST:: SOT 982 SOS 500 HAS SOPS 500 HAS SOUS 495 HAS SOUPS 495 WITH SCORE 495.5
AT ITER 363 NEW BEST:: SOT 981 SOS 499 HAS SOPS 499 HAS SOUS 494 HAS SOUPS 494 WITH SCORE 494.499
AT ITER 410 NEW BEST:: SOT 981 SOS 498 HAS SOPS 498 HAS SOUS 492 HAS SOUPS 492 WITH SCORE 492.498
AT ITER 451 NEW BEST:: SOT 981 SOS 498 HAS SOPS 498 HAS SOUS 491 HAS SOUPS 491 WITH SCORE 491.498
AT ITER 472 NEW BEST:: SOT 982 SOS 498 HAS SOPS 498 HAS SOUS 490 HAS SOUPS 490 WITH SCORE 490.498
AT ITER 496 NEW BEST:: SOT 982 SOS 495 HAS SOPS 495 HAS SOUS 490 HAS SOUPS 490 WITH SCORE 490.495
AT ITER 506 NEW BEST:: SOT 982 SOS 493 HAS SOPS 493 HAS SOUS 489 HAS SOUPS 489 WITH SCORE 489.493
AT ITER 522 NEW BEST:: SOT 979 SOS 492 HAS SOPS 492 HAS SOUS 488 HAS SOUPS 488 WITH SCORE 488.492
AT ITER 534 NEW BEST:: SOT 979 SOS 493 HAS SOPS 493 HAS SOUS 487 HAS SOUPS 487 WITH SCORE 487.493
AT ITER 543 NEW BEST:: SOT 979 SOS 491 HAS SOPS 491 HAS SOUS 485 HAS SOUPS 485 WITH SCORE 485.491
AT ITER 548 NEW BEST:: SOT 974 SOS 489 HAS SOPS 489 HAS SOUS 483 HAS SOUPS 483 WITH SCORE 483.489
AT ITER 560 NEW BEST:: SOT 972 SOS 487 HAS SOPS 487 HAS SOUS 481 HAS SOUPS 481 WITH SCORE 481.487
AT ITER 674 NEW BEST:: SOT 970 SOS 485 HAS SOPS 485 HAS SOUS 479 HAS SOUPS 479 WITH SCORE 479.485
AT ITER 713 NEW BEST:: SOT 969 SOS 487 HAS SOPS 487 HAS SOUS 478 HAS SOUPS 478 WITH SCORE 478.487
AT ITER 749 NEW BEST:: SOT 968 SOS 487 HAS SOPS 487 HAS SOUS 477 HAS SOUPS 477 WITH SCORE 477.487
AT ITER 810 NEW BEST:: SOT 963 SOS 486 HAS SOPS 486 HAS SOUS 476 HAS SOUPS 476 WITH SCORE 476.486
AT ITER 1162 NEW BEST:: SOT 962 SOS 485 HAS SOPS 485 HAS SOUS 475 HAS SOUPS 475 WITH SCORE 475.485
AT ITER 1367 NEW BEST:: SOT 961 SOS 484 HAS SOPS 484 HAS SOUS 474 HAS SOUPS 474 WITH SCORE 474.484
AT ITER 1556 NEW BEST:: SOT 961 SOS 483 HAS SOPS 483 HAS SOUS 472 HAS SOUPS 472 WITH SCORE 472.483
AT ITER 1558 NEW BEST:: SOT 961 SOS 482 HAS SOPS 482 HAS SOUS 471 HAS SOUPS 471 WITH SCORE 471.482
AT ITER 1683 NEW BEST:: SOT 960 SOS 481 HAS SOPS 481 HAS SOUS 470 HAS SOUPS 470 WITH SCORE 470.481
AT ITER 1749 NEW BEST:: SOT 958 SOS 479 HAS SOPS 479 HAS SOUS 468 HAS SOUPS 468 WITH SCORE 468.479
AT ITER 1946 NEW BEST:: SOT 956 SOS 477 HAS SOPS 477 HAS SOUS 466 HAS SOUPS 466 WITH SCORE 466.477
AT ITER 2191 NEW BEST:: SOT 954 SOS 479 HAS SOPS 479 HAS SOUS 465 HAS SOUPS 465 WITH SCORE 465.479
AT ITER 2209 NEW BEST:: SOT 953 SOS 480 HAS SOPS 480 HAS SOUS 464 HAS SOUPS 464 WITH SCORE 464.48
AT ITER 2444 NEW BEST:: SOT 952 SOS 479 HAS SOPS 479 HAS SOUS 463 HAS SOUPS 463 WITH SCORE 463.479
AT ITER 2491 NEW BEST:: SOT 952 SOS 478 HAS SOPS 478 HAS SOUS 463 HAS SOUPS 463 WITH SCORE 463.478
AT ITER 8143 NEW BEST:: SOT 952 SOS 477 HAS SOPS 477 HAS SOUS 462 HAS SOUPS 462 WITH SCORE 462.477
STATE_SPACE STATES 11776 TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
STATE_SPACE MAX_TOKEN_IN_PLACE 1 TECHNIQUES SEQUENTIAL_PROCESSING IMPLICIT RELATIONS DECISION_DIAGRAMS
STATE_SPACE MAX_TOKEN_PER_MARKING 27 TECHNIQUES SEQUENTIAL_PROCESSING IMPLICIT RELATIONS DECISION_DIAGRAMS
STATE_SPACE TRANSITIONS 56619 TECHNIQUES SEQUENTIAL_PROCESSING IMPLICIT RELATIONS DECISION_DIAGRAMS

BK_STOP 1679153617521

--------------------
content from stderr:

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="Sudoku-PT-AN03"
export BK_EXAMINATION="StateSpace"
export BK_TOOL="smart"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5348"
echo " Executing tool smart"
echo " Input is Sudoku-PT-AN03, examination is StateSpace"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 1"
echo " Run identifier is r483-tall-167912695300184"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/Sudoku-PT-AN03.tgz
mv Sudoku-PT-AN03 execution
cd execution
if [ "StateSpace" = "ReachabilityDeadlock" ] || [ "StateSpace" = "UpperBounds" ] || [ "StateSpace" = "QuasiLiveness" ] || [ "StateSpace" = "StableMarking" ] || [ "StateSpace" = "Liveness" ] || [ "StateSpace" = "OneSafe" ] || [ "StateSpace" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "StateSpace" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "StateSpace" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "StateSpace.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property StateSpace.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "StateSpace.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' StateSpace.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "StateSpace" = "ReachabilityDeadlock" ] || [ "StateSpace" = "QuasiLiveness" ] || [ "StateSpace" = "StableMarking" ] || [ "StateSpace" = "Liveness" ] || [ "StateSpace" = "OneSafe" ] ; then
echo "FORMULA_NAME StateSpace"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;