fond
Model Checking Contest 2020
10th edition, Paris, France, June 23, 2020
Execution of r224-oct2-159033538600331
Last Updated
Jun 28, 2020

About the Execution of smart for Sudoku-PT-AN03

Execution Summary
Max Memory
Used (MB)
Time wait (ms) CPU Usage (ms) I/O Wait (ms) Computed Result Execution
Status
15766.240 3600000.00 3600049.00 0.00 TFFTTF?????????? normal

Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Formatting '/data/fko/mcc2020-input.r224-oct2-159033538600331.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fko/mcc2020-input.qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
.......................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-4028
Executing tool smart
Input is Sudoku-PT-AN03, examination is CTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 1
Run identifier is r224-oct2-159033538600331
=====================================================================

--------------------
preparation of the directory to be used:
/home/mcc/execution
total 288K
-rw-r--r-- 1 mcc users 4.1K Jun 3 09:25 CTLCardinality.txt
-rw-r--r-- 1 mcc users 21K Jun 3 09:25 CTLCardinality.xml
-rw-r--r-- 1 mcc users 3.2K Jun 3 09:18 CTLFireability.txt
-rw-r--r-- 1 mcc users 20K Jun 3 09:18 CTLFireability.xml
-rw-r--r-- 1 mcc users 15K May 14 10:06 LTLCardinality.txt
-rw-r--r-- 1 mcc users 63K May 14 10:06 LTLCardinality.xml
-rw-r--r-- 1 mcc users 12K May 14 10:06 LTLFireability.txt
-rw-r--r-- 1 mcc users 49K May 14 10:06 LTLFireability.xml
-rw-r--r-- 1 mcc users 1 May 12 20:42 NewModel
-rw-r--r-- 1 mcc users 3.9K Jun 3 09:13 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 18K Jun 3 09:13 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 2.8K Jun 3 09:06 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 14K Jun 3 09:06 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.7K Jun 3 09:17 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K Jun 3 09:17 UpperBounds.xml
-rw-r--r-- 1 mcc users 5 May 12 20:42 equiv_col
-rw-r--r-- 1 mcc users 5 May 12 20:42 instance
-rw-r--r-- 1 mcc users 6 May 12 20:42 iscolored
-rw-r--r-- 1 mcc users 18K May 12 20:42 model.pnml

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-00
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-01
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-02
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-03
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-04
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-05
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-06
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-07
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-08
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-09
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-10
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-11
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-12
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-13
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-14
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-15

=== Now, execution of the tool begins

BK_START 1591336618084

======================================================
========== this is Smart for the MCC'2018 ============
======================================================
Running Sudoku (PT), instance AN03
Examination CTLCardinality
Parser /home/mcc/BenchKit/bin/parser/CTLCard.jar
Model checker /home/mcc/BenchKit/bin/rem_exec/smart

GOT IT HERE. BS
Petri model created: 54 places, 27 transitions, 108 arcs.
AT ITER 0 NEW BEST:: SOT 1004 SOS 557 HAS SOPS 557 HAS SOUS 557 HAS SOUPS 557 WITH SCORE 557.557
AT ITER 6 NEW BEST:: SOT 999 SOS 552 HAS SOPS 552 HAS SOUS 552 HAS SOUPS 552 WITH SCORE 552.552
AT ITER 34 NEW BEST:: SOT 996 SOS 555 HAS SOPS 555 HAS SOUS 549 HAS SOUPS 549 WITH SCORE 549.555
AT ITER 67 NEW BEST:: SOT 989 SOS 553 HAS SOPS 553 HAS SOUS 547 HAS SOUPS 547 WITH SCORE 547.553
AT ITER 68 NEW BEST:: SOT 993 SOS 554 HAS SOPS 554 HAS SOUS 546 HAS SOUPS 546 WITH SCORE 546.554
AT ITER 71 NEW BEST:: SOT 1003 SOS 553 HAS SOPS 553 HAS SOUS 545 HAS SOUPS 545 WITH SCORE 545.553
AT ITER 73 NEW BEST:: SOT 996 SOS 551 HAS SOPS 551 HAS SOUS 543 HAS SOUPS 543 WITH SCORE 543.551
AT ITER 81 NEW BEST:: SOT 995 SOS 550 HAS SOPS 550 HAS SOUS 542 HAS SOUPS 542 WITH SCORE 542.55
AT ITER 86 NEW BEST:: SOT 994 SOS 549 HAS SOPS 549 HAS SOUS 541 HAS SOUPS 541 WITH SCORE 541.549
AT ITER 87 NEW BEST:: SOT 1009 SOS 547 HAS SOPS 547 HAS SOUS 541 HAS SOUPS 541 WITH SCORE 541.547
AT ITER 91 NEW BEST:: SOT 1009 SOS 550 HAS SOPS 550 HAS SOUS 539 HAS SOUPS 539 WITH SCORE 539.55
AT ITER 93 NEW BEST:: SOT 1009 SOS 548 HAS SOPS 548 HAS SOUS 537 HAS SOUPS 537 WITH SCORE 537.548
AT ITER 98 NEW BEST:: SOT 1007 SOS 547 HAS SOPS 547 HAS SOUS 536 HAS SOUPS 536 WITH SCORE 536.547
AT ITER 110 NEW BEST:: SOT 1006 SOS 546 HAS SOPS 546 HAS SOUS 535 HAS SOUPS 535 WITH SCORE 535.546
AT ITER 129 NEW BEST:: SOT 999 SOS 537 HAS SOPS 537 HAS SOUS 526 HAS SOUPS 526 WITH SCORE 526.537
AT ITER 130 NEW BEST:: SOT 996 SOS 534 HAS SOPS 534 HAS SOUS 521 HAS SOUPS 521 WITH SCORE 521.534
AT ITER 164 NEW BEST:: SOT 995 SOS 533 HAS SOPS 533 HAS SOUS 520 HAS SOUPS 520 WITH SCORE 520.533
AT ITER 193 NEW BEST:: SOT 1002 SOS 532 HAS SOPS 532 HAS SOUS 519 HAS SOUPS 519 WITH SCORE 519.532
AT ITER 219 NEW BEST:: SOT 1002 SOS 530 HAS SOPS 530 HAS SOUS 517 HAS SOUPS 517 WITH SCORE 517.53
AT ITER 282 NEW BEST:: SOT 999 SOS 541 HAS SOPS 541 HAS SOUS 516 HAS SOUPS 516 WITH SCORE 516.541
AT ITER 291 NEW BEST:: SOT 997 SOS 540 HAS SOPS 540 HAS SOUS 515 HAS SOUPS 515 WITH SCORE 515.54
AT ITER 303 NEW BEST:: SOT 993 SOS 529 HAS SOPS 529 HAS SOUS 508 HAS SOUPS 508 WITH SCORE 508.529
AT ITER 335 NEW BEST:: SOT 984 SOS 526 HAS SOPS 526 HAS SOUS 505 HAS SOUPS 505 WITH SCORE 505.526
AT ITER 365 NEW BEST:: SOT 977 SOS 525 HAS SOPS 525 HAS SOUS 504 HAS SOUPS 504 WITH SCORE 504.525
AT ITER 385 NEW BEST:: SOT 977 SOS 522 HAS SOPS 522 HAS SOUS 501 HAS SOUPS 501 WITH SCORE 501.522
AT ITER 417 NEW BEST:: SOT 977 SOS 516 HAS SOPS 516 HAS SOUS 501 HAS SOUPS 501 WITH SCORE 501.516
AT ITER 435 NEW BEST:: SOT 977 SOS 513 HAS SOPS 513 HAS SOUS 498 HAS SOUPS 498 WITH SCORE 498.513
AT ITER 460 NEW BEST:: SOT 974 SOS 512 HAS SOPS 512 HAS SOUS 495 HAS SOUPS 495 WITH SCORE 495.512
AT ITER 461 NEW BEST:: SOT 972 SOS 510 HAS SOPS 510 HAS SOUS 493 HAS SOUPS 493 WITH SCORE 493.51
AT ITER 467 NEW BEST:: SOT 974 SOS 507 HAS SOPS 507 HAS SOUS 493 HAS SOUPS 493 WITH SCORE 493.507
AT ITER 515 NEW BEST:: SOT 969 SOS 505 HAS SOPS 505 HAS SOUS 491 HAS SOUPS 491 WITH SCORE 491.505
AT ITER 608 NEW BEST:: SOT 969 SOS 504 HAS SOPS 504 HAS SOUS 490 HAS SOUPS 490 WITH SCORE 490.504
AT ITER 636 NEW BEST:: SOT 969 SOS 502 HAS SOPS 502 HAS SOUS 489 HAS SOUPS 489 WITH SCORE 489.502
AT ITER 684 NEW BEST:: SOT 969 SOS 501 HAS SOPS 501 HAS SOUS 488 HAS SOUPS 488 WITH SCORE 488.501
AT ITER 721 NEW BEST:: SOT 968 SOS 500 HAS SOPS 500 HAS SOUS 487 HAS SOUPS 487 WITH SCORE 487.5
AT ITER 772 NEW BEST:: SOT 968 SOS 498 HAS SOPS 498 HAS SOUS 487 HAS SOUPS 487 WITH SCORE 487.498
AT ITER 821 NEW BEST:: SOT 967 SOS 497 HAS SOPS 497 HAS SOUS 486 HAS SOUPS 486 WITH SCORE 486.497
AT ITER 849 NEW BEST:: SOT 966 SOS 495 HAS SOPS 495 HAS SOUS 485 HAS SOUPS 485 WITH SCORE 485.495
AT ITER 939 NEW BEST:: SOT 972 SOS 493 HAS SOPS 493 HAS SOUS 483 HAS SOUPS 483 WITH SCORE 483.493
AT ITER 942 NEW BEST:: SOT 971 SOS 497 HAS SOPS 497 HAS SOUS 482 HAS SOUPS 482 WITH SCORE 482.497
AT ITER 949 NEW BEST:: SOT 969 SOS 495 HAS SOPS 495 HAS SOUS 480 HAS SOUPS 480 WITH SCORE 480.495
AT ITER 1089 NEW BEST:: SOT 969 SOS 495 HAS SOPS 495 HAS SOUS 479 HAS SOUPS 479 WITH SCORE 479.495
AT ITER 1093 NEW BEST:: SOT 969 SOS 494 HAS SOPS 494 HAS SOUS 475 HAS SOUPS 475 WITH SCORE 475.494
AT ITER 1262 NEW BEST:: SOT 975 SOS 496 HAS SOPS 496 HAS SOUS 474 HAS SOUPS 474 WITH SCORE 474.496
AT ITER 1273 NEW BEST:: SOT 974 SOS 495 HAS SOPS 495 HAS SOUS 473 HAS SOUPS 473 WITH SCORE 473.495
AT ITER 1332 NEW BEST:: SOT 974 SOS 491 HAS SOPS 491 HAS SOUS 472 HAS SOUPS 472 WITH SCORE 472.491
AT ITER 1357 NEW BEST:: SOT 965 SOS 490 HAS SOPS 490 HAS SOUS 471 HAS SOUPS 471 WITH SCORE 471.49
AT ITER 1358 NEW BEST:: SOT 965 SOS 489 HAS SOPS 489 HAS SOUS 470 HAS SOUPS 470 WITH SCORE 470.489
AT ITER 1549 NEW BEST:: SOT 964 SOS 488 HAS SOPS 488 HAS SOUS 469 HAS SOUPS 469 WITH SCORE 469.488
AT ITER 1892 NEW BEST:: SOT 964 SOS 487 HAS SOPS 487 HAS SOUS 468 HAS SOUPS 468 WITH SCORE 468.487
AT ITER 1996 NEW BEST:: SOT 963 SOS 486 HAS SOPS 486 HAS SOUS 467 HAS SOUPS 467 WITH SCORE 467.486
AT ITER 2142 NEW BEST:: SOT 961 SOS 485 HAS SOPS 485 HAS SOUS 466 HAS SOUPS 466 WITH SCORE 466.485
AT ITER 2961 NEW BEST:: SOT 960 SOS 484 HAS SOPS 484 HAS SOUS 465 HAS SOUPS 465 WITH SCORE 465.484
AT ITER 3420 NEW BEST:: SOT 960 SOS 483 HAS SOPS 483 HAS SOUS 464 HAS SOUPS 464 WITH SCORE 464.483
AT ITER 3823 NEW BEST:: SOT 960 SOS 481 HAS SOPS 481 HAS SOUS 462 HAS SOUPS 462 WITH SCORE 462.481
CTL Cardinality file is: CTLCardinality.xml
READY TO PARSE. BS
PROPERTY: Sudoku-PT-AN03-CTLCardinality-00 (AG( (! ( (! potential( ( 2 ) <= (tk(P20)) )) & ( potential( ( 3 ) <= (tk(P7)) ) & potential( (tk(P41)) <= (tk(P49)) ) ) ))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-01 (EX( ( ( ( potential( (tk(P16)) <= (tk(P7)) ) & potential( (tk(P39)) <= (tk(P35)) ) ) & potential( ( 3 ) <= (tk(P19)) ) ) | (EF(potential( ( 2 ) <= (tk(P46)) ))) )))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-02 (AU( ( ( potential( ( 2 ) <= (tk(P30)) ) | potential( (tk(P54)) <= (tk(P1)) ) ) | potential( (tk(P24)) <= (tk(P38)) ) ),(EF(potential( ( 3 ) <= (tk(P30)) ))) ))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-03 (! (EF((EG( potential( ( 2 ) <= (tk(P25)) ))))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-04 (! (! ( ( ( potential( ( 1 ) <= (tk(P19)) ) & potential( (tk(P35)) <= (tk(P8)) ) ) | potential( (tk(P21)) <= (tk(P28)) ) ) & (EG( potential( (tk(P17)) <= (tk(P1)) ))) )))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-05 (AG( (EF(potential( (tk(P13)) <= (tk(P17)) )))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-06 ( (EG( (! (! potential( (tk(P21)) <= (tk(P7)) ))))) | ( ( (! ( potential( (tk(P51)) <= (tk(P53)) ) | potential( ( 1 ) <= (tk(P1)) ) )) | (AF(potential( ( 2 ) <= (tk(P44)) ))) ) & ( potential( (tk(P1)) <= (tk(P5)) ) | ( (! potential( (tk(P45)) <= (tk(P17)) )) & ( potential( (tk(P43)) <= (tk(P16)) ) | potential( (tk(P40)) <= (tk(P2)) ) ) ) ) ) )
PROPERTY: Sudoku-PT-AN03-CTLCardinality-07 (AF(( (EG( potential( ( 3 ) <= (tk(P12)) ))) & ( potential( ( 1 ) <= (tk(P35)) ) | potential( ( 2 ) <= (tk(P9)) ) ) )))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-08 (AX( (AU( potential( (tk(P7)) <= (tk(P7)) ),potential( (tk(P16)) <= (tk(P23)) ) ))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-09 ( (EF(( potential( ( 3 ) <= (tk(P13)) ) & ( potential( ( 2 ) <= (tk(P44)) ) | potential( (tk(P16)) <= (tk(P51)) ) ) ))) | potential( ( 2 ) <= (tk(P51)) ) )
PROPERTY: Sudoku-PT-AN03-CTLCardinality-10 ( potential( ( 2 ) <= (tk(P29)) ) | (! (EG( potential( ( 1 ) <= (tk(P2)) )))) )
PROPERTY: Sudoku-PT-AN03-CTLCardinality-11 (AF(potential( (tk(P3)) <= (tk(P13)) )))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-12 (EG( ( ( potential( ( 2 ) <= (tk(P52)) ) & potential( (tk(P40)) <= (tk(P20)) ) ) | ( potential( (tk(P33)) <= (tk(P42)) ) | ( potential( ( 3 ) <= (tk(P10)) ) | potential( (tk(P39)) <= (tk(P22)) ) ) ) )))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-13 (! (EF((! (! potential( ( 3 ) <= (tk(P24)) ))))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-14 (AG( (EF(( potential( (tk(P17)) <= (tk(P51)) ) & potential( ( 1 ) <= (tk(P4)) ) )))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-15 ( ( ( (! potential( ( 2 ) <= (tk(P38)) )) | (! ( potential( ( 1 ) <= (tk(P30)) ) | potential( ( 2 ) <= (tk(P52)) ) )) ) & (AF(potential( ( 2 ) <= (tk(P49)) ))) ) | ( (AG( ( potential( (tk(P9)) <= (tk(P9)) ) & potential( ( 3 ) <= (tk(P18)) ) ))) | (! ( (! potential( (tk(P12)) <= (tk(P17)) )) | ( potential( (tk(P29)) <= (tk(P18)) ) | potential( ( 2 ) <= (tk(P50)) ) ) )) ) )
FORMULA Sudoku-PT-AN03-CTLCardinality-00 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
FORMULA Sudoku-PT-AN03-CTLCardinality-01 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
FORMULA Sudoku-PT-AN03-CTLCardinality-02 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
FORMULA Sudoku-PT-AN03-CTLCardinality-03 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
FORMULA Sudoku-PT-AN03-CTLCardinality-04 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
FORMULA Sudoku-PT-AN03-CTLCardinality-05 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS

BK_TIME_CONFINEMENT_REACHED

--------------------
content from stderr:

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="Sudoku-PT-AN03"
export BK_EXAMINATION="CTLCardinality"
export BK_TOOL="smart"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool smart"
echo " Input is Sudoku-PT-AN03, examination is CTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 1"
echo " Run identifier is r224-oct2-159033538600331"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"

tar xzf /home/mcc/BenchKit/INPUTS/Sudoku-PT-AN03.tgz
mv Sudoku-PT-AN03 execution
cd execution
if [ "CTLCardinality" = "ReachabilityDeadlock" ] || [ "CTLCardinality" = "UpperBounds" ] || [ "CTLCardinality" = "QuasiLiveness" ] || [ "CTLCardinality" = "StableMarking" ] || [ "CTLCardinality" = "Liveness" ] || [ "CTLCardinality" = "OneSafe" ] || [ "CTLCardinality" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh

echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' CTLCardinality.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ "CTLCardinality" = "ReachabilityDeadlock" ] || [ "CTLCardinality" = "QuasiLiveness" ] || [ "CTLCardinality" = "StableMarking" ] || [ "CTLCardinality" = "Liveness" ] || [ "CTLCardinality" = "OneSafe" ] ; then
echo "FORMULA_NAME CTLCardinality"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;