About the Execution of smart for Sudoku-PT-AN03
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
15766.240 | 3600000.00 | 3600049.00 | 0.00 | TFFTTF?????????? | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/data/fko/mcc2020-input.r224-oct2-159033538600331.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fko/mcc2020-input.qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
.......................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-4028
Executing tool smart
Input is Sudoku-PT-AN03, examination is CTLCardinality
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 1
Run identifier is r224-oct2-159033538600331
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 288K
-rw-r--r-- 1 mcc users 4.1K Jun 3 09:25 CTLCardinality.txt
-rw-r--r-- 1 mcc users 21K Jun 3 09:25 CTLCardinality.xml
-rw-r--r-- 1 mcc users 3.2K Jun 3 09:18 CTLFireability.txt
-rw-r--r-- 1 mcc users 20K Jun 3 09:18 CTLFireability.xml
-rw-r--r-- 1 mcc users 15K May 14 10:06 LTLCardinality.txt
-rw-r--r-- 1 mcc users 63K May 14 10:06 LTLCardinality.xml
-rw-r--r-- 1 mcc users 12K May 14 10:06 LTLFireability.txt
-rw-r--r-- 1 mcc users 49K May 14 10:06 LTLFireability.xml
-rw-r--r-- 1 mcc users 1 May 12 20:42 NewModel
-rw-r--r-- 1 mcc users 3.9K Jun 3 09:13 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 18K Jun 3 09:13 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 2.8K Jun 3 09:06 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 14K Jun 3 09:06 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.7K Jun 3 09:17 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.7K Jun 3 09:17 UpperBounds.xml
-rw-r--r-- 1 mcc users 5 May 12 20:42 equiv_col
-rw-r--r-- 1 mcc users 5 May 12 20:42 instance
-rw-r--r-- 1 mcc users 6 May 12 20:42 iscolored
-rw-r--r-- 1 mcc users 18K May 12 20:42 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-00
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-01
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-02
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-03
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-04
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-05
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-06
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-07
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-08
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-09
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-10
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-11
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-12
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-13
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-14
FORMULA_NAME Sudoku-PT-AN03-CTLCardinality-15
=== Now, execution of the tool begins
BK_START 1591336618084
======================================================
========== this is Smart for the MCC'2018 ============
======================================================
Running Sudoku (PT), instance AN03
Examination CTLCardinality
Parser /home/mcc/BenchKit/bin/parser/CTLCard.jar
Model checker /home/mcc/BenchKit/bin/rem_exec/smart
GOT IT HERE. BS
Petri model created: 54 places, 27 transitions, 108 arcs.
AT ITER 0 NEW BEST:: SOT 1004 SOS 557 HAS SOPS 557 HAS SOUS 557 HAS SOUPS 557 WITH SCORE 557.557
AT ITER 6 NEW BEST:: SOT 999 SOS 552 HAS SOPS 552 HAS SOUS 552 HAS SOUPS 552 WITH SCORE 552.552
AT ITER 34 NEW BEST:: SOT 996 SOS 555 HAS SOPS 555 HAS SOUS 549 HAS SOUPS 549 WITH SCORE 549.555
AT ITER 67 NEW BEST:: SOT 989 SOS 553 HAS SOPS 553 HAS SOUS 547 HAS SOUPS 547 WITH SCORE 547.553
AT ITER 68 NEW BEST:: SOT 993 SOS 554 HAS SOPS 554 HAS SOUS 546 HAS SOUPS 546 WITH SCORE 546.554
AT ITER 71 NEW BEST:: SOT 1003 SOS 553 HAS SOPS 553 HAS SOUS 545 HAS SOUPS 545 WITH SCORE 545.553
AT ITER 73 NEW BEST:: SOT 996 SOS 551 HAS SOPS 551 HAS SOUS 543 HAS SOUPS 543 WITH SCORE 543.551
AT ITER 81 NEW BEST:: SOT 995 SOS 550 HAS SOPS 550 HAS SOUS 542 HAS SOUPS 542 WITH SCORE 542.55
AT ITER 86 NEW BEST:: SOT 994 SOS 549 HAS SOPS 549 HAS SOUS 541 HAS SOUPS 541 WITH SCORE 541.549
AT ITER 87 NEW BEST:: SOT 1009 SOS 547 HAS SOPS 547 HAS SOUS 541 HAS SOUPS 541 WITH SCORE 541.547
AT ITER 91 NEW BEST:: SOT 1009 SOS 550 HAS SOPS 550 HAS SOUS 539 HAS SOUPS 539 WITH SCORE 539.55
AT ITER 93 NEW BEST:: SOT 1009 SOS 548 HAS SOPS 548 HAS SOUS 537 HAS SOUPS 537 WITH SCORE 537.548
AT ITER 98 NEW BEST:: SOT 1007 SOS 547 HAS SOPS 547 HAS SOUS 536 HAS SOUPS 536 WITH SCORE 536.547
AT ITER 110 NEW BEST:: SOT 1006 SOS 546 HAS SOPS 546 HAS SOUS 535 HAS SOUPS 535 WITH SCORE 535.546
AT ITER 129 NEW BEST:: SOT 999 SOS 537 HAS SOPS 537 HAS SOUS 526 HAS SOUPS 526 WITH SCORE 526.537
AT ITER 130 NEW BEST:: SOT 996 SOS 534 HAS SOPS 534 HAS SOUS 521 HAS SOUPS 521 WITH SCORE 521.534
AT ITER 164 NEW BEST:: SOT 995 SOS 533 HAS SOPS 533 HAS SOUS 520 HAS SOUPS 520 WITH SCORE 520.533
AT ITER 193 NEW BEST:: SOT 1002 SOS 532 HAS SOPS 532 HAS SOUS 519 HAS SOUPS 519 WITH SCORE 519.532
AT ITER 219 NEW BEST:: SOT 1002 SOS 530 HAS SOPS 530 HAS SOUS 517 HAS SOUPS 517 WITH SCORE 517.53
AT ITER 282 NEW BEST:: SOT 999 SOS 541 HAS SOPS 541 HAS SOUS 516 HAS SOUPS 516 WITH SCORE 516.541
AT ITER 291 NEW BEST:: SOT 997 SOS 540 HAS SOPS 540 HAS SOUS 515 HAS SOUPS 515 WITH SCORE 515.54
AT ITER 303 NEW BEST:: SOT 993 SOS 529 HAS SOPS 529 HAS SOUS 508 HAS SOUPS 508 WITH SCORE 508.529
AT ITER 335 NEW BEST:: SOT 984 SOS 526 HAS SOPS 526 HAS SOUS 505 HAS SOUPS 505 WITH SCORE 505.526
AT ITER 365 NEW BEST:: SOT 977 SOS 525 HAS SOPS 525 HAS SOUS 504 HAS SOUPS 504 WITH SCORE 504.525
AT ITER 385 NEW BEST:: SOT 977 SOS 522 HAS SOPS 522 HAS SOUS 501 HAS SOUPS 501 WITH SCORE 501.522
AT ITER 417 NEW BEST:: SOT 977 SOS 516 HAS SOPS 516 HAS SOUS 501 HAS SOUPS 501 WITH SCORE 501.516
AT ITER 435 NEW BEST:: SOT 977 SOS 513 HAS SOPS 513 HAS SOUS 498 HAS SOUPS 498 WITH SCORE 498.513
AT ITER 460 NEW BEST:: SOT 974 SOS 512 HAS SOPS 512 HAS SOUS 495 HAS SOUPS 495 WITH SCORE 495.512
AT ITER 461 NEW BEST:: SOT 972 SOS 510 HAS SOPS 510 HAS SOUS 493 HAS SOUPS 493 WITH SCORE 493.51
AT ITER 467 NEW BEST:: SOT 974 SOS 507 HAS SOPS 507 HAS SOUS 493 HAS SOUPS 493 WITH SCORE 493.507
AT ITER 515 NEW BEST:: SOT 969 SOS 505 HAS SOPS 505 HAS SOUS 491 HAS SOUPS 491 WITH SCORE 491.505
AT ITER 608 NEW BEST:: SOT 969 SOS 504 HAS SOPS 504 HAS SOUS 490 HAS SOUPS 490 WITH SCORE 490.504
AT ITER 636 NEW BEST:: SOT 969 SOS 502 HAS SOPS 502 HAS SOUS 489 HAS SOUPS 489 WITH SCORE 489.502
AT ITER 684 NEW BEST:: SOT 969 SOS 501 HAS SOPS 501 HAS SOUS 488 HAS SOUPS 488 WITH SCORE 488.501
AT ITER 721 NEW BEST:: SOT 968 SOS 500 HAS SOPS 500 HAS SOUS 487 HAS SOUPS 487 WITH SCORE 487.5
AT ITER 772 NEW BEST:: SOT 968 SOS 498 HAS SOPS 498 HAS SOUS 487 HAS SOUPS 487 WITH SCORE 487.498
AT ITER 821 NEW BEST:: SOT 967 SOS 497 HAS SOPS 497 HAS SOUS 486 HAS SOUPS 486 WITH SCORE 486.497
AT ITER 849 NEW BEST:: SOT 966 SOS 495 HAS SOPS 495 HAS SOUS 485 HAS SOUPS 485 WITH SCORE 485.495
AT ITER 939 NEW BEST:: SOT 972 SOS 493 HAS SOPS 493 HAS SOUS 483 HAS SOUPS 483 WITH SCORE 483.493
AT ITER 942 NEW BEST:: SOT 971 SOS 497 HAS SOPS 497 HAS SOUS 482 HAS SOUPS 482 WITH SCORE 482.497
AT ITER 949 NEW BEST:: SOT 969 SOS 495 HAS SOPS 495 HAS SOUS 480 HAS SOUPS 480 WITH SCORE 480.495
AT ITER 1089 NEW BEST:: SOT 969 SOS 495 HAS SOPS 495 HAS SOUS 479 HAS SOUPS 479 WITH SCORE 479.495
AT ITER 1093 NEW BEST:: SOT 969 SOS 494 HAS SOPS 494 HAS SOUS 475 HAS SOUPS 475 WITH SCORE 475.494
AT ITER 1262 NEW BEST:: SOT 975 SOS 496 HAS SOPS 496 HAS SOUS 474 HAS SOUPS 474 WITH SCORE 474.496
AT ITER 1273 NEW BEST:: SOT 974 SOS 495 HAS SOPS 495 HAS SOUS 473 HAS SOUPS 473 WITH SCORE 473.495
AT ITER 1332 NEW BEST:: SOT 974 SOS 491 HAS SOPS 491 HAS SOUS 472 HAS SOUPS 472 WITH SCORE 472.491
AT ITER 1357 NEW BEST:: SOT 965 SOS 490 HAS SOPS 490 HAS SOUS 471 HAS SOUPS 471 WITH SCORE 471.49
AT ITER 1358 NEW BEST:: SOT 965 SOS 489 HAS SOPS 489 HAS SOUS 470 HAS SOUPS 470 WITH SCORE 470.489
AT ITER 1549 NEW BEST:: SOT 964 SOS 488 HAS SOPS 488 HAS SOUS 469 HAS SOUPS 469 WITH SCORE 469.488
AT ITER 1892 NEW BEST:: SOT 964 SOS 487 HAS SOPS 487 HAS SOUS 468 HAS SOUPS 468 WITH SCORE 468.487
AT ITER 1996 NEW BEST:: SOT 963 SOS 486 HAS SOPS 486 HAS SOUS 467 HAS SOUPS 467 WITH SCORE 467.486
AT ITER 2142 NEW BEST:: SOT 961 SOS 485 HAS SOPS 485 HAS SOUS 466 HAS SOUPS 466 WITH SCORE 466.485
AT ITER 2961 NEW BEST:: SOT 960 SOS 484 HAS SOPS 484 HAS SOUS 465 HAS SOUPS 465 WITH SCORE 465.484
AT ITER 3420 NEW BEST:: SOT 960 SOS 483 HAS SOPS 483 HAS SOUS 464 HAS SOUPS 464 WITH SCORE 464.483
AT ITER 3823 NEW BEST:: SOT 960 SOS 481 HAS SOPS 481 HAS SOUS 462 HAS SOUPS 462 WITH SCORE 462.481
CTL Cardinality file is: CTLCardinality.xml
READY TO PARSE. BS
PROPERTY: Sudoku-PT-AN03-CTLCardinality-00 (AG( (! ( (! potential( ( 2 ) <= (tk(P20)) )) & ( potential( ( 3 ) <= (tk(P7)) ) & potential( (tk(P41)) <= (tk(P49)) ) ) ))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-01 (EX( ( ( ( potential( (tk(P16)) <= (tk(P7)) ) & potential( (tk(P39)) <= (tk(P35)) ) ) & potential( ( 3 ) <= (tk(P19)) ) ) | (EF(potential( ( 2 ) <= (tk(P46)) ))) )))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-02 (AU( ( ( potential( ( 2 ) <= (tk(P30)) ) | potential( (tk(P54)) <= (tk(P1)) ) ) | potential( (tk(P24)) <= (tk(P38)) ) ),(EF(potential( ( 3 ) <= (tk(P30)) ))) ))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-03 (! (EF((EG( potential( ( 2 ) <= (tk(P25)) ))))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-04 (! (! ( ( ( potential( ( 1 ) <= (tk(P19)) ) & potential( (tk(P35)) <= (tk(P8)) ) ) | potential( (tk(P21)) <= (tk(P28)) ) ) & (EG( potential( (tk(P17)) <= (tk(P1)) ))) )))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-05 (AG( (EF(potential( (tk(P13)) <= (tk(P17)) )))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-06 ( (EG( (! (! potential( (tk(P21)) <= (tk(P7)) ))))) | ( ( (! ( potential( (tk(P51)) <= (tk(P53)) ) | potential( ( 1 ) <= (tk(P1)) ) )) | (AF(potential( ( 2 ) <= (tk(P44)) ))) ) & ( potential( (tk(P1)) <= (tk(P5)) ) | ( (! potential( (tk(P45)) <= (tk(P17)) )) & ( potential( (tk(P43)) <= (tk(P16)) ) | potential( (tk(P40)) <= (tk(P2)) ) ) ) ) ) )
PROPERTY: Sudoku-PT-AN03-CTLCardinality-07 (AF(( (EG( potential( ( 3 ) <= (tk(P12)) ))) & ( potential( ( 1 ) <= (tk(P35)) ) | potential( ( 2 ) <= (tk(P9)) ) ) )))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-08 (AX( (AU( potential( (tk(P7)) <= (tk(P7)) ),potential( (tk(P16)) <= (tk(P23)) ) ))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-09 ( (EF(( potential( ( 3 ) <= (tk(P13)) ) & ( potential( ( 2 ) <= (tk(P44)) ) | potential( (tk(P16)) <= (tk(P51)) ) ) ))) | potential( ( 2 ) <= (tk(P51)) ) )
PROPERTY: Sudoku-PT-AN03-CTLCardinality-10 ( potential( ( 2 ) <= (tk(P29)) ) | (! (EG( potential( ( 1 ) <= (tk(P2)) )))) )
PROPERTY: Sudoku-PT-AN03-CTLCardinality-11 (AF(potential( (tk(P3)) <= (tk(P13)) )))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-12 (EG( ( ( potential( ( 2 ) <= (tk(P52)) ) & potential( (tk(P40)) <= (tk(P20)) ) ) | ( potential( (tk(P33)) <= (tk(P42)) ) | ( potential( ( 3 ) <= (tk(P10)) ) | potential( (tk(P39)) <= (tk(P22)) ) ) ) )))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-13 (! (EF((! (! potential( ( 3 ) <= (tk(P24)) ))))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-14 (AG( (EF(( potential( (tk(P17)) <= (tk(P51)) ) & potential( ( 1 ) <= (tk(P4)) ) )))))
PROPERTY: Sudoku-PT-AN03-CTLCardinality-15 ( ( ( (! potential( ( 2 ) <= (tk(P38)) )) | (! ( potential( ( 1 ) <= (tk(P30)) ) | potential( ( 2 ) <= (tk(P52)) ) )) ) & (AF(potential( ( 2 ) <= (tk(P49)) ))) ) | ( (AG( ( potential( (tk(P9)) <= (tk(P9)) ) & potential( ( 3 ) <= (tk(P18)) ) ))) | (! ( (! potential( (tk(P12)) <= (tk(P17)) )) | ( potential( (tk(P29)) <= (tk(P18)) ) | potential( ( 2 ) <= (tk(P50)) ) ) )) ) )
FORMULA Sudoku-PT-AN03-CTLCardinality-00 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
FORMULA Sudoku-PT-AN03-CTLCardinality-01 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
FORMULA Sudoku-PT-AN03-CTLCardinality-02 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
FORMULA Sudoku-PT-AN03-CTLCardinality-03 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
FORMULA Sudoku-PT-AN03-CTLCardinality-04 TRUE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
FORMULA Sudoku-PT-AN03-CTLCardinality-05 FALSE TECHNIQUES SEQUENTIAL_PROCESSING DECISION_DIAGRAMS
BK_TIME_CONFINEMENT_REACHED
--------------------
content from stderr:
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="Sudoku-PT-AN03"
export BK_EXAMINATION="CTLCardinality"
export BK_TOOL="smart"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-4028"
echo " Executing tool smart"
echo " Input is Sudoku-PT-AN03, examination is CTLCardinality"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 1"
echo " Run identifier is r224-oct2-159033538600331"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/Sudoku-PT-AN03.tgz
mv Sudoku-PT-AN03 execution
cd execution
if [ "CTLCardinality" = "ReachabilityDeadlock" ] || [ "CTLCardinality" = "UpperBounds" ] || [ "CTLCardinality" = "QuasiLiveness" ] || [ "CTLCardinality" = "StableMarking" ] || [ "CTLCardinality" = "Liveness" ] || [ "CTLCardinality" = "OneSafe" ] || [ "CTLCardinality" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLCardinality" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLCardinality" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLCardinality.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLCardinality.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLCardinality.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "CTLCardinality" = "ReachabilityDeadlock" ] || [ "CTLCardinality" = "QuasiLiveness" ] || [ "CTLCardinality" = "StableMarking" ] || [ "CTLCardinality" = "Liveness" ] || [ "CTLCardinality" = "OneSafe" ] ; then
echo "FORMULA_NAME CTLCardinality"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;