Execution Chart

We display below the execution chart for this examination (boot time has been removed).

Trace from the execution

Waiting for the VM to be ready (probing ssh)
......
=====================================================================
Generated by BenchKit 2-3254
Executing tool tapaal
Input is S_Eratosthenes-PT-200, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r109-blw3-149441613300337
=====================================================================

--------------------
content from stdout:

=== Data for post analysis generated by BenchKit (invocation template)

The expected result is a vector of booleans
BOOL_VECTOR

here is the order used to build the result vector(from text file)
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-0
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-1
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-10
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-11
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-12
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-13
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-14
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-15
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-2
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-3
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-4
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-5
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-6
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-7
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-8
FORMULA_NAME Eratosthenes-PT-200-CTLFireability-9

=== Now, execution of the tool begins

BK_START 1495127336385

---> tapaal --- TAPAAL
Total timeout: 3600

*************************************
* TAPAAL verifying CTLFireability *
*************************************
---------------------------------------------------
Step 1: Parallel processing
---------------------------------------------------
Doing parallel verification of individual queries (16 in total)
Each query is verified by 2 parallel strategies for 60 seconds
------------------- QUERY 1 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 1

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 1


------------------- QUERY 2 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 2

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 2


------------------- QUERY 3 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 3

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 3


------------------- QUERY 4 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 4

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 4


------------------- QUERY 5 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 5

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 5


------------------- QUERY 6 ----------------------
Solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 6

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 6

Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10


Query is NOT satisfied.

STATS:
Time (seconds): 0.04089
Configurations: 10661
Markings: 10456
Edges: 39482
Processed Edges: 507
Processed N. Edges: 307
Explored Configs: 307
Query: !(EF!(E(((tokens-count(p116) ge integer-constant(1) & tokens-count(p4) ge integer-constant(1)) & (tokens-count(p196) ge integer-constant(1) & tokens-count(p98) ge integer-constant(1)))) U (((tokens-count(p65) ge integer-constant(1) & tokens-count(p5) ge integer-constant(1)) | (tokens-count(p3) ge integer-constant(1) & tokens-count(p135) ge integer-constant(1))))))

parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 6

FORMULA Eratosthenes-PT-200-CTLFireability-5 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 7 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 7

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 7


------------------- QUERY 8 ----------------------
Solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 8

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 8

Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10


Query is NOT satisfied.

STATS:
Time (seconds): 0.04181
Configurations: 11839
Markings: 11782
Edges: 228
Processed Edges: 456
Processed N. Edges: 0
Explored Configs: 229
Query: AX(((!((tokens-count(p21) ge integer-constant(1) & tokens-count(p84) ge integer-constant(1))) & ((tokens-count(p150) ge integer-constant(1) & tokens-count(p2) ge integer-constant(1)) | (tokens-count(p29) ge integer-constant(1) & tokens-count(p87) ge integer-constant(1)))) | AF(tokens-count(p170) ge integer-constant(1) & tokens-count(p2) ge integer-constant(1))) & ((((tokens-count(p5) ge integer-constant(1) & tokens-count(p130) ge integer-constant(1)) & (tokens-count(p49) ge integer-constant(1) & tokens-count(p98) ge integer-constant(1))) | ((tokens-count(p156) ge integer-constant(1) & tokens-count(p26) ge integer-constant(1)) | (tokens-count(p76) ge integer-constant(1) & tokens-count(p4) ge integer-constant(1)))) | AF(tokens-count(p162) ge integer-constant(1) & tokens-count(p18) ge integer-constant(1))))

parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 8

FORMULA Eratosthenes-PT-200-CTLFireability-7 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 9 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 9

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 9


------------------- QUERY 10 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 10

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 10


------------------- QUERY 11 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 11

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 11


------------------- QUERY 12 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 12

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 12


------------------- QUERY 13 ----------------------
Solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 13

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 13

Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10


Query is satisfied.

STATS:
Time (seconds): 0.045
Configurations: 12013
Markings: 11782
Edges: 33818
Processed Edges: 529
Processed N. Edges: 225
Explored Configs: 305
Query: ((tokens-count(p64) ge integer-constant(1) & tokens-count(p4) ge integer-constant(1)) & !(!(EF!(AF(tokens-count(p123) ge integer-constant(1) & tokens-count(p3) ge integer-constant(1))))))

parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 13

FORMULA Eratosthenes-PT-200-CTLFireability-12 TRUE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 14 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 14

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 14


------------------- QUERY 15 ----------------------
Solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 15

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 15

Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10


Query is NOT satisfied.

STATS:
Time (seconds): 0.03883
Configurations: 4904
Markings: 4761
Edges: 20536
Processed Edges: 315
Processed N. Edges: 108
Explored Configs: 178
Query: !(EF!((((tokens-count(p9) ge integer-constant(1) & tokens-count(p135) ge integer-constant(1)) | !(AF!((tokens-count(p34) ge integer-constant(1) & tokens-count(p102) ge integer-constant(1))))) & AX((tokens-count(p150) ge integer-constant(1) & tokens-count(p30) ge integer-constant(1)) | (tokens-count(p122) ge integer-constant(1) & tokens-count(p61) ge integer-constant(1))))))

parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 15

FORMULA Eratosthenes-PT-200-CTLFireability-14 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 16 ----------------------
No solution found

Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 16

Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 16


---------------------------------------------------
Step 2: Sequential processing
---------------------------------------------------
Remaining queries are verified sequentially.
Each query is verified for a dynamic timeout (at least 480 seconds)
------------------- QUERY 1 ----------------------
Running query 1 for 482 seconds. Remaining: 12 queries and 2853 seconds

Parameters: -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 1
No solution found
------------------- QUERY 2 ----------------------
Running query 2 for 482 seconds. Remaining: 11 queries and 2370 seconds

Parameters: -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 2
No solution found
------------------- QUERY 3 ----------------------
Running query 3 for 482 seconds. Remaining: 10 queries and 1888 seconds

Parameters: -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 3
No solution found
------------------- QUERY 4 ----------------------
Running query 4 for 482 seconds. Remaining: 9 queries and 1406 seconds

Parameters: -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 4
No solution found
------------------- QUERY 5 ----------------------
Running query 5 for 482 seconds. Remaining: 8 queries and 970 seconds

Parameters: -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 5
No solution found
------------------- QUERY 7 ----------------------
Running query 7 for 482 seconds. Remaining: 7 queries and 528 seconds

Parameters: -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 7
No solution found
------------------- QUERY 9 ----------------------
Running query 9 for 47 seconds. Remaining: 6 queries and 45 seconds

Parameters: -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 9

BK_TIME_CONFINEMENT_REACHED

--------------------
content from stderr:

Command exited with non-zero status 124
Command being timed: "timeout 482 /home/mcc/BenchKit/bin/verifypn-linux64 -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 1"
User time (seconds): 475.98
System time (seconds): 5.93
Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 8:02.39
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 14137268
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 3566574
Voluntary context switches: 4
Involuntary context switches: 1528
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 124
Command exited with non-zero status 124
Command being timed: "timeout 482 /home/mcc/BenchKit/bin/verifypn-linux64 -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 2"
User time (seconds): 477.00
System time (seconds): 5.35
Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 8:02.37
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 13284012
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 3320740
Voluntary context switches: 4
Involuntary context switches: 892
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 124
Command exited with non-zero status 124
Command being timed: "timeout 482 /home/mcc/BenchKit/bin/verifypn-linux64 -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 3"
User time (seconds): 477.08
System time (seconds): 5.24
Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 8:02.38
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 13297540
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 3324121
Voluntary context switches: 4
Involuntary context switches: 968
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 124
Command terminated by signal 11
Command being timed: "timeout 482 /home/mcc/BenchKit/bin/verifypn-linux64 -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 4"
User time (seconds): 430.41
System time (seconds): 5.60
Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 7:16.04
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 14499476
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 3624599
Voluntary context switches: 3
Involuntary context switches: 794
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
Command terminated by signal 11
Command being timed: "timeout 482 /home/mcc/BenchKit/bin/verifypn-linux64 -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 5"
User time (seconds): 436.14
System time (seconds): 5.44
Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 7:21.71
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 14499368
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 3624573
Voluntary context switches: 3
Involuntary context switches: 917
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
Command exited with non-zero status 124
Command being timed: "timeout 482 /home/mcc/BenchKit/bin/verifypn-linux64 -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 7"
User time (seconds): 477.16
System time (seconds): 5.20
Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 8:02.38
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 13346896
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 3368981
Voluntary context switches: 4
Involuntary context switches: 1088
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 124

Sequence of Actions to be Executed by the VM

This is useful if one wants to reexecute the tool in the VM from the submitted image disk.

set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="S_Eratosthenes-PT-200"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="tapaal"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"

# this is specific to your benchmark or test

export BIN_DIR="$HOME/BenchKit/bin"

# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi

tar xzf /home/mcc/BenchKit/INPUTS/S_Eratosthenes-PT-200.tgz
mv S_Eratosthenes-PT-200 execution

# this is for BenchKit: explicit launching of the test

cd execution
echo "====================================================================="
echo " Generated by BenchKit 2-3254"
echo " Executing tool tapaal"
echo " Input is S_Eratosthenes-PT-200, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r109-blw3-149441613300337"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '' CTLFireability.xml | cut -d '>' -f 2 | cut -d '<' -f 1 | sort -u) ; do
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;