About the Execution of Tapaal for S_TriangularGrid-PT-4022
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
14313.360 | 2604853.00 | 2738152.00 | 616.00 | TFTFTTFTT?TTFFF? | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Waiting for the VM to be ready (probing ssh)
..................
=====================================================================
Generated by BenchKit 2-3253
Executing tool tapaal
Input is S_TriangularGrid-PT-4022, examination is CTLFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r159-ebro-149443465700346
=====================================================================
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-0
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-1
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-10
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-11
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-12
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-13
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-14
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-15
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-2
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-3
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-4
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-5
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-6
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-7
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-8
FORMULA_NAME TriangularGrid-PT-4022-CTLFireability-9
=== Now, execution of the tool begins
BK_START 1496270176164
---> tapaal --- TAPAAL
Total timeout: 3600
*************************************
* TAPAAL verifying CTLFireability *
*************************************
---------------------------------------------------
Step 1: Parallel processing
---------------------------------------------------
Doing parallel verification of individual queries (16 in total)
Each query is verified by 2 parallel strategies for 60 seconds
------------------- QUERY 1 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 1
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 1
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query is satisfied.
STATS:
Time (seconds): 0.03241
Configurations: 3348
Markings: 3185
Edges: 319
Processed Edges: 316
Processed N. Edges: 248
Explored Configs: 241
Query: !(AF!((!((tokens-count(pbl_4_1) ge integer-constant(1) & tokens-count(pi3_4_1) ge integer-constant(1))) | !(!(EF!((tokens-count(pbl_4_5) ge integer-constant(1) & tokens-count(pi1_4_5) ge integer-constant(1))))))))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 1
FORMULA TriangularGrid-PT-4022-CTLFireability-0 TRUE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 2 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 2
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 2
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=ENABLED,QSTimeout=30,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query before reduction: (AF (AF ((pbl_4_2 >= 1) and (po3_3_1 >= 1)) or (not (not ((pbl_2_2 >= 1) and (po3_1_1 >= 1))))) or (not AF (not (((pbl_2_3 >= 1) and (pi3_2_3 >= 1)) and ((pi2_4_7 >= 1) and (pbl_4_7 >= 1))))))
Query after reduction: (AF (AF ((pbl_4_2 >= 1) and (po3_3_1 >= 1)) or ((pbl_2_2 >= 1) and (po3_1_1 >= 1))) or EG (((pbl_2_3 >= 1) and (pi3_2_3 >= 1)) and ((pi2_4_7 >= 1) and (pbl_4_7 >= 1))))
Query size reduced from 34 to 34 nodes (0.00 percent reduction).
Query reduction finished after 0.019399 seconds.
Query is NOT satisfied.
STATS:
Time (seconds): 0.08848
Configurations: 12023
Markings: 6233
Edges: 668
Processed Edges: 734
Processed N. Edges: 3
Explored Configs: 501
Query: (AF(AF(tokens-count(pbl_4_2) ge integer-constant(1) & tokens-count(po3_3_1) ge integer-constant(1)) | (tokens-count(pbl_2_2) ge integer-constant(1) & tokens-count(po3_1_1) ge integer-constant(1))) | !(AF!(((tokens-count(pbl_2_3) ge integer-constant(1) & tokens-count(pi3_2_3) ge integer-constant(1)) & (tokens-count(pi2_4_7) ge integer-constant(1) & tokens-count(pbl_4_7) ge integer-constant(1))))))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 7250000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 2
FORMULA TriangularGrid-PT-4022-CTLFireability-1 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 3 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 3
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 3
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query is satisfied.
STATS:
Time (seconds): 0.1165
Configurations: 16813
Markings: 16764
Edges: 17855
Processed Edges: 921
Processed N. Edges: 0
Explored Configs: 461
Query: AX(EF(tokens-count(pbl_3_5) ge integer-constant(1) & tokens-count(pi3_3_5) ge integer-constant(1)) | (!(((tokens-count(po1_2_3) ge integer-constant(1) & tokens-count(pbl_2_2) ge integer-constant(1)) & (tokens-count(pb3_4_2) ge integer-constant(1) & tokens-count(pil3_3_1) ge integer-constant(1)))) & (!((tokens-count(pb2_4_6) ge integer-constant(1) & tokens-count(pil2_4_5) ge integer-constant(1))) | (tokens-count(po1_4_7) ge integer-constant(1) & tokens-count(pbl_4_6) ge integer-constant(1)))))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 3
FORMULA TriangularGrid-PT-4022-CTLFireability-2 TRUE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 4 ----------------------
No solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 4
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 4
------------------- QUERY 5 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 5
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 5
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=ENABLED,QSTimeout=30,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query before reduction: AX EX ((((pb2_4_5 >= 1) and (pol2_4_5 >= 1)) and ((pb3_3_4 >= 1) and (pil3_2_3 >= 1))) and (not ((po1_3_3 >= 1) and (pbl_3_2 >= 1))))
Query after reduction: AX EX ((((pb2_4_5 >= 1) and (pol2_4_5 >= 1)) and ((pb3_3_4 >= 1) and (pil3_2_3 >= 1))) and ((po1_3_3 < 1) or (pbl_3_2 < 1)))
Query size reduced from 25 to 25 nodes (0.00 percent reduction).
Query reduction finished after 0.009903 seconds.
Query is satisfied.
STATS:
Time (seconds): 0.001263
Configurations: 49
Markings: 235
Edges: 49
Processed Edges: 97
Processed N. Edges: 0
Explored Configs: 49
Query: AXEX(((tokens-count(pb2_4_5) ge integer-constant(1) & tokens-count(pol2_4_5) ge integer-constant(1)) & (tokens-count(pb3_3_4) ge integer-constant(1) & tokens-count(pil3_2_3) ge integer-constant(1))) & (tokens-count(po1_3_3) ls integer-constant(1) | tokens-count(pbl_3_2) ls integer-constant(1)))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 7250000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 5
FORMULA TriangularGrid-PT-4022-CTLFireability-4 TRUE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 6 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 6
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 6
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query is satisfied.
STATS:
Time (seconds): 0.01742
Configurations: 3342
Markings: 3185
Edges: 313
Processed Edges: 312
Processed N. Edges: 236
Explored Configs: 235
Query: !(AF!(EX(!((tokens-count(pbl_4_1) ge integer-constant(1) & tokens-count(pi3_4_1) ge integer-constant(1))) & (tokens-count(pil1_2_3) ge integer-constant(1) & tokens-count(pb1_2_2) ge integer-constant(1)))))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 6
FORMULA TriangularGrid-PT-4022-CTLFireability-5 TRUE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 7 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 7
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 7
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query is NOT satisfied.
STATS:
Time (seconds): 0.007281
Configurations: 97
Markings: 1261
Edges: 96
Processed Edges: 192
Processed N. Edges: 0
Explored Configs: 97
Query: EX((!(((tokens-count(pb2_3_3) ge integer-constant(1) & tokens-count(pol2_3_3) ge integer-constant(1)) & (tokens-count(pb1_4_5) ge integer-constant(1) & tokens-count(pol1_4_5) ge integer-constant(1)))) & (tokens-count(pbl_2_3) ge integer-constant(1) & tokens-count(pi3_2_3) ge integer-constant(1))) | EX((tokens-count(pi2_4_7) ge integer-constant(1) & tokens-count(pbl_4_7) ge integer-constant(1)) & (tokens-count(pbl_4_4) ge integer-constant(1) & tokens-count(po3_3_3) ge integer-constant(1))))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 7
FORMULA TriangularGrid-PT-4022-CTLFireability-6 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 8 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 8
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 8
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query is NOT satisfied.
STATS:
Time (seconds): 0.02837
Configurations: 3268
Markings: 3185
Edges: 160
Processed Edges: 240
Processed N. Edges: 0
Explored Configs: 160
Query: (((tokens-count(pb2_3_2) ge integer-constant(1) & tokens-count(pil2_3_1) ge integer-constant(1)) | AF!(EF!((tokens-count(pb2_1_1) ge integer-constant(1) & tokens-count(pol2_1_1) ge integer-constant(1))))) & (AFAX(tokens-count(pbl_3_4) ge integer-constant(1) & tokens-count(po2_3_3) ge integer-constant(1)) | ((!(((tokens-count(pb1_3_3) ge integer-constant(1) & tokens-count(pol1_3_3) ge integer-constant(1)) | (tokens-count(pbl_3_4) ge integer-constant(1) & tokens-count(po2_3_3) ge integer-constant(1)))) & (!((tokens-count(pbl_4_6) ge integer-constant(1) & tokens-count(po2_4_5) ge integer-constant(1))) & !((tokens-count(po1_2_1) ge integer-constant(1) & tokens-count(pil1_2_1) ge integer-constant(1))))) | AX((tokens-count(pbl_4_6) ge integer-constant(1) & tokens-count(po2_4_5) ge integer-constant(1)) | (tokens-count(po2_3_5) ge integer-constant(1) & tokens-count(pil2_3_5) ge integer-constant(1))))))
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=ENABLED,QSTimeout=30,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query before reduction: ((((pb2_3_2 >= 1) and (pil2_3_1 >= 1)) or AF AG ((pb2_1_1 >= 1) and (pol2_1_1 >= 1))) and (AF AX ((pbl_3_4 >= 1) and (po2_3_3 >= 1)) or (((not (((pb1_3_3 >= 1) and (pol1_3_3 >= 1)) or ((pbl_3_4 >= 1) and (po2_3_3 >= 1)))) and ((not ((pbl_4_6 >= 1) and (po2_4_5 >= 1))) and (not ((po1_2_1 >= 1) and (pil1_2_1 >= 1))))) or AX (((pbl_4_6 >= 1) and (po2_4_5 >= 1)) or ((po2_3_5 >= 1) and (pil2_3_5 >= 1))))))
Query after reduction: ((((pb2_3_2 >= 1) and (pil2_3_1 >= 1)) or AF AG ((pb2_1_1 >= 1) and (pol2_1_1 >= 1))) and (AF AX ((pbl_3_4 >= 1) and (po2_3_3 >= 1)) or (((((pb1_3_3 < 1) or (pol1_3_3 < 1)) and ((pbl_3_4 < 1) or (po2_3_3 < 1))) and (((pbl_4_6 < 1) or (po2_4_5 < 1)) and ((po1_2_1 < 1) or (pil1_2_1 < 1)))) or AX (((pbl_4_6 >= 1) and (po2_4_5 >= 1)) or ((po2_3_5 >= 1) and (pil2_3_5 >= 1))))))
Query size reduced from 76 to 76 nodes (0.00 percent reduction).
Query reduction finished after 0.026275 seconds.
Query is NOT satisfied.
STATS:
Time (seconds): 0.01722
Configurations: 3268
Markings: 3185
Edges: 160
Processed Edges: 240
Processed N. Edges: 0
Explored Configs: 160
Query: (((tokens-count(pb2_3_2) ge integer-constant(1) & tokens-count(pil2_3_1) ge integer-constant(1)) | AF!(EF!((tokens-count(pb2_1_1) ge integer-constant(1) & tokens-count(pol2_1_1) ge integer-constant(1))))) & (AFAX(tokens-count(pbl_3_4) ge integer-constant(1) & tokens-count(po2_3_3) ge integer-constant(1)) | ((((tokens-count(pb1_3_3) ls integer-constant(1) | tokens-count(pol1_3_3) ls integer-constant(1)) & (tokens-count(pbl_3_4) ls integer-constant(1) | tokens-count(po2_3_3) ls integer-constant(1))) & ((tokens-count(pbl_4_6) ls integer-constant(1) | tokens-count(po2_4_5) ls integer-constant(1)) & (tokens-count(po1_2_1) ls integer-constant(1) | tokens-count(pil1_2_1) ls integer-constant(1)))) | AX((tokens-count(pbl_4_6) ge integer-constant(1) & tokens-count(po2_4_5) ge integer-constant(1)) | (tokens-count(po2_3_5) ge integer-constant(1) & tokens-count(pil2_3_5) ge integer-constant(1))))))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 7250000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 8
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 8
FORMULA TriangularGrid-PT-4022-CTLFireability-7 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 9 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 9
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 9
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query is NOT satisfied.
STATS:
Time (seconds): 0.122
Configurations: 15520
Markings: 15525
Edges: 15570
Processed Edges: 2843
Processed N. Edges: 2
Explored Configs: 1417
Query: !(EFE((tokens-count(pbl_2_3) ge integer-constant(1) & tokens-count(pi2_2_3) ge integer-constant(1))) U ((tokens-count(pbl_3_1) ge integer-constant(1) & tokens-count(pi1_3_1) ge integer-constant(1))))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 9
FORMULA TriangularGrid-PT-4022-CTLFireability-8 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 10 ----------------------
No solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 10
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 10
------------------- QUERY 11 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 11
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 11
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query is satisfied.
STATS:
Time (seconds): 0.03594
Configurations: 3576
Markings: 3185
Edges: 547
Processed Edges: 780
Processed N. Edges: 236
Explored Configs: 469
Query: !(AF!(((AX(tokens-count(pbl_2_3) ge integer-constant(1) & tokens-count(pi3_2_3) ge integer-constant(1)) & (((tokens-count(pbl_2_1) ge integer-constant(1) & tokens-count(pi1_2_1) ge integer-constant(1)) & (tokens-count(pb2_3_5) ge integer-constant(1) & tokens-count(pol2_3_5) ge integer-constant(1))) & ((tokens-count(pbl_4_4) ge integer-constant(1) & tokens-count(po2_4_3) ge integer-constant(1)) & (tokens-count(pb1_4_1) ge integer-constant(1) & tokens-count(pol1_4_1) ge integer-constant(1))))) | (EX(tokens-count(pbl_4_6) ge integer-constant(1) & tokens-count(po2_4_5) ge integer-constant(1)) | (((tokens-count(pbl_1_1) ge integer-constant(1) & tokens-count(pi1_1_1) ge integer-constant(1)) | (tokens-count(pbl_2_3) ge integer-constant(1) & tokens-count(pi3_2_3) ge integer-constant(1))) & ((tokens-count(po2_2_3) ge integer-constant(1) & tokens-count(pil2_2_3) ge integer-constant(1)) | (tokens-count(pi2_4_7) ge integer-constant(1) & tokens-count(pbl_4_7) ge integer-constant(1))))))))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 11
FORMULA TriangularGrid-PT-4022-CTLFireability-10 TRUE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 12 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 12
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 12
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query is NOT satisfied.
STATS:
Time (seconds): 0.02113
Configurations: 3188
Markings: 3185
Edges: 81
Processed Edges: 80
Processed N. Edges: 4
Explored Configs: 81
Query: !(E((((tokens-count(pbl_4_6) ge integer-constant(1) & tokens-count(po2_4_5) ge integer-constant(1)) | (tokens-count(pbl_2_3) ge integer-constant(1) & tokens-count(pi1_2_3) ge integer-constant(1))) & ((tokens-count(po1_4_7) ge integer-constant(1) & tokens-count(pbl_4_6) ge integer-constant(1)) & (tokens-count(pbl_2_1) ge integer-constant(1) & tokens-count(pi1_2_1) ge integer-constant(1))))) U (!(AF!((tokens-count(pil1_2_3) ge integer-constant(1) & tokens-count(pb1_2_2) ge integer-constant(1))))))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 12
FORMULA TriangularGrid-PT-4022-CTLFireability-11 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 13 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 13
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 13
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query is satisfied.
STATS:
Time (seconds): 0.01663
Configurations: 3235
Markings: 3185
Edges: 128
Processed Edges: 80
Processed N. Edges: 2
Explored Configs: 80
Query: EF!(AF!(!(((tokens-count(pbl_4_4) ge integer-constant(1) & tokens-count(po2_4_3) ge integer-constant(1)) & (tokens-count(pbl_4_1) ge integer-constant(1) & tokens-count(pi2_4_1) ge integer-constant(1))))))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 13
FORMULA TriangularGrid-PT-4022-CTLFireability-12 TRUE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 14 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 14
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 14
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=DISABLED,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query is satisfied.
STATS:
Time (seconds): 0.000963
Configurations: 97
Markings: 191
Edges: 97
Processed Edges: 99
Processed N. Edges: 0
Explored Configs: 50
Query: EXAXEX(tokens-count(pb2_3_2) ge integer-constant(1) & tokens-count(pil2_3_1) ge integer-constant(1))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 14500000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -q\ 0\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 14
FORMULA TriangularGrid-PT-4022-CTLFireability-13 TRUE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 15 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 15
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 15
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=ENABLED,QSTimeout=30,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query before reduction: AF (((po1_3_5 >= 1) and (pbl_3_4 >= 1)) and (not EX ((po1_4_5 >= 1) and (pbl_4_4 >= 1))))
Query after reduction: AF (((po1_3_5 >= 1) and (pbl_3_4 >= 1)) and AX ((po1_4_5 < 1) or (pbl_4_4 < 1)))
Query size reduced from 17 to 17 nodes (0.00 percent reduction).
Query reduction finished after 0.005137 seconds.
Query is NOT satisfied.
STATS:
Time (seconds): 0.01661
Configurations: 3263
Markings: 3185
Edges: 156
Processed Edges: 234
Processed N. Edges: 0
Explored Configs: 156
Query: AF((tokens-count(po1_3_5) ge integer-constant(1) & tokens-count(pbl_3_4) ge integer-constant(1)) & AX(tokens-count(po1_4_5) ls integer-constant(1) | tokens-count(pbl_4_4) ls integer-constant(1)))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 7250000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 15
FORMULA TriangularGrid-PT-4022-CTLFireability-14 FALSE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
------------------- QUERY 16 ----------------------
Solution found
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "fr_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Parameters: -s DFS -d 10 ./model.pnml ./CTLFireability.xml -x 16
Parameters: -s DFS -q 0 -d 10 ./model.pnml ./CTLFireability.xml -x 16
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=10,Stubborn_Reduction=ENABLED,Query_Simplication=ENABLED,QSTimeout=30,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query before reduction: EX (EG ((pb1_2_3 >= 1) and (pol1_2_3 >= 1)) and (not AF ((pb2_3_5 >= 1) and (pol2_3_5 >= 1))))
Query after reduction: EX (EG ((pb1_2_3 >= 1) and (pol1_2_3 >= 1)) and EG ((pb2_3_5 < 1) or (pol2_3_5 < 1)))
Query size reduced from 18 to 18 nodes (0.00 percent reduction).
Query reduction finished after 0.005028 seconds.
Query is satisfied.
STATS:
Time (seconds): 0.04642
Configurations: 6671
Markings: 6549
Edges: 348
Processed Edges: 416
Processed N. Edges: 73
Explored Configs: 301
Query: EX(!(AF!((tokens-count(pb1_2_3) ge integer-constant(1) & tokens-count(pol1_2_3) ge integer-constant(1)))) & !(AF!((tokens-count(pb2_3_5) ls integer-constant(1) | tokens-count(pol2_3_5) ls integer-constant(1)))))
parallel: This job succeeded:
/home/mcc/BenchKit/start.sh 7250000 /home/mcc/BenchKit/bin/verifypn-linux64 -s\ DFS\ -d\ 10 ./model.pnml ./CTLFireability.xml -x 16
FORMULA TriangularGrid-PT-4022-CTLFireability-15 TRUE TECHNIQUES COLLATERAL_PROCESSING EXPLICIT STRUCTURAL_REDUCTION STATE_COMPRESSION STUBBORN_SETS
---------------------------------------------------
Step 2: Sequential processing
---------------------------------------------------
Remaining queries are verified sequentially.
Each query is verified for a dynamic timeout (at least 480 seconds)
------------------- QUERY 4 ----------------------
Running query 4 for 1737 seconds. Remaining: 2 queries and 3470 seconds
Parameters: -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 4
No solution found
------------------- QUERY 10 ----------------------
Running query 10 for 2608 seconds. Remaining: 1 queries and 2606 seconds
Parameters: -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 10
Search=DFS,Trace=DISABLED,State_Space_Exploration=DISABLED,Structural_Reduction=AGGRESSIVE,Struct_Red_Timout=100,Stubborn_Reduction=ENABLED,Query_Simplication=ENABLED,QSTimeout=100,Siphon_Trap=DISABLED,LPSolve_Timeout=10
Query before reduction: EX EG EF ((pbl_4_4 >= 1) and (po2_4_3 >= 1))
Query after reduction: EX EG EF ((pbl_4_4 >= 1) and (po2_4_3 >= 1))
Query size reduced from 10 to 10 nodes (0.00 percent reduction).
Query reduction finished after 0.003667 seconds.
No solution found
---------------------------------------------------
Step 3: Multiquery processing
---------------------------------------------------
Remaining 2 queries are solved using multiquery
Time remaining: 1857 seconds of the initial 3600 seconds
Running multiquery on -x 4,10 for 1857 seconds
Parameters: -s DFS -d 100 -q 100 -p ./model.pnml ./CTLFireability.xml -x 4,10
End of script.
BK_STOP 1496272781017
--------------------
content from stderr:
Command terminated by signal 11
Command being timed: "timeout 1737 /home/mcc/BenchKit/bin/verifypn-linux64 -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 4"
User time (seconds): 849.75
System time (seconds): 13.65
Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 14:23.99
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 14471596
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 3633823
Voluntary context switches: 3
Involuntary context switches: 2164
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
terminate called after throwing an instance of 'std::bad_alloc'
what(): std::bad_alloc
Command terminated by signal 6
Command being timed: "timeout 2608 /home/mcc/BenchKit/bin/verifypn-linux64 -s DFS -d 100 -q 100 ./model.pnml ./CTLFireability.xml -x 10"
User time (seconds): 739.02
System time (seconds): 10.52
Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 12:30.50
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 14484708
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 3628910
Voluntary context switches: 5
Involuntary context switches: 2128
Swaps: 0
File system inputs: 384
File system outputs: 8
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
Command terminated by signal 11
Command being timed: "timeout 1857 /home/mcc/BenchKit/bin/verifypn-linux64 -s DFS -d 100 -q 100 -p ./model.pnml ./CTLFireability.xml -x 4,10"
User time (seconds): 847.52
System time (seconds): 10.87
Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 14:19.54
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 14471604
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 3633821
Voluntary context switches: 3
Involuntary context switches: 2419
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="S_TriangularGrid-PT-4022"
export BK_EXAMINATION="CTLFireability"
export BK_TOOL="tapaal"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
tar xzf /home/mcc/BenchKit/INPUTS/S_TriangularGrid-PT-4022.tgz
mv S_TriangularGrid-PT-4022 execution
# this is for BenchKit: explicit launching of the test
cd execution
echo "====================================================================="
echo " Generated by BenchKit 2-3253"
echo " Executing tool tapaal"
echo " Input is S_TriangularGrid-PT-4022, examination is CTLFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r159-ebro-149443465700346"
echo "====================================================================="
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "CTLFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "CTLFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "CTLFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property CTLFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "CTLFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;