About the Execution of ITS-Tools for SemanticWebServices-PT-S256P15
Execution Summary | |||||
Max Memory Used (MB) |
Time wait (ms) | CPU Usage (ms) | I/O Wait (ms) | Computed Result | Execution Status |
2639.079 | 54058.00 | 138221.00 | 476.90 | FTTFFTFTTFTTTFFF | normal |
Execution Chart
We display below the execution chart for this examination (boot time has been removed).
Trace from the execution
Formatting '/data/fkordon/mcc2023-input.r357-smll-167891806400447.qcow2', fmt=qcow2 size=4294967296 backing_file=/data/fkordon/mcc2023-input.qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16
Waiting for the VM to be ready (probing ssh)
.............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
=====================================================================
Generated by BenchKit 2-5348
Executing tool itstools
Input is SemanticWebServices-PT-S256P15, examination is ReachabilityFireability
Time confinement is 3600 seconds
Memory confinement is 16384 MBytes
Number of cores is 4
Run identifier is r357-smll-167891806400447
=====================================================================
--------------------
preparation of the directory to be used:
/home/mcc/execution
total 32M
-rw-r--r-- 1 mcc users 6.0K Feb 26 10:19 CTLCardinality.txt
-rw-r--r-- 1 mcc users 60K Feb 26 10:19 CTLCardinality.xml
-rw-r--r-- 1 mcc users 6.2K Feb 26 10:18 CTLFireability.txt
-rw-r--r-- 1 mcc users 55K Feb 26 10:18 CTLFireability.xml
-rw-r--r-- 1 mcc users 3.5K Feb 25 16:51 LTLCardinality.txt
-rw-r--r-- 1 mcc users 24K Feb 25 16:51 LTLCardinality.xml
-rw-r--r-- 1 mcc users 2.4K Feb 25 16:51 LTLFireability.txt
-rw-r--r-- 1 mcc users 16K Feb 25 16:51 LTLFireability.xml
-rw-r--r-- 1 mcc users 11K Feb 26 10:21 ReachabilityCardinality.txt
-rw-r--r-- 1 mcc users 103K Feb 26 10:21 ReachabilityCardinality.xml
-rw-r--r-- 1 mcc users 6.7K Feb 26 10:20 ReachabilityFireability.txt
-rw-r--r-- 1 mcc users 48K Feb 26 10:20 ReachabilityFireability.xml
-rw-r--r-- 1 mcc users 1.8K Feb 25 16:51 UpperBounds.txt
-rw-r--r-- 1 mcc users 3.9K Feb 25 16:51 UpperBounds.xml
-rw-r--r-- 1 mcc users 6 Mar 5 18:23 equiv_col
-rw-r--r-- 1 mcc users 8 Mar 5 18:23 instance
-rw-r--r-- 1 mcc users 6 Mar 5 18:23 iscolored
-rw-r--r-- 1 mcc users 32M Mar 5 18:23 model.pnml
--------------------
content from stdout:
=== Data for post analysis generated by BenchKit (invocation template)
The expected result is a vector of booleans
BOOL_VECTOR
here is the order used to build the result vector(from text file)
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-00
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-01
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-02
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-03
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-04
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-05
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-06
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-07
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-08
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-09
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-10
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-11
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-12
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-13
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-14
FORMULA_NAME SemanticWebServices-PT-S256P15-ReachabilityFireability-15
=== Now, execution of the tool begins
BK_START 1679244589882
bash -c /home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n "BK_STOP " ; date -u +%s%3N
Invoking MCC driver with
BK_TOOL=itstools
BK_EXAMINATION=ReachabilityFireability
BK_BIN_PATH=/home/mcc/BenchKit/bin/
BK_TIME_CONFINEMENT=3600
BK_INPUT=SemanticWebServices-PT-S256P15
Not applying reductions.
Model is PT
ReachabilityFireability PT
Running Version 202303021504
[2023-03-19 16:49:53] [INFO ] Running its-tools with arguments : [-pnfolder, /home/mcc/execution, -examination, ReachabilityFireability, -its, -ltsmin, -greatspnpath, /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/, -order, META, -manyOrder, -smt, -timeout, 3600]
[2023-03-19 16:49:53] [INFO ] Parsing pnml file : /home/mcc/execution/model.pnml
[2023-03-19 16:49:55] [INFO ] Load time of PNML (sax parser for PT used): 1582 ms
[2023-03-19 16:49:55] [INFO ] Transformed 329 places.
[2023-03-19 16:49:55] [INFO ] Transformed 29492 transitions.
[2023-03-19 16:49:55] [INFO ] Parsed PT model containing 329 places and 29492 transitions and 267319 arcs in 1922 ms.
Parsed 16 properties from file /home/mcc/execution/ReachabilityFireability.xml in 23 ms.
Working with output stream class java.io.PrintStream
Deduced a syphon composed of 5 places in 46 ms
Reduce places removed 5 places and 2050 transitions.
Ensure Unique test removed 6828 transitions
Reduce redundant transitions removed 6828 transitions.
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-00 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-13 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-14 FALSE TECHNIQUES TOPOLOGICAL INITIAL_STATE
Incomplete random walk after 10004 steps, including 2 resets, run finished after 2068 ms. (steps per millisecond=4 ) properties (out of 13) seen :12
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-12 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-11 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-10 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-09 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-08 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-07 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-06 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-05 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-04 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-03 FALSE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-02 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-01 TRUE TECHNIQUES TOPOLOGICAL RANDOM_WALK
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 27 ms. (steps per millisecond=370 ) properties (out of 1) seen :0
Running SMT prover for 1 properties.
[2023-03-19 16:49:58] [INFO ] Flow matrix only has 1901 transitions (discarded 18713 similar events)
// Phase 1: matrix 1901 rows 324 cols
[2023-03-19 16:49:58] [INFO ] Computed 36 place invariants in 70 ms
[2023-03-19 16:49:58] [INFO ] Flatten gal took : 1254 ms
[2023-03-19 16:49:58] [INFO ] [Real]Absence check using 2 positive place invariants in 3 ms returned sat
[2023-03-19 16:49:58] [INFO ] [Real]Absence check using 2 positive and 34 generalized place invariants in 10 ms returned sat
[2023-03-19 16:49:59] [INFO ] Flatten gal took : 956 ms
[2023-03-19 16:49:59] [INFO ] Time to serialize gal into /tmp/ReachabilityCardinality17214216754775056147.gal : 218 ms
[2023-03-19 16:49:59] [INFO ] Time to serialize properties into /tmp/ReachabilityCardinality4618197719669738531.prop : 1 ms
Invoking ITS tools like this :cd /home/mcc/execution;'/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202303021504/bin/its-reach-linux64' '--gc-threshold' '2000000' '--quiet' '-i' '/tmp/ReachabilityCardinality17214216754775056147.gal' '-t' 'CGAL' '-reachable-file' '/tmp/ReachabilityCardinality4618197719669738531.prop' '--nowitness' '--gen-order' 'FOLLOW'
its-reach command run as :
/home/mcc/BenchKit/itstools/itstools/plugins/fr.lip6.move.gal.itstools.binaries_1.0.0.202303021504/bin/its-reach-linux64 --gc-threshold 2000000 --quiet ...329
[2023-03-19 16:49:59] [INFO ] After 1734ms SMT Verify possible using all constraints in real domain returned unsat :0 sat :0 real:1
[2023-03-19 16:50:00] [INFO ] [Nat]Absence check using 2 positive place invariants in 2 ms returned sat
[2023-03-19 16:50:00] [INFO ] [Nat]Absence check using 2 positive and 34 generalized place invariants in 21 ms returned sat
[2023-03-19 16:50:01] [INFO ] After 939ms SMT Verify possible using state equation in natural domain returned unsat :0 sat :1
[2023-03-19 16:50:01] [INFO ] State equation strengthened by 1044 read => feed constraints.
Loading property file /tmp/ReachabilityCardinality4618197719669738531.prop.
[2023-03-19 16:50:04] [INFO ] After 2462ms SMT Verify possible using 1044 Read/Feed constraints in natural domain returned unsat :0 sat :1
[2023-03-19 16:50:04] [INFO ] After 2931ms SMT Verify possible using trap constraints in natural domain returned unsat :0 sat :1
Attempting to minimize the solution found.
Minimization took 276 ms.
[2023-03-19 16:50:05] [INFO ] After 5180ms SMT Verify possible using all constraints in natural domain returned unsat :0 sat :1
Parikh walk visited 0 properties in 62 ms.
Support contains 11 out of 324 places. Attempting structural reductions.
Starting structural reductions in REACHABILITY mode, iteration 0 : 324/324 places, 20614/20614 transitions.
Graph (complete) has 3631 edges and 324 vertex of which 194 are kept as prefixes of interest. Removing 130 places using SCC suffix rule.93 ms
Discarding 130 places :
Also discarding 91 output transitions
Drop transitions removed 91 transitions
Drop transitions removed 689 transitions
Ensure Unique test removed 509 transitions
Reduce isomorphic transitions removed 1198 transitions.
Iterating post reduction 0 with 1198 rules applied. Total rules applied 1199 place count 194 transition count 19325
Discarding 19 places :
Symmetric choice reduction at 1 with 19 rule applications. Total rules 1218 place count 175 transition count 14520
Iterating global reduction 1 with 19 rules applied. Total rules applied 1237 place count 175 transition count 14520
Ensure Unique test removed 1271 transitions
Reduce isomorphic transitions removed 1271 transitions.
Iterating post reduction 1 with 1271 rules applied. Total rules applied 2508 place count 175 transition count 13249
SDD proceeding with computation,1 properties remain. new max is 4
SDD size :1 after 9
SDD proceeding with computation,1 properties remain. new max is 8
SDD size :9 after 18
SDD proceeding with computation,1 properties remain. new max is 16
SDD size :18 after 4056
SDD proceeding with computation,1 properties remain. new max is 32
SDD size :4056 after 447444
Drop transitions removed 3121 transitions
Redundant transition composition rules discarded 3121 transitions
Iterating global reduction 2 with 3121 rules applied. Total rules applied 5629 place count 175 transition count 10128
Reduce places removed 7 places and 0 transitions.
Drop transitions removed 205 transitions
Ensure Unique test removed 395 transitions
Reduce isomorphic transitions removed 600 transitions.
Iterating post reduction 2 with 607 rules applied. Total rules applied 6236 place count 168 transition count 9528
Discarding 14 places :
Symmetric choice reduction at 3 with 14 rule applications. Total rules 6250 place count 154 transition count 7959
Iterating global reduction 3 with 14 rules applied. Total rules applied 6264 place count 154 transition count 7959
Ensure Unique test removed 1352 transitions
Reduce isomorphic transitions removed 1352 transitions.
Iterating post reduction 3 with 1352 rules applied. Total rules applied 7616 place count 154 transition count 6607
Discarding 1 places :
Symmetric choice reduction at 4 with 1 rule applications. Total rules 7617 place count 153 transition count 6543
Iterating global reduction 4 with 1 rules applied. Total rules applied 7618 place count 153 transition count 6543
Ensure Unique test removed 6 transitions
Reduce isomorphic transitions removed 6 transitions.
Iterating post reduction 4 with 6 rules applied. Total rules applied 7624 place count 153 transition count 6537
Drop transitions removed 488 transitions
Redundant transition composition rules discarded 488 transitions
Iterating global reduction 5 with 488 rules applied. Total rules applied 8112 place count 153 transition count 6049
Reduce places removed 2 places and 0 transitions.
Drop transitions removed 2 transitions
Ensure Unique test removed 103 transitions
Reduce isomorphic transitions removed 105 transitions.
Iterating post reduction 5 with 107 rules applied. Total rules applied 8219 place count 151 transition count 5944
Discarding 1 places :
Symmetric choice reduction at 6 with 1 rule applications. Total rules 8220 place count 150 transition count 5936
Iterating global reduction 6 with 1 rules applied. Total rules applied 8221 place count 150 transition count 5936
Ensure Unique test removed 32 transitions
Reduce isomorphic transitions removed 32 transitions.
Iterating post reduction 6 with 32 rules applied. Total rules applied 8253 place count 150 transition count 5904
Drop transitions removed 52 transitions
Redundant transition composition rules discarded 52 transitions
Iterating global reduction 7 with 52 rules applied. Total rules applied 8305 place count 150 transition count 5852
Applied a total of 8305 rules in 7582 ms. Remains 150 /324 variables (removed 174) and now considering 5852/20614 (removed 14762) transitions.
[2023-03-19 16:50:12] [INFO ] Flow matrix only has 1061 transitions (discarded 4791 similar events)
Normalized transition count is 1060 out of 1061 initially.
// Phase 1: matrix 1060 rows 150 cols
[2023-03-19 16:50:12] [INFO ] Computed 0 place invariants in 12 ms
[2023-03-19 16:50:15] [INFO ] Dead Transitions using invariants and state equation in 2474 ms found 0 transitions.
Finished structural reductions in REACHABILITY mode , in 1 iterations and 10061 ms. Remains : 150/324 places, 5852/20614 transitions.
Incomplete random walk after 10002 steps, including 2 resets, run finished after 519 ms. (steps per millisecond=19 ) properties (out of 1) seen :0
Incomplete Best-First random walk after 10001 steps, including 2 resets, run finished after 11 ms. (steps per millisecond=909 ) properties (out of 1) seen :0
Interrupted probabilistic random walk after 2020455 steps, run timeout after 3001 ms. (steps per millisecond=673 ) properties seen :{}
Probabilistic random walk after 2020455 steps, saw 1992343 distinct states, run finished after 3002 ms. (steps per millisecond=673 ) properties seen :0
Running SMT prover for 1 properties.
[2023-03-19 16:50:18] [INFO ] Flow matrix only has 1061 transitions (discarded 4791 similar events)
[2023-03-19 16:50:18] [INFO ] Invariant cache hit.
[2023-03-19 16:50:19] [INFO ] After 376ms SMT Verify possible using all constraints in real domain returned unsat :0 sat :0 real:1
[2023-03-19 16:50:19] [INFO ] After 386ms SMT Verify possible using state equation in natural domain returned unsat :0 sat :1
[2023-03-19 16:50:20] [INFO ] State equation strengthened by 531 read => feed constraints.
[2023-03-19 16:50:20] [INFO ] After 757ms SMT Verify possible using 531 Read/Feed constraints in natural domain returned unsat :0 sat :1
[2023-03-19 16:50:21] [INFO ] After 998ms SMT Verify possible using trap constraints in natural domain returned unsat :0 sat :1
Attempting to minimize the solution found.
Minimization took 132 ms.
[2023-03-19 16:50:21] [INFO ] After 1959ms SMT Verify possible using all constraints in natural domain returned unsat :0 sat :1
Parikh walk visited 0 properties in 11 ms.
Support contains 11 out of 150 places. Attempting structural reductions.
Starting structural reductions in REACHABILITY mode, iteration 0 : 150/150 places, 5852/5852 transitions.
Applied a total of 0 rules in 1259 ms. Remains 150 /150 variables (removed 0) and now considering 5852/5852 (removed 0) transitions.
Finished structural reductions in REACHABILITY mode , in 1 iterations and 1260 ms. Remains : 150/150 places, 5852/5852 transitions.
Starting structural reductions in REACHABILITY mode, iteration 0 : 150/150 places, 5852/5852 transitions.
Applied a total of 0 rules in 834 ms. Remains 150 /150 variables (removed 0) and now considering 5852/5852 (removed 0) transitions.
[2023-03-19 16:50:23] [INFO ] Flow matrix only has 1061 transitions (discarded 4791 similar events)
[2023-03-19 16:50:23] [INFO ] Invariant cache hit.
[2023-03-19 16:50:23] [INFO ] Implicit Places using invariants in 579 ms returned []
[2023-03-19 16:50:23] [INFO ] Flow matrix only has 1061 transitions (discarded 4791 similar events)
[2023-03-19 16:50:23] [INFO ] Invariant cache hit.
[2023-03-19 16:50:24] [INFO ] State equation strengthened by 531 read => feed constraints.
[2023-03-19 16:50:26] [INFO ] Implicit Places using invariants and state equation in 2190 ms returned []
Implicit Place search using SMT with State Equation took 2774 ms to find 0 implicit places.
[2023-03-19 16:50:39] [INFO ] Redundant transitions in 13260 ms returned [46, 47, 50, 51, 52, 53, 55, 56, 58, 59, 63, 76, 79, 83, 84, 85, 89, 90, 93, 94, 95, 98, 99, 100, 101, 104, 106, 107, 109, 110, 112, 118, 119, 120, 121, 122, 123, 128, 129, 131, 134, 141, 143, 145, 152, 165, 166, 172, 173, 174, 183, 184, 185, 186, 187, 188, 189, 190, 191, 198, 199, 202, 203, 205, 206, 207, 208, 209, 211, 212, 213, 214, 218, 219, 221, 222, 223, 224, 227, 228, 229, 230, 231, 232, 234, 236, 237, 238, 239, 240, 242, 243, 244, 245, 246, 247, 248, 250, 251, 252, 256, 257, 258, 259, 260, 264, 265, 266, 267, 268, 270, 271, 272, 273, 274, 275, 279, 281, 284, 287, 288, 289, 290, 292, 298, 299, 300, 301, 304, 305, 306, 309, 310, 312, 313, 314, 315, 316, 318, 319, 320, 321, 322, 324, 325, 330, 331, 332, 333, 334, 336, 337, 344, 345, 346, 352, 353, 354, 355, 356, 358, 359, 360, 361, 363, 365, 366, 367, 368, 369, 370, 371, 372, 373, 374, 375, 376, 379, 380, 381, 382, 383, 384, 385, 386, 390, 391, 392, 393, 394, 395, 396, 397, 398, 399, 400, 401, 402, 403, 404, 405, 406, 408, 409, 410, 411, 413, 414, 415, 416, 417, 418, 419, 420, 421, 425, 426, 427, 429, 430, 431, 432, 433, 434, 435, 436, 437, 438, 439, 440, 441, 442, 443, 444, 445, 446, 448, 449, 450, 451, 452, 453, 454, 455, 457, 458, 459, 462, 464, 465, 466, 467, 469, 470, 471, 472, 473, 474, 475, 476, 477, 478, 479, 480, 484, 485, 486, 487, 488, 489, 492, 493, 495, 496, 497, 498, 502, 514, 516, 518, 519, 521, 522, 523, 524, 525, 527, 599, 600, 601, 602, 603, 604, 605, 606, 607, 608, 609, 610, 611, 612, 613, 614, 615, 616, 617, 618, 619, 620, 621, 622, 623, 624, 625, 626, 627, 628, 629, 630, 631, 632, 633, 635, 636, 637, 638, 639, 640, 641, 642, 643, 645, 646, 648, 649, 650, 651, 652, 653, 654, 656, 657, 658, 659, 660, 661, 662, 663, 664, 665, 666, 668, 669, 670, 671, 672, 673, 674, 675, 676, 677, 678, 680, 681, 683, 684, 685, 686, 687, 688, 689, 690, 691, 692, 693, 694, 695, 696, 697, 698, 699, 700, 701, 703, 704, 705, 706, 707, 708, 709, 710, 867, 868, 875, 876, 877, 878, 879, 880, 882, 883, 886, 887, 888, 889, 890, 891, 894, 895, 896, 897, 898, 899, 900, 901, 904, 905, 906, 907, 908, 909, 911, 912, 958, 976, 977, 978, 982, 990, 991, 992, 996, 997, 998, 1001, 1003, 1004, 1005, 1011, 1012, 1023, 1024, 1025, 1026, 1027, 1028, 1040, 1041, 1042, 1043, 1044, 1045, 1046, 1047, 1048, 1049, 1050, 1051, 1052, 1053, 1054, 1066, 1067, 1068, 1069, 1070, 1071, 1072, 1073, 1074, 1075, 1076, 1077, 1078, 1079, 1080, 1081, 1082, 1083, 1084, 1085, 1102, 1103, 1104, 1105, 1106, 1107, 1108, 1109, 1110, 1111, 1112, 1113, 1114, 1115, 1116, 1137, 1138, 1139, 1140, 1141, 1142, 1158, 1165, 1168, 1169, 1170, 1171, 1174, 1176, 1177, 1179, 1180, 1181, 1184, 1187, 1190, 1192, 1193, 1196, 1202, 1204, 1206, 1208, 1211, 1214, 1216, 1218, 1221, 1225, 1230, 1235, 1236, 1237, 1238, 1239, 1242, 1244, 1246, 1250, 1251, 1253, 1254, 1256, 1258, 1260, 1262, 1264, 1267, 1270, 1272, 1274, 1277, 1281, 1286, 1287, 1288, 1289, 1290, 1291, 1292, 1293, 1294, 1295, 1299, 1305, 1306, 1307, 1309, 1310, 1311, 1313, 1314, 1316, 1318, 1320, 1321, 1323, 1324, 1326, 1328, 1330, 1332, 1334, 1337, 1342, 1344, 1345, 1346, 1348, 1349, 1350, 1351, 1352, 1353, 1362, 1363, 1364, 1365, 1367, 1368, 1369, 1370, 1372, 1373, 1374, 1376, 1377, 1379, 1381, 1386, 1389, 1391, 1392, 1393, 1402, 1403, 1404, 1405, 1406, 1408, 1413, 1419, 1427, 1437, 1438, 1439, 1440, 1445, 1450, 1459, 1460, 1461, 1463, 1464, 1465, 1473, 1474, 1475, 1476, 1484, 1485, 1486, 1487, 1492, 1497, 1500, 1501, 1502, 1511, 1512, 1513, 1515, 1516, 1517, 1525, 1526, 1527, 1529, 1530, 1531, 1539, 1540, 1541, 1542, 1545, 1552, 1555, 1556, 1557, 1563, 1566, 1567, 1568, 1577, 1578, 1579, 1581, 1582, 1583, 1589, 1594, 1601, 1604, 1605, 1606, 1609, 1610, 1619, 1622, 1624, 1625, 1627, 1628, 1635, 1636, 1638, 1639, 1659, 2082, 2110, 2112, 2114, 2123, 2165, 2166, 2168, 2173, 2175, 2177, 2240, 2242, 2243, 2245, 2309, 2356, 2367, 2368, 2369, 2370, 2371, 2372, 2376, 2378, 2379, 2381, 2382, 2383, 2385, 2386, 2387, 2388, 2390, 2391, 2392, 2393, 2394, 2398, 2401, 2403, 2404, 2407, 2409, 2410, 2412, 2413, 2414, 2417, 2419, 2420, 2422, 2423, 2424, 2426, 2427, 2428, 2429, 2434, 2438, 2441, 2443, 2444, 2448, 2451, 2453, 2454, 2457, 2459, 2460, 2462, 2463, 2464, 2471, 2476, 2480, 2483, 2485, 2486, 2487, 2502, 2503, 2504, 2505, 2506, 2507, 2508, 2509, 2512, 2538, 2539, 2540, 2541, 2542, 2543, 2545, 2546, 2547, 2548, 2549, 2550, 2551, 2552, 2553, 2554, 2555, 2556, 2557, 2558, 2559, 2561, 2562, 2563, 2566, 2571, 2576, 2616, 2617, 2618, 2619, 2620, 2621, 2622, 2623, 2624, 2625, 2626, 2627, 2628, 2629, 2630, 2631, 2632, 2635, 2636, 2638, 2639, 2640, 2641, 2642, 2643, 2644, 2645, 2646, 2647, 2649, 2650, 2651, 2652, 2653, 2654, 2655, 2656, 2657, 2658, 2659, 2660, 2661, 2664, 2665, 2666, 2669, 2672, 2675, 2676, 2677, 2680, 2683, 2687, 2688, 2689, 2692, 2695, 2698, 2703, 2742, 2743, 2744, 2745, 2746, 2747, 2748, 2749, 2750, 2751, 2752, 2753, 2754, 2755, 2756, 2757, 2758, 2759, 2760, 2761, 2762, 2763, 2764, 2765, 2766, 2767, 2768, 2769, 2770, 2771, 2772, 2773, 2777, 2778, 2780, 2781, 2782, 2783, 2784, 2785, 2786, 2787, 2788, 2791, 2792, 2794, 2795, 2796, 2797, 2798, 2799, 2800, 2801, 2802, 2803, 2804, 2806, 2807, 2808, 2811, 2812, 2813, 2815, 2816, 2817, 2820, 2821, 2822, 2823, 2826, 2827, 2828, 2830, 2831, 2832, 2835, 2838, 2840, 2841, 2842, 2845, 2846, 2847, 2849, 2850, 2851, 2853, 2854, 2855, 2858, 2861, 2864, 2865, 2866, 2869, 2872, 2876, 2900, 2901, 2902, 2903, 2904, 2905, 2906, 2907, 2908, 2909, 2910, 2911, 2912, 2913, 2914, 2915, 2916, 2917, 2918, 2919, 2920, 2921, 2922, 2923, 2924, 2925, 2926, 2927, 2928, 2929, 2930, 2931, 2932, 2933, 2934, 2935, 2936, 2937, 2938, 2939, 2940, 2941, 2942, 2943, 2944, 2948, 2949, 2951, 2952, 2953, 2954, 2955, 2959, 2960, 2962, 2963, 2964, 2965, 2966, 2967, 2968, 2969, 2970, 2971, 2973, 2974, 2975, 2977, 2978, 2979, 2982, 2983, 2984, 2985, 2987, 2988, 2989, 2991, 2992, 2993, 2996, 2997, 2998, 3000, 3001, 3002, 3005, 3006, 3008, 3009, 3010, 3012, 3013, 3014, 3016, 3017, 3018, 3021, 3022, 3023, 3025, 3026, 3027, 3030, 3031, 3032, 3033, 3036, 3037, 3038, 3040, 3041, 3042, 3045, 3047, 3048, 3049, 3052, 3055, 3064, 3065, 3066, 3067, 3068, 3069, 3070, 3071, 3072, 3073, 3074, 3075, 3076, 3077, 3078, 3079, 3080, 3081, 3082, 3083, 3084, 3085, 3086, 3087, 3088, 3089, 3090, 3091, 3092, 3093, 3094, 3095, 3096, 3097, 3098, 3099, 3100, 3101, 3102, 3103, 3104, 3105, 3106, 3107, 3108, 3109, 3110, 3111, 3112, 3116, 3117, 3121, 3122, 3124, 3125, 3126, 3127, 3128, 3129, 3131, 3133, 3134, 3135, 3137, 3139, 3141, 3142, 3143, 3145, 3146, 3147, 3150, 3151, 3152, 3153, 3155, 3157, 3159, 3160, 3161, 3163, 3164, 3165, 3168, 3169, 3170, 3171, 3173, 3174, 3175, 3177, 3178, 3179, 3182, 3183, 3184, 3185, 3186, 3187, 3190, 3191, 3192, 3194, 3195, 3196, 3199, 3201, 3202, 3203, 3204, 3205, 3206, 3207, 3208, 3209, 3210, 3211, 3212, 3213, 3214, 3215, 3216, 3217, 3218, 3219, 3220, 3221, 3222, 3223, 3224, 3225, 3226, 3227, 3228, 3229, 3230, 3231, 3232, 3233, 3234, 3235, 3236, 3237, 3238, 3239, 3240, 3241, 3242, 3247, 3248, 3249, 3251, 3253, 3255, 3256, 3257, 3259, 3261, 3263, 3264, 3265, 3267, 3269, 3271, 3272, 3273, 3275, 3277, 3278, 3279, 3281, 3282, 3283, 3286, 3287, 3288, 3289, 3290, 3291, 3292, 3293, 3294, 3295, 3296, 3297, 3298, 3299, 3300, 3301, 3302, 3303, 3304, 3305, 3306, 3307, 3308, 3309, 3310, 3311, 3312, 3313, 3314, 3315, 3316, 3318, 3320, 3322, 3324, 3326, 3328, 3329, 3330, 3332, 3333, 3334, 3335, 3336, 3337, 3338, 3339, 3340, 3341, 3342, 3343, 3344, 3345, 3346, 3348, 3349, 3350, 3351, 3352, 3353, 3361, 3362, 3366, 3373, 3374, 3375, 3376, 3377, 3383, 3384, 3387, 3388, 3389, 3391, 3393, 3400, 3401, 3402, 3403, 3404, 3405, 3412, 3413, 3414, 3415, 3416, 3419, 3420, 3421, 3422, 3426, 3427, 3428, 3431, 3432, 3433, 3435, 3440, 3441, 3442, 3443, 3444, 3445, 3452, 3453, 3454, 3455, 3456, 3457, 3460, 3461, 3462, 3463, 3468, 3469, 3470, 3471, 3475, 3476, 3477, 3478, 3482, 3483, 3484, 3486, 3487, 3488, 3489, 3494, 3495, 3496, 3497, 3498, 3499, 3501, 3502, 3503, 3508, 3509, 3510, 3511, 3516, 3517, 3518, 3519, 3524, 3525, 3526, 3527, 3529, 3531, 3532, 3533, 3534, 3535, 3539, 3540, 3541, 3545, 3546, 3547, 3552, 3553, 3554, 3555, 3558, 3560, 3563, 3567, 3568, 3569, 3572, 3575, 3579, 3580, 3581, 3582, 3584, 3585, 3587, 3589, 3591, 3592, 3594, 3595, 3596, 3597, 3598, 3599, 3600, 3601, 3603, 3604, 3606, 3607, 3608, 3610, 3612, 3613, 3614, 3616, 3618, 3620, 3621, 3622, 3623, 3624, 3625, 3626, 3627, 3628, 3629, 3630, 3631, 3632, 3633, 3634, 3635, 3636, 3638, 3639, 3640, 3642, 3643, 3645, 3646, 3647, 3648, 3650, 3651, 3653, 3654, 3655, 3657, 3659, 3660, 3661, 3662, 3663, 3664, 3665, 3666, 3667, 3668, 3669, 3670, 3671, 3672, 3673, 3674, 3675, 3676, 3677, 3678, 3679, 3680, 3681, 3682, 3683, 3684, 3685, 3686, 3687, 3689, 3690, 3691, 3692, 3693, 3694, 3696, 3697, 3698, 3700, 3701, 3703, 3704, 3705, 3706, 3707, 3708, 3709, 3710, 3711, 3712, 3713, 3714, 3715, 3716, 3717, 3718, 3719, 3720, 3721, 3722, 3723, 3724, 3725, 3726, 3727, 3728, 3729, 3730, 3731, 3732, 3733, 3734, 3735, 3736, 3737, 3738, 3739, 3741, 3742, 3743, 3744, 3745, 3746, 3747, 3748, 3749, 3750, 3751, 3752, 3753, 3754, 3755, 3757, 3758, 3759, 3760, 3761, 3762, 3763, 3764, 3765, 3766, 3767, 3768, 3774, 3775, 3812, 3813, 3814, 3815, 3816, 3817, 3818, 3819, 3820, 3821, 3822, 3823, 3824, 3825, 3826, 3827, 3828, 3829, 3830, 3831, 3832, 3833, 3834, 3835, 3836, 3837, 3838, 3839, 3840, 3841, 3842, 3843, 3844, 3845, 3846, 3847, 3848, 3849, 3850, 3851, 3852, 3853, 3854, 3855, 3856, 3857, 3858, 3859, 3860, 3861, 3862, 3863, 3864, 3865, 3866, 3867, 3868, 3869, 3870, 3871, 3872, 3873, 3874, 3875, 3876, 3877, 3878, 3879, 3880, 3881, 3882, 3883, 3884, 3885, 3886, 3887, 3888, 3889, 3890, 3891, 3892, 3893, 3894, 3895, 3896, 3897, 3898, 3899, 3900, 3901, 3902, 3903, 3904, 3905, 3906, 3907, 3908, 3909, 3910, 3911, 3912, 3913, 3914, 3915, 3916, 3917, 3918, 3919, 3920, 3921, 3922, 3923, 3924, 3925, 3926, 3927, 3928, 3929, 3930, 3931, 3932, 3933, 3934, 3935, 3936, 3937, 3938, 3939, 3940, 3941, 3942, 3943, 3944, 3945, 3946, 3947, 3948, 3949, 3950, 3951, 3952, 3953, 3954, 3955, 3956, 3957, 3958, 3959, 3960, 3961, 3962, 3963, 3964, 3965, 3966, 3967, 3968, 3969, 3970, 3971, 3972, 3973, 3974, 3975, 3976, 3977, 3978, 3979, 3980, 3981, 3982, 3983, 3984, 3985, 3986, 3987, 3988, 3989, 3990, 3991, 3992, 3993, 3994, 3995, 3996, 3997, 3998, 3999, 4000, 4001, 4002, 4003, 4004, 4005, 4006, 4008, 4009, 4010, 4011, 4012, 4013, 4014, 4015, 4016, 4017, 4018, 4020, 4021, 4022, 4024, 4025, 4026, 4028, 4029, 4030, 4031, 4033, 4034, 4035, 4036, 4037, 4038, 4039, 4040, 4042, 4043, 4044, 4045, 4046, 4047, 4049, 4050, 4051, 4052, 4053, 4054, 4055, 4056, 4057, 4058, 4059, 4061, 4062, 4063, 4064, 4065, 4067, 4068, 4069, 4070, 4071, 4072, 4074, 4075, 4076, 4078, 4079, 4080, 4081, 4082, 4083, 4085, 4086, 4087, 4088, 4089, 4090, 4092, 4093, 4094, 4095, 4097, 4098, 4099, 4100, 4101, 4103, 4104, 4105, 4106, 4108, 4109, 4110, 4111, 4112, 4113, 4114, 4115, 4117, 4118, 4119, 4121, 4122, 4123, 4125, 4126, 4127, 4128, 4130, 4131, 4132, 4133, 4134, 4135, 4136, 4137, 4138, 4139, 4140, 4142, 4143, 4144, 4146, 4147, 4148, 4150, 4151, 4152, 4153, 4155, 4156, 4157, 4158, 4159, 4160, 4161, 4162, 4164, 4165, 4166, 4167, 4168, 4169, 4170, 4171, 4172, 4173, 4174, 4175, 4176, 4177, 4179, 4180, 4181, 4182, 4183, 4184, 4186, 4187, 4188, 4189, 4190, 4192, 4193, 4194, 4195, 4196, 4197, 4198, 4200, 4201, 4202, 4203, 4204, 4205, 4206, 4207, 4208, 4209, 4210, 4212, 4213, 4214, 4215, 4216, 4217, 4218, 4219, 4220, 4222, 4223, 4224, 4225, 4226, 4227, 4229, 4230, 4231, 4232, 4233, 4234, 4235, 4237, 4238, 4239, 4241, 4242, 4243, 4244, 4245, 4246, 4248, 4249, 4250, 4252, 4253, 4254, 4256, 4257, 4258, 4259, 4260, 4261, 4262, 4263, 4264, 4266, 4267, 4268, 4269, 4270, 4272, 4273, 4274, 4275, 4276, 4277, 4279, 4280, 4281, 4283, 4284, 4285, 4286, 4287, 4288, 4290, 4291, 4292, 4293, 4294, 4295, 4297, 4298, 4299, 4300, 4302, 4303, 4304, 4305, 4306, 4308, 4309, 4310, 4311, 4313, 4314, 4315, 4316, 4317, 4318, 4319, 4320, 4321, 4323, 4324, 4325, 4326, 4327, 4329, 4330, 4331, 4332, 4333, 4334, 4336, 4337, 4338, 4340, 4341, 4342, 4343, 4344, 4345, 4347, 4348, 4349, 4350, 4351, 4352, 4354, 4355, 4356, 4357, 4359, 4360, 4361, 4362, 4363, 4365, 4366, 4367, 4368, 4370, 4371, 4372, 4373, 4374, 4375, 4376, 4377, 4379, 4380, 4381, 4383, 4384, 4385, 4387, 4388, 4389, 4390, 4392, 4393, 4394, 4395, 4396, 4397, 4398, 4399, 4400, 4401, 4402, 4403, 4404, 4405, 4406, 4407, 4408, 4409, 4410, 4411, 4412, 4414, 4415, 4416, 4417, 4418, 4419, 4420, 4421, 4422, 4423, 4424, 4425, 4426, 4427, 4428, 4429, 4431, 4432, 4433, 4434, 4435, 4436, 4437, 4438, 4439, 4440, 4441, 4442, 4444, 4445, 4446, 4447, 4448, 4449, 4450, 4451, 4452, 4453, 4454, 4456, 4457, 4458, 4459, 4460, 4461, 4462, 4463, 4464, 4465, 4467, 4468, 4469, 4470, 4471, 4473, 4474, 4475, 4476, 4477, 4478, 4479, 4481, 4482, 4483, 4484, 4485, 4487, 4488, 4489, 4490, 4491, 4492, 4494, 4495, 4496, 4497, 4498, 4499, 4501, 4502, 4503, 4504, 4505, 4506, 4507, 4508, 4509, 4510, 4511, 4512, 4514, 4515, 4516, 4517, 4518, 4519, 4521, 4522, 4523, 4524, 4525, 4527, 4528, 4529, 4530, 4531, 4532, 4533, 4535, 4536, 4537, 4538, 4539, 4540, 4541, 4542, 4543, 4544, 4545, 4547, 4548, 4549, 4550, 4551, 4552, 4553, 4554, 4555, 4557, 4558, 4559, 4560, 4561, 4562, 4564, 4565, 4566, 4567, 4568, 4569, 4570, 4572, 4573, 4574, 4576, 4577, 4578, 4579, 4580, 4581, 4583, 4584, 4585, 4587, 4588, 4589, 4591, 4592, 4593, 4594, 4595, 4596, 4597, 4598, 4599, 4600, 4601, 4602, 4603, 4605, 4606, 4607, 4608, 4609, 4610, 4612, 4613, 4614, 4615, 4616, 4618, 4619, 4620, 4621, 4622, 4623, 4624, 4626, 4627, 4628, 4629, 4630, 4631, 4632, 4633, 4634, 4635, 4636, 4638, 4639, 4640, 4641, 4642, 4643, 4644, 4645, 4646, 4648, 4649, 4650, 4651, 4652, 4653, 4655, 4656, 4657, 4658, 4659, 4660, 4661, 4663, 4664, 4665, 4667, 4668, 4669, 4670, 4671, 4672, 4674, 4675, 4676, 4678, 4679, 4680, 4682, 4683, 4684, 4685, 4686, 4687, 4688, 4689, 4690, 4692, 4693, 4694, 4695, 4696, 4698, 4699, 4700, 4701, 4702, 4703, 4705, 4706, 4707, 4709, 4710, 4711, 4712, 4713, 4714, 4716, 4717, 4718, 4719, 4720, 4721, 4723, 4724, 4725, 4726, 4728, 4729, 4730, 4731, 4732, 4734, 4735, 4736, 4737, 4739, 4740, 4741, 4742, 4743, 4744, 4745, 4746, 4747, 4748, 4749, 4750, 4751, 4752, 4753, 4754, 4755, 4756, 4757, 4758, 4759, 4760, 4761, 4762, 4763, 4764, 4765, 4766, 4767, 4768, 4769, 4770, 4771, 4772, 4773, 4774, 4775, 4776, 4777, 4778, 4780, 4781, 4782, 4783, 4784, 4785, 4786, 4787, 4788, 4789, 4790, 4791, 4792, 4793, 4794, 4795, 4797, 4798, 4799, 4800, 4801, 4802, 4803, 4804, 4805, 4806, 4808, 4809, 4810, 4811, 4812, 4813, 4815, 4816, 4817, 4818, 4819, 4820, 4821, 4822, 4823, 4824, 4825, 4827, 4828, 4829, 4830, 4831, 4832, 4833, 4834, 4835, 4836, 4837, 4838, 4839, 4840, 4841, 4842, 4843, 4844, 4845, 4847, 4848, 4849, 4850, 4851, 4852, 4853, 4854, 4855, 4856, 4857, 4858, 4859, 4860, 4861, 4862, 4864, 4865, 4866, 4867, 4868, 4869, 4870, 4871, 4872, 4873, 4874, 4875, 4877, 4878, 4879, 4880, 4881, 4882, 4883, 4884, 4885, 4886, 4887, 4889, 4890, 4891, 4892, 4893, 4894, 4895, 4896, 4897, 4898, 4900, 4901, 4902, 4903, 4904, 4906, 4907, 4908, 4909, 4910, 4911, 4912, 4914, 4915, 4916, 4917, 4918, 4920, 4921, 4922, 4923, 4924, 4925, 4927, 4928, 4929, 4930, 4931, 4932, 4934, 4935, 4936, 4937, 4938, 4939, 4940, 4941, 4942, 4943, 4944, 4945, 4946, 4947, 4948, 4949, 4950, 4952, 4953, 4954, 4955, 4956, 4957, 4958, 4959, 4960, 4961, 4962, 4963, 4964, 4965, 4966, 4967, 4969, 4970, 4971, 4972, 4973, 4974, 4975, 4976, 4977, 4978, 4979, 4980, 4982, 4983, 4984, 4985, 4986, 4987, 4988, 4989, 4990, 4991, 4992, 4994, 4995, 4996, 4997, 4998, 4999, 5000, 5001, 5002, 5003, 5005, 5006, 5007, 5008, 5009, 5011, 5012, 5013, 5014, 5015, 5016, 5017, 5019, 5020, 5021, 5022, 5023, 5025, 5026, 5027, 5028, 5029, 5030, 5032, 5033, 5034, 5035, 5036, 5037, 5039, 5040, 5041, 5042, 5043, 5044, 5045, 5046, 5047, 5048, 5049, 5050, 5052, 5053, 5054, 5055, 5056, 5057, 5059, 5060, 5061, 5062, 5063, 5065, 5066, 5067, 5068, 5069, 5070, 5071, 5073, 5074, 5075, 5076, 5077, 5078, 5079, 5080, 5081, 5082, 5083, 5085, 5086, 5087, 5088, 5089, 5090, 5091, 5092, 5093, 5095, 5096, 5097, 5098, 5099, 5100, 5102, 5103, 5104, 5105, 5106, 5107, 5108, 5110, 5111, 5112, 5114, 5115, 5116, 5117, 5118, 5119, 5121, 5122, 5123, 5125, 5126, 5127, 5129, 5130, 5131, 5132, 5133, 5134, 5135, 5136, 5137, 5138, 5139, 5140, 5141, 5142, 5143, 5144, 5145, 5146, 5147, 5148, 5149, 5150, 5151, 5152, 5153, 5154, 5155, 5156, 5157, 5158, 5159, 5160, 5161, 5162, 5163, 5164, 5165, 5166, 5167, 5168, 5169, 5170, 5171, 5172, 5173, 5174, 5175, 5176, 5177, 5178, 5179, 5181, 5182, 5183, 5184, 5185, 5186, 5187, 5188, 5189, 5190, 5191, 5192, 5193, 5194, 5195, 5196, 5197, 5198, 5199, 5200, 5201, 5202, 5203, 5204, 5205, 5206, 5207, 5208, 5209, 5210, 5211, 5212, 5213, 5214, 5215, 5216, 5217, 5218, 5219, 5220, 5221, 5222, 5223, 5225, 5226, 5227, 5228, 5229, 5230, 5231, 5232, 5233, 5234, 5235, 5236, 5237, 5238, 5239, 5240, 5242, 5243, 5244, 5245, 5246, 5247, 5248, 5249, 5250, 5251, 5253, 5254, 5255, 5256, 5257, 5258, 5260, 5261, 5262, 5263, 5264, 5265, 5266, 5267, 5268, 5269, 5270, 5272, 5273, 5274, 5275, 5276, 5277, 5278, 5279, 5280, 5281, 5282, 5283, 5284, 5285, 5286, 5287, 5288, 5289, 5290, 5291, 5292, 5293, 5294, 5295, 5296, 5297, 5298, 5299, 5300, 5301, 5302, 5303, 5304, 5305, 5306, 5307, 5308, 5309, 5310, 5311, 5312, 5314, 5315, 5316, 5317, 5318, 5319, 5320, 5321, 5322, 5323, 5324, 5325, 5326, 5327, 5328, 5329, 5331, 5332, 5333, 5334, 5335, 5336, 5337, 5338, 5339, 5340, 5342, 5343, 5344, 5345, 5346, 5347, 5349, 5350, 5351, 5352, 5353, 5354, 5355, 5356, 5357, 5358, 5359, 5361, 5362, 5363, 5364, 5365, 5366, 5367, 5368, 5369, 5370, 5371, 5372, 5373, 5374, 5375, 5376, 5377, 5378, 5379, 5381, 5382, 5383, 5384, 5385, 5386, 5387, 5388, 5389, 5390, 5391, 5392, 5393, 5394, 5395, 5396, 5398, 5399, 5400, 5401, 5402, 5403, 5404, 5405, 5406, 5407, 5408, 5409, 5411, 5412, 5413, 5414, 5415, 5416, 5417, 5418, 5419, 5420, 5421, 5423, 5424, 5425, 5426, 5427, 5428, 5429, 5430, 5431, 5432, 5434, 5435, 5436, 5437, 5438, 5440, 5441, 5442, 5443, 5444, 5445, 5446, 5448, 5449, 5450, 5451, 5452, 5454, 5455, 5456, 5457, 5458, 5459, 5461, 5462, 5463, 5464, 5465, 5466, 5468, 5469, 5470, 5471, 5472, 5473, 5474, 5475, 5476, 5477, 5478, 5479, 5480, 5481, 5482, 5483, 5484, 5485, 5486, 5487, 5488, 5489, 5490, 5491, 5492, 5493, 5494, 5495, 5496, 5497, 5498, 5499, 5500, 5501, 5502, 5503, 5504, 5505, 5506, 5507, 5508, 5509, 5510, 5511, 5512, 5513, 5514, 5515, 5516, 5517, 5518, 5519, 5520, 5521, 5522, 5523, 5524, 5525, 5526, 5527, 5528, 5529, 5530, 5531, 5532, 5533, 5534, 5535, 5536, 5537, 5538, 5539, 5540, 5541, 5543, 5544, 5545, 5546, 5547, 5548, 5549, 5550, 5551, 5552, 5553, 5554, 5555, 5556, 5557, 5558, 5559, 5560, 5561, 5562, 5563, 5564, 5565, 5566, 5567, 5568, 5569, 5570, 5571, 5572, 5573, 5574, 5575, 5576, 5577, 5578, 5579, 5580, 5581, 5582, 5583, 5584, 5585, 5586, 5587, 5588, 5589, 5590, 5591, 5592, 5593, 5594, 5595, 5596, 5598, 5599, 5600, 5601, 5602, 5603, 5604, 5605, 5606, 5607, 5608, 5609, 5610, 5611, 5612, 5613, 5614, 5615, 5616, 5617, 5618, 5619, 5620, 5621, 5622, 5623, 5624, 5625, 5626, 5627, 5628, 5629, 5630, 5631, 5632, 5633, 5634, 5635, 5636, 5637, 5638, 5639, 5640, 5642, 5643, 5644, 5645, 5646, 5647, 5648, 5649, 5650, 5651, 5652, 5653, 5654, 5655, 5656, 5657, 5659, 5660, 5661, 5662, 5663, 5664, 5665, 5666, 5667, 5668, 5670, 5671, 5672, 5673, 5674, 5675, 5677, 5678, 5679, 5680, 5681, 5682, 5683, 5684, 5685, 5686, 5687, 5689, 5690, 5691, 5692, 5693, 5694, 5695, 5696, 5697, 5698, 5699, 5700, 5701, 5702, 5703, 5704, 5705, 5706, 5707, 5708, 5709, 5710, 5711, 5712, 5713, 5714, 5715, 5716, 5717, 5718, 5719, 5720, 5721, 5722, 5723, 5724, 5725, 5726, 5727, 5728, 5729, 5730, 5731, 5732, 5733, 5734, 5735, 5736, 5737, 5738, 5739, 5740, 5741, 5742, 5743, 5744, 5745, 5746, 5747, 5748, 5749, 5750, 5751, 5752, 5753, 5754, 5755, 5756, 5757, 5758, 5759, 5760, 5761, 5762, 5763, 5764, 5765, 5766, 5767, 5768, 5769, 5770, 5771, 5772, 5773, 5774, 5775, 5776, 5777, 5778, 5779, 5780, 5781, 5782, 5783, 5784, 5785, 5786, 5787, 5788, 5789, 5790, 5791, 5792, 5793, 5794, 5795, 5797, 5798, 5799, 5800, 5801, 5802, 5803, 5804, 5805, 5806, 5807, 5808, 5809, 5810, 5811, 5812, 5813, 5814, 5815, 5816, 5817, 5818, 5819, 5820, 5821, 5822, 5823, 5824, 5825, 5826, 5827, 5828, 5829, 5830, 5831, 5832, 5833, 5834, 5835, 5836, 5837, 5838, 5839, 5840, 5841, 5842, 5843, 5844, 5845, 5846, 5847, 5848, 5849, 5850, 5851]
Found 3475 redundant transitions using SMT.
Drop transitions removed 3475 transitions
Redundant transitions reduction (with SMT) removed 3475 transitions.
[2023-03-19 16:50:39] [INFO ] Flow matrix only has 505 transitions (discarded 1872 similar events)
Normalized transition count is 504 out of 505 initially.
// Phase 1: matrix 504 rows 150 cols
[2023-03-19 16:50:39] [INFO ] Computed 0 place invariants in 2 ms
[2023-03-19 16:50:40] [INFO ] Dead Transitions using invariants and state equation in 1109 ms found 0 transitions.
Starting structural reductions in REACHABILITY mode, iteration 1 : 150/150 places, 2377/5852 transitions.
Graph (complete) has 1167 edges and 150 vertex of which 141 are kept as prefixes of interest. Removing 9 places using SCC suffix rule.2 ms
Discarding 9 places :
Also discarding 0 output transitions
Drop transitions removed 8 transitions
Ensure Unique test removed 40 transitions
Reduce isomorphic transitions removed 48 transitions.
Iterating post reduction 0 with 48 rules applied. Total rules applied 49 place count 141 transition count 2329
Discarding 2 places :
Symmetric choice reduction at 1 with 2 rule applications. Total rules 51 place count 139 transition count 2288
Iterating global reduction 1 with 2 rules applied. Total rules applied 53 place count 139 transition count 2288
Ensure Unique test removed 14 transitions
Reduce isomorphic transitions removed 14 transitions.
Iterating post reduction 1 with 14 rules applied. Total rules applied 67 place count 139 transition count 2274
Drop transitions removed 74 transitions
Redundant transition composition rules discarded 74 transitions
Iterating global reduction 2 with 74 rules applied. Total rules applied 141 place count 139 transition count 2200
Reduce places removed 5 places and 0 transitions.
Drop transitions removed 19 transitions
Ensure Unique test removed 26 transitions
Reduce isomorphic transitions removed 45 transitions.
Iterating post reduction 2 with 50 rules applied. Total rules applied 191 place count 134 transition count 2155
Discarding 1 places :
Symmetric choice reduction at 3 with 1 rule applications. Total rules 192 place count 133 transition count 2151
Iterating global reduction 3 with 1 rules applied. Total rules applied 193 place count 133 transition count 2151
Ensure Unique test removed 32 transitions
Reduce isomorphic transitions removed 32 transitions.
Iterating post reduction 3 with 32 rules applied. Total rules applied 225 place count 133 transition count 2119
Drop transitions removed 72 transitions
Redundant transition composition rules discarded 72 transitions
Iterating global reduction 4 with 72 rules applied. Total rules applied 297 place count 133 transition count 2047
Free-agglomeration rule applied 1 times.
Iterating global reduction 4 with 1 rules applied. Total rules applied 298 place count 133 transition count 2046
Reduce places removed 1 places and 0 transitions.
Drop transitions removed 2 transitions
Reduce isomorphic transitions removed 2 transitions.
Iterating post reduction 4 with 3 rules applied. Total rules applied 301 place count 132 transition count 2044
Drop transitions removed 2 transitions
Redundant transition composition rules discarded 2 transitions
Iterating global reduction 5 with 2 rules applied. Total rules applied 303 place count 132 transition count 2042
Applied a total of 303 rules in 598 ms. Remains 132 /150 variables (removed 18) and now considering 2042/2377 (removed 335) transitions.
[2023-03-19 16:50:41] [INFO ] Flow matrix only has 446 transitions (discarded 1596 similar events)
Normalized transition count is 445 out of 446 initially.
// Phase 1: matrix 445 rows 132 cols
[2023-03-19 16:50:41] [INFO ] Computed 0 place invariants in 3 ms
[2023-03-19 16:50:41] [INFO ] Implicit Places using invariants in 335 ms returned []
[2023-03-19 16:50:41] [INFO ] Flow matrix only has 446 transitions (discarded 1596 similar events)
[2023-03-19 16:50:41] [INFO ] Invariant cache hit.
[2023-03-19 16:50:41] [INFO ] State equation strengthened by 227 read => feed constraints.
[2023-03-19 16:50:42] [INFO ] Implicit Places using invariants and state equation in 976 ms returned []
Implicit Place search using SMT with State Equation took 1316 ms to find 0 implicit places.
Starting structural reductions in REACHABILITY mode, iteration 2 : 132/150 places, 2042/5852 transitions.
Finished structural reductions in REACHABILITY mode , in 2 iterations and 19918 ms. Remains : 132/150 places, 2042/5852 transitions.
Incomplete random walk after 10000 steps, including 2 resets, run finished after 224 ms. (steps per millisecond=44 ) properties (out of 1) seen :0
Finished Best-First random walk after 2233 steps, including 0 resets, run visited all 1 properties in 3 ms. (steps per millisecond=744 )
FORMULA SemanticWebServices-PT-S256P15-ReachabilityFireability-15 FALSE TECHNIQUES TOPOLOGICAL BESTFIRST_WALK
ITS runner failed with exception null
java.lang.InterruptedException
at java.base/java.lang.Object.wait(Native Method)
at java.base/java.lang.Thread.join(Thread.java:1304)
at java.base/java.lang.Thread.join(Thread.java:1372)
at fr.lip6.move.gal.application.runner.AbstractRunner.join(AbstractRunner.java:27)
at fr.lip6.move.gal.application.runner.its.ITSRunner.join(ITSRunner.java:177)
at fr.lip6.move.gal.application.solver.global.GlobalPropertySolver.verifyWithSDD(GlobalPropertySolver.java:675)
at fr.lip6.move.gal.application.solver.ReachabilitySolver.lambda$2(ReachabilitySolver.java:63)
at java.base/java.lang.Thread.run(Thread.java:833)
All properties solved without resorting to model-checking.
Total runtime 49155 ms.
BK_STOP 1679244643940
--------------------
content from stderr:
+ export BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
+ BINDIR=/home/mcc/BenchKit/bin//../itstools/bin//../
++ pwd
+ export MODEL=/home/mcc/execution
+ MODEL=/home/mcc/execution
+ [[ ReachabilityFireability = StateSpace ]]
+ /home/mcc/BenchKit/bin//../itstools/bin//..//runeclipse.sh /home/mcc/execution ReachabilityFireability -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
+ ulimit -s 65536
+ [[ -z '' ]]
+ export LTSMIN_MEM_SIZE=8589934592
+ LTSMIN_MEM_SIZE=8589934592
+ export PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ PYTHONPATH=/home/mcc/BenchKit/itstools/pylibs
+ export LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
+ LD_LIBRARY_PATH=/home/mcc/BenchKit/itstools/pylibs:
++ sed s/.jar//
++ perl -pe 's/.*\.//g'
++ ls /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/plugins/fr.lip6.move.gal.application.pnmcc_1.0.0.202303021504.jar
+ VERSION=202303021504
+ echo 'Running Version 202303021504'
+ /home/mcc/BenchKit/bin//../itstools/bin//..//itstools/its-tools -pnfolder /home/mcc/execution -examination ReachabilityFireability -its -ltsmin -greatspnpath /home/mcc/BenchKit/bin//../itstools/bin//..//greatspn/ -order META -manyOrder -smt -timeout 3600
Sequence of Actions to be Executed by the VM
This is useful if one wants to reexecute the tool in the VM from the submitted image disk.
set -x
# this is for BenchKit: configuration of major elements for the test
export BK_INPUT="SemanticWebServices-PT-S256P15"
export BK_EXAMINATION="ReachabilityFireability"
export BK_TOOL="itstools"
export BK_RESULT_DIR="/tmp/BK_RESULTS/OUTPUTS"
export BK_TIME_CONFINEMENT="3600"
export BK_MEMORY_CONFINEMENT="16384"
export BK_BIN_PATH="/home/mcc/BenchKit/bin/"
# this is specific to your benchmark or test
export BIN_DIR="$HOME/BenchKit/bin"
# remove the execution directoty if it exists (to avoid increse of .vmdk images)
if [ -d execution ] ; then
rm -rf execution
fi
# this is for BenchKit: explicit launching of the test
echo "====================================================================="
echo " Generated by BenchKit 2-5348"
echo " Executing tool itstools"
echo " Input is SemanticWebServices-PT-S256P15, examination is ReachabilityFireability"
echo " Time confinement is $BK_TIME_CONFINEMENT seconds"
echo " Memory confinement is 16384 MBytes"
echo " Number of cores is 4"
echo " Run identifier is r357-smll-167891806400447"
echo "====================================================================="
echo
echo "--------------------"
echo "preparation of the directory to be used:"
tar xzf /home/mcc/BenchKit/INPUTS/SemanticWebServices-PT-S256P15.tgz
mv SemanticWebServices-PT-S256P15 execution
cd execution
if [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "UpperBounds" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] || [ "ReachabilityFireability" = "StateSpace" ]; then
rm -f GenericPropertiesVerdict.xml
fi
pwd
ls -lh
echo
echo "--------------------"
echo "content from stdout:"
echo
echo "=== Data for post analysis generated by BenchKit (invocation template)"
echo
if [ "ReachabilityFireability" = "UpperBounds" ] ; then
echo "The expected result is a vector of positive values"
echo NUM_VECTOR
elif [ "ReachabilityFireability" != "StateSpace" ] ; then
echo "The expected result is a vector of booleans"
echo BOOL_VECTOR
else
echo "no data necessary for post analysis"
fi
echo
if [ -f "ReachabilityFireability.txt" ] ; then
echo "here is the order used to build the result vector(from text file)"
for x in $(grep Property ReachabilityFireability.txt | cut -d ' ' -f 2 | sort -u) ; do
echo "FORMULA_NAME $x"
done
elif [ -f "ReachabilityFireability.xml" ] ; then # for cunf (txt files deleted;-)
echo echo "here is the order used to build the result vector(from xml file)"
for x in $(grep '
echo "FORMULA_NAME $x"
done
elif [ "ReachabilityFireability" = "ReachabilityDeadlock" ] || [ "ReachabilityFireability" = "QuasiLiveness" ] || [ "ReachabilityFireability" = "StableMarking" ] || [ "ReachabilityFireability" = "Liveness" ] || [ "ReachabilityFireability" = "OneSafe" ] ; then
echo "FORMULA_NAME ReachabilityFireability"
fi
echo
echo "=== Now, execution of the tool begins"
echo
echo -n "BK_START "
date -u +%s%3N
echo
timeout -s 9 $BK_TIME_CONFINEMENT bash -c "/home/mcc/BenchKit/BenchKit_head.sh 2> STDERR ; echo ; echo -n \"BK_STOP \" ; date -u +%s%3N"
if [ $? -eq 137 ] ; then
echo
echo "BK_TIME_CONFINEMENT_REACHED"
fi
echo
echo "--------------------"
echo "content from stderr:"
echo
cat STDERR ;