Next: Automatic variable reordering results
Up: Evaluating Symbolic Traversal Algorithms
Previous: General benchmark data
To make result tables as small as possible we will use the following
codes to identify the traversal methods:
- N for NuSMV using threshold and affinity.
- B for TranSyT BFS.
- C for TranSyT BFS with chaining.
- T for TranSyT Token traverse.
- W for TranSyT Weighed Token traverse.
- D for TranSyT Dynamic Event Clustered traverse.
- I for VIS IWLS.
- H for VIS Hybrid method.
- M for VIS MLP method.
- IH for VIS IWLS with high density.
- HH for VIS Hybrid method with high density.
- MH for VIS MLP method with high density.
|
Name |
Iterations |
Events fired |
Peak BDD |
Time |
|
|
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
|
c-arbiter |
79 |
15 |
6 |
5 |
1273 |
- |
- |
- |
- |
- |
- |
- |
5600 |
1120 |
2256 |
1857 |
1274 |
- |
- |
- |
- |
- |
- |
- |
2799017 |
116427 |
24384 |
94056 |
18431 |
- |
- |
- |
- |
- |
- |
- |
1811.4 |
9.0 |
2.6 |
13.5 |
9.3 |
- |
- |
- |
- |
- |
- |
- |
|
c-arbiter-xl |
- |
- |
16 |
11 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
- |
4602 |
3260 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
- |
1606598 |
1072355 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
- |
340.4 |
267.3 |
- |
- |
- |
- |
- |
- |
- |
- |
|
gals |
64 |
24 |
1 |
1 |
141 |
64 |
64 |
64 |
64 |
66 |
66 |
66 |
975 |
375 |
287 |
216 |
142 |
130 |
390 |
390 |
325 |
402 |
402 |
335 |
3673 |
3697 |
3668 |
3668 |
3813 |
27533 |
49567 |
11515 |
30421 |
50010 |
11673 |
30866 |
0.2 |
0.1 |
0.1 |
0.1 |
0.1 |
0.2 |
0.2 |
0.4 |
0.1 |
0.2 |
0.5 |
0.2 |
|
pcc |
68 |
17 |
6 |
4 |
408 |
68 |
68 |
68 |
68 |
97 |
83 |
93 |
2070 |
540 |
773 |
550 |
409 |
207 |
345 |
345 |
345 |
490 |
420 |
470 |
50793 |
7469 |
4903 |
5397 |
5353 |
512410 |
2059435 |
1485125 |
1454561 |
2037227 |
1375307 |
1633357 |
11.6 |
0.5 |
0.5 |
0.4 |
0.7 |
67.7 |
69.8 |
19.2 |
55.5 |
127.9 |
30.1 |
81.8 |
|
muller_ |
|
n |
Iterations |
Events fired |
Peak BDD |
Time |
|
|
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
|
5 |
11 |
6 |
1 |
1 |
19 |
11 |
11 |
11 |
11 |
13 |
13 |
13 |
120 |
70 |
113 |
82 |
20 |
24 |
36 |
36 |
24 |
42 |
42 |
28 |
1170 |
1222 |
1220 |
1220 |
1220 |
4983 |
3777 |
3777 |
2176 |
3801 |
3777 |
2176 |
0.0 |
0.0 |
0.0 |
0.0 |
0.0 |
0.0 |
0.0 |
0.0 |
0.0 |
0.0 |
0.0 |
0.0 |
|
10 |
28 |
6 |
1 |
1 |
69 |
28 |
28 |
28 |
28 |
30 |
30 |
30 |
580 |
140 |
278 |
174 |
70 |
87 |
203 |
58 |
145 |
217 |
217 |
155 |
4088 |
4228 |
3895 |
3887 |
3903 |
56036 |
51480 |
15326 |
42317 |
49592 |
15804 |
42256 |
0.1 |
0.0 |
0.1 |
0.0 |
0.1 |
0.2 |
0.2 |
0.3 |
0.1 |
0.2 |
0.3 |
0.1 |
|
15 |
45 |
7 |
1 |
1 |
172 |
45 |
45 |
45 |
45 |
68 |
68 |
68 |
1380 |
240 |
477 |
275 |
173 |
184 |
506 |
506 |
460 |
759 |
759 |
690 |
11465 |
8221 |
7919 |
8230 |
8240 |
484204 |
1248927 |
640307 |
1394826 |
1229046 |
533678 |
1847537 |
0.9 |
0.2 |
0.2 |
0.2 |
0.3 |
1.9 |
14.6 |
18.5 |
12.6 |
21.7 |
19.1 |
18.1 |
|
20 |
86 |
11 |
1 |
1 |
307 |
86 |
86 |
86 |
86 |
113 |
93 |
112 |
3480 |
480 |
756 |
396 |
308 |
435 |
1218 |
1218 |
783 |
1596 |
597567400 |
1017 |
39613 |
15933 |
14765 |
15028 |
15300 |
662453 |
2276886 |
1236246 |
1988299 |
14744789 |
1059512 |
2402464 |
13.7 |
0.8 |
0.8 |
0.7 |
1.6 |
123.5 |
303.6 |
161.8 |
177.8 |
472.0 |
156.6 |
219.2 |
|
25 |
113 |
11 |
1 |
1 |
458 |
113 |
113 |
113 |
- |
- |
- |
- |
5700 |
600 |
1045 |
519 |
459 |
684 |
1938 |
1938 |
- |
- |
- |
- |
94157 |
25002 |
21193 |
23550 |
23291 |
9473714 |
8053399 |
2018134 |
- |
- |
- |
- |
106.8 |
2.0 |
1.9 |
1.5 |
4.5 |
3048.6 |
3578.1 |
1643.5 |
- |
- |
- |
- |
|
30 |
140 |
12 |
1 |
1 |
665 |
- |
- |
- |
- |
- |
- |
- |
8460 |
780 |
1366 |
650 |
666 |
- |
- |
- |
- |
- |
- |
- |
197776 |
35041 |
28618 |
34739 |
34793 |
- |
- |
- |
- |
- |
- |
- |
415.7 |
4.5 |
4.4 |
3.2 |
13.0 |
- |
- |
- |
- |
- |
- |
- |
|
40 |
- |
16 |
1 |
1 |
1235 |
- |
- |
- |
- |
- |
- |
- |
- |
1360 |
2219 |
964 |
1236 |
- |
- |
- |
- |
- |
- |
- |
- |
72333 |
50844 |
69847 |
66016 |
- |
- |
- |
- |
- |
- |
- |
- |
19.0 |
15.8 |
11.6 |
65.6 |
- |
- |
- |
- |
- |
- |
- |
|
50 |
- |
21 |
1 |
1 |
1974 |
- |
- |
- |
- |
- |
- |
- |
- |
2200 |
3267 |
1326 |
1975 |
- |
- |
- |
- |
- |
- |
- |
- |
124040 |
79033 |
119143 |
113264 |
- |
- |
- |
- |
- |
- |
- |
- |
57.4 |
40.6 |
30.0 |
231.3 |
- |
- |
- |
- |
- |
- |
- |
|
60 |
- |
22 |
1 |
1 |
2744 |
- |
- |
- |
- |
- |
- |
- |
- |
2760 |
4372 |
1700 |
2745 |
- |
- |
- |
- |
- |
- |
- |
- |
189749 |
107884 |
191655 |
177155 |
- |
- |
- |
- |
- |
- |
- |
- |
130.6 |
79.2 |
67.6 |
691.0 |
- |
- |
- |
- |
- |
- |
- |
|
70 |
- |
26 |
1 |
1 |
4090 |
- |
- |
- |
- |
- |
- |
- |
- |
3780 |
5795 |
2154 |
4091 |
- |
- |
- |
- |
- |
- |
- |
- |
292735 |
146516 |
291131 |
269729 |
- |
- |
- |
- |
- |
- |
- |
- |
301.2 |
156.4 |
144.4 |
1669.8 |
- |
- |
- |
- |
- |
- |
- |
|
80 |
- |
31 |
1 |
1 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
5120 |
7413 |
2656 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
442759 |
196450 |
436100 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
690.1 |
299.7 |
304.9 |
- |
- |
- |
- |
- |
- |
- |
- |
|
90 |
- |
32 |
1 |
1 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
5940 |
9010 |
3150 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
606186 |
243723 |
620684 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
1221.6 |
477.7 |
523.9 |
- |
- |
- |
- |
- |
- |
- |
- |
|
100 |
- |
36 |
1 |
1 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
7400 |
11003 |
3744 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
830806 |
300593 |
828491 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
2190.9 |
777.3 |
910.5 |
- |
- |
- |
- |
- |
- |
- |
- |
|
pipeline |
|
n |
Iterations |
Events fired |
Peak BDD |
Time |
|
|
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
|
1 |
41 |
14 |
5 |
5 |
126 |
41 |
41 |
41 |
41 |
42 |
42 |
42 |
882 |
315 |
330 |
309 |
127 |
42 |
84 |
84 |
84 |
86 |
86 |
86 |
1479 |
942 |
831 |
857 |
773 |
13906 |
13104 |
9857 |
18370 |
12393 |
9915 |
17650 |
0.1 |
0.0 |
0.0 |
0.0 |
0.0 |
0.1 |
0.0 |
0.2 |
0.1 |
0.1 |
0.2 |
0.1 |
|
2 |
68 |
17 |
6 |
6 |
300 |
68 |
68 |
68 |
68 |
69 |
69 |
69 |
2415 |
630 |
672 |
601 |
301 |
138 |
276 |
276 |
276 |
280 |
280 |
280 |
10787 |
1717 |
1600 |
1671 |
1655 |
45638 |
652507 |
244883 |
2071780 |
649288 |
249345 |
1822428 |
2.0 |
0.1 |
0.1 |
0.1 |
0.1 |
1.0 |
6.8 |
1.8 |
13.7 |
6.7 |
1.8 |
13.1 |
|
4 |
122 |
26 |
9 |
12 |
879 |
- |
68 |
68 |
68 |
69 |
69 |
69 |
7749 |
1701 |
1545 |
1465 |
880 |
- |
276 |
276 |
276 |
280 |
280 |
280 |
1427996 |
4813 |
4560 |
4542 |
4124 |
- |
671260 |
250198 |
2068884 |
767794 |
315504 |
2117109 |
978.4 |
0.4 |
0.5 |
0.6 |
1.2 |
- |
6.7 |
1.7 |
13.3 |
7.1 |
1.9 |
13.3 |
|
pipelineabs |
|
n |
Iterations |
Events fired |
Peak BDD |
Time |
|
|
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
|
1 |
27 |
9 |
2 |
3 |
60 |
27 |
27 |
27 |
27 |
29 |
29 |
29 |
448 |
160 |
163 |
155 |
61 |
56 |
84 |
84 |
84 |
90 |
90 |
90 |
1878 |
1721 |
1617 |
1629 |
1679 |
14357 |
16508 |
6010 |
6568 |
16754 |
6078 |
6848 |
0.0 |
0.0 |
0.0 |
0.0 |
0.0 |
0.1 |
0.1 |
0.1 |
0.0 |
0.1 |
0.1 |
0.0 |
|
2 |
53 |
13 |
3 |
4 |
153 |
53 |
53 |
53 |
53 |
55 |
55 |
55 |
1296 |
336 |
317 |
267 |
154 |
108 |
270 |
270 |
270 |
280 |
280 |
280 |
6962 |
4360 |
4295 |
4028 |
4225 |
354517 |
429191 |
31433 |
158802 |
430128 |
30862 |
160063 |
0.5 |
0.1 |
0.1 |
0.1 |
0.1 |
0.8 |
1.2 |
1.6 |
0.5 |
1.2 |
1.6 |
0.6 |
|
4 |
129 |
21 |
3 |
6 |
591 |
129 |
- |
129 |
129 |
- |
368 |
- |
5200 |
880 |
614 |
563 |
592 |
390 |
- |
1430 |
910 |
- |
4059 |
- |
52620 |
13981 |
10811 |
11925 |
10364 |
2630829 |
- |
1453363 |
6668142 |
- |
1945980 |
- |
27.0 |
1.0 |
0.5 |
1.0 |
1.9 |
1162.9 |
- |
358.5 |
1009.4 |
- |
2172.0 |
- |
|
8 |
377 |
37 |
3 |
10 |
2709 |
- |
- |
- |
- |
- |
- |
- |
27216 |
2736 |
1388 |
1436 |
2710 |
- |
- |
- |
- |
- |
- |
- |
598405 |
41278 |
27745 |
41547 |
30395 |
- |
- |
- |
- |
- |
- |
- |
3493.6 |
11.2 |
2.4 |
11.7 |
39.3 |
- |
- |
- |
- |
- |
- |
- |
|
16 |
- |
69 |
3 |
18 |
13947 |
- |
- |
- |
- |
- |
- |
- |
- |
9520 |
3656 |
4319 |
13948 |
- |
- |
- |
- |
- |
- |
- |
- |
126406 |
80400 |
158123 |
100017 |
- |
- |
- |
- |
- |
- |
- |
- |
146.7 |
13.8 |
170.1 |
1092.1 |
- |
- |
- |
- |
- |
- |
- |
|
stari |
|
n |
Iterations |
Events fired |
Peak BDD |
Time |
|
|
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
|
4 |
201 |
22 |
7 |
12 |
863 |
201 |
201 |
201 |
201 |
251 |
213 |
253 |
11312 |
1288 |
1472 |
1799 |
864 |
808 |
1212 |
1212 |
1010 |
1512 |
1284 |
1270 |
39477 |
6224 |
4299 |
6339 |
3110 |
1184185 |
2156713 |
1099257 |
3219982 |
3940176 |
1149236 |
2252645 |
28.0 |
0.5 |
0.4 |
1.4 |
0.8 |
332.8 |
431.8 |
65.6 |
186.6 |
493.4 |
180.8 |
447.1 |
|
8 |
- |
42 |
11 |
24 |
3642 |
- |
- |
- |
- |
- |
- |
- |
- |
4472 |
5421 |
5643 |
3643 |
- |
- |
- |
- |
- |
- |
- |
- |
37507 |
14335 |
30000 |
10350 |
- |
- |
- |
- |
- |
- |
- |
- |
11.2 |
5.7 |
29.8 |
25.2 |
- |
- |
- |
- |
- |
- |
- |
|
12 |
- |
62 |
15 |
34 |
8309 |
- |
- |
- |
- |
- |
- |
- |
- |
9576 |
43968 |
11306 |
8310 |
- |
- |
- |
- |
- |
- |
- |
- |
156822 |
27465 |
77272 |
24553 |
- |
- |
- |
- |
- |
- |
- |
- |
77.3 |
72.8 |
186.8 |
210.6 |
- |
- |
- |
- |
- |
- |
- |
|
16 |
- |
- |
19 |
46 |
14740 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
574482 |
19211 |
14741 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
48590 |
200435 |
74089 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
1937.4 |
982.0 |
1995.5 |
- |
- |
- |
- |
- |
- |
- |
|
tree |
|
n |
Iterations |
Events fired |
Peak BDD |
Time |
|
|
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
B |
C |
T |
W |
D |
N |
I |
H |
M |
IHD |
HHD |
MHD |
|
5 |
37 |
16 |
1 |
1 |
134 |
37 |
37 |
37 |
37 |
39 |
39 |
39 |
912 |
408 |
353 |
231 |
135 |
114 |
304 |
304 |
152 |
320 |
320 |
160 |
3638 |
3333 |
3004 |
2674 |
2836 |
24265 |
81207 |
18422 |
35593 |
79821 |
19084 |
34636 |
0.1 |
0.0 |
0.1 |
0.0 |
0.0 |
0.2 |
0.4 |
0.3 |
0.1 |
0.4 |
0.4 |
0.2 |
|
10 |
72 |
31 |
1 |
1 |
418 |
72 |
72 |
72 |
72 |
86 |
74 |
102 |
3212 |
1408 |
931 |
546 |
419 |
365 |
1241 |
1241 |
657 |
1479 |
1275 |
927 |
16493 |
12865 |
10318 |
7366 |
7441 |
1507518 |
5392903 |
1376876 |
4381289 |
5911182 |
1377119 |
4847021 |
2.4 |
0.5 |
0.3 |
0.1 |
0.2 |
104.6 |
377.6 |
57.4 |
106.5 |
373.0 |
59.1 |
196.8 |
|
15 |
107 |
46 |
1 |
1 |
860 |
- |
- |
- |
- |
- |
- |
- |
6912 |
3008 |
1764 |
961 |
861 |
- |
- |
- |
- |
- |
- |
- |
43454 |
32711 |
42591 |
14580 |
14580 |
- |
- |
- |
- |
- |
- |
- |
21.4 |
3.1 |
2.8 |
0.3 |
0.8 |
- |
- |
- |
- |
- |
- |
- |
|
20 |
142 |
61 |
1 |
1 |
1457 |
- |
- |
- |
- |
- |
- |
- |
12012 |
5208 |
2666 |
1476 |
1458 |
- |
- |
- |
- |
- |
- |
- |
85312 |
67754 |
104753 |
24194 |
24194 |
- |
- |
- |
- |
- |
- |
- |
144.1 |
16.0 |
10.4 |
0.5 |
1.8 |
- |
- |
- |
- |
- |
- |
- |
|
30 |
212 |
91 |
1 |
1 |
3107 |
- |
- |
- |
- |
- |
- |
- |
26412 |
11408 |
5888 |
2806 |
3108 |
- |
- |
- |
- |
- |
- |
- |
204875 |
198251 |
403739 |
50622 |
50622 |
- |
- |
- |
- |
- |
- |
- |
1028.6 |
126.6 |
72.7 |
1.4 |
6.0 |
- |
- |
- |
- |
- |
- |
- |
|
40 |
- |
121 |
1 |
1 |
5363 |
- |
- |
- |
- |
- |
- |
- |
- |
20008 |
9816 |
4536 |
5364 |
- |
- |
- |
- |
- |
- |
- |
- |
439408 |
440749 |
86650 |
86650 |
- |
- |
- |
- |
- |
- |
- |
- |
501.0 |
304.2 |
2.9 |
15.2 |
- |
- |
- |
- |
- |
- |
- |
|
50 |
- |
151 |
- |
1 |
8267 |
- |
- |
- |
- |
- |
- |
- |
- |
31008 |
- |
6666 |
8268 |
- |
- |
- |
- |
- |
- |
- |
- |
875587 |
- |
132278 |
132278 |
- |
- |
- |
- |
- |
- |
- |
- |
1601.3 |
- |
5.4 |
35.8 |
- |
- |
- |
- |
- |
- |
- |
|
60 |
- |
- |
- |
1 |
11762 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
- |
9196 |
11763 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
- |
187506 |
187506 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
- |
8.9 |
68.1 |
- |
- |
- |
- |
- |
- |
- |
|
70 |
- |
- |
- |
1 |
15858 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
- |
12126 |
15859 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
- |
252335 |
252335 |
- |
- |
- |
- |
- |
- |
- |
- |
- |
- |
13.4 |
131.0 |
- |
- |
- |
- |
- |
- |
- |
Next: Automatic variable reordering results
Up: Evaluating Symbolic Traversal Algorithms
Previous: General benchmark data
Enric Pastor
2004-05-28