Skip to content

Commit c4f8c2a

Browse files
committed
Add more result
1 parent 941fcb7 commit c4f8c2a

4 files changed

Lines changed: 136 additions & 0 deletions
Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,40 @@
1+
================================================================================================
2+
Coalesced RDD , large scale
3+
================================================================================================
4+
5+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
6+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
7+
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
8+
------------------------------------------------------------------------------------------------------------------------
9+
Coalesce Num Partitions: 100 Num Hosts: 1 455 623 151 0.2 4547.4 1.0X
10+
Coalesce Num Partitions: 100 Num Hosts: 5 340 409 65 0.3 3397.1 1.3X
11+
Coalesce Num Partitions: 100 Num Hosts: 10 292 363 95 0.3 2923.3 1.6X
12+
Coalesce Num Partitions: 100 Num Hosts: 20 307 320 11 0.3 3069.8 1.5X
13+
Coalesce Num Partitions: 100 Num Hosts: 40 333 368 55 0.3 3329.1 1.4X
14+
Coalesce Num Partitions: 100 Num Hosts: 80 286 338 63 0.3 2862.5 1.6X
15+
Coalesce Num Partitions: 500 Num Hosts: 1 769 837 59 0.1 7693.5 0.6X
16+
Coalesce Num Partitions: 500 Num Hosts: 5 427 461 31 0.2 4268.5 1.1X
17+
Coalesce Num Partitions: 500 Num Hosts: 10 372 389 27 0.3 3722.2 1.2X
18+
Coalesce Num Partitions: 500 Num Hosts: 20 347 365 31 0.3 3468.5 1.3X
19+
Coalesce Num Partitions: 500 Num Hosts: 40 335 336 1 0.3 3347.3 1.4X
20+
Coalesce Num Partitions: 500 Num Hosts: 80 329 360 49 0.3 3294.5 1.4X
21+
Coalesce Num Partitions: 1000 Num Hosts: 1 1254 1292 47 0.1 12538.6 0.4X
22+
Coalesce Num Partitions: 1000 Num Hosts: 5 518 553 47 0.2 5177.0 0.9X
23+
Coalesce Num Partitions: 1000 Num Hosts: 10 394 432 42 0.3 3937.3 1.2X
24+
Coalesce Num Partitions: 1000 Num Hosts: 20 341 381 44 0.3 3414.4 1.3X
25+
Coalesce Num Partitions: 1000 Num Hosts: 40 313 358 48 0.3 3134.9 1.5X
26+
Coalesce Num Partitions: 1000 Num Hosts: 80 335 360 38 0.3 3347.0 1.4X
27+
Coalesce Num Partitions: 5000 Num Hosts: 1 3937 4066 156 0.0 39375.0 0.1X
28+
Coalesce Num Partitions: 5000 Num Hosts: 5 1413 1453 40 0.1 14133.4 0.3X
29+
Coalesce Num Partitions: 5000 Num Hosts: 10 826 861 49 0.1 8255.2 0.6X
30+
Coalesce Num Partitions: 5000 Num Hosts: 20 542 609 58 0.2 5423.3 0.8X
31+
Coalesce Num Partitions: 5000 Num Hosts: 40 410 470 64 0.2 4101.0 1.1X
32+
Coalesce Num Partitions: 5000 Num Hosts: 80 352 427 69 0.3 3515.3 1.3X
33+
Coalesce Num Partitions: 10000 Num Hosts: 1 7101 7151 54 0.0 71007.4 0.1X
34+
Coalesce Num Partitions: 10000 Num Hosts: 5 2540 2582 59 0.0 25396.2 0.2X
35+
Coalesce Num Partitions: 10000 Num Hosts: 10 1378 1432 48 0.1 13781.4 0.3X
36+
Coalesce Num Partitions: 10000 Num Hosts: 20 829 867 66 0.1 8286.8 0.5X
37+
Coalesce Num Partitions: 10000 Num Hosts: 40 573 630 49 0.2 5730.2 0.8X
38+
Coalesce Num Partitions: 10000 Num Hosts: 80 438 449 9 0.2 4382.5 1.0X
39+
40+
Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
================================================================================================
2+
Benchmark KryoPool vs old"pool of 1" implementation
3+
================================================================================================
4+
5+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
6+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
7+
Benchmark KryoPool vs old"pool of 1" implementation: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
8+
------------------------------------------------------------------------------------------------------------------------
9+
KryoPool:true 6524 9149 NaN 0.0 13047076.5 1.0X
10+
KryoPool:false 12855 16469 663 0.0 25709170.6 0.5X
11+
12+
Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,40 @@
1+
================================================================================================
2+
Properties Cloning
3+
================================================================================================
4+
5+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
6+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
7+
Empty Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
8+
------------------------------------------------------------------------------------------------------------------------
9+
SerializationUtils.clone 0 0 0 0.1 13755.0 1.0X
10+
Utils.cloneProperties 0 0 0 3.5 285.0 48.3X
11+
12+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
13+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
14+
System Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
15+
------------------------------------------------------------------------------------------------------------------------
16+
SerializationUtils.clone 0 0 0 0.0 191892.0 1.0X
17+
Utils.cloneProperties 0 0 0 0.2 6027.0 31.8X
18+
19+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
20+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
21+
Small Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
22+
------------------------------------------------------------------------------------------------------------------------
23+
SerializationUtils.clone 1 1 0 0.0 721334.0 1.0X
24+
Utils.cloneProperties 0 0 0 0.2 5237.0 137.7X
25+
26+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
27+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
28+
Medium Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
29+
------------------------------------------------------------------------------------------------------------------------
30+
SerializationUtils.clone 3 3 0 0.0 3006554.0 1.0X
31+
Utils.cloneProperties 0 0 0 0.0 27042.0 111.2X
32+
33+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
34+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
35+
Large Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
36+
------------------------------------------------------------------------------------------------------------------------
37+
SerializationUtils.clone 6 6 0 0.0 5864452.0 1.0X
38+
Utils.cloneProperties 0 0 0 0.0 53760.0 109.1X
39+
40+
Lines changed: 44 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,44 @@
1+
================================================================================================
2+
Pseudo random
3+
================================================================================================
4+
5+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
6+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
7+
nextInt: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
8+
------------------------------------------------------------------------------------------------------------------------
9+
java.util.Random 1357 1358 0 73.7 13.6 1.0X
10+
XORShiftRandom 228 228 0 438.0 2.3 5.9X
11+
12+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
13+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
14+
nextLong: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
15+
------------------------------------------------------------------------------------------------------------------------
16+
java.util.Random 2718 2719 1 36.8 27.2 1.0X
17+
XORShiftRandom 632 633 0 158.1 6.3 4.3X
18+
19+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
20+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
21+
nextDouble: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
22+
------------------------------------------------------------------------------------------------------------------------
23+
java.util.Random 2722 2723 0 36.7 27.2 1.0X
24+
XORShiftRandom 632 632 0 158.3 6.3 4.3X
25+
26+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
27+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
28+
nextGaussian: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
29+
------------------------------------------------------------------------------------------------------------------------
30+
java.util.Random 6979 6979 1 14.3 69.8 1.0X
31+
XORShiftRandom 5183 5183 0 19.3 51.8 1.3X
32+
33+
34+
================================================================================================
35+
hash seed
36+
================================================================================================
37+
38+
OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
39+
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
40+
Hash seed: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
41+
------------------------------------------------------------------------------------------------------------------------
42+
XORShiftRandom.hashSeed 38 39 1 263.9 3.8 1.0X
43+
44+

0 commit comments

Comments
 (0)