Skip to content

Commit

Permalink
[SPARK-37766][TESTS] Regenerate benchmark results
Browse files Browse the repository at this point in the history 
### What changes were proposed in this pull request?

This PR aims to regenerate benchmark results.

### Why are the changes needed?

To make the benchmark up-to-date according to the latest code change. The oldest benchmark result files are 9 months ago.

The PR contains the files generated by the following GitHub Action jobs.
- Java 8: https://github.com/dongjoon-hyun/spark/actions/runs/1629005432
- Java 11: https://github.com/dongjoon-hyun/spark/actions/runs/1629042818
- Java 17: https://github.com/dongjoon-hyun/spark/actions/runs/1629006193

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Manually review.

Closes apache#35046 from dongjoon-hyun/SPARK-37766.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
  • Loading branch information
@dongjoon-hyun
dongjoon-hyun committed Dec 29, 2021
1 parent 7429804 commit a85a205
Show file tree
Hide file tree
Showing 183 changed files with 9,136 additions and 8,927 deletions.
64 changes: 32 additions & 32 deletions core/benchmarks/CoalescedRDDBenchmark-jdk11-results.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,39 +2,39 @@
Coalesced RDD , large scale
================================================================================================

OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Coalesce Num Partitions: 100 Num Hosts: 1 365 454 104 0.3 3652.8 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 271 374 90 0.4 2708.0 1.3X
Coalesce Num Partitions: 100 Num Hosts: 10 265 337 88 0.4 2651.9 1.4X
Coalesce Num Partitions: 100 Num Hosts: 20 277 338 87 0.4 2772.8 1.3X
Coalesce Num Partitions: 100 Num Hosts: 40 313 320 6 0.3 3127.8 1.2X
Coalesce Num Partitions: 100 Num Hosts: 80 291 330 60 0.3 2909.5 1.3X
Coalesce Num Partitions: 500 Num Hosts: 1 974 1035 59 0.1 9741.6 0.4X
Coalesce Num Partitions: 500 Num Hosts: 5 443 450 6 0.2 4427.7 0.8X
Coalesce Num Partitions: 500 Num Hosts: 10 382 455 64 0.3 3816.6 1.0X
Coalesce Num Partitions: 500 Num Hosts: 20 359 402 39 0.3 3589.9 1.0X
Coalesce Num Partitions: 500 Num Hosts: 40 317 350 54 0.3 3165.5 1.2X
Coalesce Num Partitions: 500 Num Hosts: 80 267 337 81 0.4 2668.5 1.4X
Coalesce Num Partitions: 1000 Num Hosts: 1 1621 1712 84 0.1 16205.9 0.2X
Coalesce Num Partitions: 1000 Num Hosts: 5 582 638 85 0.2 5817.7 0.6X
Coalesce Num Partitions: 1000 Num Hosts: 10 398 446 74 0.3 3980.8 0.9X
Coalesce Num Partitions: 1000 Num Hosts: 20 332 410 108 0.3 3315.1 1.1X
Coalesce Num Partitions: 1000 Num Hosts: 40 345 377 54 0.3 3453.1 1.1X
Coalesce Num Partitions: 1000 Num Hosts: 80 294 353 69 0.3 2940.5 1.2X
Coalesce Num Partitions: 5000 Num Hosts: 1 6818 6906 151 0.0 68183.8 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 1606 1719 138 0.1 16061.1 0.2X
Coalesce Num Partitions: 5000 Num Hosts: 10 965 1031 94 0.1 9653.8 0.4X
Coalesce Num Partitions: 5000 Num Hosts: 20 643 722 98 0.2 6427.4 0.6X
Coalesce Num Partitions: 5000 Num Hosts: 40 445 517 97 0.2 4448.8 0.8X
Coalesce Num Partitions: 5000 Num Hosts: 80 369 432 93 0.3 3688.6 1.0X
Coalesce Num Partitions: 10000 Num Hosts: 1 12850 12953 90 0.0 128503.9 0.0X
Coalesce Num Partitions: 10000 Num Hosts: 5 3431 3463 49 0.0 34307.1 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 10 1687 1795 106 0.1 16874.8 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 20 1084 1125 58 0.1 10844.2 0.3X
Coalesce Num Partitions: 10000 Num Hosts: 40 667 722 73 0.1 6674.4 0.5X
Coalesce Num Partitions: 10000 Num Hosts: 80 488 542 82 0.2 4883.9 0.7X
Coalesce Num Partitions: 100 Num Hosts: 1 372 439 69 0.3 3721.8 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 244 307 82 0.4 2439.9 1.5X
Coalesce Num Partitions: 100 Num Hosts: 10 238 285 56 0.4 2376.3 1.6X
Coalesce Num Partitions: 100 Num Hosts: 20 268 299 50 0.4 2683.0 1.4X
Coalesce Num Partitions: 100 Num Hosts: 40 237 304 84 0.4 2367.0 1.6X
Coalesce Num Partitions: 100 Num Hosts: 80 256 263 8 0.4 2562.7 1.5X
Coalesce Num Partitions: 500 Num Hosts: 1 588 647 83 0.2 5882.1 0.6X
Coalesce Num Partitions: 500 Num Hosts: 5 335 340 6 0.3 3347.3 1.1X
Coalesce Num Partitions: 500 Num Hosts: 10 272 350 71 0.4 2716.5 1.4X
Coalesce Num Partitions: 500 Num Hosts: 20 250 297 60 0.4 2501.5 1.5X
Coalesce Num Partitions: 500 Num Hosts: 40 238 330 83 0.4 2376.8 1.6X
Coalesce Num Partitions: 500 Num Hosts: 80 235 330 83 0.4 2349.8 1.6X
Coalesce Num Partitions: 1000 Num Hosts: 1 1010 1061 60 0.1 10102.5 0.4X
Coalesce Num Partitions: 1000 Num Hosts: 5 411 415 5 0.2 4105.3 0.9X
Coalesce Num Partitions: 1000 Num Hosts: 10 302 348 75 0.3 3022.8 1.2X
Coalesce Num Partitions: 1000 Num Hosts: 20 262 319 93 0.4 2624.4 1.4X
Coalesce Num Partitions: 1000 Num Hosts: 40 291 352 95 0.3 2910.4 1.3X
Coalesce Num Partitions: 1000 Num Hosts: 80 275 324 79 0.4 2746.0 1.4X
Coalesce Num Partitions: 5000 Num Hosts: 1 4077 4116 57 0.0 40771.2 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 1401 1449 66 0.1 14012.6 0.3X
Coalesce Num Partitions: 5000 Num Hosts: 10 820 849 43 0.1 8196.3 0.5X
Coalesce Num Partitions: 5000 Num Hosts: 20 556 611 81 0.2 5560.3 0.7X
Coalesce Num Partitions: 5000 Num Hosts: 40 373 431 91 0.3 3732.1 1.0X
Coalesce Num Partitions: 5000 Num Hosts: 80 332 375 64 0.3 3316.1 1.1X
Coalesce Num Partitions: 10000 Num Hosts: 1 7346 7372 32 0.0 73455.9 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 5 2599 2656 85 0.0 25985.4 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 10 1429 1458 43 0.1 14292.3 0.3X
Coalesce Num Partitions: 10000 Num Hosts: 20 822 857 50 0.1 8224.4 0.5X
Coalesce Num Partitions: 10000 Num Hosts: 40 528 592 102 0.2 5278.3 0.7X
Coalesce Num Partitions: 10000 Num Hosts: 80 389 457 101 0.3 3894.3 1.0X


64 changes: 32 additions & 32 deletions core/benchmarks/CoalescedRDDBenchmark-jdk17-results.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,39 +2,39 @@
Coalesced RDD , large scale
================================================================================================

OpenJDK 64-Bit Server VM 17.0.1+12-LTS on Linux 5.8.0-1042-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
OpenJDK 64-Bit Server VM 17.0.1+12-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Coalesce Num Partitions: 100 Num Hosts: 1 342 373 27 0.3 3424.0 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 293 307 21 0.3 2933.8 1.2X
Coalesce Num Partitions: 100 Num Hosts: 10 251 272 28 0.4 2505.8 1.4X
Coalesce Num Partitions: 100 Num Hosts: 20 273 281 11 0.4 2727.5 1.3X
Coalesce Num Partitions: 100 Num Hosts: 40 251 253 2 0.4 2513.1 1.4X
Coalesce Num Partitions: 100 Num Hosts: 80 272 276 6 0.4 2720.4 1.3X
Coalesce Num Partitions: 500 Num Hosts: 1 653 694 48 0.2 6534.7 0.5X
Coalesce Num Partitions: 500 Num Hosts: 5 357 364 9 0.3 3573.6 1.0X
Coalesce Num Partitions: 500 Num Hosts: 10 357 363 7 0.3 3565.7 1.0X
Coalesce Num Partitions: 500 Num Hosts: 20 299 317 26 0.3 2988.7 1.1X
Coalesce Num Partitions: 500 Num Hosts: 40 303 316 11 0.3 3031.1 1.1X
Coalesce Num Partitions: 500 Num Hosts: 80 282 286 4 0.4 2815.0 1.2X
Coalesce Num Partitions: 1000 Num Hosts: 1 1007 1043 35 0.1 10065.2 0.3X
Coalesce Num Partitions: 1000 Num Hosts: 5 463 477 12 0.2 4627.6 0.7X
Coalesce Num Partitions: 1000 Num Hosts: 10 348 368 20 0.3 3475.5 1.0X
Coalesce Num Partitions: 1000 Num Hosts: 20 304 328 22 0.3 3037.0 1.1X
Coalesce Num Partitions: 1000 Num Hosts: 40 304 338 30 0.3 3035.6 1.1X
Coalesce Num Partitions: 1000 Num Hosts: 80 291 322 29 0.3 2906.1 1.2X
Coalesce Num Partitions: 5000 Num Hosts: 1 4423 4476 57 0.0 44229.2 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 1630 1655 22 0.1 16303.1 0.2X
Coalesce Num Partitions: 5000 Num Hosts: 10 919 934 14 0.1 9189.5 0.4X
Coalesce Num Partitions: 5000 Num Hosts: 20 639 658 18 0.2 6385.7 0.5X
Coalesce Num Partitions: 5000 Num Hosts: 40 461 465 3 0.2 4610.4 0.7X
Coalesce Num Partitions: 5000 Num Hosts: 80 370 387 26 0.3 3703.7 0.9X
Coalesce Num Partitions: 10000 Num Hosts: 1 7814 7867 47 0.0 78136.0 0.0X
Coalesce Num Partitions: 10000 Num Hosts: 5 2946 2978 34 0.0 29457.1 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 10 1616 1638 34 0.1 16162.9 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 20 920 961 39 0.1 9197.3 0.4X
Coalesce Num Partitions: 10000 Num Hosts: 40 614 623 8 0.2 6135.2 0.6X
Coalesce Num Partitions: 10000 Num Hosts: 80 459 464 7 0.2 4586.4 0.7X
Coalesce Num Partitions: 100 Num Hosts: 1 314 337 28 0.3 3142.0 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 224 226 3 0.4 2235.1 1.4X
Coalesce Num Partitions: 100 Num Hosts: 10 198 201 2 0.5 1982.9 1.6X
Coalesce Num Partitions: 100 Num Hosts: 20 194 206 16 0.5 1936.3 1.6X
Coalesce Num Partitions: 100 Num Hosts: 40 189 192 3 0.5 1893.6 1.7X
Coalesce Num Partitions: 100 Num Hosts: 80 229 232 4 0.4 2291.2 1.4X
Coalesce Num Partitions: 500 Num Hosts: 1 553 559 5 0.2 5533.2 0.6X
Coalesce Num Partitions: 500 Num Hosts: 5 276 281 7 0.4 2762.6 1.1X
Coalesce Num Partitions: 500 Num Hosts: 10 265 269 3 0.4 2648.8 1.2X
Coalesce Num Partitions: 500 Num Hosts: 20 214 231 19 0.5 2141.3 1.5X
Coalesce Num Partitions: 500 Num Hosts: 40 237 245 8 0.4 2365.4 1.3X
Coalesce Num Partitions: 500 Num Hosts: 80 206 220 19 0.5 2057.9 1.5X
Coalesce Num Partitions: 1000 Num Hosts: 1 846 879 55 0.1 8459.7 0.4X
Coalesce Num Partitions: 1000 Num Hosts: 5 310 317 9 0.3 3104.2 1.0X
Coalesce Num Partitions: 1000 Num Hosts: 10 269 282 20 0.4 2686.3 1.2X
Coalesce Num Partitions: 1000 Num Hosts: 20 234 236 1 0.4 2339.7 1.3X
Coalesce Num Partitions: 1000 Num Hosts: 40 243 250 7 0.4 2431.1 1.3X
Coalesce Num Partitions: 1000 Num Hosts: 80 206 209 2 0.5 2060.4 1.5X
Coalesce Num Partitions: 5000 Num Hosts: 1 3579 3582 4 0.0 35785.7 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 806 844 46 0.1 8059.4 0.4X
Coalesce Num Partitions: 5000 Num Hosts: 10 502 512 11 0.2 5023.4 0.6X
Coalesce Num Partitions: 5000 Num Hosts: 20 416 420 6 0.2 4160.6 0.8X
Coalesce Num Partitions: 5000 Num Hosts: 40 301 305 4 0.3 3013.1 1.0X
Coalesce Num Partitions: 5000 Num Hosts: 80 254 259 5 0.4 2541.9 1.2X
Coalesce Num Partitions: 10000 Num Hosts: 1 6490 6501 13 0.0 64904.9 0.0X
Coalesce Num Partitions: 10000 Num Hosts: 5 1830 1860 26 0.1 18301.2 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 10 1022 1040 25 0.1 10218.7 0.3X
Coalesce Num Partitions: 10000 Num Hosts: 20 677 679 2 0.1 6767.7 0.5X
Coalesce Num Partitions: 10000 Num Hosts: 40 442 445 3 0.2 4420.7 0.7X
Coalesce Num Partitions: 10000 Num Hosts: 80 330 337 9 0.3 3303.2 1.0X


Loading

0 comments on commit a85a205

Please sign in to comment.