Raw data generated by iklam on 2025/03/07 HOWTO: https://github.com/openjdk/leyden/blob/bbac8f2d845aa6408182ca3ff9ce60b5ca6e0390/README.md#5-benchmarking Dell OptiPlex 7090 (May 2022) Intel Core i7-10700 @ 2.90GHz, 1TB SSD Ubuntu 22.04.5 LTS MAINLINE_JAVA: $ /work/official/jdk24/bin/java --version java 24 2025-03-18 Java(TM) SE Runtime Environment (build 24+36-3646) Java HotSpot(TM) 64-Bit Server VM (build 24+36-3646, mixed mode, sharing) PREMAIN_JAVA: Build from https://github.com/openjdk/leyden/tree/bbac8f2d845aa6408182ca3ff9ce60b5ca6e0390 =================================================================================================== /work/le4/open/test/hotspot/jtreg/premain/helidon-quickstart-se$ make bench rm -f *.cds *.cds.code *.classlist *.jsa *~ *.log *.log.* hs_err_* *.aot *.aotconf rm -f mainline_vs_premain.csv run,mainline default,mainline custom static cds,mainline aot cache,premain aot cache 1,456,229,156,117 2,453,227,157,117 3,455,232,155,116 4,448,230,154,114 5,440,228,156,114 6,446,228,156,114 7,448,232,156,114 8,465,261,159,114 9,448,226,157,113 10,442,233,154,114 Geomean,450.05,232.41,155.99,114.69 Stdev,6.98,9.72,1.41,1.35 Markdown snippets in mainline_vs_premain.md /work/le4/open/test/hotspot/jtreg/premain/helidon-quickstart-se$ cat mainline_vs_premain.md ```mermaid --- config: xyChart: chartOrientation: horizontal height: 300 --- xychart-beta x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"] y-axis "Elapsed time (ms, smaller is better)" 0 --> 450.05 bar [450.05, 232.41, 155.99, 114.69] ``` -----------------Normalized--------------------------------------------- ```mermaid --- config: xyChart: chartOrientation: horizontal height: 300 --- xychart-beta x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"] y-axis "Elapsed time (normalized, smaller is better)" 0 --> 1000 bar [1000, 516, 347, 255] ``` =================================================================================================== /work/le4/open/test/hotspot/jtreg/premain/micronaut-first-app$ make bench rm -f *.cds *.cds.code *.classlist *.jsa *~ *.log *.log.* hs_err_* rm -f mainline_vs_premain.csv run,mainline default,mainline custom static cds,mainline aot cache,premain aot cache 1,589,294,222,188 2,585,281,227,208 3,594,274,224,199 4,620,344,221,200 5,611,297,221,203 6,617,285,223,201 7,614,282,220,197 8,665,290,229,200 9,612,281,224,181 10,601,279,222,184 Geomean,610.43,290.13,223.28,195.92 Stdev,21.43,18.98,2.69,8.32 Markdown snippets in mainline_vs_premain.md /work/le4/open/test/hotspot/jtreg/premain/micronaut-first-app$ cat mainline_vs_premain.md ```mermaid --- config: xyChart: chartOrientation: horizontal height: 300 --- xychart-beta x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"] y-axis "Elapsed time (ms, smaller is better)" 0 --> 610.43 bar [610.43, 290.13, 223.28, 195.92] ``` -----------------Normalized--------------------------------------------- ```mermaid --- config: xyChart: chartOrientation: horizontal height: 300 --- xychart-beta x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"] y-axis "Elapsed time (normalized, smaller is better)" 0 --> 1000 bar [1000, 475, 366, 321] ``` ===================================================================================== /work/le4/open/test/hotspot/jtreg/premain/quarkus-getting-started$ make bench rm -f *.cds *.cds.code *.classlist *.jsa *~ *.log *.log.* hs_err_* rm -f mainline_vs_premain.csv run,mainline default,mainline custom static cds,mainline aot cache,premain aot cache 1,604,283,241,176 2,612,273,238,176 3,614,276,248,179 4,601,287,257,176 5,615,283,241,177 6,629,283,232,179 7,617,273,234,179 8,845,258,239,187 9,588,271,232,179 10,601,264,232,179 Geomean,629.18,274.96,239.28,178.67 Stdev,71.59,8.78,7.64,3.07 Markdown snippets in mainline_vs_premain.md /work/le4/open/test/hotspot/jtreg/premain/quarkus-getting-started$ cat mainline_vs_premain.md ```mermaid --- config: xyChart: chartOrientation: horizontal height: 300 --- xychart-beta x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"] y-axis "Elapsed time (ms, smaller is better)" 0 --> 629.18 bar [629.18, 274.96, 239.28, 178.67] ``` -----------------Normalized--------------------------------------------- ```mermaid --- config: xyChart: chartOrientation: horizontal height: 300 --- xychart-beta x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"] y-axis "Elapsed time (normalized, smaller is better)" 0 --> 1000 bar [1000, 437, 380, 284] ``` =============================================================================== /work/le4/open/test/hotspot/jtreg/premain/spring-boot-getting-started$ make bench rm -f *.cds *.cds.code *.classlist *.jsa *~ *.log *.log.* hs_err_* tmp.txt rm -f mainline_vs_premain.csv run,mainline default,mainline custom static cds,mainline aot cache,premain aot cache 1,981,507,379,268 2,1000,500,386,444 3,1037,507,381,266 4,1007,515,386,269 5,1004,512,387,284 6,1009,507,379,297 7,1023,506,398,270 8,1007,509,385,287 9,1022,509,389,272 10,1013,502,386,273 Geomean,1010.20,507.38,385.56,289.48 Stdev,14.30,4.13,5.26,51.22 Markdown snippets in mainline_vs_premain.md /work/le4/open/test/hotspot/jtreg/premain/spring-boot-getting-started$ cat mainline_vs_premain.md ```mermaid --- config: xyChart: chartOrientation: horizontal height: 300 --- xychart-beta x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"] y-axis "Elapsed time (ms, smaller is better)" 0 --> 1010.20 bar [1010.20, 507.38, 385.56, 289.48] ``` -----------------Normalized--------------------------------------------- ```mermaid --- config: xyChart: chartOrientation: horizontal height: 300 --- xychart-beta x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"] y-axis "Elapsed time (normalized, smaller is better)" 0 --> 1000 bar [1000, 502, 382, 287] ``` =================================================================================================== /work/le4/open/test/hotspot/jtreg/premain/spring-petclinic$ make bench rm -fv spring-petclinic.* *.aot *.aotconf removed 'spring-petclinic.aot' removed 'spring-petclinic.aot.log' removed 'spring-petclinic.aotconf' removed 'spring-petclinic.aotconf.log' removed 'spring-petclinic.classload.ml.log' removed 'spring-petclinic.ml.aot' removed 'spring-petclinic.ml.aot.log' removed 'spring-petclinic.ml.aotconf' removed 'spring-petclinic.ml.aotconf.log' removed 'spring-petclinic.ml.classlist' removed 'spring-petclinic.static.ml.jsa' removed 'spring-petclinic.static.ml.jsa.log' rm -f mainline_vs_premain.csv run,mainline default,mainline custom static cds,mainline aot cache,premain aot cache 1,4371,2716,2687,1634 2,4280,2674,2521,1626 3,4333,2726,2497,1657 4,4332,2824,2539,1645 5,4321,2680,2589,1656 6,4346,2629,2550,1661 7,4460,2717,2520,1634 8,4361,2797,2521,1654 9,4338,2757,2520,1603 10,4374,2678,2539,1610 Geomean,4351.37,2719.22,2547.79,1637.89 Stdev,44.41,56.51,51.76,19.25 Markdown snippets in mainline_vs_premain.md cat bench.sh >bench chmod a+x bench /work/le4/open/test/hotspot/jtreg/premain/spring-petclinic$ cat mainline_vs_premain.md ```mermaid --- config: xyChart: chartOrientation: horizontal height: 300 --- xychart-beta x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"] y-axis "Elapsed time (ms, smaller is better)" 0 --> 4351.37 bar [4351.37, 2719.22, 2547.79, 1637.89] ``` -----------------Normalized--------------------------------------------- ```mermaid --- config: xyChart: chartOrientation: horizontal height: 300 --- xychart-beta x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"] y-axis "Elapsed time (normalized, smaller is better)" 0 --> 1000 bar [1000, 625, 586, 376] ```