Raw data generated by iklam on 2025/09/12

HOWTO: https://github.com/openjdk/leyden/blob/8df3504f55cabe9ff8a1d239f469b18d00ff802b/README.md#5-benchmarking

XPS Desktop 8960 (Nov 2024) Intel(R) Core(TM) i7-14700 @ 2.90GHz, 1TB SSD
Ubuntu 24.04.1 LTS

MAINLINE_JAVA:

$ /work/official/jdk25/bin/java --version
java 25 2025-09-16 LTS
Java(TM) SE Runtime Environment (build 25+37-LTS-3491)
Java HotSpot(TM) 64-Bit Server VM (build 25+37-LTS-3491, mixed mode, sharing)

PREMAIN_JAVA:
Build from https://github.com/openjdk/leyden/commit/8df3504f55cabe9ff8a1d239f469b18d00ff802b

===================================================================================================

/work/le4/open/test/hotspot/jtreg/premain/helidon-quickstart-se$ make bench
rm -f *.cds *.cds.code *.classlist *.jsa *~ *.log *.log.* hs_err_* *.aot *.aotconf
rm -f mainline_vs_premain.csv
run,mainline default,mainline custom static cds,mainline aot cache,premain aot cache
1,261,124,81,78
2,248,123,78,65
3,235,119,77,67
4,239,163,82,66
5,238,130,80,65
6,240,121,81,66
7,238,122,83,63
8,236,123,83,64
9,230,126,79,67
10,239,124,82,67
Geomean,240.27,126.99,80.58,66.69 (3.52 improvement)
Stdev,8.09,12.16,1.96,3.94
Markdown snippets in mainline_vs_premain.md

/work/le4/open/test/hotspot/jtreg/premain/helidon-quickstart-se$ cat mainline_vs_premain.md
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (ms, smaller is better)" 0 --> 230.47
    bar [230.47, 123.45, 76.34, 65.48]
```

-----------------Normalized---------------------------------------------
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (normalized, smaller is better)" 0 --> 1000
    bar [1000, 536, 331, 284]
```
===============================================================================

/work/le4/open/test/hotspot/jtreg/premain/javac_bench$ make bench
rm -f  *.class *.jar
rm -f mainline_vs_premain.csv
run,mainline default,mainline custom static cds,mainline aot cache,premain aot cache
1,482,362,273,215
2,465,364,254,215
3,463,378,266,239
4,485,362,283,211
5,462,374,272,230
6,465,384,261,208
7,491,369,250,215
8,477,363,263,214
9,460,360,292,214
10,470,363,263,212
Geomean,471.89,367.82,267.43,217.12 (2.17x improvement)
Stdev,10.40,7.71,12.10,9.08
Markdown snippets in mainline_vs_premain.md

/work/le4/open/test/hotspot/jtreg/premain/javac_bench$ cat mainline_vs_premain.md 
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (ms, smaller is better)" 0 --> 471.89
    bar [471.89, 367.82, 267.43, 217.12]
```

-----------------Normalized---------------------------------------------
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (normalized, smaller is better)" 0 --> 1000
    bar [1000, 779, 567, 460]
```

===================================================================================================

/work/le4/open/test/hotspot/jtreg/premain/micronaut-first-app$ make bench
rm -f *.cds *.cds.code *.classlist *.jsa *~ *.log *.log.* hs_err_* *.aot *.aotconf
rm -f mainline_vs_premain.csv
run,mainline default,mainline custom static cds,mainline aot cache,premain aot cache
1,332,149,136,115
2,312,155,139,112
3,320,156,119,122
4,309,148,117,110
5,316,151,124,111
6,309,172,122,108
7,327,149,124,102
8,324,144,115,118
9,308,155,148,104
10,306,153,118,109
Geomean,316.18,153.04,125.79,110.95 (2.85x improvement)
Stdev,8.57,7.21,10.45,5.75
Markdown snippets in mainline_vs_premain.md

/work/le4/open/test/hotspot/jtreg/premain/micronaut-first-app$ cat mainline_vs_premain.md
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (ms, smaller is better)" 0 --> 316.18
    bar [316.18, 153.04, 125.79, 110.95]
```

-----------------Normalized---------------------------------------------
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (normalized, smaller is better)" 0 --> 1000
    bar [1000, 484, 398, 351]
```

=====================================================================================

/work/le4/open/test/hotspot/jtreg/premain/quarkus-getting-started$ make bench
rm -f *.cds *.cds.code *.classlist *.jsa *~ *.log *.log.* hs_err_* *.aot *.aotconf
rm -f mainline_vs_premain.csv
run,mainline default,mainline custom static cds,mainline aot cache,premain aot cache
1,347,176,150,129
2,340,165,134,131
3,352,169,138,134
4,340,172,148,125
5,338,162,140,133
6,339,171,155,118
7,342,168,153,124
8,356,169,131,141
9,353,156,136,113
10,345,174,140,121
Geomean,345.15,168.10,142.28,126.65 (2.73x improvement)
Stdev,6.18,5.62,7.95,7.92
Markdown snippets in mainline_vs_premain.md

/work/le4/open/test/hotspot/jtreg/premain/quarkus-getting-started$ cat mainline_vs_premain.md
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (ms, smaller is better)" 0 --> 345.15
    bar [345.15, 168.10, 142.28, 126.65]
```

-----------------Normalized---------------------------------------------
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (normalized, smaller is better)" 0 --> 1000
    bar [1000, 487, 412, 367]
```

===============================================================================

/work/le4/open/test/hotspot/jtreg/premain/spring-boot-getting-started$ make bench
rm -f *.cds *.cds.code *.classlist *.jsa *~ *.log *.log.* hs_err_* tmp.txt *.aot *.aotconf
rm -f mainline_vs_premain.csv
run,mainline default,mainline custom static cds,mainline aot cache,premain aot cache
1,498,249,160,127
2,490,240,164,125
3,492,247,163,121
4,491,247,167,127
5,494,242,161,124
6,495,243,163,128
7,487,248,176,123
8,487,243,162,123
9,491,243,169,124
10,508,244,161,124
Geomean,493.27,244.58,164.54,124.58 (3.96x improvement)
Stdev,5.87,2.80,4.63,2.06
Markdown snippets in mainline_vs_premain.md

/work/le4/open/test/hotspot/jtreg/premain/spring-boot-getting-started$ cat mainline_vs_premain.md
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (ms, smaller is better)" 0 --> 493.27
    bar [493.27, 244.58, 164.54, 124.58]
```

-----------------Normalized---------------------------------------------
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (normalized, smaller is better)" 0 --> 1000
    bar [1000, 496, 334, 253]
```

===================================================================================================

/work/le4/open/test/hotspot/jtreg/premain/spring-petclinic$ make bench
rm -f spring-petclinic.* *.aot *.aotconf
rm -f mainline_vs_premain.csv
run,mainline default,mainline custom static cds,mainline aot cache,premain aot cache
1,2109,1216,1169,696
2,2132,1243,1153,707
3,2125,1253,1123,722
4,2426,1441,1420,711
5,2414,1460,1352,731
6,2585,1580,1453,790
7,2618,1555,1429,773
8,2550,1543,1490,763
9,2562,1559,1420,764
10,2544,1557,1350,747
Geomean,2398.24,1433.59,1329.35,739.79 (3.24x improvement)
Stdev,195.91,139.87,129.37,30.02
Markdown snippets in mainline_vs_premain.md
cat bench.sh >bench 
chmod a+x bench

/work/le4/open/test/hotspot/jtreg/premain/spring-petclinic$ cat mainline_vs_premain.md
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (ms, smaller is better)" 0 --> 2398.24
    bar [2398.24, 1433.59, 1329.35, 739.79]
```

-----------------Normalized---------------------------------------------
```mermaid
---
config:
    xyChart:
        chartOrientation: horizontal
        height: 300
---
xychart-beta
    x-axis "variant" ["mainline default", "mainline custom static cds", "mainline aot cache", "premain aot cache"]
    y-axis "Elapsed time (normalized, smaller is better)" 0 --> 1000
    bar [1000, 598, 554, 308]
```