dd-trace-java
dd-trace-java copied to clipboard
DataDog
Bump Groovy: 3.0.25 -> 4.0.29
DO NOT MERGE
What Does This Do
Bump Groovy: 3.0.25 -> 4.0.29
Motivation
Latest Groovy
Additional Notes
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | alexeyk/groovy-4 |
| git_commit_date | 1766094198 | 1766103948 |
| git_commit_sha | 45bc239667 | 71c1ad1e64 |
| release_version | 1.58.0-SNAPSHOT~45bc239667 | 1.55.0-SNAPSHOT~71c1ad1e64 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1766105982 | 1766105982 |
| ci_job_id | 1308344498 | 1308344498 |
| ci_pipeline_id | 87704257 | 87704257 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-acw2fm6e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-acw2fm6e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 10 unstable metrics.
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~71c1ad1e64, baseline=1.58.0-SNAPSHOT~45bc239667
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.086 s) : 0, 1086363
Total [baseline] (8.819 s) : 0, 8819211
Agent [candidate] (1.079 s) : 0, 1079435
Total [candidate] (8.717 s) : 0, 8716539
section iast
Agent [baseline] (1.225 s) : 0, 1225349
Total [baseline] (9.314 s) : 0, 9314253
Agent [candidate] (1.223 s) : 0, 1222998
Total [candidate] (9.319 s) : 0, 9318875
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.086 s | - |
| Agent | iast | 1.225 s | 138.986 ms (12.8%) |
| Total | tracing | 8.819 s | - |
| Total | iast | 9.314 s | 495.042 ms (5.6%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.079 s | - |
| Agent | iast | 1.223 s | 143.563 ms (13.3%) |
| Total | tracing | 8.717 s | - |
| Total | iast | 9.319 s | 602.336 ms (6.9%) |
gantt
title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~71c1ad1e64, baseline=1.58.0-SNAPSHOT~45bc239667
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (652.757 ms) : 0, 652757
BytebuddyAgent [candidate] (648.744 ms) : 0, 648744
GlobalTracer [baseline] (283.506 ms) : 0, 283506
GlobalTracer [candidate] (281.593 ms) : 0, 281593
AppSec [baseline] (32.543 ms) : 0, 32543
AppSec [candidate] (32.112 ms) : 0, 32112
Debugger [baseline] (67.248 ms) : 0, 67248
Debugger [candidate] (67.162 ms) : 0, 67162
Remote Config [baseline] (633.174 µs) : 0, 633
Remote Config [candidate] (620.346 µs) : 0, 620
Telemetry [baseline] (9.07 ms) : 0, 9070
Telemetry [candidate] (8.941 ms) : 0, 8941
Flare Poller [baseline] (3.776 ms) : 0, 3776
Flare Poller [candidate] (3.642 ms) : 0, 3642
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (793.217 ms) : 0, 793217
BytebuddyAgent [candidate] (791.269 ms) : 0, 791269
GlobalTracer [baseline] (256.29 ms) : 0, 256290
GlobalTracer [candidate] (255.734 ms) : 0, 255734
IAST [baseline] (27.218 ms) : 0, 27218
IAST [candidate] (27.113 ms) : 0, 27113
AppSec [baseline] (34.427 ms) : 0, 34427
AppSec [candidate] (32.672 ms) : 0, 32672
Debugger [baseline] (65.081 ms) : 0, 65081
Debugger [candidate] (66.988 ms) : 0, 66988
Remote Config [baseline] (583.09 µs) : 0, 583
Remote Config [candidate] (606.38 µs) : 0, 606
Telemetry [baseline] (8.452 ms) : 0, 8452
Telemetry [candidate] (8.493 ms) : 0, 8493
Flare Poller [baseline] (3.507 ms) : 0, 3507
Flare Poller [candidate] (3.562 ms) : 0, 3562
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~71c1ad1e64, baseline=1.58.0-SNAPSHOT~45bc239667
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1081159
Total [baseline] (10.821 s) : 0, 10820991
Agent [candidate] (1.087 s) : 0, 1087304
Total [candidate] (10.828 s) : 0, 10827817
section appsec
Agent [baseline] (1.263 s) : 0, 1262525
Total [baseline] (10.996 s) : 0, 10996024
Agent [candidate] (1.265 s) : 0, 1265245
Total [candidate] (11.082 s) : 0, 11082460
section iast
Agent [baseline] (1.228 s) : 0, 1227775
Total [baseline] (11.206 s) : 0, 11206483
Agent [candidate] (1.222 s) : 0, 1222457
Total [candidate] (11.203 s) : 0, 11202979
section profiling
Agent [baseline] (1.21 s) : 0, 1210347
Total [baseline] (11.014 s) : 0, 11014459
Agent [candidate] (1.205 s) : 0, 1204568
Total [candidate] (10.906 s) : 0, 10906387
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.081 s | - |
| Agent | appsec | 1.263 s | 181.366 ms (16.8%) |
| Agent | iast | 1.228 s | 146.616 ms (13.6%) |
| Agent | profiling | 1.21 s | 129.188 ms (11.9%) |
| Total | tracing | 10.821 s | - |
| Total | appsec | 10.996 s | 175.034 ms (1.6%) |
| Total | iast | 11.206 s | 385.492 ms (3.6%) |
| Total | profiling | 11.014 s | 193.468 ms (1.8%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.087 s | - |
| Agent | appsec | 1.265 s | 177.941 ms (16.4%) |
| Agent | iast | 1.222 s | 135.153 ms (12.4%) |
| Agent | profiling | 1.205 s | 117.264 ms (10.8%) |
| Total | tracing | 10.828 s | - |
| Total | appsec | 11.082 s | 254.642 ms (2.4%) |
| Total | iast | 11.203 s | 375.162 ms (3.5%) |
| Total | profiling | 10.906 s | 78.57 ms (0.7%) |
gantt
title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~71c1ad1e64, baseline=1.58.0-SNAPSHOT~45bc239667
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (649.3 ms) : 0, 649300
BytebuddyAgent [candidate] (652.58 ms) : 0, 652580
GlobalTracer [baseline] (281.4 ms) : 0, 281400
GlobalTracer [candidate] (283.084 ms) : 0, 283084
AppSec [baseline] (32.136 ms) : 0, 32136
AppSec [candidate] (32.444 ms) : 0, 32444
Debugger [baseline] (67.755 ms) : 0, 67755
Debugger [candidate] (68.89 ms) : 0, 68890
Remote Config [baseline] (613.194 µs) : 0, 613
Remote Config [candidate] (617.481 µs) : 0, 617
Telemetry [baseline] (9.68 ms) : 0, 9680
Telemetry [candidate] (9.073 ms) : 0, 9073
Flare Poller [baseline] (3.637 ms) : 0, 3637
Flare Poller [candidate] (3.789 ms) : 0, 3789
section appsec
crashtracking [baseline] (1.173 ms) : 0, 1173
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (688.196 ms) : 0, 688196
BytebuddyAgent [candidate] (691.012 ms) : 0, 691012
GlobalTracer [baseline] (258.066 ms) : 0, 258066
GlobalTracer [candidate] (259.208 ms) : 0, 259208
AppSec [baseline] (173.498 ms) : 0, 173498
AppSec [candidate] (173.115 ms) : 0, 173115
Debugger [baseline] (68.081 ms) : 0, 68081
Debugger [candidate] (67.345 ms) : 0, 67345
Remote Config [baseline] (720.321 µs) : 0, 720
Remote Config [candidate] (692.78 µs) : 0, 693
Telemetry [baseline] (8.942 ms) : 0, 8942
Telemetry [candidate] (8.894 ms) : 0, 8894
Flare Poller [baseline] (3.878 ms) : 0, 3878
Flare Poller [candidate] (3.833 ms) : 0, 3833
IAST [baseline] (24.502 ms) : 0, 24502
IAST [candidate] (24.48 ms) : 0, 24480
section iast
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (793.323 ms) : 0, 793323
BytebuddyAgent [candidate] (790.447 ms) : 0, 790447
GlobalTracer [baseline] (256.787 ms) : 0, 256787
GlobalTracer [candidate] (255.234 ms) : 0, 255234
AppSec [baseline] (32.926 ms) : 0, 32926
AppSec [candidate] (34.492 ms) : 0, 34492
Debugger [baseline] (68.194 ms) : 0, 68194
Debugger [candidate] (66.01 ms) : 0, 66010
Remote Config [baseline] (589.519 µs) : 0, 590
Remote Config [candidate] (607.536 µs) : 0, 608
Telemetry [baseline] (8.617 ms) : 0, 8617
Telemetry [candidate] (8.594 ms) : 0, 8594
Flare Poller [baseline] (3.543 ms) : 0, 3543
Flare Poller [candidate] (3.509 ms) : 0, 3509
IAST [baseline] (27.266 ms) : 0, 27266
IAST [candidate] (27.077 ms) : 0, 27077
section profiling
ProfilingAgent [baseline] (97.825 ms) : 0, 97825
ProfilingAgent [candidate] (96.842 ms) : 0, 96842
crashtracking [baseline] (1.22 ms) : 0, 1220
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (705.059 ms) : 0, 705059
BytebuddyAgent [candidate] (702.637 ms) : 0, 702637
GlobalTracer [baseline] (221.852 ms) : 0, 221852
GlobalTracer [candidate] (220.963 ms) : 0, 220963
AppSec [baseline] (32.196 ms) : 0, 32196
AppSec [candidate] (31.976 ms) : 0, 31976
Debugger [baseline] (68.682 ms) : 0, 68682
Debugger [candidate] (68.229 ms) : 0, 68229
Remote Config [baseline] (626.322 µs) : 0, 626
Remote Config [candidate] (634.381 µs) : 0, 634
Telemetry [baseline] (9.006 ms) : 0, 9006
Telemetry [candidate] (8.672 ms) : 0, 8672
Flare Poller [baseline] (3.733 ms) : 0, 3733
Flare Poller [candidate] (3.697 ms) : 0, 3697
Profiling [baseline] (98.413 ms) : 0, 98413
Profiling [candidate] (97.419 ms) : 0, 97419
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | alexeyk/groovy-4 |
| git_commit_date | 1766094198 | 1766103948 |
| git_commit_sha | 45bc239667 | 71c1ad1e64 |
| release_version | 1.58.0-SNAPSHOT~45bc239667 | 1.55.0-SNAPSHOT~71c1ad1e64 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1766106476 | 1766106476 |
| ci_job_id | 1308344500 | 1308344500 |
| ci_pipeline_id | 87704257 | 87704257 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-f3io1rux 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-f3io1rux 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 2 performance improvements and 0 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:petclinic:appsec:high_load | better [-1.518ms; -0.765ms] or [-7.794%; -3.925%] |
better [-2.049ms; -0.827ms] or [-6.541%; -2.642%] |
unstable [-10.126op/s; +37.501op/s] or [-4.286%; +15.872%] |
18.340ms | 29.887ms | 249.969op/s | 19.481ms | 31.325ms | 236.281op/s |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~71c1ad1e64, baseline=1.58.0-SNAPSHOT~45bc239667
dateFormat X
axisFormat %s
section baseline
no_agent (18.272 ms) : 18083, 18460
. : milestone, 18272,
appsec (19.758 ms) : 19553, 19963
. : milestone, 19758,
code_origins (18.124 ms) : 17941, 18306
. : milestone, 18124,
iast (18.016 ms) : 17834, 18197
. : milestone, 18016,
profiling (18.872 ms) : 18686, 19058
. : milestone, 18872,
tracing (17.587 ms) : 17415, 17760
. : milestone, 17587,
section candidate
no_agent (18.094 ms) : 17910, 18278
. : milestone, 18094,
appsec (18.672 ms) : 18484, 18859
. : milestone, 18672,
code_origins (17.752 ms) : 17573, 17930
. : milestone, 17752,
iast (17.743 ms) : 17564, 17922
. : milestone, 17743,
profiling (18.743 ms) : 18555, 18931
. : milestone, 18743,
tracing (17.613 ms) : 17442, 17784
. : milestone, 17613,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.272 ms [18.083 ms, 18.46 ms] | - |
| appsec | 19.758 ms [19.553 ms, 19.963 ms] | 1.486 ms (8.1%) |
| code_origins | 18.124 ms [17.941 ms, 18.306 ms] | -148.123 µs (-0.8%) |
| iast | 18.016 ms [17.834 ms, 18.197 ms] | -256.191 µs (-1.4%) |
| profiling | 18.872 ms [18.686 ms, 19.058 ms] | 600.077 µs (3.3%) |
| tracing | 17.587 ms [17.415 ms, 17.76 ms] | -684.252 µs (-3.7%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.094 ms [17.91 ms, 18.278 ms] | - |
| appsec | 18.672 ms [18.484 ms, 18.859 ms] | 577.991 µs (3.2%) |
| code_origins | 17.752 ms [17.573 ms, 17.93 ms] | -342.142 µs (-1.9%) |
| iast | 17.743 ms [17.564 ms, 17.922 ms] | -350.36 µs (-1.9%) |
| profiling | 18.743 ms [18.555 ms, 18.931 ms] | 648.924 µs (3.6%) |
| tracing | 17.613 ms [17.442 ms, 17.784 ms] | -480.575 µs (-2.7%) |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~71c1ad1e64, baseline=1.58.0-SNAPSHOT~45bc239667
dateFormat X
axisFormat %s
section baseline
no_agent (1.189 ms) : 1177, 1201
. : milestone, 1189,
iast (3.226 ms) : 3184, 3267
. : milestone, 3226,
iast_FULL (5.921 ms) : 5861, 5981
. : milestone, 5921,
iast_GLOBAL (3.646 ms) : 3593, 3699
. : milestone, 3646,
profiling (2.111 ms) : 2092, 2131
. : milestone, 2111,
tracing (1.802 ms) : 1787, 1817
. : milestone, 1802,
section candidate
no_agent (1.186 ms) : 1175, 1198
. : milestone, 1186,
iast (3.188 ms) : 3150, 3225
. : milestone, 3188,
iast_FULL (5.754 ms) : 5696, 5811
. : milestone, 5754,
iast_GLOBAL (3.522 ms) : 3467, 3577
. : milestone, 3522,
profiling (1.976 ms) : 1958, 1994
. : milestone, 1976,
tracing (1.775 ms) : 1760, 1790
. : milestone, 1775,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.189 ms [1.177 ms, 1.201 ms] | - |
| iast | 3.226 ms [3.184 ms, 3.267 ms] | 2.037 ms (171.4%) |
| iast_FULL | 5.921 ms [5.861 ms, 5.981 ms] | 4.733 ms (398.2%) |
| iast_GLOBAL | 3.646 ms [3.593 ms, 3.699 ms] | 2.457 ms (206.7%) |
| profiling | 2.111 ms [2.092 ms, 2.131 ms] | 922.543 µs (77.6%) |
| tracing | 1.802 ms [1.787 ms, 1.817 ms] | 613.676 µs (51.6%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.186 ms [1.175 ms, 1.198 ms] | - |
| iast | 3.188 ms [3.15 ms, 3.225 ms] | 2.001 ms (168.7%) |
| iast_FULL | 5.754 ms [5.696 ms, 5.811 ms] | 4.567 ms (385.0%) |
| iast_GLOBAL | 3.522 ms [3.467 ms, 3.577 ms] | 2.335 ms (196.9%) |
| profiling | 1.976 ms [1.958 ms, 1.994 ms] | 789.977 µs (66.6%) |
| tracing | 1.775 ms [1.76 ms, 1.79 ms] | 588.896 µs (49.6%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | alexeyk/groovy-4 |
| git_commit_date | 1766094198 | 1766103948 |
| git_commit_sha | 45bc239667 | 71c1ad1e64 |
| release_version | 1.58.0-SNAPSHOT~45bc239667 | 1.55.0-SNAPSHOT~71c1ad1e64 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1766106381 | 1766106381 |
| ci_job_id | 1308344502 | 1308344502 |
| ci_pipeline_id | 87704257 | 87704257 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-9bjnz0z2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-9bjnz0z2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~71c1ad1e64, baseline=1.58.0-SNAPSHOT~45bc239667
dateFormat X
axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
. : milestone, 1473,
appsec (2.463 ms) : 2411, 2515
. : milestone, 2463,
iast (2.204 ms) : 2139, 2268
. : milestone, 2204,
iast_GLOBAL (2.246 ms) : 2182, 2311
. : milestone, 2246,
profiling (2.079 ms) : 2024, 2133
. : milestone, 2079,
tracing (2.042 ms) : 1991, 2093
. : milestone, 2042,
section candidate
no_agent (1.473 ms) : 1461, 1485
. : milestone, 1473,
appsec (3.695 ms) : 3475, 3915
. : milestone, 3695,
iast (2.207 ms) : 2143, 2271
. : milestone, 2207,
iast_GLOBAL (2.256 ms) : 2190, 2321
. : milestone, 2256,
profiling (2.094 ms) : 2040, 2148
. : milestone, 2094,
tracing (2.043 ms) : 1992, 2094
. : milestone, 2043,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.473 ms [1.461 ms, 1.484 ms] | - |
| appsec | 2.463 ms [2.411 ms, 2.515 ms] | 990.395 µs (67.3%) |
| iast | 2.204 ms [2.139 ms, 2.268 ms] | 730.886 µs (49.6%) |
| iast_GLOBAL | 2.246 ms [2.182 ms, 2.311 ms] | 773.576 µs (52.5%) |
| profiling | 2.079 ms [2.024 ms, 2.133 ms] | 605.931 µs (41.1%) |
| tracing | 2.042 ms [1.991 ms, 2.093 ms] | 569.689 µs (38.7%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.473 ms [1.461 ms, 1.485 ms] | - |
| appsec | 3.695 ms [3.475 ms, 3.915 ms] | 2.222 ms (150.8%) |
| iast | 2.207 ms [2.143 ms, 2.271 ms] | 734.144 µs (49.8%) |
| iast_GLOBAL | 2.256 ms [2.19 ms, 2.321 ms] | 782.57 µs (53.1%) |
| profiling | 2.094 ms [2.04 ms, 2.148 ms] | 620.596 µs (42.1%) |
| tracing | 2.043 ms [1.992 ms, 2.094 ms] | 570.082 µs (38.7%) |
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~71c1ad1e64, baseline=1.58.0-SNAPSHOT~45bc239667
dateFormat X
axisFormat %s
section baseline
no_agent (15.319 s) : 15319000, 15319000
. : milestone, 15319000,
appsec (14.614 s) : 14614000, 14614000
. : milestone, 14614000,
iast (17.953 s) : 17953000, 17953000
. : milestone, 17953000,
iast_GLOBAL (17.904 s) : 17904000, 17904000
. : milestone, 17904000,
profiling (14.723 s) : 14723000, 14723000
. : milestone, 14723000,
tracing (14.483 s) : 14483000, 14483000
. : milestone, 14483000,
section candidate
no_agent (14.985 s) : 14985000, 14985000
. : milestone, 14985000,
appsec (14.696 s) : 14696000, 14696000
. : milestone, 14696000,
iast (18.75 s) : 18750000, 18750000
. : milestone, 18750000,
iast_GLOBAL (17.906 s) : 17906000, 17906000
. : milestone, 17906000,
profiling (14.875 s) : 14875000, 14875000
. : milestone, 14875000,
tracing (14.545 s) : 14545000, 14545000
. : milestone, 14545000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.319 s [15.319 s, 15.319 s] | - |
| appsec | 14.614 s [14.614 s, 14.614 s] | -705.0 ms (-4.6%) |
| iast | 17.953 s [17.953 s, 17.953 s] | 2.634 s (17.2%) |
| iast_GLOBAL | 17.904 s [17.904 s, 17.904 s] | 2.585 s (16.9%) |
| profiling | 14.723 s [14.723 s, 14.723 s] | -596.0 ms (-3.9%) |
| tracing | 14.483 s [14.483 s, 14.483 s] | -836.0 ms (-5.5%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 14.985 s [14.985 s, 14.985 s] | - |
| appsec | 14.696 s [14.696 s, 14.696 s] | -289.0 ms (-1.9%) |
| iast | 18.75 s [18.75 s, 18.75 s] | 3.765 s (25.1%) |
| iast_GLOBAL | 17.906 s [17.906 s, 17.906 s] | 2.921 s (19.5%) |
| profiling | 14.875 s [14.875 s, 14.875 s] | -110.0 ms (-0.7%) |
| tracing | 14.545 s [14.545 s, 14.545 s] | -440.0 ms (-2.9%) |
![pr-commenter[bot] avatar](https://avatars.githubusercontent.com/u/365230?v=4 "Published by a pub.dev verified publisher"){kind=small}
Kafka / producer-benchmark
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | alexeyk/groovy-4 |
| git_commit_date | 1766094198 | 1766103948 |
| git_commit_sha | 45bc23966786044e698b7f859b59b5d3911900e8 | 71c1ad1e645b9d2f43bf88e7ed848d0e415d7893 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| ci_job_date | 1766105212 | 1766105212 |
| ci_job_id | 1308344508 | 1308344508 |
| ci_pipeline_id | 87704257 | 87704257 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| jdkVersion | 11.0.25 | 11.0.25 |
| jmhVersion | 1.36 | 1.36 |
| jvm | /usr/lib/jvm/java-11-openjdk-amd64/bin/java | /usr/lib/jvm/java-11-openjdk-amd64/bin/java |
| jvmArgs | -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant | -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant |
| vmName | OpenJDK 64-Bit Server VM | OpenJDK 64-Bit Server VM |
| vmVersion | 11.0.25+9-post-Ubuntu-1ubuntu122.04 | 11.0.25+9-post-Ubuntu-1ubuntu122.04 |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.
See unchanged results
| scenario | Δ mean throughput |
|---|---|
| scenario:not-instrumented/KafkaProduceBenchmark.benchProduce | same |
| scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce | same |
| scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce | same |
Kafka / consumer-benchmark
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | alexeyk/groovy-4 |
| git_commit_date | 1766094198 | 1766103948 |
| git_commit_sha | 45bc23966786044e698b7f859b59b5d3911900e8 | 71c1ad1e645b9d2f43bf88e7ed848d0e415d7893 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| ci_job_date | 1766105395 | 1766105395 |
| ci_job_id | 1308344511 | 1308344511 |
| ci_pipeline_id | 87704257 | 87704257 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| jdkVersion | 11.0.25 | 11.0.25 |
| jmhVersion | 1.36 | 1.36 |
| jvm | /usr/lib/jvm/java-11-openjdk-amd64/bin/java | /usr/lib/jvm/java-11-openjdk-amd64/bin/java |
| jvmArgs | -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant | -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant |
| vmName | OpenJDK 64-Bit Server VM | OpenJDK 64-Bit Server VM |
| vmVersion | 11.0.25+9-post-Ubuntu-1ubuntu122.04 | 11.0.25+9-post-Ubuntu-1ubuntu122.04 |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.
See unchanged results
| scenario | Δ mean throughput |
|---|---|
| scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume | same |
| scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume | same |
| scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume | same |
🎯 Code Coverage
• Patch Coverage: 50.00%
• Total Coverage: 59.57% (-0.02%)
View detailed report
🔗 Commit SHA: 7d882b5 | Docs | Datadog PR Page | Was this helpful? Give us feedback!
Debugger benchmarks
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| ci_job_date | 1765654223 | 1765654569 |
| end_time | 2025-12-13T19:31:44 | 2025-12-13T19:37:30 |
| git_branch | master | alexeyk/groovy-4 |
| git_commit_sha | ef9d162d84 | f5167a7f69e6aaa75babddfcbf8c0926c2af13d4 |
| start_time | 2025-12-13T19:30:24 | 2025-12-13T19:36:10 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| ci_job_id | 1293247319 | 1293247319 |
| ci_pipeline_id | 86648310 | 86648310 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| git_commit_date | 1765653356 | 1765653356 |
Summary
Found 1 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 5 unstable metrics.
| scenario | Δ mean agg_http_req_duration_min | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p75 | Δ mean agg_http_req_duration_p99 | Δ mean throughput |
|---|---|---|---|---|---|
| scenario:basic | better [-10.217µs; -3.103µs] or [-4.022%; -1.221%] |
same | same | unstable [-12.007µs; +164.327µs] or [-1.519%; +20.794%] |
same |
See unchanged results
| scenario | Δ mean agg_http_req_duration_min | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p75 | Δ mean agg_http_req_duration_p99 | Δ mean throughput |
|---|---|---|---|---|---|
| scenario:noprobe | unstable [-29.168µs; +14.136µs] or [-10.410%; +5.045%] |
unstable [-43.891µs; +23.048µs] or [-13.513%; +7.096%] |
unstable [-56.291µs; +32.740µs] or [-16.568%; +9.636%] |
unstable [-92.010µs; +140.138µs] or [-9.174%; +13.973%] |
same |
| scenario:loop | unsure [-20.129µs; -12.377µs] or [-0.227%; -0.139%] |
unsure [-14.315µs; -2.446µs] or [-0.160%; -0.027%] |
unsure [-17.439µs; -6.781µs] or [-0.193%; -0.075%] |
same | same |
Request duration reports for reports
gantt
title reports - request duration [CI 0.99] : candidate=None, baseline=None
dateFormat X
axisFormat %s
section baseline
noprobe (324.807 µs) : 287, 363
. : milestone, 325,
basic (282.919 µs) : 276, 290
. : milestone, 283,
loop (8.966 ms) : 8960, 8972
. : milestone, 8966,
section candidate
noprobe (314.385 µs) : 290, 339
. : milestone, 314,
basic (278.338 µs) : 272, 285
. : milestone, 278,
loop (8.958 ms) : 8953, 8963
. : milestone, 8958,
- baseline results
| Scenario | Request median duration [CI 0.99] |
|---|---|
| noprobe | 324.807 µs [286.969 µs, 362.645 µs] |
| basic | 282.919 µs [276.143 µs, 289.695 µs] |
| loop | 8.966 ms [8.96 ms, 8.972 ms] |
- candidate results
| Scenario | Request median duration [CI 0.99] |
|---|---|
| noprobe | 314.385 µs [289.917 µs, 338.853 µs] |
| basic | 278.338 µs [271.947 µs, 284.728 µs] |
| loop | 8.958 ms [8.953 ms, 8.963 ms] |