dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

AWS Payload Tagging 2

Open ygree opened this issue 1 year ago • 1 comments

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

ygree avatar Oct 18 '24 23:10 ygree

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/aws-payload-tagging-2
git_commit_date 1730486404 1730491923
git_commit_sha d46416d5b6 b49f9a4d18
release_version 1.42.0-SNAPSHOT~d46416d5b6 1.42.0-SNAPSHOT~b49f9a4d18
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1730494874 1730494874
ci_job_id 693114335 693114335
ci_pipeline_id 48076720 48076720
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 8 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1080407
Total [baseline] (8.58 s) : 0, 8579705
Agent [candidate] (1.081 s) : 0, 1081483
Total [candidate] (8.548 s) : 0, 8547934
section iast
Agent [baseline] (1.214 s) : 0, 1214271
Total [baseline] (9.14 s) : 0, 9139816
Agent [candidate] (1.211 s) : 0, 1211405
Total [candidate] (9.16 s) : 0, 9159944
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.221 s) : 0, 1221225
Total [baseline] (9.135 s) : 0, 9135082
Agent [candidate] (1.206 s) : 0, 1205718
Total [candidate] (9.093 s) : 0, 9092956
section iast_TELEMETRY_OFF
Agent [baseline] (1.213 s) : 0, 1212757
Total [baseline] (9.14 s) : 0, 9139562
Agent [candidate] (1.201 s) : 0, 1201292
Total [candidate] (9.134 s) : 0, 9134322
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent iast 1.214 s 133.864 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.221 s 140.818 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.213 s 132.35 ms (12.3%)
Total tracing 8.58 s -
Total iast 9.14 s 560.111 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.135 s 555.378 ms (6.5%)
Total iast_TELEMETRY_OFF 9.14 s 559.857 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent iast 1.211 s 129.922 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.206 s 124.235 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.201 s 119.809 ms (11.1%)
Total tracing 8.548 s -
Total iast 9.16 s 612.01 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.093 s 545.022 ms (6.4%)
Total iast_TELEMETRY_OFF 9.134 s 586.388 ms (6.9%)
gantt
    title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.164 ms) : 0, 687164
BytebuddyAgent [candidate] (686.754 ms) : 0, 686754
GlobalTracer [baseline] (316.562 ms) : 0, 316562
GlobalTracer [candidate] (316.176 ms) : 0, 316176
AppSec [baseline] (53.927 ms) : 0, 53927
AppSec [candidate] (53.866 ms) : 0, 53866
Remote Config [baseline] (657.668 µs) : 0, 658
Remote Config [candidate] (658.413 µs) : 0, 658
Telemetry [baseline] (8.421 ms) : 0, 8421
Telemetry [candidate] (10.379 ms) : 0, 10379
section iast
BytebuddyAgent [baseline] (807.861 ms) : 0, 807861
BytebuddyAgent [candidate] (805.683 ms) : 0, 805683
GlobalTracer [baseline] (306.279 ms) : 0, 306279
GlobalTracer [candidate] (305.045 ms) : 0, 305045
AppSec [baseline] (56.859 ms) : 0, 56859
AppSec [candidate] (57.782 ms) : 0, 57782
IAST [baseline] (21.387 ms) : 0, 21387
IAST [candidate] (20.907 ms) : 0, 20907
Remote Config [baseline] (625.956 µs) : 0, 626
Remote Config [candidate] (627.07 µs) : 0, 627
Telemetry [baseline] (7.477 ms) : 0, 7477
Telemetry [candidate] (7.619 ms) : 0, 7619
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (813.504 ms) : 0, 813504
BytebuddyAgent [candidate] (801.683 ms) : 0, 801683
GlobalTracer [baseline] (306.885 ms) : 0, 306885
GlobalTracer [candidate] (304.806 ms) : 0, 304806
AppSec [baseline] (57.236 ms) : 0, 57236
AppSec [candidate] (56.465 ms) : 0, 56465
IAST [baseline] (21.605 ms) : 0, 21605
IAST [candidate] (21.011 ms) : 0, 21011
Remote Config [baseline] (617.591 µs) : 0, 618
Remote Config [candidate] (598.526 µs) : 0, 599
Telemetry [baseline] (7.545 ms) : 0, 7545
Telemetry [candidate] (7.479 ms) : 0, 7479
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (806.324 ms) : 0, 806324
BytebuddyAgent [candidate] (798.116 ms) : 0, 798116
GlobalTracer [baseline] (306.974 ms) : 0, 306974
GlobalTracer [candidate] (304.683 ms) : 0, 304683
AppSec [baseline] (57.331 ms) : 0, 57331
AppSec [candidate] (57.186 ms) : 0, 57186
IAST [baseline] (20.339 ms) : 0, 20339
IAST [candidate] (19.828 ms) : 0, 19828
Remote Config [baseline] (615.884 µs) : 0, 616
Remote Config [candidate] (595.253 µs) : 0, 595
Telemetry [baseline] (7.414 ms) : 0, 7414
Telemetry [candidate] (7.258 ms) : 0, 7258
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.082 s) : 0, 1081879
Total [baseline] (10.361 s) : 0, 10361061
Agent [candidate] (1.086 s) : 0, 1086051
Total [candidate] (10.391 s) : 0, 10390934
section appsec
Agent [baseline] (1.218 s) : 0, 1217638
Total [baseline] (10.65 s) : 0, 10650348
Agent [candidate] (1.22 s) : 0, 1220292
Total [candidate] (10.684 s) : 0, 10683738
section iast
Agent [baseline] (1.206 s) : 0, 1205619
Total [baseline] (10.939 s) : 0, 10938973
Agent [candidate] (1.207 s) : 0, 1206655
Total [candidate] (10.891 s) : 0, 10891090
section profiling
Agent [baseline] (1.285 s) : 0, 1284949
Total [baseline] (10.775 s) : 0, 10774873
Agent [candidate] (1.283 s) : 0, 1282799
Total [candidate] (10.721 s) : 0, 10721146
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent appsec 1.218 s 135.758 ms (12.5%)
Agent iast 1.206 s 123.74 ms (11.4%)
Agent profiling 1.285 s 203.07 ms (18.8%)
Total tracing 10.361 s -
Total appsec 10.65 s 289.287 ms (2.8%)
Total iast 10.939 s 577.912 ms (5.6%)
Total profiling 10.775 s 413.812 ms (4.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent appsec 1.22 s 134.241 ms (12.4%)
Agent iast 1.207 s 120.604 ms (11.1%)
Agent profiling 1.283 s 196.747 ms (18.1%)
Total tracing 10.391 s -
Total appsec 10.684 s 292.804 ms (2.8%)
Total iast 10.891 s 500.156 ms (4.8%)
Total profiling 10.721 s 330.212 ms (3.2%)
gantt
    title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.163 ms) : 0, 687163
BytebuddyAgent [candidate] (690.509 ms) : 0, 690509
GlobalTracer [baseline] (316.458 ms) : 0, 316458
GlobalTracer [candidate] (316.235 ms) : 0, 316235
AppSec [baseline] (54.08 ms) : 0, 54080
AppSec [candidate] (54.301 ms) : 0, 54301
Remote Config [baseline] (656.756 µs) : 0, 657
Remote Config [candidate] (661.377 µs) : 0, 661
Telemetry [baseline] (9.849 ms) : 0, 9849
Telemetry [candidate] (10.622 ms) : 0, 10622
section appsec
BytebuddyAgent [baseline] (705.238 ms) : 0, 705238
BytebuddyAgent [candidate] (708.355 ms) : 0, 708355
GlobalTracer [baseline] (313.854 ms) : 0, 313854
GlobalTracer [candidate] (313.941 ms) : 0, 313941
AppSec [baseline] (166.424 ms) : 0, 166424
AppSec [candidate] (165.739 ms) : 0, 165739
IAST [baseline] (19.34 ms) : 0, 19340
IAST [candidate] (20.28 ms) : 0, 20280
Remote Config [baseline] (643.059 µs) : 0, 643
Remote Config [candidate] (636.138 µs) : 0, 636
Telemetry [baseline] (8.135 ms) : 0, 8135
Telemetry [candidate] (7.797 ms) : 0, 7797
section iast
BytebuddyAgent [baseline] (801.674 ms) : 0, 801674
BytebuddyAgent [candidate] (802.495 ms) : 0, 802495
GlobalTracer [baseline] (304.511 ms) : 0, 304511
GlobalTracer [candidate] (305.495 ms) : 0, 305495
AppSec [baseline] (57.352 ms) : 0, 57352
AppSec [candidate] (56.668 ms) : 0, 56668
IAST [baseline] (20.446 ms) : 0, 20446
IAST [candidate] (20.386 ms) : 0, 20386
Remote Config [baseline] (607.614 µs) : 0, 608
Remote Config [candidate] (607.385 µs) : 0, 607
Telemetry [baseline] (7.375 ms) : 0, 7375
Telemetry [candidate] (7.343 ms) : 0, 7343
section profiling
BytebuddyAgent [baseline] (683.841 ms) : 0, 683841
BytebuddyAgent [candidate] (683.692 ms) : 0, 683692
GlobalTracer [baseline] (401.048 ms) : 0, 401048
GlobalTracer [candidate] (400.115 ms) : 0, 400115
AppSec [baseline] (54.622 ms) : 0, 54622
AppSec [candidate] (54.61 ms) : 0, 54610
Remote Config [baseline] (673.673 µs) : 0, 674
Remote Config [candidate] (678.124 µs) : 0, 678
Telemetry [baseline] (13.516 ms) : 0, 13516
Telemetry [candidate] (13.475 ms) : 0, 13475
ProfilingAgent [baseline] (92.253 ms) : 0, 92253
ProfilingAgent [candidate] (91.153 ms) : 0, 91153
Profiling [baseline] (92.277 ms) : 0, 92277
Profiling [candidate] (91.177 ms) : 0, 91177

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-11-01T20:29:31 2024-11-01T20:36:25
git_branch master ygree/aws-payload-tagging-2
git_commit_date 1730486404 1730491923
git_commit_sha d46416d5b6 b49f9a4d18
release_version 1.42.0-SNAPSHOT~d46416d5b6 1.42.0-SNAPSHOT~b49f9a4d18
start_time 2024-11-01T20:29:18 2024-11-01T20:36:11
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1730493733 1730493733
ci_job_id 693114336 693114336
ci_pipeline_id 48076720 48076720
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (372.746 µs) : 353, 393
.   : milestone, 373,
iast (488.742 µs) : 467, 510
.   : milestone, 489,
iast_FULL (646.249 µs) : 625, 668
.   : milestone, 646,
iast_GLOBAL (508.545 µs) : 488, 530
.   : milestone, 509,
iast_HARDCODED_SECRET_DISABLED (490.557 µs) : 469, 512
.   : milestone, 491,
iast_INACTIVE (447.529 µs) : 426, 469
.   : milestone, 448,
iast_TELEMETRY_OFF (479.736 µs) : 459, 501
.   : milestone, 480,
tracing (439.083 µs) : 418, 460
.   : milestone, 439,
section candidate
no_agent (362.256 µs) : 342, 382
.   : milestone, 362,
iast (490.158 µs) : 469, 512
.   : milestone, 490,
iast_FULL (647.71 µs) : 626, 669
.   : milestone, 648,
iast_GLOBAL (507.123 µs) : 486, 528
.   : milestone, 507,
iast_HARDCODED_SECRET_DISABLED (481.679 µs) : 461, 503
.   : milestone, 482,
iast_INACTIVE (449.325 µs) : 428, 470
.   : milestone, 449,
iast_TELEMETRY_OFF (486.318 µs) : 464, 509
.   : milestone, 486,
tracing (439.642 µs) : 419, 460
.   : milestone, 440,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.746 µs [352.92 µs, 392.573 µs] -
iast 488.742 µs [467.35 µs, 510.134 µs] 115.996 µs (31.1%)
iast_FULL 646.249 µs [624.974 µs, 667.524 µs] 273.503 µs (73.4%)
iast_GLOBAL 508.545 µs [487.5 µs, 529.589 µs] 135.798 µs (36.4%)
iast_HARDCODED_SECRET_DISABLED 490.557 µs [469.093 µs, 512.02 µs] 117.81 µs (31.6%)
iast_INACTIVE 447.529 µs [426.485 µs, 468.573 µs] 74.783 µs (20.1%)
iast_TELEMETRY_OFF 479.736 µs [458.532 µs, 500.94 µs] 106.989 µs (28.7%)
tracing 439.083 µs [418.175 µs, 459.99 µs] 66.336 µs (17.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 362.256 µs [342.466 µs, 382.045 µs] -
iast 490.158 µs [468.653 µs, 511.664 µs] 127.903 µs (35.3%)
iast_FULL 647.71 µs [626.184 µs, 669.236 µs] 285.454 µs (78.8%)
iast_GLOBAL 507.123 µs [485.875 µs, 528.37 µs] 144.867 µs (40.0%)
iast_HARDCODED_SECRET_DISABLED 481.679 µs [460.566 µs, 502.793 µs] 119.424 µs (33.0%)
iast_INACTIVE 449.325 µs [428.431 µs, 470.218 µs] 87.069 µs (24.0%)
iast_TELEMETRY_OFF 486.318 µs [463.866 µs, 508.771 µs] 124.063 µs (34.2%)
tracing 439.642 µs [419.114 µs, 460.17 µs] 77.386 µs (21.4%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.334 ms) : 1314, 1354
.   : milestone, 1334,
appsec (1.717 ms) : 1692, 1742
.   : milestone, 1717,
appsec_no_iast (1.71 ms) : 1686, 1735
.   : milestone, 1710,
iast (1.482 ms) : 1458, 1505
.   : milestone, 1482,
profiling (1.474 ms) : 1450, 1497
.   : milestone, 1474,
tracing (1.486 ms) : 1461, 1510
.   : milestone, 1486,
section candidate
no_agent (1.332 ms) : 1312, 1352
.   : milestone, 1332,
appsec (1.742 ms) : 1718, 1766
.   : milestone, 1742,
appsec_no_iast (1.71 ms) : 1685, 1734
.   : milestone, 1710,
iast (1.477 ms) : 1454, 1500
.   : milestone, 1477,
profiling (1.494 ms) : 1470, 1517
.   : milestone, 1494,
tracing (1.472 ms) : 1447, 1497
.   : milestone, 1472,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.334 ms [1.314 ms, 1.354 ms] -
appsec 1.717 ms [1.692 ms, 1.742 ms] 382.739 µs (28.7%)
appsec_no_iast 1.71 ms [1.686 ms, 1.735 ms] 376.017 µs (28.2%)
iast 1.482 ms [1.458 ms, 1.505 ms] 147.687 µs (11.1%)
profiling 1.474 ms [1.45 ms, 1.497 ms] 139.418 µs (10.5%)
tracing 1.486 ms [1.461 ms, 1.51 ms] 151.424 µs (11.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.332 ms [1.312 ms, 1.352 ms] -
appsec 1.742 ms [1.718 ms, 1.766 ms] 410.156 µs (30.8%)
appsec_no_iast 1.71 ms [1.685 ms, 1.734 ms] 377.691 µs (28.4%)
iast 1.477 ms [1.454 ms, 1.5 ms] 145.22 µs (10.9%)
profiling 1.494 ms [1.47 ms, 1.517 ms] 161.787 µs (12.1%)
tracing 1.472 ms [1.447 ms, 1.497 ms] 139.892 µs (10.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/aws-payload-tagging-2
git_commit_date 1730486404 1730491923
git_commit_sha d46416d5b6 b49f9a4d18
release_version 1.42.0-SNAPSHOT~d46416d5b6 1.42.0-SNAPSHOT~b49f9a4d18
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1730494278 1730494278
ci_job_id 693114337 693114337
ci_pipeline_id 48076720 48076720
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.079 s) : 15079000, 15079000
.   : milestone, 15079000,
appsec (15.384 s) : 15384000, 15384000
.   : milestone, 15384000,
iast (18.749 s) : 18749000, 18749000
.   : milestone, 18749000,
iast_GLOBAL (17.962 s) : 17962000, 17962000
.   : milestone, 17962000,
profiling (15.685 s) : 15685000, 15685000
.   : milestone, 15685000,
tracing (14.979 s) : 14979000, 14979000
.   : milestone, 14979000,
section candidate
no_agent (15.067 s) : 15067000, 15067000
.   : milestone, 15067000,
appsec (15.094 s) : 15094000, 15094000
.   : milestone, 15094000,
iast (18.966 s) : 18966000, 18966000
.   : milestone, 18966000,
iast_GLOBAL (18.418 s) : 18418000, 18418000
.   : milestone, 18418000,
profiling (15.653 s) : 15653000, 15653000
.   : milestone, 15653000,
tracing (15.452 s) : 15452000, 15452000
.   : milestone, 15452000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.079 s [15.079 s, 15.079 s] -
appsec 15.384 s [15.384 s, 15.384 s] 305.0 ms (2.0%)
iast 18.749 s [18.749 s, 18.749 s] 3.67 s (24.3%)
iast_GLOBAL 17.962 s [17.962 s, 17.962 s] 2.883 s (19.1%)
profiling 15.685 s [15.685 s, 15.685 s] 606.0 ms (4.0%)
tracing 14.979 s [14.979 s, 14.979 s] -100.0 ms (-0.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.067 s [15.067 s, 15.067 s] -
appsec 15.094 s [15.094 s, 15.094 s] 27.0 ms (0.2%)
iast 18.966 s [18.966 s, 18.966 s] 3.899 s (25.9%)
iast_GLOBAL 18.418 s [18.418 s, 18.418 s] 3.351 s (22.2%)
profiling 15.653 s [15.653 s, 15.653 s] 586.0 ms (3.9%)
tracing 15.452 s [15.452 s, 15.452 s] 385.0 ms (2.6%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (2.334 ms) : 2293, 2375
.   : milestone, 2334,
iast (2.075 ms) : 2023, 2127
.   : milestone, 2075,
iast_GLOBAL (2.121 ms) : 2069, 2173
.   : milestone, 2121,
profiling (2.386 ms) : 2213, 2558
.   : milestone, 2386,
tracing (1.909 ms) : 1870, 1948
.   : milestone, 1909,
section candidate
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (2.342 ms) : 2300, 2383
.   : milestone, 2342,
iast (2.077 ms) : 2025, 2129
.   : milestone, 2077,
iast_GLOBAL (2.129 ms) : 2076, 2181
.   : milestone, 2129,
profiling (1.952 ms) : 1910, 1995
.   : milestone, 1952,
tracing (1.923 ms) : 1883, 1963
.   : milestone, 1923,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.456 ms, 1.479 ms] -
appsec 2.334 ms [2.293 ms, 2.375 ms] 866.441 µs (59.0%)
iast 2.075 ms [2.023 ms, 2.127 ms] 607.407 µs (41.4%)
iast_GLOBAL 2.121 ms [2.069 ms, 2.173 ms] 653.573 µs (44.5%)
profiling 2.386 ms [2.213 ms, 2.558 ms] 918.253 µs (62.6%)
tracing 1.909 ms [1.87 ms, 1.948 ms] 441.533 µs (30.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 2.342 ms [2.3 ms, 2.383 ms] 869.641 µs (59.1%)
iast 2.077 ms [2.025 ms, 2.129 ms] 604.902 µs (41.1%)
iast_GLOBAL 2.129 ms [2.076 ms, 2.181 ms] 656.782 µs (44.6%)
profiling 1.952 ms [1.91 ms, 1.995 ms] 480.441 µs (32.6%)
tracing 1.923 ms [1.883 ms, 1.963 ms] 451.213 µs (30.7%)

pr-commenter[bot] avatar Oct 19 '24 00:10 pr-commenter[bot]