Skip to content

Conversation

@jbachorik
Copy link
Contributor

Backport #9930 to release/v1.55.x

@jbachorik jbachorik requested a review from a team as a code owner November 12, 2025 15:42
@jbachorik jbachorik added type: enhancement Enhancements and improvements comp: profiling Profiling labels Nov 12, 2025
@jbachorik jbachorik requested a review from a team as a code owner November 12, 2025 15:42
@jbachorik jbachorik requested review from amarziali and removed request for a team November 12, 2025 15:42
@datadog-official
Copy link

datadog-official bot commented Nov 12, 2025

🎯 Code Coverage
Patch Coverage: 0.00%
Total Coverage: 59.68% (-0.04%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 5676edc | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Nov 12, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jaroslav.bachorik/backport-pr-9930
git_commit_date 1762961860 1762962168
git_commit_sha d422f6d 5676edc
release_version 1.56.0-SNAPSHOT~d422f6d41e 1.56.0-SNAPSHOT~5676edcadb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762964009 1762964009
ci_job_id 1230274814 1230274814
ci_pipeline_id 82107921 82107921
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-bzriwazl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-bzriwazl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 12 performance improvements and 10 performance regressions! Performance is the same for 32 metrics, 11 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start better
[-101.326ms; -54.750ms] or [-8.115%; -4.385%]
1.171s 1.249s
scenario:startup:insecure-bank:iast:Debugger better
[-59.977ms; -58.353ms] or [-91.760%; -89.276%]
6.198ms 65.363ms
scenario:startup:insecure-bank:iast:Remote Config worse
[+31.448µs; +67.491µs] or [+5.664%; +12.156%]
604.674µs 555.205µs
scenario:startup:insecure-bank:iast:Telemetry worse
[+0.820ms; +1.235ms] or [+10.635%; +16.010%]
8.739ms 7.711ms
scenario:startup:insecure-bank:iast:Flare Poller worse
[+508.357µs; +715.083µs] or [+14.163%; +19.923%]
4.201ms 3.589ms
scenario:startup:insecure-bank:tracing:Agent.start better
[-84.907ms; -70.828ms] or [-7.665%; -6.394%]
1.030s 1.108s
scenario:startup:insecure-bank:tracing:Debugger better
[-61.925ms; -61.313ms] or [-91.077%; -90.176%]
6.373ms 67.992ms
scenario:startup:petclinic:appsec:Agent.start better
[-101.774ms; -68.501ms] or [-7.880%; -5.304%]
1.206s 1.292s
scenario:startup:petclinic:appsec:Debugger better
[-56.565ms; -54.329ms] or [-92.176%; -88.533%]
5.919ms 61.366ms
scenario:startup:petclinic:iast:Agent.start better
[-93.136ms; -60.415ms] or [-7.472%; -4.847%]
1.170s 1.247s
scenario:startup:petclinic:iast:Debugger better
[-60.709ms; -59.385ms] or [-91.712%; -89.712%]
6.148ms 66.195ms
scenario:startup:petclinic:iast:Remote Config worse
[+32.129µs; +85.295µs] or [+5.793%; +15.380%]
613.301µs 554.590µs
scenario:startup:petclinic:iast:Telemetry worse
[+581.132µs; +1051.765µs] or [+7.514%; +13.599%]
8.551ms 7.734ms
scenario:startup:petclinic:iast:Flare Poller worse
[+407.755µs; +706.167µs] or [+11.302%; +19.573%]
4.165ms 3.608ms
scenario:startup:petclinic:profiling:Agent.start better
[-84.919ms; -56.280ms] or [-6.853%; -4.542%]
1.169s 1.239s
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+10.051ms; +12.875ms] or [+10.330%; +13.232%]
108.767ms 97.304ms
scenario:startup:petclinic:profiling:Debugger better
[-59.341ms; -54.193ms] or [-87.085%; -79.529%]
11.375ms 68.142ms
scenario:startup:petclinic:profiling:Flare Poller worse
[+219.077µs; +398.606µs] or [+5.785%; +10.526%]
4.096ms 3.787ms
scenario:startup:petclinic:profiling:Profiling worse
[+10.095ms; +12.932ms] or [+10.311%; +13.209%]
109.414ms 97.900ms
scenario:startup:petclinic:tracing:Agent.start better
[-80.682ms; -72.076ms] or [-7.298%; -6.520%]
1.029s 1.106s
scenario:startup:petclinic:tracing:Debugger better
[-62.907ms; -62.074ms] or [-91.383%; -90.173%]
6.348ms 68.839ms
scenario:startup:petclinic:tracing:Remote Config worse
[+21.244µs; +65.864µs] or [+3.363%; +10.426%]
675.295µs 631.741µs
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~5676edcadb, baseline=1.56.0-SNAPSHOT~d422f6d41e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.106 s) : 0, 1105544
Total [baseline] (10.807 s) : 0, 10806737
Agent [candidate] (1.029 s) : 0, 1029164
Total [candidate] (10.883 s) : 0, 10883017
section appsec
Agent [baseline] (1.292 s) : 0, 1291510
Total [baseline] (11.125 s) : 0, 11124986
Agent [candidate] (1.206 s) : 0, 1206372
Total [candidate] (10.977 s) : 0, 10976985
section iast
Agent [baseline] (1.247 s) : 0, 1246521
Total [baseline] (11.237 s) : 0, 11236890
Agent [candidate] (1.17 s) : 0, 1169746
Total [candidate] (11.268 s) : 0, 11268226
section profiling
Agent [baseline] (1.239 s) : 0, 1239214
Total [baseline] (11.09 s) : 0, 11089788
Agent [candidate] (1.169 s) : 0, 1168614
Total [candidate] (10.83 s) : 0, 10830299
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.106 s -
Agent appsec 1.292 s 185.966 ms (16.8%)
Agent iast 1.247 s 140.978 ms (12.8%)
Agent profiling 1.239 s 133.67 ms (12.1%)
Total tracing 10.807 s -
Total appsec 11.125 s 318.248 ms (2.9%)
Total iast 11.237 s 430.153 ms (4.0%)
Total profiling 11.09 s 283.051 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.029 s -
Agent appsec 1.206 s 177.208 ms (17.2%)
Agent iast 1.17 s 140.581 ms (13.7%)
Agent profiling 1.169 s 139.45 ms (13.5%)
Total tracing 10.883 s -
Total appsec 10.977 s 93.969 ms (0.9%)
Total iast 11.268 s 385.21 ms (3.5%)
Total profiling 10.83 s -52.718 ms (-0.5%)
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~5676edcadb, baseline=1.56.0-SNAPSHOT~d422f6d41e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (706.565 ms) : 0, 706565
BytebuddyAgent [candidate] (703.007 ms) : 0, 703007
GlobalTracer [baseline] (249.102 ms) : 0, 249102
GlobalTracer [candidate] (245.023 ms) : 0, 245023
AppSec [baseline] (32.422 ms) : 0, 32422
AppSec [candidate] (32.11 ms) : 0, 32110
Debugger [baseline] (68.839 ms) : 0, 68839
Debugger [candidate] (6.348 ms) : 0, 6348
Remote Config [baseline] (631.741 µs) : 0, 632
Remote Config [candidate] (675.295 µs) : 0, 675
Telemetry [baseline] (8.127 ms) : 0, 8127
Telemetry [candidate] (13.05 ms) : 0, 13050
Flare Poller [baseline] (3.692 ms) : 0, 3692
Flare Poller [candidate] (6.343 ms) : 0, 6343
section appsec
crashtracking [baseline] (1.474 ms) : 0, 1474
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (736.972 ms) : 0, 736972
BytebuddyAgent [candidate] (728.244 ms) : 0, 728244
GlobalTracer [baseline] (243.396 ms) : 0, 243396
GlobalTracer [candidate] (237.039 ms) : 0, 237039
IAST [baseline] (25.222 ms) : 0, 25222
IAST [candidate] (24.93 ms) : 0, 24930
AppSec [baseline] (175.068 ms) : 0, 175068
AppSec [candidate] (174.588 ms) : 0, 174588
Debugger [baseline] (61.366 ms) : 0, 61366
Debugger [candidate] (5.919 ms) : 0, 5919
Remote Config [baseline] (684.748 µs) : 0, 685
Remote Config [candidate] (630.532 µs) : 0, 631
Telemetry [baseline] (8.34 ms) : 0, 8340
Telemetry [candidate] (8.457 ms) : 0, 8457
Flare Poller [baseline] (3.902 ms) : 0, 3902
Flare Poller [candidate] (3.913 ms) : 0, 3913
section iast
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (832.257 ms) : 0, 832257
BytebuddyAgent [candidate] (830.256 ms) : 0, 830256
GlobalTracer [baseline] (238.223 ms) : 0, 238223
GlobalTracer [candidate] (235.256 ms) : 0, 235256
IAST [baseline] (29.419 ms) : 0, 29419
IAST [candidate] (31.997 ms) : 0, 31997
AppSec [baseline] (32.259 ms) : 0, 32259
AppSec [candidate] (29.858 ms) : 0, 29858
Debugger [baseline] (66.195 ms) : 0, 66195
Debugger [candidate] (6.148 ms) : 0, 6148
Remote Config [baseline] (554.59 µs) : 0, 555
Remote Config [candidate] (613.301 µs) : 0, 613
Telemetry [baseline] (7.734 ms) : 0, 7734
Telemetry [candidate] (8.551 ms) : 0, 8551
Flare Poller [baseline] (3.608 ms) : 0, 3608
Flare Poller [candidate] (4.165 ms) : 0, 4165
section profiling
crashtracking [baseline] (1.441 ms) : 0, 1441
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (734.626 ms) : 0, 734626
BytebuddyAgent [candidate] (723.517 ms) : 0, 723517
GlobalTracer [baseline] (222.744 ms) : 0, 222744
GlobalTracer [candidate] (219.632 ms) : 0, 219632
AppSec [baseline] (32.575 ms) : 0, 32575
AppSec [candidate] (32.267 ms) : 0, 32267
Debugger [baseline] (68.142 ms) : 0, 68142
Debugger [candidate] (11.375 ms) : 0, 11375
Remote Config [baseline] (640.299 µs) : 0, 640
Remote Config [candidate] (1.424 ms) : 0, 1424
Telemetry [baseline] (7.983 ms) : 0, 7983
Telemetry [candidate] (10.773 ms) : 0, 10773
Flare Poller [baseline] (3.787 ms) : 0, 3787
Flare Poller [candidate] (4.096 ms) : 0, 4096
ProfilingAgent [baseline] (97.304 ms) : 0, 97304
ProfilingAgent [candidate] (108.767 ms) : 0, 108767
Profiling [baseline] (97.9 ms) : 0, 97900
Profiling [candidate] (109.414 ms) : 0, 109414
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~5676edcadb, baseline=1.56.0-SNAPSHOT~d422f6d41e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.108 s) : 0, 1107798
Total [baseline] (8.876 s) : 0, 8875797
Agent [candidate] (1.03 s) : 0, 1029930
Total [candidate] (8.679 s) : 0, 8679030
section iast
Agent [baseline] (1.249 s) : 0, 1248667
Total [baseline] (9.597 s) : 0, 9596722
Agent [candidate] (1.171 s) : 0, 1170629
Total [candidate] (9.346 s) : 0, 9345889
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.108 s -
Agent iast 1.249 s 140.869 ms (12.7%)
Total tracing 8.876 s -
Total iast 9.597 s 720.925 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.03 s -
Agent iast 1.171 s 140.698 ms (13.7%)
Total tracing 8.679 s -
Total iast 9.346 s 666.86 ms (7.7%)
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~5676edcadb, baseline=1.56.0-SNAPSHOT~d422f6d41e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (710.162 ms) : 0, 710162
BytebuddyAgent [candidate] (702.189 ms) : 0, 702189
GlobalTracer [baseline] (248.549 ms) : 0, 248549
GlobalTracer [candidate] (244.837 ms) : 0, 244837
AppSec [baseline] (32.295 ms) : 0, 32295
AppSec [candidate] (32.286 ms) : 0, 32286
Debugger [baseline] (67.992 ms) : 0, 67992
Debugger [candidate] (6.373 ms) : 0, 6373
Remote Config [baseline] (640.863 µs) : 0, 641
Remote Config [candidate] (672.813 µs) : 0, 673
Telemetry [baseline] (8.176 ms) : 0, 8176
Telemetry [candidate] (15.124 ms) : 0, 15124
Flare Poller [baseline] (3.76 ms) : 0, 3760
Flare Poller [candidate] (5.824 ms) : 0, 5824
section iast
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.478 ms) : 0, 1478
BytebuddyAgent [baseline] (834.389 ms) : 0, 834389
BytebuddyAgent [candidate] (830.689 ms) : 0, 830689
GlobalTracer [baseline] (238.425 ms) : 0, 238425
GlobalTracer [candidate] (235.062 ms) : 0, 235062
IAST [baseline] (29.708 ms) : 0, 29708
IAST [candidate] (29.649 ms) : 0, 29649
AppSec [baseline] (32.626 ms) : 0, 32626
AppSec [candidate] (32.5 ms) : 0, 32500
Debugger [baseline] (65.363 ms) : 0, 65363
Debugger [candidate] (6.198 ms) : 0, 6198
Remote Config [baseline] (555.205 µs) : 0, 555
Remote Config [candidate] (604.674 µs) : 0, 605
Telemetry [baseline] (7.711 ms) : 0, 7711
Telemetry [candidate] (8.739 ms) : 0, 8739
Flare Poller [baseline] (3.589 ms) : 0, 3589
Flare Poller [candidate] (4.201 ms) : 0, 4201
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jaroslav.bachorik/backport-pr-9930
git_commit_date 1762961860 1762962168
git_commit_sha d422f6d 5676edc
release_version 1.56.0-SNAPSHOT~d422f6d41e 1.56.0-SNAPSHOT~5676edcadb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762964520 1762964520
ci_job_id 1230274816 1230274816
ci_pipeline_id 82107921 82107921
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-qdva6wxc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-qdva6wxc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 9 performance regressions! Performance is the same for 9 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-237.582µs; -133.266µs] or [-9.234%; -5.179%]
better
[-660.835µs; -186.880µs] or [-8.776%; -2.482%]
unstable
[-61.327op/s; +241.889op/s] or [-4.406%; +17.379%]
2.388ms 7.107ms 1482.094op/s 2.573ms 7.530ms 1391.812op/s
scenario:load:petclinic:code_origins:high_load worse
[+494.692µs; +1207.120µs] or [+2.896%; +7.068%]
unsure
[+355.924µs; +1614.504µs] or [+1.257%; +5.700%]
unstable
[-38.839op/s; +15.464op/s] or [-14.557%; +5.796%]
17.930ms 29.309ms 255.125op/s 17.079ms 28.324ms 266.812op/s
scenario:load:petclinic:appsec:high_load worse
[+1.248ms; +1.720ms] or [+6.719%; +9.259%]
worse
[+1.050ms; +2.128ms] or [+3.461%; +7.016%]
unstable
[-42.617op/s; +6.430op/s] or [-17.213%; +2.597%]
20.060ms 31.918ms 229.500op/s 18.576ms 30.329ms 247.594op/s
scenario:load:petclinic:iast:high_load worse
[+1.661ms; +2.090ms] or [+9.533%; +11.992%]
worse
[+1.479ms; +2.513ms] or [+5.099%; +8.661%]
unstable
[-49.113op/s; +2.363op/s] or [-18.759%; +0.903%]
19.302ms 31.007ms 238.438op/s 17.427ms 29.011ms 261.812op/s
scenario:load:petclinic:profiling:high_load worse
[+1.395ms; +1.919ms] or [+7.590%; +10.438%]
worse
[+1.152ms; +2.636ms] or [+3.815%; +8.727%]
unstable
[-44.140op/s; +5.015op/s] or [-17.760%; +2.018%]
20.037ms 32.095ms 228.969op/s 18.380ms 30.201ms 248.531op/s
scenario:load:petclinic:tracing:high_load worse
[+1.482ms; +1.782ms] or [+8.531%; +10.259%]
worse
[+1.157ms; +2.801ms] or [+4.038%; +9.781%]
unstable
[-47.530op/s; +4.405op/s] or [-18.055%; +1.673%]
19.005ms 30.620ms 241.688op/s 17.373ms 28.641ms 263.250op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~5676edcadb, baseline=1.56.0-SNAPSHOT~d422f6d41e
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.183 ms) : 18001, 18365
.   : milestone, 18183,
appsec (18.851 ms) : 18657, 19044
.   : milestone, 18851,
code_origins (17.49 ms) : 17316, 17663
.   : milestone, 17490,
iast (17.827 ms) : 17649, 18004
.   : milestone, 17827,
profiling (18.778 ms) : 18587, 18969
.   : milestone, 18778,
tracing (17.725 ms) : 17553, 17897
.   : milestone, 17725,
section candidate
no_agent (19.001 ms) : 18806, 19195
.   : milestone, 19001,
appsec (20.34 ms) : 20132, 20548
.   : milestone, 20340,
code_origins (18.293 ms) : 18109, 18476
.   : milestone, 18293,
iast (19.577 ms) : 19378, 19777
.   : milestone, 19577,
profiling (20.398 ms) : 20192, 20604
.   : milestone, 20398,
tracing (19.314 ms) : 19121, 19507
.   : milestone, 19314,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.183 ms [18.001 ms, 18.365 ms] -
appsec 18.851 ms [18.657 ms, 19.044 ms] 667.393 µs (3.7%)
code_origins 17.49 ms [17.316 ms, 17.663 ms] -693.677 µs (-3.8%)
iast 17.827 ms [17.649 ms, 18.004 ms] -356.597 µs (-2.0%)
profiling 18.778 ms [18.587 ms, 18.969 ms] 594.571 µs (3.3%)
tracing 17.725 ms [17.553 ms, 17.897 ms] -458.158 µs (-2.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.001 ms [18.806 ms, 19.195 ms] -
appsec 20.34 ms [20.132 ms, 20.548 ms] 1.34 ms (7.1%)
code_origins 18.293 ms [18.109 ms, 18.476 ms] -707.911 µs (-3.7%)
iast 19.577 ms [19.378 ms, 19.777 ms] 576.973 µs (3.0%)
profiling 20.398 ms [20.192 ms, 20.604 ms] 1.397 ms (7.4%)
tracing 19.314 ms [19.121 ms, 19.507 ms] 313.387 µs (1.6%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~5676edcadb, baseline=1.56.0-SNAPSHOT~d422f6d41e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.18 ms) : 1169, 1192
.   : milestone, 1180,
iast (3.288 ms) : 3247, 3330
.   : milestone, 3288,
iast_FULL (5.615 ms) : 5559, 5671
.   : milestone, 5615,
iast_GLOBAL (3.688 ms) : 3634, 3742
.   : milestone, 3688,
profiling (1.91 ms) : 1895, 1926
.   : milestone, 1910,
tracing (1.836 ms) : 1820, 1853
.   : milestone, 1836,
section candidate
no_agent (1.185 ms) : 1173, 1197
.   : milestone, 1185,
iast (3.084 ms) : 3043, 3126
.   : milestone, 3084,
iast_FULL (5.758 ms) : 5701, 5815
.   : milestone, 5758,
iast_GLOBAL (3.718 ms) : 3656, 3781
.   : milestone, 3718,
profiling (2.029 ms) : 2011, 2047
.   : milestone, 2029,
tracing (1.782 ms) : 1767, 1797
.   : milestone, 1782,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.18 ms [1.169 ms, 1.192 ms] -
iast 3.288 ms [3.247 ms, 3.33 ms] 2.108 ms (178.6%)
iast_FULL 5.615 ms [5.559 ms, 5.671 ms] 4.435 ms (375.7%)
iast_GLOBAL 3.688 ms [3.634 ms, 3.742 ms] 2.508 ms (212.5%)
profiling 1.91 ms [1.895 ms, 1.926 ms] 729.875 µs (61.8%)
tracing 1.836 ms [1.82 ms, 1.853 ms] 656.205 µs (55.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.185 ms [1.173 ms, 1.197 ms] -
iast 3.084 ms [3.043 ms, 3.126 ms] 1.899 ms (160.2%)
iast_FULL 5.758 ms [5.701 ms, 5.815 ms] 4.573 ms (385.8%)
iast_GLOBAL 3.718 ms [3.656 ms, 3.781 ms] 2.533 ms (213.7%)
profiling 2.029 ms [2.011 ms, 2.047 ms] 843.922 µs (71.2%)
tracing 1.782 ms [1.767 ms, 1.797 ms] 596.705 µs (50.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jaroslav.bachorik/backport-pr-9930
git_commit_date 1762961860 1762962168
git_commit_sha d422f6d 5676edc
release_version 1.56.0-SNAPSHOT~d422f6d41e 1.56.0-SNAPSHOT~5676edcadb
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1762964191 1762964191
ci_job_id 1230274819 1230274819
ci_pipeline_id 82107921 82107921
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-lxnwnnxd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-lxnwnnxd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~5676edcadb, baseline=1.56.0-SNAPSHOT~d422f6d41e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1455, 1478
.   : milestone, 1467,
appsec (3.743 ms) : 3521, 3964
.   : milestone, 3743,
iast (2.192 ms) : 2129, 2255
.   : milestone, 2192,
iast_GLOBAL (2.242 ms) : 2177, 2306
.   : milestone, 2242,
profiling (2.478 ms) : 2313, 2643
.   : milestone, 2478,
tracing (2.025 ms) : 1975, 2074
.   : milestone, 2025,
section candidate
no_agent (1.471 ms) : 1460, 1482
.   : milestone, 1471,
appsec (3.704 ms) : 3487, 3921
.   : milestone, 3704,
iast (2.201 ms) : 2138, 2265
.   : milestone, 2201,
iast_GLOBAL (2.237 ms) : 2174, 2301
.   : milestone, 2237,
profiling (2.498 ms) : 2326, 2669
.   : milestone, 2498,
tracing (2.014 ms) : 1964, 2063
.   : milestone, 2014,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.455 ms, 1.478 ms] -
appsec 3.743 ms [3.521 ms, 3.964 ms] 2.276 ms (155.1%)
iast 2.192 ms [2.129 ms, 2.255 ms] 725.187 µs (49.4%)
iast_GLOBAL 2.242 ms [2.177 ms, 2.306 ms] 774.697 µs (52.8%)
profiling 2.478 ms [2.313 ms, 2.643 ms] 1.011 ms (68.9%)
tracing 2.025 ms [1.975 ms, 2.074 ms] 557.739 µs (38.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.482 ms] -
appsec 3.704 ms [3.487 ms, 3.921 ms] 2.233 ms (151.8%)
iast 2.201 ms [2.138 ms, 2.265 ms] 730.416 µs (49.7%)
iast_GLOBAL 2.237 ms [2.174 ms, 2.301 ms] 766.248 µs (52.1%)
profiling 2.498 ms [2.326 ms, 2.669 ms] 1.027 ms (69.8%)
tracing 2.014 ms [1.964 ms, 2.063 ms] 542.543 µs (36.9%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~5676edcadb, baseline=1.56.0-SNAPSHOT~d422f6d41e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.485 s) : 15485000, 15485000
.   : milestone, 15485000,
appsec (14.418 s) : 14418000, 14418000
.   : milestone, 14418000,
iast (18.29 s) : 18290000, 18290000
.   : milestone, 18290000,
iast_GLOBAL (17.812 s) : 17812000, 17812000
.   : milestone, 17812000,
profiling (14.861 s) : 14861000, 14861000
.   : milestone, 14861000,
tracing (14.542 s) : 14542000, 14542000
.   : milestone, 14542000,
section candidate
no_agent (15.492 s) : 15492000, 15492000
.   : milestone, 15492000,
appsec (15.012 s) : 15012000, 15012000
.   : milestone, 15012000,
iast (18.553 s) : 18553000, 18553000
.   : milestone, 18553000,
iast_GLOBAL (18.103 s) : 18103000, 18103000
.   : milestone, 18103000,
profiling (15.529 s) : 15529000, 15529000
.   : milestone, 15529000,
tracing (15.563 s) : 15563000, 15563000
.   : milestone, 15563000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.485 s [15.485 s, 15.485 s] -
appsec 14.418 s [14.418 s, 14.418 s] -1.067 s (-6.9%)
iast 18.29 s [18.29 s, 18.29 s] 2.805 s (18.1%)
iast_GLOBAL 17.812 s [17.812 s, 17.812 s] 2.327 s (15.0%)
profiling 14.861 s [14.861 s, 14.861 s] -624.0 ms (-4.0%)
tracing 14.542 s [14.542 s, 14.542 s] -943.0 ms (-6.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.492 s [15.492 s, 15.492 s] -
appsec 15.012 s [15.012 s, 15.012 s] -480.0 ms (-3.1%)
iast 18.553 s [18.553 s, 18.553 s] 3.061 s (19.8%)
iast_GLOBAL 18.103 s [18.103 s, 18.103 s] 2.611 s (16.9%)
profiling 15.529 s [15.529 s, 15.529 s] 37.0 ms (0.2%)
tracing 15.563 s [15.563 s, 15.563 s] 71.0 ms (0.5%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: profiling Profiling type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants