Add metrics OpenTelemetry instrumentation entry mechanism #9908

cecile75 · 2025-11-06T14:59:37Z

What Does This Do

Initial OpenTelemetry metrics instrumentation and stubbed types to support the OTel metrics API - tests will be added as the various stubs are replaced with real implementations

Motivation

OpenTelemetry Metrics API support

Additional Notes

Jira ticket: APMAPI-1671

datadog-official · 2025-11-06T15:31:41Z

🎯 Code Coverage
• Patch Coverage: 0.00%
• Total Coverage: 59.59% (-0.03%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: b0b9e20 | Docs | Datadog PR Page | Was this helpful? Give us feedback!}

pr-commenter · 2025-11-06T16:36:18Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	cecile/otelmetrics13
git_commit_date	1763059139	1763059498
git_commit_sha	`439604a`	`b0b9e20`
release_version	1.56.0-SNAPSHOT~439604a63d	1.55.0-SNAPSHOT~b0b9e2009b

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763061447	1763061447
ci_job_id	1233616985	1233616985
ci_pipeline_id	82312660	82312660
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-8k4b1c2o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-8k4b1c2o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 14 performance improvements and 9 performance regressions! Performance is the same for 31 metrics, 11 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent	better [-351.693ms; -202.429ms] or [-3.677%; -2.116%]	9.288s	9.565s
scenario:startup:insecure-bank:iast:Agent.start	better [-82.742ms; -48.380ms] or [-6.655%; -3.891%]	1.178s	1.243s
scenario:startup:insecure-bank:iast:Debugger	better [-55.066ms; -53.461ms] or [-91.373%; -88.709%]	6.002ms	60.265ms
scenario:startup:insecure-bank:iast:Remote Config	worse [+33.522µs; +81.947µs] or [+6.050%; +14.790%]	611.802µs	554.068µs
scenario:startup:insecure-bank:iast:Telemetry	worse [+566.692µs; +1166.232µs] or [+7.413%; +15.256%]	8.511ms	7.644ms
scenario:startup:insecure-bank:iast:Flare Poller	worse [+602.252µs; +798.230µs] or [+17.459%; +23.140%]	4.150ms	3.450ms
scenario:startup:insecure-bank:tracing:Agent	better [-262.800ms; -190.563ms] or [-2.968%; -2.152%]	8.627s	8.854s
scenario:startup:insecure-bank:tracing:Agent.start	better [-58.345ms; -49.475ms] or [-5.308%; -4.501%]	1.045s	1.099s
scenario:startup:insecure-bank:tracing:Debugger	better [-57.974ms; -56.593ms] or [-91.106%; -88.935%]	6.350ms	63.634ms
scenario:startup:insecure-bank:tracing:Remote Config	worse [+36.868µs; +99.734µs] or [+5.753%; +15.564%]	709.114µs	640.813µs
scenario:startup:petclinic:appsec:Agent.start	better [-66.024ms; -55.632ms] or [-5.149%; -4.339%]	1.221s	1.282s
scenario:startup:petclinic:appsec:Debugger	better [-55.375ms; -54.278ms] or [-91.026%; -89.223%]	6.008ms	60.834ms
scenario:startup:petclinic:iast:Agent.start	better [-96.030ms; -57.522ms] or [-7.660%; -4.588%]	1.177s	1.254s
scenario:startup:petclinic:iast:Debugger	better [-55.125ms; -54.291ms] or [-90.807%; -89.433%]	5.998ms	60.706ms
scenario:startup:petclinic:iast:Telemetry	worse [+600.949µs; +1012.484µs] or [+7.891%; +13.294%]	8.423ms	7.616ms
scenario:startup:petclinic:iast:Flare Poller	worse [+529.860µs; +717.618µs] or [+15.296%; +20.716%]	4.088ms	3.464ms
scenario:startup:petclinic:profiling:Agent.start	better [-79.124ms; -34.784ms] or [-6.329%; -2.782%]	1.193s	1.250s
scenario:startup:petclinic:profiling:ProfilingAgent	worse [+9.494ms; +14.166ms] or [+9.618%; +14.352%]	110.534ms	98.705ms
scenario:startup:petclinic:profiling:Debugger	better [-58.988ms; -54.458ms] or [-91.846%; -84.793%]	7.502ms	64.225ms
scenario:startup:petclinic:profiling:Profiling	worse [+9.516ms; +14.227ms] or [+9.582%; +14.325%]	111.184ms	99.312ms
scenario:startup:petclinic:tracing:Agent.start	better [-66.636ms; -33.903ms] or [-6.043%; -3.075%]	1.052s	1.103s
scenario:startup:petclinic:tracing:Debugger	better [-59.455ms; -57.569ms] or [-91.554%; -88.649%]	6.428ms	64.940ms
scenario:startup:petclinic:tracing:Remote Config	worse [+43.210µs; +77.418µs] or [+6.647%; +11.909%]	710.394µs	650.080µs

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~b0b9e2009b, baseline=1.56.0-SNAPSHOT~439604a63d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.103 s) : 0, 1102620
Total [baseline] (10.825 s) : 0, 10825484
Agent [candidate] (1.052 s) : 0, 1052351
Total [candidate] (10.94 s) : 0, 10939613
section appsec
Agent [baseline] (1.282 s) : 0, 1282250
Total [baseline] (11.182 s) : 0, 11182488
Agent [candidate] (1.221 s) : 0, 1221422
Total [candidate] (11.0 s) : 0, 10999517
section iast
Agent [baseline] (1.254 s) : 0, 1253688
Total [baseline] (11.259 s) : 0, 11259110
Agent [candidate] (1.177 s) : 0, 1176912
Total [candidate] (11.141 s) : 0, 11141339
section profiling
Agent [baseline] (1.25 s) : 0, 1250122
Total [baseline] (11.28 s) : 0, 11279714
Agent [candidate] (1.193 s) : 0, 1193167
Total [candidate] (10.884 s) : 0, 10884112

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.103 s	-
Agent	appsec	1.282 s	179.63 ms (16.3%)
Agent	iast	1.254 s	151.068 ms (13.7%)
Agent	profiling	1.25 s	147.501 ms (13.4%)
Total	tracing	10.825 s	-
Total	appsec	11.182 s	357.004 ms (3.3%)
Total	iast	11.259 s	433.626 ms (4.0%)
Total	profiling	11.28 s	454.23 ms (4.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.052 s	-
Agent	appsec	1.221 s	169.071 ms (16.1%)
Agent	iast	1.177 s	124.561 ms (11.8%)
Agent	profiling	1.193 s	140.817 ms (13.4%)
Total	tracing	10.94 s	-
Total	appsec	11.0 s	59.904 ms (0.5%)
Total	iast	11.141 s	201.725 ms (1.8%)
Total	profiling	10.884 s	-55.501 ms (-0.5%)

gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~b0b9e2009b, baseline=1.56.0-SNAPSHOT~439604a63d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (706.559 ms) : 0, 706559
BytebuddyAgent [candidate] (708.76 ms) : 0, 708760
GlobalTracer [baseline] (249.684 ms) : 0, 249684
GlobalTracer [candidate] (246.783 ms) : 0, 246783
AppSec [baseline] (32.551 ms) : 0, 32551
AppSec [candidate] (32.459 ms) : 0, 32459
Debugger [baseline] (64.94 ms) : 0, 64940
Debugger [candidate] (6.428 ms) : 0, 6428
Remote Config [baseline] (650.08 µs) : 0, 650
Remote Config [candidate] (710.394 µs) : 0, 710
Telemetry [baseline] (8.286 ms) : 0, 8286
Telemetry [candidate] (14.323 ms) : 0, 14323
Flare Poller [baseline] (3.767 ms) : 0, 3767
Flare Poller [candidate] (6.537 ms) : 0, 6537
section appsec
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (730.935 ms) : 0, 730935
BytebuddyAgent [candidate] (728.506 ms) : 0, 728506
GlobalTracer [baseline] (241.374 ms) : 0, 241374
GlobalTracer [candidate] (237.489 ms) : 0, 237489
AppSec [baseline] (174.758 ms) : 0, 174758
AppSec [candidate] (175.117 ms) : 0, 175117
Debugger [baseline] (60.834 ms) : 0, 60834
Debugger [candidate] (6.008 ms) : 0, 6008
Remote Config [baseline] (678.259 µs) : 0, 678
Remote Config [candidate] (684.705 µs) : 0, 685
Telemetry [baseline] (8.445 ms) : 0, 8445
Telemetry [candidate] (8.584 ms) : 0, 8584
Flare Poller [baseline] (3.932 ms) : 0, 3932
Flare Poller [candidate] (3.973 ms) : 0, 3973
IAST [baseline] (24.954 ms) : 0, 24954
IAST [candidate] (24.783 ms) : 0, 24783
section iast
crashtracking [baseline] (1.492 ms) : 0, 1492
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (843.99 ms) : 0, 843990
BytebuddyAgent [candidate] (826.212 ms) : 0, 826212
GlobalTracer [baseline] (239.162 ms) : 0, 239162
GlobalTracer [candidate] (234.09 ms) : 0, 234090
AppSec [baseline] (31.167 ms) : 0, 31167
AppSec [candidate] (26.884 ms) : 0, 26884
Debugger [baseline] (60.706 ms) : 0, 60706
Debugger [candidate] (5.998 ms) : 0, 5998
Remote Config [baseline] (546.178 µs) : 0, 546
Remote Config [candidate] (665.887 µs) : 0, 666
Telemetry [baseline] (7.616 ms) : 0, 7616
Telemetry [candidate] (8.423 ms) : 0, 8423
Flare Poller [baseline] (3.464 ms) : 0, 3464
Flare Poller [candidate] (4.088 ms) : 0, 4088
IAST [baseline] (30.557 ms) : 0, 30557
IAST [candidate] (34.217 ms) : 0, 34217
section profiling
ProfilingAgent [baseline] (98.705 ms) : 0, 98705
ProfilingAgent [candidate] (110.534 ms) : 0, 110534
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (743.061 ms) : 0, 743061
BytebuddyAgent [candidate] (729.319 ms) : 0, 729319
GlobalTracer [baseline] (226.022 ms) : 0, 226022
GlobalTracer [candidate] (222.287 ms) : 0, 222287
AppSec [baseline] (33.177 ms) : 0, 33177
AppSec [candidate] (32.068 ms) : 0, 32068
Debugger [baseline] (64.225 ms) : 0, 64225
Debugger [candidate] (7.502 ms) : 0, 7502
Remote Config [baseline] (660.747 µs) : 0, 661
Remote Config [candidate] (666.437 µs) : 0, 666
Telemetry [baseline] (8.179 ms) : 0, 8179
Telemetry [candidate] (15.424 ms) : 0, 15424
Flare Poller [baseline] (3.863 ms) : 0, 3863
Flare Poller [candidate] (4.083 ms) : 0, 4083
Profiling [baseline] (99.312 ms) : 0, 99312
Profiling [candidate] (111.184 ms) : 0, 111184

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~b0b9e2009b, baseline=1.56.0-SNAPSHOT~439604a63d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.099 s) : 0, 1099219
Total [baseline] (8.854 s) : 0, 8853831
Agent [candidate] (1.045 s) : 0, 1045310
Total [candidate] (8.627 s) : 0, 8627150
section iast
Agent [baseline] (1.243 s) : 0, 1243369
Total [baseline] (9.565 s) : 0, 9564977
Agent [candidate] (1.178 s) : 0, 1177809
Total [candidate] (9.288 s) : 0, 9287916

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.099 s	-
Agent	iast	1.243 s	144.15 ms (13.1%)
Total	tracing	8.854 s	-
Total	iast	9.565 s	711.145 ms (8.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.045 s	-
Agent	iast	1.178 s	132.499 ms (12.7%)
Total	tracing	8.627 s	-
Total	iast	9.288 s	660.766 ms (7.7%)

gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~b0b9e2009b, baseline=1.56.0-SNAPSHOT~439604a63d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (706.16 ms) : 0, 706160
BytebuddyAgent [candidate] (703.507 ms) : 0, 703507
GlobalTracer [baseline] (248.326 ms) : 0, 248326
GlobalTracer [candidate] (245.438 ms) : 0, 245438
AppSec [baseline] (32.371 ms) : 0, 32371
AppSec [candidate] (32.131 ms) : 0, 32131
Debugger [baseline] (63.634 ms) : 0, 63634
Debugger [candidate] (6.35 ms) : 0, 6350
Remote Config [baseline] (640.813 µs) : 0, 641
Remote Config [candidate] (709.114 µs) : 0, 709
Telemetry [baseline] (8.184 ms) : 0, 8184
Telemetry [candidate] (13.711 ms) : 0, 13711
Flare Poller [baseline] (3.656 ms) : 0, 3656
Flare Poller [candidate] (7.389 ms) : 0, 7389
section iast
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (835.111 ms) : 0, 835111
BytebuddyAgent [candidate] (826.819 ms) : 0, 826819
GlobalTracer [baseline] (238.332 ms) : 0, 238332
GlobalTracer [candidate] (234.286 ms) : 0, 234286
IAST [baseline] (31.018 ms) : 0, 31018
IAST [candidate] (31.52 ms) : 0, 31520
AppSec [baseline] (30.683 ms) : 0, 30683
AppSec [candidate] (29.764 ms) : 0, 29764
Debugger [baseline] (60.265 ms) : 0, 60265
Debugger [candidate] (6.002 ms) : 0, 6002
Remote Config [baseline] (554.068 µs) : 0, 554
Remote Config [candidate] (611.802 µs) : 0, 612
Telemetry [baseline] (7.644 ms) : 0, 7644
Telemetry [candidate] (8.511 ms) : 0, 8511
Flare Poller [baseline] (3.45 ms) : 0, 3450
Flare Poller [candidate] (4.15 ms) : 0, 4150

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	cecile/otelmetrics13
git_commit_date	1763059139	1763059498
git_commit_sha	`439604a`	`b0b9e20`
release_version	1.56.0-SNAPSHOT~439604a63d	1.55.0-SNAPSHOT~b0b9e2009b

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763061852	1763061852
ci_job_id	1233616986	1233616986
ci_pipeline_id	82312660	82312660
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-03glnz19 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-03glnz19 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:profiling:high_load	better [-1.509ms; -0.607ms] or [-7.921%; -3.186%]	same [-1532.921µs; +106.142µs] or [-5.089%; +0.352%]	unstable [-13.214op/s; +37.839op/s] or [-5.466%; +15.652%]	17.987ms	29.407ms	254.062op/s	19.045ms	30.120ms	241.750op/s
scenario:load:petclinic:code_origins:high_load	worse [+0.643ms; +1.549ms] or [+3.725%; +8.978%]	unsure [+0.527ms; +1.896ms] or [+1.852%; +6.656%]	unstable [-42.100op/s; +9.850op/s] or [-15.892%; +3.718%]	18.345ms	29.698ms	248.781op/s	17.250ms	28.486ms	264.906op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~b0b9e2009b, baseline=1.56.0-SNAPSHOT~439604a63d
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.602 ms) : 19393, 19811
.   : milestone, 19602,
appsec (18.713 ms) : 18524, 18902
.   : milestone, 18713,
code_origins (17.614 ms) : 17440, 17788
.   : milestone, 17614,
iast (17.866 ms) : 17685, 18046
.   : milestone, 17866,
profiling (19.31 ms) : 19118, 19501
.   : milestone, 19310,
tracing (17.816 ms) : 17639, 17993
.   : milestone, 17816,
section candidate
no_agent (19.087 ms) : 18891, 19283
.   : milestone, 19087,
appsec (18.534 ms) : 18348, 18721
.   : milestone, 18534,
code_origins (18.764 ms) : 18575, 18953
.   : milestone, 18764,
iast (17.757 ms) : 17579, 17935
.   : milestone, 17757,
profiling (18.368 ms) : 18182, 18554
.   : milestone, 18368,
tracing (17.692 ms) : 17517, 17867
.   : milestone, 17692,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.602 ms [19.393 ms, 19.811 ms]	-
appsec	18.713 ms [18.524 ms, 18.902 ms]	-889.031 µs (-4.5%)
code_origins	17.614 ms [17.44 ms, 17.788 ms]	-1.988 ms (-10.1%)
iast	17.866 ms [17.685 ms, 18.046 ms]	-1.736 ms (-8.9%)
profiling	19.31 ms [19.118 ms, 19.501 ms]	-292.492 µs (-1.5%)
tracing	17.816 ms [17.639 ms, 17.993 ms]	-1.786 ms (-9.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.087 ms [18.891 ms, 19.283 ms]	-
appsec	18.534 ms [18.348 ms, 18.721 ms]	-552.81 µs (-2.9%)
code_origins	18.764 ms [18.575 ms, 18.953 ms]	-323.422 µs (-1.7%)
iast	17.757 ms [17.579 ms, 17.935 ms]	-1.33 ms (-7.0%)
profiling	18.368 ms [18.182 ms, 18.554 ms]	-719.156 µs (-3.8%)
tracing	17.692 ms [17.517 ms, 17.867 ms]	-1.395 ms (-7.3%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~b0b9e2009b, baseline=1.56.0-SNAPSHOT~439604a63d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.169 ms) : 1157, 1180
.   : milestone, 1169,
iast (3.156 ms) : 3114, 3198
.   : milestone, 3156,
iast_FULL (5.78 ms) : 5647, 5913
.   : milestone, 5780,
iast_GLOBAL (3.547 ms) : 3494, 3601
.   : milestone, 3547,
profiling (2.152 ms) : 2134, 2171
.   : milestone, 2152,
tracing (1.784 ms) : 1769, 1798
.   : milestone, 1784,
section candidate
no_agent (1.188 ms) : 1176, 1200
.   : milestone, 1188,
iast (3.049 ms) : 3015, 3083
.   : milestone, 3049,
iast_FULL (5.637 ms) : 5582, 5692
.   : milestone, 5637,
iast_GLOBAL (3.553 ms) : 3501, 3605
.   : milestone, 3553,
profiling (2.01 ms) : 1993, 2028
.   : milestone, 2010,
tracing (1.792 ms) : 1777, 1807
.   : milestone, 1792,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.169 ms [1.157 ms, 1.18 ms]	-
iast	3.156 ms [3.114 ms, 3.198 ms]	1.987 ms (170.1%)
iast_FULL	5.78 ms [5.647 ms, 5.913 ms]	4.611 ms (394.6%)
iast_GLOBAL	3.547 ms [3.494 ms, 3.601 ms]	2.379 ms (203.6%)
profiling	2.152 ms [2.134 ms, 2.171 ms]	983.891 µs (84.2%)
tracing	1.784 ms [1.769 ms, 1.798 ms]	615.063 µs (52.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.188 ms [1.176 ms, 1.2 ms]	-
iast	3.049 ms [3.015 ms, 3.083 ms]	1.861 ms (156.7%)
iast_FULL	5.637 ms [5.582 ms, 5.692 ms]	4.449 ms (374.5%)
iast_GLOBAL	3.553 ms [3.501 ms, 3.605 ms]	2.365 ms (199.0%)
profiling	2.01 ms [1.993 ms, 2.028 ms]	822.422 µs (69.2%)
tracing	1.792 ms [1.777 ms, 1.807 ms]	603.992 µs (50.8%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	cecile/otelmetrics13
git_commit_date	1763059139	1763059498
git_commit_sha	`439604a`	`b0b9e20`
release_version	1.56.0-SNAPSHOT~439604a63d	1.55.0-SNAPSHOT~b0b9e2009b

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1763061525	1763061525
ci_job_id	1233616987	1233616987
ci_pipeline_id	82312660	82312660
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-4-pui3p2w2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-4-pui3p2w2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~b0b9e2009b, baseline=1.56.0-SNAPSHOT~439604a63d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.709 ms) : 3491, 3927
.   : milestone, 3709,
iast (2.222 ms) : 2158, 2286
.   : milestone, 2222,
iast_GLOBAL (2.249 ms) : 2185, 2313
.   : milestone, 2249,
profiling (2.074 ms) : 2021, 2127
.   : milestone, 2074,
tracing (2.032 ms) : 1982, 2082
.   : milestone, 2032,
section candidate
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.734 ms) : 3506, 3961
.   : milestone, 3734,
iast (2.22 ms) : 2156, 2284
.   : milestone, 2220,
iast_GLOBAL (2.254 ms) : 2190, 2318
.   : milestone, 2254,
profiling (2.064 ms) : 2011, 2116
.   : milestone, 2064,
tracing (2.033 ms) : 1983, 2083
.   : milestone, 2033,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.484 ms]	-
appsec	3.709 ms [3.491 ms, 3.927 ms]	2.237 ms (151.9%)
iast	2.222 ms [2.158 ms, 2.286 ms]	749.962 µs (50.9%)
iast_GLOBAL	2.249 ms [2.185 ms, 2.313 ms]	776.506 µs (52.7%)
profiling	2.074 ms [2.021 ms, 2.127 ms]	601.847 µs (40.9%)
tracing	2.032 ms [1.982 ms, 2.082 ms]	559.382 µs (38.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.484 ms]	-
appsec	3.734 ms [3.506 ms, 3.961 ms]	2.261 ms (153.6%)
iast	2.22 ms [2.156 ms, 2.284 ms]	747.367 µs (50.8%)
iast_GLOBAL	2.254 ms [2.19 ms, 2.318 ms]	781.405 µs (53.1%)
profiling	2.064 ms [2.011 ms, 2.116 ms]	591.41 µs (40.2%)
tracing	2.033 ms [1.983 ms, 2.083 ms]	560.555 µs (38.1%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~b0b9e2009b, baseline=1.56.0-SNAPSHOT~439604a63d
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.98 s) : 14980000, 14980000
.   : milestone, 14980000,
appsec (14.916 s) : 14916000, 14916000
.   : milestone, 14916000,
iast (18.647 s) : 18647000, 18647000
.   : milestone, 18647000,
iast_GLOBAL (18.171 s) : 18171000, 18171000
.   : milestone, 18171000,
profiling (15.243 s) : 15243000, 15243000
.   : milestone, 15243000,
tracing (14.88 s) : 14880000, 14880000
.   : milestone, 14880000,
section candidate
no_agent (15.658 s) : 15658000, 15658000
.   : milestone, 15658000,
appsec (15.03 s) : 15030000, 15030000
.   : milestone, 15030000,
iast (18.104 s) : 18104000, 18104000
.   : milestone, 18104000,
iast_GLOBAL (18.153 s) : 18153000, 18153000
.   : milestone, 18153000,
profiling (15.257 s) : 15257000, 15257000
.   : milestone, 15257000,
tracing (14.702 s) : 14702000, 14702000
.   : milestone, 14702000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.98 s [14.98 s, 14.98 s]	-
appsec	14.916 s [14.916 s, 14.916 s]	-64.0 ms (-0.4%)
iast	18.647 s [18.647 s, 18.647 s]	3.667 s (24.5%)
iast_GLOBAL	18.171 s [18.171 s, 18.171 s]	3.191 s (21.3%)
profiling	15.243 s [15.243 s, 15.243 s]	263.0 ms (1.8%)
tracing	14.88 s [14.88 s, 14.88 s]	-100.0 ms (-0.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.658 s [15.658 s, 15.658 s]	-
appsec	15.03 s [15.03 s, 15.03 s]	-628.0 ms (-4.0%)
iast	18.104 s [18.104 s, 18.104 s]	2.446 s (15.6%)
iast_GLOBAL	18.153 s [18.153 s, 18.153 s]	2.495 s (15.9%)
profiling	15.257 s [15.257 s, 15.257 s]	-401.0 ms (-2.6%)
tracing	14.702 s [14.702 s, 14.702 s]	-956.0 ms (-6.1%)

mcculls · 2025-11-13T10:48:04Z

...agent-otel/otel-shim/src/main/java/datadog/opentelemetry/shim/metrics/OtelMeterProvider.java

+  private final Map<String, List<Meter>> meters;
+
+  public OtelMeterProvider() {
+    this.meters = new HashMap<>();
+  }


Suggested change

private final Map<String, List<Meter>> meters;

public OtelMeterProvider() {

this.meters = new HashMap<>();

}

private final Map<String, List<Meter>> scopedMeters = new ConcurrentHashMap();

Users may call this from different threads, so the map needs to handle concurrent updates.

Also final fields can be assigned in the same line, avoiding the need to do that in the constructor.

This can mean you can drop the constructor completely, making the code more concise.

Lastly I would call this field scopedMeters because it holds meters indexed by scope.

(This helps make the code clearer later on when you query scopedMeters and store the list of meters for that scope in a variable called meters)

cecile75 added 4 commits November 4, 2025 14:13

initial commit

34cb0c5

trace autoinstrumentaton should still match all versions after 1.4

7960f83

Merge branch 'master' into cecile/otelmetrics13

29ddda6

Add otel metrics enable config but doesn't use it

726a5f0

cecile75 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes inst: opentelemetry OpenTelemetry instrumentation labels Nov 6, 2025

cecile75 added 3 commits November 9, 2025 15:07

remove useless dependencies for now

e78078d

remove unused content for now

eab6ec2

Merge branch 'master' into cecile/otelmetrics13

f15cec4

cecile75 marked this pull request as ready for review November 12, 2025 14:35

cecile75 requested review from a team as code owners November 12, 2025 14:35

cecile75 requested review from mcculls and removed request for a team November 12, 2025 14:35

mcculls reviewed Nov 13, 2025

View reviewed changes

change HashMap to ConcurrentHashMap

b0b9e20

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add metrics OpenTelemetry instrumentation entry mechanism #9908

Add metrics OpenTelemetry instrumentation entry mechanism #9908

cecile75 commented Nov 6, 2025 •

edited

Loading

Uh oh!

datadog-official bot commented Nov 6, 2025 •

edited by datadog-datadog-prod-us1 bot

Loading

Uh oh!

pr-commenter bot commented Nov 6, 2025 •

edited

Loading

Uh oh!

mcculls Nov 13, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Add metrics OpenTelemetry instrumentation entry mechanism #9908

Are you sure you want to change the base?

Add metrics OpenTelemetry instrumentation entry mechanism #9908

Conversation

cecile75 commented Nov 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Uh oh!

datadog-official bot commented Nov 6, 2025 • edited by datadog-datadog-prod-us1 bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Nov 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

mcculls Nov 13, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

cecile75 commented Nov 6, 2025 •

edited

Loading

datadog-official bot commented Nov 6, 2025 •

edited by datadog-datadog-prod-us1 bot

Loading

pr-commenter bot commented Nov 6, 2025 •

edited

Loading