set unified service tags on llm obs span start #9935

gary-huang · 2025-11-11T21:43:29Z

What Does This Do

when LLM Obs spans start, unified service tags are now attached automatically on the spans

tested by running a sample app locally with the following

java -javaagent:$JARPATH -Ddd.service=gary-test -Ddd.env=local -Ddd.version=4.20 -Ddd.llmobs.enabled=true -Ddd.llmobs.ml.app=gary-test  -jar build/libs/rest-service-0.0.1-SNAPSHOT.jar

meaning we should have env:local, service:gary-test, and version:4.20

the resulting span (and its children spans) all have the UST tags as well as the tags added in the sample app

https://dddev.datadoghq.com/llm/traces?query=%40event_type%3Aspan%20%40parent_id%3Aundefined%20service%3Agary-test&agg_m=count&agg_m_source=base&agg_t=count&fromUser=true&sp=%5B%7B%22p%22%3A%7B%22eventId%22%3A%22AwAAAZp0yabX95MsMAAAABhBWnAweWFiWEFBQjd4M2hJOFVTNEFBQUEAAAAkMDE5YTc0YzktYTZkYS00MjQ5LTgwNDUtMTkwNjg2NWM1YWZkAAAAAw%22%7D%2C%22i%22%3A%22llm-obs-panel%22%7D%5D&spanId=6960426944522644278&start=1762894957239&end=1762898557239&paused=true

also searchable
https://dddev.datadoghq.com/llm/traces?query=%40event_type%3Aspan%20%40parent_id%3Aundefined%20service%3Agary-test&agg_m=count&agg_m_source=base&agg_t=count&fromUser=true&spanId=6960426944522644278&start=1762894957239&end=1762898557239&paused=true
https://dddev.datadoghq.com/llm/traces?query=%40event_type%3Aspan%20%40parent_id%3Aundefined%20env%3Alocal&agg_m=count&agg_m_source=base&agg_t=count&fromUser=true&spanId=6960426944522644278&start=1762894957239&end=1762898557239&paused=true
https://dddev.datadoghq.com/llm/traces?query=%40event_type%3Aspan%20%40parent_id%3Aundefined%20version%3A4.20&agg_m=count&agg_m_source=base&agg_t=count&fromUser=true&spanId=6960426944522644278&start=1762894957239&end=1762898557239&paused=true

Motivation

bug report fixes MLOS-291

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

github-actions · 2025-11-11T21:43:38Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request
Remove the tag from the pull request title

If you need help, please check our contributing guidelines.

datadog-official · 2025-11-11T22:07:18Z

🎯 Code Coverage
• Patch Coverage: 25.00%
• Total Coverage: 59.89% (+0.25%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 4569fd7 | Docs | Datadog PR Page | Was this helpful? Give us feedback!}

pr-commenter · 2025-11-11T22:35:19Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	gary/mlos-291
git_commit_date	1763060338	1763061126
git_commit_sha	`29d5c2d`	`4569fd7`
release_version	1.56.0-SNAPSHOT~29d5c2d641	1.56.0-SNAPSHOT~4569fd7206

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763063026	1763063026
ci_job_id	1233693613	1233693613
ci_pipeline_id	82317623	82317623
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-n95l9vdc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-n95l9vdc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~4569fd7206, baseline=1.56.0-SNAPSHOT~29d5c2d641

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.103 s) : 0, 1103487
Total [baseline] (8.818 s) : 0, 8818287
Agent [candidate] (1.103 s) : 0, 1102718
Total [candidate] (8.813 s) : 0, 8813181
section iast
Agent [baseline] (1.233 s) : 0, 1233027
Total [baseline] (9.529 s) : 0, 9529309
Agent [candidate] (1.235 s) : 0, 1235065
Total [candidate] (9.536 s) : 0, 9535722

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.103 s	-
Agent	iast	1.233 s	129.54 ms (11.7%)
Total	tracing	8.818 s	-
Total	iast	9.529 s	711.023 ms (8.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.103 s	-
Agent	iast	1.235 s	132.347 ms (12.0%)
Total	tracing	8.813 s	-
Total	iast	9.536 s	722.541 ms (8.2%)

gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~4569fd7206, baseline=1.56.0-SNAPSHOT~29d5c2d641

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (708.874 ms) : 0, 708874
BytebuddyAgent [candidate] (709.001 ms) : 0, 709001
GlobalTracer [baseline] (249.553 ms) : 0, 249553
GlobalTracer [candidate] (249.33 ms) : 0, 249330
AppSec [baseline] (32.556 ms) : 0, 32556
AppSec [candidate] (32.62 ms) : 0, 32620
Debugger [baseline] (63.658 ms) : 0, 63658
Debugger [candidate] (63.29 ms) : 0, 63290
Remote Config [baseline] (650.186 µs) : 0, 650
Remote Config [candidate] (631.587 µs) : 0, 632
Telemetry [baseline] (8.324 ms) : 0, 8324
Telemetry [candidate] (8.019 ms) : 0, 8019
Flare Poller [baseline] (3.702 ms) : 0, 3702
Flare Poller [candidate] (3.656 ms) : 0, 3656
section iast
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (827.112 ms) : 0, 827112
BytebuddyAgent [candidate] (828.192 ms) : 0, 828192
GlobalTracer [baseline] (236.85 ms) : 0, 236850
GlobalTracer [candidate] (237.482 ms) : 0, 237482
IAST [baseline] (27.493 ms) : 0, 27493
IAST [candidate] (29.131 ms) : 0, 29131
AppSec [baseline] (33.964 ms) : 0, 33964
AppSec [candidate] (32.388 ms) : 0, 32388
Debugger [baseline] (59.936 ms) : 0, 59936
Debugger [candidate] (60.138 ms) : 0, 60138
Remote Config [baseline] (543.767 µs) : 0, 544
Remote Config [candidate] (546.377 µs) : 0, 546
Telemetry [baseline] (7.616 ms) : 0, 7616
Telemetry [candidate] (7.662 ms) : 0, 7662
Flare Poller [baseline] (3.452 ms) : 0, 3452
Flare Poller [candidate] (3.463 ms) : 0, 3463

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~4569fd7206, baseline=1.56.0-SNAPSHOT~29d5c2d641

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.094 s) : 0, 1094413
Total [baseline] (10.722 s) : 0, 10721603
Agent [candidate] (1.101 s) : 0, 1100625
Total [candidate] (10.83 s) : 0, 10829925
section appsec
Agent [baseline] (1.279 s) : 0, 1278629
Total [baseline] (11.212 s) : 0, 11211676
Agent [candidate] (1.281 s) : 0, 1281475
Total [candidate] (11.102 s) : 0, 11101691
section iast
Agent [baseline] (1.237 s) : 0, 1237201
Total [baseline] (11.229 s) : 0, 11228744
Agent [candidate] (1.237 s) : 0, 1237269
Total [candidate] (11.197 s) : 0, 11197222
section profiling
Agent [baseline] (1.226 s) : 0, 1225740
Total [baseline] (11.013 s) : 0, 11013330
Agent [candidate] (1.237 s) : 0, 1236733
Total [candidate] (11.205 s) : 0, 11205123

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.094 s	-
Agent	appsec	1.279 s	184.216 ms (16.8%)
Agent	iast	1.237 s	142.789 ms (13.0%)
Agent	profiling	1.226 s	131.327 ms (12.0%)
Total	tracing	10.722 s	-
Total	appsec	11.212 s	490.073 ms (4.6%)
Total	iast	11.229 s	507.141 ms (4.7%)
Total	profiling	11.013 s	291.727 ms (2.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.101 s	-
Agent	appsec	1.281 s	180.85 ms (16.4%)
Agent	iast	1.237 s	136.643 ms (12.4%)
Agent	profiling	1.237 s	136.108 ms (12.4%)
Total	tracing	10.83 s	-
Total	appsec	11.102 s	271.765 ms (2.5%)
Total	iast	11.197 s	367.297 ms (3.4%)
Total	profiling	11.205 s	375.197 ms (3.5%)

gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~4569fd7206, baseline=1.56.0-SNAPSHOT~29d5c2d641

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (702.686 ms) : 0, 702686
BytebuddyAgent [candidate] (706.137 ms) : 0, 706137
GlobalTracer [baseline] (247.063 ms) : 0, 247063
GlobalTracer [candidate] (248.515 ms) : 0, 248515
AppSec [baseline] (32.179 ms) : 0, 32179
AppSec [candidate] (32.573 ms) : 0, 32573
Debugger [baseline] (63.917 ms) : 0, 63917
Debugger [candidate] (64.515 ms) : 0, 64515
Remote Config [baseline] (665.297 µs) : 0, 665
Remote Config [candidate] (646.942 µs) : 0, 647
Telemetry [baseline] (8.205 ms) : 0, 8205
Telemetry [candidate] (8.369 ms) : 0, 8369
Flare Poller [baseline] (3.689 ms) : 0, 3689
Flare Poller [candidate] (3.804 ms) : 0, 3804
section appsec
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (729.083 ms) : 0, 729083
BytebuddyAgent [candidate] (729.824 ms) : 0, 729824
GlobalTracer [baseline] (240.731 ms) : 0, 240731
GlobalTracer [candidate] (240.959 ms) : 0, 240959
AppSec [baseline] (173.795 ms) : 0, 173795
AppSec [candidate] (174.817 ms) : 0, 174817
Debugger [baseline] (61.137 ms) : 0, 61137
Debugger [candidate] (61.672 ms) : 0, 61672
Remote Config [baseline] (664.49 µs) : 0, 664
Remote Config [candidate] (690.179 µs) : 0, 690
Telemetry [baseline] (8.339 ms) : 0, 8339
Telemetry [candidate] (8.457 ms) : 0, 8457
Flare Poller [baseline] (3.966 ms) : 0, 3966
Flare Poller [candidate] (3.978 ms) : 0, 3978
IAST [baseline] (24.735 ms) : 0, 24735
IAST [candidate] (24.911 ms) : 0, 24911
section iast
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (829.421 ms) : 0, 829421
BytebuddyAgent [candidate] (829.18 ms) : 0, 829180
GlobalTracer [baseline] (237.697 ms) : 0, 237697
GlobalTracer [candidate] (238.002 ms) : 0, 238002
AppSec [baseline] (33.072 ms) : 0, 33072
AppSec [candidate] (33.919 ms) : 0, 33919
Debugger [baseline] (60.954 ms) : 0, 60954
Debugger [candidate] (60.983 ms) : 0, 60983
Remote Config [baseline] (534.969 µs) : 0, 535
Remote Config [candidate] (539.299 µs) : 0, 539
Telemetry [baseline] (7.615 ms) : 0, 7615
Telemetry [candidate] (7.651 ms) : 0, 7651
Flare Poller [baseline] (3.499 ms) : 0, 3499
Flare Poller [candidate] (3.488 ms) : 0, 3488
IAST [baseline] (28.264 ms) : 0, 28264
IAST [candidate] (27.406 ms) : 0, 27406
section profiling
ProfilingAgent [baseline] (97.127 ms) : 0, 97127
ProfilingAgent [candidate] (99.78 ms) : 0, 99780
crashtracking [baseline] (1.432 ms) : 0, 1432
crashtracking [candidate] (1.444 ms) : 0, 1444
BytebuddyAgent [baseline] (728.669 ms) : 0, 728669
BytebuddyAgent [candidate] (734.84 ms) : 0, 734840
GlobalTracer [baseline] (221.28 ms) : 0, 221280
GlobalTracer [candidate] (222.374 ms) : 0, 222374
AppSec [baseline] (32.368 ms) : 0, 32368
AppSec [candidate] (32.259 ms) : 0, 32259
Debugger [baseline] (63.132 ms) : 0, 63132
Debugger [candidate] (63.766 ms) : 0, 63766
Remote Config [baseline] (647.634 µs) : 0, 648
Remote Config [candidate] (662.32 µs) : 0, 662
Telemetry [baseline] (7.97 ms) : 0, 7970
Telemetry [candidate] (8.037 ms) : 0, 8037
Flare Poller [baseline] (3.79 ms) : 0, 3790
Flare Poller [candidate] (3.811 ms) : 0, 3811
Profiling [baseline] (97.712 ms) : 0, 97712
Profiling [candidate] (100.379 ms) : 0, 100379

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	gary/mlos-291
git_commit_date	1763060338	1763061126
git_commit_sha	`29d5c2d`	`4569fd7`
release_version	1.56.0-SNAPSHOT~29d5c2d641	1.56.0-SNAPSHOT~4569fd7206

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763063529	1763063529
ci_job_id	1233693614	1233693614
ci_pipeline_id	82317623	82317623
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-95vy1hgc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-95vy1hgc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 18 metrics, 18 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~4569fd7206, baseline=1.56.0-SNAPSHOT~29d5c2d641
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.188 ms) : 1176, 1200
.   : milestone, 1188,
iast (3.215 ms) : 3152, 3278
.   : milestone, 3215,
iast_FULL (5.915 ms) : 5836, 5994
.   : milestone, 5915,
iast_GLOBAL (3.729 ms) : 3623, 3835
.   : milestone, 3729,
profiling (2.178 ms) : 2158, 2199
.   : milestone, 2178,
tracing (1.831 ms) : 1816, 1846
.   : milestone, 1831,
section candidate
no_agent (1.192 ms) : 1180, 1204
.   : milestone, 1192,
iast (3.318 ms) : 3213, 3422
.   : milestone, 3318,
iast_FULL (5.743 ms) : 5673, 5812
.   : milestone, 5743,
iast_GLOBAL (3.467 ms) : 3419, 3515
.   : milestone, 3467,
profiling (2.0 ms) : 1982, 2018
.   : milestone, 2000,
tracing (1.817 ms) : 1802, 1833
.   : milestone, 1817,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.188 ms [1.176 ms, 1.2 ms]	-
iast	3.215 ms [3.152 ms, 3.278 ms]	2.027 ms (170.6%)
iast_FULL	5.915 ms [5.836 ms, 5.994 ms]	4.727 ms (397.9%)
iast_GLOBAL	3.729 ms [3.623 ms, 3.835 ms]	2.541 ms (213.8%)
profiling	2.178 ms [2.158 ms, 2.199 ms]	990.132 µs (83.3%)
tracing	1.831 ms [1.816 ms, 1.846 ms]	642.905 µs (54.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.192 ms [1.18 ms, 1.204 ms]	-
iast	3.318 ms [3.213 ms, 3.422 ms]	2.125 ms (178.3%)
iast_FULL	5.743 ms [5.673 ms, 5.812 ms]	4.55 ms (381.7%)
iast_GLOBAL	3.467 ms [3.419 ms, 3.515 ms]	2.275 ms (190.8%)
profiling	2.0 ms [1.982 ms, 2.018 ms]	807.771 µs (67.8%)
tracing	1.817 ms [1.802 ms, 1.833 ms]	624.903 µs (52.4%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~4569fd7206, baseline=1.56.0-SNAPSHOT~29d5c2d641
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.271 ms) : 18086, 18457
.   : milestone, 18271,
appsec (18.673 ms) : 18482, 18863
.   : milestone, 18673,
code_origins (17.62 ms) : 17444, 17795
.   : milestone, 17620,
iast (18.286 ms) : 18101, 18471
.   : milestone, 18286,
profiling (18.36 ms) : 18178, 18542
.   : milestone, 18360,
tracing (17.495 ms) : 17323, 17668
.   : milestone, 17495,
section candidate
no_agent (17.358 ms) : 17184, 17533
.   : milestone, 17358,
appsec (18.776 ms) : 18584, 18969
.   : milestone, 18776,
code_origins (18.01 ms) : 17831, 18189
.   : milestone, 18010,
iast (17.71 ms) : 17532, 17888
.   : milestone, 17710,
profiling (18.713 ms) : 18524, 18903
.   : milestone, 18713,
tracing (17.687 ms) : 17511, 17862
.   : milestone, 17687,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.271 ms [18.086 ms, 18.457 ms]	-
appsec	18.673 ms [18.482 ms, 18.863 ms]	401.476 µs (2.2%)
code_origins	17.62 ms [17.444 ms, 17.795 ms]	-651.513 µs (-3.6%)
iast	18.286 ms [18.101 ms, 18.471 ms]	14.441 µs (0.1%)
profiling	18.36 ms [18.178 ms, 18.542 ms]	88.985 µs (0.5%)
tracing	17.495 ms [17.323 ms, 17.668 ms]	-775.812 µs (-4.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.358 ms [17.184 ms, 17.533 ms]	-
appsec	18.776 ms [18.584 ms, 18.969 ms]	1.418 ms (8.2%)
code_origins	18.01 ms [17.831 ms, 18.189 ms]	651.343 µs (3.8%)
iast	17.71 ms [17.532 ms, 17.888 ms]	351.729 µs (2.0%)
profiling	18.713 ms [18.524 ms, 18.903 ms]	1.355 ms (7.8%)
tracing	17.687 ms [17.511 ms, 17.862 ms]	328.245 µs (1.9%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	gary/mlos-291
git_commit_date	1763060338	1763061126
git_commit_sha	`29d5c2d`	`4569fd7`
release_version	1.56.0-SNAPSHOT~29d5c2d641	1.56.0-SNAPSHOT~4569fd7206

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1763063089	1763063089
ci_job_id	1233693615	1233693615
ci_pipeline_id	82317623	82317623
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-fw2cye7x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-fw2cye7x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~4569fd7206, baseline=1.56.0-SNAPSHOT~29d5c2d641
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.713 ms) : 3496, 3930
.   : milestone, 3713,
iast (2.204 ms) : 2141, 2268
.   : milestone, 2204,
iast_GLOBAL (2.27 ms) : 2204, 2335
.   : milestone, 2270,
profiling (2.078 ms) : 2024, 2131
.   : milestone, 2078,
tracing (2.027 ms) : 1977, 2078
.   : milestone, 2027,
section candidate
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (3.634 ms) : 3420, 3848
.   : milestone, 3634,
iast (2.207 ms) : 2142, 2271
.   : milestone, 2207,
iast_GLOBAL (2.259 ms) : 2195, 2323
.   : milestone, 2259,
profiling (2.511 ms) : 2340, 2682
.   : milestone, 2511,
tracing (2.027 ms) : 1976, 2077
.   : milestone, 2027,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.461 ms, 1.484 ms]	-
appsec	3.713 ms [3.496 ms, 3.93 ms]	2.241 ms (152.1%)
iast	2.204 ms [2.141 ms, 2.268 ms]	731.789 µs (49.7%)
iast_GLOBAL	2.27 ms [2.204 ms, 2.335 ms]	797.096 µs (54.1%)
profiling	2.078 ms [2.024 ms, 2.131 ms]	605.085 µs (41.1%)
tracing	2.027 ms [1.977 ms, 2.078 ms]	554.819 µs (37.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.475 ms [1.463 ms, 1.486 ms]	-
appsec	3.634 ms [3.42 ms, 3.848 ms]	2.159 ms (146.4%)
iast	2.207 ms [2.142 ms, 2.271 ms]	732.007 µs (49.6%)
iast_GLOBAL	2.259 ms [2.195 ms, 2.323 ms]	784.315 µs (53.2%)
profiling	2.511 ms [2.34 ms, 2.682 ms]	1.036 ms (70.3%)
tracing	2.027 ms [1.976 ms, 2.077 ms]	552.167 µs (37.4%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~4569fd7206, baseline=1.56.0-SNAPSHOT~29d5c2d641
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.981 s) : 14981000, 14981000
.   : milestone, 14981000,
appsec (14.532 s) : 14532000, 14532000
.   : milestone, 14532000,
iast (18.241 s) : 18241000, 18241000
.   : milestone, 18241000,
iast_GLOBAL (18.031 s) : 18031000, 18031000
.   : milestone, 18031000,
profiling (14.875 s) : 14875000, 14875000
.   : milestone, 14875000,
tracing (14.78 s) : 14780000, 14780000
.   : milestone, 14780000,
section candidate
no_agent (15.366 s) : 15366000, 15366000
.   : milestone, 15366000,
appsec (14.881 s) : 14881000, 14881000
.   : milestone, 14881000,
iast (18.293 s) : 18293000, 18293000
.   : milestone, 18293000,
iast_GLOBAL (17.896 s) : 17896000, 17896000
.   : milestone, 17896000,
profiling (15.127 s) : 15127000, 15127000
.   : milestone, 15127000,
tracing (14.519 s) : 14519000, 14519000
.   : milestone, 14519000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.981 s [14.981 s, 14.981 s]	-
appsec	14.532 s [14.532 s, 14.532 s]	-449.0 ms (-3.0%)
iast	18.241 s [18.241 s, 18.241 s]	3.26 s (21.8%)
iast_GLOBAL	18.031 s [18.031 s, 18.031 s]	3.05 s (20.4%)
profiling	14.875 s [14.875 s, 14.875 s]	-106.0 ms (-0.7%)
tracing	14.78 s [14.78 s, 14.78 s]	-201.0 ms (-1.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.366 s [15.366 s, 15.366 s]	-
appsec	14.881 s [14.881 s, 14.881 s]	-485.0 ms (-3.2%)
iast	18.293 s [18.293 s, 18.293 s]	2.927 s (19.0%)
iast_GLOBAL	17.896 s [17.896 s, 17.896 s]	2.53 s (16.5%)
profiling	15.127 s [15.127 s, 15.127 s]	-239.0 ms (-1.6%)
tracing	14.519 s [14.519 s, 14.519 s]	-847.0 ms (-5.5%)

dd-java-agent/agent-llmobs/src/main/java/datadog/trace/llmobs/domain/DDLLMObsSpan.java

AlexeyKuznetsov-DD

Does this change need to be covered with tests?

gary-huang · 2025-11-12T19:52:28Z

Does this change need to be covered with tests?

yes, done!

dd-java-agent/agent-llmobs/src/test/groovy/datadog/trace/llmobs/domain/DDLLMObsSpanTest.groovy

gary-huang requested a review from a team as a code owner November 11, 2025 21:43

gary-huang force-pushed the gary/mlos-291 branch from 8439d19 to f624996 Compare November 11, 2025 21:44

ygree reviewed Nov 11, 2025

View reviewed changes

dd-java-agent/agent-llmobs/src/main/java/datadog/trace/llmobs/domain/DDLLMObsSpan.java Outdated Show resolved Hide resolved

ygree approved these changes Nov 11, 2025

View reviewed changes

sabrenner approved these changes Nov 12, 2025

View reviewed changes

dd-java-agent/agent-llmobs/src/main/java/datadog/trace/llmobs/domain/DDLLMObsSpan.java Show resolved Hide resolved

AlexeyKuznetsov-DD reviewed Nov 12, 2025

View reviewed changes

gary-huang added comp: mlobs ML Observability (LLMObs) type: bug Bug report and fix labels Nov 12, 2025

gary-huang self-assigned this Nov 12, 2025

gary-huang changed the title ~~[MLOS-291] set unified service tags on llm obs span start~~ set unified service tags on llm obs span start Nov 12, 2025

AlexeyKuznetsov-DD reviewed Nov 12, 2025

View reviewed changes

dd-java-agent/agent-llmobs/src/test/groovy/datadog/trace/llmobs/domain/DDLLMObsSpanTest.groovy Outdated Show resolved Hide resolved

gary-huang added 3 commits November 13, 2025 14:12

set unified service tags on llm obs span start

cd26b9a

tests and clarify comment

859ad01

dont need asserts in then

4569fd7

gary-huang force-pushed the gary/mlos-291 branch from 403f4f8 to 4569fd7 Compare November 13, 2025 19:12

gary-huang merged commit 7a4d8d0 into master Nov 13, 2025
540 checks passed

gary-huang deleted the gary/mlos-291 branch November 13, 2025 22:28

github-actions bot added this to the 1.56.0 milestone Nov 13, 2025

gary-huang mentioned this pull request Nov 17, 2025

🍒 9935 - set unified service tags on llm obs span start #9988

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

set unified service tags on llm obs span start #9935

set unified service tags on llm obs span start #9935

gary-huang commented Nov 11, 2025 •

edited by atlassian bot

Loading

Uh oh!

github-actions bot commented Nov 11, 2025 •

edited

Loading

Uh oh!

datadog-official bot commented Nov 11, 2025 •

edited by datadog-datadog-prod-us1 bot

Loading

Uh oh!

pr-commenter bot commented Nov 11, 2025 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

AlexeyKuznetsov-DD left a comment •

edited

Loading

Uh oh!

gary-huang commented Nov 12, 2025

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

set unified service tags on llm obs span start #9935

set unified service tags on llm obs span start #9935

Conversation

gary-huang commented Nov 11, 2025 • edited by atlassian bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actions bot commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

datadog-official bot commented Nov 11, 2025 • edited by datadog-datadog-prod-us1 bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Uh oh!

AlexeyKuznetsov-DD left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

gary-huang commented Nov 12, 2025

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

gary-huang commented Nov 11, 2025 •

edited by atlassian bot

Loading

github-actions bot commented Nov 11, 2025 •

edited

Loading

datadog-official bot commented Nov 11, 2025 •

edited by datadog-datadog-prod-us1 bot

Loading

pr-commenter bot commented Nov 11, 2025 •

edited

Loading

AlexeyKuznetsov-DD left a comment •

edited

Loading