8000 Gary/add llmobs svc functionalities traceid by gary-huang · Pull Request #8505 · DataDog/dd-trace-java · GitHub
[go: up one dir, main page]
Skip to content

Gary/add llmobs svc functionalities traceid #8505

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 14 commits into from
Closed

Gary/add llmobs svc functionalities traceid #8505

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
e2f347c
add APIs for llm obs
gary-huang Sep 19, 2024
d16b87d
add llm message class to support llm spans
gary-huang Mar 6, 2025
ec0066e
add llm message class to support llm spans
gary-huang Mar 6, 2025
6e3ea48
impl llmobs agent and llmobs apis
gary-huang Jan 27, 2025
8ae12e9
support llm messages with tool calls
gary-huang Mar 6, 2025
a090459
handle default model name and provider
gary-huang Mar 26, 2025
768f4e6
impl llmobs agent
gary-huang Jan 27, 2025
3def304
working writer
gary-huang Feb 7, 2025
f858e30
add support for llm message and tool calls
gary-huang Mar 6, 2025
5743fe3
working writer
gary-huang Feb 7, 2025
11a0421
working writer
gary-huang Feb 7, 2025
c90915b
working writer
gary-huang Feb 7, 2025
d2b33d9
working writer
gary-huang Feb 7, 2025
63275f6
use trace ID to map to individual stacks of active contexts
gary-huang Feb 20, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
handle default model name and provider
  • Loading branch information
@gary-huang
gary-huang committed Mar 26, 2025
commit a090459bf4dc45959debb80f42a4e927452c8e8a
9 changes: 9 additions & 0 deletions dd-java-agent/agent-llmobs/src/main/java/datadog/trace/llmobs/LLMObsSystem.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,8 @@ public class LLMObsSystem {

private static final Logger LOGGER = LoggerFactory.getLogger(LLMObsSystem.class);

private static final String CUSTOM_MODEL_VAL = "custom";

public static void start(Instrumentation inst, SharedCommunicationObjects sco) {
Config config = Config.get();
if (!config.isLlmObsEnabled()) {
Expand Down Expand Up @@ -57,7 +59,14 @@ public LLMObsSpan startLLMSpan(
new DDLLMObsSpan(
Tags.LLMOBS_LLM_SPAN_KIND, spanName, getMLApp(mlApp), sessionID, serviceName);

if (modelName == null || modelName.isEmpty()) {
modelName = CUSTOM_MODEL_VAL;
}
span.setTag(LLMObsTags.MODEL_NAME, modelName);

if (modelProvider == null || modelProvider.isEmpty()) {
modelProvider = CUSTOM_MODEL_VAL;
}
span.setTag(LLMObsTags.MODEL_PROVIDER, modelProvider);
return span;
}
Expand Down
0