8000 [MLOB-2380] Add LLM Observability Serverless Quickstart Guide by sabrenner · Pull Request #28118 · DataDog/documentation · GitHub
[go: up one dir, main page]

Skip to content

[MLOB-2380] Add LLM Observability Serverless Quickstart Guide #28118

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 24 commits into from
May 21, 2025

Conversation

sabrenner
Copy link
Contributor

What does this PR do? What is the motivation?

Adds a quickstart guide for LLM Observability in serverless.

Merge instructions

Merge readiness:

  • Ready for merge

Merge queue is enabled in this repo. To have it automatically merged after it receives the required reviews, create the PR (from a branch that follows the <yourname>/description naming convention) and then add the following PR comment:

/merge

Additional notes

@github-actions github-actions bot added the Images Images are added/removed with this PR label Mar 14, 2025
@github-actions github-actions bot removed the Images Images are added/removed with this PR label Mar 14, 2025
@sabrenner sabrenner marked this pull request as ready for review March 18, 2025 20:36
@sabrenner sabrenner requested a review from a team as a code owner March 18, 2025 20:36
sabrenner and others added 4 commits March 18, 2025 21:32
Co-authored-by: cecilia saixue watt <cecilia.watt@datadoghq.com>
Co-authored-by: cecilia saixue watt <cecilia.watt@datadoghq.com>
Co-authored-by: cecilia saixue watt <cecilia.watt@datadoghq.com>
@github-actions github-actions bot added the Guide Content impacting a guide label Mar 19, 2025
@sabrenner
Copy link
Contributor Author

waiting on the next release of datadog-lambda-python to merge this, should be this week

export DATADOG_API_KEY_SECRET_ARN=<DATADOG_API_KEY_SECRET_ARN>
```
4. Instrument your Lambda function with LLM Observability (this requires at least version 77 of the Datadog Extension layer).
{{< tabs >}}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because this tabbed section is nested inside a numbered list, the tabs are indented. I think it looks a bit odd, but perhaps it is intentional and desired? Take a look and tell me what you think. If you'd like the tabs to be left justified, I think adding some extra newlines will separate them from the numbered list.

To see what I mean about the indentation, go to the preview, search on the page for the string "77", and look at the tabs just below the search result.

Copy link
Contributor Author
@sabrenner sabrenner May 15, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ahh yes i see what you're saying! yeah let me try adding some newlines around it to see if it helps a bit. it is intentional to have a tab section here, although the misalignment wasn't intentional, but otherwise i don't think it's something we're too concerned about.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i tried a bunch of newline configurations and couldn't quite get it to look right. any ideas for how to get the spacing a little better are appreciated 😄 we wanted the tabs here because of the different layer versions for the different language extensions. thanks!!

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I also played around with newlines. I was able to get the tab left justified, but it looked strange. I think the current configuration is the best. Thanks for being willing to experiment!

@sabrenner
Copy link
Contributor Author

/merge

@dd-devflow
Copy link
dd-devflow bot commented May 21, 2025

View all feedbacks in Devflow UI.

2025-05-21 19:09:12 UTC ℹ️ Start processing command /merge


2025-05-21 19:09:19 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 21m (p90).


2025-05-21 19:29:23 UTC ℹ️ MergeQueue: This merge request was merged

@dd-mergequeue dd-mergequeue bot merged commit 885ad08 into master May 21, 2025
20 of 22 checks passed
@dd-mergequeue dd-mergequeue bot deleted the sabrenner/llmobs-serverless-quickstart branch May 21, 2025 19:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Guide Content impacting a guide mergequeue-status: done
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants
0