8000 fix: Adding detailed information on each metric evaluation by copybara-service[bot] · Pull Request #1480 · google/adk-python · GitHub
[go: up one dir, main page]
Skip to content

fix: Adding detailed information on each metric evaluation #1480

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

fix: Adding detailed information on each metric evaluation #1480

wants to merge 1 commit into from

Conversation

copybara-service[bot]
Copy link
@copybara-service copybara-service bot commented Jun 17, 2025 •
edited
Loading

fix: Adding detailed information on each metric evaluation

Additionally, few other small changes.

  • Updated a test fixture to support the latest eval data schema. Somehow I missed doing that previously.
  • Updated the evaluation_generator.py to use run_async, instead of run.
  • Also, raise an informed error when dependencies required eval are not installed.
  • Also, changed the behavior of AgentEvaluator.evaluate method to run all the evals, instead of failing at the first eval metric failure.

@ankursharmas @copybara-github
fix: Adding detailed information on each metric evaluation
7e4ee83 
Additionally, few other small changes.
*   Updated a test fixture to support the latest eval data schema. Somehow I missed doing that previously.
*   Updated the `evaluation_generator.py` to use `run_async`, instead of `run`.
*   Also, raise an informed error when dependencies required eval are not installed.
*   Also, changed the behavior of AgentEvaluator.evaluate method to run all the evals, instead of failing at the first eval metric failure.

PiperOrigin-RevId: 772653363
@copybara-service copybara-service bot force-pushed the copybara/772653363 branch from ddf590c to 7e4ee83 Compare June 17, 2025 23:27
@hangfei hangfei added bot_triaged core Issues related to the core interface and implementation labels Jun 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
bot_triaged core Issues related to the core interface and implementation google-contributor
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@hangfei @ankursharmas
0