[FEATURE] Support for async Tool #116
Assignees
Labels
enhancement
New feature or request
Comments
This comment has been minimized.
This comment has been minimized.
|
Thank you for opening this feature request @tan-z-tan. This is something that the team is actively thinking about. #83 is a little related as well so tagging that here. |
This comment has been minimized.
This comment has been minimized.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Problem Statement
Hi team,
I’m looking to create tools for LLM calls and search systems, but these functions are implemented as async functions in my codebase.
Does StrandsAgents support defining tools as async functions? If not, I would like to request support for async tool definitions to better integrate with asynchronous workflows.
Proposed Solution
No response
Use Case
Many modern applications use asynchronous operations for network-bound tasks like API calls or database queries. For example:
• Calling an external LLM API such as OpenAI or Claude, which requires awaiting the HTTP response
• Performing a vector search against an async-compatible database or search engine (e.g., Redis, Qdrant, or OpenSearch via async clients)
• Fetching contextual information from other services in parallel
Allowing tools to be defined as async def would enable developers to:
• Seamlessly integrate StrandsAgents into async applications without blocking the event loop
• Compose multiple async tools in parallel using asyncio.gather
• Improve responsiveness and scalability in production environments
Alternatives Solutions
No response
Additional Context
No response
The text was updated successfully, but these errors were encountered: