Skip to content

[BUG/FEAT]: AWS Bedrock reasoning models with @agent #3553

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
timothycarambat opened this issue Mar 27, 2025 · 2 comments
Open

[BUG/FEAT]: AWS Bedrock reasoning models with @agent #3553

timothycarambat opened this issue Mar 27, 2025 · 2 comments
Assignees
Labels
bug Something isn't working enhancement New feature or request Integration Request Request for support of a new LLM, Embedder, or Vector database

Comments

@timothycarambat
Copy link
Member

How are you running AnythingLLM?

All versions

What happened?

With the refactor of AWS Bedrock to move away from Langchain in #3537

This needs to be expanded to the agent execution provider, as the use of Langchain to use reasoning models for agent execution is not possible with the current implementation.

Current workaround
Do not use reasoning models for AWS Bedrock agent execution as the content response is an array as opposed to a string - like all other models.

Are there known steps to reproduce?

Use a reasoning model for AWS bedrock and send a single agent chat. This error will manifest as a jsonString?.startsWith error - which is a red herring as the real error is the output formats from the response being mishandled by Langchain.

@timothycarambat timothycarambat added bug Something isn't working enhancement New feature or request Integration Request Request for support of a new LLM, Embedder, or Vector database labels Mar 27, 2025
@timothycarambat timothycarambat self-assigned this Mar 27, 2025
@timothycarambat timothycarambat changed the title [BUG]: AWS Bedrock reasoning models with @agent [BUG/FEAT]: AWS Bedrock reasoning models with @agent Mar 27, 2025
@tristan-stahnke
Copy link

@timothycarambat I think my PR #3714 resolved this, can you check?

@tristan-stahnke
Copy link

I was able to create agents using bedrock with my PR applied for the bedrock provider, parsed the content of a google search and sent it back to the LLM; not sure if there's another part of the @agent functionality that's needed, but would be cool to test it out, definitely want to get agents working fully with bedrock 💯

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request Integration Request Request for support of a new LLM, Embedder, or Vector database
Projects
None yet
Development

No branches or pull requests

3 participants
@timothycarambat @tristan-stahnke and others