[BUG/FEAT]: AWS Bedrock reasoning models with @agent
#3553
Labels
bug
Something isn't working
enhancement
New feature or request
Integration Request
Request for support of a new LLM, Embedder, or Vector database
How are you running AnythingLLM?
All versions
What happened?
With the refactor of AWS Bedrock to move away from Langchain in #3537
This needs to be expanded to the
agent
execution provider, as the use of Langchain to use reasoning models for agent execution is not possible with the current implementation.Current workaround
Do not use reasoning models for AWS Bedrock agent execution as the
content
response is an array as opposed to a string - like all other models.Are there known steps to reproduce?
Use a reasoning model for AWS bedrock and send a single agent chat. This error will manifest as a
jsonString?.startsWith
error - which is a red herring as the real error is the output formats from the response being mishandled by Langchain.The text was updated successfully, but these errors were encountered: