Support structured output and tool use for Gemini models

[jhammarstedt]

This might be more of a gemini related opinion. But I think the concept of structured output is extremely powerful for building stable and consistent workflows. It allows for clearly defined datamodels, if you're using Gemini, and then having to add another agent that cannot use tools but should just fit the output to a structured datamodel feels suboptimal, and many of the other providers support this

[hangfei]

Could you see if this can address your need: https://google.github.io/adk-docs/agents/llm-agents/#structuring-data-input_schema-output_schema-output_key ?

If not, could you explain a bit with an example of the ideal behaviour?

[jhammarstedt]

This does specifically say that "# Cannot use tools=[get_capital_city] effectively here" which was the point of my thread.

I'm asking if we can support tool calls and structured output

[casepot]

It would be convenient to be able to assign tools= and output_schema= together for a single LLMAgent. Maybe there is some reason this is not possible but I'm not sure. Right now, based on my understanding, you would have to make a LLMAgent dedicated to the structured output, and give that as an AgentTool to another agent to call as a tool after using other tools, or make tools with args dedicated to specific schemas or some other work around.

[jwalitptl]

I am moving from openai adk to google sdk and this the biggest minus point for google adk. in openai sdk you can get stcrutured out to mater if you use tools or not and gives whole lot stability the flow as you always get deterministic output. output shchema should always work regardless if you use tool or not.

[hangfei]

Hi, we are looking into how to address this limitation. Stay tuned.

[3az1le]

Hi, do you have an ETA for this feature ? Thanks

[serranoarevalo]

So is this a feature in the roadmap then?

[jhammarstedt]

any progress on this @hangfei ? :)