Error: JSON not found

[GeorgeCarpenter]

When I use bytedance-research/UI-TARS-7B-DPO as the model to run Agent-S2, the output of the model does not contain json during the generation of the DAG. I think maybe the error is due to the ability limitation of UI-TARS-7B-DPO. Can you generate json when using UI-TARS-7B-DPO as the model for Agent-S2? @alckasoc

[alckasoc]

Hello again!

Oh, UI-TARS-7B-DPO and 72B are used exclusively for grounding not as the main generation model (which is responsible for the DAG generation).

[GeorgeCarpenter]

Hello again!

Oh, UI-TARS-7B-DPO and 72B are used exclusively for grounding not as the main generation model (which is responsible for the DAG generation).

What main generation model do you use? @alckasoc

[alckasoc]

claude-3-7-sonnet-20250219 yields the best performance from our experiments. We also tested GPT-4o, but it was ~8% worse on OSWorld compared to Claude 3.7 Sonnet with thinking mode.

[GeorgeCarpenter]

claude-3-7-sonnet-20250219 yields the best performance from our experiments. We also tested GPT-4o, but it was ~8% worse on OSWorld compared to Claude 3.7 Sonnet with thinking mode.

OK. Thanks.

[GeorgeCarpenter]

Hello, how to set the grounding model and main generation model?

I would like to set the grounding model and main generation model seperately. However, there exists no param can be set for the two kinds of models in config() of osworld_setup.s2.run

Would you provide the param to set the grounding model and main generation model in config()?

Thanks.

[alckasoc]

Hi @GeorgeCarpenter , I modified it to include the parameters. Please take a look.

[GeorgeCarpenter]

I have fix the bug and contribute a pull request.

#68