Your organization must be verified ... error message o3 (16apr) model

[weipienlee]

What happened?

get weird verification message (see log below) while no problems with LangChain.

Version Information

docker images | grep librechat
ghcr.io/danny-avila/librechat-dev latest 0fcd67e41a63 4 weeks ago 872MB

git rev-parse HEAD
4d04904

Steps to Reproduce

1. select o3 model (OpenAI or Azure endpoint)
2. send "hi"

What browsers are you seeing the problem on?

No response

Relevant log output

2025-04-16 23:19:50 error: [handleAbortError] AI response error; aborting request: 400 Your organization must be verified to stream this model. Please go to: https://platform.openai.com/settings/organization/general⁠ and click on Verify Organization.

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[wipash]

It's an OpenAI requirement: https://help.openai.com/en/articles/10910291-api-organization-verification

[weipienlee]

ah, guess you use streaming while i only tested langchain invoke. nvm

[weipienlee]

confirmed langchain stream api indeed needs verification of o3.
however, o4-mini can be streamed if not asking for reasoning summary:

model = "o4-mini"; temperature=1

reasoning = {
    "effort": "low",  # 'low', 'medium', or 'high'
    # "summary": "auto",  # 'detailed', 'auto', or None
}

llm = ChatOpenAI(
    model=model,
    temperature=temperature,
    use_responses_api=True,
    model_kwargs={"reasoning": reasoning},
)

LangChain AzureOpenAI client doesn't support these extra parameters.

[iGerman00]

@danny-avila do you plan on adding support for turning off streaming to mitigate this? or do we have to wait until Responses API support is implemented?

[danny-avila]

It looks like o3 verification is indeed required for streaming and non-streaming does not.

Maybe something better would be a toggle for streaming

https://community.openai.com/t/need-verification-for-o3-streaming-despite-being-tier-5/1230334/5

[weipienlee]

would great, a pity that everything will become "walled".

[Odrec]

We're also getting this error even though our organization is verified.

[weipienlee]

have you tried it with your own code eg langchain and it’s (event-)steaming api?

[Odrec]

Hmmm I'll do that soon.

[Odrec]

It was a layer 8 problem :D thx @weipienlee

[weipienlee]

Not sure what that means, curious though. In any case, you're welcome:)

[usnavy13]

How do we verify is were using o3 through azure?

[weipienlee]

what do you mean, you config it via the the librechat.yaml, right? Really stupid way is to change its deployment name and see if your code/app breaks.

However, I suspect that in some edge cases, LibreChat is not using the model that is selected.