Skip to content

New gpt-image-1 model for openai_conversation.generate_image action #143975

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 5 commits into
base: dev
Choose a base branch
from

Conversation

Shulyaka
Copy link
Contributor

@Shulyaka Shulyaka commented Apr 30, 2025

Proposed change

  1. Latest image model gpt-image-1 for openai_conversation.generate_image action. Blog post: https://openai.com/index/image-generation-api, API reference: https://platform.openai.com/docs/api-reference/images/create
  2. Updated action parameters to support the new model features.
  3. The action parameters are backwards compatible, but a repair issue is created if deprecated parameters are used.
  4. Because OpenAI requires verification for some users to use gpt-image-1, the PR implements a fallback to the current dall-e-3 model. A repair issue is created in this case to let the user know about the verification. We will remove this failover if/when OpenAI opens full access to gpt-image-1
  5. The images are now saved in local media files, and the url that the action returns is now a HA url instead of an OpenAI-hosted url.

Type of change

  • Dependency upgrade
  • Bugfix (non-breaking change which fixes an issue)
  • New integration (thank you!)
  • New feature (which adds functionality to an existing integration)
  • Deprecation (breaking change to happen in the future)
  • Breaking change (fix/feature causing existing functionality to break)
  • Code quality improvements to existing code or addition of tests

Additional information

Checklist

  • The code change is tested and works locally.
  • Local tests pass. Your PR cannot be merged unless tests pass
  • There is no commented out code in this PR.
  • I have followed the development checklist
  • I have followed the perfect PR recommendations
  • The code has been formatted using Ruff (ruff format homeassistant tests)
  • Tests have been added to verify that the new code works.

If user exposed functionality or configuration variables are added/changed:

If the code communicates with devices, web services, or third-party tools:

  • The manifest file has all fields filled out correctly.
    Updated and included derived files by running: python3 -m script.hassfest.
  • New or updated dependencies have been added to requirements_all.txt.
    Updated by running python3 -m script.gen_requirements_all.
  • For the updated dependencies - a link to the changelog, or at minimum a diff between library versions is added to the PR description.

To help with the load of incoming pull requests:

@home-assistant
Copy link

Hey there @balloob, mind taking a look at this pull request as it has been labeled with an integration (openai_conversation) you are listed as a code owner for? Thanks!

Code owner commands

Code owners of openai_conversation can trigger bot actions by commenting:

  • @home-assistant close Closes the pull request.
  • @home-assistant rename Awesome new title Renames the pull request.
  • @home-assistant reopen Reopen the pull request.
  • @home-assistant unassign openai_conversation Removes the current integration label and assignees on the pull request, add the integration domain after the command.
  • @home-assistant add-label needs-more-information Add a label (needs-more-information, problem in dependency, problem in custom component) to the pull request.
  • @home-assistant remove-label needs-more-information Remove a label (needs-more-information, problem in dependency, problem in custom component) on the pull request.

@Shulyaka Shulyaka marked this pull request as ready for review April 30, 2025 16:46
@Shulyaka Shulyaka requested a review from balloob as a code owner April 30, 2025 16:46
@Shulyaka
Copy link
Contributor Author

Prompt: A realistic picture of a smart home controlled by Home Assistant. Please show some smart devices and Home Assistant control panel.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants