Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multi modal image types #375

Merged
merged 3 commits into from
Jan 22, 2025
+4 −4
Merged

Multi modal image types #375

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
55df3ff
Updating documentation for the multimodal embedding file types.
Jan 21, 2025
b5fe89a
Updating documentation for the multimodal embedding file types.
Jan 21, 2025
6317dda
Merge branch 'main' into multi-modal-image-types
trentfowlercohere Jan 22, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions fern/pages/text-embeddings/embeddings.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -91,15 +91,15 @@ print(embeddings[0][:5]) # Print embeddings for the first text

## Image Embeddings

The Cohere embedding platform supports image embeddings for the entire of `embed-v3.0` family. This functionality can be utilized with the following steps:
The Cohere embedding platform supports image embeddings for the entire `embed-v3.0` family. This functionality can be utilized with the following steps:

- Pass `image` to the `input_type` parameter (as discussed above).
- Pass your image URL to the new `images` parameter.

Be aware that image embedding has the following restrictions:

- If `input_type='image'`, the `texts` field must be empty.
- The original image file type must be `png` or `jpeg`.
- The original image file type must be in a `png`, `jpeg`, `webp`, or `gif` format and can be up to 5 MB in size.
- The image must be base64 encoded and sent as a Data URL to the `images` parameter.
- Our API currently does not support batch image embeddings.

Expand Down
4 changes: 2 additions & 2 deletions fern/pages/v2/text-embeddings/embeddings.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -93,15 +93,15 @@ print(embeddings[0][:5]) # Print embeddings for the first text

## Image Embeddings

The Cohere embedding platform supports image embeddings for the entire of `embed-v3.0` family. This functionality can be utilized with the following steps:
The Cohere embedding platform supports image embeddings for the entire `embed-v3.0` family. This functionality can be utilized with the following steps:

- Pass `image` to the `input_type` parameter (as discussed above).
- Pass your image URL to the new `images` parameter.

Be aware that image embedding has the following restrictions:

- If `input_type='image'`, the `texts` field must be empty.
- The original image file type must be `png` or `jpeg`.
- The original image file type must be in a `png`, `jpeg`, `webp`, or `gif` format and can be up to 5 MB in size.
- The image must be base64 encoded and sent as a Data URL to the `images` parameter.
- Our API currently does not support batch image embeddings.

Expand Down
Loading