Skip to content

VAP-9999 Sesame Voice Cloning #322

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 22, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 13 additions & 4 deletions fern/providers/voice/sesame.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,12 @@ slug: providers/voice/sesame

**What is Sesame CSM-1B?**

Sesame CSM-1B is an open source text-to-speech (TTS) model that Vapi hosts for seamless integration into your voice applications. Currently in beta, this model delivers natural-sounding speech synthesis with a single default voice option.
Sesame CSM-1B is an open source text-to-speech (TTS) model that Vapi hosts for seamless integration into your voice applications. This model delivers natural-sounding speech synthesis with a default voice option and voice cloning capabilities.

**Key Features:**

- **Vapi-Hosted Solution**: Access this open source model directly through Vapi without managing your own infrastructure
- **Single Default Voice**: Currently offers one voice option optimized for clarity and naturalness
- **Beta Release**: Early access to this emerging TTS technology
- **Voice Options**: Offers a default voice and voice cloning capabilities

**Integration Benefits:**

Expand All @@ -27,6 +26,16 @@ Sesame CSM-1B is an open source text-to-speech (TTS) model that Vapi hosts for s
- Interactive voice applications
- Prototyping voice-driven experiences

**Voice Cloning:**

![Sesame Voice Cloning](/static/images/voice-tab/sesame/cloning.png)

Sesame supports voice cloning. To clone a voice:
1. Navigate to the additional configuration tab (below the voice tab) on the assistants page
2. Upload a WAV file containing your voice sample
3. Provide the transcript of the audio file
4. Name your custom voice

**Current Limitations:**

As this is a beta release, the model currently offers limited customization options with only one default voice available. Additional features and voice options may be introduced in future updates.
The model currently has some limitations. Additional features may be introduced in future updates.
Binary file added fern/static/images/voice-tab/sesame/cloning.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.