Introducing Realtime Voice Chat
Samuel Su
on October 20, 2024We're excited to roll out Realtime Voice Chat, a groundbreaking feature that lets your chatbot communicate just like a real person! With this update, users can engage in natural voice conversations, making interactions faster, more engaging, and more intuitive.
š Available on Standard and Above Plans
š§ How to Enable Realtime Voice Chat
Realtime Voice Chat is not enabled by default due to its high resource costs. To activate it:
1ļøā£ Go to Settings > Realtime Audio.
2ļøā£ Choose the voice avatar that appears in the chatbot.
3ļøā£ Set a default voice (users can change this later).
4ļøā£ Preview available voices before selecting.
šļø Realtime Voice Chat Features
- ā Audio Playback in Chat Logs
- By default, original voice interactions are stored and available in the Chat Logs Dashboard for review.
- Disabling this option will store only text transcripts (generated by OpenAI's Whisper model).
āļø Adjustable Voice Chat Parameters
Fine-tune voice interaction settings for a seamless experience:
- Threshold ā Adjust voice activity detection sensitivity.
- Prefix Padding ā Set how much audio before speech recognition is included.
- Silence Duration ā Define when the chatbot considers speech to have ended.
- RAG Limit ā Control how much context is retrieved per message to optimize costs.
Users can also change voices dynamically via the voice selection overlay. š Multi-language support is available!
š° Cost & Pricing
Voice-based interactions are processed through OpenAI's realtime API, which is more resource-intensive than text-based queries.
š Cost Optimization Tip:
- By default, the chatbot retrieves 10 RAG text chunks (~3,000 tokens). Lowering this to 5 chunks reduces costs.
- gpt-4-realtime-min-preview is more cost-effective than gpt-4o-mini, averaging 1 credit per message.
- Messages without context retrieval cost ~10 credits, while those with context retrieval cost 30-40 credits.
š View Credit Usage:
You can check cost per message in the Chat Logs dashboard by hovering over the question mark icon.
š Lead Information Collection
With Realtime Voice Chat, lead collection is fully automated! šÆ
- The chatbot can extract and store user details like name, phone number, and email directly from conversations.
- This data is synced to your leads dashboard, webhooks, and CRM.
- The chatbot remembers lead information for future conversations, even after a page refresh.
š” Customize Data Collection:
Modify the chatbot's base prompt to gather user details before providing further service.
š Get Started Today!
1ļøā£ Enable Realtime Voice Chat from the Settings page.
2ļøā£ Fine-tune parameters for cost efficiency and accuracy.
3ļøā£ Enjoy natural voice conversations with automated lead capture!
š Experience a truly conversational AI with Realtime Voice Chat today!
Check the Realtime Voice Chat page for more details.