Build Hour: GPT-Realtime-2

Author: OpenAI - Bewertung: 37x - Views:690

Build with the next wave of realtime voice AI. In this Build Hour, you’ll learn how to use GPT-Realtime-2, GPT-Realtime-Translate, and GPT-Realtime-Whisper to build low-latency voice agents that can translate live speech, reason across tools, operate apps, and support more natural voice-to-voice and voice-to-action experiences.

In this session, Teri Yu (Product) and Erika Kettleson (Solutions Engineering) will cover:
• Building with new realtime audio models for translation, streaming speech-to-text, and intelligent voice agents
• Using GPT-Realtime-2 capabilities like preambles, 128K context, parallel tool calling, domain understanding, context over turns, and controllable expressiveness
• Creating voice-powered workflows for shopping and product analytics dashboards
• Customer Spotlight on how Sierra (https://sierra.ai/) is designing production customer experience agents with guardrails, VAD tuning, tracing, redaction, evals, and customer-specific harnesses.


👉 Realtime Voice Blog: https://openai.com/index/advancing-voice-intelligence-with-new-models-in-the-api/
👉 Voice Agents Docs: https://developers.openai.com/api/docs/guides/voice-agents
👉 Playground: https://platform.openai.com/audio/realtime
👉 Follow along with the code repo: http://github.com/openai/build-hours
👉 Sign up for upcoming live Build Hours: https://webinar.openai.com/buildhours

00:00 Welcome and intro
02:06 Realtime voice models overview
02:26 GPT-Realtime-Translate and GPT-Realtime-Whisper demo
04:36 GPT-Realtime-2: three ways to build with voice AI
05:14 What’s new in GPT-Realtime-2
06:58 Demo: Voice-powered search agent
12:32 Demo: Product analytics dashboard
17:24 What can you build with voice AI?
18:36 Customer spotlight: Sierra
29:56 Q&A
42:05 Resources & Upcoming Build Hours