Podcast Generation with Microsoft Foundry

Generate AI-powered podcast-style audio narratives using Azure OpenAI's GPT Realtime Mini model via WebSocket. Use when building text-to-speech features, audio narrative generation, podcast creation f

Popular

Join 2,534+ developers using this skill

skill

Creative & Media

advanced

2,534 installs

View Source

Last updated: April 29, 2026

AI Skill Market Insights

Real data. Real impact.

Popularity

Top 50%

Growing

Active Users

2,534+

Developers

Quick Start

Manual Installation

No automatic installation available. Please visit the source repository for installation instructions.

View Installation Instructions

TEAR & SHARE

3-5hrs/WK

RISING

2.5K+ USING

Podcast Generation with GPT Realtime Mini

Generate real audio narratives from text content using Azure OpenAI's Realtime API.

Quick Start

Configure environment variables for Realtime API
Connect via WebSocket to Azure OpenAI Realtime endpoint
Send text prompt, collect PCM audio chunks + transcript
Convert PCM to WAV format
Return base64-encoded audio to frontend for playback

Environment Configuration

AZURE_OPENAI_AUDIO_API_KEY=your_realtime_api_key
AZURE_OPENAI_AUDIO_ENDPOINT=https://your-resource.cognitiveservices.azure.com
AZURE_OPENAI_AUDIO_DEPLOYMENT=gpt-realtime-mini

Note: Endpoint should NOT include

/openai/v1/

- just the base URL.

Core Workflow

Backend Audio Generation

from openai import AsyncOpenAI
import base64
Convert HTTPS endpoint to WebSocket URL
ws_url = endpoint.replace("https://", "wss://") + "/openai/v1"
client = AsyncOpenAI(
websocket_base_url=ws_url,
api_key=api_key
)
audio_chunks = []
transcript_parts = []
async with client.realtime.connect(model="gpt-realtime-mini") as conn:
# Configure for audio-only output
await conn.session.update(session={
"output_modalities": ["audio"],
"instructions": "You are a narrator. Speak naturally."
})
# Send text to narrate
await conn.conversation.item.create(item={
    &quot;type&quot;: &quot;message&quot;,
    &quot;role&quot;: &quot;user&quot;,
    &quot;content&quot;: [{&quot;type&quot;: &quot;input_text&quot;, &quot;text&quot;: prompt}]
})

await conn.response.create()

# Collect streaming events
async for event in conn:
    if event.type == &quot;response.output_audio.delta&quot;:
        audio_chunks.append(base64.b64decode(event.delta))
    elif event.type == &quot;response.output_audio_transcript.delta&quot;:
        transcript_parts.append(event.delta)
    elif event.type == &quot;response.done&quot;:
        break

Convert PCM to WAV (see scripts/pcm_to_wav.py)
pcm_audio = b''.join(audio_chunks)
wav_audio = pcm_to_wav(pcm_audio, sample_rate=24000)

Frontend Audio Playback

// Convert base64 WAV to playable blob
const base64ToBlob = (base64, mimeType) => {
  const bytes = atob(base64);
  const arr = new Uint8Array(bytes.length);
  for (let i = 0; i < bytes.length; i++) arr[i] = bytes.charCodeAt(i);
  return new Blob([arr], { type: mimeType });
};
const audioBlob = base64ToBlob(response.audio_data, 'audio/wav');
const audioUrl = URL.createObjectURL(audioBlob);
new Audio(audioUrl).play();

Voice Options

Voice	Character
alloy	Neutral
echo	Warm
fable	Expressive
onyx	Deep
nova	Friendly
shimmer	Clear

Realtime API Events

```
response.output_audio.delta
```
- Base64 audio chunk
```
response.output_audio_transcript.delta
```
- Transcript text
```
response.done
```
- Generation complete
```
error
```
- Handle with
```
event.error.message
```

Audio Format

Input: Text prompt
Output: PCM audio (24kHz, 16-bit, mono)
Storage: Base64-encoded WAV

References

Full architecture: See references/architecture.md for complete stack design
Code examples: See references/code-examples.md for production patterns
PCM conversion: Use scripts/pcm_to_wav.py for audio format conversion

Podcast Generation with Microsoft Foundry

AI Skill Market Insights

Quick Start

Manual Installation

TEAR & SHARE

Tags

Chart MCP Server

Be Part of the 2,534+ Developer Community

Podcast Generation with GPT Realtime Mini

Quick Start

Environment Configuration

Core Workflow

Backend Audio Generation

Convert HTTPS endpoint to WebSocket URL

Convert PCM to WAV (see scripts/pcm_to_wav.py)

Frontend Audio Playback

Voice Options

Realtime API Events

Audio Format

References

Heddy IP — Brand Illustration

KiCad MCP Server

Shadcn UI MCP Server

Douyin MCP Server

Channels

Learn

Compare

Company

Agents