Local speech-to-text with NVIDIA Parakeet TDT 0.6B v3 (ONNX on CPU). 30x faster than Whisper, 25 languages, auto-detection, OpenAI-compatible API. Use when transcribing audio files, converting speech
Real data. Real impact.
Emerging
Developers
Per week
Open source
Skills give you superpowers. Install in 30 seconds.
Local transcription using NVIDIA Parakeet TDT 0.6B v3 with ONNX Runtime. Runs on CPU — no GPU required. ~30x faster than realtime.
# Clone the repo git clone https://github.com/groxaxo/parakeet-tdt-0.6b-v3-fastapi-openai.git cd parakeet-tdt-0.6b-v3-fastapi-openaiRun with Docker (recommended)
docker compose up -d parakeet-cpu
Or run directly with Python
pip install -r requirements.txt uvicorn app.main:app --host 0.0.0.0 --port 5000
Default port is
5000PARAKEET_URLhttp://localhost:5092OpenAI-compatible API at
$PARAKEET_URLhttp://localhost:5000# Transcribe audio file (plain text) curl -X POST $PARAKEET_URL/v1/audio/transcriptions \ -F "file=@/path/to/audio.mp3" \ -F "response_format=text"Get timestamps and segments
curl -X POST $PARAKEET_URL/v1/audio/transcriptions
-F "file=@/path/to/audio.mp3"
-F "response_format=verbose_json"Generate subtitles (SRT)
curl -X POST $PARAKEET_URL/v1/audio/transcriptions
-F "file=@/path/to/audio.mp3"
-F "response_format=srt"
import os from openai import OpenAIclient = OpenAI( base_url=os.getenv("PARAKEET_URL", "http://localhost:5000") + "/v1", api_key="not-needed" )
with open("audio.mp3", "rb") as f: transcript = client.audio.transcriptions.create( model="parakeet-tdt-0.6b-v3", file=f, response_format="text" ) print(transcript)
| Format | Output |
|---|---|
| Plain text |
| |
| Segments with timestamps and words |
| SRT subtitles |
| WebVTT subtitles |
English, Spanish, French, German, Italian, Portuguese, Polish, Russian, Ukrainian, Dutch, Swedish, Danish, Finnish, Norwegian, Greek, Czech, Romanian, Hungarian, Bulgarian, Slovak, Croatian, Lithuanian, Latvian, Estonian, Slovenian
Language is auto-detected — no configuration needed.
Open
$PARAKEET_URL# Check status docker ps --filter "name=parakeet"View logs
docker logs -f <container-name>
Restart
docker compose restart
Stop
docker compose down
No automatic installation available. Please visit the source repository for installation instructions.
View Installation Instructions
1,500+ AI skills, agents & workflows. Install in 30 seconds. Part of the Torly.ai family.
© 2026 Torly.ai. All rights reserved.