🎙️ Audio & Speech Family

Audio & Speech Intelligence APIs

Name: Brainiall Audio & Speech Intelligence
Brand: Brainiall
SKU: audio

Low-latency WebSocket streaming STT, sub-second speaker diarization, biometric voiceprint verification, and automated studio dubbing.

Start free trial

Streaming Speech-to-Text

WSS / POST/v1/audio/stream & /v1/audio/transcribe

Real-time bidirectional WebSocket speech transcription with sub-250ms chunk latency and word-level timing offsets.

Sub-250ms chunk latency with WebSocket streaming protocol
Word-level timestamps with punctuate-and-capitalize normalization
Multilingual acoustic coverage across 99 spoken languages

ProtocolWebSocket / HTTP

Latency P95< 250ms

Audio InputsPCM, WAV, Opus, MP3

WebSocket Audio StreamNode.js / Browser

const ws = new WebSocket("wss://api.brainiall.com/v1/audio/stream", {
  headers: { Authorization: `Bearer ${API_KEY}` }
});

ws.send(JSON.stringify({ config: { language: "en", interim_results: true } }));
audioSource.on("data", (chunk) => ws.send(chunk));

ws.on("message", (data) => {
  const result = JSON.parse(data);
  console.log("Transcript:", result.text, "Confidence:", result.confidence);
});

Speaker Diarization

POST/v1/audio/diarize

Segment multi-speaker meetings and calls into distinct conversational turns with sub-second boundary precision.

Accurate “who spoke when” segmentation with sub-second boundaries
Handles overlapping speech, interruptions, and variable speaker counts
Emits structured turns with speaker labels (SPEAKER_00, SPEAKER_01) and time ranges

Speaker LimitUp to 24 speakers

Accuracy DER< 9.2% on AMI test

POST /v1/audio/diarizecURL

curl -X POST https://api.brainiall.com/v1/audio/diarize \
  -H "Authorization: Bearer $BRAINIALL_KEY" \
  -F "audio=@meeting_record.wav" \
  -F "num_speakers=2"

# Response:
# {
#   "segments": [
#     { "speaker": "SPEAKER_00", "start": 0.0, "end": 4.12, "text": "Good morning team." },
#     { "speaker": "SPEAKER_01", "start": 4.25, "end": 8.70, "text": "Morning, let us review Q3." }
#   ]
# }

Voice ID & Verification

POST/v1/audio/voice-id/verify & identify

Biometric 1:1 speaker verification and 1:N voiceprint identification resilient to background acoustic noise.

Biometric 1:1 voice verification against enrolled voiceprints
1:N speaker identification over millions of customer profile vectors
Text-independent acoustic embeddings resilient to background acoustic noise

Enrollment Time3 to 5 seconds audio

EER< 0.9% on VoxCeleb1

POST /v1/audio/voice-id/verifycURL

curl -X POST https://api.brainiall.com/v1/audio/voice-id/verify \
  -H "Authorization: Bearer $BRAINIALL_KEY" \
  -F "user_id=usr_8921" \
  -F "audio=@auth_sample.wav"

# Response:
# { "match": true, "similarity": 0.942, "threshold": 0.85, "verified": true }

Audio Enhancement & Denoise

POST/v1/audio/enhance

Studio vocal isolation, HVAC/reverb elimination, and 48 kHz dynamic range restoration for broadcast clarity.

Suppresses HVAC, keyboard clicks, traffic rumble, and background chatter
Removes room reverberation for clean, up-front vocal presence
Outputs broadcast-ready 48 kHz normalized audio

POST /v1/audio/enhancecURL

curl -X POST https://api.brainiall.com/v1/audio/enhance \
  -H "Authorization: Bearer $BRAINIALL_KEY" \
  -F "audio=@noisy_mic.wav" \
  -F "dereverb=true" \
  --output enhanced_studio.wav

Automated Dubbing

POST/v1/audio/dub

Multilingual video and podcast dubbing with vocal identity retention and automatic lip-sync pacing alignment.

End-to-end automated video and podcast dubbing into 40+ languages
Preserves original vocal tone, emotion, and speaker identity across languages
Automatic timestamp duration alignment with video lip-sync pacing

POST /v1/audio/dubcURL

curl -X POST https://api.brainiall.com/v1/audio/dub \
  -H "Authorization: Bearer $BRAINIALL_KEY" \
  -F "video=@course_video.mp4" \
  -F "target_language=es" \
  -F "voice_match=true" \
  --output dubbed_spanish.mp4

Speech-to-Speech Translation

POST/v1/audio/speech-to-speech

Translate spoken voice directly into target spoken audio in a single streaming pipeline pass.

Spoken audio in, translated spoken audio out in a single orchestrated pass
Streaming audio translation without intermediate text roundtrips

POST /v1/audio/speech-to-speechcURL

curl -X POST https://api.brainiall.com/v1/audio/speech-to-speech \
  -H "Authorization: Bearer $BRAINIALL_KEY" \
  -F "audio=@english_query.wav" \
  -F "source_lang=en" \
  -F "target_lang=pt-br" \
  --output translated_speech.wav

Speech Suite Pro Pipeline

POST/v1/audio/pipeline

Unified multi-capability pipeline combining transcription, diarization, translation, and PII redaction in one call.

Complete turnkey pipeline: Transcription + Diarization + PII Redaction + Translation in one call
Saves up to 40% in latency and compute overhead vs chaining individual APIs

POST /v1/audio/pipelinecURL

curl -X POST https://api.brainiall.com/v1/audio/pipeline \
  -H "Authorization: Bearer $BRAINIALL_KEY" \
  -F "audio=@call_center.wav" \
  -F "features=transcribe,diarize,redact_pii,translate" \
  -F "target_lang=es"