qidZddlmZmZmZddlmZddlmZm Z m Z m Z GddeZ GddeZ Gd d e ZGd d e ZGd de ZGdde ZeezezezZGddeZy)zAssemblyAI WebSocket API message models and connection parameters. This module defines Pydantic models for handling AssemblyAI's real-time transcription WebSocket messages and connection configuration. )ListLiteralOptional)logger) BaseModel ConfigDictFieldmodel_validatorcXeZdZUdZeed<eed<eed<eed<eddZ e ed<y ) WordaxRepresents a single word in a transcription with timing and confidence. Parameters: start: Start time of the word in milliseconds. end: End time of the word in milliseconds. text: The transcribed word text. confidence: Confidence score for the word (0.0 to 1.0). word_is_final: Whether this word is finalized and won't change. startendtext confidence. word_is_final)aliasN) __name__ __module__ __qualname____doc__int__annotations__strfloatr rboolT/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/services/assemblyai/models.pyr r s/ J H I?;M4;rr ceZdZUdZeed<y) BaseMessagezrBase class for all AssemblyAI WebSocket messages. Parameters: type: The message type identifier. typeN)rrrrrrrrrr r %s Irr c:eZdZUdZdZeded<eed<eed<y) BeginMessagezMessage sent when a new session begins. Parameters: type: Always "Begin" for this message type. id: Unique session identifier. expires_at: Unix timestamp when the session expires. Beginr!id expires_atN) rrrrr!rrrrrrrr#r#/s"%D'' $ GOrr#ceZdZUdZedZdZeded<e ed<e ed<e ed<e ed <e ed <e eed <d Zee ed <d Zee ed<ed dZee ed<y ) TurnMessageaMessage containing transcription data for a turn of speech. Parameters: type: Always "Turn" for this message type. turn_order: Sequential number of this turn in the session. turn_is_formatted: Whether the transcript has been formatted. end_of_turn: Whether this marks the end of a speaking turn. transcript: The transcribed text for this turn. end_of_turn_confidence: Confidence score for end-of-turn detection. words: List of individual words with timing and confidence data. language_code: Detected language code (e.g., "es", "fr"). Only present with complete utterances or when end_of_turn is True. language_confidence: Confidence score (0-1) for language detection. Only present with complete utterances or when end_of_turn is True. speaker: Speaker label (e.g., "A", "B"). Only present when speaker_labels is enabled and end_of_turn is True. Maps to 'speaker_label' in JSON response. T)populate_by_nameTurnr! turn_orderturn_is_formatted end_of_turn transcriptend_of_turn_confidencewordsN language_codelanguage_confidence speaker_label)defaultrspeaker)rrrrr model_configr!rrrrrrrr r1rr2r r5rrrr(r(=sy$t4L"D'&/"OO!! :#'M8C='+/%/"4GGXc]Grr(c0eZdZUdZdZeded<eed<y)SpeechStartedMessagezMessage sent when speech is first detected in the audio stream. Parameters: type: Always "SpeechStarted" for this message type. timestamp: Audio timestamp in milliseconds when speech was detected. SpeechStartedr! timestampN)rrrrr!rrrrrrr8r8^s&5D'/ "4Nrr8c:eZdZUdZdZeded<eed<eed<y)TerminationMessageaMessage sent when the session is terminated. Parameters: type: Always "Termination" for this message type. audio_duration_seconds: Total duration of audio processed. session_duration_seconds: Total duration of the session. Terminationr!audio_duration_secondssession_duration_secondsN)rrrrr!rrrrrrr<r<js$$1D'- 0!!##rr<c.eZdZUdZdZeed<dZeded<dZ e e ed<dZ e eed <dZ e eed <dZe eed <dZe eeed <dZe eed <dZeded<dZe eed<dZeed<dZe eed<dZe e ed<eddZy)AssemblyAIConnectionParamsaO Configuration parameters for AssemblyAI WebSocket connection. .. deprecated:: 0.0.105 Use ``settings=AssemblyAISTTSettings(foo=...)`` instead. Parameters: sample_rate: Audio sample rate in Hz. Defaults to 16000. encoding: Audio encoding format. Defaults to "pcm_s16le". end_of_turn_confidence_threshold: Confidence threshold for end-of-turn detection. min_turn_silence: Minimum silence duration when confident about end-of-turn. min_end_of_turn_silence_when_confident: DEPRECATED. Use min_turn_silence instead. max_turn_silence: Maximum silence duration before forcing end-of-turn. keyterms_prompt: List of key terms to guide transcription. Will be JSON serialized before sending. prompt: Optional text prompt to guide the transcription. Only used when speech_model is "u3-rt-pro". speech_model: Select between English, multilingual, and u3-rt-pro models. Defaults to "u3-rt-pro". language_detection: Enable automatic language detection. Only applicable to universal-streaming-multilingual. When enabled, Turn messages include language_code and language_confidence fields. Defaults to None (not sent). format_turns: Whether to format transcript turns. Only applicable to universal-streaming-english and universal-streaming-multilingual models. For u3-rt-pro, formatting is automatic and built-in. Defaults to True. speaker_labels: Enable speaker diarization. When enabled, final transcripts (end_of_turn=True) include a speaker field identifying the speaker (e.g., "Speaker A", "Speaker B"). Defaults to None (not sent). vad_threshold: Voice activity detection confidence threshold. Only applicable to u3-rt-pro. The confidence threshold (0.0 to 1.0) for classifying audio frames as silence. Frames with VAD confidence below this value are considered silent. Increase for noisy environments to reduce false speech detection. Defaults to 0.3 (API default). For best performance when using with external VAD (e.g., Silero), align this value with your VAD's activation threshold to avoid the "dead zone" where AssemblyAI transcribes speech that your VAD hasn't detected yet. Defaults to None (not sent). i> sample_rate pcm_s16le)rC pcm_mulawencodingN end_of_turn_confidence_thresholdmin_turn_silence&min_end_of_turn_silence_when_confidentmax_turn_silencekeyterms_promptprompt u3-rt-pro)zuniversal-streaming-englishz universal-streaming-multilingualrL speech_modellanguage_detectionT format_turnsspeaker_labels vad_thresholdafter)modec|j2tjd|j|j|_|S)zCHandle deprecated min_end_of_turn_silence_when_confident parameter.zThe 'min_end_of_turn_silence_when_confident' parameter is deprecated and will be removed in a future version. Please use 'min_turn_silence' instead.)rHrwarningrG)selfs rhandle_deprecated_paramz2AssemblyAIConnectionParams.handle_deprecated_paramsC  6 6 B NNV  $$,(,(S(S% r)rrrrrBrrrErrFrrrGrHrIrJrrrKrMrNrrOrPrQr rWrrrrArA|s DK2=Hg./=8<$huo<&*hsm*<@*HSM@&*hsm*+/OXd3i(/ FHSM  'V*.-L$%)NHTN)%)M8E?)'" # rrAN)rtypingrrrlogururpydanticrrr r r r r#r(r8r< AnyMessagerArrrr\s +*BB<9<$) ; H+HB ;  $ $K '*> >AS S >>r