qi#-dZddlZddlmZddlmZmZmZddlm Z ddl m Z m Z m Z mZmZmZmZddlmZddlmZmZdd lmZdd lmZdd lmZdd lmZdd lm Z  ddl!m"Z"m#Z#m$Z$m%Z%ddl&m'Z'm(Z(ddl)m*Z*eGddeZ/GddeZ0y#e+$r7Z,e jZde,e jZde.de,dZ,[,wwxYw)zAzure Speech-to-Text service implementation for Pipecat. This module provides speech-to-text functionality using Azure Cognitive Services Speech SDK for real-time audio transcription. N) dataclass)AnyAsyncGeneratorOptional)logger) CancelFrameEndFrame ErrorFrameFrameInterimTranscriptionFrame StartFrameTranscriptionFramelanguage_to_azure_language) STTSettings_warn_deprecated_param)AZURE_TTFS_P99) STTService)Language)time_now_iso8601) traced_stt)CancellationReason ResultReason SpeechConfigSpeechRecognizer)AudioStreamFormatPushAudioInputStream) AudioConfigz Exception: zCIn order to use Azure, you need to `pip install pipecat-ai[azure]`.zMissing module: ceZdZdZy)AzureSTTSettingszSettings for AzureSTTService.N)__name__ __module__ __qualname____doc__L/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/services/azure/stt.pyr r 6s'r&r cteZdZUdZeZeed<dejdddde dde de e de ede e d e e d e e d e ed e e ffd ZdefdZdede e fdZdedee efffd ZdedeedffdZdeffd Zdeffd Zdeffd ZdZ dZ!e" d!de dede efdZ#dZ$dZ%d Z&xZ'S)"AzureSTTServicea"Azure Speech-to-Text service for real-time audio transcription. This service uses Azure Cognitive Services Speech SDK to convert speech audio into text transcriptions. It supports continuous recognition and provides real-time transcription results with timing information. _settingsN)regionlanguage sample_rateprivate_endpoint endpoint_idsettingsttfs_p99_latencyapi_keyr+r,r-r.r/r0r1c 4tdttj} |4|tjk7r!t dtdt|| _|| j |t | d ||| d| | j xsttj} |s |s td|r+|rtjdt||| |_ nt||| |_ |r||j_d|_d|_y) aInitialize the Azure STT service. Args: api_key: Azure Cognitive Services subscription key. region: Azure region for the Speech service (e.g., 'eastus'). Required unless ``private_endpoint`` is provided. language: Language for speech recognition. Defaults to English (US). .. deprecated:: 0.0.105 Use ``settings=AzureSTTSettings(language=...)`` instead. sample_rate: Audio sample rate in Hz. If None, uses service default. private_endpoint: Private endpoint for STT behind firewall. See https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-services-private-link?tabs=portal endpoint_id: Custom model endpoint id. settings: Runtime-updatable settings. When provided alongside deprecated parameters, ``settings`` values take precedence. ttfs_p99_latency: P99 latency from speech end to final transcript in seconds. Override for your deployment. See https://github.com/pipecat-ai/stt-benchmark **kwargs: Additional arguments passed to parent STTService. N)modelr,r,)r-r1r0z7Either 'region' or 'private_endpoint' must be provided.zHBoth 'region' and 'private_endpoint' provided; 'region' will be ignored.) subscriptionendpointspeech_recognition_language)r5r+r7r%)r rrEN_USrr, apply_updatesuper__init__ ValueErrorrwarningr_speech_configr/ _audio_stream_speech_recognizer) selfr2r+r,r-r.r/r0r1kwargsdefault_settingsrecognition_language __class__s r'r;zAzureSTTService.__init__Hs'F,/?   H$> ":/? L(B8(L  %    ) )( 3  #-%    088 r7r? _disconnect_connect)rArLchangedrEs r'rNz AzureSTTService._update_settingss077  ''U+Ehnn+U    ;!!&&(((mmo%%8)%s4B#BA'B#>B?B#B!B#B#!B#audiocK |jd{|jr|jj|dy71#t$r}t d|Yd}~yd}~wwxYww)aoProcess audio data for speech-to-text conversion. Feeds audio data to the Azure speech recognizer for processing. Recognition results are handled asynchronously through callbacks. Args: audio: Raw audio bytes to process. Yields: Frame: Either None for successful processing or ErrorFrame on failure. NzUnknown error occurred: )error)start_processing_metricsr?write Exceptionr )rArRes r'run_sttzAzureSTTService.run_sttsn C//1 1 1!!""((/J 2 C%=aS#AB B B Cs>A3A A 0A A3 A A0A+&A3+A00A3framectKt||d{|jd{y77w)zzStart the speech recognition service. Args: frame: Frame indicating the start of processing. N)r:startrPrArZrEs r'r\zAzureSTTService.starts3 gmE"""mmo #848688ctKt||d{|jd{y77w)zwStop the speech recognition service. Args: frame: Frame indicating the end of processing. N)r:stoprOr]s r'r`zAzureSTTService.stops6 gl5!!!    " r^ctKt||d{|jd{y77w)zpCancel the speech recognition service. Args: frame: Frame indicating cancellation. N)r:cancelrOr]s r'rbzAzureSTTService.cancels6 gnU###    $ r^cK|jry t|jd}t||_t |j}t |j ||_|jjj|j|jjj|j|jjj|j|jjy#t $r)}|j#d||d{7Yd}~yd}~wwxYww)zHInitialize the Azure speech recognizer and begin continuous recognition.N)samples_per_secondchannels)stream) speech_config audio_configz*Uncaught exception during initialization: ) error_msg exception)r?rr-rrrr>r@ recognizingconnect_on_handle_recognizing recognized_on_handle_recognizedcanceled_on_handle_canceled"start_continuous_recognition_asyncrW push_error)rA stream_formatrirXs r'rPzAzureSTTService._connects      -AQAQ\]^M!5m!DD &d.@.@AL&6"11 'D #  # # / / 7 78S8S T  # # . . 6 6t7Q7Q R  # # , , 4 4T5M5M N  # # F F H //FqcJVW"   s;EDDE ED?4D75D?:E?EEcK|jr!|jjd|_|jr"|jjd|_yyw)z)Stop recognition and close audio streams.N)r@!stop_continuous_recognition_asyncr?closerHs r'rOzAzureSTTService._disconnectsQ  " "  # # E E G&*D #       $ $ &!%D  sAA transcriptis_finalc@K|jd{y7w)z+Handle a transcription result with tracing.N)stop_processing_metrics)rAryrzr,s r'_handle_transcriptionz%AzureSTTService._handle_transcriptions **,,,s c^|jjtjk(rt |jj dkDrt |jddxs|jj}t|jj |jt||}tj|j|jj d||jtj|j!||jyyy)Nrr,resultT)rreasonrRecognizedSpeechlentextgetattrr*r,r_user_idrasynciorun_coroutine_threadsafer}get_event_loop push_framerAeventr,rZs r'rpz%AzureSTTService._on_handle_recognizeds <<  ,"?"? ?C HYHYDZ]^D^u||Z>Y$..BYBYH& !!  " E  , ,**5<<+<+Y$..BYBYH- !!  " E  , ,T__U-CTEXEXEZ [F` @r&c.|jj}|jtjk(rbd|j}|j r|d|j z }t j|j||jyy)Nz Azure STT recognition canceled: z - )rj) rcancellation_detailsrrError error_detailsrrrtr)rArdetailsrjs r'rrz#AzureSTTService._on_handle_canceled3s,,33 >>/55 5:7>>:JKI$$s7#8#8"9::  , ,)4d6I6I6K  6r&)N)(r!r"r#r$r Settings__annotations__rr8rstrrintfloatr;boolrIrKrdictrrNbytesrr rYr r\r r`rrbrPrOrr}rprnrr __classcell__)rEs@r'r)r)=s~ H !%'/~~%)*.%)/3,:V'V' V' 8$ V' c] V'#3-V'c]V'+,V'#5/V'pd 4X 4(3- 4 K DcN C5C^E4K-HC(!!!+!.&NR--)--9A(9K-- \ \r&r))1r$r dataclassesrtypingrrrlogururpipecat.frames.framesrr r r r r rpipecat.services.azure.commonrpipecat.services.settingsrrpipecat.services.stt_latencyrpipecat.services.stt_servicerpipecat.transcriptions.languagerpipecat.utils.timer(pipecat.utils.tracing.service_decoratorsrazure.cognitiveservices.speechrrrr$azure.cognitiveservices.speech.audiorr%azure.cognitiveservices.speech.dialogrModuleNotFoundErrorrXrTrWr r)r%r&r'rs !00EI734/?, B  {   ~j~,FLL;qc"#FLLVW &qc* ++,sBC2C  C