qi3@dZddlZddlZddlmZmZddlmZmZm Z ddl m Z ddl m Z ddlmZmZmZmZmZmZmZddlmZdd lmZmZmZmZdd lmZdd lm Z dd l!m"Z"m#Z#dd l$m%Z%ddl&m'Z' ddl(m)Z*ddl+m,Z,dZ1de"de e2fdZ3eGddeZ4Gdde Z5y#e-$r7Z.e j^de.e j^de0de.dZ.[.wwxYw)zGradium's speech-to-text service implementation. This module provides integration with Gradium's real-time speech-to-text WebSocket API for streaming audio transcription. N) dataclassfield)AnyAsyncGeneratorOptional)logger) BaseModel) CancelFrameEndFrameFrame StartFrameTranscriptionFrameVADUserStartedSpeakingFrameVADUserStoppedSpeakingFrame)FrameDirection) NOT_GIVEN STTSettings _NotGiven_warn_deprecated_param)GRADIUM_TTFS_P99)WebsocketSTTService)Languageresolve_language)time_now_iso8601) traced_stt)connect)Statez Exception: zIIn order to use Gradium, you need to `pip install "pipecat-ai[gradium]"`.zMissing module: i]languagereturnc tjdtjdtjdtjdtj di}t ||dS)zConvert a Language enum to Gradium's language code format. Args: language: The Language enum value to convert. Returns: The Gradium language code string or None if not supported. deenesfrptT) use_base_code)rDEENESFRPTr)r LANGUAGE_MAPs N/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/services/gradium/stt.pylanguage_to_gradium_languager.1sI  T T T T T L Hl$ GGc<eZdZUdZedZeeeze d<y)GradiumSTTSettingsa^Settings for GradiumSTTService. Parameters: delay_in_frames: Delay in audio frames (80ms each) before text is generated. Higher delays allow more context but increase latency. Allowed values: 7, 8, 10, 12, 14, 16, 20, 24, 36, 48. Default is 10 (800ms). Lower values like 7-8 give faster response. ctSN)rr/r-zGradiumSTTSettings.Psyr/)default_factorydelay_in_framesN) __name__ __module__ __qualname____doc__rr7rintr__annotations__r4r/r-r1r1Es"27GX1YOXc]Y.Yr/r1c~eZdZUdZeZeed<GddeZdddde dde d e d e ed e e d e ed e e f fdZ defdZdedee efffd Zdeffd Zdeffd Zdeffd Zdedeffd ZdZdedeedffdZ e!de dede"fdZ#fd Z$d!Z%fd"Z&d#Z'd$Z(d%Z)d&Z*d'Z+d(Z,d)e fd*Z-xZ.S)+GradiumSTTServicezGradium real-time speech-to-text service. Provides real-time speech transcription using Gradium's WebSocket API. Supports both interim and final transcriptions with configurable parameters for audio processing and connection management. _settingsc:eZdZUdZdZeeed<dZee ed<y)GradiumSTTService.InputParamsaConfiguration parameters for Gradium STT API. .. deprecated:: 0.0.105 Use ``settings=GradiumSTTSettings(...)`` instead. Parameters: language: Expected language of the audio (e.g., "en", "es", "fr"). This helps ground the model to a specific language and improve transcription quality. delay_in_frames: Delay in audio frames (80ms each) before text is generated. Higher delays allow more context but increase latency. Allowed values: 7, 8, 10, 12, 14, 16, 20, 24, 36, 48. Default is 10 (800ms). Lower values like 7-8 give faster response. Nrr7) r8r9r:r;rrrr=r7r<r4r/r- InputParamsrB^s& (,(8$+)-#-r/rCz&wss://eu.api.gradium.ai/api/speech/asrN)api_endpoint_base_urlparams json_configsettingsttfs_p99_latencyapi_keyrDrErFrGrHc |ddl}|jdtdtddd} |@t dt|s.|j | _|j |j | _|| j|t |$d t|| d|||_ ||_ d|_ ||_d|_t!|_d |_d|_d|_d|_y) aInitialize the Gradium STT service. Args: api_key: Gradium API key for authentication. api_endpoint_base_url: WebSocket endpoint URL. Defaults to Gradium's streaming endpoint. params: Configuration parameters for language and delay settings. .. deprecated:: 0.0.105 Use ``settings=GradiumSTTSettings(...)`` instead. json_config: Optional JSON configuration string for additional model settings. .. deprecated:: 0.0.101 Use `params` instead for type-safe configuration. settings: Runtime-updatable settings. When provided alongside deprecated parameters, ``settings`` values take precedence. ttfs_p99_latency: P99 latency from speech end to final transcript in seconds. Override for your deployment. See https://github.com/pipecat-ai/stt-benchmark **kwargs: Additional arguments passed to parent STTService class. NrzdParameter 'json_config' is deprecated and will be removed in a future version, use 'params' instead.) stacklevel)modelrr7rE) sample_raterHrGPr4)warningswarnDeprecationWarningr1rrr7 apply_updatesuper__init__ SAMPLE_RATE_api_key_api_endpoint_base_url _websocket _json_config _receive_task bytearray _audio_buffer_chunk_size_ms_chunk_size_bytes_delay_in_frames _frame_size) selfrIrDrErFrGrHkwargsrPdefault_settings __class__s r-rUzGradiumSTTService.__init__qs @  "  MMv"  .     "8-? @,2OO )))57=7M7M$4    ) )( 3  #-%     &;#'!&[ !"!"r/rcy)zzCheck if the service can generate metrics. Returns: True if metrics generation is supported. Tr4rbs r-can_generate_metricsz&GradiumSTTService.can_generate_metricss r/deltacKt||d{}|s|S|jr0|jd{|j d{|S7F7 7 w)zApply a settings delta, sync params, and reconnect. Args: delta: A :class:`STTSettings` (or ``GradiumSTTSettings``) delta. Returns: Dict mapping changed field names to their previous values. N)rT_update_settingsrY _disconnect_connect)rbrichangedres r-rkz"GradiumSTTService._update_settingss_077N ??""$ $ $--/ ! !8 % !s1A#A'A#AA#A!A#A#!A#framecKt||d{t|j|jzdzdz |_|j d{y7J7w)zmStart the speech-to-text service. Args: frame: Start frame to begin processing. NrKi)rTstartr<r^rNr_rmrbrores r-rqzGradiumSTTService.starts\ gmE"""!$T%8%84;K;K%Ka%ORV%V!Wmmo #s"A%A!AA%A#A%#A%ctKt||d{|jd{y77w)ziStop the speech-to-text service. Args: frame: End frame to stop processing. N)rTstoprlrrs r-rtzGradiumSTTService.stops6 gl5!!!    " 848688ctKt||d{|jd{y77w)zoCancel the speech-to-text service. Args: frame: Cancel frame to abort processing. N)rTcancelrlrrs r-rwzGradiumSTTService.cancels6 gnU###    $ ru directioncKt|||d{t|tr|j d{yt|t r|j d{yy7W717 w)aProcess frames with VAD-specific handling. When VAD detects the user has stopped speaking, we flush the transcription by sending silence frames. This makes the system more reactive by getting the final transcription faster without closing the connection. Args: frame: The frame to process. direction: The direction of frame processing. N)rT process_frame isinstancerstart_processing_metricsr_flush_transcription)rbrorxres r-rzzGradiumSTTService.process_frameslg#E9555 e8 9//1 1 1 : ;++- - -< 6 2 -s2A5A/'A5A1(A5(A3)A51A53A5cK|jr&|jjtjury|jdkrt j dyt|jdz}tj|jd}t j d|jdt|jD]>}d|d } |jjtj|d{@y7#t $r#}t j"d |Yd}~yd}~wwxYww) aFlush the transcription by sending silence frames. When VAD detects the user stopped speaking, we send delay_in_frames chunks of silence (zeros) to flush the remaining audio from the model's buffer. This allows for faster turn-around without closing the connection. From Gradium docs: "feed in delay_in_frames chunks of silence (vectors of zeros). If those are fed in faster than realtime, the API also has a possibility to process them faster." Nrz&No delay_in_frames set, skipping flushrKutf-8zFlushing Gradium STT with z silence framesaudiotyperzFailed to send silence frame: )rYstaterOPENr`rdebugbytesrabase64 b64encodedecoderangesendjsondumps Exceptionwarning)rb silence_bytes silence_b64_msges r-r}z&GradiumSTTService._flush_transcriptions$//"7"7uzz"I   A % LLA B d..23 &&}5<AB>BcK |jr'|jjtjuryt j d|j }|jdd}t||d{|_|jdd{ddd}i}|jrtj|j}|jjr&t|jj}|r||d <|jj r|jj |d <|r||d <|jj#tj$|d{|jj'd{}tj|}|d d k(rt)d|d|d dk7rt)d|d |j+d d|_|j+dd|_t j d|j,d|j.dy7777#t($r%}|j1d||d{7d}~wwxYww)NzConnecting to Gradium STTpipecat)z x-api-keyz x-api-source)additional_headers on_connectedsetuppcm)r input_formatrr7rFrerrorzreceived error messagereadyzunexpected first message type r frame_sizeiz*Connected to Gradium STT (delay_in_frames=z , frame_size=)Unknown error occurred:  error_msg exception)rYrrrrrrXrWwebsocket_connect_call_event_handlerrZrloadsr@rr.r7rrrecvrgetr`ra push_error)rbws_urlheaders setup_msgrFgradium_language ready_msgrs r-rz$GradiumSTTService._connect_websocketQsE2 4??#8#8EJJ#F LL4 500F!]] )G%6#*%DO**>: : : %I K  "jj):):; ~~&&#?@W@W#X #.>K +~~--151O1O -.+6 -(//&&tzz)'<= = ="oo2244I 9-I G+/)I2F1G HII G+"@6AR@S TUU%.MM2CQ$GD !(}}\4@D  LL4 //.Fqc,JVW/X X X  sI72II7AI7H<8IH?CI/I0!IIB)I;I7<I?III I4I/(I+)I//I44I7cKt|d{|jr*|j|jd{d|_|j d{y7S7&7 wr3)rTrlr[ cancel_task_disconnect_websocketrs r-rlzGradiumSTTService._disconnectsfg!###   ""4#5#56 6 6!%D ((*** $ 7 +s3A/A).A/A+A/#A-$A/+A/-A/cK |jr]|jjtjur7t j d|jj d{d|_|jdd{y7%#t$r)}|jd||d{7Yd}~Pd}~wwxYw7<#d|_|jdd{7wxYww)NzDisconnecting from Gradium STTrron_disconnected) rYrrrrrcloserrr)rbrs r-rz'GradiumSTTService._disconnect_websockets >4??#8#8EJJ#F =>oo++---#DO**+<= = = . Y//.Fqc,JVW/X X X Y >#DO**+<= = =swC-A$B(B)B-C-C C-B CB=2B53B=8C=CCC-C*#C&$C**C-cH|jr |jStd)NzWebsocket not connected)rYrrgs r-_get_websocketz GradiumSTTService._get_websockets ???? "122r/c K|j23d{} tj|}|j|d{9747#tj$rt j d|YjwxYw6yw)NzReceived non-JSON message: )rrr_process_responseJSONDecodeErrorrr)rbrdatas r-_process_messagesz#GradiumSTTService._process_messagess!002 H H' Hzz'*,,T222 H3'' H!;B=A>>BcK |jd{tj|d|jd{I757w)Nz= Gradium connection was disconnected (timeout?), reconnecting)rrrrrgs r-_receive_messagesz#GradiumSTTService._receive_messagessM((* * * LLD6!^_ `))+ + + * +s!AA /AAAAcK|jdd}|dk(r|j|dd{y|dk(r|jd{y|dk(r|jd|d{yy7G7+7 w)Nrtext end_of_streamrzError: )r)r _handle_text_handle_end_of_streamr)rbrtype_s r-rz#GradiumSTTService._process_responses# F?##CK0 0 0 o %,,. . . g //gcUO/< < < 1 . .$B5^E4K-H* S D T\  b3j+ >3 H, =C -s -r/r?)6r;rr dataclassesrrtypingrrrlogururpydanticr pipecat.frames.framesr r r r rrr"pipecat.processors.frame_processorrpipecat.services.settingsrrrrpipecat.services.stt_latencyrpipecat.services.stt_servicerpipecat.transcriptions.languagerrpipecat.utils.timer(pipecat.utils.tracing.service_decoratorsrwebsockets.asyncio.clientrrwebsockets.protocolrModuleNotFoundErrorrrrrVrr.r1r?r4r/r-rs  (00>__9<F/?,F)  H8H H(  Z Z  Zq-+q-U,FLL;qc"#FLL\] &qc* ++,s. B##C(2CC