qi2dZddlZddlZddlZddlZddlZddlmZmZddl m Z dejd<ddl m Z mZmZmZmZddlmZdd lmZmZmZdd lmZmZmZmZmZmZdd lm Z m!Z!m"Z"m#Z#dd l$m%Z%dd l&m'Z'ddl(m)Z)m*Z*ddl+m,Z, ddl-m.Z.ddl/m0Z0ddl1m2Z2ddl3m4Z4ddl5m6Z6ddl7m8Z8ddl9m:Z:de)dee?fdZ@eGdde!ZAGdd e'ZBy#e;$r7Z<ejzde<ejzde>de<dZ<[dtj@dtjBdtjDditjFdtjHdtjJdtjLdtjNdtjPdtjRdtjTdtjVdtjXdtjZdtj\d tj^d tj`d!tjbd!tjdd"tjfd"itjhd#tjjd$tjld#tjnd%tjpd&tjrd'tjtd(tjvd)tjxd*tjzd+tj|d,tj~d-tjd.tjd/tjd0tjd1tjd2itjd%tjd3tjd4tjd4tjd5tjd5tjd6tjd6tjd7tjd8tjd9tjd:tjd7tjd;tjd;tjd<tjd<itjd=tjd>tjd?tjd=tjd@tjd@tjdAtjdAtjdBtjdBtjdCtjdCtjdDtjdDtjdEtjdEtjdFitjdFtjdGtjdGtjdHtjdItjdItjdJtjdJtjdKtjdKtjdLtjdLtjdMtjdMtjdNtjdNtjdOitjdOtjdPtjdPtjdQtjdQtjdRtjdRtjdStjdStjdTtjdTtjdUtjdUtj dVtj dVtjdWtjdWitjdXtjdXtjdXtjdYtjdYtjdZtjdZtj d[tj"d\tj$d[tj&d]tj(d]tj*d^tj,d^tj.d_tj0d_tj2d`itj4d`tj6datj8datj:dbtj<dbtj>dctj@dctjBddtjDdetjFdftjHdgtjJdhtjLditjNdjtjPdktjRddtjTdlitjVdmtjXdntjZdotj\dptj^dqtj`drtjbdstjddttjfdutjhdvtjjdwtjldxtjndxtjpdytjrdztjtdytjvd{itjxd{tjzd|tj|d|tj~d}tjd~tjdtjdtjdtjdtjdtjdtjdtjdtjdtjdtjdtjdtjdtjdtjdtjdtjdtjdtjdi}t||dS)zMaps Language enum to Google Speech-to-Text V2 language codes. Args: language: Language enum value. Returns: Optional[str]: Google STT language code or None if not supported. zaf-ZAzsq-ALzam-ETzar-EGzar-AEzar-BHzar-DZzar-IQzar-JOzar-KWzar-LBzar-MAzar-OMzar-QAzar-SAzar-SYzar-TNzar-YEzhy-AMzaz-AZzeu-ESzbn-INzbn-BDzbs-BAzbg-BGzmy-MMzca-ESz cmn-Hans-CNz cmn-Hans-HKz cmn-Hant-TWz yue-Hant-HKzhr-HRzcs-CZzda-DKznl-NLznl-BEen-USzen-AUzen-CAzen-GBzen-GHzen-HKzen-INzen-IEzen-KEzen-NGzen-NZzen-PHzen-SGzen-TZzen-ZAzet-EEzfil-PHzfi-FIzfr-FRzfr-BEzfr-CAzfr-CHzgl-ESzka-GEzde-DEzde-ATzde-CHzel-GRzgu-INziw-ILzhi-INzhu-HUzis-ISzid-IDzit-ITzit-CHzja-JPzjv-IDzkn-INzkk-KZzkm-KHzko-KRzlo-LAzlv-LVzlt-LTzmk-MKzms-MYzml-INzmr-INzmn-MNzne-NPzno-NOzfa-IRzpl-PLzpt-PTzpt-BRz pa-Guru-INzro-ROzru-RUzsr-RSzsi-LKzsk-SKzsl-SIzes-ESzes-ARzes-BOzes-CLzes-COzes-CRzes-DOzes-ECzes-GTzes-HNzes-MXzes-NIzes-PAzes-PEzes-PRzes-PYzes-SVzes-USzes-UYzes-VEzsu-IDzsw-TZzsw-KEzsv-SEzta-INzta-MYzta-SGzta-LKzte-INzth-THztr-TRzuk-UAzur-INzur-PKzuz-UZzvi-VNzxh-ZAzzu-ZAF) use_base_code)rAFAF_ZASQSQ_ALAMAM_ETARAR_AEAR_BHAR_DZAR_EGAR_IQAR_JOAR_KWAR_LBAR_MAAR_OMAR_QAAR_SAAR_SYAR_TNAR_YEHYHY_AMAZAZ_AZEUEU_ESBNBN_BDBN_INBSBS_BABGBG_BGMYMY_MMCACA_ESZHZH_CNZH_HKZH_TWYUEYUE_CNHRHR_HRCSCS_CZDADA_DKNLNL_BENL_NLENEN_AUEN_CAEN_GBEN_GHEN_HKEN_INEN_IEEN_KEEN_NGEN_NZEN_PHEN_SGEN_TZEN_USEN_ZAETET_EEFILFIL_PHFIFI_FIFRFR_BEFR_CAFR_CHFR_FRGLGL_ESKAKA_GEDEDE_ATDE_CHDE_DEELEL_GRGUGU_INHEHE_ILHIHI_INHUHU_HUISIS_ISIDID_IDITIT_ITIT_CHJAJA_JPJVJV_IDKNKN_INKKKK_KZKMKM_KHKOKO_KRLOLO_LALVLV_LVLTLT_LTMKMK_MKMSMS_MYMLML_INMRMR_INMNMN_MNNENE_NPNONBNB_NOFAFA_IRPLPL_PLPTPT_BRPT_PTPAPA_INRORO_RORURU_RUSRSR_RSSISI_LKSKSK_SKSLSL_SIESES_ARES_BOES_CLES_COES_CRES_DOES_ECES_ESES_GTES_HNES_MXES_NIES_PAES_PEES_PRES_PYES_SVES_USES_UYES_VESUSU_IDSWSW_KESW_TZSVSV_SETATA_INTA_MYTA_SGTA_LKTETE_INTHTH_THTRTR_TRUKUK_UAURUR_INUR_PKUZUZ_UZVIVI_VNXHZUZU_ZAr)r' LANGUAGE_MAPs M/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/services/google/stt.pylanguage_to_google_stt_languager>sU] W] ]  W ]  ]  W] ]  W] ] ] ] ] !]" #]$ %]& ']( )]* +], -]. /]0 1]2 3]4 5]8  W9]: ;]>  W?]@ A]D  WE]F G]J  WK]L M]N O]R  WS]T U]X  WY]Z []^  W_]` a]d  We]f g]j  ]k]l  m]n  o]p  q]r  ms]t u]x  Wy]z {]~  W]@ A]D  WE]F G]J  WK]L M]N O]R  WS]T U]V W]X Y]Z []\ ]]^ _]` a]b c]d e]f g]h i]j k]l m]n o]p q]t  Wu]v w]z  h{]| }]@  WA]B C]F  WG]H I]J K]L M]N O]R  WS]T U]X  WY]Z []^  W_]` a]b c]d e]h  Wi]j k]n  Wo]p q]t  Wu]v w]z  W{]| }]@  WA]B C]F  WG]H I]L  WM]N O]R  WS]T U]V W]Z  W[]\ ]]`  Wa]b c]f  Wg]h i]l  Wm]n o]r  Ws]t u]x  Wy]z {]~  W]@ A]D  WE]F G]J  WK]L M]P  WQ]R S]V  WW]X Y]\  W]]^ _]b  Wc]d e]h  Wi]j k]n  Wo]p q]t  Wu]v  Ww]x y]|  W}]~ ]B  WC]D E]H  WI]J K]L M]P  \Q]R  S]V  WW]X Y]\  W]]^ _]b  Wc]d e]h  Wi]j k]n  Wo]p q]t  Wu]v w]z  W{]| }]~ ]@ A]B C]D E]F G]H I]J K]L M]N O]P Q]R S]T U]V W]X Y]Z []\ ]]^ _]` a]b c]f  Wg]h i]l  Wm]n o]p q]t  Wu]v w]z  W{]| }]~ ]@ A]B C]F  WG]H I]L  WM]N O]R  WS]T U]X  WY]Z []^  W_]` a]b c]f  W W W Wy]L~ Hl% HHceZdZUdZedZeeeze d<edZ ee eze d<edZ e eze d<ed Ze eze d <ed Ze eze d <ed Ze eze d<edZe eze d<edZe eze d<edZe eze d<edZe eze d<edZe eze d<y)GoogleSTTSettingsaSettings for GoogleSTTService. Parameters: languages: List of ``Language`` enums for recognition (e.g. ``[Language.EN_US]``). Preferred over ``language_codes``. language_codes: List of Google STT language code strings (e.g. ``["en-US"]``). .. deprecated:: 0.0.104 Use ``languages`` instead. If both are provided, ``languages`` takes precedence. This field is here just for backward compatibility with dict-based settings updates. use_separate_recognition_per_channel: Process each audio channel separately. enable_automatic_punctuation: Add punctuation to transcripts. enable_spoken_punctuation: Include spoken punctuation in transcript. enable_spoken_emojis: Include spoken emojis in transcript. profanity_filter: Filter profanity from transcript. enable_word_time_offsets: Include timing information for each word. enable_word_confidence: Include confidence scores for each word. enable_interim_results: Stream partial recognition results. enable_voice_activity_events: Detect voice activity in audio. ctSNrrrzGoogleSTTSettings.)rdefault_factory languagesctSrrrrrr zGoogleSTTSettings.r rlanguage_codesctSrrrrrr zGoogleSTTSettings.s r$use_separate_recognition_per_channelctSrrrrrr zGoogleSTTSettings.S\renable_automatic_punctuationctSrrrrrr zGoogleSTTSettings.sPYrenable_spoken_punctuationctSrrrrrr zGoogleSTTSettings.s9renable_spoken_emojisctSrrrrrr zGoogleSTTSettings.syrprofanity_filterctSrrrrrr zGoogleSTTSettings.syrenable_word_time_offsetsctSrrrrrr zGoogleSTTSettings.Yrenable_word_confidencectSrrrrrr zGoogleSTTSettings.rrenable_interim_resultsctSrrrrrr zGoogleSTTSettings.rrenable_voice_activity_eventsN)__name__ __module__ __qualname____doc__rr r rr__annotations__rstrrboolrrrrrrr!r#rrrrris.-2BS,TItH~ )T,1BS,TNDI )T=B)>($*:6;K\5] $"2]27HY2Zti/Z-2CT-U$*U).?P)QdY&Q16GX1YdY.Y/4EV/WD9,W/4EV/WD9,W5:K\5] $"2]rrcFeZdZUdZeZeed<dZGddeZ dddddde dd e e d e e d e d e e d e e de ede effdZdefdZdeeezde ee zfdZdee fdZdZdeefdZdedee efffd Zdeffd Zdeffd Zdeffd Z dddddddddddd de eed e e d!e ed"e ed#e ed$e ed%e ed&e ed'e ed(e ed e e ddfd)Z!d*Z"d+Z#d,Z$d-Z%d.e&de'e(dffd/Z)e* d4d0e d1ede e fd2Z+d3Z,xZ-S)5GoogleSTTServiceaGoogle Cloud Speech-to-Text V2 service implementation. Provides real-time speech recognition using Google Cloud's Speech-to-Text V2 API with streaming support. Handles audio transcription and optional voice activity detection. Implements automatic stream reconnection to handle Google's 4-minute streaming limit. Parameters: InputParams: Configuration parameters for the STT service. STREAMING_LIMIT: Google Cloud's streaming limit in milliseconds (4 minutes). Raises: ValueError: If neither credentials nor credentials_path is provided. ValueError: If project ID is not found in credentials. _settingsicZeZdZUdZedZeeeefe d<dZ e e e d<dZ e ee d<d Ze ee d <dZe ee d <dZe ee d <dZe ee d <dZe ee d<dZe ee d<d Ze ee d<dZe ee d<eddedeefdZedeefdZy)GoogleSTTService.InputParamsaConfiguration parameters for Google Speech-to-Text. .. deprecated:: 0.0.105 Use ``settings=GoogleSTTSettings(...)`` instead. Parameters: languages: Single language or list of recognition languages. First language is primary. model: Speech recognition model to use. use_separate_recognition_per_channel: Process each audio channel separately. enable_automatic_punctuation: Add punctuation to transcripts. enable_spoken_punctuation: Include spoken punctuation in transcript. enable_spoken_emojis: Include spoken emojis in transcript. profanity_filter: Filter profanity from transcript. enable_word_time_offsets: Include timing information for each word. enable_word_confidence: Include confidence scores for each word. enable_interim_results: Stream partial recognition results. enable_voice_activity_events: Detect voice activity in audio. c$tjgSr)rrprrrr z%GoogleSTTService.InputParams.sT\TbTbScrr r  latest_longmodelFrTrrrrrrr!r#before)moder(c,t|tr|gS|S)zEnsure languages is always a list. Args: v: Single Language enum or list of Language enums. Returns: List[Language]: List of configured languages. ) isinstancer)clsvs rvalidate_languagesz/GoogleSTTService.InputParams.validate_languagess!X&s HrcRt|jtsJ|jS)zGet languages as a guaranteed list. Returns: List[Language]: List of configured languages. )r6r listselfs r language_listz*GoogleSTTService.InputParams.language_lists"dnnd3 33>> !rN)r$r%r&r'rr r rr r(r2r r)rr*rrrrrrr!r#r classmethodr9propertyr>rrr InputParamsr/s &6;Kc5d 54>12d,x},?D,htnD7;$htn;49!8D>9/4htn4+0(4.038 (4.81661557<$htn< 8 4  $x.   5   "4> "  "rrANglobal) credentialscredentials_pathlocation sample_rateparamssettingsttfs_p99_latencyrCrDrErFrGrHrIc tdtjgddddddddddd } |tdt|st |j | _|j| _|j| _|j| _ |j| _ |j| _ |j| _ |j| _ |j| _|j| _|j | _|| j#|t%|Ld||| d|||_d|_d|_d|_d|_g|_g|_d|_d|_d|_d|_d|_d|_ d|_!d} |j(d k7rtE|j(d  } d} |rKtGjH|} | jKd |_&tNjPjS| } ny|r_tU|5} tGjV| } | jKd |_&dddtNjPjY|} n t[d g\} }||_&| s t_d|jLs t_dtajb| | |_2y#1swYxYw#t\$rYXwxYw)aInitialize the Google STT service. Args: credentials: JSON string containing Google Cloud service account credentials. credentials_path: Path to service account credentials JSON file. location: Google Cloud location (e.g., "global", "us-central1"). sample_rate: Audio sample rate in Hertz. params: Configuration parameters for the service. .. deprecated:: 0.0.105 Use ``settings=GoogleSTTSettings(...)`` instead. settings: Runtime-updatable settings. When provided alongside deprecated ``params``, ``settings`` values take precedence. ttfs_p99_latency: P99 latency from speech end to final transcript in seconds. Override for your deployment. See https://github.com/pipecat-ai/stt-benchmark **kwargs: Additional arguments passed to STTService. Nr1FT) r'r rr2rrrrrrrr!r#rG)rFrIrHrrBz-speech.googleapis.com) api_endpoint project_idz.https://www.googleapis.com/auth/cloud-platform)scopeszNo valid credentials provided.z#Project ID not found in credentials)rCclient_optionsr)3rrrprr;r>r r2rrrrrrrr!r# apply_updatesuper__init__ _location_stream_config_streaming_task_stream_start_time_last_audio_input _audio_input_result_end_time_is_final_end_time_final_request_end_time_bridging_offset_last_transcript_was_final _new_stream_restart_counterr jsonloadsget _project_idr& Credentialsfrom_service_account_infoopenloadfrom_service_account_filer"r# ValueErrorr$SpeechAsyncClient_client)r=rCrDrErFrGrHrIkwargsdefault_settingsrNcredsjson_account_infofrL __class__s rrQzGoogleSTTService.__init__s>-~~&16)-&+!&"%*#(#'). &   "8-> ?-1&2F2F-G *)/ &??!EAG@c@c ==C=]=] :8>8S8S 54:4K4K 1>X %*4>>:JJ`8abN8<  $ ; 7 044\BD #//IIJ[\E &' G1$(IIaL!#4#8#8#F  G$//IIJZ[E $+LM%!z$. => >BC C 22uUcd ' G G#  s,J<$K<K KKr(cy)zCheck if the service can generate metrics. Returns: bool: True, as this service supports metrics generation. Trr<s rcan_generate_metricsz%GoogleSTTService.can_generate_metricscs rr'ct|tr|Dcgc]}t|xsdc}St|xsdScc}w)zConvert Language enum(s) to Google STT language code(s). Args: language: Single Language enum or list of Language enums. Returns: str | List[str]: Google STT language code(s). r*)r6r;r)r=r'langs rlanguage_to_service_languagez-GoogleSTTService.language_to_service_languageksC h %QYZ3D9DWDZ Z.x8CGC[s=c|jjr3|jjDcgc]}|j|c}S|jjrt |jjSdgScc}w)a-Resolve the current language settings to Google STT language code strings. Prefers ``languages`` (``Language`` enums) over the deprecated ``language_codes`` (raw strings). Falls back to ``["en-US"]``. Returns: List[str]: Google STT language code strings. r*)r-r rvrr;)r=rus r_get_language_codesz$GoogleSTTService._get_language_codesxsg >> # #HLH`H`aD55d;a a >> ( (556 6ybsBcK|jrFtjd|jd{|j d{yy77w)z.Reconnect the stream if it's currently active.z0Reconnecting stream due to configuration changesN)rUr debug _disconnect_connectr<s r_reconnect_if_neededz%GoogleSTTService._reconnect_if_neededsI    LLK L""$ $ $--/ ! ! $ !s!5AAAAAAr cHKtj5tjdtjdtdddt j d||jtt|d{y#1swYNxYw7w)a#Update the service's recognition languages. .. deprecated:: 0.0.104 Use ``STTUpdateSettingsFrame`` with ``GoogleSTTSettings(languages=...)`` instead. Args: languages: List of languages for recognition. First language is primary. alwayszhset_languages() is deprecated. Use STTUpdateSettingsFrame with GoogleSTTSettings(languages=...) instead.NzSwitching STT languages to: )r ) warningscatch_warnings simplefilterwarnDeprecationWarningr rz_update_settingsrr;)r=r s r set_languageszGoogleSTTService.set_languagess $ $ &   ! !( + MM<"    3I;?@##$5Y$PQQQ   Rs)B"0BAB"B B"BB"deltacKddlm}||jr|jg|_t|_||j rNt j5t jdt jdtddddt|1|d{}|r|jd{|S#1swY>11)5)L)L)@@NNWW&*&6&6()* $779nn**%99151\1\.2nn.V.V)-)L)L%)^^%D%D-1^^-T-T+/>>+P+P " ,HH-1^^-X-X $ E E %  0&mmo#//0B0B0DE&&~666sG8H:H;HcK|jr?tjd|j|jd{d|_|j dd{y7%7w)z)Clean up streaming recognition resources.z(Disconnecting from Google Speech-to-TextNon_disconnected)rUr rz cancel_taskrr<s rr{zGoogleSTTService._disconnectUs^    LLC D""4#7#78 8 8#'D &&'8999 9 :s$AA,A(A,"A*#A,*A,cNKd|jd|jd}tjd| t j ||j  |jjd{}|jjttjdz|jz |jkDrftjd|j|_g|_|xj"d z c_|jj%|d{y|jj'|t j | 77=#t($r%}|j+d || d{7d}~wwxYww) z6Generates requests for the streaming recognize method.z projects/z /locations/z/recognizers/_zUsing recognizer path: ) recognizerstreaming_configNrz9Streaming limit reached, initiating graceful reconnectionr)audioUnknown error occurred:  error_msg exception)rcrRr tracer%StreamingRecognizeRequestrTrrb task_donerrrVSTREAMING_LIMITrzrXrWr_putappend Exception push_error)r=recognizer_path audio_dataes r_request_generatorz#GoogleSTTService._request_generator^sn%d&6&6%7{4>>BRR`a ..?@A 88*!%  #'#6#6#:#:#<< ##--/ d*+d.E.EEI]I]]LL!\]-1->->D*(*D%))Q.)--11*===!!((4"<<:NN#<>  //.Fqc,JVW/X X X  sZ6F%AE4;E0F4?E?DDD E<E7)D,*E7E *E72E?7E<<E?? F1F,!F$"F,'F4,F11F4rcK|jr;|jd{|jj|d{dy7-7 w)zProcess an audio chunk for STT transcription. Args: audio: Raw audio bytes to transcribe. Yields: Frame: None (actual transcription frames are pushed via internal processing). N)rUstart_processing_metricsrr)r=rs rrun_sttzGoogleSTTService.run_sttsK   //1 1 1%%))%0 0 0  2 0s! AA"AA AA transcriptis_finalc Kywrr)r=rrr's r_handle_transcriptionz&GoogleSTTService._handle_transcriptions  sc K |23d{}ttjdz|jz |jkDrt j dy|j sg|j D]}|js|jdj}|s-|jd}|jrud|_ |jt||jt||d{|j!d{|j#|d|d{d|_ |jt%||jt||d{y7u77k7Q76y#t&$r}t j |d d}~wt($r%}|j+d || d{7d}~wwxYww) z(Process streaming recognition responses.Nrz-Stream timeout reached in response processingrT)result)rr'FzQ Stream aborted due to inactivity (no audio input). Reconnecting automatically...rr)rrrVrr rzresults alternativesrrxrr] push_framer_user_idrstop_processing_metricsrrr!rr)r=rresponserrprimary_languagers rrz#GoogleSTTService._process_responsess@ "5. . h d*+d.E.EEI]I]]LL!PQ''&..%F!.. !'!4!4Q!7!B!BJ% '+'?'?'A!'D$:>7"oo. * $ 0 2 0'- #::<<<"88&%)%59 ;@7"oo5 * $ 0 2 0'- ;%. *=M#6^  LL&01   //.Fqc,JVW/X X X   sG"F F E?F AF G" B F FF FF 4F5AF 5F6 F ?F F F F F F G" GF.. G:GGGGG"r).r$r%r&r'rSettingsr(rrrArr r)rfloatrQr*rsrr rvrxr}rdictrrrrrrrrrr|r{rrbytesr rrrrr __classcell__)rqs@rr,r,s !H  O7"i7"x&**. %)(,04,;~ec]~e#3- ~e  ~e c] ~e%~e,-~e#5/~e@d DXX5N DSVY]^aYbSb D T#Y "RT(^R(&,=&$sCx.&P!!!+!/3#7;48/3+/3715157;"&I+DN+I+} I+ '/tn I+ $,D> I+'tnI+#4.I+#+4.I+!)I+!)I+'/tnI+3-I+ I+V#7J:!F"YH 5 ^E4K-H IM  )- 9A#  Brr,)Cr'rr`osrr dataclassesrr(pipecat.utils.tracing.service_decoratorsrenvirontypingrr r r r logurur pydanticrrrpipecat.frames.framesrrrrrrrrrrrpipecat.services.stt_latencyrpipecat.services.stt_servicerpipecat.transcriptions.languagerrpipecat.utils.timergoogle.api_core.client_optionsr google.api_core.exceptionsr! google.authr"google.auth.exceptionsr# google.cloudr$google.cloud.speech_v2.typesr% google.oauth2r&ModuleNotFoundErrorrerrorrr)rrr,rrrrs (?*1 %&==66`_83F/,<2#6&9-hIhhI8C=hIV  $^ $^ $^Nk zk w ,FLL;qc"#FLL T &qc* ++ ,s *CD2DD