qi|N"dZddlZddlZddlmZmZddlmZmZm Z ddl m Z ddl m Z mZmZmZmZmZmZmZmZddlmZddlmZdd lmZmZdd lmZmZm Z dd l!m"Z"dd l#m$Z$dd l%m&Z&ddl'm(Z(ddl)m*Z*eGddeZ+Gdde$Z,y)aFDeepgram speech-to-text service for AWS SageMaker. This module provides a Pipecat STT service that connects to Deepgram models deployed on AWS SageMaker endpoints. Uses HTTP/2 bidirectional streaming for low-latency real-time transcription with support for interim results, multiple languages, and various Deepgram features. N) dataclassfields)AnyAsyncGeneratorOptional)logger) CancelFrameEndFrame ErrorFrameFrameInterimTranscriptionFrame StartFrameTranscriptionFrameVADUserStartedSpeakingFrameVADUserStoppedSpeakingFrame)FrameDirection)SageMakerBidiClient)DeepgramSTTSettings LiveOptions) STTSettings_warn_deprecated_paramis_given)DEEPGRAM_SAGEMAKER_TTFS_P99) STTService)Language)time_now_iso8601) traced_sttceZdZdZy)DeepgramSageMakerSTTSettingszqSettings for the Deepgram SageMaker STT service. Inherits all fields from :class:`DeepgramSTTSettings`. N)__name__ __module__ __qualname____doc__Y/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/services/deepgram/sagemaker/stt.pyrr,s   r%rcteZdZUdZeZeed<dddddddedded ed ed e d e d e e de e de e de ede e ffdZde fdZdedeeefffd Zdeffd Zdeffd Zdeffd ZdedeedffdZdefdZdZdZ d Z!d!Z"d"efd#Z#e$ d+d$ed%e d&e e%fd'Z&d(Z'ded)e(ffd* Z)xZ*S),DeepgramSageMakerSTTServicea~Deepgram speech-to-text service for AWS SageMaker. Provides real-time speech recognition using Deepgram models deployed on AWS SageMaker endpoints. Uses HTTP/2 bidirectional streaming for low-latency transcription with support for interim results, speaker diarization, and multiple languages. Requirements: - AWS credentials configured (via environment variables, AWS CLI, or instance metadata) - A deployed SageMaker endpoint with Deepgram model: https://developers.deepgram.com/docs/deploy-amazon-sagemaker Example:: stt = DeepgramSageMakerSTTService( endpoint_name="my-deepgram-endpoint", region="us-east-2", settings=DeepgramSageMakerSTTSettings( model="nova-3", language="en", interim_results=True, punctuate=True, ), ) _settingslinear16FN)encodingchannels multichannel sample_rate mip_opt_out live_optionssettingsttfs_p99_latency endpoint_nameregionr,r-r.r/r0r1r2r3c  rtdidddtjdddddddd d d d d d d dddd dd dd dd dd dddd dd} |tdt| s|j| |j}|j |j }|j |j }|j |j}|j |j}hd} |jjDcic] \}}|| vs ||}}}tj|}| j|| | j| | jt|<d|| | d| ||_||_||_||_||_||_d |_d |_d |_y cc}}w)aInitialize the Deepgram SageMaker STT service. Args: endpoint_name: Name of the SageMaker endpoint with Deepgram model deployed (e.g., "my-deepgram-nova-3-endpoint"). region: AWS region where the endpoint is deployed (e.g., "us-east-2"). encoding: Audio encoding format. Defaults to "linear16". channels: Number of audio channels. Defaults to 1. multichannel: Transcribe each audio channel independently. Defaults to False. sample_rate: Audio sample rate in Hz. If None, uses the pipeline sample rate. mip_opt_out: Opt out of Deepgram model improvement program. live_options: Legacy configuration options. .. deprecated:: 0.0.105 Use ``settings=DeepgramSageMakerSTTSettings(...)`` for runtime-updatable fields and direct init parameters for connection-level config. settings: Runtime-updatable settings. When provided alongside ``live_options``, ``settings`` values take precedence (applied after the ``live_options`` merge). ttfs_p99_latency: P99 latency from speech end to final transcript in seconds. Override for your deployment. See https://github.com/pipecat-ai/stt-benchmark **kwargs: Additional arguments passed to the parent STTService. modelznova-3languagedetect_entitiesFdiarize dictation endpointingNinterim_resultsTkeytermkeywordsnumeralsprofanity_filter punctuateredactreplacesearch smart_formatutterance_end_ms vad_eventsr1>r-r,r0r/r.)r/r3r2r$)rrENrr/r,r-r.r0to_dictitems from_mapping apply_update_sync_extra_to_fieldssuper__init___endpoint_name_region _encoding _channels _multichannel _mip_opt_out_client_response_task_keepalive_task)selfr4r5r,r-r.r/r0r1r2r3kwargsdefault_settings init_onlykvlo_dictdelta __class__s r&rPz$DeepgramSageMakerSTTService.__init__TsFV8  [[ "       !    "     ! ""# $% ,  # ">3O P++7KzBDeepgramSageMakerSTTService._build_query_string..5s>tq!1#Qqc >s)r)rname startswithgetattrrriboolstrlowerr7r8rSrTrUr/rVrrKjoin)rZparamssfvaluekeys r&_build_query_stringz/DeepgramSageMakerSTTService._build_query_strings NN [Avv77166;L;LS;QAqvv&EE?em3=eT3JSZ--/PSTYPZF166N  [ AGG !4!!''lF7O AJJ AJJ$:!$QZZF: "^^z 0z!$T%7%7!8!>!>!@~ #D$4$4 5}    ($'(9(9$:$@$@$BF= ! 77ggmmo ` U$8B5$8O#e*"2"2"4UXY^U_F3K `xx>v||~>>>r%cKtjd|j}t|j|j d||_ |j jd{|j|j|_ |j|j|_ tjd|jdd{y7{7#t$rM}|jd||d{7|jd t!|d{7Yd}~yd}~wwxYww) aConnect to the SageMaker endpoint and start the BiDi session. Builds the Deepgram query string from settings, creates the BiDi client, starts the streaming session, and launches background tasks for processing responses and sending KeepAlive messages. z&Connecting to Deepgram on SageMaker...z v1/listen)r4r5model_invocation_pathmodel_query_stringNz"Connected to Deepgram on SageMaker on_connectedry error_msg exceptionon_connection_error)rdebugrrrQrRrW start_session create_task_process_responsesrX_send_keepaliverY_call_event_handlerr} push_errorr)rZ query_stringr~s r&roz$DeepgramSageMakerSTTService._connect7s  =>//1 +--<<"-+    J,,,,. . .#'"2"243J3J3L"MD $(#3#3D4H4H4J#KD LL= >**>: : : / ; J//.Fqc,JVW/X X X**+@#a&I I I JsmAEC..C*/A5C.$C,%C.)E*C.,C.. E7D?D#D?4D75D?:E?EEcK|jr6|jjrtjd |jj ddid{|jr=|jjs#|j|jd{|jr=|jjs#|j|jd{|jjd{tjd|jdd{yyy7#t $r#}tj d|Yd}~d}~wwxYw777j7>w)zDisconnect from the SageMaker endpoint. Sends a CloseStream message to Deepgram, cancels background tasks (KeepAlive and response processing), and closes the BiDi session. Safe to call multiple times. z+Disconnecting from Deepgram on SageMaker...type CloseStreamNz$Failed to send CloseStream message: z'Disconnected from Deepgram on SageMakeron_disconnected) rWr{rr send_jsonr}warningrYdone cancel_taskrX close_sessionrrZr~s r&rtz'DeepgramSageMakerSTTService._disconnect[s> <+>+C+C+E&&t':':;;;,,,,. . . LLB C**+<= = =+3< F K!EaSIJJ K =< / >s:F E EE "AF&E8'AF/E:0!FE<-F?E>FE E5E0*F0E55F:F<F>FcK|jr|jjrtjdd{|jr<|jjr& |jj ddid{|jr|jjryyyy7s7-#t $r"}t jd|Yd}~Qd}~wwxYww)aSend periodic KeepAlive messages to maintain the connection. Sends a KeepAlive JSON message to Deepgram every 5 seconds while the connection is active. This prevents the connection from timing out during periods of silence. Nr KeepAlivezFailed to send KeepAlive: )rWr{asynciosleeprr}rrrs r&rz+DeepgramSageMakerSTTService._send_keepaliveysllt||55--" " "|| 6 6E,,00&+1FGGG llt||55l5l "H ENN%?s#CDDEsQ;C#B1&C#% B5B3B5 "C#-C#3B55 C >CC#C  C#cK |jr|jjr|jjd{}|nt|drt|jdrn|jj rX|jj j d} tj|}d|vr|j|d{|jr|jjrtjd y77?#tj$rtjd|YjwxYw#tj$rtjdYut $r)}|j#d|| d{7Yd}~d}~wwxYw#tjd wxYww) a5Process streaming responses from Deepgram on SageMaker. Continuously receives responses from the BiDi stream, decodes the payload, parses JSON responses from Deepgram, and processes transcription results. Runs as a background task until the connection is closed or cancelled. Nrbytes_zutf-8channelzNon-JSON response: zResponse processor cancelledryrzResponse processor stopped)rWr{receive_responsehasattrrrdecodejsonloads_handle_transcript_responseJSONDecodeErrorrrrCancelledErrorrr}r)rZresult response_dataparsedr~s r&rz.DeepgramSageMakerSTTService._process_responsessd 7,,4<<#9#9#||<<>>>67+ h0O||**(. (;(;(B(B7(K  R%)ZZ %>F )F2&*&F&Fv&N N N#,,4<<#9#96 LL5 65? !O#33R"NN-@+PQR%% 9 LL7 8 Y//.Fqc,JVW/X X X Y LL5 6sG?E DA$E )-DDD"E >GE D+EE EE (F$1F'3F$;FFFF'F$$F''F>>Grc K|jdijdg}|r|djdsy|dd}|jsy|jdd}d}|djdr|ddd}t|}|r|jd d}|r|j|j t ||j t|| d{|j|||d{|jd{y|j t||j t|| d{y7r7Y7C7 w) aHandle a transcript response from Deepgram. Extracts the transcript text, determines if it's final or interim, extracts language information, and pushes the appropriate frame (TranscriptionFrame or InterimTranscriptionFrame) downstream. Args: parsed: The parsed JSON response from Deepgram containing channel, alternatives, transcript, and metadata. r alternativesr transcriptNis_finalF languages from_finalize)r) getstriprconfirm_finalize push_framer_user_idr_handle_transcriptionstop_processing_metricsr )rZrrrrr8rs r&rz7DeepgramSageMakerSTTService._handle_transcript_responsesozz)R044^RH <?#6#6|#D !!_\2 ! ::j%0 ?  { +#A{3A6H)H #JJ>M%%'//"MM$&!   ,,Z8L L L..0 0 0//)MM$&!     M 0 sHC+E(-E .E(E" E( E$!9E(E&E("E($E(&E(rrr8c Kyw)aHandle a transcription result with tracing. This method is decorated with @traced_stt for observability and tracing integration. The actual transcription processing is handled by the parent class and observers. Args: transcript: The transcribed text. is_final: Whether this is a final transcription result. language: The detected language of the transcription, if available. Nr$)rZrrr8s r&rz1DeepgramSageMakerSTTService._handle_transcriptions  sc@K|jd{y7w)z$Start processing metrics collection.N)start_processing_metricsres r&_start_metricsz*DeepgramSageMakerSTTService._start_metricss++---s  directioncKt|||d{t|tr|j d{yt|t r~|j |jr<|jjr& |jjddid{tjd|jd|yy777/#t$r"}tjd|Yd}~Sd}~wwxYww)zProcess frames with Deepgram SageMaker-specific handling. Args: frame: The frame to process. direction: The direction of frame processing. NrFinalizez Error sending Finalize message: z(Triggered finalize event on: frame.name=z , direction=)rO process_framerirrrrequest_finalizerWr{rr}rrtracer)rZrlrr~rbs r&rz)DeepgramSageMakerSTTService.process_framesg#E9555 e8 9%%' ' ' : ;  ! ! #|| 6 6K,,00&*1EFFF LLD ] |T U< 6 (G KNN%EaS#IJJKs]DC'DCAD C(C)C-(DDC D#D;DDD)N)+r r!r"r#rSettings__annotations__rrintrrrfloatrPrfrdictrrhrrnr rsr rvbytesrr rrrortrrrrrrrrr __classcell__)rbs@r&r(r(6s4,H++#"%)&*.2;?,Gu<u< u<  u<  u<u<c]u<d^u<{+u<78u<#5/u< E#7J66pNR  )- 9A(9K  .VV>VVr%r()-r#rr dataclassesrrtypingrrrlogururpipecat.frames.framesr r r r r rrrr"pipecat.processors.frame_processorr*pipecat.services.aws.sagemaker.bidi_clientrpipecat.services.deepgram.sttrrpipecat.services.settingsrrrpipecat.services.stt_latencyrpipecat.services.stt_servicerpipecat.transcriptions.languagerpipecat.utils.timer(pipecat.utils.tracing.service_decoratorsrrr(r$r%r&rsy )00   >JJSSD34/?  #6   YV*YVr%