qijdZddlZddlZddlmZmZmZmZmZm Z ddl m Z m Z m Z ddlmZGdde ZGdd eZGd d eZGd d eZGdde ZGdde ZGdde ZGdde ZGdde ZGdde ZGdde ZGdde ZGdde ZGd d!e ZGd"d#e ZGd$d%e ZGd&d'e Z Gd(d)e Z!Gd*d+e!Z"Gd,d-e!Z#Gd.d/e!Z$Gd0d1e!Z%Gd2d3e!Z&Gd4d5e!Z'Gd6d7e!Z(Gd8d9e!Z)Gd:d;e!Z*Gd<d=e!Z+Gd>d?e Z,Gd@dAe,Z-GdBdCe,Z.GdDdEe,Z/GdFdGe,Z0GdHdIe,Z1GdJdKe,Z2GdLdMe,Z3GdNdOe,Z4GdPdQe,Z5GdRdSe,Z6GdTdUe,Z7GdVdWe,Z8GdXdYe,Z9GdZd[e,Z:Gd\d]e,Z;Gd^d_e,Z<Gd`dae,Z=Gdbdce,Z>Gdddee,Z?Gdfdge,Z@Gdhdie,ZAGdjdke,ZBGdldme,ZCGdndoe,ZDGdpdqe,ZEGdrdse,ZFGdtdue,ZGGdvdwe,ZHGdxdye,ZIGdzd{e,ZJGd|d}e,ZKGd~de ZLGdde ZMGdde ZNGdde ZOideJde-de.de/deHdeIdeFdeGde0de1de2de3de4de5de6de7de8e9e:e;ee?e@eAeBeCeDeEeKdZPdZQy)zGEvent models and data structures for OpenAI Realtime API communication.N)AnyDictListLiteralOptionalUnion) BaseModel ConfigDictField) ToolsSchemaceZdZUdZeed<y) AudioFormatz*Base class for audio format configuration.typeN)__name__ __module__ __qualname____doc__str__annotations__Y/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/services/openai/realtime/events.pyrrs 4 Irrc:eZdZUdZdZeded<dZeded<y)PCMAudioFormatzPCM audio format configuration. Parameters: type: Audio format type, always "audio/pcm". rate: Sample rate, always 24000 for PCM. z audio/pcmri]rateN)rrrrrrrrrrrrrs&"-D'+ , D'%. rrc&eZdZUdZdZeded<y)PCMUAudioFormatu{PCMU (G.711 μ-law) audio format configuration. Parameters: type: Audio format type, always "audio/pcmu". z audio/pcmurNrrrrrrrrrrrr( #/D', .rrc&eZdZUdZdZeded<y)PCMAAudioFormatzzPCMA (G.711 A-law) audio format configuration. Parameters: type: Audio format type, always "audio/pcma". z audio/pcmarNrrrrr!r!2rrr!czeZdZUdZdZeed<eeed<eeed< ddeedeedeeffd ZxZ S)InputAudioTranscriptionz/Configuration for audio transcription settings.gpt-4o-transcribemodellanguagepromptc*t||||y)a Initialize InputAudioTranscription. Args: model: Transcription model to use (e.g., "gpt-4o-transcribe", "whisper-1"). language: Optional language code for transcription. prompt: Optional transcription hint text. )r%r&r'N)super__init__)selfr%r&r' __class__s rr*z InputAudioTranscription.__init__Cs uxGr)r$NN) rrrrr%rrrr* __classcell__r,s@rr#r#<sf9$E3$sm SM 3"& $ H} H3- H H Hrr#cheZdZUdZdZeeded<dZee ed<dZ ee ed<dZ ee ed <y ) TurnDetectionaServer-side voice activity detection configuration. Parameters: type: Detection type, must be "server_vad". threshold: Voice activity detection threshold (0.0-1.0). Defaults to 0.5. prefix_padding_ms: Padding before speech starts in milliseconds. Defaults to 300. silence_duration_ms: Silence duration to detect speech end in milliseconds. Defaults to 500. server_vadrg? thresholdi,prefix_padding_msisilence_duration_msN) rrrrrrrrr2floatr3intr4rrrr0r0SsI-9D(7<( )8!$Ix$'*x}*),#,rr0cneZdZUdZdZeeded<dZeeded<dZ ee ed<dZ ee ed<y) SemanticTurnDetectionaSemantic-based turn detection configuration. Parameters: type: Detection type, must be "semantic_vad". eagerness: Turn detection eagerness level. Can be "low", "medium", "high", or "auto". create_response: Whether to automatically create responses on turn detection. interrupt_response: Whether to interrupt ongoing responses on turn detection. semantic_vadrN)lowmediumhighauto eagernesscreate_responseinterrupt_response) rrrrrrrrr>r?boolr@rrrr8r8csO/=D(7>* +?OKL MT7;M834;:>OX67>RVNHU=2G#MNOVrrGcZeZdZUdZdZeeeee fe d<dZ ee e d<dZ eee d<y) AudioOutputzAudio output configuration. Parameters: format: The format of the output audio. voice: The voice the model uses to respond. speed: The speed of the model's spoken response. NrHvoicespeed)rrrrrHrrrrr!rrNrrOr5rrrrMrMsBQUFHU>?OKL MTE8C=!E8E?!rrMc:eZdZUdZdZeeed<dZee ed<y)AudioConfigurationzAudio configuration for input and output. Parameters: input: Configuration for input audio. output: Configuration for output audio. Ninputoutput) rrrrrRrrGrrSrMrrrrQrQs'#'E8J &$(FH[ !(rrQceZdZUdZedZdZeede d<dZ eede d<dZ ee e d <dZ ee e d <dZeeed e d <dZee e d <dZeee d<dZeeeeze d<dZeede d<dZeeeedfe d<dZeeedefe d<dZeee d<dZeee d<dZeee e d<y)SessionPropertiesa4Configuration properties for an OpenAI Realtime session. Parameters: type: The type of session, always "realtime". object: Object type identifier, always "realtime.session". id: Unique identifier for the session. model: The Realtime model used for this session. Note: The model is set at connection time via model arg in __init__ and cannot be changed during the session. output_modalities: The set of modalities the model can respond with. instructions: System instructions for the assistant. audio: Configuration for input and output audio. tools: Available function tools for the assistant. tool_choice: Tool usage strategy ("auto", "none", or "required"). max_output_tokens: Maximum tokens in response or "inf" for unlimited. tracing: Configuration options for tracing. prompt: Reference to a prompt template and its variables. expires_at: Session expiration timestamp. include: Additional fields to include in server outputs. Tarbitrary_types_allowedrealtimerNzrealtime.sessionobjectidr%textaudiooutput_modalities instructionsr]toolsr=nonerequired tool_choiceinfmax_output_tokensr=tracingr' expires_atinclude)rrrrr model_configrrrrrYrZrr%r^rr_r]rQr`r rrdrfrr6rgr'rhrirrrrUrUs),d;L*4D(7:& '448FHW/0 18B E8C=BFxW_%= >?F"&L(3-&*.E8& '.15E8K$t*, -4AEK'"<=>E>Bxc75>&9 :;B6:GXeGFOT12 3:!FHTN! $J $#'GXd3i 'rrUceZdZUdZeded<dZeeed<dZ eeed<dZ eeed<dZ eeed<dZ eed ed <y) ItemContentaContent within a conversation item. Parameters: type: Content type (text, audio, input_text, input_audio, input_image, output_text, or output_audio). text: Text content for text-based items. audio: Base64-encoded audio data for audio items. transcript: Transcribed text for audio items. image_url: Base64-encoded image data as a data URI for input_image items. detail: Detail level for image processing ("auto", "low", or "high"). )r\r] input_text input_audio input_image output_text output_audiorNr\r] transcript image_url)r=r:r<detail) rrrrrrr\rrr]rrrsrtrrrrlrlsh  b D(3-E8C= $J $#Ix}#7;FHW23 4;rrlceZdZUdZedZeed<dZe e ded<e ded <dZ e e d ed <dZ e e d ed <dZ e eeed<dZe eed<dZe eed<dZe eed<dZe eed<y)ConversationItemaA conversation item in the realtime session. Parameters: id: Unique identifier for the item, auto-generated if not provided. object: Object type identifier for the realtime API. type: Item type (message, function_call, or function_call_output). status: Current status of the item. role: Speaker role for message items (user, assistant, or system). content: Content list for message items. call_id: Function call identifier for function_call items. name: Function name for function_call items. arguments: Function arguments as JSON string for function_call items. output: Function output as JSON string for function_call_output items. cPttjjSN)ruuiduuid4hexrrrzConversationItem.sC 0@0@,Ardefault_factoryrZNz realtime.itemrY)message function_callfunction_call_outputr) completed in_progress incompletestatus)user assistantsystemrolecontentcall_idname argumentsrS)rrrrr rZrrrYrrrrrrrlrrrrSrrrrvrvs $ABBB15FHW_- .5 D EEJNFHWEF GN=AD(789 :A+/GXd;' (/!GXc]!D(3-#Ix}# FHSM rrvc,eZdZUdZeed<eded<y)RealtimeConversationzA realtime conversation session. Parameters: id: Unique identifier for the conversation. object: Object type identifier, always "realtime.conversation". rZzrealtime.conversationrYN)rrrrrrrrrrrr s G + ,,rrceZdZUdZdgZeeeded<dZ ee ed<dZ ee ed<dZ eeeed<dZeeded <dZeeed <dZeeeed fed <y) ResponsePropertiesaProperties for configuring assistant responses. Parameters: output_modalities: Output modalities for the response. Must be either ["text"] or ["audio"]. Defaults to ["audio"]. instructions: Specific instructions for this response. audio: Audio configuration for this response. tools: Available tools for this response. tool_choice: Tool usage strategy for this response. temperature: Sampling temperature for this response. max_output_tokens: Maximum tokens for this response. r]r[r^Nr_r`rard temperaturererf)rrrrr^rrrrr_rr]rQr`rrdrr5rfrr6rrrrrs DK)xW_%= >?K"&L(3-&*.E8& '."&E8DJ &AEK'"<=>E#'K%'>Bxc75>&9 :;BrrcbeZdZUdZeed<dZeeed<eed<dZeeed<dZ eeed<y) RealtimeErrora>Error information from the realtime API. Parameters: type: Error type identifier. code: Specific error code. message: Human-readable error message. param: Parameter name that caused the error, if applicable. event_id: Event ID associated with the error, if applicable. rcoderNparamevent_id) rrrrrrrrrrrrrrr1s= ID(3- LE8C="Hhsm"rrc0eZdZUdZedZeed<y) ClientEventzBase class for client events sent to the realtime API. Parameters: event_id: Unique identifier for the event, auto-generated if not provided. c<ttjSrx)rryrzrrrr|zClientEvent.Os#djjl2Crr}rN)rrrrr rrrrrrrrHs *CDHcDrrcReZdZUdZdZeded<eed<dee e fffd Z xZ S)SessionUpdateEventzEvent to update session properties. Parameters: type: Event type, always "session.update". session: Updated session properties. zsession.updatersessionreturnct||i|}d|dvrH|ddr@d|ddvr6|dddr+d|dddvr|dddddurd|dddd<|S)a`Serialize the event to a dictionary. Handles special serialization for turn_detection where False becomes null. Args: *args: Positional arguments passed to parent model_dump. **kwargs: Keyword arguments passed to parent model_dump. Returns: Dictionary representation of the event. r]rrRrKFN)r) model_dump)r+argskwargsdumpr,s rrzSessionUpdateEvent.model_dump]sw!4262 d9o %$y/'*B$y/'22tIw7OPW7X#tIw'?'HHIw/89IJeSNRY09:JK r) rrrrrrrrUrrrrr-r.s@rrrRs9'7D'" #6 T#s(^rrc0eZdZUdZdZeded<eed<y)InputAudioBufferAppendEventzEvent to append audio data to the input buffer. Parameters: type: Event type, always "input_audio_buffer.append". audio: Base64-encoded audio data to append. zinput_audio_buffer.appendrr]Nrrrrrrrrrrrrrus2MD'- .L Jrrc&eZdZUdZdZeded<y)InputAudioBufferCommitEventzEvent to commit the current input audio buffer. Parameters: type: Event type, always "input_audio_buffer.commit". zinput_audio_buffer.commitrNrrrrrrs 2MD'- .Lrrc&eZdZUdZdZeded<y)InputAudioBufferClearEventzyEvent to clear the input audio buffer. Parameters: type: Event type, always "input_audio_buffer.clear". zinput_audio_buffer.clearrNrrrrrrs 1KD', -JrrcDeZdZUdZdZeded<dZee ed<e ed<y)ConversationItemCreateEventzEvent to create a new conversation item. Parameters: type: Event type, always "conversation.item.create". previous_item_id: ID of the item to insert after, if any. item: The conversation item to create. zconversation.item.createrNprevious_item_iditem) rrrrrrrrrrrvrrrrrs/1KD', -J&*hsm* rrcDeZdZUdZdZeded<eed<eed<eed<y)ConversationItemTruncateEventaIEvent to truncate a conversation item's audio content. Parameters: type: Event type, always "conversation.item.truncate". item_id: ID of the item to truncate. content_index: Index of the content to truncate within the item. audio_end_ms: End time in milliseconds for the truncated audio. zconversation.item.truncateritem_id content_index audio_end_msN) rrrrrrrrr6rrrrrs+3OD'. /N Lrrc0eZdZUdZdZeded<eed<y)ConversationItemDeleteEventzEvent to delete a conversation item. Parameters: type: Event type, always "conversation.item.delete". item_id: ID of the item to delete. zconversation.item.deleterrNrrrrrrs1KD', -J Lrrc0eZdZUdZdZeded<eed<y)ConversationItemRetrieveEventzEvent to retrieve a conversation item by ID. Parameters: type: Event type, always "conversation.item.retrieve". item_id: ID of the item to retrieve. zconversation.item.retrieverrNrrrrrrs3OD'. /N Lrrc:eZdZUdZdZeded<dZee ed<y)ResponseCreateEventzEvent to create a new assistant response. Parameters: type: Event type, always "response.create". response: Optional response configuration properties. zresponse.createrNresponse) rrrrrrrrrrrrrrrs)(9D'# $8-1Hh)*1rrc&eZdZUdZdZeded<y)ResponseCancelEventzyEvent to cancel the current assistant response. Parameters: type: Event type, always "response.cancel". zresponse.cancelrNrrrrrrs (9D'# $8rrc8eZdZUdZedZeed<eed<y) ServerEventzBase class for server events received from the realtime API. Parameters: event_id: Unique identifier for the event. type: Type of the server event. TrVrrN)rrrrr rjrrrrrrrsd;LM Irrc,eZdZUdZeded<eed<y)SessionCreatedEventzEvent indicating a session has been created. Parameters: type: Event type, always "session.created". session: The created session properties. session.createdrrNrrrrrrrUrrrrr # $$ rrc,eZdZUdZeded<eed<y)SessionUpdatedEventzEvent indicating a session has been updated. Parameters: type: Event type, always "session.updated". session: The updated session properties. session.updatedrrNrrrrrrrrrc,eZdZUdZeded<eed<y)ConversationCreatedzEvent indicating a conversation has been created. Parameters: type: Event type, always "conversation.created". conversation: The created conversation. conversation.createdr conversationN)rrrrrrrrrrrr s ( ))&&rrc@eZdZUdZeded<dZeeed<e ed<y)ConversationItemAddedzEvent indicating a conversation item has been added. Parameters: type: Event type, always "conversation.item.added". previous_item_id: ID of the previous item, if any. item: The added conversation item. conversation.item.addedrNrr rrrrrrrrrrvrrrrrs* + ,,&*hsm* rrc@eZdZUdZeded<dZeeed<e ed<y)ConversationItemDonezEvent indicating a conversation item is done processing. Parameters: type: Event type, always "conversation.item.done". previous_item_id: ID of the previous item, if any. item: The completed conversation item. conversation.item.donerNrrrrrrrr&s* * ++&*hsm* rrc@eZdZUdZeded<eed<eed<eed<y),ConversationItemInputAudioTranscriptionDeltaaOEvent containing incremental input audio transcription. Parameters: type: Event type, always "conversation.item.input_audio_transcription.delta". item_id: ID of the conversation item being transcribed. content_index: Index of the content within the item. delta: Incremental transcription text. 1conversation.item.input_audio_transcription.deltarrrdeltaNrrrrrrrr6rrrrr4s% E FF L Jrrc@eZdZUdZeded<eed<eed<eed<y)0ConversationItemInputAudioTranscriptionCompletedaXEvent indicating input audio transcription is complete. Parameters: type: Event type, always "conversation.item.input_audio_transcription.completed". item_id: ID of the conversation item that was transcribed. content_index: Index of the content within the item. transcript: Complete transcription text. 5conversation.item.input_audio_transcription.completedrrrrrNrrrrrrDs% I JJ LOrrc@eZdZUdZeded<eed<eed<eed<y)-ConversationItemInputAudioTranscriptionFaileda`Event indicating input audio transcription failed. Parameters: type: Event type, always "conversation.item.input_audio_transcription.failed". item_id: ID of the conversation item that failed transcription. content_index: Index of the content within the item. error: Error details for the transcription failure. 2conversation.item.input_audio_transcription.failedrrrerrorN) rrrrrrrr6rrrrrrTs& F GG L rrc@eZdZUdZeded<eed<eed<eed<y)ConversationItemTruncatedaKEvent indicating a conversation item has been truncated. Parameters: type: Event type, always "conversation.item.truncated". item_id: ID of the truncated conversation item. content_index: Index of the content within the item. audio_end_ms: End time in milliseconds for the truncated audio. conversation.item.truncatedrrrrNrrrrrrds& / 00 Lrrc,eZdZUdZeded<eed<y)ConversationItemDeletedzEvent indicating a conversation item has been deleted. Parameters: type: Event type, always "conversation.item.deleted". item_id: ID of the deleted conversation item. conversation.item.deletedrrN)rrrrrrrrrrrrts - .. Lrrc,eZdZUdZeded<eed<y)ConversationItemRetrievedzEvent containing a retrieved conversation item. Parameters: type: Event type, always "conversation.item.retrieved". item: The retrieved conversation item. conversation.item.retrievedrrN)rrrrrrrvrrrrrs / 00 rrc,eZdZUdZeded<ded<y)ResponseCreatedzEvent indicating an assistant response has been created. Parameters: type: Event type, always "response.created". response: The created response object. response.createdrResponserNrrrrrrrrrrrs $ %%rrc,eZdZUdZeded<ded<y) ResponseDonezEvent indicating an assistant response is complete. Parameters: type: Event type, always "response.done". response: The completed response object. response.donerrrNrrrrrrs / ""rrc@eZdZUdZeded<eed<eed<eed<y)ResponseOutputItemAddedaEvent indicating an output item has been added to a response. Parameters: type: Event type, always "response.output_item.added". response_id: ID of the response. output_index: Index of the output item. item: The added conversation item. response.output_item.addedr response_id output_indexrN rrrrrrrr6rvrrrrrs' . // rrc@eZdZUdZeded<eed<eed<eed<y)ResponseOutputItemDoneaEvent indicating an output item is complete. Parameters: type: Event type, always "response.output_item.done". response_id: ID of the response. output_index: Index of the output item. item: The completed conversation item. response.output_item.donerrrrNrrrrrrs' - .. rrcTeZdZUdZeded<eed<eed<eed<eed<eed<y ) ResponseContentPartAddedarEvent indicating a content part has been added to a response. Parameters: type: Event type, always "response.content_part.added". response_id: ID of the response. item_id: ID of the conversation item. output_index: Index of the output item. content_index: Index of the content part. part: The added content part. response.content_part.addedrrrrrpartN rrrrrrrr6rlrrrrrs2  / 00 L rrcTeZdZUdZeded<eed<eed<eed<eed<eed<y ) ResponseContentPartDoneadEvent indicating a content part is complete. Parameters: type: Event type, always "response.content_part.done". response_id: ID of the response. item_id: ID of the conversation item. output_index: Index of the output item. content_index: Index of the content part. part: The completed content part. response.content_part.donerrrrrrNrrrrrrs2  . // L rrcTeZdZUdZeded<eed<eed<eed<eed<eed<y ) ResponseTextDeltaaiEvent containing incremental text from a response. Parameters: type: Event type, always "response.output_text.delta". response_id: ID of the response. item_id: ID of the conversation item. output_index: Index of the output item. content_index: Index of the content part. delta: Incremental text content. response.output_text.deltarrrrrrNrrrrrrs1  . // L JrrcTeZdZUdZeded<eed<eed<eed<eed<eed<y ) ResponseTextDonea\Event indicating text content is complete. Parameters: type: Event type, always "response.output_text.done". response_id: ID of the response. item_id: ID of the conversation item. output_index: Index of the output item. content_index: Index of the content part. text: Complete text content. response.output_text.donerrrrrr\Nrrrrrrs1  - .. L IrrcTeZdZUdZeded<eed<eed<eed<eed<eed<y ) ResponseAudioTranscriptDeltaaEvent containing incremental audio transcript from a response. Parameters: type: Event type, always "response.output_audio_transcript.delta". response_id: ID of the response. item_id: ID of the conversation item. output_index: Index of the output item. content_index: Index of the content part. delta: Incremental transcript text. &response.output_audio_transcript.deltarrrrrrNrrrrrrs1  : ;; L JrrcTeZdZUdZeded<eed<eed<eed<eed<eed<y ) ResponseAudioTranscriptDoneauEvent indicating audio transcript is complete. Parameters: type: Event type, always "response.output_audio_transcript.done". response_id: ID of the response. item_id: ID of the conversation item. output_index: Index of the output item. content_index: Index of the content part. transcript: Complete transcript text. %response.output_audio_transcript.donerrrrrrrNrrrrr r (s1  9 :: LOrr cTeZdZUdZeded<eed<eed<eed<eed<eed<y ) ResponseAudioDeltaa}Event containing incremental audio data from a response. Parameters: type: Event type, always "response.output_audio.delta". response_id: ID of the response. item_id: ID of the conversation item. output_index: Index of the output item. content_index: Index of the content part. delta: Base64-encoded incremental audio data. response.output_audio.deltarrrrrrNrrrrrr<s1  / 00 L JrrcJeZdZUdZeded<eed<eed<eed<eed<y) ResponseAudioDonea9Event indicating audio content is complete. Parameters: type: Event type, always "response.output_audio.done". response_id: ID of the response. item_id: ID of the conversation item. output_index: Index of the output item. content_index: Index of the content part. response.output_audio.donerrrrrNrrrrrrPs, . // LrrcTeZdZUdZeded<eed<eed<eed<eed<eed<y ) "ResponseFunctionCallArgumentsDeltaa~Event containing incremental function call arguments. Parameters: type: Event type, always "response.function_call_arguments.delta". response_id: ID of the response. item_id: ID of the conversation item. output_index: Index of the output item. call_id: ID of the function call. delta: Incremental function arguments as JSON. &response.function_call_arguments.deltarrrrrrNrrrrrrbs0  : ;; L L JrrcTeZdZUdZeded<eed<eed<eed<eed<eed<y ) !ResponseFunctionCallArgumentsDoneaEvent indicating function call arguments are complete. Parameters: type: Event type, always "response.function_call_arguments.done". response_id: ID of the response. item_id: ID of the conversation item. output_index: Index of the output item. call_id: ID of the function call. arguments: Complete function arguments as JSON string. %response.function_call_arguments.donerrrrrrNrrrrrrvs0  9 :: L LNrrc6eZdZUdZeded<eed<eed<y)InputAudioBufferSpeechStartedaEvent indicating speech has started in the input audio buffer. Parameters: type: Event type, always "input_audio_buffer.speech_started". audio_start_ms: Start time of speech in milliseconds. item_id: ID of the associated conversation item. !input_audio_buffer.speech_startedraudio_start_msrNrrrrrrr6rrrrrrs  5 66 Lrrc6eZdZUdZeded<eed<eed<y)InputAudioBufferSpeechStoppeda Event indicating speech has stopped in the input audio buffer. Parameters: type: Event type, always "input_audio_buffer.speech_stopped". audio_end_ms: End time of speech in milliseconds. item_id: ID of the associated conversation item. !input_audio_buffer.speech_stoppedrrrNrrrrrrs  5 66 Lrrc@eZdZUdZeded<dZeeed<eed<y)InputAudioBufferCommittedaEvent indicating the input audio buffer has been committed. Parameters: type: Event type, always "input_audio_buffer.committed". previous_item_id: ID of the previous item, if any. item_id: ID of the committed conversation item. input_audio_buffer.committedrNrr) rrrrrrrrrrrrr"r"s) 0 11&*hsm* Lrr"c"eZdZUdZeded<y)InputAudioBufferClearedzEvent indicating the input audio buffer has been cleared. Parameters: type: Event type, always "input_audio_buffer.cleared". input_audio_buffer.clearedrNrrrrr%r%s . //rr%c,eZdZUdZeded<eed<y) ErrorEventzEvent indicating an error occurred. Parameters: type: Event type, always "error". error: Error details. rrN)rrrrrrrrrrr(r(s '  rr(c<eZdZUdZeded<eeee fed<y)RateLimitsUpdatedzEvent indicating rate limits have been updated. Parameters: type: Event type, always "rate_limits.updated". rate_limits: List of rate limit information. rate_limits.updatedr rate_limitsN) rrrrrrrrrrrrrr*r*s( ' ((d38n%%rr*c:eZdZUdZdZeeed<dZeeed<y)CachedTokensDetailszDetails about cached tokens. Parameters: text_tokens: Number of cached text tokens. audio_tokens: Number of cached audio tokens. r text_tokens audio_tokensN) rrrrr/rr6rr0rrrr.r.s%"#K#""#L(3-#rr.ceZdZUdZedZdZeee d<dZ eee d<dZ eee d<dZ ee e d <dZeee d <y) TokenDetailsaDetailed token usage information. Parameters: cached_tokens: Number of cached tokens used. Defaults to 0. text_tokens: Number of text tokens used. Defaults to 0. audio_tokens: Number of audio tokens used. Defaults to 0. cached_tokens_details: Detailed breakdown of cached tokens. image_tokens: Number of image tokens used (for input only). allow)extrar cached_tokensr/r0Ncached_tokens_details image_tokens)rrrrr rjr5rr6rr/r0r6r.r7rrrr2r2s\G,L#$M8C=$!"K#""#L(3-#;?8$78?"#L(3-#rr2cDeZdZUdZeed<eed<eed<eed<eed<y)UsageaeToken usage statistics for a response. Parameters: total_tokens: Total number of tokens used. input_tokens: Number of input tokens used. output_tokens: Number of output tokens used. input_token_details: Detailed breakdown of input token usage. output_token_details: Detailed breakdown of output token usage. total_tokens input_tokens output_tokensinput_token_detailsoutput_token_detailsN)rrrrr6rr2rrrr9r9s'%%&&rr9ceZdZUdZeed<eded<eded<eed<ee ed<d Z e eed ed <d Z e e eed fed <d Ze eed<d Ze eed<d Ze eed<d Ze eed<d Ze eed<y )ra.A complete assistant response. Parameters: id: Unique identifier for the response. object: Object type, always "realtime.response". status: Current status of the response. status_details: Additional status information. output: List of conversation items in the response. conversation_id: Which conversation the response is added to. output_modalities: The set of modalities the model used to respond. max_output_tokens: Maximum number of output tokens used. audio: Audio configuration for the response. usage: Token usage statistics for the response. voice: The voice the model used to respond. temperature: Sampling temperature used for the response. output_audio_format: The format of output audio. rZzrealtime.responserY)rrr cancelledfailedrstatus_detailsrSNr[r^rerfr]usagerNroutput_audio_format)rrrrrrrrrrvr^rrfrr6r]rQrCr9rNrr5rDrrrrrs$ G ' (( S TT ! ""BFxW_%= >?F>Bxc75>&9 :;B*.E8& '.!E8E?!E8C=#'K%')-#-rrrrrrr#r&rr rrrrrrrrr)rrrrrrrr r rrrrr+c tj|}|d}|tvrtd|t|j |S#t$r}t|d|d}~wwxYw)a Parse a server event from JSON string. Args: str: JSON string containing the server event. Returns: Parsed server event object of the appropriate type. Raises: Exception: If the event type is unimplemented or parsing fails. rz!Unimplemented server event type: z N)jsonloads_server_event_types Exceptionmodel_validate)revent event_typees rparse_server_eventrNLsu* 36] 0 0? |LM M":.==eDD *1#U3%())*sAA A(A##A()RrrFrytypingrrrrrrpydanticr r r %pipecat.adapters.schemas.tools_schemar rrrr!r#r0r8rCrGrMrQrUrlrvrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrrr"r%r(r*r.r2r9rrHrNrrrrRsEN <<11=) ![ !/k//k/HiH. -I - .I . 7y7 W W ") " ) ))( )(b<)<,!y!< -9 -CC2#I#.E)E  F + M+MKK +  K  +  K  2+ 29+9 )  +  +  '+ ' K  ;  ;  {  K    k    k  ;  k  [  {(k( ({(;(+(( $( ( K  K   0k0   & & $) $$9$('I'$.y.B  Z * * /  #$=  !"9 ()F ()F 4 2 89e <=m 9:g "#<  !8  "#