qi&dZddlZddlZddlmZddlmZmZmZm Z m Z ddl m Z ddl mZddlmZddlmZmZdd lmZmZdd lmZGd d e ZGd deZy)z(OpenAI Realtime LLM adapter for Pipecat.N) dataclass)AnyDictListOptional TypedDict)logger)BaseLLMAdapter)FunctionSchema) AdapterType ToolsSchema) LLMContextLLMContextMessage)eventsc`eZdZUdZeeed<eejed<ee ee fed<y)!OpenAIRealtimeLLMInvocationParamszContext-based parameters for invoking OpenAI Realtime API. This is a placeholder until support for universal LLMContext machinery is added for OpenAI Realtime. system_instructionmessagestoolsN) __name__ __module__ __qualname____doc__rstr__annotations__rrConversationItemrrd/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/adapters/services/open_ai_realtime_adapter.pyrrs7 ! %6**++ S#X rrceZdZdZedefdZdedefdZ de e ee ffdZ eGddZd e edefd Zd edej&fd Zed ede ee ffdZdede e ee ffdZy)OpenAIRealtimeLLMAdapterzLLM adapter for OpenAI Realtime API function calling. Converts Pipecat's tool schemas into the specific format required by OpenAI's Realtime API for function calling capabilities. returncy)zLGet the identifier used in LLMSpecificMessage instances for OpenAI Realtime.zopenai-realtimer)selfs rid_for_llm_specific_messagesz5OpenAIRealtimeLLMAdapter.id_for_llm_specific_messages)s!rcontextc|j|j|}|j|j|j |j xsgdS)a{Get OpenAI Realtime-specific LLM invocation parameters from a universal LLM context. This is a placeholder until support for universal LLMContext machinery is added for OpenAI Realtime. Args: context: The LLM context containing messages, tools, etc. Returns: Dictionary of parameters for invoking OpenAI Realtime's API. )rrr) _from_universal_context_messages get_messagesrrfrom_standard_toolsr)r$r&rs rget_llm_invocation_paramsz2OpenAIRealtimeLLMAdapter.get_llm_invocation_params.sR889J9J79ST"*"="= ))--gmm<B   rcng}|j|D]}tj|}d|vrUt|dtrB|dD]:}|ddk(r|ddj drd|dd<|ddk(s3d|dd <<d |vr|d j d rd|d <|j ||S) aGet messages from a universal LLM context in a format ready for logging about OpenAI Realtime. Removes or truncates sensitive data like image content for safe logging. This is a placeholder until support for universal LLMContext machinery is added for OpenAI Realtime. Args: context: The LLM context containing messages. Returns: List of messages in a format ready for logging about OpenAI Realtime. contenttype image_urlurlz data:image/zdata:image/... input_audioz...data mime_typezimage/)r)copydeepcopy isinstancelist startswithappend)r$r&msgsmessagemsgitems rget_messages_for_loggingz1OpenAIRealtimeLLMAdapter.get_messages_for_loggingAs"((1 G--(CCc)nd3 #I@<;6#K07BB=Q;K[ 1% 8<=8:?D/7 @ c!c+&6&A&A(&K#F KK   rcJeZdZUdZeej ed<dZe e ed<y)*OpenAIRealtimeLLMAdapter.ConvertedMessageszIContainer for OpenAI-formatted messages converted from universal context.rNr) rrrrrrrrrrrrrrConvertedMessagesr@bs%Wv..//,0HSM0rrAuniversal_context_messagesc |s|jgStj|}d}|djddk(rn|j d}|jd}t |t r|}n$t |tr|djd}|s|jg|St|dk(r=|djdd k(r&|j|j|dg|Sd }d }|jd d d dj|tj|d|gdgdg|S)N)rrrolesystemr-text)rruserz This is a previously saved conversation. Please treat this conversation history as a starting point for the current conversation.aS This is the end of the previously saved conversation. Please continue the conversation from here. If the last message is a user instruction or question, act on that instruction or answer the question. If the last message is an assistant response, simple say that you are ready to continue the conversation.r; input_textz )indentr.rFrDr.r-) rAr4r5getpopr6rr7len_from_universal_context_messagejoinjsondumps)r$rBrrrEr- intro_text trailing_texts rr(z9OpenAIRealtimeLLMAdapter._from_universal_context_messagesisj*))2)6 6==!;<! A;??6 "h .\\!_Fjj+G'3'%,"GT*%,QZ^^F%;"--rN`-aa x=A (1+//&"9V"C))>>x{KL#5* 8 3 %%#%%1$*KK!+TZZ-K] [%    2&  rr;c|jddk(r|jd}t|jdtrnd}|jdD]X}|jddk(r|d|jdzz }/tjd|jdd |Zt j dd t jd | g S|jddk(rM|jdr<|jdd}t j d|d|dd|ddStjd|y)NrDrHr-r.rF z+Unhandled content type in context message: z - r;rIrLrM assistant tool_callsr function_callidfunctionname arguments)r.call_idr_r`z;Unhandled message type in _from_universal_context_message: )rNr6r7r errorrr ItemContent)r$r;r-ctcs rrQz8OpenAIRealtimeLLMAdapter._from_universal_context_messagesN ;;v & (kk),G'++i0$7 Y/AuuV}.3v#66 I!%%PV-X[\c[de **++GLM  ;;v + -'++l2K\*1-B**$4 ^F+Z.5    RSZR[\]rr^chd|j|jd|j|jddS)zConvert a function schema to OpenAI Realtime format. Args: function: The function schema to convert. Returns: Dictionary in OpenAI Realtime function format. r^object)r. propertiesrequired)r.r_ description parameters)r_rjrhri)r^s r#_to_openai_realtime_function_formatzrrArr(rrrQ staticmethodr rlr rurrrr!r!"s !c!!  @a &4S#X3GB111 = *./@*A= = ~^(^  ^: n cSVh  (.[.T$sTWx.EY.rr!)rr4rS dataclassesrtypingrrrrrlogurur !pipecat.adapters.base_llm_adapterr (pipecat.adapters.schemas.function_schemar %pipecat.adapters.schemas.tools_schemar r *pipecat.processors.aggregators.llm_contextrr pipecat.services.openai.realtimerrr!rrrrsE/ !77<CJT3  P.~P.r