qi$dZddlZddlZddlmZddlmZmZmZm Z m Z ddl m Z ddl mZddlmZddlmZmZdd lmZmZdd lmZGd d e ZGd deZy)zGrok Realtime LLM adapter for Pipecat. Converts Pipecat's tool schemas and context into the format required by Grok's Voice Agent API. N) dataclass)AnyDictListOptional TypedDict)logger)BaseLLMAdapter)FunctionSchema) AdapterType ToolsSchema) LLMContextLLMContextMessage)eventsc`eZdZUdZeeed<eejed<ee ee fed<y)GrokRealtimeLLMInvocationParamsa7Context-based parameters for invoking Grok Realtime API. Attributes: system_instruction: System prompt/instructions for the session. messages: List of conversation items formatted for Grok Realtime. tools: List of tool definitions (function, web_search, x_search, file_search). system_instructionmessagestoolsN) __name__ __module__ __qualname____doc__rstr__annotations__rrConversationItemrra/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/adapters/services/grok_realtime_adapter.pyrrs7! %6**++ S#X rrceZdZdZedefdZdedefdZ de e ee ffdZ eGddZd e edefd Zd edej&fd Zed ede ee ffdZdede e ee ffdZy)GrokRealtimeLLMAdapterzLLM adapter for Grok Voice Agent API. Converts Pipecat's universal context and tool schemas into the specific format required by Grok's Voice Agent Realtime API. returncy)zJGet the identifier used in LLMSpecificMessage instances for Grok Realtime.z grok-realtimer)selfs rid_for_llm_specific_messagesz3GrokRealtimeLLMAdapter.id_for_llm_specific_messages0srcontextc|j|j|}|j|j|j |j xsgdS)a Get Grok Realtime-specific LLM invocation parameters from a universal LLM context. Args: context: The LLM context containing messages, tools, etc. Returns: Dictionary of parameters for invoking Grok's Voice Agent API. )rrr) _from_universal_context_messages get_messagesrrfrom_standard_toolsr)r$r&rs rget_llm_invocation_paramsz0GrokRealtimeLLMAdapter.get_llm_invocation_params5sR889J9J79ST"*"="= ))--gmm<B  rc*g}|j|D]|}tj|}d|vrPt|dtr=|dD]5}|j ddk(rd|d<|j ddk(s1d|d<7|j |~|S)aGet messages from context in a format safe for logging. Removes or truncates sensitive data like audio content. Args: context: The LLM context containing messages. Returns: List of messages with sensitive data redacted. contenttype input_audioz...audio)r)copydeepcopy isinstancelistgetappend)r$r&msgsmessagemsgitems rget_messages_for_loggingz/GrokRealtimeLLMAdapter.get_messages_for_loggingEs((1 G--(CCc)nd3 #I288F+}<,1DM88F+w6,1DM 2 KK   rcJeZdZUdZeej ed<dZe e ed<y)(GrokRealtimeLLMAdapter.ConvertedMessageszGContainer for Grok-formatted messages converted from universal context.rNr) rrrrrrrrrrrrrrConvertedMessagesr=]s%Uv..//,0HSM0rr>universal_context_messagesc|s|jgStj|}d}|djddk(rn|j d}|jd}t |t r|}n$t |tr|djd}|s|jg|St|d k(r=|djdd k(r&|j|j|dg|Sd }d }|jtjd d tjddj|tj|d|ggg|S)aConvert universal context messages to Grok Realtime format. Similar to OpenAI Realtime, we pack conversation history into a single user message since the realtime API doesn't support loading long histories. Args: universal_context_messages: List of messages in universal format. Returns: ConvertedMessages with Grok-formatted messages and system instruction. )rNrrolesystemr-text)rruserz This is a previously saved conversation. Please treat this conversation history as a starting point for the current conversation.aS This is the end of the previously saved conversation. Please continue the conversation from here. If the last message is a user instruction or question, act on that instruction or answer the question. If the last message is an assistant response, simply say that you are ready to continue the conversation.r8 input_textz )indentr.rCrAr.r-)r>r1r2r5popr3rr4len_from_universal_context_messagerr ItemContentjoinjsondumps)r$r?rrrBr- intro_text trailing_texts rr(z7GrokRealtimeLLMAdapter._from_universal_context_messagesds|*))2)6 6==!;<! A;??6 "h .\\!_Fjj+G'3'%,"GT*%,QZ^^F%;"--rN`-aa x=A (1+//&"9V"C))>>x{KL#5*  8 3 %%''"**!-!'$.$(JJx$B$1!""  $ 2'&  rr8c|jddk(r|jd}t|trod}|D]X}|jddk(r|d|jdzz }/tjd|jdd |Z|j }t jdd t jd | g S|jddk(rM|jdr<|jdd}t jd|d|dd|ddStjd|y)zConvert a single universal context message to Grok format. Args: message: Message in universal format. Returns: ConversationItem formatted for Grok Realtime API. rArEr-r.rC z+Unhandled content type in context message: z - r8rFrIrJ assistant tool_callsr function_callidfunctionname arguments)r.call_idr\r]z;Unhandled message type in _from_universal_context_message: N) r5r3r4r errorstriprrrN)r$r8r- text_contentctcs rrMz6GrokRealtimeLLMAdapter._from_universal_context_messagesJ ;;v & (kk),G'4(!  AuuV}.$aeeFm(;;  I!%%PV-X[\c[de ',,.**++GLM  ;;v + -'++l2K\*1-B**$4 ^F+Z.5    RSZR[\]rr[chd|j|jd|j|jddS)zConvert a function schema to Grok Realtime function format. Args: function: The function schema to convert. Returns: Dictionary in Grok Realtime function format. r[object)r. propertiesrequired)r.r\ description parameters)r\rhrfrg)r[s r_to_grok_function_formatz/GrokRealtimeLLMAdapter._to_grok_function_formats;MM#// &11$--  r tools_schemac|j}|Dcgc]}|j|}}g}|jr*|jjtj g}||zScc}w)aUConvert tool schemas to Grok Realtime format. Supports both standard function tools and Grok-specific tools (web_search, x_search, file_search). Args: tools_schema: The tools schema containing functions to convert. Returns: List of tool definitions in Grok Realtime format. )standard_toolsrj custom_toolsr5r SHIM)r$rkfunctions_schemafuncrm shimmed_toolss rto_provider_tools_formatz/GrokRealtimeLLMAdapter.to_provider_tools_formatsm(66JZ[$$77=[[  $ $(5599+:J:JBOM --\sA(N)rrrrpropertyrr%rrr+rrrr;rr>rr(rrrM staticmethodr rjr rsrrrr!r!)s c  @_ 4S#X3G0111 E *./@*AE E N&^(&^  &^P > d38n  (.[.T$sTWx.EY.rr!)rr1rP dataclassesrtypingrrrrrlogurur !pipecat.adapters.base_llm_adapterr (pipecat.adapters.schemas.function_schemar %pipecat.adapters.schemas.tools_schemar r *pipecat.processors.aggregators.llm_contextrrpipecat.services.grok.realtimerrr!rrrr~sG  !77<CJT1  i  T.^T.r