qi&dZddlmZddlmZmZmZddlmZddl m Z ddl m Z ddl mZddlmZdd lmZdd lmZeGd d eZGd deZy)zEMistral LLM service implementation using OpenAI-compatible interface.) dataclass)ListOptionalSequence)logger)ChatCompletionMessageParam)OpenAILLMInvocationParams)FunctionCallFromLLM)OpenAILLMSettings)OpenAILLMService)_warn_deprecated_paramceZdZdZy)MistralLLMSettingszSettings for MistralLLMService.N)__name__ __module__ __qualname____doc__N/opt/pipecat/venv/lib/python3.12/site-packages/pipecat/services/mistral/llm.pyrrs)rrc eZdZUdZeZeed<dddddededeed eeffd Z dfd Z d e e d e e fdZ deeffd Zded efdZxZS)MistralLLMServicezA service for interacting with Mistral's API using the OpenAI-compatible interface. This service extends OpenAILLMService to connect to Mistral's API endpoint while maintaining full compatibility with OpenAI's interface and functionality. _settingszhttps://api.mistral.ai/v1N)base_urlmodelsettingsapi_keyrrrc td}|tdtd||_||j|t |d|||d|y)aInitialize the Mistral LLM service. Args: api_key: The API key for accessing Mistral's API. base_url: The base URL for Mistral API. Defaults to "https://api.mistral.ai/v1". model: The model identifier to use. Defaults to "mistral-small-latest". .. deprecated:: 0.0.105 Use ``settings=OpenAILLMSettings(model=...)`` instead. settings: Runtime-updatable settings. When provided alongside deprecated parameters, ``settings`` values take precedence. **kwargs: Additional keyword arguments passed to OpenAILLMService. zmistral-small-latest)rNr)rrrr)rr r apply_updatesuper__init__)selfrrrrkwargsdefault_settings __class__s rr!zMistralLLMService.__init__'s`0.4JK   "7,> H%*  "    ) )( 3 a8FVaZ`arc Vtjd|t| ||fi|S)aCreate OpenAI-compatible client for Mistral API endpoint. Args: api_key: The API key for authentication. If None, uses instance key. base_url: The base URL for the API. If None, uses instance URL. **kwargs: Additional arguments passed to the client constructor. Returns: An OpenAI-compatible client configured for Mistral API. z!Creating Mistral client with api )rdebugr create_client)r"rrr#r%s rr(zMistralLLMService.create_clientNs0  8 CDw$WhA&AArmessagesreturncZ|s|S|Dcgc] }t|}}g}t|D]Z\}}|jddk(s|t|dz k(s||dzjddk7sG|j |dz\t |D]}|j |dddtdt|Dt|}t|D]%\}}|jddk(s||k\s!d |d<'|d }|jddk(r d |vrd |d <|Scc}w) a-Apply fixups to messages to meet Mistral-specific requirements. 1. A "tool"-role message must be followed by an assistant message. 2. "system"-role messages must only appear at the start of a conversation. 3. Assistant messages must have prefix=True when they are the final message in a conversation (but at no other point). Args: messages: The original list of messages. Returns: Messages with Mistral prefix requirement applied to final assistant message. roletool assistant r,contentc3PK|]\}}|jddk7s| yw)r,systemN)get).0imsgs r z:MistralLLMService._apply_mistral_fixups..s# V61c#''&/X:UQ Vs&&r4userprefixT)dict enumerater5lenappendreversedinsertnext) r"r)r8fixed_messagesassistant_insert_indicesr7idxfirst_non_system_idx last_messages r_apply_mistral_fixupsz'MistralLLMService._apply_mistral_fixups\s]&O088$s)88$& / ;FAswwv&(N+a//>!a%3H3L3LV3TXc3c,33AE:  ; 45 NC  ! !# 'L M N $ VY~6 V    / %FAswwv(*q4H/H$F  % &b)    F #{ 2x|7S%)L ";9sD(function_callscK|syg}|r|djjng}t}|D]I}|jddk(s|jds*|j |jdK|D]Q}|j |vr|j |#tjd|jd|j S|rt|-|d{yy7w)aExecute function calls, filtering out already-completed ones. Mistral and OpenAI have different function call detection patterns: OpenAI (Stream-based detection): - Detects function calls only from streaming chunks as the LLM generates them - Second LLM completion doesn't re-detect existing tool_calls in message history - Function calls execute exactly once Mistral (Message-based detection): - Detects function calls from the complete message history on each completion - Second LLM completion with the response re-detects the same tool_calls from previous messages - Without filtering, function calls would execute twice This method prevents duplicate execution by: 1. Checking message history for existing tool result messages 2. Filtering out function calls that already have corresponding results 3. Only executing function calls that haven't been completed yet Note: This filtering prevents duplicate function execution, but the on_function_calls_started event may still fire twice due to the detection pattern difference. This is expected behavior. Args: function_calls: The function calls to potentially execute. Nrr,r- tool_call_idz)Skipping already-executed function call: :) context get_messagessetr5addrLr@rtrace function_namer run_function_calls)r"rJcalls_to_executer)executed_call_idsr8callr%s rrTz$MistralLLMService.run_function_callss> @N>!$,,99;SU E ?Cwwv&(SWW^-D!%%cggn&=> ? # D  (99 ''- ?@R@R?SSTUYUfUfTgh   ',-=> > >  >sA C5C5 B C5,C3-C5params_from_contextc ||j|d}|jjd||d|d|jj|jj|jj |jj |jjd }|jjr|jj|d<|j|jj|jjr2|jdg}d|jjdg|z|d<|S) aBuild parameters for Mistral chat completion request. Handles Mistral-specific requirements including: - Assistant message prefix requirement for API compatibility - Parameter mapping (random_seed instead of seed) - Core completion settings r)Ttools tool_choice) rstreamr)rZr[frequency_penaltypresence_penalty temperaturetop_p max_tokens random_seedr4r1) rIrrr]r^r_r`raseedupdateextrasystem_instructionr5)r"rXrDparamsr)s rbuild_chat_completion_paramsz.MistralLLMService.build_chat_completion_paramss334G 4ST^^))&(1.}=!%!A!A $ ? ?>>55^^))..33   >>  $(NN$7$7F= !  dnn**+ >> , ,zz*b1H!dnn.O.OP""F:  r)NN)rrrrrSettings__annotations__strrr!r(rrrIrr rTr r=rh __classcell__)r%s@rrrs "H!! 4#15 %b%b %b } %b -. %bN B4784 ( )4l9?x@S7T9?v'@Y'^b'rrN)r dataclassesrtypingrrrlogururopenai.types.chatr)pipecat.adapters.services.open_ai_adapterr pipecat.frames.framesr pipecat.services.openai.base_llmr pipecat.services.openai.llmr pipecat.services.settingsr rrrrrrvsTL!++8O5>8<  *   W(Wr