qiddlmZddlmZddlmZddlmZddlm Z eje Z Gdd eZ d gZy ) )deepcopy)Any)PreTrainedConfig)logging)CONFIG_MAPPINGcbeZdZUdZdZdeiZeee fe d< d de de ffd Z defd ZxZS) ColModernVBertConfiga Configuration class to store the configuration of a [`ColModernVBertForRetrieval`]. It is used to instantiate an instance of `ColModernVBertForRetrieval` according to the specified arguments, defining the model architecture following the methodology from the "ColPali: Efficient Document Retrieval with Vision Language Models" paper. Instantiating a configuration with the defaults will yield a similar configuration to the vision encoder used by the pre-trained ColModernVBert model, e.g. [ModernVBERT/colmodernvbert-merged](https://huggingface.co/ModernVBERT/colmodernvbert-merged). Configuration objects inherit from [`PreTrainedConfig`] and can be used to control the model outputs. Read the documentation from [`PreTrainedConfig`] for more information. Args: vlm_config (`PreTrainedConfig`, *optional*): Configuration of the VLM backbone model. embedding_dim (`int`, *optional*, defaults to 128): Dimension of the multi-vector embeddings produced by the model. initializer_range (`float`, *optional*, defaults to 0.02): The standard deviation of the truncated_normal_initializer for initializing all weight matrices. Example: ```python from transformers import ColModernVBertConfig, ColModernVBertForRetrieval config = ColModernVBertConfig() model = ColModernVBertForRetrieval(config) ``` colmodernvbert vlm_config sub_configs embedding_diminitializer_rangec |#td}tjdndt|tr,t |}d|vr t dt|ddi|}n(t|tstdt|dt|ds|jj|_ ||_ ||_||_t!|Ddi|y) N modernvbertzc`vlm_config` is `None`. Initializing `vlm_config` with the `ModernVBertConfig` with default values. model_typez^The `model_type` key is missing in the `vlm_config` dictionary. Please provide the model type.zWInvalid type for `vlm_config`. Expected `PreTrainedConfig`, `dict`, or `None`, but got . vocab_size)r loggerinfo isinstancedictrKeyErrorr TypeErrortypehasattrget_text_configrr rrsuper__init__)selfr rrkwargs __class__s q/opt/pipecat/venv/lib/python3.12/site-packages/transformers/models/colmodernvbert/configuration_colmodernvbert.pyr!zColModernVBertConfig.__init__@s  ' 68J KKu  D )!*-J:-t( <(@AOJOJJ(89ijnoyjzi{{|} z<0$.$>$>$@$K$KJ !$*!2 "6"returnc:|jj|i|S)N)r r)r"argsr#s r%rz$ColModernVBertConfig.get_text_config`s.t..???r&)Ng{Gz?)__name__ __module__ __qualname____doc__rrrrstrr__annotations__intfloatr!r __classcell__)r$s@r%r r s[8"J#/1A"BKc3hB #' ##! #@@2B@r&r N)copyrtypingrconfiguration_utilsrutilsrautor get_loggerr+rr __all__rr&r%r;sF*3!   H %A@+A@H " "r&