qidZddlZddlmZddlmZddlmZm Z m Z m Z m Z ddl mZmZddlmZGd d e d ZGd de d ZeGdde ZdgZy)z Processor class for Chameleon. N) BatchFeature) ImageInput)MultiModalDataProcessingKwargsProcessorMixin TextKwargsUnpack)PreTokenizedInput TextInput)auto_docstringceZdZUdZeed<y)ChameleonTextKwargsa return_for_text_completion (`bool`, *optional*, defaults to `False`): Whether the processed text is intended for text completion tasks. When `True`, the processor does not append the separator token (`sep_token`) to the end of the prompt, which is typically used for chat mode. When `False`, the separator token is appended for proper chat formatting. return_for_text_completionN)__name__ __module__ __qualname____doc__bool__annotations__d/opt/pipecat/venv/lib/python3.12/site-packages/transformers/models/chameleon/processing_chameleon.pyrr!s!%$rrF)totalc.eZdZUeed<ddddddidZy)ChameleonProcessorKwargs text_kwargsF)paddingrreturn_mm_token_type_idsreturn_tensorspt)r common_kwargsN)rrrrr _defaultsrrrrr,s+$$*/(- d Irrc eZdZd dedeffd Ze d dedzdee ze eze e zdzde e de fd Zd d ZxZS)ChameleonProcessorimage_seq_length image_tokenc>||_t|dr |jn||_|j|j|_t|dr |j nd|_t|dr |jnd|_|j|j|_|j|j |_ |j|j|_ |j|j|jg|_ t|5||y)a image_seq_length (`int`, *optional*, defaults to 1024): Sequence length of one image embedding. image_token (`str`, *optional*, defaults to `""`): The special token used to indicate image in the text. r' boi_tokenz eoi_tokenzN)r&hasattrr'convert_tokens_to_idsimage_token_idr)image_start_tokenr*image_end_tokenimage_start_token_idimage_end_token_id image_idssuper__init__)selfimage_processor tokenizerr&r' __class__s rr4zChameleonProcessor.__init__<s!14;I}4U900[f'==d>N>NO#*9k#BI   7>i6Uy22[c'==d>N>NO$-$C$CDDZDZ$[!"+"A"A$BVBV"W--t/H/H$JaJab )4rNimagestextkwargsreturnc t|tr|g}n.t|tst|dts td| | t d|j t fd|jji|}|djdd}g}|j|j|jzz|jz}|D]J}|j|j|}|s||jjz }|j!|Li} ||j"|fi|d } |djd d} |djd d} |j|fi|dd di} |j%|| d g | rft'j(| d} t'j*| d}d|t'j,| |j.<|j1| d<t3i| | | S)aA Returns: [`BatchFeature`]: A [`BatchFeature`] with the following fields: - **input_ids** -- List of token ids to be fed to a model. Returned when `text` is not `None`. - **attention_mask** -- List of indices specifying which tokens should be attended to by the model (when `return_attention_mask=True` or if *"attention_mask"* is in `self.model_input_names` and if `text` is not `None`). - **pixel_values** -- Pixel values to be fed to a model. Returned when `images` is not `None`. rzAInvalid input text. Please provide a string, or a list of stringsNz&You must provide either text or imagestokenizer_init_kwargsrrF images_kwargsr rimage) modalities input_idsmm_token_type_ids)data tensor_type) isinstancestrlist TypeError ValueError _merge_kwargsrr7 init_kwargspopr.r'r&r/replace sep_tokenappendr6_check_special_mm_tokensnparray zeros_likeisinr2tolistr)r5r9r:r; output_kwargsrprompt_stringsone_img_tokenssample image_inputsr r text_inputs array_idsrDs r__call__zChameleonProcessor.__call__Qs$ dC 6DD$' 47C0H_` ` )NN)N)rrrintrHr4r rr r rIr rrr_rh __classcell__)r8s@rr%r%:s5S5^a5*%)ae7^T!7^++d9o=EV@WWZ^^7^12 7^  7^7^r-rr%)rnumpyrSfeature_extraction_utilsr image_utilsrprocessing_utilsrrrr r tokenization_utils_baser r utilsr rrr%__all__rrrrrsn4%D#%*E% /u e-e-e-P r