§ UùÔinãó—ddlZddlmZmZddlTddlTddlTddlTddlTddl Tddl Tddl Tddl Tddl TddlTddlTddlTddlTddlTddlmZddlTddlTddlTddlTddlTGd„de¦«ZGd„d e¦«ZdS) éN)ÚPretrainedConfigÚ Qwen3Configé)Ú*)Ú RADIOConfigcó2‡—eZdZdZdZ dˆfd„ ZˆxZS) ÚProjectorConfigÚvectorllm_0407_projectorÚ AutoConfigééÚgeluTc 󀕗||_||_||_||_||_t ¦«jdi|¤ŽdS)N©)Úvisual_hidden_sizeÚllm_hidden_sizeÚdepthÚ hidden_actÚbiasÚsuperÚ__init__)ÚselfrrrrrÚkwargsÚ __class__s €úD/home/zhangtao/hf_model/vectorllm_hf_0407/configuration_vectorllm.pyrzProjectorConfig.__init__ sMø€ð#5ˆÔØ.ˆÔ؈Œ Ø$ˆŒØˆŒ Ø�‰ŒÔÐ"Ð"˜6Ð"Ð"Ð"Ð"Ð"ó)r r r rT)Ú__name__Ú __module__Ú __qualname__Ú model_typeÚ _auto_classrÚ __classcell__©rs@rr r sXø€€€€€Ø+€JØ€Kð ØØØØ ð #ð#ð#ð#ð#ð#ð#ð#ð#ð#rr cóN‡—eZdZdZdZdZ dˆfd„ Zd„ZˆxZS)ÚVectorLLMConfigÚvectorllm_hf_0407ÚVectorLLMProcessorTN©é€r)r ré°r)éFÚÚbfloat16c ó$•—| dd¦«}| dd¦«}t¦«jd i|¤Ž|€i}|€i}t|t¦«r| ¦«}nt j|¦«}t|t¦«r| ¦«}nt j|¦«}||_ ||_ td i|¤Ž}t d i|¤Ž}||_ |j |_ |j pi}|€|�|}|�|n| d|j ¦«|_|�t j|¦«|_n3t!|j|j |¬¦« ¦«|_t#|¦«|_||_d|_d| dd¦«z|_||_||_| |_| |_| |_| |_t j| ¦«|_||_dS) NÚvision_hidden_sizeÚprojector_configÚmlp_hidden_size)rrrFrÚregister_multiplerr)ÚgetrrÚ isinstanceÚ HFRADIOConfigÚto_dictÚcopyÚdeepcopyrÚ vision_configÚ llm_configÚ text_configÚ hidden_sizeÚargsr/r0r ÚtupleÚregression_sizeÚ pixel_idxÚtie_word_embeddingsÚnum_cls_register_tokensÚpre_resize_sizeÚ resized_sizeÚ patch_sizeÚ do_normalizeÚvision_model_name_or_pathÚllm_name_or_pathÚvisual_peft_configÚvision_torch_dtype)rr9r:r?Úprojector_depthrr@rCrDrErFrGrHrIrJrÚserialized_visual_hidden_sizeÚserialized_projector_configÚ qwen3_configÚ radio_configÚ radio_argsrs €rrzVectorLLMConfig.__init__6s=ø€ð$)/¯ ª Ð3GÈÑ(NÔ(NÐ%Ø&,§j¢jÐ1CÀTÑ&JÔ&JÐ#Ø�‰ŒÔÐ"Ð"˜6Ð"Ð"Ð"à Р؈MØ Ð ØˆJå �m¥]Ñ 3Ô 3ð 9Ø)×1Ò1Ñ3Ô3ˆMˆMå œM¨-Ñ8Ô8ˆMÝ �j¥+Ñ .Ô .ð 3Ø#×+Ò+Ñ-Ô-ˆJˆJ圠zÑ2Ô2ˆJà*ˆÔØ$ˆŒå"Ð0Ð0 ZÐ0Ð0ˆ Ý$Ð5Ð5 }Ð5Ð5ˆ Ø'ˆÔØ'Ô3ˆÔØ!Ô&Ð,¨"ˆ Ø Ð %Ð*GÐ*SØ!>Ð ð"Ð-ð Ð à—’Ð 1°<Ô3KÑLÔLð Ôð 'Ð 2Ý$(¤MÐ2MÑ$NÔ$NˆDÔ !Ð !å$3Ø#'Ô#:Ø $Ô 0Ø%ð%ñ%ô%÷Šg‰iŒið Ô !õ % _Ñ5Ô5ˆÔØ"ˆŒØ#(ˆÔ Ø'(¨:¯>ª>Ð:MÈqÑ+QÔ+QÑ'QˆÔ$Ø.ˆÔØ(ˆÔØ$ˆŒØ(ˆÔØ)BˆÔ&Ø 0ˆÔÝ"&¤-Ð0BÑ"CÔ"CˆÔØ"4ˆÔÐÐrcó6—tj|j¦«}tj|j¦«|d<tj|j¦«|d<|j ¦«|d<tj|j¦«|d<|jj |d<|S)Nr9r:r;r0r ) r7r8Ú__dict__r9r:r;r6r0rr )rÚoutputs rr6zVectorLLMConfig.to_dict€s…€Ý”˜tœ}Ñ-Ô-ˆÝ"&¤-°Ô0BÑ"CÔ"CˆˆÑÝ#œ}¨T¬_Ñ=Ô=ˆˆ|ÑØ $Ô 0× 8Ò 8Ñ :Ô :ˆˆ}ÑÝ%)¤]°4Ô3HÑ%IÔ%IˆÐ!Ñ"Ø#œ~Ô8ˆˆ|ÑØˆ r)NNr(r Nrr*r)r+Fr,r,Nr-) rrrr Úprocessor_classÚis_compositionrr6r"r#s@rr%r%1sŽø€€€€€Ø$€JØ*€OØ€NðØØ"ØØØØØØØØ"$ØØØ%ðH5ðH5ðH5ðH5ðH5ðH5ðTððððððrr%)r7Ú transformersrrÚ adaptor_baseÚadaptor_genericÚ adaptor_mlpÚadaptor_registryÚ cls_tokenÚcommonÚ dinov2_archÚdual_hybrid_vitÚenable_cpe_supportÚenable_spectral_reparamÚ eradio_modelÚ extra_modelsÚextra_timm_modelsÚfeature_normalizerÚforward_intermediatesÚhf_modelrr5Úinput_conditionerÚopen_clip_adaptorÚ radio_modelÚvit_patch_generatorÚvitdetr r%rrrúrls’ðØ € € € à6Ð6Ð6Ð6Ð6Ð6Ð6Ð6àÐÐÐØÐÐÐØÐÐÐØÐÐÐØÐÐÐØÐÐÐØÐÐÐØÐÐÐØ!Ð!Ð!Ð!Ø&Ð&Ð&Ð&ØÐÐÐØÐÐÐØ Ð Ð Ð Ø!Ð!Ð!Ð!Ø$Ð$Ð$Ð$Ø2Ð2Ð2Ð2Ð2Ð2Ø Ð Ð Ð Ø Ð Ð Ð ØÐÐÐØ"Ð"Ð"Ð"ØÐÐÐð#ð#ð#ð#ð#Ð&ñ#ô#ð#ð*VðVðVðVðVÐ&ñVôVðVðVðVr