hCQdZddlmZddlmZddlmZmZeje Z GddeZ Gdd eZ Gd d eZ Gd d eZGddeZgdZy)zSAM2 model configuration)PretrainedConfig)logging)CONFIG_MAPPING AutoConfigcReZdZdZdZdZ dfd ZxZS)Sam2HieraDetConfiga This is the configuration class to store the configuration of a [`Sam2HieraDetModel`]. It is used to instantiate a HieraDet model as defined in the original sam2 repo according to the specified arguments, defining the model architecture. Instantiating a configuration defaults will yield a similar configuration to that of SAM 2.1 Hiera-tiny [facebook/sam2.1-hiera-tiny](https://huggingface.co/facebook/sam2.1-hiera-tiny) architecture. Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the documentation from [`PretrainedConfig`] for more information. Args: hidden_size (`int`, *optional*, defaults to 96): The hidden dimension of the image encoder. num_attention_heads (`int`, *optional*, defaults to 1): Number of attention heads for each attention layer in the Transformer encoder. num_channels (`int`, *optional*, defaults to 3): The number of channels in the image. image_size (`list[int]`, *optional*, defaults to `[1024, 1024]`): The size of the image. patch_kernel_size (`list[int]`, *optional*, defaults to `[7, 7]`): The kernel size of the patch. patch_stride (`list[int]`, *optional*, defaults to `[4, 4]`): The stride of the patch. patch_padding (`list[int]`, *optional*, defaults to `[3, 3]`): The padding of the patch. query_stride (`list[int]`, *optional*, defaults to `[2, 2]`): The downsample stride between stages. window_positional_embedding_background_size (`list[int]`, *optional*, defaults to `[7, 7]`): The window size per stage when not using global attention. num_query_pool_stages (`int`, *optional*, defaults to 3): The number of query pool stages. blocks_per_stage (`list[int]`, *optional*, defaults to `[1, 2, 7, 2]`): The number of blocks per stage. embed_dim_per_stage (`list[int]`, *optional*, defaults to `[96, 192, 384, 768]`): The embedding dimension per stage. num_attention_heads_per_stage (`list[int]`, *optional*, defaults to `[1, 2, 4, 8]`): The number of attention heads per stage. window_size_per_stage (`list[int]`, *optional*, defaults to `[8, 4, 14, 7]`): The window size per stage. global_attention_blocks (`list[int]`, *optional*, defaults to `[5, 7, 9]`): The blocks where global attention is used. mlp_ratio (`float`, *optional*, defaults to 4.0): The ratio of the MLP hidden dimension to the embedding dimension. hidden_act (`str`, *optional*, defaults to `"gelu"`): The non-linear activation function in the neck. layer_norm_eps (`float`, *optional*, defaults to 1e-06): The epsilon for the layer normalization. initializer_range (`float`, *optional*, defaults to 0.02): The standard deviation of the truncated_normal_initializer for initializing all weight matrices. backbone_configsam2_hiera_det_modelc t|d i|||nddg}||nddg}||nddg}||nddg}||nddg}| | nddg} | | ngd} | | ngd} | | ngd} ||ngd }||ngd }||_||_||_||_||_||_||_||_ | |_ | |_ | |_ | |_ | |_||_||_||_||_||_||_y) Nrr)rrr)`)rrr)rrr)r )super__init__ hidden_sizenum_attention_heads num_channels image_sizepatch_kernel_size patch_stride patch_padding query_stride+window_positional_embedding_background_sizenum_query_pool_stagesblocks_per_stageembed_dim_per_stagenum_attention_heads_per_stagewindow_size_per_stageglobal_attention_blocks mlp_ratio hidden_actlayer_norm_epsinitializer_range)selfrrrrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.kwargs __class__s i/var/www/html/eduruby.in/venv/lib/python3.12/site-packages/transformers/models/sam2/configuration_sam2.pyrzSam2HieraDetConfig.__init__Psk. "6"#-#9Zd| 1B1N-UVXYTZ'3'?|aV )6)B A '3'?|aV ;F 8Q 4 0@/K+Q]5H5T1Zm-J-V )\h &:O9Z 5`m=T=`"9fo&#6 ($!2(*(;f8%:" 0#6 -J*%:"'>$"$,!2)rrrNNNNNNrNNNNNg@geluư>{Gz?)__name__ __module__ __qualname____doc__base_config_key model_typer __classcell__r1s@r2r r sZ1f(O'J48 &*" $)=3=3r3r cLeZdZdZdZdZdeiZ dfd ZxZ S)Sam2VisionConfiga This is the configuration class to store the configuration of a [`Sam2VisionModel`]. It is used to instantiate a SAM vision encoder according to the specified arguments, defining the model architecture. Instantiating a configuration defaults will yield a similar configuration to that of SAM 2.1 Hiera-tiny [facebook/sam2.1-hiera-tiny](https://huggingface.co/facebook/sam2.1-hiera-tiny) architecture. Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the documentation from [`PretrainedConfig`] for more information. Args: backbone_config (`Union[dict, "PretrainedConfig"]`, *optional*): Configuration for the vision backbone. This is used to instantiate the backbone using `AutoModel.from_config`. backbone_channel_list (`List[int]`, *optional*, defaults to `[768, 384, 192, 96]`): The list of channel dimensions for the backbone. backbone_feature_sizes (`List[List[int]]`, *optional*, defaults to `[[256, 256], [128, 128], [64, 64]]`): The spatial sizes of the feature maps from the backbone. fpn_hidden_size (`int`, *optional*, defaults to 256): The hidden dimension of the FPN. fpn_kernel_size (`int`, *optional*, defaults to 1): The kernel size for the convolutions in the neck. fpn_stride (`int`, *optional*, defaults to 1): The stride for the convolutions in the neck. fpn_padding (`int`, *optional*, defaults to 0): The padding for the convolutions in the neck. fpn_top_down_levels (`List[int]`, *optional*, defaults to `[2, 3]`): The levels for the top-down FPN connections. num_feature_levels (`int`, *optional*, defaults to 3): The number of feature levels from the FPN to use. hidden_act (`str`, *optional*, defaults to `"gelu"`): The non-linear activation function in the neck. layer_norm_eps (`float`, *optional*, defaults to 1e-06): The epsilon for the layer normalization. initializer_range (`float`, *optional*, defaults to 0.02): The standard deviation of the truncated_normal_initializer for initializing all weight matrices. vision_configsam2_vision_modelr c  t|d i| |gdn|}| ddgddgddggn|}|ddgn|}t|tr'|j dd|d<t |dd i|}nt|t r|}n | t }||_||_||_ ||_ ||_ ||_ ||_ ||_| |_| |_| |_| |_y) N)rrrr@rrr<r r)rr isinstancedictgetrr r backbone_channel_listbackbone_feature_sizesfpn_hidden_sizefpn_kernel_size fpn_stride fpn_paddingfpn_top_down_levelsnum_feature_levelsr,r-r.)r/r rJrKrLrMrNrOrPrQr,r-r.r0r1s r2rzSam2VisionConfig.__init__s "6"7L7T 3Zo2H2Pc3Z#sb"X .Vl )<(Cq!fI\ ot ,,;,?,? Nd,eOL ),_\-JK^o^O ); <-O  $02O.&;"&<#..$&#6 "4$,!2r3) NNNrDrrNrr4r5r6) r7r8r9r:r;r<r sub_configsrr=r>s@r2r@r@sQ$L&O$J:K "# .3.3r3r@c8eZdZdZdZ dfd ZxZS)Sam2PromptEncoderConfiga< This is the configuration class to store the configuration of a [`Sam2PromptEncoder`]. The [`Sam2PromptEncoder`] module is used to encode the input 2D points and bounding boxes. Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the documentation from [`PretrainedConfig`] for more information. Args: hidden_size (`int`, *optional*, defaults to 256): Dimensionality of the hidden states. image_size (`int`, *optional*, defaults to 1024): The expected output resolution of the image. patch_size (`int`, *optional*, defaults to 16): The size (resolution) of each patch. mask_input_channels (`int`, *optional*, defaults to 16): The number of channels to be fed to the `MaskDecoder` module. num_point_embeddings (`int`, *optional*, defaults to 4): The number of point embeddings to be used. hidden_act (`str`, *optional*, defaults to `"gelu"`): The non-linear activation function in the encoder and pooler. layer_norm_eps (`float`, *optional*, defaults to 1e-06): The epsilon used by the layer normalization layers. scale (`float`, *optional*, defaults to 1): The scale factor for the prompt encoder. prompt_encoder_configc  t |di| ||_||_||_||_||_||_||_||_ yNr) rrrr patch_sizemask_input_channelsnum_point_embeddingsr,r-scale) r/rrrYrZr[r,r-r\r0r1s r2rz Sam2PromptEncoderConfig.__init__ sQ "6"&$$#6 $8!$, r3)rDr r]rr4r5rr7r8r9r:r;rr=r>s@r2rUrUs34.Or3rUc@eZdZdZdZ dfd ZxZS)Sam2MaskDecoderConfiga This is the configuration class to store the configuration of a [`Sam2MaskDecoder`]. It is used to instantiate a SAM2 memory encoder according to the specified arguments, defining the model architecture. Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the documentation from [`PretrainedConfig`] for more information. Args: hidden_size (`int`, *optional*, defaults to 256): Dimensionality of the hidden states. hidden_act (`str`, *optional*, defaults to `"gelu"`): The non-linear activation function in the SAM2 mask decoder. mlp_dim (`int`, *optional*, defaults to 2048): The dimension of the MLP in the two-way transformer. num_hidden_layers (`int`, *optional*, defaults to 2): The number of hidden layers in the two-way transformer. num_attention_heads (`int`, *optional*, defaults to 8): The number of attention heads in the two-way transformer. attention_downsample_rate (`int`, *optional*, defaults to 2): The downsample rate for the attention layers. num_multimask_outputs (`int`, *optional*, defaults to 3): The number of multimask outputs. iou_head_depth (`int`, *optional*, defaults to 3): The depth of the IoU head. iou_head_hidden_dim (`int`, *optional*, defaults to 256): The hidden dimension of the IoU head. dynamic_multimask_via_stability (`bool`, *optional*, defaults to `True`): Whether to use dynamic multimask via stability. dynamic_multimask_stability_delta (`float`, *optional*, defaults to 0.05): The stability delta for the dynamic multimask. dynamic_multimask_stability_thresh (`float`, *optional*, defaults to 0.98): The stability threshold for the dynamic multimask. mask_decoder_configc  t|di| ||_||_||_||_| |_| |_| |_| |_ ||_ ||_||_ ||_ ||_ yrX)rrrnum_multimask_outputsr,iou_head_depthiou_head_hidden_dimdynamic_multimask_via_stability!dynamic_multimask_stability_delta"dynamic_multimask_stability_threshnum_hidden_layersrmlp_dimattention_downsample_rate)r/rr,rjrirrkrcrdrerfrgrhr0r1s r2rzSam2MaskDecoderConfig.__init__Hs} "6"&%:"$,#6 /N,1R.2T/"3&#6  )B&r3) rDr4irrrrrrDTg?g\(\?r^r>s@r2r`r`"sB!F,O"#(,*.+/ C Cr3r`c<eZdZdZdZeeedZ dfd Z xZ S) Sam2Configal [`Sam2Config`] is the configuration class to store the configuration of a [`Sam2Model`]. It is used to instantiate a SAM2 model according to the specified arguments, defining the memory attention, memory encoder, and image encoder configs. Instantiating a configuration defaults will yield a similar configuration to that of the SAM 2.1 Hiera-tiny [facebook/sam2.1-hiera-tiny](https://huggingface.co/facebook/sam2.1-hiera-tiny) architecture. Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the documentation from [`PretrainedConfig`] for more information. Args: vision_config (Union[`dict`, `Sam2VisionConfig`], *optional*): Dictionary of configuration options used to initialize [`Sam2VisionConfig`]. prompt_encoder_config (Union[`dict`, `Sam2PromptEncoderConfig`], *optional*): Dictionary of configuration options used to initialize [`Sam2PromptEncoderConfig`]. mask_decoder_config (Union[`dict`, `Sam2MaskDecoderConfig`], *optional*): Dictionary of configuration options used to initialize [`Sam2MaskDecoderConfig`]. initializer_range (`float`, *optional*, defaults to 0.02): Standard deviation for parameter initialization. kwargs (*optional*): Dictionary of keyword arguments. Example: ```python >>> from transformers import ( ... Sam2VisionConfig, ... Sam2PromptEncoderConfig, ... Sam2MaskDecoderConfig, ... Sam2Model, ... ) >>> # Initializing a Sam2Config with `"facebook/sam2.1_hiera_tiny"` style configuration >>> configuration = Sam2config() >>> # Initializing a Sam2Model (with random weights) from the `"facebook/sam2.1_hiera_tiny"` style configuration >>> model = Sam2Model(configuration) >>> # Accessing the model configuration >>> configuration = model.config >>> # We can also initialize a Sam2Config from a Sam2VisionConfig, Sam2PromptEncoderConfig, and Sam2MaskDecoderConfig >>> # Initializing SAM2 vision encoder, memory attention, and memory encoder configurations >>> vision_config = Sam2VisionConfig() >>> prompt_encoder_config = Sam2PromptEncoderConfig() >>> mask_decoder_config = Sam2MaskDecoderConfig() >>> config = Sam2Config(vision_config, prompt_encoder_config, mask_decoder_config) ```sam2)rArVrac t|di|||ni}||ni}||ni}t|tr'|j dd|d<t |ddi|}nt|t r|}t|tr|j}t|tr|j}||_ tdi||_ tdi||_ ||_ y)Nr<rBr)rrrGrHrIrrrUto_dictr`rArVrar.)r/rArVrar.r0r1s r2rzSam2Config.__init__s "6")6)B  9N9Z 5`b5H5T1Z\ mT **7*;*;LJ]*^M, '*=+FGX-XM  '7 8)M +-D E$9$A$A$C ! )+@ A"5"="="? *%<%U?T%U"#8#O;N#O !2r3)NNNr6) r7r8r9r:r<rrUr`rSrr=r>s@r2rmrmks80 dJ#!84K"  33r3rm)rmr r@rUr`N)r:configuration_utilsrutilsrautorr get_loggerr7loggerr r@rUr`rm__all__rr3r2rws~3-   H %t3)t3n[3'[3|1.1hFC,FCRU3!U3p r3