hUddlmZmZmZmZddlmZmZddlm Z ddl m Z m Z ddl mZe r ddlmZdd lmZeed efZeed <ed eed ZedeeedZdedeeefdZGddeZy))AnySequence TypedDictUnion) TypeAliasoverload) is_pil_image)is_vision_availablerequires_backends)Pipeline)Image) load_imagez Image.Image ImagePairKeypointxyMatchkeypoint_image_0keypoint_image_1scoreimagesreturncd}dt|tr;t|dk(rtfd|Dr|gStfd|Dr|St |)N)z-Input images must be a one of the following :z - A pair of images.z - A list of pairs of images.c<t|xst|tS)z"images is a PIL Image or a string.)r isinstancestr)images f/var/www/html/eduruby.in/venv/lib/python3.12/site-packages/transformers/pipelines/keypoint_matching.py_is_valid_imagez-validate_image_pairs.._is_valid_image+sE"z'validate_image_pairs..0s#Q_U%;#Qc3K|]:}t|txr$t|dk(xrtfd|D<yw)r c3.K|] }|ywr&r'r(s r"r*z1validate_image_pairs...5sCuOE*Cr+N)rrlenall)r) image_pairr#s r"r*z'validate_image_pairs..2sN  z8 , DJ1$ DC CC D sAA)rrr.r/ ValueError)r error_messager#s @r"validate_image_pairsr3$sdM =&(# v;! #Q&#Q Q8O  %   M ] ##r$c eZdZdZdZdZdZdZfdZddZ e dde de de d eefd Ze ddee de de d eeefd Z ddeee e fde de d eeeeeefffd Zdd ZdZdd eefdZxZS)KeypointMatchingPipelinez Keypoint matching pipeline using any `AutoModelForKeypointMatching`. This pipeline matches keypoints between two images. FTcpt||i|t|d|jdk7r t dy)NvisionptzBKeypoint matching pipeline only supports PyTorch (framework='pt').)super__init__r frameworkr1)selfargskwargs __class__s r"r:z!KeypointMatchingPipeline.__init__Fs< $)&)$) >>T !ab b "r$c0i}|||d<i}|||d<|i|fS)Ntimeout thresholdr')r<rBrApreprocess_paramspostprocess_paramss r"_sanitize_parametersz-KeypointMatchingPipeline._sanitize_parametersLs>  +2 i (  .7 { + "&888r$inputsrBr>rc yr&r'r<rFrBr>s r"__call__z!KeypointMatchingPipeline.__call__Usadr$c yr&r'rHs r"rIz!KeypointMatchingPipeline.__call__Xsmpr$c | tdt|}t| |fd|i|}t |dk(r|dS|S)a Find matches between keypoints in two images. Args: inputs (`str`, `list[str]`, `PIL.Image` or `list[PIL.Image]`): The pipeline handles three types of images: - A string containing a http link pointing to an image - A string containing a local path to an image - An image loaded in PIL directly The pipeline accepts either a single pair of images or a batch of image pairs, which must then be passed as a string. Images in a batch must all be in the same format: all as http links, all as local paths, or all as PIL images. threshold (`float`, *optional*, defaults to 0.0): The threshold to use for keypoint matching. Keypoints matched with a lower matching score will be filtered out. A value of 0 means that all matched keypoints will be returned. kwargs: `timeout (`float`, *optional*, defaults to None)` The maximum time in seconds to wait for fetching images from the web. If None, no timeout is set and the call may block forever. Return: Union[list[Match], list[list[Match]]]: A list of matches or a list if a single image pair is provided, or of lists of matches if a batch of image pairs is provided. Each match is a dictionary containing the following keys: - **keypoint_image_0** (`Keypoint`): The keypoint in the first image (x, y coordinates). - **keypoint_image_1** (`Keypoint`): The keypoint in the second image (x, y coordinates). - **score** (`float`): The matching score between the two keypoints. zFCannot call the keypoint-matching pipeline without an inputs argument!rBr r)r1r3r9rIr.)r<rFrBr>formatted_inputsoutputsr?s r"rIz!KeypointMatchingPipeline.__call__[sYN >ef f/7'"#3SySFS  A %1: r$c|Dcgc]}t||}}|j||j}|j|j}|Dcgc]}|j }}||d}|Scc}wcc}w)N)rA)rreturn_tensors) model_inputs target_sizes)rimage_processorr;to torch_dtypesize)r<rrAr!rPrQpreprocess_outputss r" preprocessz#KeypointMatchingPipeline.preprocesss|BHI*UG4II++6$..+Y #t'7'78 067u 7 7.:LY!! J8s A3A8cF|d}|jdi|}||dgd}|S)NrPrQ) model_outputsrQr')model)r<rVrPrYforward_outputss r"_forwardz!KeypointMatchingPipeline._forwards9).9 " 2\2 ,9L^_mLnKopr$c |d}|d}|jj|||}|d}g}t|d|d|dD]\}}} t|dj |dj }t|dj |dj }|j t ||| j t|d d }|S)NrYrQ)rQrBr keypoints0 keypoints1matching_scoresr rrc |dS)Nrr')rs r"z6KeypointMatchingPipeline.postprocess..s ' r$T)keyreverse)rRpost_process_keypoint_matchingzipritemappendrsorted) r<r[rBrYrQpostprocess_outputs pair_resultkp_0kp_1rs r" postprocessz$KeypointMatchingPipeline.postprocesss'8 &~6 "22QQ  R 2!4 !$  -  -  1 2"  h D$ d1gllnQ ?Dd1gllnQ ?D   udTY^YcYcYef g h[.BDQ r$)NN)gr&)__name__ __module__ __qualname____doc___load_processor_load_image_processor_load_feature_extractor_load_tokenizerr:rErrfloatrlistrrIrrWr\rn __classcell__)r?s@r"r5r5<sO #Oc 9dydUdCdTXY^T_dd ptIp5pRUpZ^_cdi_jZkpp -d9oy01-- - tE{De-- . -^" T%[r$r5N)typingrrrrtyping_extensionsrr image_utilsr utilsr r baserPILrrr r__annotations__rwrrr3r5r'r$r"rs321&:( mS&8 9: 9: Zu5!9 :'hafgh$$(92E)F$0mxmr$