hm/ddlmZddlZddlZddlmZmZmZmZm Z ddl Z ddl m Z ddlmZddlmZej$eZGddeZy) ) annotationsN)AnyIterableListOptionalType)Document) Embeddings) VectorStorecXeZdZUdZdZded< d ddZeddZ d ddZ dd Z d dd Z e d dd Z e d dd Zy)AtlasDBa`Atlas` vector store. Atlas is the `Nomic's` neural database and `rhizomatic` instrument. To use, you should have the ``nomic`` python package installed. Example: .. code-block:: python from langchain_community.vectorstores import AtlasDB from langchain_community.embeddings.openai import OpenAIEmbeddings embeddings = OpenAIEmbeddings() vectorstore = AtlasDB("my_project", embeddings.embed_query) atlas_idstr_ATLAS_DEFAULT_ID_FIELDNc* ddl}ddlm}| td|j |||_d} |j d} |||| ||t j|_|jjy#t$r tdwxYw) a  Initialize the Atlas Client Args: name (str): The name of your project. If the project already exists, it will be loaded. embedding_function (Optional[Embeddings]): An optional function used for embedding your data. If None, data will be embedded with Nomic's embed model. api_key (str): Your nomic API key description (str): A description for your project. is_public (bool): Whether your project is publicly accessible. True by default. reset_project_if_exists (bool): Whether to reset this project if it already exists. Default False. Generally useful during development and testing. rN) AtlasProjectzRCould not import nomic python package. Please install it with `pip install nomic`.z/No API key provided. Sign up at atlas.nomic.ai!text embedding)name descriptionmodality is_publicreset_project_if_existsunique_id_field) nomicr ImportError ValueErrorlogin_embedding_functionr rproject_latest_project_state) selfrembedding_functionapi_keyrrrrrrs d/var/www/html/eduruby.in/venv/lib/python3.12/site-packages/langchain_community/vectorstores/atlas.py__init__zAtlasDB.__init__"s4   * ?NO O G#5   # # /"H$#$;#;;    **,1 >  s A==Bc|jS)N)r)r"s r% embeddingszAtlasDB.embeddingsYs'''c |.t|dkDr d|djvr tdt|}|*|Dcgc]}t t j !}}|j|jj|}tj|}|6t|D cgc]\} }tj|| d|| i!} } }n?tt|D]&} || || tj<|| || d<(|} |jj!gtj| |jj#5|jj%|| dddn|3t|D cgc]\} } d| tj|| i} } } n6t|D]&\} } ||| d<|| || tj<(|} |jj!gtj| |jj#5|jj'| ddd|rat|jj(dkDr?|jj#5|jj+ddd|S|Scc}wcc}} w#1swYyxYwcc} } w#1swYxYw#1swY|SxYw)aRun more texts through the embeddings and add to the vectorstore. Args: texts (Iterable[str]): Texts to add to the vectorstore. metadatas (Optional[List[dict]], optional): Optional list of metadatas. ids (Optional[List[str]]): An optional list of ids. refresh(bool): Whether or not to refresh indices with the updated data. Default True. Returns: List[str]: List of IDs of the added texts. Nrrz#Cannot accept key text in metadata!)id_fielddata)r(r,)lenkeysrlistruuiduuid4rembed_documentsnpstack enumerater rranger _validate_map_data_inputswait_for_project_lockadd_embeddingsadd_textindices rebuild_maps) r"texts metadatasidsrefreshkwargs_ _embeddingsr(ir,rs r% add_textszAtlasDB.add_texts]s*  !I")A,++--BC CU  ;.343tzz|$4C4  # # /22BB5IK+.J !*% 0144c!ffeAhO s9~.4ADGFIaL!@!@A+08IaL(4! LL 2 2W<<4 3 335 N ++z+M N N $-U#34T7#B#BCFK )/KGAt+0IaL(DGFIaL!@!@AK! LL 2 2W<<4 3 335 , %%d+ , 4<<''(1,\\7790LL--/0 s _5 N N  , , 0 s6$K5$K"K!K:K K,K K),K6c |jj5|jjdi|cdddS#1swYyxYw)zCreates an index in your project. See https://docs.nomic.ai/atlas_api.html#nomic.project.AtlasProject.create_index for full detail. N)r r8 create_index)r"rAs r%rHzAtlasDB.create_indexs@\\ / / 1 7,4<<,,6v6 7 7 7s AA c  |j td|jj|gd}tj|j dd}|j j5|j jdj||\}}|j j|d}dddtD cgc]\} } t| d||  } } } | S#1swY D >Dc  :|| td|dzdd} | | jD] \} }|| | < ||||d|| }|jj5|j ||||j d i| ddd|S#1swY|SxYw) a^Create an AtlasDB vectorstore from a raw documents. Args: texts (List[str]): The list of texts to ingest. name (str): Name of the project to create. api_key (str): Your nomic API key, embedding (Optional[Embeddings]): Embedding function. Defaults to None. metadatas (Optional[List[dict]]): List of metadatas. Defaults to None. ids (Optional[List[str]]): Optional list of document IDs. If None, ids will be auto created description (str): A description for your project. is_public (bool): Whether your project is publicly accessible. True by default. reset_project_if_exists (bool): Whether to reset this project if it already exists. Default False. Generally useful during development and testing. index_kwargs (Optional[dict]): Dict of kwargs for index creation. See https://docs.nomic.ai/atlas_api.html Returns: AtlasDB: Nomic's neural database and finest rhizomatic instrument N$`name` and `api_key` cannot be None._indexr)r indexed_fieldA description for your project)r#r$rrr)r=r>r?rG)ritemsr r8rErH)clsr=rr>r?rr$rrr index_kwargsrAall_index_kwargsrMvatlasDBs r% from_textszAtlasDB.from_textssJ <7?CD D%)8OfM  #$**, (1&' # ( (8$;  __ 2 2 4 5   EYC  H G 4#3 4 5 5s 'BBc || td|D cgc]} | j} } |D cgc]} | j}} |j||| |||||| |  Scc} wcc} w)a+Create an AtlasDB vectorstore from a list of documents. Args: name (str): Name of the collection to create. api_key (str): Your nomic API key, documents (List[Document]): List of documents to add to the vectorstore. embedding (Optional[Embeddings]): Embedding function. Defaults to None. ids (Optional[List[str]]): Optional list of document IDs. If None, ids will be auto created description (str): A description for your project. is_public (bool): Whether your project is publicly accessible. True by default. reset_project_if_exists (bool): Whether to reset this project if it already exists. Default False. Generally useful during development and testing. index_kwargs (Optional[dict]): Dict of kwargs for index creation. See https://docs.nomic.ai/atlas_api.html Returns: AtlasDB: Nomic's neural database and finest rhizomatic instrument r]) rr$r=rr>r?rrrrc)rrNrOrg)rb documentsrr?rr$persist_directoryrrrrcrAdocr=r>s r%from_documentszAtlasDB.from_documentssH <7?CD D-67c!!77-67cS\\7 7~~#$;%  87s AA")NNr`TF)rrr#Optional[Embeddings]r$ Optional[str]rrrboolrroreturnNone)rprm)NNT) r=z Iterable[str]r>Optional[List[dict]]r?Optional[List[str]]r@rorArrp List[str])rArrpr))rVrrMintrArrpList[Document]) NNNNNr`TFN)rb Type[AtlasDB]r=rtrrmr>rrr?rsrrnr$rnrrrrorrorcOptional[dict]rArrpr )rbrxrirwrrmr?rsrrnr$rnrjrnrrrrorrorcryrArrpr )__name__ __module__ __qualname____doc__r__annotations__r&propertyr(rErHr[ classmethodrgrlrGr)r%r r sj $.S- 48!%;(-5-5-15- 5-  5-  5-"&5- 5-n(( +/#' LL(L! L  L  L L\7       D+/*.#'"!%;(-'+9 99(9( 9 ! 9  9999"&9%99 99v+/#'"!%+/;(-'+2 2 !2 (2 ! 2  2  2 )2 2 2 "&2 %2 2  2 2 r)r ) __future__rloggingr0typingrrrrrnumpyr3langchain_core.documentsr langchain_core.embeddingsr langchain_core.vectorstoresr getLoggerrzloggerr rGr)r%rs@" 66-03   8 $w kw r)