hJ5ddlmZddlZddlZddlmZmZmZmZm Z m Z m Z ddl m Z ddlmZddlmZddlmZdZd ZGd d eZy) ) annotationsN)AnyDictIterableListOptionalTupleType)Document) Embeddings)get_from_dict_or_env) VectorStoreilangchain_pg_embeddingceZdZdZeeddf ddZ ddZeddZ e ddeedf ddZ ddZ d dd Z d dd Z d dd Z d dd Z d dd Ze deeddf d dZe deeddf d!dZe eedf d"dZe d#dZe eeddf d$dZe d%dZy)&Hologresa`Hologres API` vector store. - `connection_string` is a hologres connection string. - `embedding_function` any embedding function implementing `langchain.embeddings.base.Embeddings` interface. - `ndims` is the number of dimensions of the embedding output. - `table_name` is the name of the table to store embeddings and data. (default: langchain_pg_embedding) - NOTE: The table will be created when initializing the store (if not exists) So, make sure the user has the right permissions to create tables. - `pre_delete_table` if True, will delete the table if it exists. (default: False) - Useful for testing. FNc||_||_||_||_||_|xst j t|_|jyN) connection_stringndims table_nameembedding_functionpre_delete_tablelogging getLogger__name__logger __post_init__)selfrrrrrrs g/var/www/html/eduruby.in/venv/lib/python3.12/site-packages/langchain_community/vectorstores/hologres.py__init__zHologres.__init__ sM"3 $"4 0; 1 1( ;  cddlm}||j|j|jddi|j |_y)z' Initialize the store. r)HologresVectordocumenttext)rr table_schemarN)hologres_vectorr#rrrrstorage)rr#s rrzHologres.__post_init__1s; 3%  " "**$f-!22   r!c|jSr)r)rs r embeddingszHologres.embeddingsAs&&&r!c  |*|D cgc]} ttj!}} |s|D cgc]} i}} |j| } || ||||} | jd||||d| | Scc} wcc} w)N)rrrrr)textsr* metadatasids)struuiduuid4get_connection_stringadd_embeddings) clsr,r*rr-r.rrrkwargs_rstores r__fromzHologres.__fromEs ;.343tzz|$4C4%*++I+55f=/1!-    J) PV  '5,s $A5 A:c  |Dcgc]}d|i}}|jj||||ycc}w#t$r%}|jj |Yd}~yd}~wwxYw)a/Add embeddings to the vectorstore. Args: texts: Iterable of strings to add to the vectorstore. embeddings: List of list of embedding vectors. metadatas: List of metadatas associated with the texts. kwargs: vectorstore specific parameters r$N)r(upsert_vectors Exceptionr exception) rr,r*r-r.r6t schema_datases rr4zHologres.add_embeddingshs`  %5:;ZO;L; LL ' ' CL Q< % KK ! !! $ $ %s!7 2 77 A%A  A%c |*|Dcgc]}ttj!}}|jj t |}|s|Dcgc]}i}}|j ||||fi||Scc}wcc}w)arRun more texts through the embeddings and add to the vectorstore. Args: texts: Iterable of strings to add to the vectorstore. metadatas: Optional list of metadatas associated with the texts. kwargs: vectorstore specific parameters Returns: List of ids from adding the texts into the vectorstore. )r0r1r2rembed_documentslistr4)rr,r-r.r6r7r*s r add_textszHologres.add_texts~s" ;.343tzz|$4C4,,<"++77U7C //0  r!c `|j|||}|Dcgc]\}}| c}}Scc}}w)akReturn docs most similar to embedding vector. Args: embedding: Embedding to look up documents similar to. k: Number of Documents to return. Defaults to 4. filter (Optional[Dict[str, str]]): Filter by metadata. Defaults to None. Returns: List of Documents most similar to the query vector. rF)&similarity_search_with_score_by_vector)rrGrHrIr6docs_and_scoresdocr7s rrKz$Hologres.similarity_search_by_vectors;"EE1VF #22Q222s *cd|jj|}|j|||}|S)abReturn docs most similar to query. Args: query: Text to look up documents similar to. k: Number of Documents to return. Defaults to 4. filter (Optional[Dict[str, str]]): Filter by metadata. Defaults to None. Returns: List of Documents most similar to the query and score for each rF)rrJrO)rrLrHrIrGdocss rsimilarity_search_with_scorez%Hologres.similarity_search_with_scores= ++77> ::1V;  r!c|jj||dg|}|Dcgc]}t|d|d|df}}|Scc}w)Nr$)rHselect_columnsmetadata_filtersmetadata) page_contentrXdistance)r(searchr )rrGrHrIresultsresultrSs rrOz/Hologres.similarity_search_with_score_by_vectorsy )- (;(; J<&)<) "   !' !3#J/z"         sAc l|jt|} |j|| |f|||||d|S)aM Return VectorStore initialized from texts and embeddings. Hologres connection string is required "Either pass it as a parameter or set the HOLOGRES_CONNECTION_STRING environment variable. Create the connection string by calling HologresVector.connection_string_from_db_params r-r.rrr)rBrC_Hologres__from) r5r,rGr-rrr.rr6r*s r from_textszHologres.from_textssT(..tE{; szz      !-    r!c |D cgc]} | d } } |D cgc]} | d } } |j| | |f|||||d|Scc} wcc} w)a~Construct Hologres wrapper from raw documents and pre- generated embeddings. Return VectorStore initialized from documents and embeddings. Hologres connection string is required "Either pass it as a parameter or set the HOLOGRES_CONNECTION_STRING environment variable. Create the connection string by calling HologresVector.connection_string_from_db_params Example: .. code-block:: python from langchain_community.vectorstores import Hologres from langchain_community.embeddings import OpenAIEmbeddings embeddings = OpenAIEmbeddings() text_embeddings = embeddings.embed_documents(texts) text_embedding_pairs = list(zip(texts, text_embeddings)) faiss = Hologres.from_embeddings(text_embedding_pairs, embeddings) rr_)r`) r5text_embeddingsrGr-rrr.rr6r>r,r*s rfrom_embeddingszHologres.from_embeddingssw@ //!1//$34qad4 4szz      !-    04s A Ac B|j|}||||||}|S)z Get instance of an existing Hologres store.This method will return the instance of the store without inserting any new embeddings )rrrrr)r3)r5rGrrrr6rr8s rfrom_existing_indexzHologres.from_existing_indexFs5 55f=/!(-   r!c<t|dd}|s td|S)NrHOLOGRES_CONNECTION_STRING)datakeyenv_keyzHologres connection string is requiredEither pass it as a parameteror set the HOLOGRES_CONNECTION_STRING environment variable.Create the connection string by callingHologresVector.connection_string_from_db_params)r ValueError)r5r6rs rr3zHologres.get_connection_stringas6!5#0"  !B ! r!c |Dcgc]}|j} }|Dcgc]}|j} }|j|} | |d<|jd| ||| |||d|Scc}wcc}w)aQ Return VectorStore initialized from documents and embeddings. Hologres connection string is required "Either pass it as a parameter or set the HOLOGRES_CONNECTION_STRING environment variable. Create the connection string by calling HologresVector.connection_string_from_db_params r)r,pre_delete_collectionrGr-r.rrr/)rYrXr3ra) r5 documentsrGrrr.ror6dr,r-rs rfrom_documentszHologres.from_documentsts(*33A33)23AQZZ3 355f=&7"#s~~  "7!    43s A#A(c $d|d|d|d|d| S)z2Return connection string from database parameters.zdbname=z user=z password=z host=z port=r/)r5hostportdatabaseuserpasswords r connection_string_from_db_paramsz)Hologres.connection_string_from_db_paramss-hZvdV:hZvdV6RVQW X r!)rr0rr rintrr0rboolrzOptional[logging.Logger]returnNone)r|r})r|r )r, List[str]r*List[List[float]]rr r-Optional[List[dict]]r.Optional[List[str]]rrzrr0rr{r6rr|r) r, Iterable[str]r*rr-z List[dict]r.r~r6rr|r})NN) r,rr-rr.rr6rr|r~)N) rLr0rHrzrIOptional[dict]r6rr|List[Document]) rG List[float]rHrzrIrr6rr|r)rLr0rHrzrIrr|List[Tuple[Document, float]])rGrrHrzrIrr|r)r5Type[Hologres]r,r~rGr r-rrrzrr0r.rrr{r6rr|r)rdzList[Tuple[str, List[float]]]rGr r-rrrzrr0r.rrr{r6rr|r)r5rrGr rrzrr0rr{r6rr|r)r6zDict[str, Any]r|r0)r5rrprrGr rrzrr0r.rror{r6rr|r) rtr0rurzrvr0rwr0rxr0r|r0)r __module__ __qualname____doc__ADA_TOKEN_COUNT_LANGCHAIN_DEFAULT_TABLE_NAMEr rpropertyr* classmethodr`r4rDrMrKrTrOrarergr3rrryr/r!rrrs &%7!&+/'     ) "  '' +/#'$7!&  & '  (  !        D%%&% %  %  % %2+/#' (!     @!%           6!% 33 3 3  3  32!%    & 2!%    & , +/$7#'!&    (      !      B +/$7#'!&, 6, , ( ,  ,  , !, , ,  , , \%7!&        4!!$ %7#'&+" " !" "  "  " ! "  $" "  " " H                 r!r) __future__rrr1typingrrrrrr r langchain_core.documentsr langchain_core.embeddingsr langchain_core.utilsr langchain_core.vectorstoresrrrrr/r!rrs<" CCC-053 8U {U r!