h:#ddlmZddlZddlmZddlmZmZmZm Z m Z m Z m Z ddl mZddlmZddlmZGdd eZy) ) annotationsN)repeat)AnyDictIterableListOptionalTupleType)Document) Embeddings) VectorStorecheZdZdZ ddZeddZ d ddZ d ddZ d ddZ e d ddZ e d dd Z d dd Z d dd Zdd Z d dd ZddZdd dZy)!XataVectorStorez`Xata` vector store. It assumes you have a Xata database created with the right schema. See the guide at: https://integrations.langchain.com/vectorstores?integration_name=XataVectorStore c ddlm}||||_||_|xsd|_y#t$r tdwxYw)zInitialize with Xata client.r) XataClientzPCould not import xata python package. Please install it with `pip install xata`.)api_keydb_urlvectorsN) xata.clientr ImportError_client _embedding _table_name)selfrr embedding table_namers c/var/www/html/eduruby.in/venv/lib/python3.12/site-packages/langchain_community/vectorstores/xata.py__init__zXataVectorStore.__init__sQ  . "'&A &/%2 =  s*?c|jSN)r)rs r embeddingszXataVectorStore.embeddings(s Nc(|j|||Sr!) _add_vectors)rr documentsidss r add_vectorszXataVectorStore.add_vectors,s   )S99r#c |}|j||}|jjt|}|j |||Sr!)_texts_to_documentsrembed_documentslistr()rtexts metadatasr'kwargsdocsrs r add_textszXataVectorStore.add_texts4sH''y9//11$u+>s33r#cg}t|D]a\}}||j|d}|r|||d<||jjD]\}} |dvs | ||<|j |cd} g} t dt || D]~} || | | z} |jjj|jd| i}|jdk7rtd|jd || j|d | S) z!Add vectors to the Xata database.)contentrid)r4r3rirrecordszError adding vectors to Xata:  recordIDs) enumerate page_contentmetadataitemsappendrangelenrr5 bulk_insertr status_code Exceptionextend)rrr&r'rowsidxrrowkeyval chunk_sizeid_listichunkrs rr%zXataVectorStore._add_vectorsAs5&('0 NC$S>66&CHD %cN3399; #S<<"CH # KK   q#d)Z0 +AQ^,E $$&2243C3CiQVEWXA}}#"@qQRPS TUU NN1[> *  +r#c~| ti}t||Dcgc]\}}t||}}}|Scc}}w)z:Return list of Documents from list of texts and metadatas.r:r;)rzipr )r-r.textr;r0s rr*z#XataVectorStore._texts_to_documentscsP  r I#&eY"7 h $ :    s9c |r|s td|j|} d}|j||} |||||} | j| | || S)z9Return VectorStore initialized from texts and embeddings.z$Xata api_key and db_url must be set.N)rrrr) ValueErrorr+r*r%) clsr-rr.rrrr'r/r"r0 vector_dbs r from_textszXataVectorStore.from_textssslfCD D..u5 &&ui8!   z45r#c \|j|||}|Dcgc]}|d }}|Scc}w)zReturn docs most similar to query. Args: query: Text to look up documents similar to. k: Number of Documents to return. Defaults to 4. Returns: List of Documents most similar to the query. )filterr)similarity_search_with_score)rquerykrXr/docs_and_scoresdr&s rsimilarity_searchz!XataVectorStore.similarity_searchs=;;E1V;T#23aQqT3 34s )c |jj|}|d|d}|r||d<|jjj |j |}|j dk7rtd|j d||d}|D cgc])} t| d |j|  | d d f+} } | Scc} w) aRun similarity search with Chroma with distance. Args: query (str): Query text to search for. k (int): Number of results to return. Defaults to 4. filter (Optional[dict]): Filter by metadata. Defaults to None. Returns: List[Tuple[Document, float]]: List of documents most similar to the query text with distance in float. r) queryVectorcolumnsizerXpayloadr6z!Error running similarity search: r7r5r3rOxatascore) r embed_queryrdata vector_searchrrArBr _extractMetadata) rrZr[rXr/rrdrMhitshitr\s rrYz,XataVectorStore.similarity_search_with_scoresOO//6 $!   &GH  LL    - -d.>.> - P ==C ? aPQsST T|   !$Y!2237F G$        s.CcNi}|jD]\}}|dvs |||<|S)z:Extract metadata from a record. Filters out known columns.)r4r3rre)r<)rrecordr;rGrHs rrjz XataVectorStore._extractMetadatas9  $HC@@ #  $r#c P|r#|j|jdy|pd}tdt||D]T}||||z}|Dcgc]}d|j|di}}|j j jd|iVytd cc}w) zDelete by vector IDs. Args: ids: List of ids to delete. delete_all: Delete all records in the table. r)ndocsNideletetabler4 operationsrcz%Either ids or delete_all must be set.) _delete_allwait_for_indexingr>r?rrr5 transactionrS) rr' delete_allr/rIrKrLr4rts rrqzXataVectorStore.deletes       " " " + _J1c#h 3 WAJ/PUJLX)9)9DE  $$&22L*;U2V  WDE E sB#c |jjj|jddgi}|jdk7rt d|jd||dDcgc]}|d }}t |dk(ry |Dcgc]}d |j|d i}}|jjjd |icc}wcc}w) z Delete all records in the table.columnsr4rcr6zError running query: r7r5rrqrrrtN) rrhrZrrArBr?r5rw)rrMrecr'r4rts rruzXataVectorStore._delete_alls !!#))$*:*:YQUPVDW)XA}}#"7 as KLL()) 53t95C53x1}LOFHT%5%5R@AJ LL " . . j7Q . R6s + C Cc|tj} |jjj|jdddid}|j dk7rt d|j d||d |k(ry tj|z |kDr t d tjd ) zeWait for the search index to contain a certain number of documents. Useful in tests. rbr)rZpagercr6zError running search: r7 totalCountz+Timed out waiting for indexing to complete.g?N)timerrh search_tablerrArBsleep)rtimeoutrpstartrMs rrvz!XataVectorStore.wait_for_indexings  !!#00  B *L1A}}#"8q LMM%'yy{U"W, MNN JJsOr#) rstrrrrr rrreturnNone)rr r!)rzList[List[float]]r&List[Document]r'Optional[List[str]]r List[str])NN) r- Iterable[str]r.zOptional[List[Dict[Any, Any]]]r'rr/rrr)r-rr.z"Optional[Iterable[Dict[Any, Any]]]rr)NNNrN)rTzType['XataVectorStore']r-rrr r.zOptional[List[dict]]r Optional[str]rrrrr'rr/rrz'XataVectorStore')N) rZrr[intrXOptional[dict]r/rrr) rZrr[rrXrr/rrzList[Tuple[Document, float]])rndictrr)r'rrxzOptional[bool]r/rrr)rr))rfloatrprrr)__name__ __module__ __qualname____doc__rpropertyr"r(r1r% staticmethodr* classmethodrVr^rYrjrqrurvr#rrr sW333 3  3  3&$( :":":! :  :59#' 4 42 4! 4  4  4"$( " " !   D9=  5     +/!% $##' $(     ! >@D .<OR "@D$$ $.<$OR$ %$L$(%)F F#F F  F4 Sr#r) __future__rr itertoolsrtypingrrrrr r r langchain_core.documentsr langchain_core.embeddingsr langchain_core.vectorstoresrrrr#rrs." CCC-03{k{r#