o Zh:#@s|ddlmZddlZddlmZddlmZmZmZm Z m Z m Z m Z ddl mZddlmZddlmZGdd d eZdS) ) annotationsN)repeat)AnyDictIterableListOptionalTupleTypeDocument) Embeddings) VectorStorec@seZdZdZdHd d ZedId d Z dJdKddZ  dLdMddZ dJdKd d!Z e dJdNd#d$Z e     dOdPd*d+Z dQdRd2d3Z dQdSd5d6ZdTd9d:Z  dLdUd=d>ZdVd?d@ZdWdXdFdGZdS)YXataVectorStorez`Xata` vector store. It assumes you have a Xata database created with the right schema. See the guide at: https://integrations.langchain.com/vectorstores?integration_name=XataVectorStore api_keystrdb_url embeddingr table_namereturnNonecCsJzddlm}Wn tytdw|||d|_||_|p!d|_dS)zInitialize with Xata client.r) XataClientzPCould not import xata python package. Please install it with `pip install xata`.)rrvectorsN)Z xata.clientr ImportError_client _embedding _table_name)selfrrrrrr\/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/vectorstores/xata.py__init__s zXataVectorStore.__init__cCs|jSN)rrrrr embeddings(szXataVectorStore.embeddingsNrList[List[float]] documentsList[Document]idsOptional[List[str]] List[str]cCs||||Sr!) _add_vectors)rrr%r'rrr add_vectors,szXataVectorStore.add_vectorstexts Iterable[str] metadatasOptional[List[Dict[Any, Any]]]kwargsrcKs.|}|||}|jt|}||||Sr!)_texts_to_documentsrembed_documentslistr+)rr,r.r'r0docsrrrr add_texts4s zXataVectorStore.add_textscCsg}t|D]-\}}||j|d}|r|||d<||jD] \}} |dvr-| ||<q!||qd} g} tdt|| D]-} || | | } |j |j d| i}|j dkrft d|j d || |d q@| S) z!Add vectors to the Xata database.)contentrid)r7r6rirrecordszError adding vectors to Xata:  Z recordIDs) enumerate page_contentmetadataitemsappendrangelenrr8Z bulk_insertr status_code Exceptionextend)rrr%r'rowsidxrrowkeyval chunk_sizeZid_listichunkrrrrr*As*   zXataVectorStore._add_vectors"Optional[Iterable[Dict[Any, Any]]]cCs(|durti}ddt||D}|S)z:Return list of Documents from list of texts and metadatas.NcSsg|] \}}t||dqS)r<r=r ).0textr=rrr ls z7XataVectorStore._texts_to_documents..)rzip)r,r.r4rrrr1cs z#XataVectorStore._texts_to_documentsclsType['XataVectorStore']Optional[List[dict]] Optional[str]'XataVectorStore'c KsL|r|std||} d}|||} |||||d} | | | || S)z9Return VectorStore initialized from texts and embeddings.z$Xata api_key and db_url must be set.N)rrrr) ValueErrorr2r1r*) rTr,rr.rrrr'r0r#r4Z vector_dbrrr from_textsss  zXataVectorStore.from_textsquerykintfilterOptional[dict]cKs"|j|||d}dd|D}|S)zReturn docs most similar to query. Args: query: Text to look up documents similar to. k: Number of Documents to return. Defaults to 4. Returns: List of Documents most similar to the query. )r_cSg|]}|dqS)rr)rPdrrrrRz5XataVectorStore.similarity_search..)similarity_search_with_score)rr\r]r_r0docs_and_scoresr%rrrsimilarity_searchs z!XataVectorStore.similarity_searchList[Tuple[Document, float]]c  sxj|}|d|d}|r||d<jjj|d}|jdkr-td|jd||d}fd d |D} | S) aRun similarity search with Chroma with distance. Args: query (str): Query text to search for. k (int): Number of results to return. Defaults to 4. filter (Optional[dict]): Filter by metadata. Defaults to None. Returns: List[Tuple[Document, float]]: List of documents most similar to the query text with distance in float. r)Z queryVectorcolumnsizer_payloadr9z!Error running similarity search: r:r8cs.g|]}t|d|d|ddfqS)r6rOxataZscore)r _extractMetadata)rPhitr"rrrRs z@XataVectorStore.similarity_search_with_score..)rZ embed_queryrdataZ vector_searchrrBrC) rr\r]r_r0rrkrMhitsrerr"rrds    z,XataVectorStore.similarity_search_with_scorerecorddictcCs*i}|D] \}}|dvr|||<q|S)z:Extract metadata from a record. Filters out known columns.)r7r6rrl)r>)rrqr=rHrIrrrrms z XataVectorStore._extractMetadata delete_allOptional[bool]c s|rjdddS|dur=d}tdt||D]}||||}fdd|D}jjd|idqdStd ) zDelete by vector IDs. Args: ids: List of ids to delete. delete_all: Delete all records in the table. r)ndocsNicg|] }dj|diqSdelete)tabler7rrPr7r"rrrRz*XataVectorStore.delete.. operationsrjz%Either ids or delete_all must be set.) _delete_allwait_for_indexingr@rArr8 transactionrY)rr'rsr0rJrKrLr}rr"rrxs  zXataVectorStore.deletecs jjjddgid}|jdkrtd|jd|dd |d D}t|d kr0dSfd d |D}jjd |idq)z Delete all records in the table.Tcolumnsr7rjr9zError running query: r:cSra)r7r)rPZrecrrrrRrcz/XataVectorStore._delete_all..r8rcrvrwrzr{r"rrrRr|r}N) rror\rrBrCrAr8r)rrMr'r}rr"rr~s   zXataVectorStore._delete_alltimeoutfloatrucCs~t} |jj|jdddidd}|jdkr%td|jd ||d |kr-d St||kr9td td q)zeWait for the search index to contain a certain number of documents. Useful in tests. Trir)r\pagerjr9zError running search: r:Z totalCountz+Timed out waiting for indexing to complete.g?N)timerroZ search_tablerrBrCsleep)rrrustartrMrrrrs    z!XataVectorStore.wait_for_indexing) rrrrrr rrrr)rr r!)rr$r%r&r'r(rr))NN) r,r-r.r/r'r(r0rrr))r,r-r.rNrr&)NNNrN)rTrUr,r)rr r.rVrrWrrWrrr'r(r0rrrX)r[N) r\rr]r^r_r`r0rrr&) r\rr]r^r_r`r0rrrg)rqrrrrr)r'r(rsrtr0rrr)rr)rr)rrrur^rr)__name__ __module__ __qualname____doc__r propertyr#r+r5r* staticmethodr1 classmethodrZrfrdrmrxr~rrrrrr s@      "  &  r) __future__rr itertoolsrtypingrrrrrr r Zlangchain_core.documentsr Zlangchain_core.embeddingsr Zlangchain_core.vectorstoresrrrrrrs  $