o Zh;@sddlmZddlZddlmZmZmZmZmZm Z m Z m Z m Z er6ddl Z ddlZ ddlmZmZmZmZddlmZddlmZddlmZddlmZd ZdddZdddZGdddeZdS)) annotationsN) TYPE_CHECKINGAnyCallableDictIterableListOptionalTupleType)ID OneOrManyWhere WhereDocumentDocument) Embeddings)xor_args) VectorStoreresultsrreturnList[Document]cCsddt|DS)NcSg|]\}}|qSr.0doc_rr]/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/vectorstores/bagel.py z$_results_to_docs..)_results_to_docs_and_scoresrrrr_results_to_docssr$List[Tuple[Document, float]]cCs.ddt|dd|dd|ddDS)NcSs,g|]}t|d|dp id|dfqS)r) page_contentmetadatar)rresultrrrr "sz/_results_to_docs_and_scores.. documentsr metadatasZ distances)zipr#rrrr"!s   r"c @s0eZdZUdZdZded<edddddfd[ddZed\ddZe d    d]d^d$d%Z   d_d`d-d.Z e dfdad1d2Z e dfdbd4d5Zedddeddddfdcd:d;Zddd.cg|]}|qSrrridx)r,rrr r!crbrrrcr[rrr r!crbrrrcrMrrr r!crbrrrcr^rrr r!)rMr,r+r^crbrrrjrerrr r!crbrrrhrfrrr r!crbrrrhrgrrr r!)rMr+r^)rMr+r,r^)rXrHrYlen enumerateappendrFZupsert)rIr[r,r^rMrWZ length_diffZ empty_idsZ non_empty_idsrdr(Ztexts_with_metadatasZembeddings_with_metadatasZids_with_metadataZtexts_without_metadatasZembeddings_without_metadatasZids_without_metadatasr)rMr^r,r[r add_texts~s\    zBagel.add_textsquerykcKs|j|||d}dd|DS)a Run a similarity search with Bagel. Args: query (str): The query text to search for similar documents/texts. k (int): The number of results to return. where (Optional[Dict[str, str]]): Metadata filters to narrow down. Returns: List[Document]: List of documents objects representing the documents most similar to the query text. )rUcSrrrrrrrr r!z+Bagel.similarity_search..)similarity_search_with_score)rIrnrorUrWZdocs_and_scoresrrrsimilarity_searchszBagel.similarity_searchr%cKs|j|g||d}t|S)a Run a similarity search with Bagel and return documents with their corresponding similarity scores. Args: query (str): The query text to search for similar documents. k (int): The number of results to return. where (Optional[Dict[str, str]]): Filter using metadata. Returns: List[Tuple[Document, float]]: List of tuples, each containing a Document object representing a similar document and its corresponding similarity score. )rNrSrU_Bagel__query_clusterr")rIrnrorUrWrrrrrpsz"Bagel.similarity_search_with_scorecls Type[Bagel] embeddingtext_embeddingsc Ks0|d|||||d| } | j|| ||d} | S)a Create and initialize a Bagel instance from list of texts. Args: texts (List[str]): List of text content to be added. cluster_name (str): The name of the Bagel cluster. client_settings (Optional[bagel.config.Settings]): Client settings. cluster_metadata (Optional[Dict]): Metadata of the cluster. embeddings (Optional[Embeddings]): List of embedding. metadatas (Optional[List[dict]]): List of metadata. ids (Optional[List[str]]): List of unique ID. Defaults to None. client (Optional[bagel.Client]): Bagel client instance. Returns: Bagel: Bagel vectorstore. )r1r4r2r8r6)r[rMr,r^Nr)rm) rtr[rvr,r^r1r2r6r8rwrWZ bagel_clusterrrrr from_textsszBagel.from_textscCs|j|jjdS)zDelete the cluster.N)rDdelete_clusterrFr?rLrrrry!szBagel.delete_cluster List[float]cK|j|||d}t|S)zT Return docs most similar to embedding vector and similarity score. rOrSrUrr)rIrOrorUrWrrrr1similarity_search_by_vector_with_relevance_scores%s z7Bagel.similarity_search_by_vector_with_relevance_scorescKr{)z-Return docs most similar to embedding vector.r|)rsr$)rIrvrorUrWrrrrsimilarity_search_by_vector4sz!Bagel.similarity_search_by_vectorCallable[[float], float]cCsj|jr|jSd}d}|jj}|r||vr||}|dkr|jS|dkr&|jS|dkr-|jStd|d)z Select and return the appropriate relevance score function based on the distance metric used in the Bagel cluster. l2z hnsw:spaceZcosineipzANo supported normalization function for distance metric of type: z=. Consider providing relevance_score_fn to Bagel constructor.)rGrFr(Z_cosine_relevance_score_fnZ_euclidean_relevance_score_fnZ%_max_inner_product_relevance_score_fn ValueError)rIZdistanceZ distance_keyr(rrr_select_relevance_score_fnAs$ z Bagel._select_relevance_score_fnr+c Ks>dd|D} dd|D} |jd| || |||||d|S)a Create a Bagel vectorstore from a list of documents. Args: documents (List[Document]): List of Document objects to add to the Bagel vectorstore. embedding (Optional[List[float]]): List of embedding. ids (Optional[List[str]]): List of IDs. Defaults to None. cluster_name (str): The name of the Bagel cluster. client_settings (Optional[bagel.config.Settings]): Client settings. client (Optional[bagel.Client]): Bagel client instance. cluster_metadata (Optional[Dict]): Metadata associated with the Bagel cluster. Defaults to None. Returns: Bagel: Bagel vectorstore. cSg|]}|jqSr)r'rrrrrr zz(Bagel.from_documents..cSrr)r(rrrrr {r)r[rvr,r^r1r2r8r6Nr)rx) rtr+rvr^r1r2r8r6rWr[r,rrrfrom_documents]s zBagel.from_documents document_iddocumentrcCs(|j}|j}|jj|g|g|gddS)zUpdate a document in the cluster. Args: document_id (str): ID of the document to update. document (Document): Document to update. )r^r+r,N)r'r(rFupdate)rIrrtextr(rrrupdate_documents zBagel.update_documentOptional[OneOrMany[ID]]Optional[Where]limit Optional[int]offsetwhere_documentOptional[WhereDocument]includeDict[str, Any]cCs2|||||d}|dur||d<|jjdi|S)zGets the collection.)r^rUrrrNrr)rFget)rIr^rUrrrrrWrrrrs z Bagel.getcKs|jj|ddS)zW Delete by IDs. Args: ids: List of ids to delete. rgN)rFdelete)rIr^rWrrrrsz Bagel.delete)r1r/r2r3r4r5r6r7r8r9r:r;rr<)rr5)NNrPN) rNrQrOrRrSrTrUrVrWrrr)NNN) r[r\r,r]r^rQrMrRrWrrr_) rnr/rorTrUrVrWrrr) rnr/rorTrUrVrWrrr%)rtrur[r_rvr5r,r]r^rQr1r/r2r3r6r7r8r9rwrRrWrrr.)rr<) rOrzrorTrUrVrWrrr%) rvrzrorTrUrVrWrrr)rr)rtrur+rrvr5r^rQr1r/r2r3r8r9r6r7rWrrr.)rr/rrrr<)NNNNNN)r^rrUrrrrrrrrrQrrrK)r^rQrWrrr<)__name__ __module__ __qualname____doc__r0__annotations__rJpropertyrMrrsrm DEFAULT_Krqrp classmethodrxryr}r~rrrrrrrrrr.,s~   $  L   *   * r.)rrrr)rrrr%) __future__rr`typingrrrrrrr r r r@rAZbagel.api.typesr r rrZlangchain_core.documentsrZlangchain_core.embeddingsrZlangchain_core.utilsrZlangchain_core.vectorstoresrrr$r"r.rrrrs ,