o Zh@s|dZddlZddlmZddlmZmZmZddlm Z ddl m Z m Z m Z ddlmZdgZeeZGd dde e ZdS) z-written under MIT Licence, Michael Feil 2023.N) getLogger)AnyListOptional) Embeddings) BaseModel ConfigDictmodel_validator)SelfInfinityEmbeddingsLocalc@seZdZUdZeed< dZeeed< dZe ed< dZ eed< d Z eed < d Z e ed < dZeed < edddZedddefddZd%ddZdeddfddZdeedeeefddZdedeefdd Zdeedeeefd!d"Zdedeefd#d$ZdS)&r aOptimized Infinity embedding models. https://github.com/michaelfeil/infinity This class deploys a local Infinity instance to embed text. The class requires async usage. Infinity is a class to interact with Embedding Models on https://github.com/michaelfeil/infinity Example: .. code-block:: python from langchain_community.embeddings import InfinityEmbeddingsLocal async with InfinityEmbeddingsLocal( model="BAAI/bge-small-en-v1.5", revision=None, device="cpu", ) as embedder: embeddings = await engine.aembed_documents(["text1", "text2"]) modelNrevision batch_sizeautodeviceZtorchbackendT model_warmupengineZforbid)extraZprotected_namespacesafter)modereturncCsNzddlm}Wn tytdw||j|j|j|j|j|jd|_ |S)z?Validate that api key and python package exists in environment.r)AsyncEmbeddingEnginezrPlease install the `pip install 'infinity_emb[optimum,torch]>=0.0.24'` package to use the InfinityEmbeddingsLocal.)Zmodel_name_or_pathrr rrr) Z infinity_embr ImportErrorr rr rrrr)selfrrrd/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/embeddings/infinity_local.pyvalidate_environmentBs  z,InfinityEmbeddingsLocal.validate_environmentcs|jIdHdS)aQstart the background worker. recommended usage is with the async with statement. async with InfinityEmbeddingsLocal( model="BAAI/bge-small-en-v1.5", revision=None, device="cpu", ) as embedder: embeddings = await engine.aembed_documents(["text1", "text2"]) N)r __aenter__)rrrrrXs z"InfinityEmbeddingsLocal.__aenter__argscs|jj|IdHdS)zUstop the background worker, required to free references to the pytorch model.N)r __aexit__)rr rrrr!esz!InfinityEmbeddingsLocal.__aexit__textsc s|jjs8td|4IdH|j|IdH\}}WdIdHn 1IdHs,wYtd|S|j|IdH\}}|S)zAsync call out to Infinity's embedding endpoint. Args: texts: The list of texts to embed. Returns: List of embeddings, one for each text. zeStarting Infinity engine on the fly. This is not recommended.Please start the engine before using it.Nz$Stopped infinity engine after usage.)rrunningloggerwarningZembed)rr" embeddings_rrraembed_documentsjs ( z(InfinityEmbeddingsLocal.aembed_documentstextcs||gIdH}|dS)zAsync call out to Infinity's embedding endpoint. Args: text: The text to embed. Returns: Embeddings for the text. Nr)r()rr)r&rrr aembed_querys z$InfinityEmbeddingsLocal.aembed_querycCtdt||S)z, This method is async only. zQThis method is async only. Please use the async version `await aembed_documents`.)r$r%asynciorunr()rr"rrrembed_documentssz'InfinityEmbeddingsLocal.embed_documentscCr+) zMThis method is async only. Please use the async version `await aembed_query`.)r$r%r,r-r*)rr)rrr embed_querysz#InfinityEmbeddingsLocal.embed_query)rN)__name__ __module__ __qualname____doc__str__annotations__r rrintrrrboolrrrZ model_configr r rrr!rfloatr(r*r.r0rrrrr s:          )r4r,loggingrtypingrrrZlangchain_core.embeddingsrZpydanticrrr Ztyping_extensionsr __all__r1r$r rrrrs