o Zh @s\ddlmZddlmZmZmZmZddlmZddl m Z ddl m Z Gddde Z dS) ) annotations)AnyIteratorOptionalSequence)Document) BaseLoader)MaxComputeAPIWrapperc@sBeZdZdZddddd d Zeddd dddZdddZdS)MaxComputeLoaderz+Load from `Alibaba Cloud MaxCompute` table.N)page_content_columnsmetadata_columnsquerystr api_wrapperr r Optional[Sequence[str]]r cCs||_||_||_||_dS)aInitialize Alibaba Cloud MaxCompute document loader. Args: query: SQL query to execute. api_wrapper: MaxCompute API wrapper. page_content_columns: The columns to write into the `page_content` of the Document. If unspecified, all columns will be written to `page_content`. metadata_columns: The columns to write into the `metadata` of the Document. If unspecified, all columns not added to `page_content` will be written. N)r rr r )selfr rr r rg/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/document_loaders/max_compute.py__init__s zMaxComputeLoader.__init__ access_idsecret_access_keyendpointprojectr Optional[str]rkwargsrreturncKs$tj||||d}|||fi|S)aConvenience constructor that builds the MaxCompute API wrapper from given parameters. Args: query: SQL query to execute. endpoint: MaxCompute endpoint. project: A project is a basic organizational unit of MaxCompute, which is similar to a database. access_id: MaxCompute access ID. Should be passed in directly or set as the environment variable `MAX_COMPUTE_ACCESS_ID`. secret_access_key: MaxCompute secret access key. Should be passed in directly or set as the environment variable `MAX_COMPUTE_SECRET_ACCESS_KEY`. r)r from_params)clsr rrrrrrrrrr%szMaxComputeLoader.from_paramsIterator[Document]c#sjjD]@}jrfdd|Dn|dddD}jr6fdd|D}n fdd|D}t||dVqdS) Nc i|] \}}|jvr||qSr)r .0kvrrr Fsz.MaxComputeLoader.lazy_load.. css"|] \}}|d|VqdS)z: Nrr!rrr Ks z-MaxComputeLoader.lazy_load..cr r)r r!r%rrr&Ms csi|] \}}|vr||qSrrr!)page_content_datarrr&Os) page_contentmetadata)rr r itemsjoinr r)rrowr*r+r)r)rr lazy_loadCs zMaxComputeLoader.lazy_load)r rrr r rr r)r rrrrrrrrrrrrr )rr)__name__ __module__ __qualname____doc__r classmethodrr/rrrrr sr N) __future__rtypingrrrrZlangchain_core.documentsrZ)langchain_community.document_loaders.baserZ)langchain_community.utilities.max_computer r rrrrs