o Zh1@s ddlmZddlZddlmZmZddlmZddlm Z m Z m Z m Z m Z mZddlmZddlmZddlmZdd lmZdd lmZmZmZdd lmZd ZGd ddeZGdddeZGdddeZ GdddeZ!GdddeeZ"Gdddee"Z#dS)) annotationsN)ABCabstractmethod)Enum)AnyDictIteratorListMappingOptional)CallbackManagerForLLMRun)LLM)GenerationChunk)pre_init) BaseModel ConfigDictField)enforce_stop_tokenszocid1.generativeaiendpointc@s,eZdZeed ddZed ddZd S) ProviderreturnstrcCdSNselfrra/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/llms/oci_generative_ai.pystop_sequence_keyszProvider.stop_sequence_keyresponsercCrrrrrrrrcompletion_response_to_textsz$Provider.completion_response_to_textNrrrrrr)__name__ __module__ __qualname__propertyrrr rrrrrs rc@.eZdZUdZded<d ddZdd d Zd S)CohereProviderZstop_sequencesrrrNonecCddlm}|j|_dSNrmodels)oci.generative_ai_inferencer-ZCohereLlmInferenceRequestllm_inference_requestrr-rrr__init__  zCohereProvider.__init__rrcC|jjjdjSNr)datainference_responseZgenerated_textstextrrrrr $z*CohereProvider.completion_response_to_textNrr)r"r#r$r%r__annotations__r1r rrrrr(  r(c@r') MetaProviderstoprrrr)cCr*r+)r.r-ZLlamaLlmInferenceRequestr/r0rrrr1+r2zMetaProvider.__init__rrcCr3r4)r5r6choicesr7rrrrr 0r8z(MetaProvider.completion_response_to_textNr9r"r:rrrrr=(r<r=c@s eZdZdZdZdZdZdZdS) OCIAuthTypez'OCI authentication types as enumerator.N)r#r$r%__doc__API_KEYZSECURITY_TOKENZINSTANCE_PRINCIPALZRESOURCE_PRINCIPALrrrrr@4s r@c@seZdZUdZedddZded<dZded < d Zded < d Z ded < dZ ded< dZ ded< dZ ded< dZ ded< dZded< dZded< eddddZed%ddZed&d d!Zd'd#d$ZdS)( OCIGenAIBasezBase class for OCI GenAI modelsNT)defaultexcluderclientrFz Optional[str] auth_typeDEFAULT auth_profilez ~/.oci/configauth_file_locationmodel_idproviderzOptional[Dict] model_kwargsservice_endpointcompartment_idFbool is_streamforbidr)extraarbitrary_types_allowedZprotected_namespacesvaluesrrc sx|ddur|Szddlid|djjdd}|dtdjkr7jj|d |d d |d <|d dnU|dtdjkr^fdd}jj|d |d d |d <||d d|d <n.|dtdjkrpjj |d <n|dtdjkrjj |d <n t d|ddj jdi||d<W|Sty}ztd|d}~wty}zt d||d}~ww)zBValidate that OCI config and python package exists in environment.rJNrrR) )configsignerrRZretry_strategytimeoutrKrArNrM)Z file_locationZ profile_namer\r]rBcs^j|dd}t|ddd }|}Wdn1s"wYjj||S)Nkey_fileZsecurity_token_filezutf-8)encoding)r]Zload_private_key_from_filegetopenreadauthsignersZSecurityTokenSigner) oci_configpkfZ st_stringocirrmake_security_token_signers   zEOCIGenAIBase.validate_environment..make_security_token_signer)rfrCrDz)Please provide valid value to auth_type, z is not valid.zYCould not import oci python package. Please make sure you have the oci package installed.zCould not authenticate with OCI client. If INSTANCE_PRINCIPAL or RESOURCE_PRINCIPAL is used, please check the specified auth_profile, auth_file_location and auth_type are valid.r)rjretryZDEFAULT_RETRY_STRATEGYr@namer\ from_filepoprdreZ%InstancePrincipalsSecurityTokenSignerZget_resource_principals_signer ValueErrorZgenerative_ai_inferenceZGenerativeAiInferenceClient ImportErrorModuleNotFoundError Exception)clsrYZ client_kwargsrkexerrirvalidate_environmentpsp          z!OCIGenAIBase.validate_environmentMapping[str, Any]cCs|jpi}id|iS)zGet the identifying parameters.rQ)rQ)r _model_kwargsrrr_identifying_paramss z OCIGenAIBase._identifying_params provider_mapcCsZ|jdur |j}n|jdurtd|jdd}||vr)td|jd||S)Nzmodel_id is required to derive the provider, please provide the provider explicitly or specify the model_id to derive the provider..rz(Invalid provider derived from model_id: zL Please explicitly pass in the supported provider when using custom endpoint)rPrOrpsplitlower)rr{rPrrr _get_providers   zOCIGenAIBase._get_provider)rYrrrrrx)r{rxrr)r#r$r%rErrJr;rKrMrNrOrPrQrRrSrUr model_configrrwr&rzrrrrrrG=s:           M rGc@szeZdZdZedddZed!ddZed"d d Zed#d dZ d$ddZ d%ddZ  d&d'ddZ  d&d(dd Z dS))OCIGenAIaOCI large language models. To authenticate, the OCI client uses the methods described in https://docs.oracle.com/en-us/iaas/Content/API/Concepts/sdk_authentication_methods.htm The authentifcation method is passed through auth_type and should be one of: API_KEY (default), SECURITY_TOKEN, INSTANCE_PRINCIPAL, RESOURCE_PRINCIPAL Make sure you have the required policies (profile/roles) to access the OCI Generative AI service. If a specific config profile is used, you must pass the name of the profile (from ~/.oci/config) through auth_profile. If a specific config file location is used, you must pass the file location where profile name configs present through auth_file_location To use, you must provide the compartment id along with the endpoint url, and model id as named parameters to the constructor. Example: .. code-block:: python from langchain_community.llms import OCIGenAI llm = OCIGenAI( model_id="MY_MODEL_ID", service_endpoint="https://inference.generativeai.us-chicago-1.oci.oraclecloud.com", compartment_id="MY_OCID" ) rVT)rWrXrrcCsdS)zReturn type of llm.Zoci_generative_ai_completionrrrrr _llm_typeszOCIGenAI._llm_typerxcCsttdS)zGet the provider map)Zcoheremeta)r(r=rrrr _provider_mapszOCIGenAI._provider_maprcCs|j|jdS)z Get the internal provider object)r{)rrrrrr _providerszOCIGenAI._providerpromptr>Optional[List[str]]kwargsDict[str, Any]c Csddlm}|jp i}|dur|||jj<|jdurtd|jtr,|j |jd}n|j |jd}i||}||d<|j |d<|j |j ||jjd i|d}|S) Nrr,zDmodel_id is required to call the model, please provide the model_id.)Z endpoint_id)rOrrU)rS serving_modeZinference_requestr)r.r-rQrrrOrp startswithCUSTOM_ENDPOINT_PREFIXZDedicatedServingModeZOnDemandServingModerUZGenerateTextDetailsrSr/) rrr>rr-ryrZinference_paramsinvocation_objrrr_prepare_invocation_objects(       z#OCIGenAI._prepare_invocation_objectrcCs"|j|}|durt||}|Sr)rr r)rrr>r7rrr_process_response2s  zOCIGenAI._process_responseN run_manager"Optional[CallbackManagerForLLMRun]c Ksl|jr#d}|j|||fi|D]}||j7}q|dur!t||}|S||||}|j|}|||S)akCall out to OCIGenAI generate endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = llm.invoke("Tell me a joke.") N)rU_streamr7rrrJ generate_textr) rrr>rrr7chunkrrrrr_call:s    zOCIGenAI._callIterator[GenerationChunk]c ks|d|_||||}|j|}|jD]%}t|j}d|vr'|d} nd} t| d} |r8|j | j | d| VqdS)acStream OCIGenAI LLM on given prompt. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: An iterator of GenerationChunks. Example: .. code-block:: python response = llm.stream("Tell me a joke.") Tr7r)r7)rN) rUrrJrr5eventsjsonloadsrZon_llm_new_tokenr7) rrr>rrrreventZ json_loadZevent_data_textrrrrr[s    zOCIGenAI._streamr!r)rr)rrr>rrrrr)rrr>rrr)NN) rrr>rrrrrrr) rrr>rrrrrrr)r#r$r%rErrr&rrrrrrrrrrrrs(        $r)$ __future__rrabcrrenumrtypingrrrr r r Zlangchain_core.callbacksr Z#langchain_core.language_models.llmsr Zlangchain_core.outputsrZlangchain_core.utilsrZpydanticrrrZlangchain_community.llms.utilsrrrr(r=r@rGrrrrrs&