o Zh@slddlmZmZmZmZmZddlmZddlm Z ddl m Z m Z m Z ddlmZmZGddde ZdS) )AnyDictListMappingOptional)CallbackManagerForLLMRun)LLM)convert_to_secret_strget_from_dict_or_envpre_init) ConfigDict SecretStrc @seZdZUdZdZeed<dZeed< dZ e ed< dZ eed < d Z e ed < d Zeed < dZe ed< dZe ed< dZe ed< gZeeed< dZe ed< dZeed< dZe ed< dZeed< dZeed< dZeeed<eddZede de fdd Z!e"de#eeffd!d"Z$e"de#eeffd#d$Z%e"defd%d&Z&  d-d'ed(eeed)ee'd*edef d+d,Z(dS).NLPCloudaaNLPCloud large language models. To use, you should have the ``nlpcloud`` python package installed, and the environment variable ``NLPCLOUD_API_KEY`` set with your API key. Example: .. code-block:: python from langchain_community.llms import NLPCloud nlpcloud = NLPCloud(model="finetuned-gpt-neox-20b") Nclientzfinetuned-gpt-neox-20b model_nameTgpuenlanggffffff? temperature max_lengthlength_no_input remove_inputremove_end_sequence bad_wordsg?top_p2top_krepetition_penalty num_beamsnum_return_sequencesnlpcloud_api_keyZforbid)extravaluesreturncCsdtt|dd|d<zddl}|j|d|d|d|dd|d <W|Sty1td w) z?Validate that api key and python package exists in environment.r"ZNLPCLOUD_API_KEYrNrrr)rrrzXCould not import nlpcloud python package. Please install it with `pip install nlpcloud`.)r r nlpcloudZClientZget_secret_value ImportError)clsr$r&r)X/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/llms/nlpcloud.pyvalidate_environment:s"    zNLPCloud.validate_environmentc Cs2|j|j|j|j|j|j|j|j|j|j |j d S)z4Get the default parameters for calling NLPCloud API. rrrrrrrrrr r!r,selfr)r)r*_default_paramsPszNLPCloud._default_paramscCs(id|jid|jid|ji|jS)zGet the identifying parameters.rrr)rrrr/r-r)r)r*_identifying_paramsaszNLPCloud._identifying_paramscCsdS)zReturn type of llm.r&r)r-r)r)r* _llm_typekszNLPCloud._llm_typepromptstop run_managerkwargscKsd|r t|dkr td|rt|dkr|d}nd}i|j|}|jj|fd|i|}|dS)alCall out to NLPCloud's create endpoint. Args: prompt: The prompt to pass into the model. stop: Not supported by this interface (pass in init method) Returns: The string generated by the model. Example: .. code-block:: python response = nlpcloud("Tell me a joke.") rzXNLPCloud only supports a single stop sequence per generation.Pass in a list of length 1.rN end_sequenceZgenerated_text)len ValueErrorr/rZ generation)r.r2r3r4r5r6paramsresponser)r)r*_callps zNLPCloud._call)NN))__name__ __module__ __qualname____doc__rr__annotations__rstrrboolrrfloatrintrrrrrrrrr r!r"rr r Z model_configr rr+propertyrr/r0r1rr;r)r)r)r*r sp                rN)typingrrrrrZlangchain_core.callbacksrZ#langchain_core.language_models.llmsrZlangchain_core.utilsr r r Zpydanticr r rr)r)r)r*s