o Zh)@sddlZddlmZmZmZmZmZddlmZddl m Z ddl m Z ddl mZddlmZmZmZddlmZeeZed d d d Gd dde ZdS)N)AnyDictListOptionalUnion) deprecated)CallbackManagerForLLMRun)LLM)get_from_dict_or_env) BaseModel ConfigDictmodel_validator)enforce_stop_tokensz0.3.28z1.0z)langchain_predictionguard.PredictionGuard)ZsinceZremovalZalternative_importc @sveZdZUdZdZeed<dZee ed< dZ ee ed< dZ ee ed < d Zee ed < dZee ed < dZeee ed <dZeee ee effed< dZeee efed< dZee ed< eddZedddedefddZedee effddZede fddZdedee effddZ  d$d e d eee d!ee dede f d"d#Z!dS)%PredictionGuardaPrediction Guard large language models. To use, you should have the ``predictionguard`` python package installed, and the environment variable ``PREDICTIONGUARD_API_KEY`` set with your API key, or pass it as a named parameter to the constructor. Example: .. code-block:: python llm = PredictionGuard( model="Hermes-3-Llama-3.1-8B", predictionguard_api_key="your Prediction Guard API key", ) NclientzHermes-3-Llama-3.1-8Bmodel max_tokensg? temperatureg?top_ptop_kstoppredictionguard_inputpredictionguard_outputpredictionguard_api_keyZforbid)extrabefore)modevaluesreturncCsDt|dd}zddlm}||d|d<W|Sty!tdw)zCValidate that the api_key and python package exists in environment.rZPREDICTIONGUARD_API_KEYr)r)Zapi_keyrzfCould not import predictionguard python package. Please install it with `pip install predictionguard`.)r predictionguardr ImportError)clsrZ pg_api_keyrr#_/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/llms/predictionguard.pyvalidate_environmentBs   z$PredictionGuard.validate_environmentcCs d|jiS)zGet the identifying parameters.r)rselfr#r#r$_identifying_paramsXs z#PredictionGuard._identifying_paramscCsdS)zReturn type of llm.r r#r&r#r#r$ _llm_type]szPredictionGuard._llm_typekwargsc Ksf|d|j}|d|j}i|j|j|j|jt|tr | n|t|tr*| n|d|}|S)Nrr)rrrrinputoutput) poprrrrrr isinstancer Z model_dump)r'r*r+r,paramsr#r#r$_get_parametersbs zPredictionGuard._get_parametersprompt run_managerc Ks|jd i|}d}|jdur|durtd|jdur |j}n|}|jjjd |j|d|}|dD]}|dddrM|d d} td| q4|dd d } |r]t | |} | S) a$Call out to Prediction Guard's model API. Args: prompt: The prompt to pass into the model. Returns: The string generated by the model. Example: .. code-block:: python response = llm.invoke("Tell me a joke.") Nz2`stop` found in both the input and default params.)rr1choicesstatuszerror: z Error from PredictionGuard API: rtextr#) r0r ValueErrorrZ completionscreaterget startswith removeprefixr) r'r1rr2r*r/stopsresponsereserr_msgr6r#r#r$_callys,    zPredictionGuard._call)NN)"__name__ __module__ __qualname____doc__rr__annotations__rrstrrintrfloatrrrrrrrboolrrr Z model_configr r%propertyr(r)r0rr@r#r#r#r$rsR     r)loggingtypingrrrrrZlangchain_core._api.deprecationrZlangchain_core.callbacksrZ#langchain_core.language_models.llmsr Zlangchain_core.utilsr Zpydanticr r r Zlangchain_community.llms.utilsr getLoggerrAloggerrr#r#r#r$s