o Zh@sdZddlZddlmZmZmZmZddlmZddl m Z ddl m Z m Z ddlmZddlmZmZdd lmZmZmZdd lmZeeZe d d d dGdddeZdS)z,Wrapper around Together AI's Completion API.N)AnyDictListOptional) ClientSession) deprecated)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)LLMconvert_to_secret_strget_from_dict_or_env) ConfigDict SecretStrmodel_validator)Requestsz0.0.12z1.0zlangchain_together.Together)ZsinceZremovalZalternative_importc @szeZdZUdZdZeed< eed< eed< dZe e ed< dZ e e ed< dZ e e ed < dZe e ed < dZe e ed < dZe e ed < ed dZeddededefddZedefddZdedefddZedefddZedeeeffddZ  d&dede eed e e d!edef d"d#Z!  d&dede eed e e"d!edef d$d%Z#dS)'TogetheraLLLM models from `Together`. To use, you'll need an API key which you can find here: https://api.together.xyz/settings/api-keys. This can be passed in as init param ``together_api_key`` or set as environment variable ``TOGETHER_API_KEY``. Together AI API reference: https://docs.together.ai/reference/inference z"https://api.together.xyz/inferencebase_urltogether_api_keymodelN temperaturetop_ptop_k max_tokensrepetition_penaltylogprobsZforbid)extrabefore)modevaluesreturncCstt|dd|d<|S)z,Validate that api key exists in environment.rZTOGETHER_API_KEYr )clsrr"X/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/llms/together.pyvalidate_environmentIs zTogether.validate_environmentcCsdS)zReturn type of model.Ztogetherr"selfr"r"r# _llm_typeRszTogether._llm_typeoutputcCs|ddddS)Nr(choicesrtextr")r&r(r"r"r#_format_outputWszTogether._format_outputcCsddlm}d|S)Nr __version__z langchain/)Zlangchain_communityr-r,r"r"r#get_user_agentZs  zTogether.get_user_agentcCs|j|j|j|j|j|jdS)Nrrrrrrr/r%r"r"r#default_params`szTogether.default_paramspromptstop run_managerkwargsc Ksd|jdd}|rt|dkr|dn|}i|j||d|}dd|D}t|d }|j|j|d } | jd krHt d | j| jd krUt d| j | jdkrft d| jd| j | } | ddkr{| dd} t | || } | S)zCall out to Together's text generation endpoint. Args: prompt: The prompt to pass into the model. Returns: The string generated by the model.. Bearer application/json Authorizationz Content-Typerr1r2cSi|] \}}|dur||qSNr".0kvr"r"r# z"Together._call..)headers)urldataTogether Server: Error &Together received an invalid payload: 5Together returned an unexpected response with status : statusfinishederrorUndefined Error)rget_secret_valuelenr0itemsrpostr status_code Exception ValueErrorr*jsongetr+) r&r1r2r3r4rC stop_to_usepayloadrequestresponserEerr_msgr(r"r"r#_callksB      zTogether._callc sd|jdd}|rt|dkr|dn|}i|j||d|}dd|D}t4Id H}|j|j||d 4Id H_} | jd krRt d | j| jd kr_t d| j | jdkrpt d| jd| j | Id H} | ddkr| dd} t | || } | Wd Id HWd Id HS1Id HswYWd Id Hd S1Id HswYd S)zCall Together model to get predictions based on the prompt. Args: prompt: The prompt to pass into the model. Returns: The string generated by the model. r5r6r7r9rr:cSr;r<r"r=r"r"r#rArBz#Together._acall..N)rXrCrFrGrHrIrJrKrLrMrNrOrP)rrQrRr0rSrrTrrMrVrWr*rXrYr+) r&r1r2r3r4rCrZr[sessionr]Z response_jsonr^r(r"r"r#_acallsV      .zTogether._acall)NN)$__name__ __module__ __qualname____doc__rstr__annotations__rrrfloatrrintrrrrZ model_configr classmethodrrr$propertyr'dictr+ staticmethodr.r0rr r_rrar"r"r"r#rsv     7 r)reloggingtypingrrrrZaiohttprZlangchain_core._api.deprecationrZlangchain_core.callbacksrr Z#langchain_core.language_models.llmsr Zlangchain_core.utilsr r ZpydanticrrrZ&langchain_community.utilities.requestsr getLoggerrbloggerrr"r"r"r#s