o Zh@shddlZddlmZmZmZmZmZddlmZm Z m Z ddl m Z GdddZ Gdddee ZdS) N)AnyDictListOptionalTuple) BaseModel ConfigDictmodel_validator)BaseCrossEncoderc@sLeZdZdZdZdZdeeeefde fddZ de dee fdd Z d S) CrossEncoderContentHandlerz'Content handler for CrossEncoder class.zapplication/json text_pairsreturncCstd|i}|dS)Nr utf-8)jsondumpsencode)selfr Z input_strrl/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/cross_encoders/sagemaker_endpoint.pytransform_inputs z*CrossEncoderContentHandler.transform_inputoutputcCs t|d}|d}|S)Nrscores)rloadsreaddecode)rrZ response_jsonrrrrtransform_outputsz+CrossEncoderContentHandler.transform_outputN)__name__ __module__ __qualname____doc__ content_typeacceptsrrstrbytesrrfloatrrrrrr s r c@seZdZUdZ dZeed<dZeed< dZ eed< dZ e eed< e Z e ed<dZe eed < dZe eed < ed d d dZeddededefddZdeeeefdeefddZdS)SagemakerEndpointCrossEncoderaSageMaker Inference CrossEncoder endpoint. To use, you must supply the endpoint name from your deployed Sagemaker model & the region where it is deployed. To authenticate, the AWS client uses the following methods to automatically load credentials: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html If a specific credential profile should be used, you must pass the name of the profile from the ~/.aws/credentials file that is to be used. Make sure the credentials / roles used have the required policies to access the Sagemaker endpoint. See: https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies.html Nclient endpoint_name region_namecredentials_profile_namecontent_handler model_kwargsendpoint_kwargsTZforbidr)Zarbitrary_types_allowedextraZprotected_namespacesbefore)modevaluesr c Csz7ddl}z!|dr|j|dd}n|}|jd|dd|d<WW|Sty7}ztd |d}~wwtyBtd w) zJValidate that AWS credentials to and python package exists in environment.rNr*)Z profile_namezsagemaker-runtimer))r)r&zCould not load credentials to authenticate with AWS client. Please check that credentials in the specified profile name are valid.zRCould not import boto3 python package. Please install it with `pip install boto3`.)boto3getSessionr& Exception ValueError ImportError)clsr1r2sessionerrrvalidate_environment`s2  z2SagemakerEndpointCrossEncoder.validate_environmentr c Cs|jpi}|j|}|jj}|jj}z|jjd|j|||d|}Wnty7}zt d|d}~ww|j |dS)z6Call out to SageMaker Inference CrossEncoder endpoint.)Z EndpointNameBodyZ ContentTypeAcceptz$Error raised by inference endpoint: Nr<r) r-r+rr r!r&Zinvoke_endpointr(r5r6r)rr Z_endpoint_kwargsbodyr r!responser:rrrscores$   z#SagemakerEndpointCrossEncoder.score)rrrrr&r__annotations__r(r"r)r*rr r+r,rr-rZ model_configr classmethodr;rrr$r@rrrrr%s,    & r%)rtypingrrrrrZpydanticrrr Z'langchain_community.cross_encoders.baser r r%rrrrs