o Zh @sddlmZddlmZmZmZmZmZddlm Z m Z m Z Gddde Z ddZd d d d ed eeeefdeeed fdedef ddZed edeed fdefddZd S)) lru_cache)CallableDictListOptionalUnion)HfHubHTTPErrorRepositoryNotFoundErroris_minijinja_availablec@seZdZdZdS) TemplateErrorzAAny error raised while trying to fetch or render a chat template.N)__name__ __module__ __qualname____doc__rr\/var/www/html/lang_env/lib/python3.10/site-packages/huggingface_hub/inference/_templating.pyr sr cCststdddl}|S)NzOCannot render template. Please install minijinja using `pip install minijinja`.r)r ImportError minijinja)rrrr_import_minijinja srNT)tokenadd_generation_promptmodel_idmessagesrrreturnc KsZt}t||d}z |d||d|WS|jy,}z td|d||d}~ww)aRender a chat prompt using a model's chat template. Args: model_id (`str`): The model id. messages (`List[Dict[str, str]]`): The list of messages to render. token (`str` or `bool`, *optional*): Hugging Face token. Will default to the locally saved token if not provided. Returns: `str`: The rendered chat prompt. Raises: `TemplateError`: If there's any issue while fetching, compiling or rendering the chat template. )rr)rrz4Error while trying to render chat prompt for model '': Nr)r_fetch_and_compile_templater )rrrrkwargsrtemplateerrrrender_chat_prompts r c sddlm}t}z ||d|j}Wn+ty)}z td|d|d}~wty?}z td|d||d}~ww|durLtd |d |d }|dur]td |d |d durltd|d |d }t |t stdt |d|di| D]%\}} d|vrt | t r| |<qt | t r| ddkr| d|<q|zd |Wn|jy}z td|d||d}~wwfddS)aFetch and compile a model's chat template. Method is cached to avoid fetching the same model's config multiple times. Args: model_id (`str`): The model id. token (`str` or `bool`, *optional*): Hugging Face token. Will default to the locally saved token if not provided. Returns: `Callable`: A callable that takes a list of messages and returns the rendered chat prompt. r)HfApi)rz$Cannot render chat template: model 'z ' not found.Nz5Error while trying to fetch chat template for model 'rzConfig not found for model 'z'.tokenizer_configz&Tokenizer config not found for model ' chat_templatez7Chat template not found in tokenizer_config for model 'z%Chat template must be a string, not 'z ' (model: z).rZ__typeZ AddedTokencontentz7Error while trying to compile chat template for model 'csjdi|S)Nr#)r#)Zrender_template)renvZspecial_tokensrrisz-_fetch_and_compile_template..)Zhuggingface_hub.hf_apir!rZ model_infoconfigr r r get isinstancestrtypeitemsdict EnvironmentZ add_template) rrr!rr(rr"r#keyvaluerr%rr4sJ     r) functoolsrtypingrrrrrutilsr r r Exceptionr rr+boolr rrrrrs(    !$