o ®©Zh‹ã@sNddlZddlmZmZddlmZddlmZe e ¡Z Gdd„deƒZ dS)éN)ÚAnyÚOptional)ÚLLM)ÚIpexLLMc@sšeZdZdZe dddddœdedeedeeded eed e d e fd d „ƒZ e dddœdedeedeed e d e f dd„ƒZ e d efdd„ƒZdS)ÚBigdlLLMzÔWrapper around the BigdlLLM model Example: .. code-block:: python from langchain_community.llms import BigdlLLM llm = BigdlLLM.from_model_id(model_id="THUDM/chatglm-6b") NT)Ú tokenizer_idÚ load_in_4bitÚload_in_low_bitÚmodel_idÚ model_kwargsrrr ÚkwargsÚreturncKs&t d¡zddlm}m}ddlm} m} Wn ty"tdƒ‚w|dur,t d¡|s2t dƒ‚|p5i} |p9|} z | j | fi| ¤Ž} Wnt yW| j | fi| ¤Ž} Ynwz |j |fd d i| ¤Ž}Wnt yy|j |fd d i| ¤Ž}Ynwd | vr‡d d „|   ¡Dƒ} |d||| | dœ|¤ŽS)a5 Construct object from model_id Args: model_id: Path for the huggingface repo id to be downloaded or the huggingface checkpoint folder. tokenizer_id: Path for the huggingface repo id to be downloaded or the huggingface checkpoint folder which contains the tokenizer. model_kwargs: Keyword arguments to pass to the model and tokenizer. kwargs: Extra arguments to pass to the model and tokenizer. Returns: An object of BigdlLLM. ú4BigdlLLM was deprecated. Please use IpexLLM instead.r©Ú AutoModelÚAutoModelForCausalLM©Ú AutoTokenizerÚLlamaTokenizerúpCould not import bigdl-llm or transformers. Please install it with `pip install --pre --upgrade bigdl-llm[all]`.Nz°`load_in_low_bit` option is not supported in BigdlLLM and is ignored. For more data types support with `load_in_low_bit`, use IpexLLM instead.zŒBigdlLLM only supports loading in 4-bit mode, i.e. load_in_4bit = True. Please install it with `pip install --pre --upgrade bigdl-llm[all]`.rTÚtrust_remote_codecSói|] \}}|dkr||“qS©r©©Ú.0ÚkÚvrrúY/var/www/html/lang_env/lib/python3.10/site-packages/langchain_community/llms/bigdl_llm.pyÚ ]óz*BigdlLLM.from_model_id..©r ÚmodelÚ tokenizerr r) ÚloggerÚwarningÚbigdl.llm.transformersrrÚ transformersrrÚ ImportErrorÚ ValueErrorÚfrom_pretrainedÚ ExceptionÚitems)Úclsr r rrr r rrrrÚ _model_kwargsÚ _tokenizer_idr#r"rrrÚ from_model_idsj  ÿÿÿÿ ÿÿÿ ÿ ÿÿ ÿÿÿüûzBigdlLLM.from_model_id)rc Kst d¡zddlm}m}ddlm}m}Wn ty"tdƒ‚w|p&i} |p*|} z |j | fi| ¤Ž} Wnt yH|j | fi| ¤Ž} Ynwz |j |fi| ¤Ž} Wnt yf|j |fi| ¤Ž} Ynwd| vrtdd„|   ¡Dƒ} |d || | | d œ|¤ŽS) aê Construct low_bit object from model_id Args: model_id: Path for the bigdl-llm transformers low-bit model folder. tokenizer_id: Path for the huggingface repo id or local model folder which contains the tokenizer. model_kwargs: Keyword arguments to pass to the model and tokenizer. kwargs: Extra arguments to pass to the model and tokenizer. Returns: An object of BigdlLLM. rrrrrrcSrrrrrrrržr z2BigdlLLM.from_model_id_low_bit..r!Nr) r$r%r&rrr'rrr(r*r+Z load_low_bitr,) r-r r rr rrrrr.r/r#r"rrrÚfrom_model_id_low_bitisB  ÿÿ ÿ ÿÿüûzBigdlLLM.from_model_id_low_bitcCsdS)Nz bigdl-llmr)ÚselfrrrÚ _llm_typeªszBigdlLLM._llm_type)N)Ú__name__Ú __module__Ú __qualname__Ú__doc__Ú classmethodÚstrrÚdictÚboolrrr0r1Úpropertyr3rrrrr sP ýùþýûúùø ÷Sýûþýûú ù@r) ÚloggingÚtypingrrZ#langchain_core.language_models.llmsrZ!langchain_community.llms.ipex_llmrÚ getLoggerr4r$rrrrrÚs