o %Âif& ã@s>UddlmZddlmZddlmZddddddddœZded<id d“d d“d d“d d“d d“dd“dd“dd“dd“dd“dd“dd“dd“dd“dd“dd“dd“idd“dd“dd“dd“d d“d!d"“d#d"“d$d“d%d“d&d“d'd“d(d“d)d“d*d“d+d“d,d“d-d“¥d.d.i¥Zded/<d9d3d4„Z d:d6d7„Z d8S);é)Ú annotationsé)ÚEncoding)Ú get_encodingÚ cl100k_base)zgpt-4-zgpt-3.5-turbo-z gpt-35-turbo-zft:gpt-4zft:gpt-3.5-turbozft:davinci-002zft:babbage-002zdict[str, str]ÚMODEL_PREFIX_TO_ENCODINGzgpt-4z gpt-3.5-turboz gpt-35-turboz davinci-002z babbage-002ztext-embedding-ada-002ztext-davinci-003Ú p50k_baseztext-davinci-002ztext-davinci-001Ú r50k_baseztext-curie-001ztext-babbage-001z text-ada-001ÚdavinciÚcurieÚbabbageÚadazcode-davinci-002zcode-davinci-001zcode-cushman-002zcode-cushman-001z davinci-codexz cushman-codexztext-davinci-edit-001Ú p50k_editzcode-davinci-edit-001ztext-similarity-davinci-001ztext-similarity-curie-001ztext-similarity-babbage-001ztext-similarity-ada-001ztext-search-davinci-doc-001ztext-search-curie-doc-001ztext-search-babbage-doc-001ztext-search-ada-doc-001zcode-search-babbage-code-001zcode-search-ada-code-001Úgpt2ÚMODEL_TO_ENCODINGÚ model_nameÚstrÚreturncCsXd}|tvr t|}nt ¡D] \}}| |¡r|Sq|dur*td|›dƒd‚|S)zrReturns the name of the encoding used by a model. Raises a KeyError if the model name is not recognised. NzCould not automatically map z_ to a tokeniser. Please use `tiktoken.get_encoding` to explicitly get the tokeniser you expect.)rrÚitemsÚ startswithÚKeyError)rÚ encoding_nameÚ model_prefixÚmodel_encoding_name©rúG/var/www/html/corbot_env/lib/python3.10/site-packages/tiktoken/model.pyÚencoding_name_for_modelCs  ÿ ÿýrrcCs tt|ƒƒS)zfReturns the encoding used by a model. Raises a KeyError if the model name is not recognised. )rr)rrrrÚencoding_for_model\s rN)rrrr)rrrr) Ú __future__rÚcorerÚregistryrrÚ__annotations__rrrrrrrÚs¨  ÷ þýüúù ÷ ô óòñðïîíìëéèçæåäâá!ß"Þ#Ý$Ü%Û&Ú'Ù(Ø)×*Ö,Ô 0