o %if @sUddlmZddlZddlZddlZddlZddlmZmZm Z m Z ddl Z ddl m Z eZiZded<daded<edd d ZdddZdddZdddZdS)) annotationsN)AnyCallableOptionalSequence)Encodingzdict[str, Encoding] ENCODINGSz1Optional[dict[str, Callable[[], dict[str, Any]]]]ENCODING_CONSTRUCTORSreturn Sequence[str]cCs6g}ttjtjd}|D] \}}}||q|S)N.)pkgutil iter_modules tiktoken_ext__path____name__append)mods plugin_mods_mod_namerJ/var/www/html/corbot_env/lib/python3.10/site-packages/tiktoken/registry.py_available_plugin_moduless  rNonec CstYtdur WddSiatD]=}t|}z|j}Wnty6}z td|d|d}~ww|D]\}}|tvrMtd|d||t|<q;qWddS1s^wYdS)Nztiktoken plugin z& does not define ENCODING_CONSTRUCTORSzDuplicate encoding name z in tiktoken plugin )_lockr r importlib import_moduleAttributeError ValueErroritems)rmod constructorseenc_name constructorrrr_find_constructors s4     "r& encoding_namestrrcCs|tvrt|StE|tvrt|WdStdur'ttdus'J|tvr6td|dtt|}tdi|}|t|<|WdS1sRwYdS)NzUnknown encoding z. Plugins found: r)rrr r&rrr)r'r%encrrr get_encoding7s$ $r* list[str]cCsJttdurttdusJttWdS1swYdS)N)rr r&listrrrrlist_encoding_namesNs  $r-)r r )r r)r'r(r r)r r+) __future__r functoolsrr threadingtypingrrrrr tiktoken.corerRLockrr__annotations__r lru_cacherr&r*r-rrrrs