o TZhX @sddlmZmZmZmZmZddlmZddlm Z ddl m Z m Z ddl mZeeZGdd d e Zd ed ed eeeefd eeeeffddZd ed ed eeeefd eeeeefffddZdS))AnyDictListOptionalUnion)config) DatasetsError)"get_authentication_headers_for_urlhttp_get) get_loggerc@seZdZdZdS)DatasetsServerErrorzDataset-server error. Raised when trying to use the Datasets-server HTTP API and when trying to access: - a missing dataset, or - a private/gated dataset and the user is not authenticated. - unavailable /parquet or /info responses N)__name__ __module__ __qualname____doc__rrV/var/www/html/lang_env/lib/python3.10/site-packages/datasets/utils/_datasets_server.pyrsrdatasetrevisiontokenreturnc CsDtjddd}zqt||dttjd||dddd }|d |jvrq|jd |ks3|dur]|}|d d urS|d dsS|ddsSd|vrS|dWSt d|dnt d|d|jd dWtdWtdWtdt y}zt d|dt |j d|dWYd}~tdd}~ww)zn Get the dataset exported parquet files Docs: https://huggingface.co/docs/datasets-server/parquet ://://datasets-server.z/parquet?dataset=N datasets/rY@url temp_fileheaderstimeout max_retries X-RevisionpartialFpendingTfailedZ parquet_fileszParquet export for  is not completely ready yet.& is available but outdated (revision='')zNo parquet export for available (: )z$No exported Parquet files available.rZ HF_ENDPOINTreplacer r raise_for_statusr"jsongetloggerdebug Exceptiontyperr)rrrZdatasets_server_parquet_urlZparquet_data_files_responseZ parquet_data_files_response_jsonerrrget_exported_parquet_filessD    .r9c CsDtjddd}zqt||dttjd||dddd }|d |jvrq|jd |ks3|dur]|}|d d urS|d dsS|ddsSd|vrS|dWSt d|dnt d|d|jd dWtdWtdWtdt y}zt d|dt |j d|dWYd}~tdd}~ww)z Get the dataset information, can be useful to get e.g. the dataset features. Docs: https://huggingface.co/docs/datasets-server/info rrz/info?dataset=Nrrrrrr%r&Fr'Tr(Z dataset_infozDataset info for r)r*r+zNo dataset info for r,r-r.z$No exported dataset infos available.r/)rrrZdatasets_server_info_urlZ info_responser8rrrget_exported_dataset_infos=sD    .r:N)typingrrrrrr exceptionsr Z file_utilsr r loggingr rr4rstrboolr9r:rrrrs"   2 $