o Zh@sdZddlZddlZddlZddlZddlmZddlmZm Z m Z ddl m Z ddl mZmZddlmZmZmZeeZGd d d e ZGd d d Zd efddZde efddZGdddZdS)a Implementation of a custom transfer agent for the transfer type "multipart" for git-lfs. Inspired by: github.com/cbartz/git-lfs-swift-transfer-agent/blob/master/git_lfs_swift_transfer.py Spec is: github.com/git-lfs/git-lfs/blob/master/docs/custom-transfers.md To launch debugger while developing: ``` [lfs "customtransfer.multipart"] path = /path/to/huggingface_hub/.env/bin/python args = -m debugpy --listen 5678 --wait-for-client /path/to/huggingface_hub/src/huggingface_hub/commands/huggingface_cli.py lfs-multipart-upload ```N)_SubParsersAction)DictListOptional)BaseHuggingfaceCLICommand)LFS_MULTIPART_UPLOAD_COMMAND SliceFileObj) get_sessionhf_raise_for_statusloggingc@s"eZdZdZedefddZdS) LfsCommandsu Implementation of a custom transfer agent for the transfer type "multipart" for git-lfs. This lets users upload large files >5GB 🔥. Spec for LFS custom transfer agent is: https://github.com/git-lfs/git-lfs/blob/master/docs/custom-transfers.md This introduces two commands to the CLI: 1. $ huggingface-cli lfs-enable-largefiles This should be executed once for each model repo that contains a model file >5GB. It's documented in the error message you get if you just try to git push a 5GB file without having enabled it before. 2. $ huggingface-cli lfs-multipart-upload This command is called by lfs directly and is not meant to be called by the user. parsercCsP|jddd}|jdtdd|jddd |jtd d }|jd dd dS) Nzlfs-enable-largefilesz:Configure your repository to enable upload of files > 5GB.)helppathz/Local path to repository you want to configure.)typercSt|SN)LfsEnableCommandargsrS/var/www/html/lang_env/lib/python3.10/site-packages/huggingface_hub/commands/lfs.py>z1LfsCommands.register_subcommand..)funcF)add_helpcSrr)LfsUploadCommandrrrrrBr) add_parser add_argumentstr set_defaultsr)rZ enable_parserZ upload_parserrrrregister_subcommand8szLfsCommands.register_subcommandN)__name__ __module__ __qualname____doc__ staticmethodrr"rrrrr #sr c@seZdZddZddZdS)rcC ||_dSrrselfrrrr__init__F zLfsEnableCommand.__init__cCsftj|jj}tj|stdtdtjd d|dtjdt  d|dtddS)Nz)This does not look like a valid git repo.zs    "