o Zh@sdZddlZddlZddlmZddlmZGdddeZGd d d eZ Gd d d e Z Gd dde Z ddZ gdZ dS)zEModule implementing the Pool for :mod:``requests_toolbelt.threaded``.N)thread)queuec@sneZdZdZdddejfddZddZeddZ edd d Z d d Z d dZ ddZ ddZddZdS)Poola>Pool that manages the threads containing sessions. :param queue: The queue you're expected to use to which you should add items. :type queue: queue.Queue :param initializer: Function used to initialize an instance of ``session``. :type initializer: collections.Callable :param auth_generator: Function used to generate new auth credentials for the session. :type auth_generator: collections.Callable :param int num_process: Number of threads to create. :param session: :type session: requests.Session Ncs||dur tp d}|dkrtd|_t_t_|_|p%t _ |p*t _ |_ fddt jD_dS)Nrz)Number of processes should at least be 1.cs&g|]}tjjjqS)rZ SessionThread _new_session _job_queue_response_queue _exc_queue).0_selfrV/var/www/html/lang_env/lib/python3.10/site-packages/requests_toolbelt/threaded/pool.py *s z!Pool.__init__..)multiprocessing cpu_count ValueErrorr rQueuer r Z _processes _identity _initializer_auth_sessionrange_pool)r job_queueZ initializerZauth_generatorZ num_processessessionrrr__init__s       z Pool.__init__cCs|||SN)rrrrrrrr0szPool._new_sessioncKs0t}|D]}||jq|dd|i|S)a2Create a :class:`~Pool` from an :class:`~ThreadException`\ s. Provided an iterable that provides :class:`~ThreadException` objects, this classmethod will generate a new pool to retry the requests that caused the exceptions. :param exceptions: Iterable that returns :class:`~ThreadException` :type exceptions: iterable :param kwargs: Keyword arguments passed to the :class:`~Pool` initializer. :returns: An initialized :class:`~Pool` object. :rtype: :class:`~Pool` rNr)rrputrequest_kwargs)cls exceptionskwargsrexcrrrfrom_exceptions3szPool.from_exceptionscKsZddi}||p it}|D]}|}|d|i||q|dd|i|S)aCreate a :class:`~Pool` from an iterable of URLs. :param urls: Iterable that returns URLs with which we create a pool. :type urls: iterable :param dict request_kwargs: Dictionary of other keyword arguments to provide to the request method. :param kwargs: Keyword arguments passed to the :class:`~Pool` initializer. :returns: An initialized :class:`~Pool` object. :rtype: :class:`~Pool` methodGETurlrNr)updaterrcopyr )r"urlsr!r$Z request_dictrr)Zjobrrr from_urlsIs zPool.from_urlscc |}|dur dS|Vq)zoIterate over all the exceptions in the pool. :returns: Generator of :class:`~ThreadException` TN) get_exception)rr%rrrr#bzPool.exceptionscC4z |j\}}Wn tjyYdSwt||S)zSGet an exception from the pool. :rtype: :class:`~ThreadException` N)r get_nowaitrEmptyThreadException)rrequestr%rrrr/m  zPool.get_exceptioncCr1)zPGet a response from the pool. :rtype: :class:`~ThreadResponse` N)r r2rr3ThreadResponse)rr5responserrr get_responseyr6zPool.get_responseccr.)zmIterate over all the responses in the pool. :returns: Generator of :class:`~ThreadResponse` TN)r9)rresprrr responsesr0zPool.responsescCs|jD]}|qdS)z*Join all the threads to the master thread.N)rjoin)rZsession_threadrrrjoin_alls  z Pool.join_allr)__name__ __module__ __qualname____doc__requestsSessionrr classmethodr&r-r#r/r9r;r=rrrrr s      rc@seZdZdZddZdS) ThreadProxyNcCs0tj}||jvr|||j}t||S|||S)z/Proxy attribute accesses to the proxied object.)object__getattribute__attrs proxied_attrgetattr)rattrgetr8rrr __getattr__s     zThreadProxy.__getattr__)r>r?r@rIrMrrrrrEs rEc@(eZdZdZdZeddgZddZdS)r7a>A wrapper around a requests Response object. This will proxy most attribute access actions to the Response object. For example, if you wanted the parsed JSON from the response, you might do: .. code-block:: python thread_response = pool.get_response() json = thread_response.json() r8r!cC||_||_dSr)r!r8)rr!r8rrrr zThreadResponse.__init__Nr>r?r@rArI frozensetrHrrrrrr7   r7c@rN)r4a=A wrapper around an exception raised during a request. This will proxy most attribute access actions to the exception object. For example, if you wanted the message from the exception, you might do: .. code-block:: python thread_exc = pool.get_exception() msg = thread_exc.message exceptionr!cCrOr)r!rT)rr!rTrrrrrPzThreadException.__init__NrQrrrrr4rSr4cCs|Srr)Z session_objrrrrsr)r4r7r)rArrBr_compatrrFrrEr7r4r__all__rrrrs