o "if@sdZddlmZddlZddlZddlZddlZddlZddlZddl m Z ddl m Z ddl mZddl mZddl mZdd l mZdd l mZdd l mZdd l mZdd l mZGdddeZGdddeZGdddeZGdddeZGdddejdZGdddeZGdddeZGdddeZGdd d eZdd$d%Z Gd&d'd'Z!Gd(d)d)Z"e#e$fZ%ej&'d*Z(e)Z*e(d+krdd/d0Z+n&e(rddlZddl,Z,ej-.e,/d1e*Z0e1e0d2Z2dd3d0Z+nd4d5Z3Z+Gd6d7d7Z4Gd8d9d9Z5Gd:d;d;e6Z7ej8e%fddAdBZ9GdCdDdDe6Z:GdEdFdFe;ZGdGdHdHZ?e=Z@dIZAdJZBGdKdLdLZCGdMdNdNZDGdOdPdPeDZEGdQdRdReDZFGdSdTdTZGGdUdVdVeGZHGdWdXdXe6ZIGdYdZdZeIZJGd[d\d\eIZKdd`daZLeLdbZMdcZNddZOePeOZQdeZRePeRZSGdfdgdge6ZTGdhdidiZUGdjdkdkZVddmdnZWddodpZX qdddwdxZY qdddzd{ZZ  ddd~dZ[dddZ\GdddZ]dddZ^dddZ_dS)zBase execnet gateway code send to the other side for bootstrapping. :copyright: 2004-2015 :authors: - Holger Krekel - Armin Rigo - Benjamin Peterson - Ronny Pfannschmidt - many others ) annotationsN)interrupt_main)BytesIO)Any)Callable)Iterator)Literal) MutableSet)Protocol)cast)overloadc@eZdZdddZdS) WriteIOdatabytesreturnNonecCdSNselfrrrM/var/www/html/corbot_env/lib/python3.10/site-packages/execnet/gateway_base.pywrite!z WriteIO.writeNrrrr)__name__ __module__ __qualname__rrrrrr rc@r ) ReadIOnumbytesintrrcCrrrrr!rrrread%rz ReadIO.readNr!r"rr)rrrr$rrrrr $rr c@sReZdZUded<dddZdd d Zdd dZdddZdddZdddZ dS)IO ExecModel execmodelr!r"rrcCrrrr#rrrr$+rzIO.readrrcCrrrrrrrr-rzIO.writecCrrrrrrr close_read/rz IO.close_readcCrrrr)rrr close_write1rzIO.close_write int | NonecCrrrr)rrrwait3rzIO.waitcCrrrr)rrrkill5rzIO.killNr%rrr)rr,) rrr__annotations__r$rr*r+r-r.rrrrr&(s      r&c@s:eZdZdZdddZdddZdd d ZddddZd S)Eventz3Protocol for types which look like threading.Event.rboolcCrrrr)rrris_set;rz Event.is_setrcCrrrr)rrrset=rz Event.setcCrrrr)rrrclear?rz Event.clearNtimeout float | NonecCrrrrr6rrrr-Arz Event.waitrr2r/rr6r7rr2)rrr__doc__r3r4r5r-rrrrr18s    r1c@seZdZeejd$ddZd$ddZeejddZeejd d Z eejd d Z ejd%d&ddZ ejd'ddZ ejd(ddZ ejd)ddZejddZejddZejd*d!d"Zd#S)+r'rstrcCtrNotImplementedErrorr)rrrbackendEzExecModel.backendcCs d|jS)Nzr@r)rrr__repr__J zExecModel.__repr__cCr=rr>r)rrrqueueMrAzExecModel.queuecCr=rr>r)rrr subprocessRrAzExecModel.subprocesscCr=rr>r)rrrsocketWrAzExecModel.socketrrcCr=rr>)rfuncargsrrrstart\zExecModel.startr"cCr=rr>r)rrr get_ident`rKzExecModel.get_identdelayfloatcCr=rr>)rrMrrrsleepdrKzExecModel.sleepTcCr=rr>)rfdmodebufsizeclosefdrrrfdopenhrKzExecModel.fdopencCr=rr>r)rrrLocklrKzExecModel.LockcCr=rr>r)rrrRLockprKzExecModel.RLockr1cCr=rr>r)rrrr1trKzExecModel.EventNrr<rr/rr"rMrNrrrPT)rr1)rrrpropertyabcabstractmethodr@rCrErFrGrJrLrOrUrVrWr1rrrrr'Ds8         r') metaclassc@veZdZdZeddZeddZeddZdd d Zd ddZ d!d"ddZ d#ddZ ddZ ddZ ddZdS)$ThreadExecModelthreadcC ddl}|SNr)rE)rrErrrrE|zThreadExecModel.queuecCrdre)rF)rrFrrrrFrfzThreadExecModel.subprocesscCrdre)rG)rrGrrrrGrfzThreadExecModel.socketrr"cCddl}|Sre)_threadrL)rrhrrrrLzThreadExecModel.get_identrMrNrcCddl}||dSre)timerO)rrMrkrrrrOzThreadExecModel.sleeprcCsddl}|||dSre)rhstart_new_thread)rrHrIrhrrrrJszThreadExecModel.startrPTcCsddl}|j|||d|dS)Nrutf-8)encodingrT)osrU)rrQrRrSrTrprrrrUszThreadExecModel.fdopencCrgre threadingrWrrrrrrrVrizThreadExecModel.LockcCrgrerqrsrrrrWrizThreadExecModel.RLockcCrgre)rrr1rsrrrr1rizThreadExecModel.EventNrZr[rYr/r\rrrr@r]rErFrGrLrOrJrUrVrWr1rrrrrby        rbc@eZdZdZdS)MainThreadOnlyExecModelmain_thread_onlyN)rrrr@rrrrrwrwc@ra)$EventletExecModeleventletcCddl}|jSre)r{rErr{rrrrEzEventletExecModel.queuecCddl}|jjSre)eventlet.green.subprocessgreenrFr}rrrrFzEventletExecModel.subprocesscCrre)eventlet.green.socketrrGr}rrrrGrzEventletExecModel.socketrr"cCddl}|jjSre)eventlet.green.threadrrcrLr}rrrrL zEventletExecModel.get_identrMrNrcCrjre)r{rO)rrMr{rrrrOrlzEventletExecModel.sleeprcCddl}|j|g|RdSre)r{spawn_n)rrHrIr{rrrrJzEventletExecModel.startrPTcCsddl}|jjj||||dSNrrT)eventlet.green.osrrprU)rrQrRrSrTr{rrrrUrzEventletExecModel.fdopencCrreeventlet.green.threadingrrrrWr}rrrrVrzEventletExecModel.LockcCrrerr}rrrrWrzEventletExecModel.RLockcCrre)rrrrr1r}rrrr1rzEventletExecModel.EventNrZr[rYr/r\rtrrrrrzrurzc@ra)$GeventExecModelgeventcCr|re) gevent.queuerErrrrrrEr~zGeventExecModel.queuecCr|re)gevent.subprocessrFrrrrrFr~zGeventExecModel.subprocesscCr|re)rrGrrrrrGr~zGeventExecModel.socketrr"cCddl}|jSre) gevent.threadrcrLrrrrrL zGeventExecModel.get_identrMrNrcCrjre)rrO)rrMrrrrrO rlzGeventExecModel.sleeprcCrre)rspawn)rrHrIrrrrrJrzGeventExecModel.startrPTcCsddl}|jj||||dSr)gevent.fileobject fileobjectFileObjectThread)rrQrRrSrTrrrrrUszGeventExecModel.fdopencCrre gevent.locklockrWrrrrrVrzGeventExecModel.LockcCrrerrrrrrWrzGeventExecModel.RLockcCrre) gevent.eventeventr1rrrrr1#rzGeventExecModel.EventNrZr[rYr/r\rtrrrrrs        rr@str | ExecModelrcCsTt|tr|S|dkrtS|dkrtS|dkrtS|dkr#tStd|)Nrcrxr{rzunknown execmodel ) isinstancer'rbrwrzr ValueErrorrBrrr get_execmodel)s rc@s<eZdZdZdddZddd d Zddd dZdddZdS)ReplyzhProvide access to the result of a function execution that got dispatched through WorkerPool.spawn(). threadmodelr'rrcCs||_||_d|_dSNT)taskr1 _result_readyrunning)rrrrrr__init__<s  zReply.__init__Nr6r7cCs*||z|jWSty|jdw)zget the result object from an asynchronous function execution. if the function execution raised an exception, then calling get() will reraise that exception including its traceback. N) waitfinish_resultAttributeError_excr8rrrgetAs  z Reply.getcCs |j|std|jdS)Nztimeout waiting for )rr-OSErrorrr8rrrrMs zReply.waitfinishc Cs|j\}}}z6z ||i||_Wnty&}z ||_WYd}~nd}~wwW|jd|_dSW|jd|_dS|jd|_wNF)rr BaseExceptionrrr4r)rrHrIkwargsexcrrrrunQs      z Reply.run)rr'rrr)r6r7r6r7rrr/)rrrr;rrrrrrrrr8s    rc@szeZdZUdZded<d#d$d d Zd%d dZd%ddZd&ddZd'ddZ d(ddZ d)ddZ d*d+dd Z d*d+d!d"Z dS), WorkerPoolaA WorkerPool allows to spawn function executions to threads, returning a reply object on which you can ask for the result (and get exceptions reraised). This implementation allows the main thread to integrate itself into performing function execution through calling integrate_as_primary_thread() which will return when the pool received a trigger_shutdown(). By default allows unlimited number of spawns. z Reply | None_primary_thread_taskFr(r' hasprimaryr2rrcCsX||_|j|_t|_d|_g|_|r'|jjdvrtd|j |_ dSd|_ dS)NFrcrxz%hasprimary=True requires thread model) r(rV _running_lockr4_running _shuttingdown_waitall_eventsr@rr1_primary_thread_task_ready)rr(rrrrrls   zWorkerPool.__init__cCs|jjdvs J|j|j}|dusJ ||j}|dur"dS|||j|jr7 WddS||jur@|Wdn1sJwYq)zyIntegrate the thread with which we are called as a primary thread for executing functions triggered with spawn().rN) r(r@rr-r_perform_spawnrrr5)rprimary_thread_task_readyreplyrrrintegrate_as_primary_threadys$   z&WorkerPool.integrate_as_primary_threadcCs\|j!d|_|jdurd|_|jWddSWddS1s'wYdSr)rrrrr4r)rrrtrigger_shutdowns  "zWorkerPool.trigger_shutdownr"cCs t|jSr)lenrr)rrr active_countrDzWorkerPool.active_countrrcCs||j1|j||js(|jr0|j}||jsWddSWddSWddS1s;wYdSr)rrrremoverpopr4)rr waitall_eventrrrrs  "zWorkerPool._perform_spawncCs^|j}|dur-|s||_|dS|jjdkr-|jdur-|j||_|dSdS)NTrxF)rr3rr4r(r@r)rrrrrr_try_send_to_primary_threads   z&WorkerPool._try_send_to_primary_threadcOst|||f|j}|j,|jrtd|j|||s0|j|j |fWd|SWd|S1s;wY|S)zAAsynchronously dispatch func(*args, **kwargs) and return a Reply.zpool is shutting downN) rr(rrrraddrrJr)rrHrIrrrrrrs    zWorkerPool.spawnNr6r7cCs||j|dS)z;Trigger shutdown and wait for completion of all executions.r6)rwaitallr8rrr terminates zWorkerPool.terminatecCs`|j|js WddS|j}|j|Wdn1s%wY|j|dS)z5Wait until all active spawns have finished executing.NTr)rrr(r1rappendr-)rr6my_waitall_eventrrrrs  zWorkerPool.waitallF)r(r'rr2rrr/rZ)rrrr)rrrr2)rrrr:)rrrr;r0rrrrrrrrrrrrrr]s       r EXECNET_DEBUG2msgobjectrcGsPzdtt|}tjdtd|dtjWdSty'YdSw)N [z]  ) joinmapr<sysstderrrpidflush Exception)rlinerrrtraces rzexecnet-debug-%dwc Gszdtt|}t|dtWdStyI}z'ztjdt d|dWn ty6YnwWYd}~dSWYd}~dSd}~ww)Nrrrz] exception during tracing: ) rrr< debugfilerrrrrr)rrrrrrrs cGrrrrrrrrrc@sHeZdZeeefZdddZdd d Zdd dZ dddZ dddZ dS)Popen2IOr(r'rrc Cs|||_|_tjdkr0ddl}z||tj||tjWn t t fy/Ynwt |d|j |_ t |d|j|_||_dS)Nwin32rbuffer)outfileinfilerplatformmsvcrtsetmodefilenorpO_BINARYrrgetattrr$_readr_writer()rrrr(rrrrrs  zPopen2IO.__init__r!r"rcCsRd}|t|kr'||t|}|std|t|f||7}|t|ks|S)z,Read exactly 'numbytes' bytes from the pipe.zexpected %d bytes, got %d)rrEOFError)rr!bufrrrrr$s  z Popen2IO.readrcCs&t|tsJ|||jdS)zWrite out all data bytes.N)rrrrrrrrrrs zPopen2IO.writecC|jdSr)rcloser)rrrr*"zPopen2IO.close_readcCrr)rrr)rrrr+%rzPopen2IO.close_writeN)r(r'rrr%rr/) rrrIOErrorrrerrorrr$rr*r+rrrrrs    rc@s&eZdZUdZiZded<d>d?d dZed@ddZdAddZ dBddZ dCddZ dDddZ dZ d e fee <dDd!d"Zd#Zd$efee<dDd%d&Zd'Zd(efee<dDd)d*Zd+Zd,efee<dDd-d.Zd/Zd0efee<dDd1d2Zd3Zd4efee<dDd5d6Zd7Zd8efee<dDd9d:Zd;Zd)rrrrr)rnamerrrrCGs zMessage.__repr__messagecCsHt|jj|j|jjd}|tj |j t ||tj |j dS)N) numchannels numexecutingr() r_channelfactory _channels _execpoolrr(r@_sendr CHANNEL_DATArdumps_internal CHANNEL_CLOSE)rr drrr_statusKs zMessage._statusSTATUScCsFt|j|}t|ts J|}|jdkr||_dS||j|j_dSre)loads_internalrrtupler _strconfigrnew)rr r strconfigrrr _reconfigureZs   zMessage._reconfigurerP RECONFIGUREcCst|r)GatewayReceivedTerminaterr rrr_gateway_terminatefszMessage._gateway_terminateGATEWAY_TERMINATEcCs"|j|j}|j||jddS)N)r sourcetask)rr#r_local_schedulexecr)rr rrrr _channel_execlszMessage._channel_exec CHANNEL_EXECcCs|j|j|jdSr)r_local_receiverrr(rrr _channel_dataszMessage._channel_datarcCs|j|jdSrr _local_closerr(rrr_channel_closeyzMessage._channel_closercCs4t|j}t|ts Jt|}|j|j|dSr)r rrr< RemoteErrorrr6r)rr  error_message remote_errorrrr_channel_close_errors zMessage._channel_close_errorCHANNEL_CLOSE_ERRORcCs|jj|jdddSNT)sendonlyr5r(rrr_channel_last_messager3zMessage._channel_last_messageCHANNEL_LAST_MESSAGENrrrr"rr"rrrr)rr rr)rrrr)r r rrrX)rrr r rr)rrrr;rr0r staticmethodr r rrCrrr%r&r)r+r.r0r2rr7rr=r?rBrDrrrrr)sB                     rc@rv)r'z'Receiverthread got termination message.Nrrrr;rrrrr'ryr'rrsysextuple[type[BaseException], ...]r<cCsZz|t|||j}d|}W|S|yty,t|jd|}Y|Sw)N: )type __traceback__rrr)rformat_exceptionrIl errortextrrr geterrortexts   rRcs@eZdZdZdfdd Zddd Zdd d Zdd d ZZS)r:z=Exception containing a stringified error from the other side. formattedr<rrcst||_dSr)superrrS)rrS __class__rrrs  zRemoteError.__init__cC|jSr)rSr)rrr__str__szRemoteError.__str__cCs|jjd|jS)NrL)rVrrSr)rrrrCszRemoteError.__repr__cCs0|jtkrtjdtd|ddSdS)Nrz] Warning: unhandled r)rSINTERRUPT_TEXTrrrrpgetpidr)rrrwarns "zRemoteError.warn)rSr<rrrXr/) rrrr;rrXrCr[ __classcell__rrrUrr:s   r:c@rv) TimeoutErrorz0Exception indicating that a timeout was reached.NrHrrrrr]ryr]c@seZdZdZeZeZdZdZdDd d ZdEddZ e fdFddZ dGddZ dHddZ ddZdIddZedJdKd$d%Ze  dLdMd(d%Z ) dNdOd,d%ZdPdHd.d/ZdPdQd2d3ZdRd5d6ZdPdSd8d9ZdTd;d<ZdUd=d>ZeZ dVdWdBdCZd-S)XChannelzFCommunication channel between two Python Interpreter execution points.iFr r idr"rrcCsdt|tsJt|trJ||_t|dd|_||_|jjj |_ d|_ |jj |_ g|_dS)z :private:r"TFFN)rr"rMr rr"r_r(rEQueue_items_closedr1_receiveclosed _remoteerrors)rr r_rrrrs zChannel.__init__rrcGs|jj|jg|RdSr)r _tracer_rrrrrrfzChannel._tracecallbackCallable[[Any], Any] endmarkerc Cs|jjj}|jjb|jdurt|d|j}d|_ z|jdd}Wn|jjjj yC|j sA|j sA|||j f||j<Ynw|turV|||turU||n ||qWddSWddS1snwYdS)aSet a callback function for receiving items. All already-queued items will immediately trigger the callback. Afterwards the callback will execute in the receiver thread for each received data item and calls to ``receive()`` will raise an error. If an endmarker is specified the callback will eventually be called with the endmarker when the channel closes. Nz has callback already registeredrPF)block)r r _callbacks _receivelockrbrrr(rEEmptyrcrdr3r"r_ ENDMARKERputNO_ENDMARKER_WANTED)rrirkrmitemsolditemrrr setcallbacks2    "zChannel.setcallbackr<cCs|rdpd}d|j|fS)Nclosedopenz)isclosedr_)rflagrrrrCrzChannel.__repr__c Cs|jdurdS|d|jr|jD]}|qdS|jr"dStdurJ|jdur/tj }ntj }z |j ||j WdSt tfyIYdSwdS)Nzchannel.__del__)r rfrcrer[rdr3rrbrDrrr_rr)rrrrrr__del__s&      zChannel.__del__c CsDz|jdWSty!z|jjWYSty YYdSwwre)rer IndexErrorr _errorrr)rrr_getremoteerrors  zChannel._getremoteerrorr2cCrW)z^Return True if the channel is closed. A closed channel may still hold items. )rcr)rrrrx)szChannel.isclosed.rR Literal['r'] proxycloseChannelFileReadcCrrrrrRrrrrmakefile0szChannel.makefile Literal['w']ChannelFileWritecCrrrrrrrr4srLiteral['r', 'w']"ChannelFileWrite | ChannelFileReadcCs8|dkr t||dS|dkrt||dStd|d)zReturn a file-like object. mode can be 'w' or 'r' for writeable/readable files. If proxyclose is true, file.close() will also close the channel. r)rrrzmode z not available)rrrrrrrr<s   NcCs|jrtd|jr|j|d|jsa|js8|jj}|dur,|tj |j t |n|tj |j |dt |trC|j|d|_|j|j}|durW|t|jj|j dSdS)zClose down this channel with an optional error message. Note that closing of a channel tied to remote_exec happens automatically at the end of execution and cannot be done explicitly. z2cannot explicitly close channel within remote_execz"ignoring redundant call to close()Nzsent channel close messageT) _executingrrcr rfrdr3rrr?r_rrrr:rerr4rbrqrpr_no_longer_opened)rrrqrErrrrLs(      z Channel.closer6r7cCs:|jj|d|js|d||}|r|dS)a^Wait until this channel is closed (or the remote side otherwise signalled that no more data was being sent). The channel may still hold receiveable items, but not receive any more after waitclose() has returned. Exceptions from executing code on the other side are reraised as local channel.RemoteErrors. EOFError is raised if the reading-connection was prematurely closed, which often indicates a dying process. self.TimeoutError is raised after the specified number of seconds (default is None, i.e. wait indefinitely). rzTimeout after %r secondsN)rdr-r3r]r})rr6rrrr waitclosems zChannel.waitcloseitemcCs2|r td||jtj|jt|dS)a!Sends the given item to the other side of the channel, possibly blocking if the sender queue is full. The item must be a simple Python type and will be copied to the other side by value. OSError is raised if the write pipe was prematurely closed. zcannot send to N)rxrr rrrr_r)rrrrrsends z Channel.sendrcCsr|j}|dur tdz|j|d}Wn|jjjjy&|d|dw|tur7| || p6t |S)aReceive a data item that was sent from the other side. timeout: None [default] blocked waiting. A positive number indicates the number of seconds after which a channel.TimeoutError exception will be raised if no item was received. Note that exceptions from the remotely executing code will be reraised as channel.RemoteError exceptions containing a textual representation of the remote traceback. Nz/cannot receive(), channel has receiver callbackrzno item after %r seconds) rbrrr r(rEror]rprqr}r)rr6 itemqueuexrrrreceives  zChannel.receive Iterator[Any]cCs|Srrr)rrr__iter__zChannel.__iter__cCs z|WStytdwr)rr StopIterationr)rrrnexts   z Channel.nextTpy2str_as_py3strpy3str_as_py2strcCs.||f|_t|j}|jjtj|j|ddS)zSet the string coercion for this channel. The default is to try to convert py2 str as py3 str, but not to try and convert py3 str to py2 str )rN)r"rr rrr&r_)rrrrrrr reconfigures  zChannel.reconfigure)r r r_r"rrrrrr)rirjrkrrrrXr/r9).)rRr~rr2rr)..)rRrrr2rr)rF)rRrrr2rrrr)rrrr)r6r7rr)rr)rrr`)rr2rr2rr)rrrr;r:r]_INTERNALWAKEUPrrrfrrrurCrzr}rxr rrrrrrr__next__rrrrrr^s@   $     !   r^zkeyboard-interruptedzJconcurrent remote_exec would cause deadlock for main_thread_only execmodelc@sXeZdZdddd Zd d!ddZd"ddZd#ddZd$d%ddZd#ddZd&ddZ d S)'ChannelFactoryrPr r  startcountr"rrcCs8t|_i|_|j|_||_||_d|_ t |_ dSr) weakrefWeakValueDictionaryrrmr(rV _writelockr countfinishedlist_list)rr rrrrrs  zChannelFactory.__init__Nr_r,r^c Cs|j?|jrtd|j|dur|j}|jd7_z|j|}Wnty8t|j|}|j|<Ynw|WdS1sEwYdS)z:Create a new Channel with 'id' (or create new id if None).zconnection already closed: Nr*)rrrr rrKeyErrorr^)rr_rrrrr#s $zChannelFactory.new list[Channel]cCs||jSr)rrvaluesr)rrrchannelszChannelFactory.channelscCsdz|j|=Wn tyYnwz |j|\}}}Wn ty%YdSw|tur0||dSdSr)rrrmrrr)rr_rirkr$rrrrs    z ChannelFactory._no_longer_openedFrAr2cCsx|j|}|dur|r|||dS|r|j||j}|dur+|t|||s5d|_ |j dSr) rrr[rrerrbrqrprcrdr4)rr_ remoteerrorrArrErrrr6s    zChannelFactory._local_closec Cs|j|}z |j|\}}}Wn$ty4|dur|jnd}|dur'YdSt||}||YdSwz t|||}||WdStyt} z&|j d| |j | } |j t j |t| ||| WYd} ~ dSd} ~ ww)Nzexception during callback: %s)rrrmrrbr rqrr rf _geterrortextrrr?rr6) rr_rrrirkr$rErrrQrrrr1 s,      zChannelFactory._local_receivecCsl|j d|_Wdn1swY||jD] }|j|ddq||jD]}||q,dSr@)rrrrr6rmr)rr_rrr_finished_receiving$s z"ChannelFactory._finished_receiving)rP)r r rr"rrr)r_r,rr^)rr)r_r"rrr)r_r"rAr2rrr/) rrrrr#rrr6r1rrrrrrs     rc@s6eZdZdddd Zdd d Zdd d ZdddZdS) ChannelFileTrr^rr2rrcCs||_||_dSr)r _proxycloserrrrrrr.s zChannelFile.__init__cCsdSrrr)rrrisatty2rzChannelFile.isattycCs|jr |jdSdSr)rrrr)rrrr5szChannelFile.closer<cCs"|jrdpd}d|jj|fS)Nrvrwz)rrxr_)rstaterrrrC9szChannelFile.__repr__NTrr^rr2rrr9r/rX)rrrrrrrCrrrrr-s    rc@s eZdZd ddZd ddZd S) routrrrcCs|j|dSr)rr)rrrrrr?rzChannelFileWrite.writecCrrrr)rrrrBrzChannelFileWrite.flushN)rrrrr/)rrrrrrrrrr>s rcs4eZdZddfdd Zdd dZdddZZS)rTrr^rr2rrcst||d|_dSr)rTr_bufferrrUrrrGs zChannelFileRead.__init__nr"r<cCsz+|jdurtt|j|_t|j|kr*|jtt|j7_t|j|ksWn ty8|Ynw|jdurBd}|S|jd|}|j|d|_|S)NrK)rr r<rrrrr)rrretrrrr$Ks     zChannelFileRead.readcCs|jdur!|jd}|dkr||dS|t|jd}n|d}|rD|ddkrD|d}|s8 |S||7}|rD|ddks.|S)NrrP)rfindr$r)rircrrrreadlineZs    zChannelFileRead.readlinerr)rr"rr<rX)rrrrr$rr\rrrUrrFs rc@steZdZeZdZd)d*d d Zd+d dZd,ddZd,ddZ d,ddZ d-d.ddZ d/d d!Z d0d"d#Z d1d2d'd(Zd$S)3r zr*rr& _startcountr"rrcCsV|j|_||_||_tjtjf|_t|||_|j |_ t |_ t |_t|j|_dSr)r(_ior_ Unserializerrrr"rrrWrnr_BaseGateway__tracerRrr _receivepool)rrr_rrrrrns  zBaseGateway.__init__rrcGs|j|jg|RdSr)rr_rgrrrrfzszBaseGateway._tracecCs|j|jdSr)rr_thread_receiverr)rrr _initreceive}r8zBaseGateway._initreceivec s:dfdd }|dj}z% t|}|d |j|~Wdn1s.wYqttfy>Yn1tyV}z |d |_WYd}~nd}~wt yn}z | |WYd}~nd}~ww|d j |d  |d j|dj|djdS)Nrrrrcsjdg|RdS)Nz[receiver-thread]rfrr)rrlogr3z)BaseGateway._thread_receiver..logzRECEIVERTHREAD: starting to runrPrz-EOF without prior gateway termination messagezfinishing receiving threadzterminating executionz closing readz closing writez#terminating our receive pseudo poolr)rrr rnrKeyboardInterruptr'rr|rrrr_terminate_executionr*r+rr)rrrrrrr)rrs@      zBaseGateway._thread_receivercCrrrr)rrrrrz BaseGateway._terminate_executionrrrrrrc Cs`t|||}z||j|d|WdSttfy/}z |d||td|d}~ww)Nsentzfailed to sendzcannot send (already closed?))rr rrfrr)rrrrrrrrrrs   zBaseGateway._sendrr^r,cCs|ddS)Nzexecution disallowed)r)rrr,rrrr-rzBaseGateway._local_schedulexeccCs |jS)z!Return a new independent channel.)rr#r)rrr newchannels zBaseGateway.newchannelNr6r7cCs|d|j|dS)z%Wait for receiverthread to terminate.z%waiting for receiver thread to finishN)rfrrr8rrrrs zBaseGateway.join)r*)rr&rr"rrrr/rErFrr^r,rrr)rr^rr)rrrrI_sysexr_rrfrrrrr-rrrrrrr js     r c@s4eZdZdddZdd d Zdd d ZdddZdS) WorkerGatewayrr^r,rrrcCsb|jjjdkr!|jdusJ|jjdds|tdS|jt|}|j |j ||fdS)NrxrPr) rr(r@_executetask_completer-rMAIN_THREAD_ONLY_DEADLOCK_TEXTr5r r executetask)rrr, sourcetask_rrrr-s  z WorkerGateway._local_schedulexeccCs|d|j|jdsF|dtjdkr(|dttdn t dur4|dt |jdsH|d t d dSdSdS) Nzshutting down execution poolg@z5execution ongoing after 5 secs, trying interrupt_mainrzsending ourselves a SIGINTr*zcalling interrupt_main()g$@z?execution did not finish in another 10 secs, calling os._exit()rP) rfrrrrrrpr.rZr_exitr)rrrrs"         z"WorkerGateway._terminate_executioncsdfdd }jjdv}tj|d_d_jjd kr)j_j|d z|r=|d j|d  WdSt yU|d YdSw)Nrr<rrcsd|dS)Nz[serve] rrr)rrrr8z"WorkerGateway.serve..tracer)rrxzspawning receiver threadzintegrating as primary threadzjoining receiver threadz,swallowing keyboardinterrupt, serve finished)rr<rr) r(r@rrrr1r4rrrr)rrrrr)rserves$      zWorkerGateway.serverEtuple[Channel, tuple[str, str | None, str | None, dict[str, object]]]c Csnz^|\}\}}}}|dd}|d|jdt|ddd|_z0t|d|p+dd }t|||rJ|d ||f||} | |fi|Wd |_|d n d |_|d wWnFtyk|tt y} z.t | t s|j j js|d | || } || WYd} ~ dS|dWYd} ~ nd} ~ ww||jdur|jdSdS)N__channelexec__)rrzexecution starts[z]: 2Trz execzcalling %s(**%60r)Fzexecution finishedzgot exception: z,ignoring EOFError because receiving finished)rfr_reprrcompilerrrrYrrrr rrrrr4) rrrsource file_name call_namerloccofunctionrrQrrrrsD $         zWorkerGateway.executetaskNrr/)rrrr)rrrr-rrrrrrrrs    rc@ eZdZdS)DataFormatErrorNrrrrrrrr+rc@rv) DumpErrorz"Error while serializing an object.NrHrrrrr/ryrc@rv) LoadErrorz$Error while unserializing an object.NrHrrrrr3ryrrr"rcCs t|gSr)r)rrrrbchr7rDrr*iz!dz!ddc@r)_StopNrrrrrrErrc@sdeZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d Zd ZdZdZdZdZdZdZdZdZdZdS)opcodez#Container for name -> num mappings.@ABCDEFGHIJKLMNOPQRSTN)rrrr; BUILDTUPLEBYTESCHANNELFALSEFLOAT FROZENSETINTLONGLONGINTLONGLONGNEWDICTNEWLISTNONE PY2STRING PY3STRINGSETSETITEMSTOPTRUEUNICODECOMPLEXrrrrrIs.rc@seZdZUiZded<dZdZ  dEdFddZdGdHddZdIddZ e ee j <dIddZ e ee j <dIddZeee j<dIddZeee j<dIddZeee j<eZeee j<eZeee j<dIdd Zeee j<dId!d"Zeee j<dJd$d%ZdKd'd(ZdId)d*Zeee j<dId+d,Z e ee j!<dId-d.Z"e"ee j#<dId/d0Z$e$ee j%<dId1d2Z&e&ee j'<dId3d4Z(e(ee j)<dId5d6Z*e*ee j+<dLd9d:Z,dId;d<Z-e-ee j.<dId=d>Z/e/ee j0<dId?d@Z1e1ee j2<dIdAdBZ3e3ee j4<dIdCdDZ5e5ee j6<dS)Mrz+dict[bytes, Callable[[Unserializer], None]]num2funcTFNstreamr channel_or_gatewayChannel | BaseGateway | Noner$tuple[bool, bool] | NonerrcCsXt|tr |j}n|}|dur|j}|r|\|_|_||_|dur&d|_dS|j|_dSr) rr^r r"rrrchannelfactoryr)rrrr$gwrrrrhs    zUnserializer.__init__ versionedr2rcCs|r|jd}|tkrtd|g|_z( |jd}|s!tz|j|}Wnty8td|ddw||qtyXt |jdkrPtdd|j dYSw)NrPzwrong dumpformat version %rTzunknown opcode z - wire protocol corruption?zinternal unserialization errorr) rr$DUMPFORMAT_VERSIONrstackrrrrrr)rrverrloaderrrrload|s4       zUnserializer.loadcCs|jddSrrrr)rrr load_nonerzUnserializer.load_nonecC|jddSrrr)rrr load_truerzUnserializer.load_truecCr rrr)rrr load_falserzUnserializer.load_falsecC|}|j|dSr _read_int4rrrrrrrload_intzUnserializer.load_intcCs|}|jt|dSr)_read_byte_stringrrr"rsrrr load_longintszUnserializer.load_longintcCs(|jt}|jtt|ddSre)rr$FLOAT_FORMAT_SIZErrrr FLOAT_FORMATrbinaryrrr load_float zUnserializer.load_floatcCs(|jt}|jttt|dSr) rr$COMPLEX_FORMAT_SIZErrcomplexrrCOMPLEX_FORMATr/rrr load_complexr2zUnserializer.load_complexr"cCstd|jdd}|S)N!ir4r)rrrr$)rvaluerrrr%szUnserializer._read_int4rcCs|}|j|}|Sr)r%rr$)rlengthas_bytesrrrr)s zUnserializer._read_byte_stringcCs4|}|jr|j|dS|j|ddSNrn)r)rrrdecode)rr:rrrload_py3stringszUnserializer.load_py3stringcCs.|}|jr |d}n|}|j|dS)Nzlatin-1)r)rr<rr)rr:r+rrrload_py2strings  zUnserializer.load_py2stringcCr#r)r)rrr*rrr load_bytesr(zUnserializer.load_bytescCs|j|ddSr;)rrr)r<r)rrr load_unicoderhzUnserializer.load_unicodecCs|}|jdg|dSrr$)rr9rrr load_newlistszUnserializer.load_newlistcCs<t|jdkr td|j}|j}||jd|<dS)Nr/znot enough items for setitemr)rrrr)rr8keyrrr load_setitems   zUnserializer.load_setitemcCs|jidSrrr)rrr load_newdictrzUnserializer.load_newdicttype_rMcCsP|}|r||j| d}|j| d=|j|dS|j|dSrr$)rrEr9resrrr_load_collections zUnserializer._load_collectioncC|tdSr)rGr!r)rrrload_buildtuplerzUnserializer.load_buildtuplecCrHr)rGr4r)rrrload_set rzUnserializer.load_setcCrHr)rG frozensetr)rrrload_frozensetrzUnserializer.load_frozensetcCstr)rr)rrr load_stoprzUnserializer.load_stopcCs2|}|jdus J|j|}|j|dSr)r%rr#rr)rr_rrrr load_channels zUnserializer.load_channelNN)rr rrr$rrrr)rr2rrr/rZ)rr)rErMrr)7rrrrr0rrrrrrrr!rr"rr'rr,r load_longr load_longlongrr1rr6rr%r)r=r r>r r?rr@rrArrCr rDrrGrIrrJr rLrrMr rNrrrrrrcsj                                           robjcCstj|ddS)zSerialize the given obj to a bytestring. The obj and all contained objects must be of a builtin Python type (so nested dicts, sets, etc. are all OK but not user-level instances). Tr _SerializersaverRrrrdumps#srXcCst|jdj|dddS)zCwrite a serialized bytestring of the given obj to the given stream.)rTrSN)rUrrV)byteiorRrrrdump-srZF bytestringrr2rrcCst|}t|||dS)aXDeserialize the given bytestring to an object. py2str_as_py3str: If true then string (str) objects previously dumped on Python2 will be loaded as Python3 strings which really are text objects. py3str_as_py2str: If true then string (str) objects previously dumped on Python3 will be loaded as Python2 strings instead of unicode objects. If the bytestring was dumped with an incompatible protocol version or if the bytestring is corrupted, the ``execnet.DataFormatError`` will be raised. )rr)rr)r[rrrrrrloads2sr\rcCs||f}t||djddS)z}Derserialize an object form the specified stream. Behaviour and parameters are otherwise the same as with ``loads`` )r$TrS)rr)rrrr$rrrrHsrr$rcCst|}t|||Sr)rrr)r[rr$rrrrr Ssr cCs t|SrrTrWrrrr\s rc@seZdZUiZded<d[d\dd Zd]d^ddZd_ddZd`ddZdaddZ dbddZ dcd d!Z dcd"d#Z dbd$d%Z ddd*d+Zded,d-Zdfd/d0Zdgd3d4Zdhd7d8Zd9effdid;d<Zdjd?d@ZdkdCdDZdldGdHZdmdKdLZdndOdPZdodRdSZdpdUdVZdqdYdZZdS)rrUz1dict[type, Callable[[_Serializer, object], None]] _dispatchNrCallable[[bytes], None] | NonerrcCs |dur g|_|jj}||_dSr) _streamlistrr)rrrrrrcs z_Serializer.__init__FrRrrr2 bytes | NonecCsN|r|t|||tjz|j}Wn ty!YdSwd|S)Nr)rr_saverr r_rr)rrRr streamlistrrrrVis      z_Serializer.savecCsvt|}z|j|}Wn(ty3d|j}t|j|d}|dur*td|d|}|j|<Ynw|||dS)Nsave_zcan't serialize )rMr]rrrrVr)rrRtpdispatch methodnamemethrrrraws  z_Serializer._savenoncCs|tjdSr)rrr)rrhrrr save_NoneTyperz_Serializer.save_NoneTypebooleancCs$|r |tjdS|tjdSr)rrrr)rrjrrr save_boolsz_Serializer.save_boolbytes_rcC|tj||dSr)rrr_write_byte_sequencerrlrrr save_bytes z_Serializer.save_bytesr+r<cCrmr)rrr _write_unicode_stringr*rrrsave_strrqz_Serializer.save_strc Cs@z|d}Wnty}ztd|d}~ww||dS)Nrnzstrings must be utf-8 encodable)encodeUnicodeEncodeErrorrrn)rr+r:rrrrrrs z!_Serializer._write_unicode_stringcCs|t|d||dS)Nzstring is too long) _write_int4rrrorrrrnrz _Serializer._write_byte_sequencerr"short_oplong_opcCsH|tkr||||dS|||t|dddS)NLascii)FOUR_BYTE_INT_MAXrrvrnr<rstriprt)rrrwrxrrr_save_integrals   z_Serializer._save_integralcC||tjtjdSr)r}rrrr&rrrsave_intr3z_Serializer.save_intrPcCr~r)r}rrr)rrPrrr save_longr3z_Serializer.save_longfltrNcCs"|tj|tt|dSr)rrrrr r.)rrrrr save_floats z_Serializer.save_floatcpxr4cCs(|tj|tt|j|jdSr)rrrrr r5realimag)rrrrr save_complexr2z_Serializer.save_complexzint must be less than %ircCs&|tkrt||td|dS)Nr7)r{rrrr )rrrrrrrvsz_Serializer._write_int4ry list[object]cCs>|tj|t|dt|D] \}}|||qdS)Nzlist is too long)rrrrvr enumerate_write_setitem)rryrrrrr save_lists z_Serializer.save_listrBr8cCs$|||||tjdSr)rarrr )rrBr8rrrrs  z_Serializer._write_setitemrdict[object, object]cCs.|tj|D] \}}|||q dSr)rrrrsr)rrrBr8rrr save_dicts z_Serializer.save_dicttuptuple[object, ...]cCs4|D]}||q|tj|t|ddS)Nztuple is too long)rarrrrvr)rrrrrr save_tuples  z_Serializer.save_tupleset[object] | frozenset[object]opcCs2|D]}||q|||t|ddS)Nzset is too long)rarrvr)rr+rrrrr _write_sets  z_Serializer._write_set set[object]cC||tjdSr)rrr r*rrrsave_setr8z_Serializer.save_setfrozenset[object]cCrr)rrrr*rrrsave_frozensetr8z_Serializer.save_frozensetrr^cCs|tj||jdSr)rrrrvr_)rrrrr save_Channels z_Serializer.save_Channelr)rr^rrr)rRrrr2rr`rRrrr)rhrrr)rjr2rr)rlrrr)r+r<rr)rr"rwrrxrrr)rr"rr)rPr"rr)rrNrr)rr4rr)rr"rr<rr)ryrrr)rBrr8rrr)rrrr)rrrr)r+rrrrr)r+rrr)r+rrr)rr^rr)rrrr]r0rrVrarirkrprsrrrnr}rrrrr{rvrrrrrrrrrrrrrU`s4                      rUr(cCsDttdsttjtj|}ddl}|dt_|dt_|Sztj}Wnt y7tj dkr3d}nd}Ynw| t ddd}t |tj}t|dt|| t ddd}t |tj}t|dtj dkr| t d ddt_t|d t|t|||}|j dddd d t_|j dddd d t_|S) NduprrrntNULz /dev/nullrPr*Fr)hasattrrprrstdoutstdintempfile TemporaryFiledevnullrrrUrrwO_RDONLYdup2rO_WRONLYr)r(rrrrrQrrrr init_popen_ios:             rcCs$td|t||dddS)Nzcreating workergateway on r*)rr_r)rrr)rr_rrrr sr)r@rrr'r)rrrIrJrr<)rr"rr)rRrrrr)FF)r[rrr2rr2rr)rr rr2rr2rrrO)r[rr$rrr)r(r'rr)rr&rr)`r; __future__rr^rprr tracebackrrhrrrtypingrrrrr r r r rr r&r1ABCMetar'rbrwrzrrrrr SystemExitrIenvironrDEBUGrZrrrpathr gettempdirfnrwrnotracerrrr'rOrRr:rr]rrrr^rprYrrrrrr rrrrrrr{r.calcsizer-r5r3rrrrXrZr\rr rrUrrrrrrs            599 :%|     *f d$Ul    A      '