h*SrSSKJr SSKJrJr SSKJrJrJ r J r J r SSK J r JrJr SSKJr SSKJrJr SSKJr SS KJr SS KJr \ "S 5r\ "S 5r"S S\5r"SS\5r\ "5r!"SS5r"g)z twisted.python.threadpool: a pool of threads to which we dispatch tasks. In most cases you can just use C{reactor.callInThread} and friends instead of creating a thread pool directly. ) annotations)Threadcurrent_thread)AnyCallableListOptionalTypeVar) ParamSpecProtocol TypedDict)pool)contextlog) deprecated)Failure)Version_P_Rc\rSrSrSSjrSrg)_SupportsQsizecgNselfs `/root/1688_scrapy/alibaba-scraper/venv/lib/python3.13/site-packages/twisted/python/threadpool.pyqsize_SupportsQsize.qsizes rNreturnint__name__ __module__ __qualname____firstlineno__r__static_attributes__rr!rrrs r!rc*\rSrSr%S\S'S\S'Srg)_State"r$minmaxrN)r&r'r(r)__annotations__r*rr!rr,r,"s H Hr!r,c \rSrSrSrSrSrSrSrSr \ r \ "\ "\"SSS S 5S S 9"\55r\ "\5rSSS jjr\S Sj5r\S!Sj5r\S!Sj5r\S"Sj5r\rS#SjrS#SjrS$SjrS#SjrS%SjrS&SjrS'SjrS(Sjr S#Sjr!S)S*Sjjr"S#Sjr#Sr$g)+ ThreadPool*a This class (hopefully) generalizes the functionality of a pool of threads to which work can be dispatched. L{callInThread} and L{stop} should only be called from a single thread. @ivar started: Whether or not the thread pool is currently running. @type started: L{bool} @ivar threads: List of workers currently running in this thread pool. @type threads: L{list} @ivar _pool: A hook for testing. @type _pool: callable compatible with L{_pool} FNTwistedrzthreading.current_thread)version replacementc^US:dS5eX::dS5eUTlUTlUTl/TlSU4SjjnSU4SjjnTR XT5Tlg) a# Create a new threadpool. @param minthreads: minimum number of threads in the pool @type minthreads: L{int} @param maxthreads: maximum number of threads in the pool @type maxthreads: L{int} @param name: The name to give this threadpool; visible in log messages. @type name: native L{str} rminimum is negativeminimum is greater than maximumc>TR"USTR50UD6nTRRU5 U$)Nname) threadFactory _generateNamethreadsappend)akwthreadrs rtrackingThreadFactory2ThreadPool.__init__..trackingThreadFactory`sH''++-13F LL   'Mr!c@>TR(dgTR$)Nr)startedr/rsr currentLimit)ThreadPool.__init__..currentLimitgs<<88Or!N)rDrrErr#rr")r.r/r?rB_pool_team)r minthreads maxthreadsr?rGrKs` r__init__ThreadPool.__init__JsaQ5 55'J)JJ' %'    ZZ D r!chURR5nURUR-$)z For legacy compatibility purposes, return a total number of workers. @return: the current number of workers, both idle and busy (but not those that have been quit by L{ThreadPool.adjustPoolsize}) @rtype: L{int} )rN statisticsidleWorkerCountbusyWorkerCount)rstatss rworkersThreadPool.workersns- %%'$$u'<'<<\rSrSrSU4SjjrSrg)$ThreadPool._queue..NotAQueuecL>TRR5R$)z Pretend to be a Python threading Queue and return the number of as-yet-unconsumed tasks. @return: the amount of backlogged work not yet dispatched to a worker. @rtype: L{int} )rNrTbackloggedWorkCount)qrs rr*ThreadPool._queue..NotAQueue.qsizeszz,,.BBBr!rNr"r%rsr NotAQueuerbs C Cr!rhr)rrhs` r_queueThreadPool._queues C C{r!cSUlSUlUR5 URR 5R nU(aURR U5 gg)z Start the threadpool. FTN)joinedrJadjustPoolsizerNrTregrow)rbacklogs rstartThreadPool.startsN   **'')==  JJOOG $ r!c:URRS5 g)zt Increase the number of available workers for the thread pool by 1, up to the maximum allowed by L{ThreadPool.max}. r8N)rNrnrs r startAWorkerThreadPool.startAWorkers r!c^SUR=(d [U5SUR3$)zk Generate a name for a new pool thread. @return: A distinctive name for the thread. @rtype: native L{str} z PoolThread--)r?idrXrs rrAThreadPool._generateNames)TYY2"T(31T\\NCCr!c:URRS5 g)zV Decrease the number of available workers by 1, by quitting one as soon as it's idle. r8N)rNshrinkrs r stopAWorkerThreadPool.stopAWorkers !r!cr[USU5 [RXRUR5 g)N__dict__)setattrr2rQr.r/)rstates r __setstate__ThreadPool.__setstate__s&j%(D((DHH5r!c>[URURS9$)N)r.r/)r,r.r/rs r __getstate__ThreadPool.__getstate__s$((11r!c2UR"SU/UQ70UD6 g)z Call a callable object in a separate thread. @param func: callable object to be called in separate thread @param args: positional arguments to be passed to C{func} @param kw: keyword args to be passed to C{func} N)callInThreadWithCallback)rfuncargsrEs r callInThreadThreadPool.callInThreads %%dD>4>2>r!c^^^^^UR(ag[RR5RSmSU4SjjmUUUU4SjTlUTlURRT5 g)a| Call a callable object in a separate thread and call C{onResult} with the return value, or a L{twisted.python.failure.Failure} if the callable raises an exception. The callable is allowed to block, but the C{onResult} function must not block and should perform as little work as possible. A typical action for C{onResult} for a threadpool used with a Twisted reactor would be to schedule a L{twisted.internet.defer.Deferred} to fire in the main reactor thread using C{.callFromThread}. Note that C{onResult} is called inside the separate thread, not inside the reactor thread. @param onResult: a callable with the signature C{(success, result)}. If the callable returns normally, C{onResult} is called with C{(True, result)} where C{result} is the return value of the callable. If the callable throws an exception, C{onResult} is called with C{(False, failure)}. Optionally, C{onResult} may be L{None}, in which case it is not called at all. @param func: callable object to be called in separate thread @param args: positional arguments to be passed to C{func} @param kw: keyword arguments to be passed to C{func} Nc>TR5nSnSTlTRbTRX5 STlgU(d[R "U5 gg![a [5nSnNdf=f)NTF)theWork BaseExceptionronResultrerr)resultok inContexts rr6ThreadPool.callInThreadWithCallback..inContext sw "**, !%I !!-""2.%) "!   sA!!A:9A:c:>[R"TT/TQ70TD6$r)rcall)rctxrrEsr5ThreadPool.callInThreadWithCallback..s#GLL % % "% r!r#None) rlrtheContextTrackercurrentContextcontextsrrrNdo)rrrrrErrs ```@@rr#ThreadPool.callInThreadWithCallbacksXH ;; ''668AA"E $ &  i r!cSUlSUlURR5 URHnUR 5 M g)z) Shutdown the threads in the threadpool. TFN)rlrJrNquitrBjoin)rrFs rstopThreadPool.stop$s7   llF KKM#r!cUc URnUc URnUS:dS5eX::dS5eXlX lUR(dgURUR:a2URR URUR- 5 URUR:a3URR URUR- 5 gg)z Adjust the number of available threads by setting C{min} and C{max} to new values. @param minthreads: The new value for L{ThreadPool.min}. @param maxthreads: The new value for L{ThreadPool.max}. Nrr<r=)r.r/rJrXrNrzrn)rrOrPs rrmThreadPool.adjustPoolsize.s  J  JQ5 55'J)JJ'||  <<$(( " JJ  dllTXX5 6 <<$(( " JJOODHHt||3 4 #r!c[R"SUR35 [R"SUR35 [R"SUR35 g)z_ Dump some plain-text informational messages to the log about the state of this L{ThreadPool}. z waiters: z workers: ztotal: N)rmsgr^r[rBrs r dumpStatsThreadPool.dumpStatsMsI )DLL>*+ )DLL>*+ '$,,()r!)rNrlr/r.r?rJrB)r4r5N)rOr$rPr$r?z Optional[str]r")r#z list[None])r#rr)r#str)rr,r#r)r#r,)rzCallable[_P, object]r_P.argsrE _P.kwargsr#r) rz&Optional[Callable[[bool, _R], object]]rzCallable[_P, _R]rrrErr#r)NN)rO Optional[int]rPrr#r)%r&r'r(r)__doc__r.r/rlrJr?rr@ staticmethodrrr currentThreadrMrQpropertyrXr[r^rirfrprsrAr{rrrrrrmrr*rr!rr2r2*s C C FG DM Ir1a02   M  EPT"E"E/2"E?L"EH = =@@ @ @, A %D62 ?( ?18 ?@I ?  ??!8?!?! ?!  ?!  ?!BMQ5'5*r!r2N)#r __future__r threadingrrtypingrrrr r typing_extensionsr r r twisted._threadsrrMtwisted.pythonrrtwisted.python.deprecatertwisted.python.failurertwisted.python.versionsrrrrr,object WorkerStopr2rr!rrsl #,99<<*'/*+t_ T] X  Y X j*j*r!