hpZSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKJr SSK J r J r J r SSK JrJr SSKJrJr SSKJr SSKJr SSKJr SS KJrJrJrJrJrJr SS K J!r!J"r"J#r# "S S 5r$"S S\$5r%"SS\$5r&"SS5r'"SS5r(Sr)S%Sjr*Sr+Sr,"SS5r-Sr.Sr/"SS5r0"SS \Rb\05r2S!r3S"r4S#r5S$r6g)&N) attrgetter) copyrightloggerplugin)reactorsservice) NoSuchReactorinstallReactor)defer)_ISupportsExitSignalCapturing)sob)failureloglogfileruntimeusageutil)namedAny namedModulequalc$\rSrSrSrSrSrSrg)_BasicProfilerz @ivar saveStats: if C{True}, save the stats information instead of the human readable format @type saveStats: C{bool} @ivar profileOutput: the name of the file use to print profile data. @type profileOutput: C{str} cXlX lgN profileOutput saveStats)selfrrs ^/root/1688_scrapy/alibaba-scraper/venv/lib/python3.13/site-packages/twisted/application/app.py__init___BasicProfiler.__init__%s *"c2SUSU3nUS- n[U5e)z Helper method to report an import error with a profile module. This has to be explicit because some of these modules are removed by distributions due to them being non-free. zFailed to import module : z This is most likely caused by your operating system not including the module due to it being non-free. Either do not use the option --profile, or install the module; your operating system vendor may provide it in a separate package. ) SystemExit)rmoduleess r _reportImportError!_BasicProfiler._reportImportError)s1 'vhb 4   mr#rN)__name__ __module__ __qualname____firstlineno____doc__r!r*__static_attributes__r#r rrs# r#rc\rSrSrSrSrSrg) ProfileRunner9z) Runner for the standard profile module. cLSSKnWR5nUR UR 5 UR (aURUR5 g[R[URS5sn[l UR5 U[Rs[l nUR5 g![anURSU5 SnANSnAff=f!U[Rs[l nUR5 f=f)z* Run reactor under the standard profiler. rNprofilea)r7 ImportErrorr*Profileruncallrunr dump_statsrsysstdoutopen print_statsclose)rreactorr7r(ptmps r r<ProfileRunner.run>s 2  OO  '++ >> LL++ ,!jj$t/A/A3*GOC  "%szz C  2  # #Iq 1 1 2#&szz C s#C C5 C2C--C25.D#r2Nr,r-r.r/r0r<r1r2r#r r4r49s r#r4c\rSrSrSrSrSrg)CProfileRunnerTz! Runner for the cProfile module. cSSKnSSKnWR 5nUR UR 5 UR(aURUR5 g[URS5nWRXVS9nUR5 URS5 UR5 SSS5 g![anURSU5 SnANSnAff=f!,(df  g=f)z* Run reactor under the cProfile profiler. rNcProfilew)stream)rLpstatsr9r*r:r;r<rr=rr@Stats strip_dirs sort_statsrA)rrCrLrPr(rDrNr)s r r<CProfileRunner.runYs 3       '++ >> LL++ ,d((#.&LLL2  R   /. 3  # #J 2 2 3/.s$C8AC+ C( C##C(+ C9r2NrGr2r#r rIrITs  r#rIc(\rSrSrSr\\S.rSrSr g) AppProfileroz Class which selects a specific profile runner based on configuration options. @ivar profiler: the name of the selected profiler. @type profiler: C{str} )r7cprofilecZURSS5nURSS5nURSS5R5UlURUR;a1URUR"X25nURUlg[ SUR35e)N savestatsFr7profilerrXzUnsupported profiler name: )getlowerr[ profilersr<r&)roptionsrrr[s r r!AppProfiler.__init__zsKK U3  It4  J ;AAC ==DNN *~~dmm4]NH||DH:4==/JK Kr#)r[r<N) r,r-r.r/r0r4rIr^r!r1r2r#r rVrVos*~FILr#rVc:\rSrSrSrSrSrSrSrSr Sr S r g) AppLoggera- An L{AppLogger} attaches the configured log observer specified on the commandline to a L{ServerOptions} object, a custom L{logger.ILogObserver}, or a legacy custom {log.ILogObserver}. @ivar _logfilename: The name of the file to which to log, if other than the default. @type _logfilename: C{str} @ivar _observerFactory: Callable object that will create a log observer, or None. @ivar _observer: log observer added at C{start} and removed at C{stop}. @type _observer: a callable that implements L{logger.ILogObserver} or L{log.ILogObserver}. NcpURSS5UlURS5=(d SUlg)z5 Initialize an L{AppLogger} with a L{ServerOptions}. rrN)r\ _logfilename_observerFactoryrr_s r r!AppLogger.__init__s-$KK 26 ' H 5 =r#cURbUR5nOCUR[RS5nUc UR[RS5nUcUR 5nX l[RRUR 5(aUR /nO[RRUR 5(a"[R"UR 5/nO;[R"S[SS9 [R"UR 5/n[RRU5 UR5 g)aK Initialize the global logging system for the given application. If a custom logger was specified on the command line it will be used. If not, and an L{logger.ILogObserver} or legacy L{log.ILogObserver} component has been set on C{application}, then it will be used as the log observer. Otherwise a log observer will be created based on the command line options for built-in loggers (e.g. C{--logfile}). @param application: The application on which to check for an L{logger.ILogObserver} or legacy L{log.ILogObserver}. @type application: L{twisted.python.components.Componentized} NaZPassing a logger factory which makes log observers which do not implement twisted.logger.ILogObserver or twisted.python.log.ILogObserver to twisted.application.app.AppLogger was deprecated in Twisted 16.2. Please use a factory that produces twisted.logger.ILogObserver (or the legacy twisted.python.log.ILogObserver) implementing objects instead.) stacklevel)rg getComponentr ILogObserverr_getLogObserver _observer providedByLegacyLogObserverWrapperwarningswarnDeprecationWarningglobalLogBeginnerbeginLoggingTo _initialLog)r applicationobserver observerss r startAppLogger.starts  ,,,.H"//0C0CTJH&33C4D4DdK  ++-H!    ) )$.. 9 9(I    ( ( 8 888HII MM#  88HII  // : r#c(SSKJn [R"U5R S[ R [R[R"5S9 [R"U5R S[UR5S9 g)z! Print twistd start log message. rrCz1twistd {version} ({exe} {pyVersion}) starting up.)versionexe pyVersionzreactor class: {reactor}.N) twisted.internetrCr _loggerForinforrr> executablershortPythonVersionr __class__)rrCs r rxAppLogger._initialLogst -$$$ ?%%002 % $$$ 'g6G6G1H % r#cURS:XdUR(d[RnO)[RR UR5n[ R"U5$)zZ Create a log observer to be added to the logging system before running this application. -)rfr>r?rLogFile fromFullPathrtextFileLogObserver)rlogFiles r roAppLogger._getLogObserversN    #4+<+<jjGoo2243D3DEG))'22r#c[R"U5RS5 URb1[RR UR5 SUlgg)zC Remove all log observers previously set up by L{AppLogger.start}. zServer Shut Down.N)rrrrpglobalLogPublisherremoveObserverrs r stopAppLogger.stopsL $$$%89 >> %  % % 4 4T^^ D!DN &r#)rfrprg) r,r-r.r/r0rpr!r|rxrorr1r2r#r rbrbs("I>0d 3"r#rbcSnSnSnU[RlU[RlU[Rlg)NcUR5 UR5 SSKJn UR SUR 5 g)Nrr)clear_all_breaks set_continuerrC callLaterr)rargrCs r do_stopfixPdb..do_stops4  ,!W\\*r#c[S5 g)NzEstop - Continue execution, then cleanly shutdown the twisted reactor.)printrs r help_stopfixPdb..help_stops  V r#c0[R"S5 g)Nr)os_exitrs r set_quitfixPdb..set_quits   r#)pdbPdbrrr)rrrs r fixPdbrs6  CGGCGGO!CGGr#cUcSSKJn US(aUbURU5 ggUS(aU[lU[l[ RS:XaL[R"[RS5 [R"[RS5 [5 [R"UR5 gUR5 g![a{ S nUS (aUnO[S S 5nS n[ R""US9 UR%5 U(aUR'5 gg!U(aUR'5 ff=ff=f)a Start the reactor, using profiling if specified by the configuration, and log any error happening in the process. @param config: configuration of the twistd application. @type config: L{ServerOptions} @param oldstdout: initial value of C{sys.stdout}. @type oldstdout: C{file} @param oldstderr: initial value of C{sys.stderr}. @type oldstderr: C{file} @param profiler: object used to run the reactor with profiling. @type profiler: L{AppProfiler} @param reactor: The reactor to use. If L{None}, the global reactor will be used. Nrrr7debugposixc,[R"5$rr set_traceargss r 'runReactorWithLogging..+s CMMOr#c,[R"5$rrrs r rr,s 3==?r#FnodaemonzTWISTD-CRASH.logr8Tfile)rrCr<r>r?stderrr platformTypesignalSIGUSR2SIGINTrrr; BaseExceptionr@ traceback print_excflushrB)config oldstdout oldstderrr[rCrBrs r runReactorWithLoggingr s (, ) # W%$ G_"CJ"CJ##w. fnn.KL fmm-JK H KK $ KKM   * D*C0DE    T * JJL u  s/C'B*C'C'''E,$E3E,E((E,c>U(a[R"S5$g)Nz Passphrase: )getpassneededs r getPassphraser@s ~..r#c>U(a[R"S5$g)NzEncryption passphrase: )r getPasswordrs r getSavePassphraserGs  9::r#cD\rSrSrSr\r\rSr Sr Sr Sr Sr SrS rg ) ApplicationRunneriNa An object which helps running an application based on a config object. Subclass me and implement preApplication and postApplication methods. postApplication generally will want to run the reactor after starting the application. @ivar config: The config object, which provides a dict-like interface. @ivar application: Available in postApplication, but not preApplication. This is the application object. @ivar profilerFactory: Factory for creating a profiler object, able to profile the application if options are set accordingly. @ivar profiler: Instance provided by C{profilerFactory}. @ivar loggerFactory: Factory for creating object responsible for logging. @ivar logger: Instance provided by C{loggerFactory}. chXlURU5UlURU5Ulgr)rprofilerFactoryr[ loggerFactoryr)rrs r r!ApplicationRunner.__init__hs+ ,,V4 ((0 r#cUR5 UR5UlURR UR5 UR 5 URR 5 g)z Run the application. N)preApplicationcreateOrGetApplicationryrr|postApplicationrrs r r<ApplicationRunner.runmsU 668 $**+  r#cUcSSKJn [URX#URU5 [ R "U5(aURUlgSUlg)z Run the reactor with the given configuration. Subclasses should probably call this from C{postApplication}. @see: L{runReactorWithLogging} Nrr)rrCrrr[r rq _exitSignal)rrCrrs r startReactorApplicationRunner.startReactorysJ ? 0dkk9PWX ( 3 3G < <&22D #D r#c[5e)zk Override in subclass. This should set up any state necessary before loading and running the Application. NotImplementedErrorrs r r ApplicationRunner.preApplications "##r#c[5e)z Override in subclass. This will be called after the application has been loaded (so the C{application} attribute will be set). Generally this should start the application and run the reactor. rrs r r!ApplicationRunner.postApplications "##r#cURR(aURRURRnURURR5n[ R "UR5nURU5 U$[URS5n[URU5nU$)aM Create or load an Application based on the parameters found in the given L{ServerOptions} instance. If a subcommand was used, the L{service.IServiceMaker} that it represents will be used to construct a service to be added to a newly-created Application. Otherwise, an application will be loaded based on parameters in the config. encrypted) r subCommand loadedPlugins makeService subOptionsr ApplicationtapnamesetServiceParentrgetApplication)rplgserry passphrases r r(ApplicationRunner.createOrGetApplications ;; ! !++++DKK,B,BCC//$++"8"89C!--ckk:K   -'t{{;'?@J(jAKr#)rryrrr[N)r,r-r.r/r0rVrrbrr!r<rrrrr1r2r#r rrNs1,"OM1 $ $$r#rcSVs/sHo U(dMXU4PM snSnUSSS0RUSUS5pT[R"SU-5 [R"XEU5n[R"S5 U$s snf![ anSU-n[ U[5(aURSS :XaUS - n[R"[RS 9 [R"U5 [R"5 [R"S U-S -5 SnAW$SnAff=f) N)pythonsourcerrrpicklerz Loading %s...zLoaded.zFailed to load application: %sryaN Could not find 'application' in the file. To use 'twistd -y', your .tac file must create a suitable object (e.g., by calling service.Application()) and store it in a variable named 'application'. twistd loads your .tac file and scans the global variables for one of this name. Please read the 'Using Application' HOWTO for details. r )r\rmsgrloadApplication Exception isinstanceKeyErrorrrrrdeferrr>exit)rrtr)filenamestyleryr(s r rrs!=K!=A&)Q!=KANAdVX.221Q41>e" (*+--hzJ    + L " ,q 0 a " "qvvayM'A  A -    D!! "s$ B  B AB EBD==Ec[R"[R"5Vs/sHoRPM sn5$s snfr)r CompleteListrgetReactorTypes shortName)rs r _reactorActionrs2   H4L4L4NO4Nq{{4NO PPOsAc\rSrSrSr\R "S\0S9r\ Rr \ "\ R5rSrSr\rSrg) ReactorSelectionMixiniz Provides options for selecting a reactor to install. If a reactor is installed, the short name which was used to locate it is saved as the value for the C{"reactor"} key. rC) optActionsc X[UR5[S5S9nSnUHPn[UR5 UR R SURSSURS35 MR U(aQUR R S5 UR R S 5 UR R U5 [S 5e![aBnUSRURURURS 5- nS nAMS nAff=f) z5 Display a list of possibly available reactor names. rkeyrez z<4 rz !{:<4} {} ({}) rNz. reactors not available on this platform: ) sorted_getReactorTypesrr moduleName messageOutputwriter descriptionr9formatrr&)rrctsnotWorkingReactorsrr(s r opt_help_reactors'ReactorSelectionMixin.opt_help_reactorssd++-:k3JKA ALL)""((4 B/?r!--PR)ST     $ $T *    $ $E     $ $%7 8m "&=&D&DKKMMFF1I'" sA C D)'7D$$D)c[U5 XS'g![a SU<S3n[R"U5e[a"nSU<S3n[R"U5eSnAff=f)zH Which reactor to use (see --help-reactors for a list of possibilities) rCz'The specified reactor does not exist: 'z:'. See the list of available reactors with --help-reactorsz9The specified reactor cannot be used, failed with error: z9. See the list of available reactors with --help-reactorsN)r r r UsageErrorr)rrrr(s r opt_reactor!ReactorSelectionMixin.opt_reactorsv ( 9 % (O (&/1  ""3' ' (&')  ""3' '  (s 0A$AA$r2N)r,r-r.r/r0r CompletionsrcompDatar>r?r staticmethodrrrrropt_rr1r2r#r rrsI  Y,GHHJJM#H$<$<=2(8 Er#rc \rSrSrSr/SQ/SQ/SQ/r/SQ/SQ/SQS S S S S R \R5-//SQ/SQ/SQ/SQ/r \ R"S/\ R"S5\ R"S5\ R"S5\ R"5S.S9r\"\R"5rSrSr\rSrSSjrSr\S5rSrg ) ServerOptionsizQtwistd reads a twisted.application.service.Application out of a file and runs it.)rZNzBsave the Stats object rather than the text output of the profiler.)no_saveozdo not save state on shutdown)rr(z(The specified tap/aos file is encrypted.)rlNz%log to a specified file, - for stdout)rNNzA fully-qualified name to a log observer factory to use for the initial log observer. Takes precedence over --logfile and --syslog (when available).)r7rDNz7Run in profile mode, dumping results to specified file.r[NrXz!Name of the profiler to use (%s).z, )rfz twistd.tapzread the given .tap file)ryNz:read an application from within a Python file (implies -o))rr)Nz2Read an application from a .tas file (AOT format).)rundird.z-Change to a supplied directory before running)rrrz*.tapz *.(tac|py)z*.tas)rrrr()mutuallyExclusiver cSUS'SU;a USUlO[RUl[RR U5 g)NFrr?)r?r>rOptionsr!)rr8kws r r!ServerOptions.__init__Xs:W r>X,DK**DK t$r#cd[R"S5 [R"5 SUS'g)zh Run the application in the Python Debugger (implies nodaemon), sending SIGUSR2 will drop into debugger TrN)r setDebuggingrstartDebugModers r opt_debugServerOptions.opt_debug`s' 4  W r#c[R"[R5 SSKnUR[R5 g![ a gf=f)zs Print an insanely verbose log of everything that happens. Useful when debugging freezes or locks in complex code. rN)r>settracerspewer threadingr9)rr8s r opt_spewServerOptions.opt_spewksD T[[!   4;;'   sA AAcUc[RSS=(d S/n[RR X5 g)Nrz--help)r>argvrr- parseOptionsrhs r r=ServerOptions.parseOptionsws/ ?hhqrl0xjG ""41r#cUR(d US(aSUS'USb[US5US'gg![a.n[R"SR USU55eSnAff=f)NrTr#rz%Logger '{}' could not be imported: {})rrrrrr)rr(s r postOptionsServerOptions.postOptions|sx ??d8n"DO > % !)$x.!9X & &&;BB4>STU s; A3)A..A3c## UR[R5n0Ul[ U[ S5S9H;nX RUR 'UR SU4SjUR4v M= g7f)Nrr c"UR5$r)r_)plugs r r+ServerOptions.subCommands..s $,,.r#) _getPluginsr IServiceMakerrrrrr)rpluginsrDs r subCommandsServerOptions.subCommandssp""7#8#897 9(=>D/3  t|| , !0   ?sA:A<)rr?r)r,r-r.r/longdescoptFlagsjoinrVr^ optParametersrr CompleteFiles CompleteDirsrrr getPluginsrFr!r3opt_br9r=r@propertyrIr1r2r#r r"r"s  !  :FH H      /$))Kr<r)runAppr"ruecommstrs r r<r<sn _F v ;;"((388Aa=) f   B4 !!"s"A==A88A=c[R"XU5n[R"U5R U5 [ U5nU(aSn[R"U5R X2S9 g)N)rr)rrr IPersistablesetStylersave)fileintypeinrfileouttypeoutencryptrys r convertStylercs[))&*EK[!**73"7+J[!&&&Or#c0SSKJn [R"U5R 5 U(a4[ R "U5nURSSURS5 URSS[R"U5R5 g)Nrraftershutdownbefore) rrCrIService startServicer r[addSystemEventTriggerr] stopService)ryr]rCrDs r startApplicationrlsm( [!..0   [ )%%gz166:N !!*g..{;GGr#c[R"U[R5 [R"[R"5U5 g)z Force the application to terminate with the specified signal by replacing the signal handler with the default and sending the signal to ourselves. @param sig: Signal to use to terminate the process with C{os.kill}. @type sig: C{int} N)rSIG_DFLrkillgetpid)sigs r _exitWithSignalrrs* MM#v~~&GGBIIKr#)NN)7rrrrr>rrsoperatorrtwistedrrrtwisted.applicationrrtwisted.application.reactorsr r rr twisted.internet.interfacesr twisted.persistedr twisted.pythonrrrrrrtwisted.python.reflectrrrrr4rIrVrbrrrrrrrrr-r"r<rcrlrrr2r#r r{s  --1G"E!FF>><N6 ^ 6LL,o"o"d",0fhhV2QBBJzEMM#8zz P  r#