!h SSKJr SSKrSSKrSSKJrJrJr SSKJ r SSK J r J r SSK Jr SSKJr SSKJr \(a SS KJr SS KJr S \R.-S -rS \R.-S -rSrSrSrSrSr"SS\5r"SS5r g)) annotationsN) TYPE_CHECKINGAny TypedDict)Failure)RequestSpider)Response)global_object_name) referer_str)Self)CrawlerzScraped from %(src)sz%(item)szDropped: %(exception)szZCrawled (%(status)s) %(request)s%(request_flags)s (referer: %(referer)s)%(response_flags)szError processing %(item)sz:Spider error processing %(request)s (referer: %(referer)s)zError downloading %(request)sz)Error downloading %(request)s: %(errmsg)sc4\rSrSr%S\S'S\S'S\S'Srg ) LogFormatterResultintlevelstrmsgz dict[str, Any] | tuple[Any, ...]argsN)__name__ __module__ __qualname____firstlineno____annotations____static_attributes__rZ/root/1688_scrapy/alibaba-scraper/venv/lib/python3.13/site-packages/scrapy/logformatter.pyrrs J H **rrc\rSrSrSrS SjrS SjrSSjrSSjrSSjr SSS jjr \ SS j5r S r g) LogFormatter%aClass for generating log messages for different actions. All methods must return a dictionary listing the parameters ``level``, ``msg`` and ``args`` which are going to be used for constructing the log message when calling ``logging.log``. Dictionary keys for the method outputs: * ``level`` is the log level for that action, you can use those from the `python logging library `_ : ``logging.DEBUG``, ``logging.INFO``, ``logging.WARNING``, ``logging.ERROR`` and ``logging.CRITICAL``. * ``msg`` should be a string that can contain different formatting placeholders. This string, formatted with the provided ``args``, is going to be the long message for that action. * ``args`` should be a tuple or dict with the formatting placeholders for ``msg``. The final log message is computed as ``msg % args``. Users can define their own ``LogFormatter`` class if they want to customize how each action is logged or if they want to omit it entirely. In order to omit logging an action the method must return ``None``. Here is an example on how to create a custom log formatter to lower the severity level of the log message when an item is dropped from the pipeline:: class PoliteLogFormatter(logformatter.LogFormatter): def dropped(self, item, exception, response, spider): return { 'level': logging.INFO, # lowering the level from logging.WARNING 'msg': "Dropped: %(exception)s" + os.linesep + "%(item)s", 'args': { 'exception': exception, 'item': item, } } c UR(aSUR<3OSnUR(aSUR<3OSn[R[URUU[ U5UUS.S.$)z0Logs a message when the crawler finds a webpage. )statusrequest request_flagsrefererresponse_flagsflagsrrr)r+loggingDEBUG CRAWLEDMSGr&r )selfr'responsespiderr(r*s rcrawledLogFormatter.crawledKsj29!GMM,-B 3;>>1X^^./r]]"//"!.&w/"0'  rcUc[UR5S3nO([U[5(aUR 5nOUn[ R [UUS.S.$)z3Logs a message when an item is scraped by a spider.z.start)srcitemr,)r __class__ isinstancergetErrorMessager-r. SCRAPEDMSG)r0r7r1r2r6s rscrapedLogFormatter.scraped_sa  '(8(89:&AC ' * ***,CC]]  rc[USS5=ncURRSn[U[5(a[[ U5nU[ UUS.S.$)zULogs a message when an item is dropped while it is passing through the item pipeline. log_levelNDEFAULT_DROPITEM_LOG_LEVEL) exceptionr7r,)getattrcrawlersettingsr9rr- DROPPEDMSG)r0r7rAr1r2rs rdroppedLogFormatter.droppedssaY T: :E CNN++,HIE eS ! !GU+E&  rc6[R[SU0S.$)zrLogs a message when an item causes an error while it is passing through the item pipeline. .. versionadded:: 2.0 r7r,)r-ERROR ITEMERRORMSG)r0r7rAr1r2s r item_errorLogFormatter.item_errors"]]  rcJ[R[U[U5S.S.$)zrms" 00*# 2,&&$bjj 0: = % 2Z ? i * M8C++ eer