!h SrSSKJr SSKJrJr SSKJrJr SSK J r J r SSK J r SSKJr SSKJrJr SS KJr \(aSS KJrJr "S S \5r"S S\5rg)z This module implements the XMLFeedSpider which is the recommended spider to use for scraping from an XML feed. See documentation in docs/topics/spiders.rst ) annotations) TYPE_CHECKINGAny) NotConfigured NotSupported)Response TextResponse)Selector)Spider)csviter xmliter_lxml)iterate_spider_output)IterableSequencec\rSrSr%SrSrS\S'SrS\S'SrS \S 'SS jr SS jr SS jr SSjr SSjr SSjrSSjrSrg) XMLFeedSpidera This class intends to be the base class for spiders that scrape from XML feeds. You can choose whether to parse the file using the 'iternodes' iterator, an 'xml' selector, or an 'html' selector. In most cases, it's convenient to use iternodes, since it's a faster and cleaner. iternodesstriteratoritemitertagzSequence[tuple[str, str]] namespacescU$)awThis overridable method is called for each result (item or request) returned by the spider, and it's intended to perform any last time processing required before returning the results to the framework core, for example setting the item GUIDs. It receives a list of results and the response which originated that results. It must return a list of results (items or requests). rselfresponseresultss Z/root/1688_scrapy/alibaba-scraper/venv/lib/python3.13/site-packages/scrapy/spiders/feed.pyprocess_resultsXMLFeedSpider.process_results%s cU$)zYou can override this function in order to make any changes you want to into the feed before parsing it. This function must return a response. rrrs r adapt_responseXMLFeedSpider.adapt_response1s r#cR[US5(aURX5$[e)DThis method must be overridden with your custom spider functionality parse_item)hasattrr*NotImplementedError)rrselectors r parse_nodeXMLFeedSpider.parse_node8s$ 4 & &??86 6!!r#c## UH6n[URX55nURX5ShvN M8 gN 7f)aThis method is called for the nodes matching the provided tag name (itertag). Receives the response and an Selector for each node. Overriding this method is mandatory. Otherwise, you spider won't work. This method must return either an item, a request, or a list containing any of them. N)rr.r!)rrnodesr-rets r parse_nodesXMLFeedSpider.parse_nodes>s;H'(KLC++H: : : :s4AA Ac [US5(d [S5eURU5nURS:XaUR U5nOURS:XaZ[ U[ 5(d [S5e[USS9nURU5 URSUR35nOuURS:XaZ[ U[ 5(d [S5e[USS9nURU5 URSUR35nO [S 5eURX5$) Nr.zBYou must define parse_node method in order to scrape this XML feedrxmlzResponse content isn't text)typez//htmlzUnsupported node iterator)r+rr&r _iternodes isinstancer ValueErrorr _register_namespacesxpathrrr3)rrkwargsr1r-s r _parseXMLFeedSpider._parseJst\**T &&x0 ==K 'OOH-E ]]e #h 55 !>??u5H  % %h /NNR ~#67E ]]f $h 55 !>??v6H  % %h /NNR ~#67E:; ;00r#c#n# [XR5HnURU5 Uv M g7fN)r rr<)rrnodes r r9XMLFeedSpider._iternodeses+ <<8D  % %d +J9s35cPURHup#URX#5 M grB)rregister_namespace)rr-prefixuris r r<"XMLFeedSpider._register_namespacesjs ??KF  ' ' 4+r#Nrrr Iterable[Any]returnrKrrrLr)rrr-r rLr)rrr1Iterable[Selector]rLrrrr>rrLr)rrrLrN)r-r rLNone)__name__ __module__ __qualname____firstlineno____doc__r__annotations__rrr!r&r.r3r?r9r<__static_attributes__rr#r rrsc HcGS,.J).   +8   " ;16 5r#rc\rSrSr%SrSrS\S'SrS\S'SrS\S'SS jr SS jr SS jr SS jr SS jr Srg) CSVFeedSpideroaSpider for parsing CSV feeds. It receives a CSV file in a response; iterates through each of its rows, and calls parse_row with a dict containing each field's data. You can set some options regarding the CSV file, such as the delimiter, quotechar and the file's headers. Nz str | None delimiter quotecharzlist[str] | NoneheaderscU$zs r r?CSVFeedSpider._parses@t[))S &&x0x((r#rrJrM)rrrdzdict[str, str]rLr)rrrLrrO)rQrRrSrTrUr[rVr\r]r!r&rerhr?rWrr#r rYrYosg z z!%G $ +8  " ;)r#rYN)rU __future__rtypingrrscrapy.exceptionsrr scrapy.httprr scrapy.selectorr scrapy.spidersr scrapy.utils.iteratorsr r scrapy.utils.spiderrcollections.abcrrrrYrr#r rusE#%9.$!852U5FU5p2)F2)r#