!h+SSKJr SSKrSSKrSSKJr SSKJrJr SSK J r SSK J r SSK Jr SSKJr \(aSS KJr SS KJr SS KJrJr SS KJr "S S\5r\ "\ 5"SS55rg)) annotationsN) defaultdict) TYPE_CHECKINGProtocol) implementer) ISpiderLoader) walk_modules)iter_spider_classes) ModuleType)Self)RequestSpider) BaseSettingscF\rSrSr\SSj5rS SjrS SjrS SjrSr g) SpiderLoaderProtocolcg)z6Return an instance of the class for the given settingsNclssettingss Z/root/1688_scrapy/alibaba-scraper/venv/lib/python3.13/site-packages/scrapy/spiderloader.py from_settings"SpiderLoaderProtocol.from_settingscg)zmReturn the Spider class for the given spider name. If the spider name is not found, it must raise a KeyError.Nrself spider_names rloadSpiderLoaderProtocol.loadrrcg)zDReturn a list with the names of all spiders available in the projectNrrs rlistSpiderLoaderProtocol.list!rrcg)zBReturn the list of spiders names that can handle the given requestNr)rrequests rfind_by_request$SpiderLoaderProtocol.find_by_request%rrrNrrreturnr r strr,z type[Spider]r, list[str])r(r r,z__builtins__.list[str]) __name__ __module__ __qualname____firstlineno__ classmethodrr!r%r)__static_attributes__rrrrrs&EE8Qrrcr\rSrSrSrS SjrSSjrSSjrSSjr\ SSj5r SSjr SS jr SS jr S rg ) SpiderLoader)zN SpiderLoader is a class which locates and loads spiders in a Scrapy project. cURS5UlURS5Ul0Ul[ [ 5UlUR5 g)NSPIDER_MODULESSPIDER_LOADER_WARN_ONLY) getlistspider_modulesgetbool warn_only_spidersrr%_found_load_all_spiders)rrs r__init__SpiderLoader.__init__0sH)1)9)9:J)K'//0IJ13 ?J4?P   rcJ/nURR5HGup#URUVVs/sH#upE[U5S:dMSUSU<SUS3PM% snn5 MI U(a/SR U5n[ R "SUS3[S 9 ggs snnf) Nz z named z (in )z z/There are several spiders with the same name: z' This can cause unexpected behavior.category)rBitemsextendlenjoinwarningswarn UserWarning)rdupesname locationsmodr dupes_strings r_check_name_duplicates#SpiderLoader._check_name_duplicates7s#{{002OD LL%.$-9~)9bWTHE#a8$-  3 !;;u-L MMC. IK$  s B B c[U5HYnURURRURUR45 X R UR'M[ gN)r rBrSappendr1rA)rmodulespclss r _load_spidersSpiderLoader._load_spidersJsI(0E KK # * *FOOU^^+L M(-MM%** %1rc JURH'n[U5HnURU5 M M) UR5 g![[4aI UR (a6[ R"S[R"5SUS3[S9 Mef=f)N z$Could not load spiders from module 'z#'. See above traceback for details.rI) r>r r^ ImportError SyntaxErrorr@rOrP traceback format_excRuntimeWarningrW)rrSr\s rrCSpiderLoader._load_all_spidersOs''D *40F&&v.1( ##% - >>MMY11345((,v.;;"0  s#A  AB" B"cU"U5$rZrrs rrSpiderLoader.from_settings`s 8}rcZURU$![a [SU35ef=f)zg Return the Spider class for the given spider name. If the spider name is not found, raise a KeyError. zSpider not found: )rAKeyErrorrs rr!SpiderLoader.loadds8  ?==- - ?/ }=> > ?s*cURR5VVs/sHup#URU5(dMUPM! snn$s snnf)zD Return the list of spider names that can handle the given request. )rArKhandles_request)rr(rSrs rr)SpiderLoader.find_by_requestnsB #'--"5"5"7 "7YT3;N;Nw;WD"7   s AAcH[URR55$)zG Return a list with the names of all spiders available in the project. )r%rAkeysr$s rr%SpiderLoader.listvsDMM&&())r)rBrAr>r@N)rr)r,None)r\r r,rsr+r-)r(r r,r0r/)r1r2r3r4__doc__rDrWr^rCr5rr!r)r%r6rrrr8r8)s> !&. &"? *rr8) __future__rrdrO collectionsrtypingrrzope.interfacerscrapy.interfacesrscrapy.utils.miscr scrapy.utils.spiderr typesr typing_extensionsr scrapyr rscrapy.settingsrrr8rrrrs`"#*&+*3 '&,Q8Q" ]P*P*P*r