!h)SrSSKJr SSKrSSKrSSKrSSKrSSKrSSKrSSK J r SSK J r SSK Jr SSKJr SSKJr SS KJr SS KJrJrJrJrJr SS KJr SS KJr SS KJ r \(aSSK J!r!J"r" SSK#J$r$ SSK%J&r& SSK'J(r( \)\\*\+4r,\"S5r-S Sjr.S!Sjr/S"Sjr0S#Sjr1S$Sjr2Sr3S%Sjr4\S&Sj5r5S'Sjr6\ "SS9r7S(Sjr8S)Sjr9g)*z.Helper functions which don't fit anywhere else) annotationsN)deque)Iterable)contextmanager)partial) import_module) iter_modules)IO TYPE_CHECKINGAnyTypeVarcast)ScrapyDeprecationWarning)Item)LocalWeakReferencedCache)CallableIterator) ModuleType)Spider)CrawlerTcUc/$[U[5(d([US5(a[[[ U5$U/$)zConvert an argument to an iterable. The argument can be a None, single value, or an iterable. Exception: if arg is a dict, [arg] will be returned __iter__) isinstance_ITERABLE_SINGLE_VALUEShasattrrrr )args X/root/1688_scrapy/alibaba-scraper/venv/lib/python3.13/site-packages/scrapy/utils/misc.py arg_to_iterr#s@  { c2 3 3Z8P8PHSM3'' 5Lcd[U[5(d)[U5(aU$[S[ U535eUR S5nUSUXS-Sp2[U5n[XC5nU$![ a [ SUS35ef=f![a [SUSUS 35ef=f) a>Load an object given its absolute object path, and return it. The object can be the import path of a class, function, variable or an instance, e.g. 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware'. If ``path`` is not a string, but is a callable object, such as a class or a function, then return it as is. z:Unexpected argument type, expected string or object, got: .zError loading object 'z': not a full pathNzModule 'z#' doesn't define any object named '') rstrcallable TypeErrortyperindex ValueErrorrgetattrAttributeError NameError)pathdotmodulenamemodobjs r load_objectr40s dC D>>KHd U  Lkk#:t!GID  CWc  J L1$7IJKKL W(6(*MdVSTUVVWsA5( B5BB/c/n[U5nURU5 [US5(aZ[UR5HAup4nUS-U-nU(aU[ U5- nM%[U5nURU5 MC U$)zLoads a module and all its submodules from the given module path and returns them. If *any* module throws an exception while importing, that exception is thrown back. For example: walk_modules('scrapy.utils') __path__r")rappendrr r6 walk_modules)r.modsr2_subpathispkgfullpathsubmods rr8r8Qs D  CKKsJ!-cll!; AczG+H X..&x0 F# "< Kr c[R"S[SS9 [R"5nUR S5nU(dUR5$UR U5 M<)zCalculate the md5 checksum of a file-like object without reading its whole content in memory. >>> from io import BytesIO >>> md5sum(BytesIO(b'file content to hash')) '784406af91dd5a54fbb9c84c2236595a' zfThe scrapy.utils.misc.md5sum function is deprecated and will be removed in a future version of Scrapy. stackleveli)warningswarnrhashlibmd5readupdate hexdigest)filemds rmd5sumrMgs^ MM 5 !   A  IIdO  ;;=  r c^USL=(a# SURSS5R5;$)z3Return True if link rel attribute has nofollow typeNnofollow, )replacesplit)rels rrel_has_nofollowrUs* d? JzS[[c-B-H-H-JJJr cz[R"S[SS9 UcUc [S5eURnU(a*[ US5(aUR "U/UQ70UD6nSnO4[ US5(aUR"U/UQ70UD6nSnO U"U0UD6nSnUc[URSUS 35eU$) akConstruct a class instance using its ``from_crawler`` or ``from_settings`` constructors, if available. At least one of ``settings`` and ``crawler`` needs to be different from ``None``. If ``settings `` is ``None``, ``crawler.settings`` will be used. If ``crawler`` is ``None``, only the ``from_settings`` constructor will be tried. ``*args`` and ``**kwargs`` are forwarded to the constructors. Raises ``ValueError`` if both ``settings`` and ``crawler`` are ``None``. .. versionchanged:: 2.2 Raises ``TypeError`` if the resulting instance is ``None`` (e.g. if an extension has not been implemented correctly). zVThe create_instance() function is deprecated. Please use build_from_crawler() instead.r@categoryrBz-Specify at least one of settings and crawler. from_crawler from_settings__new__r" returned None) rCrDrr*settingsrrYrZr' __qualname__)objclsr]crawlerargskwargsinstance method_names rcreate_instanceres" MM 3)  ?LM M##76>22&&w@@@$  ) )''B4B6B% 4*6* 6../q ^LMM Or c|[US5(aUR"U/UQ70UD6nSnOe[US5(aJ[R"URS3[ SS9 UR "UR/UQ70UD6nSnO U"U0UD6nSnUc[URSUS35e[[U5$) zConstruct a class instance using its ``from_crawler`` or ``from_settings`` constructor. .. versionadded:: 2.12 ``*args`` and ``**kwargs`` are forwarded to the constructor. Raises ``TypeError`` if the resulting instance is ``None``. rYrZz has from_settings() but not from_crawler(). This is deprecated and calling from_settings() will be removed in a future Scrapy version. You can implement a simple from_crawler() that calls from_settings() with crawler.settings.r@rWr[r"r\) rrYrCrDr^rrZr]r'rr)r_r`rarbrcrds rbuild_from_crawlerrgsv~&&&&w@@@$  ) ) ""#$6 6.  ''(8(8J4J6J% 4*6* 6../q ^LMM 8 r c+# UVs0sH"o[RRU5_M$ nn[RRU5 Sv UR 5H.upUc[RU MU[RU'M0 gs snf!UR 5H.upUc[RU MU[RU'M0 f=f7f)zsTemporarily set environment variables inside the context manager and fully restore previous environment afterwards N)osenvirongetrHitems)rbk original_envvs r set_environrps 399&Qrzz~~a((&L9JJf"  &&(DAyJJqM ! 1 ) : !&&(DAyJJqM ! 1 )s)C%)B!C%BAC%AC""C%c## [U/5nSnU(amUR5n[U[R5(a U(aM?SnUR [R "U55 Uv U(aMlgg7f)zjSimilar to ``ast.walk``, but walks only function body and skips nested functions defined within the node. FTN)rpopleftrast FunctionDefextenditer_child_nodes)nodetodowalked_func_defs r walk_callablerzsd!$=DO ||~ dCOO , ,"O C((./  $s BBB)limitc U[;a[[U5$SSjn[R"U5(Ga-Un[ U[ 5(a#UR n[ U[ 5(aM#[R"U5n[R"S5nURSU5nURU5nU(a*[R"SURS53SU5n[R"U5n[U5HNn[ U[R 5(dM$U"U5(aM3S[U'[[U5s $ S[U'[[U5$) z Returns True if a callable is a generator function which includes a 'return' statement with a value different than None, False otherwise cURnUSL=(d/ [U[R5=(a URSL$)N)valuerrsConstant) return_noders r returns_none4is_generator_with_return_value..returns_nones:!!} ucll + C t0C r z (^[\t ]+) rTF)rz ast.Returnreturnbool)_generator_callbacks_cacherinspectisgeneratorfunctionrrfunc getsourcerecompilesubmatchgrouprsparserzReturn) r&rrsrcpatterncodertreerws ris_generator_with_return_valuers4 --.x899 ""8,,w''99Dw''%**\*{{2s# c" 66Bu{{1~./trs4"  $%# 886;2 &c50 CL B,2K 'T %14@CB"""  6C@"6J  0   r