!h&SrSSKJr SSKrSSKrSSKrSSKJr SSKJ r SSK J r SSK J r JrJrJr SSKJrJr SS KJr SS KJr SS KJr SS KJr SS KJrJr SSKJ r \ (aSSK!J"r" SSK#J$r$ SSK%J&r' SSK(J)r) SSK*J+r+ \"S5r,S"Sjr-S"Sjr.S#Sjr/S$S%Sjjr0\"S\ 5r1S&Sjr2S'S(Sjjr3S)Sjr4S*Sjr5S+S,Sjjr6S-Sjr7S.S jr8S/S!jr9g)0z< This module contains some assorted functions used in tests ) annotationsN) import_module)Path)split) TYPE_CHECKINGAnyTypeVarcast)TestCasemock)SkipTest)ScrapyDeprecationWarning)is_botocore_available)create_deprecated_class)is_asyncio_reactor_installedis_reactor_installed) DefaultSpider) Awaitable)Deferred)Response)Spider)Crawler_Tcv[R"S[SS9 S[R;a [ S5eg)NzThe assert_gcs_environ() function is deprecated and will be removed in a future version of Scrapy. Check GCS_PROJECT_ID directly.category stacklevelGCS_PROJECT_IDzGCS_PROJECT_ID not found)warningswarnrosenvironr X/root/1688_scrapy/alibaba-scraper/venv/lib/python3.13/site-packages/scrapy/utils/test.pyassert_gcs_environr'%s8 MM *)  rzz)122*r%cl[R"S[SS9 [5(d [ S5eg)NzThe skip_if_no_boto() function is deprecated and will be removed in a future version of Scrapy. Check scrapy.utils.boto.is_botocore_available() directly.rrzmissing botocore library)r r!rrr r$r%r&skip_if_no_botor)0s6 MM E)  ! " "122 #r%cRSSKJn [R"S[SS9 UR [ RRS5S9nURU5nURU5nUR5n[UR5nURU5 XVU4$)Nr)storagezjThe get_gcs_content_and_delete() function is deprecated and will be removed in a future version of Scrapy.rrr)project) google.cloudr+r r!rClientr"r#get get_bucketget_blobdownload_as_stringlistacl delete_blob)bucketpathr+clientblobcontentr4s r&get_gcs_content_and_deleter;;s% MMt) ^^BJJNN3C$D^ EF   v &F ??4 D%%'G txx.C t  r%c^ SSKJn [R"S[SS9 U"5nUR X5 UR X45 U(aURS5 /m S U 4SjjnURSU3U5 [U5upURU 5 URU 5 S RT 5$) Nr)FTPzjThe get_ftp_content_and_delete() function is deprecated and will be removed in a future version of Scrapy.rrFc(>TRU5 gN)append)dataftp_datas r& buffer_data/get_ftp_content_and_delete..buffer_datadsr%zRETR r%)rAbytesreturnNone) ftplibr=r r!rconnectloginset_pasv retrbinaryrcwddeletejoin) r7hostportusernamepassworduse_active_moder=ftprCdirnamefilenamerBs @r&get_ftp_content_and_deleterXNs MMt) %CKKIIh! UHNNU4&>;/d GGGGJJx 88H r% TestSpidercf[5(d [S5e0n[5(dSUS'U$)aReturn a settings dict that works with the installed reactor. ``Crawler._apply_settings()`` checks that the installed reactor matches the settings, so tests that run the crawler in the current process may need to pass a correct ``"TWISTED_REACTOR"`` setting value when creating it. zget_reactor_settings() called without an installed reactor, you may need to install a reactor explicitly when running your tests.NTWISTED_REACTOR)r RuntimeErrorr)settingss r&get_reactor_settingsr^qs@ ! ! U   "H ' ) )&*"# Or%cSSKJn 0[5EU=(d 0EnU"U5nURU=(d [5nUR 5 U$)zReturn an unconfigured Crawler object. If settings_dict is given, it will be used to populate the crawler settings with a project level priority. r) CrawlerRunner)scrapy.crawlerr`r^create_crawlerr_apply_settings) spidercls settings_dictprevent_warningsr`r]runnercrawlers r& get_crawlerrisX-      B H8 $F##I$>?G  Nr%c[S5RSn[[U5R5[ R -[ RRSS5-$)z^Return a PYTHONPATH suitable to use in processes so that they find this installation of Scrapyscrapyr PYTHONPATH) r__path__strrparentr"pathsepr#r/) scrapy_paths r&get_pythonpathrssM )2215K tK '' (2:: 5 |UW8X XXr%c\[RR5n[5US'U$)zReturn a OS environment dict suitable to fork processes that need to import this installation of Scrapy, instead of a system installed one. rl)r"r#copyrs)envs r& get_testenvrws& **// C&(C  Jr%c[R"S[SS9 URUR 5UR 5U5 g)zdAsserts text1 and text2 have the same lines, ignoring differences in line endings between platforms z^The assert_samelines function is deprecated and will be removed in a future version of Scrapy.rrN)r r!r assertEqual splitlines)testcasetext1text2msgs r&assert_samelinesrs?  MMh)  ))+U-=-=-?Er%cr[R"5nUR5nURU5 U$r?)asyncioQueuer/ put_nowait)valueqgetters r&get_from_asyncio_queuers)"==?A UUWFLL Mr%cSSKJnJnJn [R "S[ SS9 [R"U5n[R"U5nXCRl [R"U5nXTRl X4U4$)ztCreates autospec mocks for google-cloud-storage Client, Bucket and Blob classes and set their proper return values. r)BlobBucketr.ziThe mock_google_cloud_storage() function is deprecated and will be removed in a future version of Scrapy.rr) google.cloud.storagerrr.r r!rr create_autospecr0 return_valuer9)rrr. client_mock bucket_mock blob_mocks r&mock_google_cloud_storagerst:9 MMs) &&v.K&&v.K*5'$$T*I$-! i 00r%c SSKJn SSKJn U"U5n[ SUR SUR S555$)Nr)reactor)AgentDeferred[TxResponse]sGETzutf-8)twisted.internetrtwisted.web.clientrr requestencode)urlrragents r&get_web_client_agent_reqrs3(( 'NE & fcjj>Q(R SSr%)rFrG)r6rr7rorFz'tuple[bytes, list[dict[str, str]], Any])F)r7rorProrQintrRrorSrorTboolrFrE)rFzdict[str, Any])NNT)rdztype[Spider] | Nonerezdict[str, Any] | NonerfrrFr)rFro)rFzdict[str, str]r?) r{r r|ror}ror~z str | NonerFrG)rrrFz Awaitable[_T])rFztuple[Any, Any, Any])rrorFr):__doc__ __future__rrr"r importlibrpathlibr posixpathrtypingrrr r unittestr r twisted.trial.unittestr scrapy.exceptionsrscrapy.utils.botorscrapy.utils.deprecaterscrapy.utils.reactorrrscrapy.utils.spiderrcollections.abcrtwisted.internet.deferrrr TxResponserkrrarrr'r)r;rXrYr^rirsrwrrrrr$r%r&rsi# #44#+63:S-)/9& T]33 ,2"          @%\= A &&*+/!"( .YCG F F" F+. F5? F  F1.Tr%