hm % S r SSKrSSKrSSKrSSKJr SSKJrJrJrJ r J
r
J r J r J
r
JrJrJrJrJr SSKJr SSKrSSKJrJr SSKJr SS KJrJ r SS
K J r J r J r J!r! \" S S S
9r"\\RF \RH 4 r%\ S r&\" \RN 5 r(\" S5 r)\(\): r* " S S\+5 r, " S S\+5 r- " S S\-5 r. " S S\RF 5 r/ " S S\5 r0\RH \ " 5 SS.\/\" 5 S S.S.r1\\2\04 \3S ' S \ \2 S \24S jr4S\*S!S"4S#\2S$\\% S%\ \2 S&\5S'\6S(\2S \Rn 4S) jjr8 " S* S+\\" 5 r9\:" 5 r;S#\2S \2S,\S \Rn 4S- jrS1\S.\ \2 S \24S2 jr?S#\2S \54S3 jr@S#\2S \4S4 jrA " S5 S 5 rBg)6zLXPath and JMESPath selectors based on the lxml and jmespath Python
packages. N)BytesIO)
AnyDictListLiteralMappingOptionalPattern
SupportsIndexTupleType TypedDictTypeVarUnion)warn)etreehtml)Version )GenericTranslatorHTMLTranslator)
extract_regexflatteniflattenshorten
_SelectorTypeSelector)boundr xmlz4.2c \ rS rSrSrg) CannotRemoveElementWithoutRoot- N__name__
__module__ __qualname____firstlineno____static_attributes__r$ V/root/1688_scrapy/alibaba-scraper/venv/lib/python3.13/site-packages/parsel/selector.pyr" r" - r+ r" c \ rS rSrSrg) CannotRemoveElementWithoutParent1 r$ Nr% r$ r+ r, r/ r/ 1 r- r+ r/ c \ rS rSrSrg) CannotDropElementWithoutParent5 r$ Nr% r$ r+ r, r2 r2 5 r- r+ r2 c 8 ^ \ rS rSrS\S\SS4U 4S jjrSrU =r$ )
SafeXMLParser9 argskwargsreturnNc J > UR SS5 [ TU ] " U0 UD6 g )Nresolve_entitiesF)
setdefaultsuper__init__)selfr7 r8 __class__s r, r> SafeXMLParser.__init__: s& ,e4
$)&)r+ r$ )r& r' r( r) r r> r*
__classcell__r@ s @r, r5 r5 9 s" *c *S *T * *r+ r5 c | \ rS rSr% \\\R \\R 4 \
S' \\ \ 4 \
S' \
\
S' Srg) CTGroupValue? _parser_csstranslator_tostring_methodr$ N)r& r' r( r) r r
r XMLParserr
HTMLParser__annotations__r r _TostringMethodTyper* r$ r+ r, rE rE ? s;
4($t*??
@@+^;<<))r+ rE r )rG rH rI r _ctgrouptyper9 c U S:X a S$ S$ )Nr r r$ rO s r, _xml_or_htmlrR S s EM5-v-r+ r+ utf-8text
parser_clsbase_url huge_treebodyencodingc U ( d! UR SS5 R 5 nO8U R 5 R SS5 R U5 =( d SnU( a) [ ( a U" SUSS9n[ R
" XFUS9nO_U" SUS 9n[ R
" XFUS9nUR H3 nS
UR ; d M [ R " S [ S 35 M5 Uc [ R
" SXbS9nU$ )
z3Create root node for text using given parser class. r+ s T)recoverrY rW )parserrV )r^ rY zuse XML_PARSE_HUGE optionz'Input data is too big. Upgrade to lxml z or later for huge_tree support.) replacestripencodeLXML_SUPPORTS_HUGE_TREEr
fromstring error_logmessagewarningsr lxml_huge_tree_version) rT rU rV rW rX rY r_ rooterrors r, create_root_noderk W s ||GS)//1zz|##FB/66x@NJ,,D8tL hGD8< hG%%E*emm;
=-..NP & |
6M Kr+ c ^ \ rS rSrSr\R SSS\4S j5 r\R S\ SS4S j5 rS\
S\ 4 S\
\S4 4U 4S jjrS"S jr S \ S
\
SS4S jr S#S\ S\\\ \ 4 S
\
SS4S jjrS \ SS4S jr S$S\
\ \\ 4 S\S\\ 4S jjr\R S%S\
\ \\ 4 SS
S\S\\ 4S jj5 r\R S$S\
\ \\ 4 S\ S\S\ 4S jj5 r S%S\
\ \\ 4 S\\ S\S\\ 4S jjrS\\ 4S jr\r\R S#SS
S\\ 4S jj5 r\R S\ S\ 4S j5 rS#S\\ S\
4S jjr\r\ S\\ \ 4 4S j5 r S"S jr S"S jr S!r U =r!$ )& SelectorListv zw
The :class:`SelectorList` class is a subclass of the builtin ``list``
class, which provides a few additional methods.
posr r9 c g Nr$ r? ro s r, __getitem__SelectorList.__getitem__| r+ SelectorList[_SelectorType]c g rq r$ rr s r, rs rt ru r+ c > [ TU ] U5 n[ U[ 5 ( a& U R [
R " SU5 5 $ [
R " [ U5 $ )Nrv )r= rs
isinstanceslicer@ typingcastr )r? ro or@ s r, rs rt sM
G $ c5 ! !>>&++.KQ"OP P;;}a0 0r+ Nc [ S5 e)Nz!can't pickle SelectorList objects TypeErrorr? s r, __getstate__SelectorList.__getstate__ s ;< c
~ U R [ U Vs/ s H o"R U5 PM sn5 5 $ s snf )z
Call the ``.css()`` method for each element in this list and return
their results flattened as another :class:`SelectorList`.
``query`` is the same argument as the one in :meth:`Selector.css`
)r@ r css)r? r r s r, r SelectorList.css s0 ~~gT&BTuuU|T&B CDD&Bs : regexreplace_entitiesc
\ [ U Vs/ s H o3R XS9PM sn5 $ s snf )a9
Call the ``.re()`` method for each element in this list and return
their results flattened, as a list of strings.
By default, character entity references are replaced by their
corresponding character (except for ``&`` and ``<``.
Passing ``replace_entities`` as ``False`` switches off these
replacements.
r )r re)r? r r r s r, r SelectorList.re s- PTUPT1UFPTUVVUs )defaultc g rq r$ r? r r r s r, re_firstSelectorList.re_first
r+ c g rq r$ r s r, r r r r+ c z ^^ [ UU4S jU 5 5 H n[ R " [ U5 s $ U$ )a
Call the ``.re()`` method for the first element in this list and
return the result in an string. If the list is empty or the
regex doesn't match anything, return the default value (``None`` if
the argument is not provided).
By default, character entity references are replaced by their
corresponding character (except for ``&`` and ``<``.
Passing ``replace_entities`` as ``False`` switches off these
replacements.
c 3 B ># U H oR TTS 9v M g7f)r N)r ).0r r r s r, (SelectorList.re_first.. s
DHqDD)9D :Ds )r r{ r| str)r? r r r els ` ` r, r r s; "
DH
B ;;sB' '
r+ c L U Vs/ s H oR 5 PM sn$ s snf )zt
Call the ``.get()`` method for each element is this list and return
their results flattened, as a list of strings.
getr? r s r, getallSelectorList.getall s
"&&A&&&s !c g rq r$ r? r s r, r SelectorList.get ru r+ c g rq r$ r s r, r r ru r+ c 8 U H nUR 5 s $ U$ )zu
Return the result of ``.get()`` for the first element in this list.
If the list is empty, return the default value.
r )r? r r s r, r r s
A557N r+ c 0 U H nUR s $ 0 $ )zdReturn the attributes dictionary for the first element.
If the list is empty, return an empty dict.
)attribr s r, r SelectorList.attrib s
A88O r+ c T [ S[ SS9 U H nUR 5 M g)zE
Remove matched nodes from the parent for each element in this list.
zuMethod parsel.selector.SelectorList.remove is deprecated, please use parsel.selector.SelectorList.drop method instead category
stacklevelN)r DeprecationWarningremover s r, r SelectorList.remove s-
D'
A
HHJ r+ c 6 U H nUR 5 M g)zC
Drop matched nodes from the parent for each element in this list.
N)dropr s r, r SelectorList.drop) s A
FFH r+ r$ r9 Nrq TNT)"r& r' r( r) __doc__r{ overloadr rs rz r r r r r r r r r r
boolr r r r extractr
extract_firstpropertyr r r r* rB rC s @r, rm rm v s
__
=
__
u
)F
1 %/01 } ;; <1= Tc TS T5R T" 37
WS#X ./
'
4E E!> E IM W3 ,- WAE W
c W __ !%
S'#,&'
#
__
"&
S'#,&'
"&!% S'#,&' #
# .'S ' G __
4
8C=
__
3
3
8C= C M
S)
r+ rm lxml_kwargsc 0 [ U [ U S 40 UD6$ )NrG )rk rN )rT rO r s r, _get_root_from_textr 4 s D(4."; K{ KKr+
input_typec 4 US:X a U R U5 U4$ US:X a- [ R " [ U 5 5 nU[
La US4$ US:X a gUS; d e[
U5 n[ S SU U[ U S S.UD6nXe4$ ! [ a [
n NVf = f)
NrT rS jsonNr r r Nr] rG )rT rX rY rU r$ ) decoder loadr
ValueError_NOT_SETrR rk rN )rX rY r r datarO ri s r, _get_root_and_type_from_bytesr 8 s V{{8$j007 99WT]+D x < V . .. .
#D
D>),
D : D s B BBc US:X a X4$ [ R " U 5 nU[ La US4$ US:X a gUS; d e[ U5 n[ U 4SU0UD6nXT4$ ! [ a [ n NJf = f)NrT r r r rO )r loadsr r rR r )rT r r r rO ri s r, _get_root_and_type_from_textr V s V zz$ 8V|V . .. .
#D t >$ >+ >D : s A A,+A,ri c [ U [ R 5 ( a! US; a [ SU< S35 e[ U5 $ [ U [
[ 45 ( d [ U 5 ( a gU=( d S$ )N> r rT z8Selector got an lxml.etree._Element object as root, and z as type.r )ry r _Elementr rR dictlist_is_valid_json)ri r s r, _get_root_typer i sp $'' ) ) !nI/
J'' D4, ' '>$+?+? r+ c ^ [ R " U 5 g! [ [ 4 a gf = f)NTF)r r r r rT s r, r r v s1
4
z " s ,,c [ U [ [ [ 45 ( a [ R
" U 5 $ g ! [ a g f = frq )ry r bytes bytearrayr r r r s r, _load_json_or_noner sC $eY/00 ::d# # s 9
AAc X \ rS rSrSr/ SQrSSS.rSr\S r SSS S
S\
SS\ 4 S \ \
S \ \
S
\S\
S\ \\
\
4 S\ \ S\ \
S\ \
S\SS4S jjrS\4S jrSS\ SS S
4S \
S\ \
S\S \ \
S
\S\
S\R* 4S jjrS\S\
S\S\\ 4S jr S4S\S\
S\ \\
\
4 S\S\\ 4
S jjrS\S\
S\\ 4S jrS\
S\
4S jr S5S \ \
\ \
4 S!\S\ \
4S" jjr \ RB S6S \ \
\ \
4 S#SS!\S\ \
4S$ jj5 r"\ RB S5S \ \
\ \
4 S#\
S!\S\
4S% jj5 r" S6S \ \
\ \
4 S#\ \
S!\S\ \
4S& jjr"S\4S' jr#\#r$S\ \
4S( jr%S)\
S*\
SS4S+ jr&S7S, jr'S7S- jr(S7S. jr)\*S\+\
\
4 4S/ j5 r,S\4S0 jr-\-r.S\
4S1 jr/S\
4S2 jr0S3r1g)8r i ab Wrapper for input data in HTML, JSON, or XML format, that allows
selecting parts of it using selection expressions.
You can write selection expressions in CSS or XPath for HTML and XML
inputs, or in JMESPath for JSON inputs.
``text`` is an ``str`` object.
``body`` is a ``bytes`` object. It can be used together with the
``encoding`` argument instead of the ``text`` argument.
``type`` defines the selector type. It can be ``"html"`` (default),
``"json"``, or ``"xml"``.
``base_url`` allows setting a URL for the document. This is needed when looking up external entities with relative paths.
See the documentation for :func:`lxml.etree.fromstring` for more information.
``huge_tree`` controls the lxml/libxml2 feature that forbids parsing
certain large documents to protect from possible memory exhaustion. The
argument is ``True`` by default if the installed lxml version supports it,
which disables the protection to allow parsing such documents. Set it to
``False`` if you want to enable the protection.
See `this lxml FAQ entry `_
for more information.
)r rO _expr
_huge_treeri _textrX __weakref__z$http://exslt.org/regular-expressionszhttp://exslt.org/sets)r setFNr+ rS rT rO rX rY r ri rV r rW r9 c
. U US; a [ SU 35 eUc U( d U[ L a [ S5 eUb/ [ U[ 5 ( d SUR 3n
[ U
5 eUbh U[ La [ R " SSS9 [ U[ 5 ( d SUR 3n
[ U
5 e[ UUUU S9u pbX`l X l
OzU( aK [ U[ 5 ( d S UR 3n
[ U
5 e[ UUUUU S
9u pbX`l X l
O(U[ L a [ S5 eX`l [ XbS 9U l
[ U R 5 U l Ub U R R# U5 Xl Xl Xl g ) N)r r rT r NzInvalid type: z,Selector needs text, body, or root argumentsz)text argument should be of type str, got z7Selector got both text and root, root is being ignored.r )r )r rV rW z+body argument should be of type bytes, got )rX rY r rV rW )r )r r ry r r@ r rg r r ri rO r r r r _default_namespacesr updater r r ) r? rT rO rX rY r ri rV r rW msgs r, r> Selector.__init__ s
< < ~dV 45 5 <)9 KL L JtS$9$9=dnn=MNCC. 8#
M dC((A$..AQR n$5 !# JD I I
dE**CDNNCST n$6! !# JD I I
X
KL L I&t=DI t 7 78 ! OO " ": .
#
r+ c [ S5 e)Nz can't pickle Selector objectsr r s r, r Selector.__getstate__ s 788r+ r] c X [ UUU[ U=( d U R S UUS9$ )NrG )rX rY rU rV rW )rk rN rO )r? rT rV rW rO rX rY s r, _get_rootSelector._get_root s6 1 29=
r+ r? r r8 c < ^ ^ T R S:X aB [ T R [ 5 ( a [ T R 5 nO>T R nO1T R S; d e[ T R R
5 n[ R " TU40 UD6nUc / nO[ U[ 5 ( d U/nS[ S[ 4UU 4S jjnU Vs/ s H
oe" U5 PM nn[ R " [ [ T R U5 5 $ s snf )a
Find objects matching the JMESPath ``query`` and return the result as a
:class:`SelectorList` instance with all elements flattened. List
elements implement :class:`Selector` interface too.
``query`` is a string containing the `JMESPath
`_ query to apply.
Any additional named arguments are passed to the underlying
``jmespath.search`` call, e.g.::
selector.jmespath('author.name', options=jmespath.Options(dict_cls=collections.OrderedDict))
r > r r r r9 c p > [ U [ 5 ( a TR U TSS9$ TR U TS9$ )NrT )rT r rO )ri r )ry r r@ )r r r? s r,
make_selector(Selector.jmespath..make_selector6 s8 !S!!~~1E~GG~~1E~::r+ )rO ry ri r r rT r searchr r r r{ r| rm selectorlist_cls)r? r r8 r resultr r s `` r, r Selector.jmespath s $ 99 $))S)))$))4yy99/ //%diinn5D 77 >FFD)) XF ;S ;] ; ; -33Fq-"F3{{<
68M8Mf8UVV 4s Dc U R S; a [ SU R < 35 eU R S; a U R R nO. U R U R =( d SSS9R n[ U R 5 nUb UR U5 U" U4UU R S.UD6n[ U5 [$ La U/nU Vs/ s H2 nU R' UUU R [) U R 5 S 9PM4 nn[
R " [ [ U R U5 5 $ ! [ a4 [
R " [ [ U R / 5 5 s $ f = f! [ a4 [
R " [ [ U R / 5 5 s $ f = f! [ R" a n[ S U S
U 35 eSnAff = fs snf ) a
Find nodes matching the xpath ``query`` and return the result as a
:class:`SelectorList` instance with all elements flattened. List
elements implement :class:`Selector` interface too.
``query`` is a string containing the XPATH query to apply.
``namespaces`` is an optional ``prefix: namespace-uri`` mapping (dict)
for additional prefixes to those registered with ``register_namespace(prefix, uri)``.
Contrary to ``register_namespace()``, these prefixes are not
saved for future calls.
Any additional named arguments can be used to pass values for XPath
variables in the XPath expression, e.g.::
selector.xpath('//a[href=$url]', url="http://www.example.com")
r r rT z'Cannot use xpath on a Selector of type r r] r rQ N)r
smart_stringsz
XPath error: z in )ri r r rO )rO r ri r AttributeErrorr{ r| rm r r r r r r r _lxml_smart_stringsr
XPathErrorr r@ rR ) r? r r r8 xpathevnspr excr s r, r Selector.xpath? s . 99 3 3 Ftyym TU U 99 '
))//
..)9r.GMM 4??# ! JJz " ? " 6 6 F > ?
sA E -F *G 9G4;FF;GGG1G,,G1c U R S; a [ SU R < 35 eU R U R U5 5 $ )a:
Apply the given CSS selector and return a :class:`SelectorList` instance.
``query`` is a string containing the CSS selector to apply.
In the background, CSS queries are translated into XPath queries using
`cssselect`_ library and run ``.xpath()`` method.
.. _cssselect: https://pypi.python.org/pypi/cssselect/
r z%Cannot use css on a Selector of type )rO r r
_css2xpath)r? r s r, r Selector.css s@ 99 3 3 DTYYM RS Szz$//%011r+ c b [ U R 5 n[ U S R U5 $ )NrH )rR rO rN css_to_xpath)r? r rO s r, r Selector._css2xpath s+ DII&~ ./<> *+=>"
* &yyD e#499~%
&s 4A B 4B B B c $ U R 5 /$ )zG
Serialize and return the matched node in a 1-element list of strings.
r r s r, r Selector.getall s
|r+ prefixuric X R U' g)z
Register the given namespace to be used in this :class:`Selector`.
Without registering namespaces you can't select or extract data from
non-standard namespaces. See :ref:`selector-examples-xml`.
N)r )r? r r s r, register_namespaceSelector.register_namespace s #& r+ c U R R S5 H nUR R S5 ( a$ UR R SS5 S Ul UR
HV nUR S5 ( d M UR
R
U5 UR
UR SS5 S ' MX M [ R " U R 5 g)zw
Remove all namespaces, allowing to traverse the document using
namespace-less xpaths. See :ref:`removing-namespaces`.
*{}r N) ri itertag
startswithsplitr popr cleanup_namespaces)r? r ans r, remove_namespacesSelector.remove_namespaces s
))..%Bvv %% c1-a0ii==%%57YY]]25FBIIbhhsA .q 12 & +r+ c [ S[ SS9 U R R 5 n UR
U R 5 g! [ a [ S5 ef = f! [ a [ S5 ef = f)z/
Remove matched nodes from the parent element.
zmMethod parsel.selector.Selector.remove is deprecated, please use parsel.selector.Selector.drop method insteadr r zThe node you're trying to remove has no root, are you trying to remove a pseudo-element? Try to use 'li' as a selector instead of 'li::text' or '//li' instead of '//li/text()', for example.XThe node you're trying to remove has no parent, are you trying to remove a root element?N)r r ri getparentr r" r r/ r? parents r, r Selector.remove s
{'
YY((*F MM$)) $ 0@
2;
s A A! A !A7c U R R 5 n U R S:X a* Uc [ S5 eUR
U R 5 g[ R " [ R U R 5 R 5 g! [ a [ S5 ef = f! [ [ 4 a [ S5 ef = f)z-
Drop matched nodes from the parent element.
zThe node you're trying to drop has no root, are you trying to drop a pseudo-element? Try to use 'li' as a selector instead of 'li::text' or '//li' instead of '//li/text()', for example.r NzThis node has no parentr/ )ri r0 r r" rO r r r{ r| r HtmlElement drop_treeAssertionErrorr2 r1 s r, r
Selector.drop" s YY((*F yyE!>$%>??
dii( D , ,dii8BBD 0@
/ 0;
s B 9B. =B. B+. C
c @ [ U R R 5 $ )z8Return the attributes dictionary for underlying element.)r ri r r s r, r Selector.attrib? s DII$$%%r+ c 4 [ U R 5 5 $ )z
Return ``True`` if there is any real content selected or ``False``
otherwise. In other words, the boolean value of a :class:`Selector` is
given by the contents it selects.
)r r r s r, __bool__Selector.__bool__D s DHHJ r+ c 4 [ U R 5 5 $ rq )r r r s r, __str__Selector.__str__N s 488: r+ c [ [ [ U R 5 5 SS95 nS[ U 5 R
SU R < SU S3$ )N( )width)reprr r r rO r& r )r? r s r, __repr__Selector.__repr__Q sG GC
O2674:&&'wtzznF4&JJr+ )r r r r ri rO rq r r r )2r& r' r( r) r __slots__r r rm r r rc r r r r r r r> r r r r r r r r r r r
r r r{ r r r r r r r, r r r r r r< __nonzero__r? rG r* r$ r+ r, r r s 4 I 5 ' #J/ # " 26 &"& #1BsmB smB B
B WS#X ./
B smB 3-B }B B
BH9c 9
"&1 "
3-
sm
$)W)W)W )W
m $ )W\ 37AWAWAW WS#X ./AW AW
m $ AWF
2-
2
2 ]0K
2 D D D
IMM3 ,-MAEM
cM$ __ !%
S'#,&'
#
__
"&
S'#,&'
"&!%
S'#,&'
#
#
*&S &0 G S & &3 &4 &
, :: &S#X & & $ K K# Kr+ )Cr r r{ rg ior r r r r r r r
r r r
r r r r r lxmlr r packaging.versionr
csstranslatorr r utilsr r r r r rJ rK _ParserTyperM __version__ lxml_versionrh rc Exceptionr" r/ r2 r5 rE rN r rL rR r r r rk rm objectr r r r r r r r r$ r+ r, rU s
% < < <z:
EOOU%5%556
u(() &*@@ Y y %E *EOO * *9 * ??(* "
!+- !
%$sL
! .x} . . #-
[! sm
^^ >x4
& xv 8Lc LC L L L
38_
<
&sm