C'UddlmZmZmZmZmZddlmZmZm Z ddl m Z m Z ddl mZddlmZmZmZmZddlmZmZmZddlmZdd lmZdd lmZmZmZm Z d Z!d Z"iZ#d e$d<Gdde Z%d*dZ&dZ'GddZ(defdZ)dedefdZ*d+dededefdZ+e+e#d<GddZ,dedefdZ-d Z.dedefd!Z/dededej`fd"Z1Gd#d$Z2e1e#d%<e2e#d&<d'ed(e fd)Z3y),)AnyCallableDictOptional Collection)ConfigurationError GrammarError assert_config)get_regexp_width Serialize)GrammarAnalyzer) LexerThread BasicLexerContextualLexerLexer)earleyxearleycyk) LALR_Parser)Tree) LexerConf ParserConf_ParserArgType _LexerArgTypecLtdd}|rSGfddt}|S)N__future_interface__FceZdZfdZdZy)'_wrap_lexer..CustomLexerWrapperc ||_yN)lexer)self lexer_conf lexer_classs (lib/third_party/lark/parser_frontends.py__init__z0_wrap_lexer..CustomLexerWrapper.__init__s(4 cL|jj|jSr!)r"lextext)r# lexer_state parser_states r&r*z+_wrap_lexer..CustomLexerWrapper.lexszz~~k&6&677r(N__name__ __module__ __qualname__r'r*)r%sr&CustomLexerWrapperrs  5 8r(r2)getattrr)r%future_interfacer2s` r& _wrap_lexerr5s0{,BEJ 8 8 "!r(ctj|d|}|xr|jjdxst}|j|d|||j }||_t||||S)N parser_confrparser)r8)r deserialize_pluginsgetrdebug callbacksParsingFrontend)datamemor$r=optionsr7clsr8s r&_deserialize_parsing_frontendrCsn((m))r$r7r8r$r7rANc||_||_||_|r||_nPtj |j }| Jdj|j |||||_|j}d|_ |dvr|jJd|_ yt|tr)t|tsJt|||_nPt|t"r5t$t&d|}|||j|j||_n t)d|jr&t+|j |j|_yy)Nz&{} is not supported in standalone modeF)dynamicdynamic_completeTbasic contextualz&Bad value for lexer_type: {lexer_type})r7r$rAr8rDr; parser_typeformat lexer_type skip_lexerpostlex isinstancetype issubclassrr5r"strcreate_basic_lexercreate_contextual_lexer TypeErrorPostLexConnector)r#r$r7rAr8 create_parserrN create_lexers r&r'zParsingFrontend.__init__-sN&$   DK,001H1HIM , .V.].]++/ ,( KIDK **  8 8%%- --"DO  j$ 'j%0 000Z0r>&sa@ L$J9$J:$JLLsL=#= ChsmCr(r>returnNcpt|dt|tsdddd|}t||d|zyy)N)rjrrrI)rJrGrH)rJz9Parser %r does not support lexer %%r, expected one of %%s)r rQrR)r8r"expecteds r&_validate_frontend_argsrrqsK&34 eT "+>    eX'bek'kl #r(cji}|D]+}t||jd}||||j<-|Sr!)r3name) transformer terminalsresultterminalcallbacks r&_get_lexer_callbacksrz|s> F; t<  $,F8== ! Mr(ceZdZdZdZy)rXc ||_||_yr!)r" postlexer)r#r"r}s r&r'zPostLexConnector.__init__s "r(cp|jj||}|jj|Sr!)r"r*r}process)r#r,r-is r&r*zPostLexConnector.lexs+ JJNN; 5~~%%a((r(Nr.rnr(r&rXrXs #)r(rXc`|xr|jjdxst}||S)Nr)r:r;r)r$r8rPrArBs r&rUrUs,  9w''++L9 HjC z?r(r$c .|xr|jjdxst}|jjj Dcic]\}}|t |j!}}}|r |jnd}||||Scc}}w)Nrrn) always_accept) r:r;r _parse_tablestatesitemslistkeysr) r$r8rPrArBidxtrrs r&rVrVs  >w''++,=> R?CKQK^K^KeKeKkKkKm)nKma#d1668n*EW%:%:2M z6 ??*os$Br7c|r |jnd}|r |jnd}|xr|jjdxst}||||S)NFr)r<strict)r<rr:r;r)r$r7rAr<rrBs r&create_lalr_parserrsK$GMM%E&W^^EF  :w''++M: J{C {% 77r(rjceZdZdZddZy)EarleyRegexpMatcherci|_|jD]}|jj} t |d}|dk(r t d||jr|jd}|jj||j|j|j<y#t $rt d|jd|wxYw)Nrz/Dynamic Earley doesn't allow zero-width regexpszBad regexp in token z: zutf-8) regexpsrvpattern to_regexpr r ValueErrorrt use_bytesencode re_modulecompile g_regex_flags)r#r$rregexpwidths r&r'zEarleyRegexpMatcher.__init__s %%AYY((*F ](03A:&'XZ[\\##w/#-#7#7#?#? H`H`#aDLL & T"1666#RSS Ts B..%CcT|j|jj||Sr!)rrtmatch)r#termr+indexs r&rzEarleyRegexpMatcher.matchs"||DII&,,T599r(N)r)r/r0r1r'rrnr(r&rrs b :r(rc |jr tdt|}tj|||j fi|S)Nz7Earley's dynamic lexer doesn't support lexer_callbacks.)r=r rrParserr)r$r7rgearley_matchers r&create_earley_parser__dynamicrs?TUU(4N >>*k>3G3G N2 NNr(c4|j|jk(Sr!)rtrR)rtokens r&_match_earley_basicrs 99 ""r(c :tj||tfi|Sr!)rrr)r$r7rgs r&create_earley_parser__basicrs ==[2E L LLr(c|jdk(}|r |jnd}|jdk7r|jxstnd}i}|jdk(rt }n!|jdk(r d|d<t }nt }|||f|||d|S) NresolveFforestrGrHT complete_lex)resolve_ambiguityr< tree_class) ambiguityr<rrrNrr)r$r7rArr<rextrafs r&create_earley_parserrs))Y6$GMM%E/6/@/@H/L##+tRVJ E ) )   "4 4 $n ) ' Z w8IQVcm wqv wwr(c&eZdZddZdZdZdZy) CYK_FrontEndNct||_tj|j|_|j |_yr!)r _analysisrrrulesr8r=)r#r$r7rAs r&r'zCYK_FrontEnd.__init__s1(5jj!2!23 $..r(ct|jd}|jj||}|j |Sr!)rr*r8re _transform)r# lexer_threadr\tokenstrees r&rezCYK_FrontEnd.parses<l&&t,-{{  /t$$r(ct|j}|D]B}|jDcgc]%}t|tr|j |n|'c}|_D|j |Scc}wr!)r iter_subtreeschildrenrQr_apply_callback)r#rsubtreessubtreecs r&rzCYK_FrontEnd._transformsr**,-G_f_o_op_oZ[:a;N 4 4Q 7TU U_opG  ##D)) qs*A2cT|j|j|jSr!)r=ruler)r#rs r&rzCYK_FrontEnd._apply_callbacks (t~~dii(77r(r!)r/r0r1r'rerrrnr(r&rrs/ % *8r(rrrrLrNct|tsJt|tsJ||_||_t |||Sr!)rQrrrLrNr>)rLrNr$r7rAs r&_construct_parsing_frontendrsC j) ,, , k: .. .)K&J :{G <rrrzrXrUrVrrrrrrrrrrnr(r&rsR<<GG.5BB)),HH "LGICHHCiHCVm)) @ @P_@ 898:8Xc8 .::*OiOjO#MIMJMxYxZxU[UbUbx$88.2& =# =! =r(