lQdZddlmZddlmZddlmZddlZddlZddlmZ ddl m Z ddl mZdd l mZddlm Z ddlZdd lmZd ZGd d eZ ddZGddeZy)aA class for projecting and transforming JSON-serializable objects. From the Cloud SDK doc "DD: gcloud resource projection algorithm": Algorithm The algorithm represents a resource R and projection P as trees. P is used to color the nodes of R (with the colors {0, 1, 2, 3}) as follows: 1. Initialize the nodes in R to (id, 0, identity). 2. Do a DFS on P. Let p be the projection subtree and r be the resource subtree at each level. Let f be a flag value at each level, and initialize f to the flag value of the root node of P. 2.1. For each id i in p that is also in r, set r[i].flag |= p[i].flag | f, and r[i].transform = p[i].transform if r[i].transform != identity and p[i].transform != identity. 2.2. If p contains a slice then repeat step 2.1 with i = slice. 2.3. If r[i].flag is 0 then prune the search at this node, otherwise 2.4. descend to the next level with r = r[i], p = p[i], and f = r[i].flag. 3. At the end of the search the nodes of R will be colored with the values {0, 1, 2, 3}. The projected keys are the set of the longest paths from the root of R ending with a flag value >= 2. Remarks If the initial value of f is PROJECT or PROJECT* (2 or 3) then all keys in R are projected. Non-leaf keys may be projected in this model, resulting in dict or list values instead of scalars. Example usage: projector = resource_projector.Compile(expression) for resource in resources: obj = projector.Evaluate(resource) OperateOnProjectedResource(obj) )absolute_import)division)unicode_literalsN)messages)encoding)resource_projection_parser)resource_property)rangec4tj|S)zReturns resource or a JSON-serializable copy of resource. Args: resource: The resource object. Returns: The original resource if it is a primitive type object, otherwise a JSON-serializable copy of resource. )CompileEvaluate)resources 6lib/googlecloudsdk/core/resource/resource_projector.pyMakeSerializablerGs   H %%c`eZdZdZ ddZdZdZdZdZdZ ddZ d Z d Z d Z d Zd Zy) Projectora Projects a resource using a ProjectionSpec. A projector is a method that takes an object and a projection as input and produces a new JSON-serializable object containing only the values corresponding to the keys in the projection. Optional projection key attributes may transform the values in the resulting JSON-serializable object. Attributes: _projection: The projection object. _been_here_done_that: A set of the current object id()'s being projected. Used to catch recursive objects like datetime.datetime.max. _by_columns: True if Projector projects to a list of columns. _columns: self._projection.Columns() column attributes. _ignore_default_transforms: Ignore default projection transforms if True. _retain_none_values: Retain dict entries with None values. _transforms_enabled_attribute: The projection.Attributes() transforms_enabled setting. _transforms_enabled: Projection attribute transforms enabled if True, disabled if False, or set by each Evaluate(). c||_||_|jj|_||_||_t |_|j}d|vrd|_ nd|vrd|_ nd|_ d|v|_ y)a0Constructor. Args: projection: A ProjectionSpec (parsed resource projection expression). by_columns: Project to a list of columns if True. ignore_default_transforms: Ignore default projection transforms if True. retain_none_values: project dict entries with None values. transformsTz no-transformsFNz json-decode) _projection _by_columnsColumns_columns_ignore_default_transforms_retain_none_valuesset_been_here_done_that Attributes_transforms_enabled_attribute _json_decode)self projection by_columnsignore_default_transformsretain_none_values attributess r__init__zProjector.__init__js"D!D$$,,.DM&?D#1D #D&&(Jz!+/d( J &+0d(+/d(%3Drcz|j |jS|jd|jjfvS)zReturns True if transform is enabled. Args: transform: The resource_projection_parser._Transform object. Returns: True if the transform is enabled, False if not. N)_transforms_enabledactiver)r! transforms r_TransformIsEnabledzProjector._TransformIsEnableds> +  % %%   d&6&6&=&=> >>rc<||jjkry|rl|jr`|jjrJ|j |jjr%|jjj |S|j |||dS)a"Applies projection.attribute.transform in projection if any to obj. Args: obj: An object. projection: Projection _Tree node. flag: A bitmask of DEFAULT, INNER, PROJECT. Returns: The transformed obj if there was a transform, otherwise the original obj. NTleaf)rPROJECT attributer+r,r _Project)r!objr"flags r_ProjectAttributezProjector._ProjectAttributes d&&& z++ 0D0D0N0N  $ $Z%9%9%C%C D  ! ! + + 4 4S 99 ==j$T= ::rci}t}t|tjr*tj||d<|j dnD |j t |jDcgc]}|js|c}t |D]}|jdr||vr t||}t|dr4|} ||jvrY|j|} | | jjz} | |j j"kr|j%|| | ||<|j'||j j)| ||<|Scc}w#t$rYwxYw#YxYw)a-Converts class object to a dict. Private and callable attributes are omitted in the dict. Args: obj: The class object to convert. projection: Projection _Tree node. flag: A bitmask of DEFAULT, INNER, PROJECT. Returns: The dict representing the class object. datetime)maxmin resolutiontzinfo___call__)r isinstancer7six text_typeupdatedir __class__isupperAttributeError startswithgetattrhasattrtreer1r4rINNERr2r5GetEmpty) r!r3r"r4rexcludeaattrvaluefchild_projections r _ProjectClasszProjector._ProjectClasssu AeG#x(()mmC(a mnn;< 3s}}#5E#5a#5EFC   T"  # a  %??40  ' ' , ,, t%% % --'7;$((0@0@0I0I0KQO$34 H;F    s6"E44E/ E/E4; F/E44 F?FFc|s|Si} tj|tj|D]\}}|}||jvrV|j|}||jj z}||j jkrX|j|||}n+|j||j j|}|3|js'||j jk\s|js ||tj|<|xsdS#t$rYywxYw#t $r |||<Y wxYw)zProjects a dictionary object. Args: obj: A dict. projection: Projection _Tree node. flag: A bitmask of DEFAULT, INNER, PROJECT. Returns: The projected obj. N)r? iteritems ValueErrorrIr1r4rrJr2r5rKrr0rrDecode UnicodeError) r!r3r"r4reskeyvalrQrRs r _ProjectDictzProjector._ProjectDicts9  j C mmCMM#&S a  %??3/  ' ' , ,, t%% % mmC!115$$S$*:*:*C*C*EqI /T55 t'' 'DMM &)#hooc" ##'( ;$-  ( #c( s#D?D. D+*D+.E?EcysgS t} d}t g}d}|j s||j jkry|j D]}|M||j jk\s$|j |jjsB|j |}Rt|tjsm|tt tvs|j|||j jk\r|s|j j}|s|syd}|rdgtz} ndgt!fd|Ddzz} |rttn|D]}|} |  |} ||j vr+|j |} |r| |jjz} n|} | rH| | jjz} | |j j"k\r|j%| | | } nd} | |dkr|tz }||kr|}| | |<|dkry|r| d|dzS| S#t$rtYAwxYw#t$r! tn#t$rYYywxYwYnwxYw)zProjects a list, tuple or set object. Args: obj: A list, tuple or set. projection: Projection _Tree node. flag: A bitmask of DEFAULT, INNER, PROJECT. Returns: The projected obj. Nrc3HK|]}|dkr|tzn|yw)rN)len).0xr3s r z)Projector._ProjectList..Fs%H1!a%!c#h,Q6s")r` TypeErrorsortedlistrrIrr0r1r4r>r? integer_typesr addrKr8rJr2) r!r3r"r4r<indicesslicedindexmaxindexrYr[rQrRs ` r _ProjectListzProjector._ProjectLists {   i  c(a F"gG F ??   (( (??% =d&&...ooe$..33__U+F 1 12uc#hYC11 ++e # t'''((*f 6 H Fc#h cFcHHH1L Mc$*s3x7 Jc  a *// !%??51  v$$ $!"   ' ' , ,,   && & c#3Q7##   S E c%jK8P!| #)3qA 1c1qSk 3i  sR I III II J * I65J 6 J?J JJ  J cjt|}||jvry|nBt|tjst|tj rt|tj rt j|}|jr|jdr|jds$|jdr|jdr |jtj||||St|tt t"fst|tj$rn,t|t&r t jt)|}nt|t*j,r|j.}n|jj1|ddlm}ddl}t|t*j8rt;j<|}nt||j8rdd lm}|j=|}n]t||j8r|j@jC|}n+tE|d r tE|d r|jG|||}|rm|jHra|jHjJrK|jM|jHjJr&|jHjJjO|}nh||jPjRk\s|rM|jTrAtE|d r5tE|d r |jW|||}n |j]|||}|jj_||S|r|S|ja|||S#t$rY"wxYw#tXtZf$rd}YVwxYw#tXtZf$rd}YmwxYw) aEvaluate() helper function. This function takes a resource obj and a preprocessed projection. obj is a dense subtree of the resource schema (some keys values may be missing) and projection is a sparse, possibly improper, subtree of the resource schema. Improper in that it may contain paths that do not exist in the resource schema or object. _Project() traverses both trees simultaneously, guided by the projection tree. When a projection tree path reaches an non-existent obj tree path the projection tree traversal is pruned. When a projection tree path terminates with an existing obj tree path, that obj tree value is projected and the obj tree traversal is pruned. Since resources can be sparse a projection can reference values not present in a particular resource. Because of this the code is lenient on out of bound conditions that would normally be errors. Args: obj: An object. projection: Projection _Tree node. flag: A bitmask of DEFAULT, INNER, PROJECT. leaf: Do not call _ProjectAttribute() if True. Returns: An object containing only the key:values selected by projection, or obj if the projection is None or empty. Nz{"}[]r.r)message) json_format__iter___fieldsitems)1idrr>r?r@ binary_typerrWr rFendswithr2jsonloadsrVboolfloatcomplexrh bytearraybytesprotorpc_messageEnumnamericloudsdk.google.protobufrsprotoMessageprotorpc_encoding MessageToDictrtrCto_dictrHrSr1r+r,r rr0rIr\IOErrorrerndiscardr5) r!r3r"r4r/objidprotobuf_messagerprotobuf_encodings rr2zProjector._Projectus6 sGE )))   C ':c3??+K C )ooc"    .. 3<<#4 .. #,,s"3 tzz# DtL L S40 1 S#++ , C # OOE#J 'c C).. / HHc ##E*F C)11 2--c2 c+33 4M--c2 c5== )mm##C(sJ'73 +B  j$7 --    ( (  " ":#7#7#A#A B"",,55c: T%%-- - Z( 3  ##CT:C ##CT:C ''. j3ID223 DIIg   P9% C  9% C s6'M8N1N8 NNNNN21N2c||_y)z{Sets the projection to list-of-columns mode. Args: enable: Enables projection to a list-of-columns if True. N)rr!enables r SetByColumnszProjector.SetByColumnss Drc||_y)zuSets the ignore default transforms mode. Args: enable: Disable default projection transforms if True. N)rrs rSetIgnoreDefaultTransformsz$Projector.SetIgnoreDefaultTransformss '-D#rc||_y)zSets the projection to retain-none-values mode. Args: enable: Enables projection to a retain-none-values if True. N)rrs rSetRetainNoneValueszProjector.SetRetainNoneValuess &Drc|j|_|jr |js|jrd|_|j j }n|j j}t|dr|j}|j||j j|S|j||j j|j j}|j|j |_g}|jD]}|jr tj ||jn|}|j"j$rK|j'|j"j$r&|j"j$j)||}|j+||S)aSerializes/projects/transforms obj. A default or empty projection expression simply converts a resource object to a JSON-serializable copy of the object. Args: obj: An object. Returns: A JSON-serializeable object containing only the key values selected by the projection. The return value is a deep copy of the object: changes to the input object do not affect the JSON-serializable copy. Fr)rr)rrrrDEFAULTr0rHrr2TreerKrrZr Getr1r+r,r append)r!r3r4obj_serializedcolumnscolumnr[s rr zProjector.Evaluatesv $AAD   4== #( '''' ( )""$ ]]3 0 0 5 5 7 >>]] T   & & ($*:*:*B*BN ))1%)%D%D!DdG--ZZ    ;    # #(@(@    $ $)((11#s; nnS  Nrc|jS)zzReturns the ProjectionSpec object for the projector. Returns: The ProjectionSpec object for the projector. )r)r!s r ProjectionzProjector.Projections   rN)FFF)F)__name__ __module__ __qualname____doc__r'r,r5rSr\rnr2rrrr rrrrrTsS*-2CH42 ?;*7 r&Pm2^_JB-&*XrrcXtj|||t}t|||S)aCompiles a resource projection expression. Args: expression: The resource projection string. defaults: resource_projection_spec.ProjectionSpec defaults. symbols: Transform function symbol table dict indexed by function name. by_columns: Project to a list of columns if True. retain_none_values: Retain dict entries with None values. Returns: A Projector containing the compiled expression ready for Evaluate(). )defaultssymbolscompiler)r#r%)rParser r) expressionrrr#r%r"s rr r #s2*//8WwH* :*&8 ::rc(eZdZdZfdZdZxZS)IdentityProjectorz>A no-op resource projector that preserves the original object.cPtt| tjyN)superrr'rr)r!rCs rr'zIdentityProjector.__init__:s T+,F,L,L,NOrc|Srr)r!r3s rr zIdentityProjector.Evaluate=s Jr)rrrrr'r __classcell__)rCs@rrr7sFPrr)NNFF)r __future__rrrr7r{apitools.base.protorpcliterrapitools.base.pyrrgooglecloudsdk.core.resourcerr googlecloudsdk.core.utilr? six.movesr robjectrr rrrrrs` #J'' C:C:-  &LL^DI$:( r