ldZddlmZddlmZddlmZddlZedgZddd Zd Z d Z d Z d Z y)aCode to clean-up transform the JSON description of a dataflow. Example clean-ups: 1. Dictionaries representing primitives with a schema will be converted to the primitive: Ex: { '@type': "https://schema.org/Text", 'value': "Hello" } becomes "Hello" 2. Fields that are unlikely to be human consumable may be hidden. Ex: The serialized_fn field will be hidden, since humans are unlikely to try to read the serialized Java object. )absolute_import)division)unicode_literalsN serialized_fnc|jSN) boolean_valuevalues 0lib/googlecloudsdk/api_lib/dataflow/step_json.pyr #s u/B/Bc|jSr) string_valuer s r r r $s E,>,>r)zhttp://schema.org/Booleanzhttp://schema.org/Textci}|jrP|jjD]7}|jtvst |j ||j<9|j |j|dS)zConverts a Step message into a dict with more sensible structure. Args: step_msg: A Step message. Returns: A dict with the cleaned up information. )kindname properties)radditionalPropertieskey_EXCLUDED_PROPERTIES _ExtractValuer rr)step_msgrprops r _ExtractStepr(si* ##88 - -,TZZ8 4889 mmmm rci}|jjD]}|j||j<|j dd}|xr t j |j d}|r|s%tdtj|DS ||dS#t$rdj|j |cYSwxYw)aExtracts an object from the proto representation of the JSON object. Args: proto: A protocol representation of a JSON object. Returns: A clean representation of the JSON object. If it was an object representing a primitive, then that primitive. z@typeNc3<K|]\}}|t|fywr)r).0kvs r z*_ExtractDecoratedObject..Rs!K2J$!QM!$%2Jsr z+Missing value for type [{0}] in proto [{1}]) object_valuerr rget_VALUE_RETRIEVERSrdictsix iteritemsKeyErrorformat)proto prop_dictrty retrievers r _ExtractDecoratedObjectr.=s)  ++d**Idhh,}}Wd#"A&**2??DA) 9 K#-- 2JK KK  Yw' ((  8 ? ?    s B""%C  C c|jr t|S|jr-|jjDcgc] }t |c}S|j r |j Sdj |Scc}w)NzNo decoding provided for: {0})r"r. array_valueentriesrrr))r*r s r rr^su  "5 )) &+&7&7&?&? @&?M! &? @@     ( / / 66 AsA:cR|jDcgc] }t|c}Scc}w)zExtract the cleaned up step dictionary for all the steps in the job. Args: job: A Job message. Returns: A list of cleaned up step dictionaries. )stepsr)jobsteps r ExtractStepsr6ls%*- 3,t  33 3s$) __doc__ __future__rrrr&setrr$rr.rr6rr r;sL '' O,-"C> * B 74r