"dZddlmZddlmZddlmZddlmZddlZGddeZ d Z d Z d Z d Z dd ZdZddZdZddZy)zLCode to transform the (cleaned-up) description of a dataflow into Graphviz. )absolute_import)division)unicode_literals) exceptionsNcHeZdZdZdZdZdZdZdZdZ d d Z d Z d Z y) _ClusteraEncapsulation of a single cluster in the final Step-Graph. The cluster hierarchy represents pieces of the user_name. A given cluster is either a leaf (it contains a single step and no sub-clusters) or a transform (it contains no step and one or more sub-clusters). c<i|_||_||_d|_yN)_Cluster__children_Cluster__parent_Cluster__name_in_parent_Cluster__step)selfparentname_in_parents 1lib/googlecloudsdk/api_lib/dataflow/step_graph.py__init__z_Cluster.__init__"sDODM*DDKc|j S)zbA leaf cluster contains no sub-clusters. Returns: True iff this is a leaf cluster. )r rs rIsLeafz_Cluster.IsLeaf(s  rc2t|jdk(S)zwA singleton is any cluster that contains a single child. Returns: True iff this is a singleton cluster. )lenr rs r IsSingletonz_Cluster.IsSingleton0s t 1 $$rc|j S)zbDetermine if this cluster is the root. Returns: True iff this is the root cluster. )r rs rIsRootz_Cluster.IsRoot8s }} rc|jS)zxReturn the step for this cluster. Returns: The step for this cluster. May be None if this is not a leaf. )rrs rGetStepz_Cluster.GetStep@s ;;rcJ|jrJ|jrJ||_y)zSet the step for this cluster. Can only be called on leaf nodes that have not yet had their step set. Args: step: The step that this cluster represents. N)r r)rsteps rSetStepz_Cluster.SetStepHs$ {{?DKrNc|jr|j|k(r |jS|jj|}|r|dz|jzS|jS)zReturn the name of this sub-cluster relative to the given ancestor. Args: relative_to: The ancestor to output the name relative to. Returns: The string representing the user_name component for this cluster. /)r r Name)r relative_to parent_names rr%z _Cluster.NameTs[ MMt}} ;  " ""--$$[1K 3 !6!6 66  " ""rc|jrJ||jvrt|||j|<|j|S)zReturn the cluster representing the given piece_name within this cluster. Args: piece_name: String representing the piece name of the desired child. Returns: Cluster representing the child. )rr r)r piece_names r GetOrAddChildz_Cluster.GetOrAddChildfs@{{?($,T:$>dooj! ??: &&rcRttj|jS)zhReturn the sub-clusters. Returns: Sorted list of pairs for the children in this cluster. )sortedsix iteritemsr rs rChildrenz_Cluster.Childrenss #--0 11rr ) __name__ __module__ __qualname____doc__rrrrrr"r%r*r/rrrrs4 % #$ '2rrcJd}g}g}|jdD]u}||jd|jdz z }|j||dk(r&|jdj||dd=e|jdw|r|j||S)aQGiven a user name for a step, split it into the individual pieces. Examples: _SplitStep('Transform/Step') = ['Transform', 'Step'] _SplitStep('Read(gs://Foo)/Bar') = ['Read(gs://Foo)', 'Bar'] Args: user_name: The full user_name of the step. Returns: A list representing the individual pieces of the step name. rr$()N)splitcountappendjoin) user_nameparensaccum step_partspieces r _SplitSteprB|s & %*s#e ekk#S!111F LL {' ( ll3$ e rctdd}|D]N}t|djd|d}|}|D]}|j|}|j |P|S)aExtract a hierarchy from the steps provided. The `step graph' is constructed as follows: 1. Every node has a `name'. This is flat, something like "s1", "s100". 2. Each node can depend on others. These edges are specified by "name". 3. Each node can also have a user_name, like "Foo/Bar". This name creates a hierarchy of subgraphs (eg., Foo/Bar and Foo/Baz are in the same cluster). Args: steps: A list of steps from the Job message. Returns: A Cluster representing the root of the step hierarchy. Nr8 propertiesr=name)rrBgetr*r")stepsrootr! step_pathnoderAs r_UnflattenStepsToClustersrKsl $ $d4 -11+tF|LMI D    &dLL  +rc|jdr$tjdj|dj|j ddS)aEscape a string for use as in Graphviz. Args: name: The string to escape. Returns: The `name', with double-quotes escaped, and quotes around it. Raises: exceptions.UnsupportedNameException: If the name is incompatible with Graphviz ID escaping. \z0Unsupported name for Graphviz ID escaping: {0!r}z"{0}""z\")endswithrUnsupportedNameExceptionformatreplace)rEs r_EscapeGraphvizIdrSsM ]]4  - -:AA$G II  S%0 11rzO{name} [label={user_name}, tooltip={full_name}, style=filled, fillcolor=white];c #K|jrg|j}tjt |dt |j t |j |y|j s|jr/|jD]\}}t||D]}|y|j }djt d|zddd d jt |d jt |j ||jD]\}}t||D]}|d yw) NrE)r&)rE full_namer=)rzsubgraph {0} {{zcluster z style=filled;zbgcolor=white;zlabeljust=left;z tooltip={0};z label={0};}) rr _NODE_FORMATrQrSr%rrr/_YieldGraphvizClusters)clusterrr! unused_key subclusterlinerUsubgroups rrXrXsQ ^^ ?? D    tF| ,#GLLN3#GLLVL$DE  GG 0")"2"2"4 J(FC$ D#5 I  " "#4Z)5K#L MM       1) < ==   / V0DE FF ' 0 0 2 H('B$ C!3 IsEzF{edge_source} -> {edge_dest} [taillabel={edge_output}, style={style}];cvtjt|dt|t|d|S)a;Returns an edge from the output referred to by output_ref to step_name. Args: step_name: String identifying the step with the dependency. output_ref: Output-reference dictionary to start the edge at. style: The style for the edge. Returns: A string representing the edge in Graphviz format. step_name output_name) edge_source edge_dest edge_outputstyle) _EDGE_FORMATrQrS)r_ output_refrds r _GraphvizEdgergsA   #J{$;<!),#J}$=>   rc# K|d}|djdd}|rt|||djdgD]}t|||djdijD]}t||dyw) zOutput Graphviz edges for the given step. Args: step: Step to write edges for. Yields: The Graphviz edge lines for the given step. rErDparallel_inputNinputsnon_parallel_inputsdashed)rd)rFrgvalues)r!r_ par_input other_input side_inputs r_YieldGraphvizEdgesrqs6l)< $$%5t<)  9 --,'++Hb9k  ; //:&**+@"ELLNj  :X >>OsB Bc#Kdjt|xsdt|}t|D]}|d|D]}t |D]}|dyw)aGiven a root cluster produce the Graphviz DOT format. No attempt is made to produce `pretty' output. Args: steps: A list of steps from the Job message. graph_name: The name of the graph to output. Yields: The lines representing the step-graph in Graphviz format. zstrict digraph {graph_name} {{G) graph_namer8rVN)rQrSrKrXrq)rGrtrHr\r!s r YieldGraphvizrusy )//":#45 0 77 #5 )$$T*d J+ (d#D) j* )sA%A'r )solid)r3 __future__rrrgooglecloudsdk.api_lib.dataflowrr-objectrrBrKrSrWrXrergrqrur4rrrzs^''6 _2v_2D>42(( 2< $?, r