DdZddlmZddlmZddlmZddlZddlmZddlmZddl m Z dd l m Z dd l m Z dd l mZdd lmZGd de j"Zy)z8Implementation of gcloud dataflow metrics list command. )absolute_import)division)unicode_literalsN)apis) exceptions) arg_parsers)base) dataflow_util) job_utils)timescReZdZdZdZdZedZdZdZ dZ dZ d Z d Z d Zy ) ListaRetrieves the metrics from a specific job. This command can be used to explore the job's metrics at a fine-grained level. ## EXAMPLES Filter metrics with the given name: $ {command} JOB --filter="name=ElementCount" Filter child metrics with matching transforms: $ {command} JOB --transform=WordCount Filter child output metrics: $ {command} JOB --transform=WordCount/Write.*out Filter all output metrics: $ {command} JOB --transform=.*out Filter all custom-defined user metrics $ {command} JOB --source=user Filter metrics with a scalar value greater than a threshold. $ {command} JOB --filter="scalar > 50" List metrics that have changed in the last 2 weeks: $ {command} JOB --changed-after=-P2W userservicectj|tjj |tj j |tj j ||jdtjjd|jdddd|jd d |jd d ddddd|jddddy)z Register flags for this command.z--changed-afterzOnly display metrics that have changed after the given time. See $ gcloud topic datetimes for information on time formats. For example, `2018-01-01` is the first day of the year, and `-P2W` is 2 weeks ago.)typehelpz--hide-committedF store_truezIf true, hide committed values.)defaultactionrz --transformz;Filters only the metrics that prefix match the given regex.)rz--sourcezRetrieves all metrics.z(Retrieves only dataflow service metrics.z#Retrieves only custom user metrics.)allrrrzSet the metrics source.)choicesrrz --tentativez"If true, display tentative values.N) r ArgsForJobRefr PAGE_SIZE_FLAGRemoveFromParser SORT_BY_FLAGURI_FLAG add_argumentrDatetimeParse)parsers $lib/surface/dataflow/metrics/list.pyArgsz List.ArgsHsF#((0&&v.MM""6*   ! ! ' '')  . 0   JL +A9  &(  1 3c Ztj}jxrtjj}g}j s!j rtjdj s!j s|jfdn,j r j r|jfd|jfd|jfdjr|jfdtjj|j|j|j|}|j Dcgc]2}t#|Dcgc] }|| c}rj%|4c}}Scc}wcc}}w)a)This is what gets called when the user runs this command. Args: args: all the arguments that were provided to this command invocation. Returns: List of metric values. Raises: exceptions.InvalidExclusionException: If the excluded metrics are not valid. z4Cannot exclude both tentative and committed metrics.c.j|ddk7SN tentativetrue_GetContextValuemselfs r"zList.Run..T221kBfLr$c.j|ddk(Sr'r*r,s r"r/zList.Run..r0r$c<j|jSN)_FilterBySourcesourcer-argsr.s r"r/zList.Run..s4//4;;?r$c<j|jSr3)_FilterByTransform transformr6s r"r/zList.Run..s4221dnnEr$c\tj|jjkDSr3)r ParseDateTime updateTime changed_after)r-r7s r"r/zList.Run..sE'' 58J8JJr$) project_id region_id start_time)r ExtractJobRefr>r FormatDateTimer(hide_committedrInvalidExclusionExceptionappendrMetricsGetjobId projectIdlocationmetricsr_Format)r.r7job_refrApredsresponser-preds`` r"RunzList.RunosW%%d+G##P(<(>d11  0 0 @ BB ^^D$7$7 llLM D// llLM LL?@ LLEF  ll JL|| $$""  H &.%5%5 1%5.DG./ LLO%5 11. 1s'F'5F"F'"F'c:tjj|jjsytj j|jjsy|j jdk(xs|j jdk(S)zThis returns true if the metric is a watermark with a sentinel value. Args: metric: A single UpdateMetric returned from the API. Returns: True if the metric is a sentinel value, false otherwise. F)r DATAFLOW_METRICS_REmatchnameoriginWINDMILL_WATERMARK_REscalar integer_valuer.metrics r"_IsSentinelWatermarkzList._IsSentinelWatermarkst  , , 2 26;;3E3E F   . . 4 4V[[5E5E F  MM ' '2 - . MM ' '2 -/r$c<|jj}|dk(ryy)aThis method gets the description of the watermark sentinel value. There are only two watermark sentinel values we care about, -1 represents a watermark at kInt64Min. -2 represents a watermark at kInt64Max. This runs on the assumption that _IsSentinelWatermark was called first. Args: metric: A single UpdateMetric returned from the API. Returns: The sentinel description. rTzUnknown watermarkz Max watermark)r[r\)r.r^values r" _GetWatermarkSentinelDescriptionz%List._GetWatermarkSentinelDescriptions  MM ' 'E { r$c|j|r;|j||j_|jj d|S)zPerforms extra formatting for sentinel values or otherwise. Args: metric: A single UpdateMetric returned from the API. Returns: The formatted metric. r\)r_rbr[ string_valueresetr]s r"rMz List._Formats@   (#'#H#H#Pfmm  mm/* Mr$c|j|dxsd}|j|dxsd}tj|xsd}|j|s|j|ryy)Noutput_user_namestepTF)r+recompilerW)r.r^r:rgris r"r9zList._FilterByTransformsb,,V5GHNB   0 6BD 9?+I'(IOOD,A  r$c||jk(r|jjdk(S||jk(r|jjdk(Sy)Nrz dataflow/v1b3T) USER_SOURCErXrYSERVICE_SOURCE)r.r^r5s r"r4zList._FilterBySourcesK !!! [[  6 )) 4&& & [[  ? 22 r$c|jjrB|jjjD]}|j|k(s|jcSyr3)rXcontextadditionalPropertieskeyra)r.r^rrprops r"r+zList._GetContextValuesC {{++%%::$ 88s? ; r$N)__name__ __module__ __qualname____doc__rmrn staticmethodr#rRr_rbrMr9r4r+r$r"rr!sK!F+.$3$3L(1T/$" r$r)rw __future__rrrrjgooglecloudsdk.api_lib.dataflowrrgooglecloudsdk.callioperr #googlecloudsdk.command_lib.dataflowr r googlecloudsdk.core.utilr ListCommandrryr$r"rsA'' 06/(=9*|4  |r$