dZddlmZddlmZddlmZddlZddlmZddlm Z ddl Z dZ d Z d Z d Zdd Zd ZdZdZy)z.Utilities for interacting with streaming logs.)absolute_import)division)unicode_literalsN)encoding)streamzTvalue(severity,timestamp.date("%Y-%m-%d %H:%M:%S %z",tz="LOCAL"), task_name,message) ctjt|||t|}t |j |S)aReturns the streaming log of the job by id. Args: name: string id of the entity. continue_function: One-arg function that takes in the number of empty polls and outputs a boolean to decide if we should keep polling or not. If not given, keep polling indefinitely. polling_interval: amount of time to sleep between each poll. task_name: String name of task. allow_multiline: Tells us if logs with multiline messages are okay or not. ) task_name)filterspolling_intervalcontinue_interval continue_func)r LogFetcher _LogFilters_CONTINUE_INTERVAL_SplitMultiline YieldLogs)namecontinue_functionr r allow_multiline log_fetchers -lib/googlecloudsdk/command_lib/ai/log_util.py StreamLogsr$s?!!$)4'*% '+ ..0/ BBcpddj|g}|r |jdj||S)zReturns filters for log fetcher to use. Args: name: string id of the entity. task_name: String name of task. Returns: A list of filters to be passed to the logging API. zresource.type="ml_job"zresource.labels.job_id="{0}"zresource.labels.task_name="{0}")formatappend)rr r s rrr9s> > E Ed K ' NN4;;IFG .rc#K|D]Q}t|}|dj}|r|(|sdg}|D] }tj|}||d<|"Syw)aSplits the dict output of logs into multiple lines. Args: log_generator: iterator that returns a an ml log in dict format. allow_multiline: Tells us if logs with multiline messages are okay or not. Yields: Single-line ml log dictionaries. messageN) _EntryToDict splitlinescopydeepcopy) log_generatorrloglog_dictmessagesrsingle_line_logs rrrKsicC H "--/H n 4'--1%, "sAAci}|jr|jjnd|d<|j|d<t||d<g}|j3t |j}d|vrT|drO|j |dn:|j.|j tj|jdj||d<|S)z%Converts a log entry to a dictionary.DEFAULTseverity timestampr rr ) r,rr- _GetTaskName jsonPayload_ToDictr textPayloadsix text_typejoin) log_entryoutputr json_datas rr!r!cs &/8/A/AI&&++y !++&$Y/& '& --.II 9 y+,( NN3==!6!678ggg&& -rc|jsint|jj}|jdsdS|dS)z2Reads the label attributes of the given log entry.r unknown_task)resourcer0labelsget)r5resource_labelss rr.r.xsJ'00Bg7!/.22 5' 45rcX|siSt|tr|Stj|S)N) isinstancedictr MessageToDict)rs rr0r0s*  I N  ! !' **r)F)__doc__ __future__rrrr#apitools.base.pyrgooglecloudsdk.command_lib.logsrr2 LOG_FORMATrrrrr!r.r0rrrHsM5&' %2  C*$0*5+r