!dZddlmZddlmZddlmZddlmZddlmZddlm Z ddl m Z dd l m Z dd l mZdd lmZdd lmZdd lmZddlZdZGdde j.ZGdde j.ZdZdZdZdZy)z8General BQ surface command utilites for python commands.)absolute_import)division)print_function)unicode_literals)encoding)waiter) exceptions) arg_utils) yaml_data) resource_args)concept_parsers)yamlNic,eZdZdZefdZdZdZdZy) BqJobPollerzPoller for managing Bq Jobs.c.||_||_||_y)aSets up poller for BigQuery Jobs. Args: job_service: apitools.base.py.base_api.BaseApiService, api service for retrieving information about ongoing job. result_service: apitools.base.py.base_api.BaseApiService, api service for retrieving created result of initiated operation. max_query_results: maximum number of records to return from a query job. N)result_service job_servicemax_query_results)selfrrrs 2lib/googlecloudsdk/command_lib/bq/command_utils.py__init__zBqJobPoller.__init__'s)D"D.Dc|jjdk(rJ|jjr3tj|jjj yy) Overrides.DONETF)statusstate errorResultrOperationErrormessage)rjobs rIsDonezBqJobPoller.IsDone:sH zz6!   ##CJJ$:$:$B$BCC  rc|jjd}|jj||j|j jS)zzOverrides. Args: job_ref: googlecloudsdk.core.resources.Resource. Returns: fetched job message. Get)jobId projectId)rGetRequestTyper$NameParent)rjob_ref request_types rPollzBqJobPoller.PollBsS##2259L     7<<>W^^5E5J5J5LM rc|jjd}|jj}|dk(rJ|jjj }||j |j|j}n|dk(rJ|jjj }||j |j|j}nz|dk(rs|jjd}||jj|j|jj}|jj|S|S|jj|S)zOverrides to get the response from the completed job by job type. Args: job: api_name_messages.Job. Returns: the 'response' field of the job. r$COPY) datasetIdtableIdr&LOADQUERYGetQueryResults)r% maxResultsr&)rr' configurationjobTypecopydestinationTabler/r0r&load jobReferencer%rr3r$)rr!r+job_type result_tablerequests r GetResultzBqJobPoller.GetResultPs<&&55errrr$s$ 2 /& %,rrc(eZdZdZdZdZdZdZy)BqMigrationWorkflowPollerz1Poller for managing BigQuery Migration Workflows.c||_y)zSets up poller for generic long running processes. Args: migration_service: apitools.base.py.base_api.BaseApiService, api service for retrieving information about migration workflows. N)migration_service)rrHs rrz"BqMigrationWorkflowPoller.__init__{s /Drc2t|jdk(S)r COMPLETED)strr)rmigration_workflows rr"z BqMigrationWorkflowPoller.IsDones !'' (K 77rc|jjd}||j}|jj|}|S)zOverrides. Args: migration_workflow_ref: googlecloudsdk.core.resources.Resource. Returns: fetched migration workflow message. r$name)rHr' RelativeNamer$)rmigration_workflow_refr+r=ress rr,zBqMigrationWorkflowPoller.PollsI))88?L 6 C C EFG  $ $W -C Jrc|jjd}||j}|jj|S)zOverrides to get the response from the completed job by job type. Args: migration_workflow: api_name_messages.MigrationWorkflow. Returns: the 'response' field of the Operation. r$rN)rHr'rOr$)rrLr+r=s rr>z#BqMigrationWorkflowPoller.GetResultsB))88?L 2 7 78G  ! ! % %g ..rN)r?r@rArBrr"r,r>rDrrrFrFxs9 /8  /rrFc  tj|}t|ts$tjdj | tj||}|S#tj$r=}tjdj |t j|d}~wtj$r=}tjdj |t j|d}~wwxYw#t$r=}tjdj |t j|d}~wwxYw)z7Returns the resource message and update fields in file.z File [{0}] cannot be parsed. {1}Nz(File [{0}] cannot be opened or read. {1}z9File [{0}] is not a properly formatted YAML or JSON file.z=File [{0}] is not a properly formatted YAML or JSON file. {1})r load_pathYAMLParseErrorr BadFileExceptionformatsix text_type FileLoadError isinstancedictrPyValueToMessageAttributeError) file_pathresource_message_typeresource_to_parseeresources rGetResourceFromFileres- y1 %t ,  % %CJJ    ((0H /;     % %*11)S]]1=MN      % %299 s}}Q'  $   % %GNN s}}Q'  s;A$ D$D78B//D8C==D E 8EE cj~|jr%d|jjj_|S)z*Process the overwrite flag on tables copy.WRITE_TRUNCATE) overwriter!r5r7writeDisposition)refargsr=s rProcessTableCopyOverwriterls)  ^^6FGKK""3 .rc|~|jjj}|jjj}t j |d|j jt j |d|jt j |d|jt j |d|j jt j |d|jt j |d|j|S)z;Build JobConfigurationTableCopy from request resource args.z1job.configuration.copy.destinationTable.datasetIdz1job.configuration.copy.destinationTable.projectIdz/job.configuration.copy.destinationTable.tableIdz,job.configuration.copy.sourceTable.datasetIdz,job.configuration.copy.sourceTable.projectIdz*job.configuration.copy.sourceTable.tableId) CONCEPTSsourceParse destinationr SetFieldInMessager)r(r&)rjrkr= source_refdestination_refs rProcessTableCopyConfigurationrus }}##))+*MM--335/  9##%   9   7   4    4   ;Z__=N .rc ,tjjd}tjddddddid|j tjdd dddd id|j g}d gd gd }t j||gS) z?Get Table resource args (source, destination) for copy command.zbq.tablez to copy fromroTtableF)verbrOrequiredprefixesattribute_overrides positional resource_dataz to copy torq--destination.dataset--source.dataset)rr~)r ResourceYAMLDataFromPathr GetResourcePresentationSpecGetDatar ConceptParser)table_spec_data arg_specs fallthroughss rGetTableCopyResourceArgsrs..77 C///&1'//1//& 6'//1)*33 23,  ' ' < @ AAr)rB __future__rrrrapitools.base.pyrgooglecloudsdk.api_lib.utilrgooglecloudsdk.callioper $googlecloudsdk.command_lib.util.apisr r $googlecloudsdk.command_lib.util.argsr (googlecloudsdk.command_lib.util.conceptsr googlecloudsdk.corerrYrCOperationPollerrrFrerlrurrDrrrsx?&%'%..::>D$ !Q,&((Q,h,/ 6 6,/^!H!JBr