6,rdZddlmZddlmZddlmZddlmZddlmZddlmZddl m Z dd l m Z dd l mZd Z d-d ZdZdZdZdZdZdZdZdZd.dZd/dZd.dZd.dZd.dZd.dZd.dZd.dZ d.dZ!d.dZ"d.d Z#d.d!Z$d.d"Z%d.d#Z&d.d$Z'd.d%Z(d.d&Z)d.d'Z*d.d(Z+d.d)Z,d.d*Z-d.d+Z.d.d,Z/y )0z3Flags and helpers for the compute related commands.)absolute_import)division)unicode_literals)actions) arg_parsers)base)concepts)concept_parsers) propertiesc0tjddS)Nregionz$The Cloud region for the {resource}.name help_textr ResourceParameterAttributeConfig5lib/googlecloudsdk/command_lib/datapipelines/flags.pyRegionAttributeConfigrs  2 2 E GGrNcfd}xsdtjjdj|rdnd||S)z6Constructs and returns the Pipeline Resource Argument.c|fd}tjdd|ttjdS)z?Constructs and returns the Resource specification for Pipeline.c2tjS)Nrr)arg_namersrPipelineAttributeConfigzXGetPipelineResourceArg..GetPipelineResourceSpec..PipelineAttributeConfig+s  6 69..rz*datapipelines.projects.locations.pipelinespipelineF) resource_name pipelinesId locationsId projectsIddisable_auto_completers)r ResourceSpecr DEFAULT_PROJECT_ATTRIBUTE_CONFIG)rrrs rGetPipelineResourceSpecz7GetPipelineResourceArg..GetPipelineResourceSpec(s;.  4 +-)+<< %  ''rz%Name for the Data Pipelines Pipeline.z{}{}z--required)r ConceptParser ForResourceformat)rr positionalr'r$s`` rGetPipelineResourceArgr,"sQ 'BB)  & & 2 2 mm*B$9 3 rc6tj|yNr, AddToParserparsers rAddCreatePipelineFlagsr3@&&v.rc6tj|yr.r/r1s rAddUpdatePipelineFlagsr6Dr4rc6tj|yr.r/r1s rAddDescribePipelineFlagsr8Hr4rc6tj|yr.r/r1s rAddDeletePipelineFlagsr:Lr4rc6tj|yr.r/r1s rAddStopPipelineFlagsr<Pr4rc6tj|yr.r/r1s rAddRunPipelineFlagsr>Tr4rc:tdj|y)NF)r+r/r1s rAddListJobsFlagsr@XsE*66v>rctjddttj}tj j d|dj|dj|y) zAdd a resource argument for a Vertex AI region. NOTE: Must be used only if it's the only resource arg in the command. Args: parser: the parser for the command. verb: str, the verb to describe the resource, such as 'to update'. z datapipelines.projects.locationsr )rrr z--regionzCloud region {}.Tr&N) r r"rr#r r(r)r*r0)r2verbregion_resource_specs rAddRegionResourceArgrD\sh"..('):: < ++% ,![(rcRtjd|dj|S)Nz--display-namezDisplay name of the {noun}.)noun)r'help)rArgumentr*)rFr's rGetDisplayNameArgrIrs*  ( / /T / : <ddd}tjd||dS)NzSpecifies a Batch pipeline.zSpecifies a Streaming pipeline.)batch streamingz--pipeline-typez4Type of the pipeline. One of 'BATCH' or 'STREAMING'.)choicesr'help_strrChoiceArgumentr'rMs rGetPipelineTypeArgrRys2,4 '   I  KKrc@ddd}tjd||ddS)NzSpecifies a Flex template.zSpecifies a Classic template)flexclassicz--template-typeFLEXzKType of the template. Defaults to flex template. One of 'FLEX' or 'CLASSIC')rMr'defaultrNrOrQs rGetTemplateTypeArgrXs3*/ '   `  rc4tjd|ddS)Nz --schedulez?Unix-cron format of the schedule for scheduling recurrent jobs.r'rWrGrrHr&s rGetScheduleArgr\s  P  rc4tjd|ddS)Nz --time-zonezKTimezone ID. This matches the timezone IDs used by the Cloud Scheduler API.rZr[r&s rGetTimeZoneArgr^s  \  rc ^tjd|dtjdddS)Nz--template-file-gcs-location^gs://.*Must begin with 'gs://'zMLocation of the template file or container spec file in Google Cloud Storage.r'rWtyperGrrHrRegexpValidatorr&s rGetTemplateFileGcsLocationArgrfs3 $  & &{'B D ^  rc ztjd|ddtjtjdS)Nz --parameters PARAMETERSz)User defined parameters for the template.r'rWmetavarrcactionrGrrHrArgDict UpdateActionr&s rGetParametersArgros7      % % : <tjd|dtdS)Nz --max-workerszHMaximum number of workers to run by default. Must be between 1 and 1000.rbrrHintr&s rGetMaxWorkersArgrss"   Y  rc>tjd|dtdS)Nz --num-workerszInitial number of workers to run by default. Must be between 1 and 1000. If not specified here, defaults to server-specified value.rbrqr&s rGetNumWorkersArgrus%   U  rc4tjd|ddS)Nz --networkzDefault Compute Engine network for launching instances to run your pipeline. If not specified here, defaults to the network 'default'.rZr[r&s r GetNetworkArgrws"  X  rc4tjd|ddS)Nz --subnetworkzODefault Compute Engine subnetwork for launching instances to run your pipeline.rZr[r&s rGetSubnetworkArgrys  `  rc4tjd|ddS)Nz--worker-machine-typezfDefault type of machine to use for workers. If not specified here, defaults to server-specified value.rZr[r&s rGetWorkerMachineTypeArgr{s  w  rc ^tjd|dtjdddS)Nz--temp-locationr`razDefault Google Cloud Storage location to stage temporary files. If not set, defaults to the value for staging-location (Must be a URL beginning with 'gs://'.)rbrdr&s rGetTempLocationArgr}s6   & &{'B D p  rc4tjd|ddS)Nz--dataflow-kms-keyz`Default Cloud KMS key to protect the job resources. The key must be in same location as the job.rZr[r&s rGetDataflowKmsKeyArgrs  q  rctjd|dtjtj j jdS)Nz--disable-public-ipszRSpecifies that Cloud Dataflow workers must not use public IP addresses by default.r'rWrkrG)rrHrStoreBooleanPropertyr VALUES datapipelinesdisable_public_ipsr&s rGetDisablePublicIpsArgrsB   ) )    ) ) < <> c  rc4tjd|ddS)Nz --dataflow-service-account-emailz7Default service account to run the dataflow workers as.rZr[r&s r!GetDataflowServiceAccountEmailArgr s! ( H  JJrc4tjd|ddS)Nz!--scheduler-service-account-emailzKDefault service account used by the Cloud Scheduler job for launching jobs.rZr[r&s r"GetSchedulerServiceAccountEmailArgrs! ) \  ^^rctjd|dtjtj j jdS)Nz--enable-streaming-enginez@Specifies that enabling Streaming Engine for the job by default.r)rrHrrr rrenable_streaming_enginer&s rGetEnableStreamingEngineArgrsC !  ) )    ) ) A AC Q  rc ztjd|ddtjtjdS)Nz--additional-experimentsADDITIONAL_EXPERIMENTSz%Default experiment flags for the job.ri)rrHrArgListrnr&s rGetAdditionalExperimentsArgr$s7  &     % % 6 88rc ztjd|ddtjtjdS)Nz--additional-user-labelsADDITIONAL_USER_LABELSzDefault user labels to be specified for the job. Keys and values must follow the restrictions specified in https://cloud.google.com/compute/docs/labeling-resources#restrictions.rirlr&s rGetAdditionalUserLabelsArgr/s:  &     % % C rctj|d}|jtjd|dd|jtjd|dd|S) 3Defines the Streaming Update Args for the Pipeline.T)r'mutexz--worker-regionNzDDefault Compute Engine region in which worker processing will occur.rZz --worker-zonezBDefault Compute Engine zone in which worker processing will occur.)r ArgumentGroup AddArgumentrH)r'worker_region_argss rGetWorkerRegionArgsr;sk))84H   mm Y     mm W   rc:tjd|ddddgS)Nz --flexrs-goalz&FlexRS goal for the flex template job.COST_OPTIMIZEDSPEED_OPTIMIZED)r'rWrGrMr[r&s rGetFlexRsGoalArgrOs(  7!23  55rc 4tj|}|jtjd|tj d|jtjd|ddt j tjd |S) rr&z--updatez+Set this to true for streaming update jobs.)r'rkrGz--transform-name-mappingsNTRANSFORM_NAME_MAPPINGSz5Transform name mappings for the streaming update job.ri)rrrrHrStoreTrueFalseActionrmrn)r'streaming_update_argss rGetStreamingUpdateArgsrXs,,h?## mm 11@ BC ## mm %+""$))JLM r)rNTT)F)T)0__doc__ __future__rrrgooglecloudsdk.callioperrr googlecloudsdk.calliope.conceptsr (googlecloudsdk.command_lib.util.conceptsr googlecloudsdk.corer rr,r3r6r8r:r<r>r@rDrIrRrXr\r^rfrorsrurwryr{r}rrrrrrrrrrrrrrs:&'+/(5D*G %/%)&*$(<//////?),< K <J^8 (5r