5FdZddlmZddlmZddlmZddlmZddlmZddl m Z ddl m Z d Z Gd d e jZGd d e jZGdde jZdZdZdZdZdZdZdZdZdZdZdZdZdZd"dZdZ d Z!d!Z"y)#z,Utilities for Data Catalog crawler commands.)absolute_import)division)unicode_literals)crawlers) arg_utils)repeated) exceptionsv1alpha3ceZdZdZy)InvalidCrawlScopeErrorz"Error if a crawl scope is invalid.N__name__ __module__ __qualname____doc__B=c~|jdr|jdk7r td|jds|jdk(r td|S)a8Validates scope flags for create. Args: ref: The crawler resource reference. args: The parsed args namespace. request: The create request. Returns: The request, if the crawl scope configuration is valid. Raises: InvalidCrawlScopeError: If the crawl scope configuration is not valid. bucketsbucketz}Argument `--buckets` is only valid for bucket-scoped crawlers. Use `--crawl-scope=bucket` to specify a bucket-scoped crawler.zLArgument `--buckets` must be provided when creating a bucket-scoped crawler.)r0 crawl_scoper r#r$r%s rValidateScopeFlagsForCreater;hsm  i T%5%5%A  I JJ   ) $)9)9X)E    .rc~t|}|rO|jdk7r@|jds$|jjj t d|s|jdk(r t d|S)anValidates scope flags for update. Args: ref: The crawler resource reference. args: The parsed args namespace. request: The update request. crawler: CachedResult, The cached crawler result. Returns: The request, if the crawl scope configuration is valid. Raises: InvalidCrawlScopeError: If the crawl scope configuration is not valid. r8r9zArguments `--add-buckets`, `--remove-buckets`, and `--clear-buckets` are only valid for bucket-scoped crawlers. Use `--crawl-scope=bucket` to specify a bucket-scoped crawler.z_Must provide buckets to add or remove when updating the crawl scope of a bucket-scoped crawler.)_IsChangeBucketsSpecifiedr9r0rr. bucketScoper )r#r$r%r'change_bucketss rrrs ,T2.))X5  &{{}''/  . // D,,8  & '' .rcr~g}|jdr|jd|jdr|jdt|r|jd|jdk(r|jdn=|jdk(r|jdnt |r|jd |j d k(r|jd n1|j d k(s|jd r|jd|s t ddj||_|S)aKPython hook that computes the update mask for a patch request. Args: ref: The crawler resource reference. args: The parsed args namespace. request: The update crawler request. Returns: Request with update mask set appropriately. Raises: NoFieldsSpecifiedError: If no fields were provided for updating. description display_name displayNamezconfig.bundleSpecsprojectzconfig.projectScope organizationzconfig.organizationScopezconfig.bucketScopemanualzconfig.adHocRun scheduled run_schedulezconfig.scheduledRunz.Must specify at least one parameter to update.,) r0appendr-r9r= run_optionrjoin updateMask)r#r$r% update_masks r SetUpdateMaskrOs + m$}% n%}%"4(+, ",- >)12 &+, __ () +%)9)9.)I,-  8 ::xx ,' .rc~tj}|j}|jdr*|jDcgc]}|j |}}nd}t |j|||Scc}w)aPython hook that parses the crawl scope args into the create request. Args: ref: The crawler resource reference. args: The parsed args namespace. request: The create crawler request. Returns: Request with crawl scope set appropriately. r7r8N)rrmessagesr0r7(GoogleCloudDatacatalogV1alpha3BucketSpec_SetScopeInRequestr9)r#r$r%r&rRr5r7s rParseScopeFlagsForCreaterUs  " " $& __( i  &$1@@@J$ &G D,,gw II &sA7c~tj}|j}t|rt |||}d}nd}|j }t ||||S)a9Python hook that parses the crawl scope args into the update request. Args: ref: The crawler resource reference. args: The parsed args namespace. request: The update crawler request. crawler: CachedResult, The cached crawler result. Returns: Request with crawl scope set appropriately. r8N)rrrRr=_GetBucketsPatchr9rT)r#r$r%r'r&rRr7r9s rr r s\  " " $& __(t$tWh7GKG""K K'8 DDrcp|jdxs$|jdxs|jdS)N add_bucketsremove_buckets clear_bucketsr0r$s rr=r=s<   = ) ,   + , ,   ? +-rcp|jdxs$|jdxs|jdS)Nr,r+r*r\r]s rr-r-s>   - . 1   0 1 1   / 02rc|dk(r&|s tdtj|d||S|dk(r'tj|d|j|S|dk(r%tj|d|j |S)z)Returns request with the crawl scope set.r8zSAt least one bucket must be included in the crawl scope of a bucket-scoped crawler.z@googleCloudDatacatalogV1alpha3Crawler.config.bucketScope.bucketsrDz9googleCloudDatacatalogV1alpha3Crawler.config.projectScoperEz>googleCloudDatacatalogV1alpha3Crawler.config.organizationScope)r rr20GoogleCloudDatacatalogV1alpha3ParentProjectScope5GoogleCloudDatacatalogV1alpha3ParentOrganizationScope)r9r7r%rRs rrTrTsH  " # $$J .i CAACE . n$ HFFHJ .rc|jjj}|r |jng}|j drg}|j dr3t |j }|Dcgc]}|j|vs|}}|j dr-||jDcgc]}|j|c}z }|Scc}wcc}w)zReturns list of buckets for a patch request based on the args provided. Args: args: The parsed args namespace. crawler: CachedResult, The cached crawler result. messages: The messages module. Returns: Desired list of buckets. r[rZrYrQ) rr.r>r7r0r1rZr8rYrS)r$r'rR bucket_scoper7r4r5s rrWrWs%%11,$0L b' o&G &'D''(I!?'QQXXY%>q'G? m$ ))+)AAAAK)++G . @+s2C C ,Cc~t||SN_ValidateSchedulingFlagsr:s r ValidateSchedulingFlagsForCreaterh7s !$ 00rc"~t|||dS)NT) for_updaterf)r#r$r%r's rrr<s !$T JJrNc |jdk(r|jds td|jdk7rS|jdrB|r5|jds$|jjj td|S)aValidates scheduling flags. Args: args: The parsed args namespace. request: The create or update request. crawler: CachedResult, The cached crawler result. for_update: If the request is for update instead of create. Returns: The request, if the scheduling configuration is valid. Raises: InvalidRunOptionError: If the scheduling configuration is not valid. rGrHzUArgument `--run-schedule` must be provided if `--run-option=scheduled` was specified.rKzArgument `--run-schedule` can only be provided for scheduled crawlers. Use `--run-option=scheduled` to specify a scheduled crawler.)rKr0rrr. scheduledRun)r$r%r'rjs rrgrgAs __ #D,<,<^,L    __ #(8(8(H  & ))1 !   .rc~tj}|j}t|j|j ||Sre)rrrR_SetRunOptionInRequestrKrH)r#r$r%r&rRs rParseSchedulingFlagsForCreaterobs<  " " $& __(  oot(('8 ==rc~tj}|j}|jdrdn |j}t ||j ||S)NrHrG)rrrRr0rKrnrH)r#r$r%r&rRrKs rr!r!jsV  " " $& __( $//? __ $##Wh 88rc|dk(r'tj|d|j|S|dk(rAtj||jj }tj|d||S)z(Returns request with the run option set.rFz5googleCloudDatacatalogV1alpha3Crawler.config.adHocRunrGzLgoogleCloudDatacatalogV1alpha3Crawler.config.scheduledRun.scheduledRunOption)rr2&GoogleCloudDatacatalogV1alpha3AdhocRun ChoiceToEnum*GoogleCloudDatacatalogV1alpha3ScheduledRun!ScheduledRunOptionValueValuesEnum)rKrHr%rRscheduled_run_options rrnrnws~8 ?779; .[ $11  < < + +.V .r)NF)#r __future__rrr#googlecloudsdk.api_lib.data_catalogr$googlecloudsdk.command_lib.util.apisr$googlecloudsdk.command_lib.util.argsrgooglecloudsdk.corer DATACATALOG_CRAWLER_API_VERSIONErrorr rrr(r"r;rrOrUr r=r-rTrWrhrrgror!rnrrrr~s3&'8:9*",+Z--+*J,,*>Z-->@>0<(VJ*E8- 2 201 K B= 8r