T@ UdZddlmZddlZddlmZmZmZmZddl m Z ee e e fZe ed<ee ee dffZe ed<dee efd ee fd Zd ee d ee fd ZGd deZej*dk\r;eegefZe ed<eeee gefZe ed<ee e e ge fZe ed<ee ge fZe ed<neZe ed<eZe ed<eZe ed<eZe ed<GddZGddeZdee efdee efd ee effdZGddZGddZy)zIThe classes used to define config used to delegate BQ commands to gcloud.)CallableN)DictListOptionalUnion) TypeAliasPrimitiveFlagValue NestedStrDict mapped_flagsreturnc g}|jD]a\}}t|ts!|jd|dt |7|r|jd|N|jd|c|S)z8Returns the gcloud command flags as an array of strings.--=z--no-)items isinstanceboolappendstr)r flag_arraynamevalues 9platform/bq/gcloud_wrapper/bq_to_gcloud_config_classes.py_flatten_flag_dictionaryr s|*!'')kdE eT ""TF!CJ<01 "TF $%v' *  command_arraycg}|D]U}|jdr1d|vr-|jd\}}}|j|d|dE|j|W|S)z?Returns the gcloud command flags after quoting the flag values.rrz='') startswith partitionr)rresultcommand_or_flagr_rs rquote_flag_valuesr#si&&o!!$'C?,B(2237tQ mmtfBugQ'( mmO$ ' -rceZdZdZy)!BigqueryGcloudDelegationUserErrorz9Class to represent a user error during gcloud delegation.N)__name__ __module__ __qualname____doc__rrr%r%(sArr%) ConvertFlagValuesFunctionConvertJsonFunctionConvertStatusFunctionMatchOutputFunctionc>eZdZdZ d dededeefdZdedefd Z y) FlagMappingzDefines how to create a gcloud command flag from a bq flag. For example this would return True: FlagMapping( bq_name='httplib2_debuglevel', gcloud_name='log-http', bq_to_gcloud_mapper=lambda x: x > 0, ).bq_to_gcloud_mapper(1) Nbq_name gcloud_namebq_to_gcloud_mappercV||_||_|r||_y|j|_yN)r4r5r6$default_map_bq_value_to_gcloud_value)selfr4r5r6s r__init__zFlagMapping.__init__Js, DL"D!4d!%!J!Jdr bq_flag_valuer cht|tr|xsdSt|tr|St|S)zCTakes a bq flag value and returns the equivalent gcloud flag value.F)rrintr)r:r<s rr9z0FlagMapping.default_map_bq_value_to_gcloud_valueXs4-&  #e# M3 '   rr8) r&r'r(r)rrr.r;r r9r*rrr3r3>sN BF K K K$$=> K  -    rr3c,eZdZdZdedeffd ZxZS)UnsupportedFlagMappingz9Defines a bq global flag that is not supported in gcloud.r4 error_messagecdtttfdtttfffd }t||d|y)Nxr ctr8)r%)rCrAs rraise_unsupported_flag_errorzEUnsupportedFlagMapping.__init__..raise_unsupported_flag_errorls -m <z)CommandMapping.__init__..sqrc|Sr8r*)original_statusr"__s rraz)CommandMapping.__init__..s?rcy)NFr*)r"s rraz)CommandMapping.__init__..sEr) rTrUrVrW_flag_mappingsrXrYrZr[r\r]r^) r:rTrUrVrWrXrYrZr[r\r]r^s rr;zCommandMapping.__init__s\DM DO(D.4"D26D,D(D(4 .D*dJd+ . /3Bd/(D DOrr c|js1i|_|jD]}||j|j<|jS)z2Returns the command flag mappings as a dictionary.)rfrWr4)r: flag_mappings rrJzCommandMapping.flag_mappingssG   d00,4@L0011   rprefixlabelsc|r|d|dS|S)z Returns the format from the map.()r*)r:rirjs r_add_fields_to_formatz$CommandMapping._add_fields_to_formats xq "" mr bq_formatc|r |dk(s|dk(r|jd|jSd|vryd|vr|jd|jStd|)z2Returns the gcloud format for the given bq format.prettysparsez table[box]jsoncsvzUnsupported format: )rnrXrYrM)r:ros rget_gcloud_formatz CommandMapping.get_gcloud_formatsm  X-h1F  ' ' d6K6K LL 9   )   ' 't/B/B CC -i[9 ::rrKc.t|j|S)z0Returns the gcloud flags for the given bq flags.)rQrJ)r:rKs r_get_gcloud_flagsz CommandMapping._get_gcloud_flags s $D$6$6 AArbq_command_flags identifiercN|jj}|jr%|j|}|j d||j t |j||jr|j d|r|j ||S)aPReturns the gcloud command to use for the given bq command. Args: bq_format: The `format` flag from the BQ CLI (eg. 'json'). bq_command_flags: The flags for this BQ command that will be mapped. For example, {'max_results': 5} identifier: An optional identifier of the resource this command will operate on. Returns: The equivalent gcloud command array with the leading 'gcloud' removed, with the format flag and command flags but no global flags. For example, ['alpha', 'bq', 'datasets', 'list', '--format=json', '--limit=5'] z --format=z--quiet) rVcopyr]rurextendrrwr^)r:rorxryrV gcloud_formats r%get_gcloud_command_minus_global_flagsz4CommandMapping.get_gcloud_command_minus_global_flagss(!% 3 3 8 8 :N ,,Y7m m_ % !7!78H!IJ I&J' r)NNNNNNTFr8)r&r'r(r)rrrr3r/r0r1rr;propertyrrJrnrur rwr~r*rrrSrSs>8<(,&*488< !A!A!A!3i A! "${"34 A! ! A!smA!01A!45A!-5 -A!A!A!F T#{"23 #  sm   ;# ;3 ;BS,,-B C# #$B#' "#"S#X"3- "  Cy "rrSceZdZdZdeedeefdZede e e e efffdZ ede e effdZ de e e fde e e ffd Zd e d e defd Z dd e d e de e e fde e e fdee dee f dZy )GcloudCommandGeneratorz-Generates a gcloud command from a bq command.command_mappingsglobal_flag_mappingsc<||_||_d|_d|_yr8)_command_mapping_list_global_flag_mapping_list _command_dict_global_flag_dict)r:rrs rr;zGcloudCommandGenerator.__init__;s$ "2D%9D"IMD?CDrr c`|jsi|_|jD]}|j|jvri|j|j<|j|j}|j|vrt d|j|||j<|jS)zEReturns the commands as a map of resource to bq command to delegator.zDuplicate bq command: )rrrTrUrM)r:command_mappingresource_to_commandss r command_dictz#GcloudCommandGenerator.command_dictEs   d!77/  # #4+=+= =9;$  _55 6#11/2J2JK  % %)= =&'A'A&BC   0) ]) Args: bq_global_flags: The bq flags that will be mapped. For example, {'project_id': 'my_project', 'httplib2_debuglevel': 1} Returns: The equivalent gcloud flags. For example, {'project': 'my_project', 'log-http': True} )rQr)r:rs rmap_to_gcloud_global_flagsz1GcloudCommandGenerator.map_to_gcloud_global_flags`s4 $D$9$9? KKrrTrUc&|j||S)zCReturns the gcloud delegator for the given resource and bq command.)r)r:rTrUs rget_command_mappingz*GcloudCommandGenerator.get_command_mapping|s   X &z 22rNrxryc|j||}|std||j}|jdd}t |j |} | |j |||zS)aReturns the gcloud command to use for the given bq command. As an example usage: GcloudCommandGenerator( command_mappings=[CommandMapping( resource='datasets', bq_command='ls', gcloud_command=['alpha', 'bq', 'datasets', 'list'], flag_mapping_list=[ FlagMapping( bq_name='max_results', gcloud_name='limit', ), ], flag_mappings=[ FlagMapping( bq_name='project_id', gcloud_name='project'), ]).get_gcloud_command( resource='datasets', bq_command='ls', bq_global_flags={'project_id': 'bigquery-cli-e2e', 'format': 'pretty'}, bq_command_flags={'max_results': 5}, ) Will return: ['--project=bigquery-cli-e2e', 'alpha', 'bq', 'datasets', 'list', '--format=json', '--limit=5'] Args: resource: The resource the command is being run on, named to align with `gcloud` commands. For example, 'jobs' or 'datasets'. bq_command: The bq command to run. For example, 'ls' or 'show'. bq_global_flags: The BQ CLI global flags for the command. bq_command_flags: The BQ CLI command flags for the command. identifier: The identifier of the resource to act on. Returns: The gcloud command to run as an array of strings, minus the leading 'gcloud'. This can be parsed directly into `gcloud_runner.run_gcloud_command`. zUnsupported bq command: formatrr)rorxry)rrMr{poprrr~) r:rTrUrrxry delegatorfiltered_global_flagsrogcloud_global_flagss rget_gcloud_commandz)GcloudCommandGenerator.get_gcloud_commandsh((:>I  1*> ??,002%))(H=I%= ''(=>&   9 9-! :  rr8)r&r'r(r)rrSr3r;rrrrrr rrrrr*rrrr8s+5D^,D!-D  Dd3+>&?!?@    "S+%5 6" "L!#'9"9:L C# #$L833'*33#' HHHCH~ H S#X H 3- H CyHrr)r)collections.abcrsystypingrrrrtyping_extensionsrrrr>r __annotations__r rr# Exceptionr% version_infor.r/r0r1r3r@rQrSrr*rrrsO$ ..' %c4n 5I5U3+?%@ @A yA s../  #Y  T#Y 49 B B y )1..*Y$,hsm$m3$y&.sCos.B%CC#+SE4K#8y8)1Y1#+y+%--#+y+# # L P[ P[()3**+ #! !"6hhVSSr