7dZddlmZddlmZddlmZddlmZddlmZddlm Z ddlm Z dd lm Z dd l m Z dd lmZdd lmZdd lmZdd lmZddlmZddlZGddej0ZGddeZy)z.Database Migration Service migration jobs API.)absolute_import)division)unicode_literals)encoding) list_pager)api_util)conversion_workspaces)filter_rewrite) storage_util)base) exceptions) labels_util)resource_propertyNceZdZdZy)Errorz.Class for errors raised by container commands.N)__name__ __module__ __qualname____doc__?lib/googlecloudsdk/api_lib/database_migration/migration_jobs.pyrr#s6rrc.eZdZdZgdZgdZdZdZdZdZ dZ d Z d Z d Z d Zd ZdZdZdZdZdZdZdZdZdZdZdZdZdZdZdZdZdZ dZ!d Z"d!Z#d"Z$d#Z%d$Z&d%Z'd&Z(d'Z) d/d)Z*d0d*Z+ d0d+Z, d0d,Z-d-Z.d.Z/y()1MigrationJobsClientz-Client for migration jobs service in the API.) display_nametype dump_pathsource destination dump_flags)vm_ipvm_portvmvpccdtj||_tj||_|jj |_|tjjk(r|jj|_ nd|_ tj||_ ||_yN)rGetClientInstanceclientGetMessagesModulemessages projects_locations_migrationJobs_servicer ReleaseTrackGA(projects_locations_migrationJobs_objects_service_objectsGetResourceParserresource_parser release_track)selfr3s r__init__zMigrationJobsClient.__init__5s,,];DK..}=DMKK@@DM)),,, ++ > > #d#55mDD&Drc&|j|yr&)_ValidateDumpPathr4argss r _ValidateArgsz!MigrationJobsClient._ValidateArgsBs4 rc|jy tjj|jdy#t$r.}t j dtj|d}~wwxYw)NF)allow_empty_objectz dump-path) rr ObjectReference FromArgument Exceptionr InvalidArgumentExceptionsix text_type)r4r9es rr7z%MigrationJobsClient._ValidateDumpPathEsg ~~ O""// ..U0 O  / / S]]1=M NNOs+; A2)A--A2c|O|jdrtjdd|jdrtjddyy)acValidate flags for conversion workspace. Args: conversion_workspace_ref: str, the reference of the conversion workspace. args: argparse.Namespace, The arguments that this command was invoked with. Raises: BadArgumentException: commit-id or filter field is provided without specifying the conversion workspace N commit_id commit-idoConversion workspace commit-id can only be specified for migration jobs associated with a conversion workspace.filterWFilter can only be specified for migration jobs associated with a conversion workspace.)IsKnownAndSpecifiedr BadArgumentException)r4conversion_workspace_refr9s r _ValidateConversionWorkspaceArgsz4MigrationJobsClient._ValidateConversionWorkspaceArgsOsi ' ! !+ .-- J    ! !( +-- 0   ,(rc|jO|jdrtjdd|jdrtjddyy)auValidate flags for conversion workspace. Args: conversion_workspace: str, the internal migration job conversion workspace message. args: argparse.Namespace, The arguments that this command was invoked with. Raises: BadArgumentException: commit-id or filter field is provided without specifying the conversion workspace NrErFrGrHrI)namerJr rK)r4conversion_workspacer9s r'_ValidateConversionWorkspaceMessageArgsz;MigrationJobsClient._ValidateConversionWorkspaceMessageArgsmso  ( ! !+ .-- J    ! !( +-- 0   ,)rc8|jj|Sr&)TypeValueValuesEnumlookup_by_name)r4mj_type type_values r_GetTypezMigrationJobsClient._GetTypes  & & 5 5j AArc8|jj|Sr&)DumpTypeValueValuesEnumrT)r4 dump_typedump_type_values r _GetDumpTypez MigrationJobsClient._GetDumpTypes  , , ; ;O LLrcN|jj|jS)N)r$)r*VpcPeeringConnectivitypeer_vpcr8s r_GetVpcPeeringConnectivityz.MigrationJobsClient._GetVpcPeeringConnectivitys == / /DMM / BBrc|jj|j|j|j|j S)N)r#vmIpvmPortr$)r*ReverseSshConnectivityr#r!r"r$r8s r_GetReverseSshConnectivityz.MigrationJobsClient._GetReverseSshConnectivitys7 == / / 77DLLdhh 0 rc6|jjSr&)r*StaticIpConnectivityr4s r_GetStaticIpConnectivityz,MigrationJobsClient._GetStaticIpConnectivitys == - - //rcXtj|}tj|}|jjj }tj |||jj|}|jr#|j|_ |jdyy)z$Updates labels of the migration job.) additions subtractionsclearlabelsN) rGetUpdateLabelsDictFromArgsGetRemoveLabelsListFromArgsr* MigrationJob LabelsValueDiff clear_labelsApply needs_updaternappend)r4r9 migration_job update_fields add_labels remove_labels value_type update_results r _UpdateLabelsz!MigrationJobsClient._UpdateLabelss88>J;;DAM++77J$$" eJ  !!*11m8$"rctj|j}|jj |}|j t jdd|S)zReturns the conversion workspace. Args: conversion_workspace_name: str, the reference of the conversion workspace. Raises: BadArgumentException: Unable to fetch latest commit for the specified conversion workspace. r3rOconversion-workspacerUnable to fetch latest commit for the specified conversion workspace. Conversion Workspace might not be committed.)r ConversionWorkspacesClientr3crudReadlatestCommitIdr rK)r4conversion_workspace_name cw_clientrPs r_GetConversionWorkspacez+MigrationJobsClient._GetConversionWorkspacesn&@@((I%>>.. &/**2  + + I  rc|jj|j}|j|j|_|S|j |j}|j |_|S)aUReturns the conversion workspace info. Args: conversion_workspace_ref: str, the reference of the conversion workspace. args: argparse.Namespace, The arguments that this command was invoked with. Raises: BadArgumentException: Unable to fetch latest commit for the specified conversion workspace. r)r*ConversionWorkspaceInfo RelativeNamerEcommitIdrr)r4rLr9conversion_workspace_objrPs r_GetConversionWorkspaceInfoz/MigrationJobsClient._GetConversionWorkspaceInfos $}}DD % 2 2 4 E  ~~!*...' $# "99 " / / 1+?*M*M' ##rcz|jtjdd|j|j|_|St j |j}|jj|j}|jtjdd|j|_|S)aReturns the conversion workspace info with the supplied or the latest commit id. Args: conversion_workspace: the internal migration job conversion workspace message. args: argparse.Namespace, The arguments that this command was invoked with. Raises: BadArgumentException: Unable to fetch latest commit for the specified conversion workspace. InvalidArgumentException: Invalid conversion workspace message on the migration job. rzTThe supplied migration job does not have a valid conversion workspace attached to itrrr) rOr r@rErr rr3rrrrK)r4rPr9rcst_conversion_workspaces r"_ComplementConversionWorkspaceInfoz6MigrationJobsClient._ComplementConversionWorkspaceInfos  (  / / *  ~~!&*nn# !!%@@((I )~~22 ! & & 3  ..6  + + I %=$K$K! rc|jj}||jj|jS)zReturns the performance config with dump parallel level. Args: args: argparse.Namespace, the arguments that this command was invoked with. )dumpParallelLevel)r*PerformanceConfig DumpParallelLevelValueValuesEnumrTdump_parallel_level)r4r9performance_config_objs r_GetPerformanceConfigz)MigrationJobsClient._GetPerformanceConfig s>"]]<< !0QQ``  $ $  rcg}g}|r|D]}| td|d|vrtdj|d tj|jj |}|j|d|j||D]2}||vr|j|jj |4|S#t $r}t|d}~wwxYw)aReturns the sqlserver database backups list. Args: sqlserver_databases: The list of databases to be migrated. sqlserver_encrypted_databases: JSON/YAML file for encryption settings for encrypted databases. Raises: Error: Empty list item in JSON/YAML file. Error: Encrypted Database name not found in database list. Error: Invalid JSON/YAML file. Nz"Empty list item in JSON/YAML file.databasezMigrationJobsClient._GetSqlserverHomogeneousMigrationJobConfigFs <<>3  9:==33//774jBL4>& :9!  , ,5F  ! !"9 :  & & 7D  ! !"@ A  - - 7G  ! !"7 8  - -(($*L*L  7F :9rc|jj|jjjjS)"Returns the source objects config.objectsSelectionType)r*SourceObjectsConfig#ObjectsSelectionTypeValueValuesEnum ALL_OBJECTSrhs r&_GetSourceObjectsConfigForAllDatabasesz:MigrationJobsClient._GetSourceObjectsConfigForAllDatabasesjs7 == , ,!]]>>bbnn - rc|jj|jjjj}g}|D]w}|jj ||jjj j d}|j|jj|y||_ |S)rrDATABASE)rrobjectIdentifier) r*rrSPECIFIED_OBJECTSSourceObjectIdentifierrSrTrwSourceObjectConfig objectConfigs)r4databases_filtersource_objects_conifgsource_object_configsrsource_object_identifiers r,_GetSourceObjectsConfigForSpecifiedDatabasesz@MigrationJobsClient._GetSourceObjectsConfigForSpecifiedDatabasesps MM==!]]>>bbtt>$!%!E!E}}33GGVV "F" "" -- * *7 + %+@'  rc|jj|jjjj}|D]}|d}|d}|jj |||jjj j d}|jg|_|jj|jj||S)rrschematableTABLE)rrrr) r*rrrrrSrTrrwr)r4object_filterssource_objects_config object_filter schema_name table_namers r)_GetSourceObjectsConfigForSpecifiedTablesz=MigrationJobsClient._GetSourceObjectsConfigForSpecifiedTabless MM==!]]>>bbtt>( !(+k )j!%!E!E}}33GGVV "F"  , , 4.0+))00 -- * *7 + (" ! rcd|jj}|jdr|j}nY|jdr|j |j }n,|jdr|j |j}|jj|S)zReturns the migration job objects config. Args: args: argparse.Namespace, The arguments that this command was invoked with. all_databasesrr)sourceObjectsConfig) r*rrJrrrrrMigrationJobObjectsConfig)r4r9rs r_GetMigrationJobObjectsConfigz1MigrationJobsClient._GetMigrationJobObjectsConfigs!MM==? 0"IIK ! !"4 5"OO     ! !/ 2"LL    == 2 21 3 rc|jdxsp|jdxs]|jdxsJ|jdxs7|jdxs$|jdxs|jdS)aChecks if at least one heterogeneous config flag is specified. Args: args: argparse.Namespace, The arguments that this command was invoked with. Returns: True if at least one of the heterogeneous config's flags is known and specified. $max_concurrent_full_dump_connectionsmax_concurrent_cdc_connectionsskip_full_dumporacle_cdc_start_positionsqlserver_cdc_start_position&max_concurrent_destination_connectionstransaction_timeout)rJr8s r'_IsHeterogeneousConfigKnownAndSpecifiedz;MigrationJobsClient._IsHeterogeneousConfigKnownAndSpecifieds   !GH ;  # #$D E ;  # #$4 5 ;  # #$? @ ;  # #$B C  ;  # #$L M  ;  # #$9 :rc|jj}|jdr|j|_|jdrt |j dz|_|S)zReturns the postgres destination config. Args: args: argparse.Namespace, the arguments that this command was invoked with. Returns: PostgresDestinationConfig: The postgres destination config. rrs)r*PostgresDestinationConfigrJrmaxConcurrentConnectionsstrrtransactionTimeout)r4r9postgres_destination_configs r_GetPostgresDestinationConfigz1MigrationJobsClient._GetPostgresDestinationConfigsk#'--"I"I"K  HI  5 5":  56 d&& '# -"4 '&rc|jj}|jdr|j|_|jdr|j |_|jdrV|j|_|jdrt|j}||_ |Stjdd|S)a8Returns the oracle source config. Args: args: argparse.Namespace, the arguments that this command was invoked with. Returns: The oracle source config. Raises: RequiredArgumentException: The Oracle CDC start position should be specified when skipping full dump. rrrrzoracle-cdc-start-positionzJThe Oracle CDC start position should be specified when skipping full dump.)r*OracleSourceConfigrJr maxConcurrentFullDumpConnectionsrmaxConcurrentCdcConnectionsr skipFullDumpintrcdcStartPositionr RequiredArgumentException)r4r9oracle_source_configtemps r_GetOracleSourceConfigz*MigrationJobsClient._GetOracleSourceConfigs ==;;=  FG  3 3;  @A  - -6  01*.*=*=' ! !"= >411204- 22 ''   rcz|jj}|jdr|j|_|jdr|j |_|jdrK|j|_|jdr|j|_ |Stjdd|S)aBReturns the sqlserver source config. Args: args: argparse.Namespace, the arguments that this command was invoked with. Returns: The sqlserver source config. Raises: RequiredArgumentException: The SQL Server CDC start position should be specified when skipping full dump. rrrrzsqlserver-cdc-start-positionzNThe SQL Server CDC start position should be specified when skipping full dump.) r*SqlServerSourceConfigrJrrrrrrrsqlserverCdcStartPositionr r)r4r9sqlserver_source_configs r_GetSqlServerSourceConfigz-MigrationJobsClient._GetSqlServerSourceConfigs#mmAAC  FG  3 3>  @A  - -9  01-1-@-@* ! !"@ A  - - 9 #"22 *'   #"rcp|j|r|j|}|jj|jj j jk(r|j|}n/tdj|jj|jj|jj j jk(r0|jj|j||}d|fS|jj|jj j jk(r0|jj!|j#||}d|fStdj|jjy) aReturns the heterogeneous migration job config. Args: conversion_workspace_name: str, the name of the conversion workspace. args: argparse.Namespace, The arguments that this command was invoked with. Returns: A tuple containing the heterogeneous config key and the config object. Raises: Error: Invalid source or destination engine. zXCannot create heterogeneous migration job configuration for destination engine: {engine})engine)oracleSourceConfigpostgresDestinationConfigoracleToPostgresConfig)sqlserverSourceConfigrsqlserverToPostgresConfigzTCannot create heterogeneous migration job configuration for source engine: {engine})NN)rrrrr*DatabaseEngineInfoEngineValueValuesEnum POSTGRESQLrrrrORACLEOracleToPostgresConfigr SQLSERVERSqlServerToPostgresConfigr)r4rr9rProracle_to_postgres_configsqlserver_to_postgres_configs r#_GetHeterogeneousMigrationJobConfigz7MigrationJobsClient._GetHeterogeneousMigrationJobConfig,s  33D9!99 #  * * 1 1 ]] - - C C N N O'+&H&H ' # ++16+77>>,2,    % % , , ]] - - C C J J K%)MM$H$H#::4@&A%I%!()BBB  % % , , ]] - - C C M M N(,}}'N'N"&"@"@"F&A(O($+,HHH ''-v+2299(.(  rc |jj}tj||jjj}|j ||j }|j} |j} i} |jdr|j|| d<nJ|jdr|j|| d<n$|jdr|j| d<|jdr|j|j| d<|@|j||| d <|j|j|\} } | -| | | <n'|j!|rt#j$d d |d||j&|j(j*||j,| | d | }||j|_|j1d r>    &2&?&?&A# )#1#:#:#<#D#D ++$ dk="/  56,0,F,Ft,L)  ,#'#4#4 -- $ $dnn$   ! !"; <  9 9$ ?>  23t7O7O8)-(J(J4(P% rcdj||j}dj||}dj||}|jdr |jdj||jdr |jdj||jdr |jd j||jd r!|jd j|y y ) z?  + +5E ! ! !"? @ 7 A A I MM , , . 7@  ! !"; <  ( ( 7@@I  ! !"? @  , , ; D D Q  56  + +&&(J(J 5D  ! !"A B  / / + 1  Crcv|jds|jdr|j||_yy)z>Update the migration job objects config for the migration job.rrN)rJrr$)r4r9rxs r _UpdateMigrationJobObjectsConfigz4MigrationJobsClient._UpdateMigrationJobObjectsConfiges=  23t7O7O8%)$F$Ft$Lm!8rc t|jDcgc](}|j|rtj|*}}|j t|j Dcgc]7}|j|r$djtj|9c}|jdr|jd|jdr|jd|jdr|jd|jdr|jd|jd s|jdr|jd |jd r|jd |jd r|jd|jdr|jd|jdr|jd|jdr|jd|jds|jdr|jd|jds|jdr|jd|Scc}wcc}w)z)Returns update mask for specified fields.zreverseSshConnectivity.{0}r_zvpcPeeringConnectivity.vpcrz#performanceConfig.dumpParallelLevelrZr"rHrEzconversionWorkspace.commitIdrz8sqlserverHomogeneousMigrationJobConfig.backupFilePatternrz4sqlserverHomogeneousMigrationJobConfig.useDiffBackuprz7sqlserverHomogeneousMigrationJobConfig.promoteWhenReadyrz9sqlserverHomogeneousMigrationJobConfig.dagConfig.sourceAgrz=sqlserverHomogeneousMigrationJobConfig.dagConfig.linkedServerrrz6sqlserverHomogeneousMigrationJobConfig.databaseBackupsrrz!objectsConfig.sourceObjectsConfig) sorted _FIELDS_MAPrrConvertToCamelCaseextendr=rrwrJ)r4r9r>rys r_GetUpdateMaskz"MigrationJobsClient._GetUpdateMaskmsmD,,--E   E " ,,U3- D--. /E   E " %++  0 0 7 /   #78  56@A  ,:& )8$  ,0H0H19:  ?@ D  78 @  >? C  9: E  => I  ! !"A B B  23t7O7O8>? o s -I9)cg}|jD]1\}}|j|jj||3|jj |S)z-Returns the dump flags for the migration job.)rOvalue)r)itemsrwr*DumpFlag DumpFlags)r4r dump_flags_listrOrKs rrz!MigrationJobsClient._GetDumpFlagsscO!'') e --  ! * == " "_ " ==rcv|j|}|jdr|j|_|jdr5|j |j j |j|_|jdr5|j|j j |j|_ |jdr|j|_ |jdr |j|j|_|jdr|j#|_|jdr|j#|_|jdr|j)||_|jd r">"@m  56(,(B(B4(Hm% )#1#:#:#<#D#D ++$ dk=+m]D1t]M:   !@A  # #$; <  # #$B C  # #$9 :  # #$C D  # #$= >  # #$A B 88}M))$ > 33D9 11  } - ''rcp|jj|}|jj|S)Nr)r*5DatamigrationProjectsLocationsMigrationJobsGetRequestr,Get)r4rOget_reqs r_GetExistingMigrationJobz,MigrationJobsClient._GetExistingMigrationJobs9 KK L  ==  W %%rNc|j||j|||j|||||}tj} |j j } | |||| } |jj| S)ahCreates a migration job. Args: parent_ref: a Resource reference to a parent datamigration.projects.locations resource for this migration job. migration_job_id: str, the name of the resource to create. source_ref: a Resource reference to a datamigration.projects.locations.connectionProfiles resource. destination_ref: a Resource reference to a datamigration.projects.locations.connectionProfiles resource. conversion_workspace_ref: a Resource reference to a datamigration.projects.locations.conversionWorkspaces resource. cmek_key_ref: a Resource reference to a cloudkms.projects.locations.keyRings.cryptoKeys resource. args: argparse.Namespace, The arguments that this command was invoked with. Returns: Operation: the operation for creating the migration job. ) migrationJobmigrationJobIdparent requestId) r:rMr.rGenerateRequestIdr*8DatamigrationProjectsLocationsMigrationJobsCreateRequestr,Create) r4 parent_refmigration_job_idr%r&rLr'r9rx request_idcreate_req_type create_reqs rr^zMigrationJobsClient.Creates< t))*BDI))  M++-J NN!"' J ==   ++rc|j||j|}t|drI|j=|j |j||j |j||_|j ||||\}}tj}|jj} | |||dj|} |jj| S)aUpdates a migration job. Args: name: str, the reference of the migration job to update. source_ref: a Resource reference to a datamigration.projects.locations.connectionProfiles resource. destination_ref: a Resource reference to a datamigration.projects.locations.connectionProfiles resource. args: argparse.Namespace, The arguments that this command was invoked with. Returns: Operation: the operation for updating the migration job.678888888 r,)rXrOr[ updateMask)r:rVhasattrrrQrrQrr\r*7DatamigrationProjectsLocationsMigrationJobsPatchRequestjoinr,Patch) r4rOr%r&r9 current_mjrxryraupdate_req_type update_reqs rUpdatezMigrationJobsClient.Update$s t..t4J  12  * * 6 22  ( ($(,'N'N  ( ($(j$$(#?#?J$ M=++-J MM!" 88M* J ==  z **rc|jj}|jdr|j||_|jj ||}|j j|S)aPromotes a migration job. Args: name: str, the name of the resource to promote. args: argparse.Namespace, The arguments that this command was invoked with. Returns: Operation: the operation for promoting the migration job. r)rOpromoteMigrationJobRequest)r*PromoteMigrationJobRequestrJr objectsFilter9DatamigrationProjectsLocationsMigrationJobsPromoteRequestr,Promote)r4rOr9promote_mj_req promote_reqs rrtzMigrationJobsClient.PromoteUst]]==?N  23%)%G%G%Mn" OO'5 P  ==  --rcv|jj}|jds|jdr|j||_|jdrd|_|jdrd|_|jj||}|jj|S)aRestarts a migration job. Args: name: str, the name of the resource to restart. args: argparse.Namespace, The arguments that this command was invoked with. Returns: Operation: the operation for promoting the migration job. rrskip_validationTrestart_failed_objects)rOrestartMigrationJobRequest) r*RestartMigrationJobRequestrJrrrskipValidationrestartFailedObjects9DatamigrationProjectsLocationsMigrationJobsRestartRequestr,Restart)r4rOr9restart_mj_req restart_reqs rrzMigrationJobsClient.Restartqs]]==?N  23t7O7O8&*%G%G%Mn"  12&*n#  89,0n) OO'5 P  ==  --rcp|jj|}|jj|S)zFetches source objects of a migration job. Args: name: str, the name of the resource to fetch source objects for. Returns: Operation: the operation for fetching source objects of the migration job. r)r*DDatamigrationProjectsLocationsMigrationJobsFetchSourceObjectsRequestr,FetchSourceObjects)r4rOfetch_source_objects_reqs rrz&MigrationJobsClient.FetchSourceObjectss: $}}qq  r  == + +,D EErc|jj}||j}tj|j |ddddS)zGet the list of objects in a migration job. Args: migration_job_ref: The migration job for which to list objects. Returns: An iterator over all the matching migration job objects. )rZNmigrationJobObjects)servicerequestlimit batch_sizer>batch_size_attribute)r*=DatamigrationProjectsLocationsMigrationJobsObjectsListRequestrr YieldFromListr0)r4migration_job_ref list_req_typelist_reqs r ListObjectszMigrationJobsClient.ListObjectssW SS$5$B$B$DEH  # #%%#!  r)NNNr&)0rrrrrFr=r5r:r7rMrQrWr\r`rerir~rrrrrrrrrrrrrrrr.r6r;r?rArCrIrrQrVr^rnrtrrrrrrrr's5+3, '!O < >BMC 0 % 4$4* X +Z":H !*!00*'*$ L%#N;zkZ0(d& $ 4,l/+h .>  .DF$rr)r __future__rrrapitools.base.pyrr)googlecloudsdk.api_lib.database_migrationrr r googlecloudsdk.api_lib.storager googlecloudsdk.callioper r $googlecloudsdk.command_lib.util.argsrgooglecloudsdk.corecore_exceptionsgooglecloudsdk.core.resourcerrArobjectrrrrrsW5&'%'>KD7(.<=: 7O ! !7S&Sr