V4dZddlZddlZddlmZddlZddlZddlZddlmZddl m Z ddl m Z ddl m Z ddl mZGd d Zy) z'Utilities for app migrate gen1-to-gen2.N)path) exceptions)log) properties)yaml)filescfeZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d Zd ZdZdZdZdZdZy)Gen1toGen2MigrationzCUtility class for migrating Gen 1 App Engine applications to Gen 2.zapp.yamlzmigration_progress.jsondefault)python27servicer app_yamlprocessed_filescJtj|||_tj|_|j r/tjj|j |_ nNtjdtjj|j |j|_ tjj|j|_tj j"j$j'|_y)zInitializes the Gen1toGen2Migration utility class. Args: api_client: The AppEngine API client. args: The argparse arguments. z:appyaml not provided. Using app.yaml in current directory.N)rdebug api_clientosgetcwd input_dirappyamlrrelpath appyaml_pathinfojoinDEFAULT_APPYAMLabspath output_dirrVALUEScoreprojectGet)selfrargss 4lib/googlecloudsdk/command_lib/app/migration_util.py__init__zGen1toGen2Migration.__init__+sIIdO DOYY[DN ||''//$,,7d hhKL'',,t~~t7K7KLdggoodoo6DO$$))11557DLc$|j}|j|jr|j|j}n+|j}tj j dt jdj||jj||jstj|j|j}|r|j|y|j!|y)zStarts the migration process. Raises: MissingGen1ApplicationError: If the provided project does not contain an AppEngine version with a Gen1 runtime. z:Service name not found in app.yaml. Using default service.zservice_name: {0}N)ValidateAppyamlAndGetContentsget SERVICE_FIELDDEFAULT_SERVICE_NAMErstatusPrintrformatrCheckGen1AppIdr rMissingGen1ApplicationError)CheckOutputDirectoryAndGetMigrationStatusStartNewMigrationResumeMigration)r"app_yaml_content service_nameis_new_migrations r$StartMigrationz"Gen1toGen2Migration.StartMigration?s99;D../%))$*<*<=l..l jj FHH ' ' 56 ?? ) ), E  2 24<< @@EEG \* <(r&cNtj|jstj|jt j |j}|jd|jvr*tj|j|j|S)aValidates the app.yaml file and returns its contents. Returns: The contents of the app.yaml file. Raises: FileNotFoundError: If the app.yaml file is not found. UnsupportedRuntimeError: If the runtime in app.yaml is not a valid Gen 1 runtime. runtime) rexistsrrFileNotFoundErrorr load_pathr)SUPPORTED_GEN1_RUNTIMESUnsupportedRuntimeError)r"appyaml_contents r$r(z1Gen1toGen2Migration.ValidateAppyamlAndGetContents]s ;;t(( )  ( ():): ;;nnT%6%67O9%T-I-II  . .   T99  r&c~tjj|jsNtj|jt j dj|jytj|js/t j dj|jy|jtj|jvr/t jdj|jytj|j)aCheck if output directory exists and decide the migration status. If an output directory does not exist, we create one and decide that it is a new migration. Returns: Boolean: True for new migration, False for resuming migration. Raises: InvalidOutputDirectoryError: If the output directory is not empty and does not contain a migration_progress.json file. zCreating directory: {0}TzOutput directory {0} is empty.z8Output directory {0} is not empty. Resuming migration...F) rrr:rmakedirsrrr.listdirMIGRATION_PROGRESS_FILEwarningrInvalidOutputDirectoryError)r"s r$r1z=Gen1toGen2Migration.CheckOutputDirectoryAndGetMigrationStatusus 77>>$// *kk$//" hh(//@A  ::doo & hh/66tGH  ##rzz$//'BB kk D K Koo    0 0 AAr&c `tjdj|jtj j |j}tj|j|jtjd|tj|jjdtjj!dtj j#|j|j$}i}|j'|tj j#|j|||tj j#|jd}|j)||||tjj!dy) zXFlow for starting a new migration. Args: service_name: The service name. input_dir: {0}z*.pyT)ignore dirs_exist_okz!Copying files to output directoryrequirements.txtMigration completed.N)rrr.rrrbasenamershutilcopytreerignore_patternspathlibPurePathnamer,r-rrCWriteMigratedYamlWriteMigratedCode)r"r5appyaml_filename progress_filemigration_progressrequirements_files r$r2z%Gen1toGen2Migration.StartNewMigrations<HH  $ $T^^ 45ww''(9(9: OO  %% $g&6&6t&G&L&L  JJ89GGLL$2N2NOM   T__&67  T__6HI(-9JJJ+,r&c `tjdj|jtj j |j|j}tj|5}tj|}ddd|jjddvrtjdj|j|j|tj j |jtj j!|j||tj j |jd}|j#||||tj$j'dy#1swYxYw)zFlow for a resumed migration. Args: service_name: The service name. Raises: InvalidOutputDirectoryError: If the output directory is not empty and does not contain a migration_progress.json file. rGNrz8{0} not present in migration_progress. Will be migrated.rJrK)rrr.rrrrrrCr FileReaderjsonloadrr)rSrLrTr,r-)r"r5rVpfrWrXs r$r3z#Gen1toGen2Migration.ResumeMigrations;HH  $ $T^^ 45GGLL$2N2NOM   - (B99R= )  2 6 6z2 FF hh D K K     '',,t(8(89J9J(K L    T__6HI(-9JJJ+,- ) (s 8F##F-ctj|j}tjj |j}|j j|j||j|}tj|j}tj|5} tj|| ddd|j||j<tj|d5} t!j|| ddddt"j$j'dj)|y#1swYxYw#1swYDxYw)aWrites the migrated app.yaml to the output directory. Args: service_name: The service name. output_path: The path to the output directory. migration_progress: The migration progress dictionary. progress_file: The path to the migration progress file. Nwindentz$Config modifications applied to {0}.)rReadFileContentsrrrrLrMigrateConfigYamlr PYTHON_GEN1_RUNTIMErr]configAsString FileWriterdumpAPP_YAML_FIELDr\rr,r-r.) r"r5 output_pathrWrVr?rUresponsemigrated_yaml_contentsfr^s r$rSz%Gen1toGen2Migration.WriteMigratedYamls ,,T->->?Oww''(9(9:00 ot'?'?H"YYx'>'>?   + &! ii&* '/3.?.?t**+   - - ii"Bq1 .JJ.556FG ' & . -s/E =E EE"c tj|jD]3\}}}|Dcgc]0}|tj|j j k7r|2c}|dd|D]} tjj|| } tj| jdk(sG|j|vr6| ||jvr%tjdj| tjj!dj| t#j$| } |j'| |\} } tjj|j tjj)| |j}g}tjj+|r(t#j$|}|r|j-d}| D]}||vs|j/|t#j0|dj|tjj+|rtjj3|ddzt5t7j6j-ddzdz}tj8d j| ||}t#j0|| d |j|vrg||j<||jj/| t#j:|d 5}t=j>||d ddd6ycc}w#1swYxYw)aWrites the migrated code to the output directory. Args: service_name: The service name. migration_progress: The migration progress dictionary. progress_file: The path to the migration progress file. requirements_file: The path to the requirements file. Nz.pyz)File {0} already exists. Will be skipped.zCurrently on file: {0} r_.z0File {0} already exists. Will be renamed to {1}.F) overwriter`rarb) rwalkrrPrQrrRrrPathsuffixPROCESSED_FILES_FIELDrrr.r,r-rrdGetMigratedCoderr:splitappendWriteFileContentssplitextstrtimerDrhr\ri)r"r5rWrVrXdirpathdirname filenamesdfilename file_path file_contenttransformed_coderequirements_listrkexisting_requirementsrequirements_file_contents requirementnew_output_pathr^s r$rTz%Gen1toGen2Migration.WriteMigratedCodes(*wwt~~'>#)a '""4??388 8 gaj  (GGLL(3 << " ) )U 2((,>>1$2L2LMM HH;BB9M   **  3::9E F// :,040D0DL1 - - oorwwy$..I +#%  WW^^- .).)?)?!* &*&@&F&Ft&L#/k"77#**;7/  ! !+@!A WW^^K (  -a0diik"((-a01  KKBII  *K  ! !+u  ' '/A A=? t99 : T77 8 ? ? J s3r II("Q 743{ (?D43s5M0MM' c|jj|j||j|}d}g}|jj }|D]}|j dk(r|jj}|j dk(s8|jjj}|D]+} |j| jj-||fS)aBCalls MigrateCodeFile and gets the migrated code for a python file. Args: file_content: The contents of the python file. service_name: The service name. Returns: transformed_code: The migrated code for the python file. requirements_list: The list of requirements for the python file. rZ codeAsStringpython3Requirements) rMigrateCodeFiler rfrladditionalPropertieskeyvalue string_value array_valueentriesrzstrip) r"rr5 operationrroperation_responseprop requirementsentrys r$rxz#Gen1toGen2Migration.GetMigratedCodeVs// lD$<$" # . ..r&N)__name__ __module__ __qualname____doc__rrCr+r=r*rfrjrwr%r7r(r1r2r3rSrTrxr&r$r r seK/5")-".+8()<0!BF'-R%-N8P8d/r&r )rr\rrrPrMr~googlecloudsdk.command_lib.apprgooglecloudsdk.corerrrgooglecloudsdk.core.utilrr rr&r$rs7.  5#*$*Q/Q/r&