>dZddlmZddlmZddlmZddlZddlZddlmZddl m Z ddl m Z dd l m Z dd l mZdd l mZddlZdd lmZd ZddgZdZdZdZGddeZGddeZGdde j6ZGdde j6ZGddej<ZGdde Z!Gdd e Z"d!Z#d"Z$ d&d$Z%ed#e$d#dfd%Z&y)'aLibrary for ignoring files for upload. This library very closely mimics the semantics of Git's gitignore file: https://git-scm.com/docs/gitignore See `gcloud topic gcloudignore` for details. A typical use would be: file_chooser = gcloudignore.GetFileChooserForDir(upload_directory) for f in file_chooser.GetIncludedFiles('some/path'): print 'uploading {}'.format(f) # actually do the upload, too )absolute_import)division)unicode_literalsN)glob) exceptions)log) propertiesencoding)files)mapz .gcloudignorez.git .gitignorea# This file specifies files that are *not* uploaded to Google Cloud # using gcloud. It follows the same syntax as .gitignore, with the addition of # "#!include" directives (which insert the entries of the given .gitignore-style # file at that point). # # For more information, run: # $ gcloud topic gcloudignore # .gcloudignore # If you would like to upload your .git directory, .gitignore file or files # from your .gitignore file, remove the corresponding line # below: .git .gitignore /z(?"E"Ed"K LL s !"Xdgg tyy##D)7 ;;rN)FFF)rrrrr2r6 classmethodr?rrrr+r+cs%# <>(//)gF G  IAeG ''..  g 0 7 7 BD D kk!n ++a.a ''..   "A   #   !Y ' F M M   ''//! a   #!#!rc#lKtjtj|dD]x\}}}t j |}|Dcgc]}t j |}}|Dcgc]}t j |}}||k(rd} n tj j||} |D]g}tj j| |} |jtj j|||j| sd| i|D]}tj j| |} tj j||} |j| dr|j| |sj| o|j|{ycc}wcc}ww)aYields the files in the given directory that this FileChooser includes. Args: upload_directory: str, the path of the directory to upload. include_dirs: bool, whether to include directories Yields: str, the files and directories that should be uploaded. Raises: SymlinkLoopError: if there is a symlink referring to its own containing dir or itself. T) followlinksr4N) rRwalksix ensure_strr Decoder7relpathjoinr^rPremove) r1upload_directory include_dirsdirpath orig_dirnames filenamesrXdirnamesfilenamerf file_relpathr[s rGetIncludedFileszFileChooser.GetIncludedFilessb.0WW '(d.<.<) (g:GH-w(//'*-hH=FGY8??8,YiG $ $''//'+;<(ww||GX6    gx!@A ??< (   'ww||GW5 GGLL'2 ??<? 5  " "9 -     w '.<IGs,A F4F**F40F/ BF4A1F4&F4Nc|g}|jD]}|jdrO|ddjj|jr"|j |j |||c |j tj|||S#tj$rYwxYw)azConstructs a FileChooser from the given string. See `gcloud topic gcloudignore` for details. Args: text: str, the string (many lines, in the format specified in the documentation). recurse: int, how many layers of "#!include" directives to respect. 0 means don't respect the directives, 1 means to respect the directives, but *not* in any "#!include"d files, etc. dirname: str, the base directory from which to "#!include" Raises: BadIncludedFileError: if a file being included does not exist or is not in the same directory. Returns: FileChooser. r9r$N) splitlinesr;lstrip_INCLUDE_DIRECTIVEextend_GetIncludedPatternsappendr+r?rr<)r@textrecurserXrGrAs rr?zFileChooser.FromStrings*H!   8??  ' '(>(> ? //#224'J K **401 " x= " "   s7$B%%B;:B;c|s td|j|j}||t|jzd}t|vr t d|st jd|gStjj||} |j||dz jS#t$r#}t tj|d}~wwxYw)aGets the patterns from an '#!include' line. Args: line: str, the line containing the '#!include' directive dirname: str, the name of the base directory from which to include files recurse: int, how many layers of "#!include" directives to respect. 0 means don't respect the directives, 1 means to respect the directives, but *not* in any "#!include"d files, etc. Returns: list of Pattern, the patterns recursively included from the specified file. Raises: ValueError: if dirname is not provided BadIncludedFileError: if the file being included does not exist or is not in the same directory. z4dirname must be provided in order to include a file.Nz-May only include files in the same directory.z+Not respecting `#!include` directive: [%s].r$) ValueErrorfindrulen_GCLOUDIGNORE_PATH_SEPrrinforRr7rgFromFilerGrrc text_type)r@rArXrz start_idx included_file included_patherrs rrwz FileChooser._GetIncludedPatterns"s(  M NN #001IS)?)?%@@ABM. 9 ;;  hh >> 5 s!3 445sB11 C:CCc tj|}|j |t jj||S#tj$r }tdj ||d}~wwxYw)a)Constructs a FileChooser from the given file path. See `gcloud topic gcloudignore` for details. Args: ignore_file_path: str, the path to the file in .gcloudignore format. recurse: int, how many layers of "#!include" directives to respect. 0 means don't respect the directives, 1 means to respect the directives, but *not* in any "#!include"d files, etc. Raises: BadIncludedFileError: if the file being included does not exist or is not in the same directory. Returns: FileChooser. z#Could not read ignore file [{}]: {}N)rXrz) r ReadFileContentsErrorrr=r?rRr7rX)r@ignore_file_pathrzryrs rrzFileChooser.FromFileGs~&O  # #$4 5d >>$8H(I")  ++ ;;O  / 6 67G M OOOsAA;A66A;rBT)rN)r$) rrrrrur2rPr^rqrCr?rwrrrrrErEsc#@.$(L@"5"5H++rrEc|Dcgc]"}tjj||$}}tt tjj |Scc}wr-)rRr7rganyr exists) directorynamesnamefiles_to_checks rAnyFileOrDirExistsrcsE>CDedBGGLLD1e.D S 0 11Es'Ac"t|tSr-)r GIT_FILES)rs r_GitFilesExistrhs Iy 11rTc|}|rBtjjtjj|dr|dz }|S)Nrz#!include:.gitignore )rRr7rrg)default_ignore_filerinclude_gitignoreignore_file_contentss r_GetIgnoreFileContentsrls@-277>>ggll9l+-44 rc|r!tjj||}nvtjj j js tjdtgStjj|t} tj|}tjdj||S#t$rYnwxYw||s tjdtgSt|||}tjdjd||r} t!j"||dtj$j'dnD#t j($r.} tjd j| Yd } ~ nd } ~ wwxYwtj+|d | S) aGets the FileChooser object for the given directory. In order of preference: - If ignore_file is not none, use it to skip files. If the specified file does not exist, raise error. - Use .gcloudignore file in the top-level directory. - Evaluates creation predicate to determine whether to generate .gcloudignore. include_gitignore determines whether the generated .gcloudignore will include the user's .gitignore if one exists. If the directory is not writable, the file chooser corresponding to the ignore file that would have been generated is used. - If the creation predicate evaluates to false, returned FileChooser will choose all files. Args: directory: str, the path of the top-level directory to upload default_ignore_file: str, the ignore file to use if one is not found (and the directory has Git files). write_on_disk: bool, whether to save the generated gcloudignore to disk. gcloud_ignore_creation_predicate: one argument function, indicating if a .gcloudignore file should be created. The argument is the path of the directory that would contain the .gcloudignore file. By default .gcloudignore file will be created if and only if the directory contains .gitignore file or .git directory. include_gitignore: bool, whether the generated gcloudignore should include the user's .gitignore if present. ignore_file: custom ignore_file name. Override .gcloudignore file to customize files to be skipped. Raises: BadIncludedFileError: if a file being included does not exist or is not in the same directory. Returns: FileChooser: the FileChooser for the directory. If there is no .gcloudignore file and it can't be created the returned FileChooser will choose all files. zGNot using a .gcloudignore file since gcloudignore is globally disabled.zUsing ignore file at [{}].zNot using ignore file.z,Using default gcloudignore file: {0} {1} {0}z2--------------------------------------------------F) overwritezHCreated .gcloudignore file. See `gcloud topic gcloudignore` for details.z&Could not write .gcloudignore file: {}Nr$)rzrX)rRr7rgr VALUES gcloudignoreenabledGetBoolrrrEIGNORE_FILE_NAMErr=rrr WriteFileContentsstatusPrintrr?) rr write_on_disk gcloud_ignore_creation_predicater ignore_filegcloudignore_pathchooserignore_contentsrs rGetFileChooserForDirrvsT Y <    ) ) 1 1 9 9 ; hh _ Y0@A""#45GHH ) 0 01B CD N   *) 4HH %& r?*+> +<>/(( < C C:O MN5 /(-/  jj45 ;;E hh7>>sCDDE   I  NNs*C C"!C"E::F; $F66F;r)'r __future__rrrrRenumgooglecloudsdk.command_lib.utilrgooglecloudsdk.corerrr googlecloudsdk.core.utilr r rc six.movesr rrDEFAULT_IGNORE_FILEr_ENDS_IN_ODD_NUMBER_SLASHES_RE Exceptionrrrrr!Enumr#objectr+rErrrrrrrrs '' 0*#*-* " \ "  !52)2;&;;:++;7z''7 DII .