dZddlmZddlmZddlmZddlmZddlZddlZddlm Z ddl m Z dd l m Z dd l mZdd lmZdd lmZdd lmZddlmZddlmZgdZGddeZy)z)Helper for cat and cp streaming download.)absolute_import)print_function)division)unicode_literalsN)config)EncryptionException)CommandException)NO_URLS_MATCHED_TARGET)StorageUrlFromString)CryptoKeyWrapperFromKey)FindMatchingCSEKInBotoConfig)ObjectIsGzipEncoded) text_util)bucketcontentEncodingcrc32ccustomerEncryption generationmd5Hashnamesizec,eZdZdZdZdZ ddZy) CatHelperzDProvides methods for the "cat" command and associated functionality.c||_y)zmInitializes the helper object. Args: command_obj: gsutil command instance of calling command. N) command_obj)selfrs )platform/gsutil/gslib/utils/cat_helper.py__init__zCatHelper.__init__3s #Dcv |jtj}|sytj||9)aCopies contents of the source to the destination via buffered IO. Buffered reads are necessary in the case where you're reading from a source that produces more data than can fit into memory all at once. This method does not close either file when finished. Args: src_fd: The already-open source file to read from. dst_fd: The already-open destination file to write to. N)readioDEFAULT_BUFFER_SIZEr write_to_fd)rsrc_fddst_fdbufs r_WriteBytesBufferedFileToFilez'CatHelper._WriteBytesBufferedFileToFile;s6  KK.. /c  FC( rNcd}|tj}tj}tjt_ |r)|ddvr"|jtj|n4|D].}d} |j j |jtD]} d} | jr| jjr| jjjrtt| jjjt} | s9td| jjjd| jt!| } d} |r|r t#t#d | zd}| j} dt%| d d cxkr|krnn|t_yt'| j}|j)r~t+| }|j j,j/| j0| j2||||| j4|j6| |j8 |j;t=|j>d 5}|j||ddd| rtAtB|z|t_y#1swYxYw#|t_wxYw)aPrints each of the url strings to stdout. Args: url_strings: String iterable. show_header: If true, print a header per file. start_byte: Starting byte of the file to print, used for constructing range requests. end_byte: Ending byte of the file to print; used for constructing range requests. If this is negative, the start_byte is ignored and and end range is sent over HTTP (such as range: bytes -9) cat_out_fd: File descriptor to which output should be written. Defaults to stdout if no file descriptor is supplied. Returns: 0 on success. Raises: CommandException if no URLs can be found. FNr)-zfile://-)bucket_listing_fieldsz(Missing decryption key with SHA256 hash z#. No decryption key matches object Tz ==> %s <==r)compressed_encoding start_byteend_byte object_sizerdecryption_tupleproviderrb)"sysstdoutstderrr(stdinrWildcardIterator IterObjects_CAT_BUCKET_LISTING_FIELDS root_objectr keySha256r rr url_stringr printgetattrr IsCloudUrlr gsutil_apiGetObjectMediarrrrschemeflushopen object_namer r )r url_strings show_headerr.r/ cat_out_fd printed_one old_stdouturl_str did_some_workblrdecryption_keywrapperdecryption_key cat_object storage_urlr-fs r CatUrlStringszCatHelper.CatUrlStringsLsb0K::jJCJ7 Q+<< **399jA"G-%%66w?KK$>L@c$( !COO$F$F22<<;//44>> Hn#)__77AA^^%&& '>n&M# ML3&' kJ7:vr2@j@.cj-/s~~>K%%'$7 $C!))88##//&9'#(oo(33#8&--9 /  //6!221jA76W@Z"#9G#CD Dc#fcj 76 cjs1E%J70B9J7)J*< J7 J7*J4 /J77 K)FrNN)__name__ __module__ __qualname____doc__rr(rTrrrr0s#L#)&!& !# [ rr)rX __future__rrrrr"r4botorgslib.cloud_apirgslib.exceptionr r gslib.storage_urlr gslib.utils.encryption_helperr r gslib.utils.metadata_utilr gslib.utilsrr:objectrrYrrrcsM0&%' /,22AF9! w w r