dZddlmZddlmZddlmZddlmZddlZddlZddlm Z ddlm Z dd l m Z dd l mZdd l mZGd d ej ZdZdZdZddZ d ddZ d ddZddZdZdZdZdZy)z'Hashing utilities for storage commands.)absolute_import) annotations)division)unicode_literalsN)errors)fast_crc32c_util) installers)files)hashingceZdZdZdZdZy) HashAlgorithmz&Algorithms available for hashing data.md5crc32cN)__name__ __module__ __qualname____doc__MD5CRC32C3lib/googlecloudsdk/command_lib/storage/hash_util.pyr r s. # &rr cLtj|jdS)z.Takes bytes and returns base64-encoded string.utf-8)encoding)base64 b64encodedecode) hash_bytess rget_base64_stringr 's!   * % , ,g , >>rcN|jd}tj|S)z.Takes base64-encoded string and returns bytes.r)encoder b64decode) hash_stringrs rget_bytes_from_base64_stringr%,s#!!'**   * %%rc4t|jS)zATakes hashlib object and returns base64-encoded digest as string.)r digest) hash_objects rget_base64_hash_digest_stringr)2s ;--/ 00rc|tjk(rtjS|tjk(rt j Sy)z3Returns a hash object for the given hash algorithm.N)r rr get_md5rr get_crc32c)hash_algorithms rget_hash_objectr.7s=}((( ?? }+++  & & (( rct|tjr#|dn|}|dn||z }|j||||S)z?Returns the hash for the given path and deferred crc32c object.r)offsetlength) isinstancerDeferredCrc32csum_file)pathr(startstopr0r1s r_get_hash_for_deferred_crc32cr8@sJ -<<=-QUF,QD6MFfV< rct|}|yt|tjrt ||||S|j ||S)agReturns the hash object for the given data chunk or file. For MD5 and FastCRC32C, this function will return a hash object after hashing the given data chunk. For DeferredCRC32C, this function will return the deferred hash object from the given file path. Args: path (str): The file path. data (bytes): The data chunk to hash. hash_algorithm (HashAlgorithm): The algorithm to use for hashing. start (int|None): Optional byte index to start hashing from. stop (int|None): Optional byte index to stop hashing at. Returns: A hash object or None if the algorithm is not supported. N)r.r2rr3r8update)r5datar-r6r7r(s r get_hash_from_data_chunk_or_filer<NsM& /+  -<<= ({E4 HH T rc>t|}|yt|tjrt ||||St j |5}|r|j| |r|j|k\rn|$|jtjz|krtj}n||jz }|j|}|sn3t|tr|jd}|j|ddd|S#1swY|SxYw)aWReads file and returns its hash object. core.util.files.Checksum does similar things but is different enough to merit this function. The primary differences are that this function: -Uses a FIPS-safe MD5 object. -Accomodates gcloud_crc32c, which uses a Go binary for hashing. -Supports start and end index to set byte range for hashing. Args: path (str): File to read. hash_algorithm (HashAlgorithm): Algorithm to hash file with. start (int|None): Byte index to start hashing at. stop (int|None): Stop hashing at this byte index. Returns: Hash object for file. Nr)r.r2rr3r8r BinaryFileReaderseektellr WRITE_BUFFER_SIZEreadstrr"r:)r5r-r6r7r(stream bytes_to_readr;s rget_hash_from_filerFjs$ /+  -<<= ({E4 HH d#v  kk%  &++-4'  )E)EEL"44 v{{}, [[ 'd  D# {{7#% $. /$. s B L NN%rcP|jD]}|j|y)z?Updates every hash object with new data in a dict of digesters.N)valuesr:) digestersr;r(s rupdate_digestersrQs#%%'kt(rcDi}|D]}||j||<|S)zBReturns copy of provided digesters since deepcopying doesn't work.)copy)rPresultr-s rcopy_digestersrUs. &!n&~6;;=F>" -rc|D]y}|tjurtj||<-|tjurt j ||<Wtjdj|y)z>Clears the data from every hash object in a dict of digesters.z-Unknown hash algorithm found in digesters: {}N) r rr r+rrr,rErrorrI)rPr-s rreset_digestersrXsk!n***")//"3i =// /"2"="="?i LL 9 @ @ P  "r)r-r )NN)r5rCr(zfast_crc32c_util.DeferredCrc32creturnz int | None)r5rCr;bytesr-r )r __future__rrrrrenum"googlecloudsdk.command_lib.storagerrgooglecloudsdk.core.updaterr googlecloudsdk.core.utilr r Enumr r r%r)r.r8r<rFrMrQrUrXrrrras.&"' 5?2*,DII? & 1     0   MQ ,980fN"  r