dZddlmZddlmZddlmZddlmZddlZddlZddlZejre Z gdZ gdZ d Zd Zd ezZd ezZd ezZd ezZd ezZe dZe\ZZdZdZdZdZdZddZdZdZdfdZ dZ!y)zCShared utility methods that calculate, convert, and simplify units.)absolute_import)print_function)division)unicode_literalsN))rBbit) KiBKibitK)MiBMibitM)GiBGibitG)(TiBTibitT)2PiBPibitP)<EiBEibitE))k)m) b) t)qc,d}g}i}ttD]K\}}t|ddDcgc]}|j}}|D]}|||< |j |M|dj |z}t j|}||fScc}w)z6Creates a suffix regex for human-readable byte counts.z'(?P\d*\.\d+|\d+)\s*(?P%s)?N|) enumerate _EXP_STRINGSlistlowerextendjoinrecompile) human_bytes_resuffixes suffix_to_siisis si_suffixessuffixmatchers (platform/gsutil/gslib/utils/unit_util.py_GenerateSuffixRegexr@3s=. (,&ea&*2hqrl3l1779lK3l6 OOK ' CHHX&&. JJ~ &' w  4sBir iQcd}|dzttkrE|dt|dzdzk\r0|dz }|dzttkr|dt|dzdzk\r0|tt|dt|dzz dfS)Nrr,rA@)lenr/roundfloat)numr9s r?_RoundToNearestExponentrIQs! AL!!caa!e1DQ1G.G&HFA AL!!caa!e1DQ1G.G&H E%*sLOA$666 : ::c>|dkrd}t|t|z S)aCalculates throughput and checks for a small total_elapsed_time. Args: total_bytes_transferred: Total bytes transferred in a period of time. total_elapsed_time: The amount of time elapsed in seconds. Returns: The throughput as a float. g{Gz?)rG)total_bytes_transferredtotal_elapsed_times r?CalculateThroughputrNXs)$ & '%0B*C CCrJcttD](\}}|d|zk\sdt|d|zz z}||zcSt|S)aCreates a shorter string version for a given number of objects. Args: num: The number of objects to be shortened. Returns: shortened string version for this number. It takes the largest scale (thousand, million or billion) smaller than the number and divides it by that scale, indicated by a suffix with one decimal place. This will thus create a string of at most 6 characters, assuming num < 10^18. Example: 123456789 => 123.4m r z%.1lf)reversed_EXP_TEN_STRINGrGstr)rH divisor_expr=quotients r? DecimalShortrUgsQ&o6k6 b+oE#J[89h  7 S/rJc*||z}||zdk7r|dz }|S)aReturns ceil(dividend / divisor). Takes care to avoid the pitfalls of floating point arithmetic that could otherwise yield the wrong result for large numbers. Args: dividend: Dividend for the operation. divisor: Divisor for the operation. Returns: Quotient. rr,)dividenddivisorrTs r? DivideAndCeilrZzs) (Q MH /rJcB|j}tj|}|rkt|j d}|j dr*t t |j dd}|d|zz}tt|}|Std|z)zTries to convert a human-readable string to a number of bytes. Args: human_string: A string supplied by user, e.g. '1M', '3 GiB'. Returns: An integer containing the number of bytes. Raises: ValueError: on an invalid string. rHr=rrDz!Invalid byte string specified: %s) r1MATCH_HUMAN_BYTESmatchrGgroupr/ SUFFIX_TO_SIintrF ValueError) human_stringr$rHpowers r?HumanReadableToBytesrds##%,l+!  Cwwx<(9:;A>e c5jc eCj/C J6EFFrJc 0t|j}ttt d|zt |dz}|dk(rd|rdd|zzndz|d<n&t |}|r|d||z dz|||z dz}||d<dj|S)a Creates a human readable format for bytes with fixed decimal places. Args: number: The number of bytes. decimal_places: The number of decimal places. Returns: String representing a readable format for number with decimal_places decimal places. r r0.N )MakeHumanReadablesplitrRr`rFrGrEr3)numberdecimal_places number_formatrH num_lengths r?HumanReadableWithDecimalPlacesrps$F+113- Cb.(5q1A+BBC DE#CZ5C/1IKMM!SJ -*~- . 4 n,- ./cM! -  rJc@t|\}}d|t|dfzS)zGenerates human readable string for a number of bits. Args: num: The number, in bits. Returns: A string form of the number using bit size abbreviations (kbit, Mbit, etc.) %g %srArIr/rHr9 rounded_vals r?MakeBitsHumanReadablerv++3/.![ Ka!34 44rJc@t|\}}d|t|dfzS)zGenerates human readable string for a number of bytes. Args: num: The number, in bytes. Returns: A string form of the number using size abbreviations (KiB, MiB, etc.). rrr,rsrts r?rjrjrwrJc|S)NrW)xs r?r{sarJc"|syt|dz |z}tj|}tj|}||k(r||t |S||t |||z z}||t |||z z}||zS)aFind the percentile of a list of values. Taken from: http://code.activestate.com/recipes/511478/ Args: values: a list of numeric values. Note that the values MUST BE already sorted. percent: a float value from 0.0 to 1.0. key: optional key function to compute value from each element of the list of values. Returns: The percentile of the values. Nr,)rEmathfloorceilr`)valuespercentkeyr"fcd0d1s r? Percentilers   6{Q'!! jjm! iil!!V vc!f~  6#a&>a!e$" 6#a&>a!e$" b.rJctt|}|dz}|dk\rdt|dzS|d|zz}|dz}|d|zz}|}td|zdztd|zzdztd|zzS)aDCreates a standard version for a given remaining time in seconds. Created over using strftime because strftime seems to be more suitable for a datetime object, rather than just a number of seconds remaining. Args: remaining_time: The number of seconds remaining as a float, or a string/None value indicating time was not correctly calculated. Returns: if remaining_time is a valid float, %H:%M:%D time remaining format with the nearest integer from remaining_time (%H might be higher than 23). Else, it returns the same message it received. idz%d+ hrsirz%02d:)r`rFminrR)remaining_timehoursminutessecondss r? PrettyTimersu^,-. D % c\ s5# &&TE\". b 'R'\". ' fun  #c&7*:&; ;c A fw  !rJ)r,)"__doc__ __future__rrrrr}r4sixPY3r`longr/rQr@ONE_KIBONE_MIBONE_GIBTWO_MIB EIGHT_MIBTEN_MIBSECONDS_PER_DAYr_r\rIrNrUrZrdrprvrjrrrWrJr?rsJ&%' 77 $  "  . . g+ K w,|$"6"8 ; D&&G,!2 5 5%06!rJ