JdZddlmZddlmZddlmZddlmZddlmZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlmZdd lmZdd lmZdd lmZdd lmZdd lmZesddlZddlZe j6reZdZdZdZ dZ!dZ"dZ#dZ$dZ%e jLdZ'dZ(dZ)dZ*dZ+dZ,dZ-dZ.dZ/dZ0da1e2a3Gdde4Z5Gd d!e4Z6d"Z7d#Z8 d1d$Z9d%Z:d&Z;d'Zd*Z?d+Z@d,ZAd-ZBd.ZCd/ZDd0ZEy)3zHelper file for POSIX methods.)absolute_import)print_function)division)unicode_literals)timegmN)CommandException)UTC)CreateCustomMetadata) GetValueFromObjectCustomMetadata) IS_WINDOWS)SECONDS_PER_DAYzgoog-reserved-file-atimezgoog-reserved-posix-gidzgoog-reserved-posix-modezgoog-reserved-file-mtimezgoog-reserved-posix-uidz ^[0-7]{3}$@ c"eZdZdZeeeedfdZy)POSIXAttributesz1Class to hold POSIX attributes for a file/object.Nc||_||_||_||_t |r ||_yt |_y)a6Constructor for POSIXAttributes class which holds relevant data. Args: atime: The access time of the file/object. mtime: The modification time of the file/object. uid: The user ID that owns the file. gid: The group ID that the user is in. mode: An instance of POSIXMode. N)atimemtimeuidgid POSIXModeNA_MODEmode)selfrrrrr!s )platform/gsutil/gslib/utils/posix_util.py__init__zPOSIXAttributes.__init__Vs7DJDJDHDH$$4DIG4DI)__name__ __module__ __qualname____doc__NA_TIMENA_IDr$r%r#rrSs9 5r%rceZdZdZy)rc||_y)N) permissions)r"r/s r#r$zPOSIXMode.__init__ns "Dr%N)r&r'r(r$r,r%r#rrls#r%rc0tt|ddS)z7Converts a base-10 mode integer from os.stat to base-8.N)intoctr!s r#ConvertModeToBase8r5rs SYrs^ r%cvt}t|tt\}} t |}|r|tkrt d|t}n9|t t j tzkDrtd|t}||_ t|t||t|t||t|tt \}}|r1t"j%|r t't)||_|S|S#t$rtd|t}YwxYw#t$rtd|Y|SwxYw)aAParses the POSIX attributes from the supplied metadata. Args: obj_metadata: The metadata for an object. url_str: File/object path that provides context if a warning is thrown. Returns: A POSIXAttribute object with the retrieved values or a default value for any attribute that could not be found. rr!)rr ATIME_ATTRr*longWarnNegativeAttributetimer WarnFutureTimestamp ValueErrorWarnInvalidValuerDeserializeIDAttributeGID_ATTRUID_ATTR MODE_ATTRr MODE_REGEXmatchrr2r!) obj_metadataurl_str posix_attrsfoundrr!s r#+DeserializeFileAttributesFromObjectMetadatarHys !+1, 29;,%  KE '!GW-e diik"_4 4'7+e+x+Fx+F0y18:+% z%("3t9-k ! Wg& E (vw' (s$A"C>!D>DDD87D8c|jtk7rtt|ji||r|jtk7rtt |ji||j tk7rtt|j i||jtk7rtt|ji||jjtk7r(tt|jji|yyy)a+Takes a POSIXAttributes object and serializes it into custom metadata. Args: posix_attrs: A POSIXAttributes object. custom_metadata: A custom metadata object to serialize values into. preserve_posix: Whether or not to preserve POSIX attributes other than mtime. )entriescustom_metadataN)rr*r MTIME_ATTRrr7rr+r@rr?r!r/r rA)rFrKpreserve_posixs r#'SerializeFileAttributesToObjectMetadatarNs'!*k.?.?!@)8:G#J 0A0A#B+:<%Hkoo#>+:<%Hkoo#>+:<##w.I{/?/?/K/K#L+:</r%c|jdd}t||t\}} t|}|r|tkrt ||t}t|||y#t $rt ||t}Y+wxYw)aParses the POSIX attributes from the supplied metadata into posix_attrs. Args: obj_metadata: The metadata for an object. attr: Either GID_ATTR or UID_ATTR. url_str: File/object path that provides context if a warning is thrown. posix_attrs: POSIXAttribute object. -rN)splitr r+r2r9r<r=setattr)rDattrrErF attr_namerGvals r#r>r>s|jjob!)/ dEJ*% c(C Iw/ c +y#& Y( Cs(A A>=A>c t} |tkD} |tkD} |tkD} |tkD}|tkD}|tkD}|tkD}|tkD}|tkD}| tkD}| r | s|| _| r |s|| _|r |s|| _|r |s|| _|r|s|| j_ | | xr| xs"| xr| xs|xr| xs|xr| xs|xr| fS)a;Checks whether an update for any POSIX attribute is needed. Args: src_atime: The source access time. dst_atime: The destination access time. src_mtime: The source modification time. dst_mtime: The destination modification time. src_uid: The source user ID. dst_uid: The destination user ID. src_gid: The source group ID. dst_gid: The destination group ID. src_mode: The source mode. dst_mode: The destination mode. Returns: A tuple containing a POSIXAttribute object and a boolean for whether an update was needed. ) rr*r+r rrrrr!r/) src_atime dst_atime src_mtime dst_mtimesrc_uiddst_uidsrc_giddst_gidsrc_modedst_moderF has_src_atime has_dst_atime has_src_mtime has_dst_mtime has_src_uid has_dst_uid has_src_gid has_dst_gid has_src_mode has_dst_modes r#NeedsPOSIXAttributeUpdaterks * !+g%-g%-g%-g%-%+%+%+%+G#,G#,=!K=!KKOKO,#+K  ;m*;;%;m*;;#7K;$7K;%9\)9  <= 4. Args: mode: The mode as a 3-digit, base-8 integer. Returns: True/False r1N)rBrCr3U_RG_RO_Rr4s r#ValidatePOSIXModerp sC   #d)BC. ) ;tcz0:TCZ0:/3cz;r%ctry|tkD}t|tkD}|tkD}|s|s|syt j dk(ryt tt|d}|r |sdd|zfStt}|r tj||r tj||t jk(}tt|d}|s,|r*|r(t!|t"zsdd||t%|d d fzfS|r-t!|t"z} | | rd fSd ||t%|d d fzfSt|t&vr-t!|t(z} | | rd fSd||t%|d d fzfS|t*zry|s|s|rydd |zfS#ttf$r dd||fzfcYSwxYw#ttf$r dd||fzfcYSwxYw)aValidates that the user has file access if uid, gid, and mode are applied. Args: url_str: The path to the object for which this is validating. uid: A POSIX user ID. gid: A POSIX group ID. mode: A 3-digit, number representing POSIX permissions, must be in base-8. Returns: A (bool, str) tuple, True if and only if it's safe to copy the file, and a string containing details for the error. )TrrFz$Mode for %s won't allow read access.z3UID for %s doesn't exist on current system. uid: %dz3GID for %s doesn't exist on current system. gid: %dz?Insufficient access with uid/gid/mode for %s, gid: %d, mode: %sr1Nrrz?Insufficient access with uid/gid/mode for %s, uid: %d, mode: %sz"There was a problem validating %s.)r r+r2r osgeteuidrpstrSYSTEM_POSIX_MODEpwdgetpwuidKeyError OverflowErrorgrpgetgrgidgetuidboolrmr3 USER_GROUPSrnro) rErrr! uid_present gid_present mode_present mode_validuid_is_current_uservalids r#ValidateFilePermissionAccessrs8 e +C5 +,  ZZ\Q  SY!23*  ;gE EE  !D ll3 ll3ryy{* SY $ d4#:>N !3D "#78 99  E 2 99 !3D "#7 8 99 3x;  E 2 99 !3D "#7 8 99 cz  {z  4w> >>S m $Kn m $Kns$FF0F-,F-0G  G c|td|z t|tt\}}t|tt\}}t|t t \}} t|tt \} } t|tt\} } |rEt|}|sgtj|j}tj|||fy|r-t|j }tj|||f|sy|r t|}|tkDr"|tkDrtj|||fn|tkDrA|tkr8tj|j"}tj|||fnI|tkr@|tkDr7tj|j}tj|||ft$ry|r#tj&dk(r t)| } nt } | r t)| } | t kDr!| t kDrtj*|| | nS| t kDr!| t krtj*|| dn)| t kr | t kDrtj*|d| | r,t)t-| d} tj.|| yy#t0$rtd|j2zwxYw)aParses POSIX attributes from obj_metadata and sets them. Attributes will only be set if they exist in custom metadata. This function should only be called after ValidateFilePermissionAccess has been called for the specific file/object so as not to orphan files. Args: path: The local filesystem path for the file. Valid metadata attributes will be set for the file located at path, some attributes will only be set if preserve_posix is set to True. obj_metadata: The metadata for the file/object. is_rsync: Whether or not the caller is the rsync command. Used to determine if timeCreated should be used. preserve_posix: Whether or not all POSIX attributes should be set. Nz"obj_metadata cannot be None for %s) default_valuerrrz#Check POSIX attribute values for %s)rr r7r*rLr@r+r?rAr r8rsstatst_atimeutimeConvertDatetimeToPOSIX timeCreatedst_mtimer rtr2chownruchmodr<name)pathrDis_rsyncrMfound_atrfound_mtr found_uidr found_gidr found_moder! atime_tmp mtime_tmps r#ParseAndSetPOSIXAttributesrosu& ?$F GGE.6|7AELNOHe7|7AELNOHe6l6>DIKNIs6l6>DIKNIs8 8AFMOJ5ke GGDM**   5)* $\%=%=>ehhteU^$  5ke w57?hhteU^$ Ug-''$-((ihhteY'( ' ego''$-((ihhti'( RZZ\Q& Hc c Hc U{sU{hhtS# uhhtS" #+hhtR TA dhhtT . @',,- ...s CJ>1J>CJ>C"J>>"K cNtjjd||y)zLogs if an attribute has a negative value. Args: attr_name: The name of the attribute to log. url_str: The path of the file for context. z$%s has a negative %s in its metadataNlogging getLoggerwarnrTrEs r#r9r9# A7$&r%cNtjjd||y)Logs if an attribute has an invalid value. Args: attr_name: The name of the attribute to log. url_str: The path of the file for context. z$%s has an invalid %s in its metadataNrrs r#r=r=rr%cNtjjd||y)rz5%s has an %s more than 1 day from current system timeNrrs r#r;r;s%  #r%cvtt|jtj S)aConverts a datetime object to UTC and formats as POSIX. Sanitize the timestamp returned in dt, and put it in UTC format. For more information see the UTC class. Args: dt: A Python datetime object. Returns: A POSIX timestamp according to UTC. )tzinfo)r8rreplacer timetuple)dts r#rrs* fRZZsuZ-779: ;;r%ctrdayd}tjd}tj|||z }t |dzdday)z.Records the default POSIX mode using os.umask.666Niir1)r rvrsumaskr3)max_permissions current_umaskr!s r#InitializeDefaultModersR /((5/-((= = ($$,',r%cLtrytj}tj|j }t tj|jgtjDcgc]}||jvs|jc}za ycc}w)zInitializes the set of groups that the user is in. Should only be called if the flag for preserving POSIX attributes is set. N) r rsr}rwrxpw_namesetpw_gidr{getgrallgr_memgr_gidr)user_id user_namegs r#InitializeUserGroupsrs|  IIK'll7#++) ||G##$AA9+@qxxABC+Bs 5B! B! c,tty)zrkrprrr9r=r;rrrrr,r%r#rsQ%&%' ,:F.1  77 $( $ & ' $    RZZ %          e 5f52## 'X',.