dZddlmZddlmZddlmZddlmZddlZddlZddlZddl m Z ddl m Z d d Z dd Zd d Zd Zy)z/Helper functions for Cloud API implementations.)absolute_import)print_function)division)unicode_literalsN)ArgumentException)AddQueryParamToUrlc"|xs |jS)aGets a gsutil Cloud API instance. Since Cloud API implementations are not guaranteed to be thread-safe, each thread needs its own instance. These instances are passed to each thread via the thread pool logic in command. Args: cls: Command class to be used for single-threaded case. thread_state: Per thread state from this thread containing a gsutil Cloud API instance. Returns: gsutil Cloud API instance. ) gsutil_api)cls thread_states /platform/gsutil/gslib/utils/cloud_api_helper.pyGetCloudApiInstancers  ''c|j}|r t|d|}tjr!t |t r|j d}d||j|d}tj|S)aReturns download serialization data. There are five entries: auto_transfer: JSON-specific field, always False. progress: How much of the download has already been completed. total_size: Total object size. url: Implementation-specific field used for saving a metadata get call. For JSON, this the download URL of the object. For XML, this is a pickled boto key. user_project: Project to be billed to, added as query param. Args: src_obj_metadata: Object to be downloaded. progress: See above. user_project: User project to add to query string. Returns: Serialization data for use with Cloud API GetObjectMedia. userProjectasciiFalse) auto_transferprogress total_sizeurl) mediaLinkrsixPY3 isinstancebytesdecodesizejsondumps)src_obj_metadatar user_projectrserialization_dicts r GetDownloadSerializationDatar$1sm. ""# S- >CWW#u JJw c$))   & ''rc|r>t}|D]-}|dvr|jtjdd|/|Sy)aRemoves 'items/' from the input fields and converts it to a set. Args: list_fields: Iterable fields usable in ListBuckets/ListObjects calls. Returns: Set of fields usable in GetBucket/GetObjectMetadata calls (None implies all fields should be returned). )kind nextPageTokenprefixeszitems/N)setaddresub) list_fields get_fieldsfields r ListToGetFieldsr1ZsLJ 7 7 nnRVVIr512  rcz|s td|js td|js tdy)zEnsures dst_obj_metadata supplies the needed fields for copy and insert. Args: dst_obj_metadata: Metadata to validate. Raises: ArgumentException if metadata is invalid. z3No object metadata supplied for destination object.zCObject metadata supplied for destination object had no object name.zCObject metadata supplied for destination object had no bucket name.N)rnamebucket)dst_obj_metadatas r ValidateDstObjectMetadatar6osR  = ??    M OO  M OO !r)N)rN)__doc__ __future__rrrrrr,rgslib.cloud_apirgslib.utils.text_utilrrr$r1r6rr r<sC6&%' -4(&+,.2&(R*Or