3ddlZddlZddlmZddlmZddlmZddlmZddlmZddlm Z ddlm Z dd lm Z Gd d eZ Gd d eZ GddeZy)N)Task)SubmissionTask)CreateMultipartUploadTask)CompleteMultipartUploadTask) get_callbacks)calculate_range_parameter)get_filtered_dict)ChunksizeAdjusterc feZdZdZdddddddd d Zgd Zgd Zd gZd ZdZ dZ dZ dZ dZ dZy)CopySubmissionTaskz+Task for submitting tasks to execute a copyIfMatchIfModifiedSince IfNoneMatchIfUnmodifiedSinceSSECustomerKeySSECustomerAlgorithmSSECustomerKeyMD5 RequestPayer)CopySourceIfMatchCopySourceIfModifiedSinceCopySourceIfNoneMatchCopySourceIfUnmodifiedSinceCopySourceSSECustomerKeyCopySourceSSECustomerAlgorithmCopySourceSSECustomerKeyMD5r) rrrrrrrrrrr) rrrrrrrMetadataDirectiveTaggingDirectivec,|jj|jj}|j|j}|j }|j D]&\} } | |jvs| ||j| <(|jjdi|} |jj| d|jj|jkr|j|||||y|j|||||y)a :param client: The client associated with the transfer manager :type config: s3transfer.manager.TransferConfig :param config: The transfer config associated with the transfer manager :type osutil: s3transfer.utils.OSUtil :param osutil: The os utility associated to the transfer manager :type request_executor: s3transfer.futures.BoundedExecutor :param request_executor: The request executor associated with the transfer manager :type transfer_future: s3transfer.futures.TransferFuture :param transfer_future: The transfer future associated with the transfer request that tasks are being submitted for N ContentLength)metasize call_args)_get_head_object_request_from_copy_source copy_source extra_argsitemsEXTRA_ARGS_TO_HEAD_ARGS_MAPPING source_client head_objectprovide_transfer_sizemultipart_threshold_submit_copy_request_submit_multipart_request) selfclientconfigosutilrequest_executortransfer_futurer#head_object_requestr&paramvalueresponses $lib/third_party/s3transfer/copies.py_submitzCopySubmissionTask._submitFs'*    $ $ , (,,66I>>))+ #--J!+ 0 0 2 uD@@@GL(<r?r&r")r/r0r1r2r3r4r#progress_callbackss r9r-z'CopySubmissionTask._submit_copy_request|s#((22 +?JG ""))  %)%?%?$#,#8#8'..$=="+"6"6!3+0055  r;c|jj}i}|jjD]\}} ||jvs| ||<|j j |t|j ||j|j|d} |j} t} | j| |jj} ttj |jjt#| z } g}t%|d}t'd| dzD]}|j)|j}t+| |dz | |jj|d<|j-| |dz | |jj}|j/|j j |t1|j ||j2|j|j||||dd| i|j5|j}|j j |t7|j ||j|j|d| |d d y) N)r0r>r?r&)rArBr=CopySourceRange)r0r%r>r? part_numberr&r@r" upload_id)rArBpending_main_kwargs)rLpartsT)rArBrMrC)r!r#r&r'CREATE_MULTIPART_ARGS_BLACKLISTrDrErr>r?multipart_chunksizer adjust_chunksizer"intmathceilfloatrrange_extra_upload_part_argsr_get_transfer_sizeappend CopyPartTaskr%_extra_complete_multipart_argsr)r/r0r1r2r3r4r#create_multipart_extra_argsr6valcreate_multipart_future part_sizeadjuster num_parts part_futuresrGrKextra_part_argsr"complete_multipart_extra_argss r9r.z,CopySubmissionTask._submit_multipart_requests|#((22 ')##..446JE3D@@@58+E27#'"<"<"C"C  %%)%?%?$'..$=="=   # .. $&-- ++002  IIo**//% 2BB CE  *?JG IM2K"::$$&O 2K;q=)_5I5I5N5N2PO- .**;q=)_5I5I5N5ND   **11$ -1-G-G&,+4+@+@&/&6&6#,==+6*9);$( %()@- 3F)-(K(K  )"% ""))  '%)%?%?$'..$=="? "9)%  r;ct|trtj|Std|dt |d)NzLExpecting dictionary formatted: {"Bucket": bucket_name, "Key": key} but got z or type .) isinstancedictcopy TypeErrortype)r/r%s r9r$zr?r&r@r"callbacks r9_mainzCopyObjectTask._mains=  J"6s J>H J!H t ,"r;Nrurvrwrxrr r;r9rFrFs (-r;rFceZdZdZdZy)rZz)Task to upload a part in a multipart copyc l|jd|||||d|} |D] } | |  | dd} | |dS)a :param client: The client to use when calling PutObject :param copy_source: The CopySource parameter to use :param bucket: The name of the bucket to upload to :param key: The name of the key to upload to :param upload_id: The id of the upload :param part_number: The number representing the part of the multipart upload :param extra_args: A dictionary of any extra arguments that may be used in the upload. :param callbacks: List of callbacks to call after copy part :param size: The size of the transfer. This value is passed into the callbacks :rtype: dict :returns: A dictionary representing a part:: {'Etag': etag_value, 'PartNumber': part_number} This value can be appended to a list to be used to complete the multipart upload. )r{r|r}UploadId PartNumberr~CopyPartResultETag)rrr )upload_part_copy) r/r0r%r>r?rLrKr&r@r"r8retags r9rzCopyPartTask._main&sa0+6**F"6s;F:DF"H t ,"()&1K88r;Nrr r;r9rZrZ$s 39r;rZ)rirSs3transfer.tasksrrrrs3transfer.utilsrrr r r rFrZr r;r9rsL !+68*6..qqh-T-, 94 9r;