"dZddlmZddlmZddlmZddlmZddlZddlZddlZddl m Z ddl m Z dd l mZGd d eZy) z-Helper class for streaming resumable uploads.)absolute_import)print_function)division)unicode_literalsN)CommandException)GetJsonResumableChunkSize)UTF8c`eZdZdZd dZedZd dZdZdZ e jfdZ dZ y ) #ResumableStreamingJsonUploadWrappera#Wraps an input stream in a buffer for resumable uploads. This class takes a non-seekable input stream, buffers it, and exposes it as a stream with limited seek capabilities such that it can be used in a resumable JSON API upload. max_buffer_size bytes of buffering is supported. c||_|s'|tkrtd|dtd||_t j |_d|_d|_d|_ y)avInitializes the wrapper. Args: stream: Input stream. max_buffer_size: Maximum size of internal buffer; should be >= the chunk size of the resumable upload API to ensure that at least one full chunk write can be replayed in the event of a server error. test_small_buffer: Skip check for buffer size vs. chunk size, for testing. z4Resumable streaming upload created with buffer size z#, JSON resumable upload chunk size z`. Buffer size must be >= JSON resumable upload chunk size to ensure that uploads can be resumed.rN) _orig_fprr_max_buffer_size collectionsdeque_buffer _buffer_start _buffer_end _position)selfstreammax_buffer_sizetest_small_buffers 3platform/gsutil/gslib/resumable_streaming_upload.py__init__z,ResumableStreamingJsonUploadWrapper.__init__)sjDM 3L3N!N  ./H/J L MM,D$$&DLDDDNc0t|jddS)z>rcy)z/Returns true since limited seek support exists.Trs rseekablez,ResumableStreamingJsonUploadWrapper.seekables rc |tjk(rO||jks||jkDr)t d|d|jd|jd||_y |tj k(ry||jkDrt d|d|jd|j|jr |j|jr|xj |zc_y t d|d |d ) zSeeks on the buffered stream. Args: offset: The offset to seek to; must be within the buffer bounds. whence: Must be os.SEEK_SET. Raises: CommandException if an unsupported seek mode or position is used. z]Unable to resume upload because of limited buffering available for streaming uploads. Offset z# was requested, but only data from z to z is buffered.zInvalid SEEK_END offset z on streaming upload. Only z can be buffered.z-Invalid seek mode on streaming upload. (mode z , offset )N) osSEEK_SETrrrrSEEK_ENDrr%)roffsetwhences rseekz(ResumableStreamingJsonUploadWrapper.seeks $$$ $1A1A(A!'(:(:DrXs64&%' ,;&x!&x!r