d5dZddlmZddlmZddlmZddlZddlZddlmZddl m Z ddl m Z dd l m Z dd l mZdd l mZdd l mZdd l mZddl mZddl mZddlmZddlmZddlmZddlmZddlmZddlmZddlmZgdZgdZ dgZ!GddejDZ#dZ$dZ%dZ&dZ'd Z(d!Z)d"Z*e jVGd#d$e jXZ-y)%zDImplementation of Unix-like cat command for cloud storage providers.)absolute_import)division)unicode_literalsN) cloud_api) arg_parsers)base)errors) errors_util)flags)stdin_iterator) storage_url)user_request_args_factory)wildcard_iterator) task_executor)task_graph_executor) task_status)restore_bucket_task)bulk_restore_objects_task)restore_object_task)log)allow_overwritecreated_after_timecreated_before_timedeleted_after_timedeleted_before_time) all_versionsrrrrr asyncronousrceZdZdZdZy) ExecutionMode Asynchronous SynchronousN)__name__ __module__ __qualname__ ASYNCHRONOUS SYNCHRONOUSlib/surface/storage/restore.pyrr@s ,+r(rc|D]=}t||stjdj|j|y)aRRaises error if invalid combination of flags found in user input. Args: args (parser_extensions.Namespace): User input object. execution_mode (ExecutionMode): Determined by presence of --async flag. invalid_flags (list[str]): Flags as `args` attributes. Raises: error.Error: Flag incompatible with execution mode. zB{} execution does not support flag: {}. See help text with --help.N)getattrr Errorformatvalue)argsexecution_mode invalid_flags invalid_flags r)"_raise_if_invalid_flag_combinationr3EsC$lt\" LL ((.""L)  $r(ct|rag}tD] }t||s|j|"|r3t j dj dj|yy)zRaises error if invalid combination of flags found in user input for bucket restore. Args: url: CloudUrl object. args: (parser_extensions.Namespace): User input object. Raises: Error: Flags incompatible with execution mode. zSBucket restore does not support the following flags: {}. See help text with --help.z, N)_is_bucket_restore_INVALID_BUCKET_RESTORE_FLAGSr+appendr r,r-join)urlr/invalid_flags_foundr2s r)0_raise_error_if_invalid_flags_for_bucket_restorer;Zsm5 | $""<06 LL ((.tyy9L/M(N r(ct|tjxr2|jxr t j |j  S)N) isinstancer CloudUrl is_bucketrcontains_wildcard url_string)r9s r)r5r5rsAk**+B --/B11#..A Ar(c#Ktj|j|jD]I}t j |d}t ||tj|j||Kyw)z%Extracts, validates, and yields URLs.T)is_bucket_gen_parsing_allowedN) r get_urls_iterableurlsread_paths_from_stdinr storage_url_from_stringr;r raise_error_if_not_gcs command_path)r/rAr9s r) _url_iteratorrJzsh"44 ii++j  - -$ C5S$?&&t'8'8#> IsA8A:c #BKtjt}t|D]}t j |j s$tjdj||tj|j|jj|j|j!D]V\}}t#j$|||j&|j(|j*|j,|j.|Xyw)z"Yields non-blocking restore tasks.zBulk restores are long operations. For restoring a single object, you should probably use a synchronous restore without the --async flag. URL without wildcards: {})rrrrruser_request_argsN) collections defaultdictlistrJrr@rArwarningr-r r>scheme bucket_namer7 resource_nameitemsrBulkRestoreObjectsTaskrrrrr)r/rLbucket_to_globsr9 bucket_url object_globss r)_async_restore_task_iteratorrYs++D1/ 4 c  . .s~~ > kk AAG K((S__EFMM !#2"7"7"9j, # : :,,22 4422 44+  #:sDDc #Kd}t|D]}t|rtj|'t t j |j|tjjd}|s.tjdj|j|D]p}|jrtj ||(|rE|j"j$|j"j$k7rtj |||}r|rtj ||yyw)zYields blocking restore tasks.NT) fields_scope object_state files_onlyz*The following URLs matched no objects: -{})rJr5rRestoreBucketTaskrOrget_wildcard_iteratorrAr ObjectState SOFT_DELETEDr InvalidUrlErrorr-rrRestoreObjectTaskr versionless_url_string)r/r[rL last_resourcer9 resourcesresources r)_sync_restore_task_iteratorrhs*- 4 c#  1 1# 66// NN%"..;;  I   " " 7 > >s~~ N   !33H>OPP ))@@##::;$55.  ! !!:  / /( sD=D?c,|jrtjj}ntjj}t j |t jj}|jr t||St|||S)zYields restore tasks.) metadata_type) preserve_aclr FieldsScopeFULLSHORTr'get_user_request_args_from_command_args MetadataTypeOBJECTrrYrh)r/r[rLs r)_restore_task_iteratorrrs{ ((--L((..LGG 7DDKK   '.? @@ $T<9J KKr(c0eZdZdZdddZedZdZy)Restorez)Restore one or more soft-deleted objects.z_ The restore command restores soft-deleted resources: $ {command} url... ab Restore soft-deleted version of bucket with generations: $ {command} gs://bucket#123 Restore several soft-deleted buckets with generations: $ {command} gs://bucket1#123 gs://bucket2#456 Restore latest soft-deleted version of object in a bucket. $ {command} gs://bucket/file1.txt Restore a specific soft-deleted version of object in a bucket by specifying the generation. $ {command} gs://bucket/file1.txt#123 Restore all soft-deleted versions of object in a bucket. $ {command} gs://bucket/file1.txt --all-versions Restore several objects in a bucket (with or without generation): $ {command} gs://bucket/file1.txt gs://bucket/file2.txt#456 Restore the latest soft-deleted version of all text objects in a bucket: $ {command} gs://bucket/**.txt Restore a list of objects read from stdin (with or without generation): $ cat list-of-files.txt | {command} --read-paths-from-stdin Restore object with its original ACL policy: $ {command} gs://bucket/file1.txt --preserve-acl Restore all objects in a bucket asynchronously: $ {command} gs://bucket/** --async Restore all text files in a bucket asynchronously: $ {command} gs://bucket/**.txt --async Restore objects created within a specific time range: $ {command} gs://bucket/** --async --created-after-time="2023-01-01T00:00:00Z" --created-before-time="2023-01-31T23:59:59Z" Restore objects soft-deleted within a specific time range: $ {command} gs://bucket/** --async --deleted-after-time="2023-01-01T00:00:00Z" --deleted-before-time="2023-01-31T23:59:59Z" Restore objects using a combination of creation and deletion time filters: $ {command} gs://bucket/** --async --allow-overwrite --created-after-time="2023-01-01T00:00:00Z" --deleted-after-time="2023-01-01T00:00:00Z" This command filters the objects that were live at 2023-01-01T00:00:00Z and then soft-deleted afterwards. This combination of filters is especially helpful if there is a period of erroneous overwrites. They allow you to go back to the point just before the overwrites began. You will also need to set the `--allow-overwrite` option to true. ) DESCRIPTIONEXAMPLESc|jdddtj|tj|tj||j d}|jddd d |jd d d d|j d}|jdt jjd|jdt jjd|jdd d |jdt jjd|jdt jjdy)NrE*zThe url of objects to list.)nargshelpzSYNCHRONOUS RESTORE OPTIONS)rzz-az--all-versions store_trueaRestores all versions of soft-deleted objects. This flag is only useful for buckets with [object versioning] (https://cloud.google.com/storage/docs/object-versioning) enabled. In this case, the latest soft-deleted version will become live and the previous generations will become noncurrent. If versioning is disabled, the latest soft-deleted version will become live and previous generations will be soft-deleted again. This flag disables parallelism to preserve version order.)actionrzz--asyncrzIInitiates an asynchronous bulk restore operation on the specified bucket.)destr|rzzBULK RESTORE OPTIONSz--created-after-timez#00,T2,,,+)==&44<rsK&' 4/(5:4=:H@BH@PVP#!--DII *0 6#L L odlloor(