M~dZddlmZddlmZddlmZddlZddlmZddlm Z ddl Z dZ d Z d Z d Zd Zd ZdZy)z4Helper class for uploading user files to GCS bucket.)absolute_import)division)unicode_literalsN)storage_helpers) console_ioct|}i}t|}d}|jD]\}}g||<g}|D]}t|rltj j tj j|} |j| ||jt|| z||j||s|r d}t|tj|||S)aUploads user local files to the given GCS bucket. Uploads files if they are local. The function will prompt users to enter a region to create the bucket if the bucket doesn't exist. Args: bucket: The destination GCS bucket name. files: A dictionary of lists of files to upload. Field name of the lists won't cause any behavior difference, and the structure will be kept in the return value. Returns: A dictionary of lists of uri of the files. The structure is the same as the input files. Example: Upload('my-bucket', {'jar':['my-jar.jar']} > {'jar':['gs://my-bucket/dependencies/my-jar.jar']} TF) _ParseBucketName_FormDestinationUriitems_IsLocalospath expandvars expanduserappend_FormFileDestinationUri_CreateBucketIfNotExistsrUpload) bucketfiles result_files destinationneed_create_bucketfielduris need_uploaduri expanded_uris >lib/googlecloudsdk/command_lib/dataproc/local_file_uploader.pyrrs, F #&,#F++[[]keTLK #ww))"''*<* True TF)r r )r_rrs r HasLocalFilesr#Ss1ga # r ctj|rytjdj |}tj ||y)z3Creates a Cloud Storage bucket if it doesn't exist.NzThe bucket [{}] doesn't exist. Please enter a Cloud Storage region to create the bucket (leave empty to create in "global" region):)message)r GetBucketrPromptResponseformatCreateBucketIfNotExists)rregions rrrhsEv&   $ $--3VF^ >& ))&&9r cHd}|j|r|t|dS|S)zNormalizes bucket name. Normalizes bucket name. If it starts with gs://, remove it. Api_lib's function doesn't like the gs prefix. Args: name: gs bucket name string. Returns: A name string without 'gs://' prefix. zgs://N) startswithlen)namegss rr r vs*" __R B> +r ctjj|\}}tjj j j|d}|xs |j S)z-Checks if a given uri represent a local file.F)allow_fragments) r r splitdrivesixmovesurllibparseurlsplitscheme)rdriver" parsed_uris rr r sS WW   $(%yy%%..sE.J*  'j''''r c$dj|S)zForms destination bucket uri.zgs://{}/dependencies)r()rs rr r s  & &v ..r c|tjj|tjj|S)z%Forms uri representing uploaded file.)r rjoinbasename)rrs rrrs( k277#3#3C#8 99r )__doc__ __future__rrrr googlecloudsdk.api_lib.dataprocrgooglecloudsdk.core.consolerr3rr#rr r r rr rrDsC ;&' ;2 4n* :$(/ :r