&dZddlmZddlmZddlmZddlZddlmZddlm Z ddl m Z dd l m ZddlmZdd lmZdd lmZd Zd ZdZGddeZdZy)z@Utility methods to aid in interacting with a GCS results bucket.)absolute_import)division)unicode_literalsN) exceptions)transfer)util)apis)log) resourceszgs://iic0eZdZdZdZdZdZddZdZy) ResultsBucketOpsz@A utility class to encapsulate operations on the results bucket.c||_||_tjdd|_||_|r|j |n|j||}tjj|d}|j|_ dj||j |_dj||j |_t!j"dj|jy ) aConstruct a ResultsBucketOps object to be used with a single matrix run. Args: project: string containing the Google Cloud Platform project id. bucket_name: string with the user-supplied name of a GCS bucket, or None. unique_obj_name: a unique-per-matrix GCS object name which will prefix all raw test result files within the supplied bucket_name. tr_client: ToolResults API client library generated by Apitools. tr_messages: ToolResults API messages library generated by Apitools. storage_client: Cloud Storage API client library generated by Apitools. Attributes: gcs_results_root: string containing the root path for the test results in 'gs://{bucket}/{timestamp-suffix}' format. storagev1zstorage.buckets) collectionz>https://console.developers.google.com/storage/browser/{b}/{t}/)btz gs://{b}/{t}/zRaw results root path is: [{0}]N)_project_storage_client core_apisGetMessagesModule_storage_messages_gcs_object_nameEnsureBucketExists_GetDefaultBucketr REGISTRYParsebucket_results_bucketformat_gcs_results_urlgcs_results_rootr info)selfproject bucket_nameunique_obj_name tr_client tr_messagesstorage_client bucket_refs :lib/googlecloudsdk/api_lib/firebase/test/results_bucket.py__init__zResultsBucketOps.__init__*s"DM)D&88DID+D k***9kBk##)) 1*3J%,,D I +!6!6 7 -$f{d6K6KfL HH . 5 5d6K6K LMc|j|j} |jj|}|jS#t j $rk}tj|\}}|tk(rdj|||j}ndj||}tj|d}~wwxYw)zEFetch the project's default GCS bucket name for storing tool results.) projectIdztPermission denied while fetching the default results bucket (Error {0}: {1}). Is billing enabled for project: [{2}]?zSHttp error while trying to fetch the default results bucket: ResponseError {0}: {1}N) ,ToolresultsProjectsInitializeSettingsRequestrprojectsInitializeSettings defaultBucketapitools_exceptions HttpErrorrGetErrorCodeAndMessageHTTP_FORBIDDENr r HttpException) r$r(r)requestresponseerrorcodeerr_msgmsgs r,rz"ResultsBucketOps._GetDefaultBucketRsFF--G!G *##66w?h  # ##  ( ( *11%8mdG  JtWdmm4 (tW%   $ $S )) *s&ACA&B>>CcX|jj|} |jjj |y#t j $rR}tj|\}}|tk7r'tjdj|||Yd}~nd}~wwxYwtjjdjt ||j"|jj$}|j&j(}|j*j(}|jj%|jj-||||j"} |jjj/| y#t j $r}tj|\}}|t0k(rd j||j" } n&d j|tj2| } tj| d}~wwxYw) a.Create a GCS bucket if it doesn't already exist. Args: bucket_name: the name of the GCS bucket to create if it doesn't exist. Raises: BadFileException if the bucket name is malformed, the user does not have access rights to the bucket, or the bucket can't be created. )rNzCould not access bucket [{b}]. Response error {c}: {e}. Please supply a valid bucket name or use the default bucket provided by Firebase Test Lab.)rcez2Creating results bucket [{g}{b}] in project [{p}].)grp)name)r predefinedAclpredefinedDefaultObjectAclr%zUPermission denied while creating bucket [{b}]. Is billing enabled for project: [{p}]?)rrDz!Failed to create bucket [{b}] {e})rrB)rStorageBucketsGetRequestrbucketsGetr5r6rr7HTTP_NOT_FOUNDrBadFileExceptionr r statusPrint GCS_PREFIXrStorageBucketsInsertRequestPredefinedAclValueValuesEnumprojectPrivate)PredefinedDefaultObjectAclValueValuesEnumBucketInsertr8GetError) r$r&get_reqerrr=r> bucket_reqaclobjacl insert_reqr?s r,rz#ResultsBucketOps.EnsureBucketExistses$$==>G 7 ""&&w/  ( (711#6mdG  )) -VkTWV 5 7 7 7JJIfz[DMMfJL''CCJ  1 1 @ @C  A A P PF''CC%%,,+,>#) DJ - ""))*5  ( ( -11#6mdG  8 6 3 c(:;  ' ' ,, -s1%AB)AB$$B)1%FH)*A:H$$H)Nc tjjdj| |j t rt |\}}|jj|||jdj|j|xstjj|}|jjj!|y tjj#|}|jj+|} t,j.j1||} |jj7|jdj|j|xstjj|| } |jjj9| | } | j:|k7r:t'j(d j| j:||t=| y#tj$$r%t'j(dj|wxYw#t2j4$r%t,j.j1|d } YGwxYw#t2j>$rI} t'j(d j||j@tCjD| d} ~ wwxYw)axUpload a file to the GCS results bucket using the storage API. Args: path: str, the absolute or relative path of the file to upload. File may be in located in GCS or the local filesystem. mimetype: str, the MIME type (aka Content-Type) that should be applied to files being copied from a non-GCS source to GCS. MIME types for GCS->GCS file uploads are not modified. destination_object: str, the destination object path in GCS to upload to, if it's different than the base name of the path argument. Raises: BadFileException if the file upload is not successful. z'Uploading [{f}] to Firebase Test Lab...)fz {obj}/{name})objrE) sourceBucket sourceObjectdestinationBucketdestinationObjectz![{0}] not found or not accessible)size) mime_typezapplication/octet-stream)rrEobject)uploadzoCloud storage upload failure: Insert response.size={0} bytes but [{1}] contains {2} bytes. Insert response: {3}z$Could not copy [{f}] to [{gcs}] {e}.)r^gcsrBN)#r rMrNr startswithrO_SplitBucketAndObjectrStorageObjectsCopyRequestrrospathbasenamerobjectsCopygetsizer<rrLObjectrUploadFromFiler5InvalidUserInputErrorStorageObjectsInsertRequestrUrdreprr6r"rrV) r$rmmimetypedestination_object file_bucketfile_objcopy_req file_sizesrc_objrgr\r;rXs r,UploadFileToGcsz ResultsBucketOps.UploadFileToGcssJJ>EEEMN*L  $ 5d ; X))CC$!"22,33))'E277+;+;H+E4G DH $$))(3 ;ggood+)((//Y/? :??++DH+E& ++GG''&&))'A277+;+;D+A'C H ''//66z>D7F ==I %++DvhmmT9d8nEG G &%xx ;++,O-3VD\; ; ; #88 :??++8,:& :"  ( (L  ' ' 0 6Dd33t}}S7I6 J LLLsVB-J H?J!I =CJ8I  J 4JJJJK$AKK$cttjjdj|jy)Nz7Raw results will be stored in your GCS bucket at [{0}] )r rMrNr r!)r$s r,LogGcsResultsUrlz!ResultsBucketOps.LogGcsResultsUrls'JJOfT2235r.)NN) __name__ __module__ __qualname____doc__r-rrrrr.r,r r 's#H&NP*&2-h:Lx5r.r c|ttdjdjdd}t|dk7r$t j dj ||S)zHSplit a GCS path into bucket & object tokens, or raise BadFileException.N/z.[{0}] is not a valid Google Cloud Storage path)lenrOstripsplitrrLr )gcs_pathtokenss r,rjrjs_ C O$ % + +C 0 6 6sA >&[A  % %8??I KK -r.)r __future__rrrrlapitools.base.pyrr5r$googlecloudsdk.api_lib.firebase.testrgooglecloudsdk.api_lib.utilr rgooglecloudsdk.calliopegooglecloudsdk.corer r rOr8rKrfr rjrr.r,rsQ G&' >%59.#) p5vp5fr.