%dZddlmZddlZddlmZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlmZmZddlmZddlmZddlmZdd lmZdd lmZdd lmZdd lmZd ZdZ dZ!e jDdZ#ejHddZ%GddejLZ'ejPGddZ)ejPGddZ*GddejVZ,y)zClasses and utils for Storage diagnostics. Storage diagnostics are a bunch of tests that can be run to diagnose issues with the storage system. ) annotationsN)MutableMapping)DictList)errors)utils)execution_utils)log) console_io)progress_tracker)filesCLOUDSDK_STORAGE_THREAD_COUNTCLOUDSDK_STORAGE_PROCESS_COUNTzN/Az%.*following URLs matched no objects.*c#tKtj}dtj}||z ||<yw)a1A context manager that records the time it takes to run a block of code. Args: key: The key to use in the result dictionary. result: The dictionary to store the result in. The time taken to run the block of code will be stored in this dictionary with the given key. Yields: None N)time)keyresultt0t1s =lib/googlecloudsdk/command_lib/storage/diagnose/diagnostic.py time_recorderr5s. yy{" yy{"R&+s68ceZdZdZy)DiagnosticIgnorableErrorz;Ignorable Exception thrown during the diagnostic execution.N)__name__ __module__ __qualname____doc__rrrGsCrrc<eZdZUdZded<ded<dZded<d d Zy) DiagnosticOperationResultzResult of a operation performed as part of a diagnostic. Attributes: name: The name of the operation. result: The result of the operation. payload_description: The description of the payload used for running this operation. strnamezDict[any, any]rNz str | Nonepayload_descriptionctj}|jd|jdj|j|j r*|jdj|j |jdj|j |jS)NzDiagnostic Operation Result Name: {} zPayload Description: {} z Result: {} )ioStringIOwriteformatr#r$rgetvalue)selfouts r__str__z!DiagnosticOperationResult.__str__Zs ++-CII-.IIl!!$)),-  ii+2243K3KLMIIn##DKK01 <<>rreturnr")rrrr__annotations__r$r.rrrr!r!Ks$ ) $(z(rr!c<eZdZUdZded<ded<dZded<d d Zy) DiagnosticResultzResult of a diagnostic execution. Attributes: name: The name of the diagnostic. operation_results: The results of the operations performed as part of this diagnostic. metadata: Additional metadata associated with the diagnostic. r"r#zList[DiagnosticOperationResult]operation_resultsNzDict[any, any] | Nonemetadatactj}|jd|jdj|j|j r*|jdj|j |jd|j D]}|jt|dz!|jS)NzDiagnostic Result r&z Metadata: {} z Operation Results:  ) r'r(r)r*r#r5r4r"r+)r,r-operation_results rr.zDiagnosticResult.__str__ss ++-CII#$IIl!!$)),- }} ii '' 67II&' 22 ii$%,-3 <<>rr/)rrrrr1r5r.rrrr3r3ds$ )44$(( !( rr3ceZdZdZdZeejddZdZ ejdZ dZ dZ d ddZ dd Zddd Zdd Zd Zdd Zy) DiagnosticaBase class for storage diagnostics. This class provides a framework for writing diagnostics. Subclasses can override the pre-processing, diagnostic and post-processing steps as needed. The execute method is the entry point for running the diagnostic. Ncy)zThe name of the diagnostic.Nrr,s rr#zDiagnostic.names rcJtjj|_y)aPre-processing step for the diagnostic. This method is called before the diagnostic is run. Implementing child classes can override this method to perform actions necessary for running diagnostics like file creation, setting configurations etc. N)osenvironcopy _old_env_varsr<s r _pre_processzDiagnostic._pre_processs*Drcy)zRuns the diagnostic. This method is called after the pre-processing step and is expected to perform the actual diagnostic. Nrr<s r_runzDiagnostic._runs rcH|j|jt_yy)zPost-processing step for the diagnostic. This method is called after the diagnostic is run. Implemeneting child classes can override this method to perform clean up actions, aggregating metrics, etc. N)rAr>r?r<s r _post_processzDiagnostic._post_processs" %%%bj&rctjjd|jdt j 5 |j |j|jtjjd|jdddy#t$r.}tj|jd|Yd}~wd}~wwxYw#|jwxYw#1swYyxYw)zExecutes the diagnostic.zRunning diagnostic: z...z Diagnostic execution failed: NzFinished running diagnostic: ) r statusPrintr#r RaisesKeyboardInterruptrBrDrerrorrF)r,es rexecutezDiagnostic.executesJJ+DII;c:;  0 0 2   jj6tyykBC 3 2 &C TYYK=aSABBC  3 2sBC8 B)$> ?sOA D'=DAD/DD'D DD$ D'$D''E3$E..E3c<t|tj|<y)zSets the environment variable to the given value. Args: variable_name: Name of the environment variable. variable_value: Value of the environment variable. N)r"r>r?)r, variable_namevariable_values r_set_env_variablezDiagnostic._set_env_variables!$N 3BJJ}rcdd||dg}tj||\}}|rtdj|||y)aRuns the gcloud cp command. Args: source_url: Source url for the cp command. destination_url: Destination url for the cp command. in_str: The input to pass to the gcloud cp command. Raises: DiagnosticIgnorableError: If the cp command fails. storagecpz--verbosity=debug)in_strz0Failed to copy objects from source {} to {} : {}N)r run_gcloudrr*)r, source_urldestination_urlrvargs_errs r_run_cpzDiagnostic._run_cps\    D  d6 2FAs $ < C C/3   rcdd||dg}tj|\}}|rQtj|rt j d|d|dy t j d|d|d|y y ) zz5Diagnostic._generate_random_string..*s;A  f**V]]:V=O=OOPsAA)joinr[)r,lengths rr_z"Diagnostic._generate_random_string!s& 77v rr/)i)rfz List[int]rgrrhintr0bool)rpr"rqanyr)rxr"ryr")rr"rr"r0None)rrr0r")rrrrrApropertyabcabstractmethodr#rBrDrFrMrnrrr}rrr_rrrr:r:s-    +  & D$$ ))) )  )V44 &H rr:)rr"rzMutableMapping[str, float]r0r)-r __future__rrcollections.abcr contextlib dataclassesr'r>rrerr\rtypingrr"googlecloudsdk.command_lib.storager+googlecloudsdk.command_lib.storage.diagnosergooglecloudsdk.corer r googlecloudsdk.core.consoler r googlecloudsdk.core.utilr rVrrPLACEHOLDER_METRIC_VALUEcompilercontextmanagerrErrorr dataclassr!r3ABCr:rrrrs # *  5=/#28879 (bjj,  "Dv||D 0 4nnr