K$dZddlmZddlmZddlmZddlZddlmZddlmZddl mZ ddl m Z dd l m Z ddlZejd Zd Zd Zd ZdZdZ ddZdZy)aA library to load and validate test arguments from a YAML argument file. The optional, positional ARGSPEC argument on the command line is used to specify an ARG_FILE:ARG_GROUP_NAME pair, where ARG_FILE is the path to the YAML-format argument file, and ARG_GROUP_NAME is the name of the arg group to load and parse. The basic format of a YAML argument file is: arg-group-1: arg1: value1 arg2: value2 arg-group-2: arg3: value3 ... A special 'include: []' syntax allows composition/merging of arg-groups (see example below). Included groups can include: other groups as well, with unlimited nesting within one YAML file. Precedence of arguments: Args appearing on the command line will override any arg specified within an argument file. Args which are merged into a group using the 'include:' keyword have lower precedence than an arg already defined in that group. Example of a YAML argument file for use with 'gcloud test run ...' commands: memegen-robo-args: type: robo app: path/to/memegen.apk robo-script: crawl_init.json include: [common-args, matrix-quick] timeout: 5m notepad-instr-args: type: instrumentation app: path/to/notepad.apk test: path/to/notepad-test.apk include: [common-args, matrix-large] common-args: results-bucket: gs://my-results-bucket timeout: 600 matrix-quick: device-ids: [Nexus5, Nexus6] os-version-ids: 21 locales: en orientation: landscape matrix-large: device-ids: [Nexus5, Nexus6, Nexus7, Nexus9, Nexus10] os-version-ids: [18, 19, 21] include: all-supported-locales all-supported-locales: locales: [de, en_US, en_GB, es, fr, it, ru, zh] )absolute_import)division)unicode_literalsN) arg_validate) exceptions)log)yamlz^[a-zA-Z0-9._\-]+\Zincludec|iSt|\}}t|}tt|j i}t ||||t jdtj|z|S)a.Loads a group of test args from an optional user-supplied arg file. Args: argspec: string containing an ARG_FILE:ARG_GROUP_NAME pair, where ARG_FILE is the path to a file containing groups of test arguments in yaml format, and ARG_GROUP_NAME is a yaml object name of a group of arg:value pairs. all_test_args_set: a set of strings for every possible gcloud-test argument name regardless of test type. Used for validation. Returns: A {str:str} dict created from the file which maps arg names to arg values. Raises: BadFileException: the YAML parser encountered an I/O error or syntax error while reading the arg-file. InvalidTestArgError: an argument name was not a valid gcloud test arg. InvalidArgException: an argument has an invalid value or no value. zArgs loaded from file: ) _SplitArgFileAndGroup_ReadArgGroupsFromFile_ValidateArgGroupNameslistkeys_MergeArgGroupIntoArgsrinfosix text_type)argspecall_test_args_setarg_file group_nameall_arg_groupsargs_from_files 4lib/googlecloudsdk/api_lib/firebase/test/arg_file.pyGetArgsFromArgFiler`st& _ I.w7(J)(3.n11345.^*,(( $s}}^'D DE c|jd}|dks|dk(r'|jdrtjdd|d|||dzdfS) zBParses an ARGSPEC and returns the arg filename and arg group name.:rzgs://zarg-specz&Format must be ARG_FILE:ARG_GROUP_NAMEN)rfind startswithrInvalidArgException)file_and_group_strindexs rr r sd  " "3 '% QY5A:"4"?"?"H  ( (< >> FU #%7a%A AArc  i}tj|D]s}|tjdt |t r|j |=tjdj|tj||S)a Collects all the arg groups defined in the yaml file into a dictionary. Each dictionary key is an arg-group name whose corresponding value is a nested dictionary containing arg-name: arg-value pairs defined in that group. Args: arg_file: str, the name of the YAML argument file to open and parse. Returns: A dict containing all arg-groups found in the arg_file. Raises: yaml.Error: If the YAML file could not be read or parsed. BadFileException: If the contents of the file are not valid. zIgnoring empty yaml document.zCFailed to parse YAML file [{}]: [{}] is not a valid argument group.) r load_all_pathrwarning isinstancedictupdatecalliope_exceptionsBadFileExceptionformatrr)r all_groupsds rr r s} *   h 'ay kk12 At   0 0 6(CMM!$45 77 ( rc|D];}tj|rtjdj |y)NzBInvalid argument group name [{0}]. Names may only use a-zA-Z0-9._-)_ARG_GROUP_PATTERNmatchr-r.r/) group_namesrs rrrs:j  # #J /  0 0 N 6*   rc| t}n.||vr*tjtdj |||vr%t j dj |||}|s%tjdj |y|D]}tj|}|tk(r"||vrtj|||vr)tjdj |||htj|||||<|j|t|vr8tjt|t}|D]} t!|| |||yy)aMerges args from an arg group into the given args_from_file dictionary. Args: args_from_file: dict of arg:value pairs already loaded from the arg-file. group_name: str, the name of the arg-group to merge into args_from_file. all_arg_groups: dict containing all arg-groups loaded from the arg-file. all_test_args_set: set of str, all possible test arg names. already_included_set: set of str, all group names which were already included. Used to detect 'include:' cycles. Raises: BadFileException: an undefined arg-group name was encountered. InvalidArgException: a valid argument name has an invalid value, or use of include: led to cyclic references. InvalidTestArgError: an undefined argument name was encountered. Nz,Detected cyclic reference to arg group [{g}])gz5Could not find argument group [{g}] in argument file.zArgument group [{0}] is empty.zBSkipping include: of arg [{0}] because it already had value [{1}].)setrr$_INCLUDEr/r-r.rr)rInternalArgNameFromInvalidTestArgErrorrValidateArgFromFileaddValidateStringListr) rrrralready_included_set arg_grouparg_nameargincluded_groupsincluded_groups rrrsx&!5))  ( (6== =K MM~%  . .? *  Z() KK077 CD h  * *8 4C h ##  * *8 44 n hh N 6(N3/ 02)<< y"$nS :& "55h6?6IKO)^^^.0DF*rc , t|\}} tt |j }|Dcgc]}|j|s|dz|zc}S#tj$rgcYSwxYw#t j$rgcYSwxYwcc}w)aRTab-completion function for ARGSPECs in the format ARG_FILE:ARG_GROUP. If the ARG_FILE exists, parse it on-the-fly to get the list of every ARG_GROUP it contains. If the ARG_FILE does not exist or the ARGSPEC does not yet contain a colon, then fall back to standard shell filename completion by returning an empty list. Args: prefix: the partial ARGSPEC string typed by the user so far. parsed_args: the argparse.Namespace for all args parsed so far. **kwargs: keyword args, not used. Returns: The list of all ARG_FILE:ARG_GROUP strings which match the prefix. r) r rr$rr rr FileLoadErrorr#)prefix parsed_argskwargsr group_prefixgroupsr7s rArgSpecCompleterrLs 26:Hl (2779 :F)/ M1!,,|2L8c>A  MM  ' ' I    I Ms-A"A6B BA32A36B B)N)__doc__ __future__rrrre$googlecloudsdk.api_lib.firebase.testrrgooglecloudsdk.callioper-googlecloudsdk.corerr rcompiler3r9rr r rrrLrrrUsl ;z'' =;E#$  RZZ 67 BB::F|Nr