1LdZddlmZddlmZddlmZddlZddlZddlZddlZddl Z ddl m Z ddl m Z ddl mZdd l mZdd lmZdd lmZdd lmZdd lmZddlmZddZddZ ddZdZdZdZdZdZddZ GddejBZ!dZ"dZ#dZ$dZ%d dZ&y)!z7Common utilities for the gcloud export/import commands.)absolute_import)division)unicode_literalsN) message_types)messages)encoding)encoding_helper) exceptions)log)yaml)yaml_validatorcd}||dj|z }|jdtj|dy)zAdd common export flags to the arg parser. Args: parser: The argparse parser object. schema_path: The resource instance schema file path if there is one. zPath to a YAML file where the configuration will be exported. Alternatively, you may omit this flag to write to standard output.NzL For a schema describing the export/import format, see: {}. z --destinationFhelprequiredformat add_argumenttextwrapdedentparser schema_path help_texts -lib/googlecloudsdk/command_lib/export/util.pyAddExportFlagsr'sPP)  & I  ??9 % cd}||dj|z }d|vr|dz }|jdtj|dy) zAdd common import flags to the arg parser. Args: parser: The argparse parser object. schema_path: The resource instance schema file path if there is one. zPath to a YAML file containing configuration export data. Alternatively, you may omit this flag to read from standard input.NzKFor a schema describing the export/import format, see: {}. $CLOUDSDKROOTz\ Note: $CLOUDSDKROOT represents the Google Cloud CLI's installation directory. z--sourceFrrrs rAddImportFlagsr <siP)  & I+%  i   ??9 % rc 4tjjtjjtjjtjjt j t d||dj|}|ru|jtjjdztjjz}|dkr|Stjjdd||dzd}|S) a^Returns the schema installation path. $CLOUDSDKROOT/lib/googlecloudsdk/schemas/ {api}/{api_version}/{message_name}.yaml Args: api_name: The api name. api_version: The API version string. message_name: The UpperCamelCase message name. for_help: Replaces the actual Cloud SDK installation root dir with $CLOUDSDKROOT. schemasz{}.yamlgooglecloudsdkrrlibN) ospathjoindirnamerDecode__file__rrfindsep)api_name api_version message_namefor_helpr'rel_path_indexs r GetSchemaPathr3Ws ggoobggoobggoo //( #'%&'|$  $ZZ .> > LMN k 77<<^a5G5H0I JD +rcLtj|j|y)aQValidates YAML against JSON schema. Args: parsed_yaml: YAML to validate schema_path: JSON schema file path. Raises: IOError: if schema not found in installed resources. files.Error: if schema file not found. ValidationError: if the template doesn't obey the schema. SchemaError: if the schema is invalid. N)r ValidatorValidate) parsed_yamlrs r ValidateYAMLr8us;'00=rcNtdtjd|DS)a/Parses disallowed properties from an error message. Args: error_message: The error message to parse. Returns: A list of property names. A sample error message might look like this: Additional properties are not allowed ('id', 'createTime', 'updateTime', 'name' were unexpected) c3>K|]}|jdyw)'N)strip).0propertys r z#_ParseProperties..sQ+OxhnnT+Osz'[^']*')listrefindall) error_messages r_ParsePropertiesrDs- Q+-::i+OQ QQrc>|}|D]}||} |D] }||vs||= y)zClear the given fields in a dict at a given path. Args: fields: A list of fields to clear path_deque: A deque containing path segments py_dict: A nested dict from which to clear the fields N)fields path_dequepy_dicttmp_dictelemfields r _ClearFieldsrMs5(d~He  5/rcHd}d}|j|k(xr||jvS)zChecks if an error is due to properties that were not in the schema. Args: error: A ValidationError Returns: Whether the error was due to disallowed properties additionalPropertiesz%Additional properties are not allowed) validatormessage)errorprop_validator prop_messages r_IsDisallowedPropertiesErrorrUs+*.8, N * L|u}}/LLrc<d}tj|j|D]s}t|r-t |j }t ||j|n!tj|j d}|s_tjduy)zFilter out fields from the yaml that are not in the schema. Args: parsed_yaml: yaml to filter schema_path: Path to schema. FTzDThe import command may need to be updated to handle the export data.N) r r5IteraterUrDrQrMr'r warning)r7r has_warningsrRfields_to_removes r _FilterYAMLr[s},'' 4<<[Ie$E*)%--8#UZZ= kk%-- l kk%&!Jrctj|}|r$tj|j | t j ||}|S#t$r)}tjdj|d}~wwxYw)a[Reads YAML from a stream as a message. Args: message_type: Type of message to load YAML into. stream: Input stream or buffer containing the YAML. schema_path: JSON schema file path. None for no YAML validation. Raises: ParseError: if yaml could not be parsed as the given message type. Returns: message_type object. zCannot parse YAML: [{0}]N) r loadr r5r6 api_encodingPyValueToMessage Exceptionr ParseErrorr) message_typestreamrr7rQes rImportres~ &!+[)22;?F++L+FG . F    : A A! D EEFsA B$BBc@eZdZdZdZedZfdZfdZxZ S)_ProtoJsonApiToolsz&JSON encoder used by apitools clients.NcJ|j ||_|jSN) _INSTANCE)clss rGetz_ProtoJsonApiTools.Gets }}ecm ==rct|tjrddjfd|DzSt |t j vr+t j t |j|St|}tt j/|}t||}tjtj|dS)Nz[%s]z, c3@K|]}j|ywri)encode_message)r=xselfs rr?z4_ProtoJsonApiTools.encode_message..s IA!4!4Q!7sT) sort_keys) isinstancer FieldListr(typer _CUSTOM_MESSAGE_CODECSencoder_EncodeUnknownFieldssuperrgro_EncodeCustomFieldNamesjsondumpsloads)rqrQresult __class__s` rroz!_ProtoJsonApiTools.encode_messages'8--. tyy I II JJ G}>>>  3 3DM B J J #7+G ?55((/0 $Wf 5F ::djj(D 99rct|dD]'}|||}|j}|js%|cSt|tj r|j rG|Dcgc];}tj|j|jxs |j=}}n+tj|j|j}|r|St|tjr>t|tjs$tj|j!|}t"tj$|O||Scc}w)Nrw) python_name)_GetFieldCodecsvaluecompletersr EnumFieldrepeatedr GetCustomJsonEnumMappingruname MessageFieldr DateTimeFieldr{r}roryrg encode_field)rqrLrrwr~rdremapped_valuers rrz_ProtoJsonApiTools.encode_field s!"5)4ue$flle  5 %++, DI CHa  4 4  0 :3466 :CH  )AA JJEJJ0 5(//0 um99 :jj,,U34e 33 $$)512 s"AE ) __name__ __module__ __qualname____doc__rj classmethodrlror __classcell__)rs@rrgrgs,.) :22rrgcbd}d}tj|||tj<|S)z(Registers custom field codec for int64s.c4tj|d}|SNT)rrr^ CodecResult) unused_fieldr int_values r_EncodeInt64Fieldz8RegisterCustomFieldTypeCodecs.._EncodeInt64Field#s((utDI rc0tj|dSrr)rrs r_DecodeInt64Fieldz8RegisterCustomFieldTypeCodecs.._DecodeInt64Field's  # #%$ ??r)rwdecoder)r _Codecr IntegerField)field_type_codecsrrs rRegisterCustomFieldTypeCodecsr!s7@.=-C-C):.<H))* rcRtjtj}t tjtj }t |j||dt |jt||dg}|Dcgc]}|| c}Scc}wri) copydeepcopyr _CUSTOM_FIELD_CODECSr_FIELD_TYPE_CODECSgetattrgetru)rLattrcustom_field_codecsrr~rps rrr0s o&J&JK3 mmO6679!%%e,dD9 ##DK0$= & -Vq}!V -- -s B$B$c:tjjt|}||Stj|}|j |}t |tjstjd|z|j}|j d}|j}t||}tj}|D];} |j!|| j"} |j%| j&| |=t)||g|S)z6Remap unknown fields in message out of message.source.zInvalid pairs field %sr)r _UNRECOGNIZED_FIELD_MAPPINGSrru!_CopyProtoMessageVanillaProtoJson field_by_namersrrr InvalidUserInputErrorrbvariantrrgrlrrset_unrecognized_fieldkeysetattr) rQsourcer~ pairs_field pairs_type value_field value_variantpairscodecpair encoded_values rrxrx<s  7 7 ; ;DM J& ^ N  < rs >&' 4/5,6#$.-*6<@ < > Q&  M&8<.2;;.2b  .0 0r