ZdZddlmZddlmZddlmZddlmZddlm Z ddl m Z ddl m Z dd lmZdd lmZdd lmZdd lmZdd lmZdd lZGddej.ZGddej.ZGddej.ZdZdZdZdZdZdZ dZ!dZ"dZ#dZ$y )z,Utilities for Data Catalog entries commands.)absolute_import)division)unicode_literals)messages)encoding)entries)util) exceptions) arg_utils)log)yamlNceZdZdZy)InvalidSchemaErrorz*Error if a schema is improperly specified.N__name__ __module__ __qualname____doc__;lib/googlecloudsdk/command_lib/data_catalog/entries/util.pyrr!s2rrceZdZdZy)InvalidSchemaFileErrorz1Error if a schema file is not valid JSON or YAML.Nrrrrrr%s9rrceZdZdZy)UnderSpecifiedEntryErrorz;Error if an entry resource argument is not fully specified.Nrrrrrr)sCrrcl~|jdr!|jjdd|_|S)aReturns the update request with the corrected mask. The API expects a request with an update mask of 'schema', whereas the inline schema argument generates an update mask of 'schema.columns'. So if --schema was specified, we have to correct the update mask. Args: ref: The entry resource reference. args: The parsed args namespace. request: The update entry request. Returns: Request with corrected update mask. schemazschema.columns) IsSpecified updateMaskreplacerefargsrequests rCorrectUpdateMaskr%-s6  h ++334DhOG .rcp|jdxs$|jdxs|jdS)Nadd_file_patternsremove_file_patternsclear_file_patterns)r)r#s r_IsChangeFilePatternSpecifiedr*Bs>   . / 2   1 2 2   0 13rct|s|S~|jjj}t j j |jjxsg}|jdrg}|jdr)t|j}|Dcgc] }||vs| }}|jdr||jz }tj|d||xjdz c_|Scc}w)zMerges user-provided GCS file patterns with existing patterns. Args: ref: The entry resource reference. args: The parsed args namespace. request: The update entry request. Returns: Request with merged GCS file pattern. r)r(r'z>googleCloudDatacatalogV1beta1Entry.gcsFilesetSpec.filePatternsz,gcsFilesetSpec.filePatterns)r*CONCEPTSentryParser EntriesClientGetgcsFilesetSpec filePatternsrsetr(r'r SetFieldInMessager)r"r#r$ entry_ref file_patterns to_removebs rMergeGcsFilePatternsr9Hs 't , N mm!!''))'')-- 302 +,M ,-D--.I -D 1)1CQ MD )*T+++M  O 66 .Es + D 5D cD~tj|j|SN)rParseResourceIntoLookupRequestresourcer!s rr<r<ks  / / w GGrc~|jjj}|jdr |s t d|r|jds|s'|jdst j dd|r|j|_|Stj}|j|jj|_|S)aParses the entry into the request, performing a lookup first if necessary. Args: ref: None. args: The parsed args namespace. request: The update entry request. Returns: Request containing the parsed entry. Raises: UnderSpecifiedEntryError: if ENTRY was only partially specified. RequiredMutexGroupError: if both or neither ENTRY, --lookup-entry specified. r-zYArgument [ENTRY : --entry-group=ENTRY_GROUP --location=LOCATION] was not fully specified. lookup_entryzJ([ENTRY : --entry-group=ENTRY_GROUP --location=LOCATION] | --lookup-entry)) r,r-r.rrconcept_exceptionsRequiredMutexGroupError RelativeNamenamerr/Lookupr?)r"r#r$r5clients rLookupAndParseEntryrFps mm!!''))  gy "   T%%n5 T--n=  4 4 ))+GL . " " $F==!2!2388GL .rc tj|}t |S#tj$r}tdj |d}~wwxYw)NzError parsing schema file: [{}])r loadYAMLParseErrorrformat_SchemaToMessage) schema_fileres rProcessSchemaFromFilerNsTN YY{ #F & !!   N !B!I!I!!L MMNs"AAAcbtj} tjd|i|j}t|}|r"dg}||z }t dj||S#t $r t dtj$r}t dj|d}~wwxYw)zConverts the given schema dict to the corresponding schema message. Args: schema: dict, The schema that has been processed. Returns: googleCloudDatacatalogV1betaSchema Raises: InvalidSchemaError: If the schema is invalid. columnsztInvalid schema: expected list of column names along with their types, modes, descriptions, and/or nested subcolumns.zInvalid schema: [{}]Nz6Invalid schema, the following fields are unrecognized: ) api_utilGetMessagesModuler DictToMessage#GoogleCloudDatacatalogV1beta1SchemaAttributeErrorr _messagesValidationErrorrJ_GetUnrecognizedFieldPathsjoin)rrschema_messagerMunrecognized_field_pathserror_msg_liness rrKrKs ' ' )( ?++ FXIIKN8GOPO//O TYY7 88  :  9 ::  " "? 3::1= >>?s"A))&B.B))B.ctj|}g}|D]X\}}djd|D}|jddd}|D]#}|j dj ||%Zt |S)z?Returns the field paths for unrecognized fields in the message..c3FK|]}tj|ywr;)six text_type).0rMs r z-_GetUnrecognizedFieldPaths..s!Mrs3&'<%7@P:*#$ 3))3:Z--:Dz//D*3 FH $N"D *: