AdZddlmZddlmZddlmZddlmZddlmZddlm Z ddl m Z dd l m Z dd l mZdd lZGd d e j ZGdde j ZddZddZGddeZy )z+Utilities for dealing with ML versions API.)absolute_import)division)unicode_literals)encoding) list_pager)apis) exceptions)yaml)textNceZdZdZy)InvalidVersionConfigFile7Error indicating an invalid Version configuration file.N__name__ __module__ __qualname____doc__4lib/googlecloudsdk/api_lib/ml_engine/versions_api.pyr r ?rr ceZdZdZy)NoFieldsSpecifiedErrorrNrrrrrr"rrrc.tjd|S)Nml)rGetMessagesModule)versions rrr&s  g ..rc2tjd||S)Nr)no_http)rGetClientInstance)rrs rr r *s  gw ??rceZdZdZegdZeddgZddZedZ dZ d Z d Z dd Z d Zd ZdZdZdZdZdZ ddZy)VersionsClientz3Client for the versions service of Cloud ML Engine.) autoScaling deploymentUri description frameworklabels machineType manualScaling packageUrispredictionClass pythonVersionruntimeVersionserviceAccount containerroutesNch|xs t|_|xs|jj|_yN)r clientMESSAGES_MODULEmessages)selfr3r5s r__init__zVersionsClient.__init__Es(/-/DK; ; ;DMrc.|jjSr2)r5GoogleCloudMlV1Version)r6s r version_classzVersionsClient.version_classIs == / //rc<|jj||S)N)parentgoogleCloudMlV1Version)r5%MlProjectsModelsVersionsCreateRequest)r6r<rs r_MakeCreateRequestz!VersionsClient._MakeCreateRequestMs$ == > >& ? ((rcp|jj}|jj||S)N)name'googleCloudMlV1SetDefaultVersionRequest)r5'GoogleCloudMlV1SetDefaultVersionRequest)MlProjectsModelsVersionsSetDefaultRequest)r6rArequests r_MakeSetDefaultRequestz%VersionsClient._MakeSetDefaultRequestRs7mmCCEG == B B 07 C 99rc|jjj|j|j |S)z+Creates a new version in an existing model.)r<r)r3projects_models_versionsCreater? RelativeName)r6 model_refrs rrIzVersionsClient.CreateXsA ;; / / 6 6 ))+   rc |jj} g} |jr"|j| _| j d|r|| _| j d|.|jr"| j d|j | _|| j d|| _|2| j d|jj|| _ |2| j d|jj|| _ |P| j d | j|| j_ n!|jj| | _ | 2| j d |jj| | _| Hd | vr3| j d |jj| | _n| | j_| s t#d|j$j&j)|jj+|j-| dj/t1| S)zUpdate a version.r'r%r+r*zmanualScaling.nodes)nodeszautoScaling.minNodes)minNodeszautoScaling.maxNodes)maxNodesrequestLoggingConfig)bigqueryTableName)samplingPercentagezNo updates requested.,)rAr= updateMask)r5r9 needs_updater'appendr%valuer+r*GoogleCloudMlV1ManualScalingr)GoogleCloudMlV1AutoScalingr#rO#GoogleCloudMlV1RequestLoggingConfigrPrRrr3rHPatch$MlProjectsModelsVersionsPatchRequestrJjoinsorted) r6 version_ref labels_updater%prediction_class_update package_urismanual_scaling_nodesauto_scaling_min_nodesauto_scaling_max_nodessampling_percentagebigquery_table_namer update_masks rr[zVersionsClient.Patch_sG mm224GK!!$++gn"'g'*/F/S/S*+ 7 = =g'(g'./"mmHH$I&g)/0 MMDD)E+g)/0    ('=$"mmFF+G-&/0%)]]%V%V/&W&1g"& { 212'+}}'X'X2(Y(4$;N$$7  "#: ;; ;; / / 5 5 ::))+#*xx{ 34 ; 6 77rc|jjj|jj |j S)zDeletes a version from a model.rA)r3rHDeleter5%MlProjectsModelsVersionsDeleteRequestrJr6r_s rrkzVersionsClient.DeletesB ;; / / 6 6 ;;))+ < - ..rc|jjj|jj |j S)z-Gets details about an existing model version.rj)r3rHGetr5"MlProjectsModelsVersionsGetRequestrJrms rrozVersionsClient.GetsB ;; / / 3 3 88))+ 9 - ..rc|jj|j}tj|j j |ddS)zLists the versions for a model.)r<versionspageSize)fieldbatch_size_attribute)r5#MlProjectsModelsVersionsListRequestrJr YieldFromListr3rH)r6rK list_requests rListzVersionsClient.ListsO==DD%%'E)L  # # ,,lz ;;rc|jjj|j|j S)zSets a model's default version.rj)r3rH SetDefaultrFrJrms rr{zVersionsClient.SetDefaults; ;; / / : : ##)A)A)C#D FFrc  tj|}|r tj||j}tjDcgc]$}t||jr |j&c}}||z t|jz}|rktdj t!j"t%|ddj't)||dj't)||S#tj$r>}tdj |t j |jd}~wwxYwcc}w)aRead a config file and return Version object with the values. The object is based on a YAML configuration file. The file may only have the fields given in `allowed_fields`. Args: path: str, the path to the YAML file. allowed_fields: Collection, the fields allowed in the YAML. Returns: A Version object (for the corresponding API version). Raises: InvalidVersionConfigFile: If the file contains unexpected fields. z:Could not read Version configuration file [{path}]: {err})patherrNzVInvalid {noun} [{fields}] in configuration file [{path}]. Allowed fields: [{allowed}].rt, )nounfieldsr}allowed)r load_pathErrorr formatsix text_type inner_errorr DictToMessager:set all_fieldsgetattrrAall_unrecognized_fieldsr Pluralizelenr]r^) r6r}allowed_fieldsdatar~rfspecified_fieldsinvalid_fieldss r ReadConfigzVersionsClient.ReadConfigsA I ^^D !d  &&tT-?-?@gG,>,>,@6,@q#GQVV4FF,@67&7'99;<=N $ ))/>>#n"5w?YYvn56ii~ 67 *0*9 :: N' JJI $ &d coo(F&G III6sD)E"E!9EEc pt|jsy|dsgdjt|j Dcgc]\}}|s dj |c}}}t dj ||jj|d|_ |dr|d|j_ |dr|d|j_ |d rP|d j Dcgc]"\}}|jj|| $c}}|j_ |d r<|d Dcgc]}|jj|  c}|j_|d s|dr)|jj!|d |d|_yycc}}wcc}}wcc}w)z0Adds `container` and `routes` fields to version.Nimagerz--{}z--image was not provided, but other container related flags were specified. Please specify --image or remove the following flags: {})rcommandargsenv_vars)rArWports) containerPort predict_route health_route)predicthealth)anyvaluesr]r^itemsr ValueErrorr5GoogleCloudMlV1ContainerSpecr/rrGoogleCloudMlV1EnvVarenvGoogleCloudMlV1ContainerPortrGoogleCloudMlV1RouteMapr0) r6rkwargskv set_flagsrArWps r_ConfigureContainerz"VersionsClient._ConfigureContainers v}}  '?))(.v||~(> D(>1!6== (> DFi  vi  ""  BBWoCG i"("3g f~%f~g j$J/55797kdE -- - -4u - E79gg'?!"a -- 4 41 4 E"!g o&"8}}<<)'=gn#9- E9!s F' F' 8'F->#F3c t|jsy|jj|_|dr|d|j_|dr|d|j_|drg|j_d|dvryt|dd}|jjj|jj|jjjj|d|dvrzt|dd}|jjj|jj|jjjj|yyy)z&Adds `auto_scaling` fields to version.N min_nodes max_nodesmetricsz cpu-usage)rAtargetzgpu-duty-cycle)rrr5rYr#rNrOrintrVGoogleCloudMlV1MetricSpecNameValueValuesEnum CPU_USAGEGPU_DUTY_CYCLE)r6rrts r_ConfigureAutoScalingz$VersionsClient._ConfigureAutoScalings[ v}}  --BBDG k%+K%8g" k%+K%8g" i$&g! y) ) y!+. /##** MM 3 3]]<<PP 4   VI. . y!"23 4##** MM 3 3]]<<PP 4   /rc |r0|j}|s||jz}|j||}n|j}|||||||| | | | | d }d} |dk(rC|jj } |jj }!||!_|!| _n|dk(rC|jj } |jj}"||"_ |"| _ nG|dk(rB|jj } |jj}#||#_|#| _ | | |d<|s|j|||||||||s|j|||||j!D]\}$}%|% t#||$|%|S) a Create a Version object. The object is based on an optional YAML configuration file and the parameters to this method; any provided method parameters override any provided in-file configuration. The file may only have the fields given in VersionsClientBase._ALLOWED_YAML_FIELDS specified; the only parameters allowed are those that can be specified on the command line. Args: name: str, the name of the version object to create. path: str, the path to the YAML file. deployment_uri: str, the deploymentUri to set for the Version runtime_version: str, the runtimeVersion to set for the Version labels: Version.LabelsValue, the labels to set for the version machine_type: str, the machine type to serve the model version on. description: str, the version description. framework: FrameworkValueValuesEnum, the ML framework used to train this version of the model. python_version: str, The version of Python used to train the model. prediction_class: str, the FQN of a Python class implementing the Model interface for custom prediction. package_uris: list of str, Cloud Storage URIs containing user-supplied Python code to use. accelerator_config: an accelerator config message object. service_account: Specifies the service account for resource access control. explanation_method: Enables explanations and selects the explanation method. Valid options are 'integrated-gradients' and 'sampled-shapley'. num_integral_steps: Number of integral steps for Integrated Gradients and XRAI. num_paths: Number of paths for Sampled Shapley. image: The container image to deploy. command: Entrypoint for the container image. container_args: The command-line args to pass the container. env_vars: The environment variables to set on the container. ports: The ports to which traffic will be sent in the container. predict_route: The HTTP path within the container that predict requests are sent to. health_route: The HTTP path within the container that health checks are sent to. min_nodes: The minimum number of nodes to scale this model under load. max_nodes: The maximum number of nodes to scale this model under load. metrics: List of key-value pairs to set as metrics' target for autoscaling. containers_hidden: Whether or not container-related fields are hidden on this track. autoscaling_hidden: Whether or not autoscaling fields are hidden on this track. Returns: A Version object (for the corresponding API version). Raises: InvalidVersionConfigFile: If the file contains unexpected fields. ) rAr$r-r'r(r%r&r,r+r*acceleratorConfigr.Nzintegrated-gradientszsampled-shapleyxraiexplanationConfig)rrrrrrr)rrr)_ALLOWED_YAML_FIELDS_CONTAINER_FIELDSrr:r5 GoogleCloudMlV1ExplanationConfig-GoogleCloudMlV1IntegratedGradientsAttributionnumIntegralStepsintegratedGradientsAttribution(GoogleCloudMlV1SampledShapleyAttributionnumPathssampledShapleyAttributionGoogleCloudMlV1XraiAttributionxraiAttributionrrrsetattr)&r6rAr}deployment_uriruntime_versionr' machine_typer%r&python_versionprediction_classrbaccelerator_configservice_accountexplanation_methodnum_integral_steps num_pathsrrcontainer_argsrrrrrrrcontainers_hiddenautoscaling_hiddenrradditional_fieldsexplanation_config ig_config shap_config xrai_config field_namerWs& r BuildVersionzVersionsClient.BuildVersionsl 00n $000n5g""$g')#"'+#/) 33==IIK--MMOi#5i :C7 0 0==IIKMMJJLk&k5@2 v %==IIKMM@@Bk%7k"+6(%/A+,   %#%    Y)W!N/446 E  U+7 Nr)NN)NNNNNNNN)NNNNNNNNNNNNNNNNNNNNNNNNNTT)rrrr frozensetrrr7propertyr:r?rFrIr[rkroryr{rrrrrrrr"r".s;" $  ! < 0 0( 9 ;?7;>B=A $ >7@. . ;F %N"H<"&#' $#!"&$( $&*#'&*&*!"& !% $!!%)&*9Trr")v1)rF)r __future__rrrapitools.base.pyrrgooglecloudsdk.api_lib.utilrgooglecloudsdk.corer r googlecloudsdk.core.utilr rrr rrr objectr"rrrrsi2&'%',*$) @z//@@Z--@/@EVEr