dZddlmZddlmZddlmZddlZddlZddlZddlm Z ddlm Z ddlm Z dd l mZdd l mZddl m Z dd l mZdd l mZdd l mZddl mZddl mZddl mZddlmZddlmZddlmZddlmZ ddl!m"Z"ddl!m#Z#ddl!m$Z$ddl%Z%ddl&m'Z'ddl&m(Z(e jRjTde jRjVde jRjXdiZ-dZ.dgZ/Gdd ej`Z1y)!zDFunctions for creating a client to talk to the App Engine Admin API.)absolute_import)division)unicode_literalsN)encoding) exceptions) list_pager)build)env)instances_util)operations_util) region_util) service_util)util) version_util)appengine_api_client_base)logs) convert_yaml)base)log) properties) resources)filter)mapv1v1alphav1betac>t|}tj|SN)APPENGINE_VERSIONS_MAPAppengineApiClient GetApiClient) release_track api_versions 6lib/googlecloudsdk/api_lib/app/appengine_api_client.pyGetApiClientForTrackr%9s&}5+  ( ( 55python27ceZdZdZdZdZdZd%dZd&dZ d&dZ d Z d&d Z d Z d Z d'd ZdZdZ d(dZdZd)dZd%dZdZdZd(dZd(dZdZdZdZdZdZdZd%dZ d&dZ d Z!d!Z"d"Z#d#Z$d$Z%y)*r z=Client used by gcloud to communicate with the App Engine API.c|jj|j}|jjj |S)zRetrieves the application resource. Returns: An app resource representing the project's app. Raises: apitools_exceptions.HttpNotFoundError if app doesn't exist name)messagesAppengineAppsGetRequest _FormatAppclientappsGet)selfrequests r$GetApplicationz!AppengineApiClient.GetApplicationCs=mm339J3KG ;;     ((r&c|jj|j|}|jjj |S)aGLists the available runtimes for the given App Engine environment. Args: environment: The environment for the application, either Standard or Flexible. Returns: v1beta|v1.ListRuntimesResponse, the list of Runtimes. Raises: apitools_exceptions.HttpNotFoundError if app doesn't exist )parent environment)r, AppengineAppsListRuntimesRequestr.r/r0 ListRuntimes)r2r7r3s r$r9zAppengineApiClient.ListRuntimesOsFmm<< k=G ;;   ( ( 11r&c|j|jjjj|jjjj fv}|S)aChecks application resource to get serving status. Args: app: appengine_v1_messages.Application, the application to check. Returns: bool, whether the application is currently disabled. If serving or not set, returns False. ) servingStatusr, ApplicationServingStatusValueValuesEnum USER_DISABLEDSYSTEM_DISABLED)r2appstoppeds r$ IsStoppedzAppengineApiClient.IsStoppedasT !!>>LL !!>>NN$PPG Nr&Nc|jj|j|jj}|jj j |}tjdj|jtj|jj||S)aCreates missing app resources. In particular, the Application.code_bucket GCS reference. Args: progress_message: str, the message to use while the operation is polled, if not the default. Returns: A long running operation. )r+repairApplicationRequest!Received operation: [{operation}] operationmessage)r,AppengineAppsRepairRequestr.RepairApplicationRequestr/r0Repairrdebugformatr+r WaitForOperationapps_operations)r2progress_messager3rGs r$RepairApplicationz$AppengineApiClient.RepairApplicationpsmm66 __ !%!G!G!I7KG   ''0III188..9"#  + + ##Y8H JJr&cd}|r)|jj|j||}n'|jj|j|}|r||_|jj j |}tjdj|jdj|j|}tj|jj||S) a|Creates an App Engine app within the current cloud project. Creates a new singleton app within the currently selected Cloud Project. The action is one-time and irreversible. Args: location: str, The location (region) of the app, i.e. "us-central" service_account: str, The app level service account of the app, i.e. "123@test-app.iam.gserviceaccount.com" ssl_policy: enum, the app-level SSL policy to update for this App Engine app. Can be DEFAULT or MODERN. Raises: apitools_exceptions.HttpConflictError if app already exists Returns: A long running operation. N)id locationIdserviceAccount)rTrUrErFzMCreating App Engine application in project [{project}] and region [{region}].)projectregionrH)r,r<rW sslPolicyr/r0CreaterrMrNr+r rOrP)r2locationservice_account ssl_policycreate_requestrGrIs r$ CreateAppzAppengineApiClient.CreateApps&N}}00 \\h1Pn}}00 \\h10n!+n   ''7III188..9"#$$*F4<<2:%+%<   + +DKK,G,G,5w HHr&c |j|||||||}dj|} |jtjtjfvr| dz } |j } |r|j r| stjdntj|jj| } tj|jj|| | }tj|| } | rtj j#| }|r|j%r t&j(j+|j,dt.j0j2j4j6id} t9j:j=| tj> tjN|jj| }tj|jj|| |S#t@jB$rtEjF|jIjJ}t&j(jMd t.j0j2j4j6||j, } t9j:j=| tj> Y&wxYw) a Updates and deploys new app versions. Args: service_name: str, The service to deploy. version_id: str, The version of the service to deploy. service_config: AppInfoExternal, Service info parsed from a service yaml file. manifest: Dictionary mapping source files to Google Cloud Storage locations. build: BuildArtifact, a wrapper which contains either the build ID for an in-progress parallel build, the name of the container image for a serial build, or the options for creating a build elsewhere. Not present during standard deploys. extra_config_settings: dict, client config settings to pass to the server as beta settings. service_account_email: Identity of this deployed version. If not set, the Admin API will fall back to use the App Engine default appspot service account. Returns: The Admin API Operation, unfinished. Raises: apitools_exceptions.HttpNotFoundError if build ID doesn't exist zUpdating service [{service}]servicez (this may take several minutes)zIUnable to determine build from Operation metadata. Skipping log streaming)rIpoller projectIdzcloudbuild.projects.builds)params collection)outz$cloudbuild.projects.locations.builds)rf projectsId locationsIdbuildsId)(_CreateVersionrNr FLEX MANAGED_VMS_ResolveMetadataTypeIsBuildOptionsrwarningr AppEngineOperationBuildPollerr/rPrOGetBuildFromOperationapp_cloud_build BuildArtifactMakeBuildIdArtifact IsBuildIdrREGISTRYParse identifierrVALUEScorerW GetOrFailcloudbuild_logsCloudBuildClientStreamstatusapitools_exceptionsHttpNotFoundErrorrConvertToCloudRegionr4rUrZAppEngineOperationPoller)r2 service_name version_idservice_configmanifestr extra_config_settingsservice_account_emailrGrIoperation_metadata_typercbuild_id build_refrX done_pollers r$ DeployServicez AppengineApiClient.DeployServicesoB##L*n$,e5J$9;I-33L3IGchh88 33g"779 %%' $ - .!>> KK ' ')@B#44 KK ' 'G #88 .0 !//CCHM% " M&&,,   !2!2!7!7!?!?!I!IJ3-5  ((*11)1L":: ##%<>K  + + ##  ! 2 2M**4+>+>+@+K+KL&&--=!((--55??%% .' ((*11)1LMs6B HC K*)K*c|d|jjjz}t|j|S)zAAttempts to resolve the expected type for the operation metadata.OperationMetadata)r/_VERSIONtitlegetattrr,)r2metadata_type_names r$rnz'AppengineApiClient._ResolveMetadataTypes4-t{{/C/C/I/I/KK 4=="4 55r&c|j||||||}|jj|j||} |jj j | S)aBegins the updates and deployment of new app versions. Args: service_name: str, The service to deploy. version_id: str, The version of the service to deploy. service_config: AppInfoExternal, Service info parsed from a service yaml file. manifest: Dictionary mapping source files to Google Cloud Storage locations. build: BuildArtifact, a wrapper which contains either the build ID for an in-progress parallel build, the name of the container image for a serial build, or the options to pass to Appengine for a server-side build. extra_config_settings: dict, client config settings to pass to the server as beta settings. service_account_email: Identity of this deployed version. If not set, the Admin API will fall back to use the App Engine default appspot service account. Returns: The Admin API Operation, unfinished. r)r6version)_CreateVersionResourcer,*AppengineAppsServicesVersionsCreateRequest_GetServiceRelativeNamer/apps_services_versionsrZ) r2rrrrr rrversion_resourcer^s r$rkz!AppengineApiClient._CreateVersion sr:22>83=u3H3HJ]]MM+++F N"N ;; - - 4 4^ DDr&c|jj|j|}|jjj |S)zDescribe the given service. Args: service: str, the ID of the service Returns: Service resource object from the API r*)r,AppengineAppsServicesGetRequestrr/ apps_servicesr1)r2rbr3s r$GetServiceResourcez%AppengineApiClient.GetServiceResource3sFmm;;  ) )' 2<4G ;; $ $ ( ( 11r&c.|di}|j||S)zSets the default serving version of the given services. Args: service_name: str, The service name version_id: str, The version to set as default. Returns: Long running operation. g?)SetTrafficSplit)r2rr allocationss r$SetDefaultVersionz$AppengineApiClient.SetDefaultVersion@s!s#K    k ::r&ctj|jj||d}|jj |j ||jj ||d}dj|}|jjj|}tj|jj||S) aRSets the traffic split of the given services. Args: service_name: str, The service name allocations: A dict mapping version ID to traffic split. shard_by: A ShardByValuesEnum value specifying how to shard the traffic. migrate: Whether or not to migrate traffic. Returns: Long running operation. )rshardByr)splitr)r+rbmigrateTraffic updateMaskz-Setting traffic split for service [{service}]rarH)rPyValueToMessager, TrafficSplit!AppengineAppsServicesPatchRequestrServicerNr/rPatchr rOrP) r2rrshard_bymigrate traffic_splitupdate_service_requestrIrGs r$rz"AppengineApiClient.SetTrafficSplitNs--dmm.H.H>I:B/DEM"]]LL  ) )| ) D %%M%: M >DDEG ))//0FGI  + +DKK,G,G,54; ==r&c|jj|}|jj|j||jj |d}dj |}|j jj|}tj|j j||S) aSets the ingress traffic allowed for a service. Args: service_name: str, The service name ingress_traffic_allowed: An IngressTrafficAllowed enum. Returns: The completed Operation. The Operation will contain a Service resource. )ingressTrafficAllowedr)networkSettingsr)r+rbrz0Setting ingress settings for service [{service}]rarH) r,NetworkSettingsrrrrNr/rrr rOrP)r2ringress_traffic_allowednetwork_settingsrrIrGs r$SetIngressTrafficAllowedz+AppengineApiClient.SetIngressTrafficAllowedls}}44557!]]LL  ) )| ) D %%6F%G$M& AGGHG ))//0FGI  + + ##Y AAr&c"|jj|j||}|jjj |}dj ||}tj|jj||S)zDeletes the specified version of the given service. Args: service_name: str, The service name version_id: str, The version to delete. Returns: The completed Operation. rrr*zDeleting [{0}/{1}]rH) r,*AppengineAppsServicesVersionsDeleteRequest_FormatVersionr/rDeleterNr rOrP)r2rrdelete_requestrGrIs r$ DeleteVersionz AppengineApiClient.DeleteVersions]]MM  l,6!8N9N 2299.II")), CG  + + ##Y AAr&c:|jj|j|||jj|d}|jj j |}|r*tj|jj|S|S)a|Sets the serving status of the specified version. Args: service_name: str, The service name version_id: str, The version to delete. serving_status: The serving status to set. block: bool, whether to block on the completion of the operation Returns: The completed Operation if block is True, or the Operation to wait on otherwise. r)r;r;)r+rr) r,)AppengineAppsServicesVersionsPatchRequestrVersionr/rrr rOrP)r2rrserving_statusblock patch_requestrGs r$SetServingStatusz#AppengineApiClient.SetServingStatussMMKK  l,6!8 %%N%C" L$M  2288GI  - -dkk.I.I.799r&cg}|D]}|jj|j|j|j} t j |jj|dddD]0}|jtjj|2|S#tj$rYwxYw)zProduces a generator of all instances for the given versions. Args: versions: list of version_util.Version Returns: A list of instances_util.Instance objects for the given versions r6 instancesdpageSizefield batch_sizebatch_size_attribute)r,1AppengineAppsServicesVersionsInstancesListRequestrrbrTr YieldFromListr/ apps_services_versions_instancesappendr InstanceFromInstanceResourcerr)r2versionsrrr3instances r$ ListInstancesz AppengineApiClient.ListInstancessI OO$$W__gjjAPCg  "00 KK 8 8 !+ -H   %%::8D F -  ! 2 2   s A!B..CCc |j}tjdj|t j ||r|gnd}|j |}tjdjttt|tj||r|gnd|}tt||}|j|S)aDGenerator of all instances, optionally filtering by service or version. Args: service: str, the ID of the service to filter by. version: str, the ID of the version to filter by. version_filter: filter function accepting version_util.Version Returns: generator of instance_util.Instance zAll services: {0}Nz Versions: {0}) ListServicesrrMrNrGetMatchingServices ListVersionslistrstrrGetMatchingVersionsrr)r2rbrversion_filterservicesrs r$GetAllInstancesz"AppengineApiClient.GetAllInstancess  "HII!((23//w7)D2H  *HIIo$$T#c8*<%=>?//w7)D';HF>845H   h ''r&c*|jj|j|jj|}|jj j |}tj|jj|S)a!Enable debugging of a Flexible instance. Args: res: A googleclousdk.core.Resource object. ssh_key: str, Public SSH key to add to the instance. Examples: `[USERNAME]:ssh-rsa [KEY_VALUE] [USERNAME]` , `[USERNAME]:ssh-rsa [KEY_VALUE] google-ssh {"userName":"[USERNAME]",` `"expireOn":"[EXPIRE_TIME]"}` For more information, see Adding and Removing SSH Keys (https://cloud.google.com/compute/docs/instances/adding-removing-ssh- keys). Returns: The completed Operation. )sshKey)r+debugInstanceRequest) r,2AppengineAppsServicesVersionsInstancesDebugRequest RelativeNameDebugInstanceRequestr/rDebugr rOrP)r2resssh_keyr3rGs r$ DebugInstancez AppengineApiClient.DebugInstances~ mmNN    !]]??w?OOQG <<BB7KI  + +DKK,G,G,5 77r&c|jj|j}|jjj |}t j|jj|S)zDelete a Flexible instance. Args: res: A googlecloudsdk.core.Resource object. Returns: The completed Operation. r*) r,3AppengineAppsServicesVersionsInstancesDeleteRequestrr/rrr rOrP)r2rr3rGs r$DeleteInstancez!AppengineApiClient.DeleteInstancesfmmOO    P!G <<CCGLI  + +DKK,G,G,5 77r&c|jj|j}|jjj |S)aDescribe the given instance of the given version of the given service. Args: res: A googlecloudsdk.core.Resource object. Raises: apitools_exceptions.HttpNotFoundError: If instance does not exist. Returns: Version resource object from the API r*)r,0AppengineAppsServicesVersionsInstancesGetRequestrr/rr1)r2rr3s r$GetInstanceResourcez&AppengineApiClient.GetInstanceResourcesEmmLL    M!G ;; 7 7 ; ;G DDr&cz|j|||jjjj|S)a5Stops the specified version. Args: service_name: str, The service name version_id: str, The version to stop. block: bool, whether to block on the completion of the operation Returns: The completed Operation if block is True, or the Operation to wait on otherwise. )rr,rr=STOPPEDr2rrrs r$ StopVersionzAppengineApiClient.StopVersions9   ::BB  r&cz|j|||jjjj|S)a6Starts the specified version. Args: service_name: str, The service name version_id: str, The version to start. block: bool, whether to block on the completion of the operation Returns: The completed Operation if block is True, or the Operation to wait on otherwise. )rr,rr=SERVINGrs r$ StartVersionzAppengineApiClient.StartVersion,s9   ::BB  r&c|jj|j}g}tj|j j |dddD]}i}|jr>|jjjD]}|j||j<|jtj|j|j ||S)znLists all services for the given application. Returns: A list of service_util.Service objects. rrrrr)r, AppengineAppsServicesListRequestr.rrr/rrradditionalPropertiesvaluekeyrrrrWrT)r2r3rrbrrs r$rzAppengineApiClient.ListServices>s mm<< ="GH++ !!7*Z9m ]]..CCE%*[[- "Doo   t||WZZ GI9 Or&c|jj|j|||jjjj}|j j j|S)zDescribe the given version of the given service. Args: service: str, the ID of the service for the version to describe. version: str, the ID of the version to describe. Returns: Version resource object from the API. )r+view)r,'AppengineAppsServicesVersionsGetRequestrViewValueValuesEnumFULLr/rr1)r2rbrr3s r$GetVersionResourcez%AppengineApiClient.GetVersionResourceRscmmCC  ' 2mm556I6I$$DQG ;; - - 1 1' ::r&czg}|D]}|jj|j|j} t j |j j|dddD]1}|jtjj||3|S#tj$rYwxYw)zLists all versions for the specified services. Args: services: A list of service_util.Service objects. Returns: A list of version_util.Version objects. rrrrr)r,(AppengineAppsServicesVersionsListRequestrrTrrr/rrrrFromVersionResourcerr)r2rrrbr3rs r$rzAppengineApiClient.ListVersionsbsH FF--gjj9G;g  !// KK . . !+ -G //""66wH J - " O ! 2 2   sA"B$$B:9B:c,|jjdj|j}t j |j j|ddd}|Dcgc]!}tjj|#c}Scc}w)zList all regions for the project, and support for standard and flexible. Returns: List of region_util.Region instances for the project. zapps/{0}r* locationsrrr) r,!AppengineAppsLocationsListRequestrNrWrrr/apps_locationsr RegionFromRegionResource)r2r3regionslocs r$ ListRegionszAppengineApiClient.ListRegions~s mm==   t|| ,>.G&& ""G;Z9GCJ J'3K   1 1# 6' JJ Js(&Bc|jj|j|}|jjj |}dj |}tj|jj||S)zDeletes the specified service. Args: service_name: str, Name of the service to delete. Returns: The completed Operation. rr*z Deleting [{}]rH) r,"AppengineAppsServicesDeleteRequestrr/rrrNr rOrP)r2rrrGrIs r$ DeleteServicez AppengineApiClient.DeleteServices]]EE  ) )| ) DFFN ))00@I$$\2G  + +DKK,G,G,54; ==r&c|jj|j|}|jjj |S)zGrabs details about a particular gcloud operation. Args: op_id: str, ID of operation. Returns: Operation resource object from API call. r*)r,!AppengineAppsOperationsGetRequest_FormatOperationr/rPr1)r2op_idr3s r$ GetOperationzAppengineApiClient.GetOperationsHmm==  " "5 )>+G ;; & & * *7 33r&c|jj|j|}tj|j j |ddd}|Dcgc]}tj|c}Scc}w)zLists all operations for the given application. Args: op_filter: String to filter which operations to grab. Returns: A list of opeartion_util.Operation objects. )r+r operationsrrr) r,"AppengineAppsOperationsListRequestr.rrr/rPr Operation)r2 op_filterr3rops r$ListOperationsz!AppengineApiClient.ListOperationsswmm>> __ ?G)) ##WLZ9J5? ?JbO % %b )J ?? ?sA=c tj|jj}d|vrd|d< t j |j j}|j|} t!j"djt%j&| dd ||| d <i| d <|| d d <|rl|j)rd |j*i| d d<nG|j-rd|j*i| d d<n"|j/r|j*| d d<t1j2|j4j6| } | j8r'| j8j:j=d|rd| vri| d<| dj?|d| vr| jAd} g} tC| jED]E\}}| jG|j4j6jHjK||G|j4j6jI| | _& | jNjPj:j=tSjTd|| _,| S#t$rH} tjdj|jtj| d} ~ wwxYw#tV$rYhwxYw)aConstructs a Version resource for deployment. Args: service_config: ServiceYamlInfo, Service info parsed from a service yaml file. manifest: Dictionary mapping source files to Google Cloud Storage locations. version_id: str, The version of the service. build: BuildArtifact, The build ID, image path, or build options. extra_config_settings: dict, client config settings to pass to the server as beta settings. service_account_email: identity of this deployed version. If not set, Admin API will fallback to use the App Engine default appspot SA. Returns: A Version resource whose Deployment includes either a container pointing to a completed image, or a build pointing to an in-progress build. entrypointzc[{f}] could not be converted to the App Engine configuration format for the following reason: {msg})fmsgNzConverted YAML to JSON: "{0}"T)indent sort_keysrV deploymentfilesimage container cloudBuildIdr cloudBuildOptionsc|jSrr)xs r$z;AppengineApiClient._CreateVersionResource..sr&r1 betaSettings)rr)rr)-copydeepcopyparsedToDictrGetSchemaParserr/r ConvertValue ValueErrorr ConfigErrorrNfilesix text_typerrMjsondumpsIsImageryrvrorrr,r envVariablesrsortupdategetsorteditemsrBetaSettingsValueAdditionalPropertyr4r*r+operator attrgetterAttributeErrorrT)r2rrrr rr config_dict schema_parserjson_version_resourceer json_dict attributesrrs r$rz)AppengineApiClient._CreateVersionResources2-- 5 5 < < >?K;&"$k,<"224;;3G3GHm+88E II-44 (dCEF(0E,-*,,'3;,'0  U%%< l+K8 ??  E,,8 l+G4    !    l+,?@001F1F1FH$$##88==> 4 402n-N+223HI ..'++N;ijy01*#u MM ! ! 3 3 F Fu G & '2'+mm&;&;&M&M)'N'+#  !!''<<AA!!%(B* % A <  " " 3396##q)94:4; <<