9&dZddlmZddlmZddlmZddlmZddlmZ ddlm Z ddl m Z dd lmZdd lmZd Z dd ZdZ ddZdZ ddZdZy )z/Utilities for AI Platform custom jobs commands.)absolute_import)division)unicode_literals) local_util)build)utils) arg_utils)log)filesz(aiplatform.projects.locations.customJobsNc|jd}|jd}||jd}|jd}|rEtj||j|_t |jdd|_||_t |jdd|_ |jd }|jd }|jd } |r!|jd } | | |_ |S|s|s| r%|jd} | ||xsg| |_ |S)aConstructs the specification of a single worker pool. Args: aiplatform_client: The AI Platform API client used. spec: A dict whose fields represent a worker pool config. python_package_uri: str, The common python package uris that will be used by executor image, supposedly derived from the gcloud command flags. Returns: A WorkerPoolSpec message instance for setting a worker pool in a custom job. WorkerPoolSpec MachineSpecz machine-type) machineTypezaccelerator-typezaccelerator-countz replica-countcontainer-image-uriexecutor-image-uri python-module ContainerSpec)imageUriPythonPackageSpec)executorImageUri packageUris pythonModule) GetMessagegetr ChoiceToEnumAcceleratorTypeValueValuesEnumacceleratorTypeintacceleratorCount machineSpec replicaCount containerSpecpythonPackageSpec) aiplatform_clientspecpython_package_uriworker_pool_specmachine_spec_msg machine_specaccelerator_typecontainer_image_uriexecutor_image_uri python_modulecontainer_spec_msgpython_package_spec_msgs Alib/googlecloudsdk/command_lib/ai/custom_jobs/custom_jobs_util.py_ConstructSingleWorkerPoolSpecr2 sJD&112BCE&11-@!dhh~.FG,XX01#,#9#9*II$KL $'1Da(H$IL!!-"%dhh&B"C!67xx 45((?+-*55oF%7$&&" /=/::;NO)@+'-2"*$& c g}|D]F}|r|jt||fi|"|j|jdH|S)aConstructs the specification of the worker pools in a CustomJobSpec instance. Args: aiplatform_client: The AI Platform API client used. specs: A list of dict of worker pool specifications, supposedly derived from the gcloud command flags. **kwargs: The keyword args to pass down to construct each worker pool spec. Returns: A list of WorkerPoolSpec message instances for creating a custom job. r )appendr2r)r%specskwargsworker_pool_specsr&s r1_ConstructWorkerPoolSpecsr9Lsad  ():D KF KMM0;; local_packagescriptrAr.r7 output_image push_commands r1_PrepareTrainingImagerSds#8l&D&D'$'8,&&}5!$   **CDFL1,##L1**GNN  r3c# Kd}|rd|dvr|djd}|djd}|djdd}|rtj|}n|djd}|djdd}t||||||||djdd|djd d|djd d }|D]$} |r| r| j } || d <| !| &yw) aUpdate the given worker pool specifications if any contains local packages. If any given worker pool spec is specified a local package, this builds a Docker image from the local package and update the spec to use it. Args: worker_pool_specs: list of dict representing the arg value specified via the `--worker-pool-spec` flag. job_name: str, the display name of the custom job corresponding to the worker pool specs. project: str, id of the project to which the custom job is submitted. Yields: All updated worker pool specifications that uses the already built packages and are expectedly passed to a custom-jobs create RPC request. Nzlocal-package-pathrrrrPzoutput-image-uri requirementszextra-packagesz extra-dirs) r<rNr>rOrPrAr.rUextra_packages extra_dirsr)popr ModuleToPathrScopy) r8rNr<image_built_for_first_workerr>rOr.rPrQr&new_specs r1+UpdateWorkerPoolSpecsIfLocalPackageRequiredr]s4&"&/3DQ3GG"1%))*>?J%a(,,-ABM%a(,,_dCM&&}5f #''1f$Q'++,>EL#8#&#&q)--ndC(+//0@$G$Q'++L$? $A  d#h(Dh$% n j  sDDc  |} ||| _||| _|r|| _|r|| _|rt ||fi| | _|rL| j D]=} | j r|| j _| js-|| j_?|r/| j D] } | j s|| j _ "| r| | _ | S)aConstructs the spec of a custom job to be used in job creation request. Args: aiplatform_client: The AI Platform API client used. base_config: A base CustomJobSpec message instance, e.g. imported from a YAML config file, as a template to be overridden. network: user network to which the job should be peered with (overrides yaml file) service_account: A service account (email address string) to use for the job. enable_web_access: Whether to enable the interactive shell for the job. enable_dashboard_access: Whether to enable the access to the dashboard built on the job. worker_pool_specs: A dict of worker pool specification, usually derived from the gcloud command argument values. args: A list of arguments to be passed to containers or python packge, supposedly derived from the gcloud command flags. command: A list of commands to be passed to containers, supposedly derived from the gcloud command flags. persistent_resource_id: The name of the persistent resource from the same project and region on which to run this custom job. **kwargs: The keyword args to pass to construct the worker pool specs. Returns: A CustomJobSpec message instance for creating a custom job. ) networkserviceAccountenableWebAccessenableDashboardAccessr9workerPoolSpecsr#argsr$commandpersistentResourceId) r% base_configr_service_accountenable_web_accessenable_dashboard_accessr8rdrepersistent_resource_idr7job_specr(s r1ConstructCustomJobSpecrmsL( H -H0H%r{sw6&'@FF:#*C 7;)X<)- <1l   CL1r3