8dZddlmZddlmZddlmZddlZddlmZddl m Z ddl m Z dd l m Z dd lmZdd lmZdd lmZd ZdZdZdZdZdZ ddZdZdZdZdZdZ dZ!dZ"dZ#y)z:Validations of the arguments of custom-jobs command group.)absolute_import)division)unicode_literalsN)util) exceptions) constants) validation) local_util)utils)filescNtj|tjy)zIValidate whether the given region is allowed for specifically custom job.)available_regionsN)r ValidateRegionrSUPPORTED_TRAINING_REGIONS)regions ;lib/googlecloudsdk/command_lib/ai/custom_jobs/validation.pyrr s  D DFc`|jrt|j|yt|y)z;Validate the argument values specified in `create` command.N)worker_pool_spec_ValidateWorkerPoolSpecArgs"_ValidateWorkerPoolSpecsFromConfig)argsjob_spec_from_configversions rValidateCreateArgsr&s&  5 5w?&';z8_ValidateHardwareInWorkerPoolSpecArgs..es%E1DAa1Ds )actualexpected) rrgetapi_util GetMessageAcceleratorTypeValueValuesEnumnames startswithformatjoinsorted)r! api_versionspecaccelerator_type type_enumtype valid_typess rrrAs* d t #11 GI I  $);4)G11 R  "4d; '' ;((F(F '__. .Tx(DOOE,B .   ; .33"45;V* II%E 1D%EE6<6GH H- " s+Dc\t|d}t|dkDrt|dd|yy)zJValidates the software fields specified in all `--worker-pool-spec` flags.rN)&_ValidateSoftwareInFirstWorkerPoolSpeclen&_ValidateSoftwareInRestWorkerPoolSpecs)r!has_local_packages rr r hs?< a*+ rc:d|vr t|yt|y)zValidates the software related fields specified in the first `--worker-pool-spec` flags. Args: spec: dict, the specification of the first worker pool. Returns: A boolean value whether a local package will be used. local-package-pathTF)+_ValidateWorkerPoolSoftwareWithLocalPackage/_ValidateWorkerPoolSoftwareWithoutLocalPackages)r8s rr?r?rs"T!/5 3D9 rc|D][}|s|r/hd}t|j|jd7d|vrtjddt |]y)a2Validates the argument values specified in all but the first `--worker-pool-spec` flags. Args: specs: List[dict], the list all but the first worker pool specs specified in command line. is_local_package_specified: bool, whether local package is specified in the first worker pool. >script requirements extra-dirs python-moduleextra-packagesexecutor-image-uricontainer-image-urizA local package has been specified in the first `--worker-pool-spec` flag and to be used for all workers, do not specify these keys elsewhere.unexpected_keysreasonrDrzPKey [local-package-path] is only allowed in the first `--worker-pool-spec` flag.N)_RaiseErrorIfUnexpectedKeys intersectionkeysrrrF)specsis_local_package_specifiedr8software_fieldss rrArAsmd #  $+88E; = 4 '33",. . 8=1rcd|vsJt|ddd|vrtjddd|vd|vzdk7rtjdd d |vr_|d }|jd d }gd }||vr'|j dstjdd t j |yy#t$r+}tjddj||d}~wwxYw)z^Validate the software in a single `--worker-pool-spec` when `local-package-path` is specified.rDr) flag_namerMzLKey [executor-image-uri] is required when `local-package-path` is specified.rKrHr>z_Exactly one of keys [python-module, script] is required when `local-package-path` is specified.output-image-uri/r)zgcr.ioz eu.gcr.ioz asia.gcr.ioz us.gcr.ioz-docker.pkg.devzSThe value of `output-image-uri` has to be a valid gcr.io or Artifact Registry image+'{}' is not a valid container image uri: {}N) _RaiseErrorIfNotExistsrrsplitendswith docker_utilsValidateRepositoryAndTag ValueErrorr4)r8 output_imagehostnamecontainer_registrieses rrErEs1  %% %  ,@B%  - -V  (d"23q8  - - 2 33 4*+L!!#&q)HN++H4E4E5  / /  _  ++L9    / /  8 ? ?A    s B77 C+&C&&C+c,d|vsJd|v}d|v}d|v}||zdk7rtjdd|r|rtjdd|r|stjdd hd }|j|j}t |d y )zbValidate the software in a single `--worker-pool-spec` when `local-package-path` is not specified.rDrMrNrKr>rzJExactly one of keys [executor-image-uri, container-image-uri] is required.zKKey [python-module] is not allowed together with key [container-image-uri].z Key [python-module] is required.>rHrIrJrLz_Only allow to specify together with `local-package-path` in the first `--worker-pool-spec` flag)rQN)rrrSrTrR)r8has_executor_imagehas_container_imagehas_python_modulelocal_package_only_keysrPs rrFrFs T )) )+t3-5%-..14  - -   .  - - " $$  1  - -@ BB ,88E/ nrc |r?tjddjdjt ||y)Nrz(Keys [{keys}] are not allowed: {reason}.r&)rTrQ)rrr4r5r6rOs rrRrRsJ  - -HOO6/23FPD EErc$|jD]}|jxr.|jjxs|jj}|jxr|jj }|r|s|rj|rmt jddy)zHValidate WorkerPoolSpec message instances imported from the config file.z--configzuExactly one of fields [pythonPackageSpec, containerSpec] is required for a [workerPoolSpecs] in the YAML config file.N)workerPoolSpecspythonPackageSpecexecutorImageUri pythonModule containerSpecimageUrirr)job_specr8use_python_package use_containers rrrs&&d//- // , ++&&F4+=+=+F+FM,m6H  / /  J LL'rcfg}|jr|jd|jr|jd|jr|jd|jr|jd|j r|jd|j r|jd|S)zAReturns names of all the flags specified only for image building.rHrKrIrLrJrZ)rHappend python_modulerIextra_packages extra_dirsoutput_image_uri)rimage_build_argss r_ImageBuildArgSpecifiedr~ s [[H% O, N+ ,- __L) ./ rc t|}|sy|jsK|js?tjddgdj dj t||jrd}n&tj|j|_d}tjjtjj |j|j}tjj|rtjj|s:tj |dj |j|j|j"xsgD]}tjjtjj |j|}tjj|r tjj|rtj ddj ||j|j$xsgD]}tjjtjj |j|}tjj|r tjj'|rtj d d j ||j|j(r#|j(} t+j,|yt+j0|j |_y#t.$r+} tj d d j || d} ~ wwxYw)zEValidates the arguments related to image building and normalize them.Nz--scriptz--python-modulezThey are required to build a training container image. Otherwise, please remove flags [{}] to directly run the `executor-image-uri`.r&z/File '{}' is not found under the package: '{}'.z--extra-packagesz7Package file '{}' is not found under the package: '{}'.z --extra-dirsz4Directory '{}' is not found under the package: '{}'.z--output-image-urir\) base_name)r~rHryrMinimumArgumentExceptionr4r5r6r ModuleToPathospathnormpathlocal_package_pathexistsisfilerrzr{isdirr|r`rarbGenerateImageName) rbuild_args_specifiedarg_name script_pathpackage package_path directorydir_pathrcrfs r_ValidBuildArgsOfLocalRunrs06  T//  - - &' X  &!567 8  :: [[H))$*<*<=DK H  ggll4**DKK8:+  $BGGNN;,G  - -DKK KK002 33 %%++g77##  T,,g68L 77>>, 'rww~~l/K  / /  D K Kt.. 0 11 ,OO)r)iww  T,,i8:H 77>>( #277==+B  / /  A H H00 2 33 * ((L ++L9)::++D   / /  8 ? ?A    sM N&M<<Nc|j}|rtjjt j |}tjj |rtjj|s9tjddj|t j}||_t||S)zLValidates the arguments specified in `local-run` command and normalize them.z--local-package-pathDirectory '{}' is not found.) rrrabspathr ExpandHomeDirrrrrr4GetCWDr)rargs_local_package_pachwork_dirs rValidateLocalRunArgsr\s 33wwu223JKLH 77>>( #277==+B  / / ) 0 0 : <<||~H$$D! +rc.tjjtj|}tjj |rtjj |s%tj|dj|y)zValidate the local package is valid. Args: local_package_path: str, path of the local directory to check. flag_name: str, indicates in which flag the path is specified. rN) rrrr rrrrrr4)rrYrs rr]r]nsmWW__U001CD E(  !x)@  - -299(C EE*Ar)F)$__doc__ __future__rrrrgooglecloudsdk.api_lib.airr/googlecloudsdk.calliopergooglecloudsdk.command_lib.airr )googlecloudsdk.command_lib.ai.custom_jobsr $googlecloudsdk.command_lib.ai.dockerr r`googlecloudsdk.core.utilr rrrrr r?rArErFrRrr~rrr]r(rrrsA&' 6.34@F*F =;$$HN>$GL">J" J#LEL"&;|$ Er