bdZddlmZddlmZddlmZddlZddlZddlZddlZddl Z ddl Z ddl m Z ddl mZddlmZ dd lmZ dd lmZd Zd ZGd deZGddeZGddeZGddeZGddeZGddeZ Gdde Z!GddeZ"dZ#GddeZ$Gd d!eZ%Gd"d#eZ&ejNejPejRejTd$Z+ejXejZe.%&Z/ejXejZe.%ejZe.%ejZe.%ejZe.%ejXejZe.%ej`ejZe.%'(e/e/e/e/) Z1d*Z2d+Z3Gd,d-eZ4y#e$r dd lmZYwxYw#e$rddlZYwxYw).z"Support for externalized runtimes.)absolute_import)division)print_functionN)comm)input)schema)py27_subprocesszWriting [{0}] to [{1}].z%Not writing [{0}], it already exists.ceZdZdZy)Errorz)Base class for exceptions in this module.N__name__ __module__ __qualname____doc__.lib/third_party/gae_ext_runtime/ext_runtime.pyr r /s1rr ceZdZdZy)PluginInvocationFailedz?Raised when a plugin invocation returns a non-zero result code.Nr rrrrr3sGrrceZdZdZy)InvalidRuntimeDefinitionz@Raised when an inconsistency is found in the runtime definition.Nr rrrrr7sHrrceZdZdZddZdZy)ParamsaParameters passed to the the runtime module Fingerprint() methods. Attributes: appinfo: (apphosting.api.appinfo.AppInfoExternal or None) The parsed app.yaml file for the module if it exists. custom: (bool) True if the Configurator should generate a custom runtime. runtime (str or None) Runtime (alias allowed) that should be enforced. deploy: (bool) True if this is happening from deployment. Nc<||_||_||_||_yNappinfocustomruntimedeploy)selfrrr r!s r__init__zParams.__init__GsDLDKDLDKrc|jxr|jj|j|j|jdS)zReturns the object converted to a dictionary. Returns: ({str: object}) A dictionary that can be converted to json using json.dump(). r)rToDictrr r!r"s rr%z Params.ToDictMs<||= (;(;(=kk||kk ##r)NFNF)rrrrr#r%rrrrr<s #rrc"eZdZdZdZdZdZy) ConfiguratorzBase configurator class. Configurators generate config files for specific classes of runtimes. They are returned by the Fingerprint functions in the runtimes sub-package after a successful match of the runtime's heuristics. cy)a`Collect all information on this application. This is called after the runtime type is detected and may gather additional information from the source code and from the user. Whereas performing user queries during detection is deprecated, user queries are allowed in CollectData(). The base class version of this does nothing. Nrr&s r CollectDatazConfigurator.CollectDatabrcy)zRun additional build behavior before the application is deployed. This is called after the runtime type has been detected and after any additional data has been collected. The base class version of this does nothing. Nrr&s rPrebuildzConfigurator.Prebuildmr+rct)zGenerate all configuration files for the module. Generates config files in the current working directory. Returns: (callable()) Function that will delete all of the generated files. NotImplementedErrorr&s rGenerateConfigszConfigurator.GenerateConfigsvs   rN)rrrrr*r-r1rrrr(r(Zs  rr(c(eZdZdZdZdZdZdZy)ExecutionEnvironmentzAn interface for providing system functionality to a runtime definition. Abstract interface containing methods for console IO and system introspection. This exists to allow gcloud to inject special functionality. ct)z5Returns the full path of the python executable (str).r/r&s rGetPythonExecutablez(ExecutionEnvironment.GetPythonExecutable  rct)z Returns true r/r&s r CanPromptzExecutionEnvironment.CanPromptr6rctrr/r"messages rPromptResponsez#ExecutionEnvironment.PromptResponses  rct)zDPrint a message to the console. Args: message: (str) r/r:s rPrintzExecutionEnvironment.Prints  rNrrrrr5r8r<r>rrrr3r3s     rr3c(eZdZdZdZdZdZdZy)DefaultExecutionEnvironmentz4Standard implementation of the ExecutionEnvironment.c"tjSr)sys executabler&s rr5z/DefaultExecutionEnvironment.GetPythonExecutables >>rc>tjjSr)rCstdinisattyr&s rr8z%DefaultExecutionEnvironment.CanPrompts 99   rctjj|tjjt dS)Nz> )rCstdoutwriteflushrr:s rr<z*DefaultExecutionEnvironment.PromptResponses.JJWJJ ;rct|yr)printr:s rr>z!DefaultExecutionEnvironment.Prints  'NrNr?rrrrArAs< rrAc:eZdZdZdZdZdZdZdZdZ dZ y ) ExternalRuntimeConfiguratoraConfigurator for general externalized runtimes. Attributes: runtime: (ExternalizedRuntime) The runtime that produced this. params: (Params) Runtime parameters. data: ({str: object, ...} or None) Optional dictionary of runtime data passed back through a runtime_parameters message. generated_appinfo: ({str: object, ...} or None) Generated appinfo if any is produced by the runtime. path: (str) Path to the user's source directory. c||_||_||_|r6i|_d|vrd|jd<|jj |nd|_||_||_y)aConstructor. Args: runtime: (ExternalizedRuntime) The runtime that produced this. params: (Params) Runtime parameters. data: ({str: object, ...} or None) Optional dictionary of runtime data passed back through a runtime_parameters message. generated_appinfo: ({str: object, ...} or None) Optional dictionary representing the contents of app.yaml if the runtime produces this. path: (str) Path to the user's source directory. env: (ExecutionEnvironment) envflexN)r paramsdatagenerated_appinfoupdatepathrQ)r"r rSrTrUrWrQs rr#z$ExternalRuntimeConfigurator.__init__slDLDKDI "d ' '(.u% ##$56#dDIDHrc^|jsy|jjrtjn|j j }tjj|jd}|jjstjj|r|tjdy|tjd|jt|d5}t!j"|j|ddddy#1swYyxYw)z8Generates the app.yaml file if it doesn't already exist.Napp.yamlwF)default_flow_style)rUrSr!logginginforQr>osrWjoinrexistsFILE_EXISTS_MESSAGEformatWRITING_FILE_MESSAGEopenyaml safe_dump)r"notifyfilenamefs rMaybeWriteAppYamlz-ExternalRuntimeConfigurator.MaybeWriteAppYamls  ! ! ![[//W\\TXX^^Fww||DIIz2H {{bggnnX6 ' ' 34   & &z499 => h  nnT++Q5I   s 7#D##D,c||_y)zSets the generated appinfo.N)rU)r"rUs rSetGeneratedAppInfoz/ExternalRuntimeConfigurator.SetGeneratedAppInfos .Drc:|jj|yr)r r*r&s rr*z'ExternalRuntimeConfigurator.CollectDatasLLT"rc:|jj|yr)r r-r&s rr-z$ExternalRuntimeConfigurator.PrebuildsLL$rc|j|jjs:|jr.t j |j|j_|j j|Sr)rjrSrrUrdict_to_objectr r1r&s rr1z+ExternalRuntimeConfigurator.GenerateConfigssW ;;  4#9#9 //0F0FGdkk << ' ' --rc|j|jjs:|jr.t j |j|j_|j j|Sr)rjrSrrUrrpr GenerateConfigDatar&s rrrz.ExternalRuntimeConfigurator.GenerateConfigDatasW ;;  4#9#9 //0F0FGdkk << * *4 00rN) rrrrr#rjrlr*r-r1rrrrrrOrOs+ <J0/# .1rrOcd|jd}tjj|g|S)aGet the absolute path from a unix-style relative path. Args: basedir: (str) Platform-specific encoding of the base directory. pathname: (str) A unix-style (forward slash separated) path relative to the runtime definition root directory. Returns: (str) An absolute path conforming to the conventions of the operating system. Note: in order for this to work, 'pathname' must not contain any characters with special meaning in any of the targeted operating systems. Keep those names simple. /)splitr^rWr_)basedirpathname componentss r_NormalizePathrys*~~c"* g + ++rceZdZdZdZdZy) GeneratedFilez0Wraps the name and contents of a generated file.c ||_||_y)zConstructor. Args: filename: (str) Unix style file path relative to the target source directory. contents: (str) File contents. N)rhcontents)r"rhr}s rr#zGeneratedFile.__init__&sDMDMrct||j}tjj |sX|t j |j|t|d5}|j|jddd|S|tj |jy#1swY|SxYw)a:Write the file to the destination directory. Args: dest_dir: (str) Destination directory. notify: (callable(str)) Function to notify the user. Returns: (str or None) The full normalized path name of the destination file, None if it wasn't generated because it already exists. rZN) ryrhr^rWr`rcrbrdrJr}ra)r"dest_dirrgrWris rWriteTozGeneratedFile.WriteTo1s (DMM 2D 77>>$  ! ( ( AB c?a    k ' ' 67   ks (B44B>N)rrrrr#rrrrr{r{#s8 rr{ceZdZdZy) PluginResultcJd|_d|_d|_d|_g|_y)N) exit_code runtime_datarUdocker_contextfilesr&s rr#zPluginResult.__init__Js(DND!DDDJrN)rrrr#rrrrrHsrrceZdZdZdZy) _Collectorz0Manages a PluginResult in a thread-safe context.cTt|_tj|_yr)rresult threadingLocklockr&s rr#z_Collector.__init__Us.DK DIrN)rrrrr#rrrrrRs 8!rr)r]errorwarndebug) converter)python)element)r files_to_copy) name descriptionauthor api_versiongenerate_configsdetect collect_dataprebuild postbuildz$Missing [{0}] field in [{1}] messagezTUser input requested: [{0}] while running non-interactive with no default specified.c~eZdZdZdZedZedZdZ dZ dZ dd Z d Z d Zd Ze Zd ZdZdZy)ExternalizedRuntimez%Encapsulates an externalized runtime.c||_||_ tj||_y#t $r)}t dj|jd}~wwxYw)z Args: path: (str) Path to the root of the runtime definition. config: ({str: object, ...}) The runtime definition configuration (from runtime.yaml). env: (ExecutionEnvironment) zInvalid runtime definition: {0}N) rootrQ_RUNTIME_SCHEMA ConvertValueconfig ValueErrorrrbr;)r"rWrrQexs rr#zExternalizedRuntime.__init__{s_DIDH@$008dk @ $ + 2 22:: > @@@s+ A$AAc:|jjddS)Nrunnamed)rgetr&s rrzExternalizedRuntime.names ;;??69 --rcttjj|d5}t |t j ||cdddS#1swYyxYw)zLoads the externalized runtime from the specified path. Args: path: (str) root directory of the runtime definition. Should contain a "runtime.yaml" file. Returns: (ExternalizedRuntime) z runtime.yamlN)rdr^rWr_rreload)rWrQris rLoadzExternalizedRuntime.Loads= bggll40 1Q tyy|S 9 2 1 1s AAc| |j}|sytj|d|j<)a!Process the standard error stream of a plugin. Standard error output is just written to the log at "warning" priority and otherwise ignored. Args: section_name: (str) Section name, to be attached to log messages. stderr: (file) Process standard error stream. : N)readliner\rrstrip)r" section_namestderrlines r_ProcessPluginStderrz(ExternalizedRuntime._ProcessPluginStderrs5  __ d   ll|T[[];< rcBfd}|jd}|"tjdt|zy|tvrt ||jdy|dk(r" |d|_|jd|_ y|d k(r1 |d }|d } |jjt|| y|d k(rd |j|d} || y|dk(r |d} |jd} |jjr6| rdj| | }n| dz}|jj!|}n/| | }n*d}tjt"j| |d|dy|dk(r |d|_ytjd|zy#t $r-tjtjd|YuwxYw#t $r3} tjtj| |Yd} ~ yd} ~ wwxYw#t $r3} tjtjd|Yd} ~ yd} ~ wwxYw#t $r,tjtjd|YywxYw)aProcess a message received from the plugin. Args: plugin_stdin: (file) The standard input stream of the plugin process. message: ({str: object, ...}) The message (this maps directly to the message's json object). result: (PluginResult) A result object in which to store data collected from some types of message. params: (Params) Parameters passed in through the fingerprinter. runtime_data: (object or None) Arbitrary runtime data obtained from the "detect" plugin. This will be None if we are processing a message for the detect plugin itself or if no runtime data was provided. cttj|jdjy)N )jsondumprJrK)response plugin_stdins r SendResponsez9ExternalizedRuntime._ProcessMessage..SendResponses+ ii,'rtypeNzMissing type in message: %0.80sr;runtime_parametersrrgen_filerhr} get_configget_config_response)rrSr query_userpromptdefaultz {0} [{1}]: :query_user_response)rrset_docker_contextrWzUnknown message type %s)rr\rstr _LOG_FUNCSrKeyError_MISSING_FIELD_ERRORrbrUrappendr{r%rQr8r<_NO_DEFAULT_ERRORr)r"rr;rrSrrmsg_typerhr}rrrrs ` r_ProcessMessagez#ExternalizedRuntime._ProcessMessagesn" {{6"H mm5G DE Z 7;;y12 ) )M%n5")Y!7f Z A:&:& M(H=> \ !/"MMO".0h8 \ !" I&g     !((9'SL'((1  && --)008 91VDE ) ) ' mm-89aM *11.(KLMA *11"h?@@A *11(HEF0 *11&(CDsT( F2/G+'H* I)22G('G(+ H'4)H""H'* I&3)I!!I&)2JJc |jj}|sy tj|}|j |j ||||S#t $r+tj|d|jY4wxYw)z:Process the standard output and input streams of a plugin.rN) rIrrloadsrrFrr\r]r)r"rprocrrSrrr;s r_ProcessPluginPipesz'ExternalizedRuntime._ProcessPluginPipessy  [[ ! ! #d  ?**T" TZZ&&,O ? t{{}=>?s4A1B B Nc d|vrht|j|d}t}tj|j j |g|r|ngztjtjtj} tj|j|| jf} | jtj|j|| |||f} | j| j| j| j} | |_| |vr1t#d|d|d|j$j'ddd | |St)j*d |zy ) aRun a plugin. Args: section_name: (str) Name of the config section that the plugin spec is from. plugin_spec: ({str: str, ...}) A dictionary mapping plugin locales to script names params: (Params or None) Parameters for the plugin. args: ([str, ...] or None) Command line arguments for the plugin. valid_exit_codes: (int, ...) Exit codes that will be accepted without raising an exception. runtime_data: ({str: object, ...}) A dictionary of runtime data passed back from detect. Returns: (PluginResult) A bundle of the exit code and data produced by the plugin. Raises: PluginInvocationFailed: The plugin terminated with a non-zero exit code. r)rIrFr)targetargsz"Failed during execution of plugin z for section z of runtime runknownz. rc = z"No usable plugin type found for %sN)ryrr subprocessPopenrQr5PIPErThreadrrstartrr_waitrrrrr\r) r"r plugin_specrSrvalid_exit_codesrnormalized_pathrp stderr_thread stdout_threadrs r RunPluginzExternalizedRuntime.RunPluginsT0;&tyy+h2GHo ~f   DHH88:OL$(Db2",//!+",//  3a  &&d.G.G-9188,EGm&&d.F.F-91f-3\-CDm&&(i"f * *$&5|&*kkoofi&H&/ &12 2 m mm8<GHrc|jjd}|rQ|jd|||gd}|jryt |||j |j ||jSy)anDetermine if 'path' contains an instance of the runtime type. Checks to see if the 'path' directory looks like an instance of the runtime type. Args: path: (str) The path name. params: (Params) Parameters used by the framework. Returns: (Configurator) An object containing parameters inferred from source inspection. r)rrN)rrrrrOrrUrQ)r"rWrSrrs rDetectzExternalizedRuntime.DetectJsn[[__X &F ~~hGf   *49L9L+1+C+C+/+/885 5 rc|jjd}|rR|jd||j|j}|j r|j |j yyy)aDo data collection on a detected runtime. Args: configurator: (ExternalRuntimeConfigurator) The configurator retuned by Detect(). Raises: InvalidRuntimeDefinition: For a variety of problems with the runtime definition. collectDatarrN)rrrrSrTrUrl)r" configuratorrrs rr*zExternalizedRuntime.CollectDatafsk;;??=1L~~nl*11+7+<+<>f  ! !(()A)AB " rc|jjd}|rT|jd||j|jg|j }|j r|j |_yyy)zPerform any additional build behavior before the application is deployed. Args: configurator: (ExternalRuntimeConfigurator) The configurator returned by Detect(). r)rrN)rrrrSrWrTr)r"rrrs rr-zExternalizedRuntime.Prebuildysp{{z*H~~j(L4G4G!!"1B1BDf   "11   rc4|jjd}|r|jd}|rg}t|dk7r td|D]}t |j |}t jj|std|zt|d5}|j}ddd|jt||S|jd||j|j } | j Sy#1swY^xYw) a#Generate list of GeneratedFile objects. Args: configurator: Configurator, the runtime configurator Returns: [GeneratedFile] a list of GeneratedFile objects. Raises: InvalidRuntimeDefinition: For a variety of problems with the runtime definition. generateConfigs filesToCopyrzOIf "files_to_copy" is specified, it must be the only field in generate_configs.zKFile [%s] specified in files_to_copy, but is not in the runtime definition.rNrr)rrlenrryrr^rWisfilerdreadrr{rrSrTr) r"rrrall_config_filesrh full_name file_to_read file_contentsrs rGetAllConfigFilesz%ExternalizedRuntime.GetAllConfigFiless#{{'89&**=9m   A %(*=> >&H$TYY9) **,E,4,45 5Is#|(--/M$  ! !--"H I&  24D , 3 3-9->-> @||3"$#s DD c|jjrtjn|jj }|j |}|gS|D].}|jdk(s|j|j|0g}|D]Q}tjjt|j|jrA|j|S|S)zDo config generation on the runtime, return file objects. Args: configurator: (ExternalRuntimeConfigurator) The configurator retuned by Detect(). Returns: [GeneratedFile] list of generated file objects. rY)rSr!r\r]rQr>rrhrrWr^r`ryr)r"rrgr config_file config_filess rrrz&ExternalizedRuntime.GenerateConfigDatas*0077W\\TXX^^F--l; i'    +L--v6(L' WW^^N<+<+<+6+?+?ABK(( rc |jjrtjn|jj }|j |}|yd}|D]!}|j|j| d}#|s|d|S)a5Do config generation on the runtime. This should generally be called from the configurator's GenerateConfigs() method. Args: configurator: (ExternalRuntimeConfigurator) The configurator retuned by Detect(). Returns: (bool) True if files were generated, False if not NFTz8All config files already exist, not generating anything.) rSr!r\r]rQr>rrrW)r"rrgrcreatedrs rr1z#ExternalizedRuntime.GenerateConfigss*0077W\\TXX^^F--l; G$   ,++V 4 @%  GH Nr)N)rN)rrrrr#propertyr staticmethodrrrrrrr*r- Fingerprintrrrr1rrrrrxs~-@& . . : := N:`? ?C!%!8It8C& 2$+(T4rr)5r __future__rrrrr\r^rrCrrr ruamel.yamlre six.movesr/googlecloudsdk.appengine.admin.tools.conversionr ImportErroryaml_conversiongooglecloudsdk.third_party.py27r rcra Exceptionr rrobjectrr(r3rArOryr{rrr]rwarningrrMessageValuer _EXEC_SECTION RepeatedFieldrrrrrrrrs)&%   %DK 1=2I2HUHu #V#<$ 6$ N 6 8"6$_1,_1D,$"F"J6!! LL ]] OO ]]   6<<# &( !&..  $ s+ 6<<# & s+#V^^v||c**f**<6<<#3NO    >Br&rm %$$% s$GG& G#"G#& G32G3