Q dZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z ddlZddlmZeZe j$dkDr ej&ZdZdZd Zd Zd Zd Zd ZdZdZdZdZdZdZ dZ!dZ"e e!fZ#dZ$dZ%dZ&dZ'dZ(dZ)dZ*dZ+dZ,dZ-d Z.d!Z/ej`d"d#Z1d$Z2dZ&d%Z3Gd&d'e4Z5d(Z6d)Z7Gd*d+e8Z9Gd,d-e:Z;Gd.d/e Zdlib/third_party/ml_sdk/cloud/ml/prediction/prediction_utils.py error_codezPredictionError.error_codeos 99Q<  c4|jdjSr )r!rr"s r$ error_messagezPredictionError.error_messagess 99Q<  r&c |jdS)Nr)r!r"s r$ error_detailzPredictionError.error_detailws 99Q<r&cNd|j|j|jfzS)Nz%s: %s (Error code: %d))r(r*r%r"s r$__str__zPredictionError.__str__{s. %););)-):):DOO)M MNr&N)__name__ __module__ __qualname____doc__rFAILED_TO_LOAD_MODELINVALID_INPUTSFAILED_TO_RUN_MODELINVALID_OUTPUTSINVALID_USER_CODE FAILED_TO_ACCESS_METADATA_SERVERpropertyr%r(r*r,r&r$rr\s:-$1.&'7a@.+0q:':D/)<1F%8F &"         Nr&ri@BicTeZdZdZd dZdZdZedZedZ edZ y) TimeraPContext manager for timing code blocks. The object is intended to be used solely as a context manager and not as a general purpose object. The timer starts when __enter__ is invoked on the context manager and stopped when __exit__ is invoked. After __exit__ is called, the duration properties report the amount of time between __enter__ and __exit__ and thus do not change. However, if any of the duration properties are called between the call to __enter__ and __exit__, then they will return the "live" value of the timer. If the same Timer object is re-used in multiple with statements, the values reported will reflect the latest call. Do not use the same Timer object in nested with blocks with the same Timer context manager. Example usage: with Timer() as timer: foo() print(timer.duration_secs) NcRd|_d|_|xstj|_yN)startendtimeit default_timer _get_time)r#timer_fns r$__init__zTimer.__init__s"DJDH5!5!5DNr&c>d|_|j|_|Sr<)r>rAr=r"s r$ __enter__zTimer.__enter__sDH!DJ Kr&c.|j|_y)NF)rAr>)r#exc_typevalue tracebacks r$__exit__zTimer.__exit__s~~DH r&cd|j}|jxs||jxs|z Sr<)rAr>r=)r#nows r$secondsz Timer.secondss* .. C HHO 1c 22r&c:tt|jzSr<)intMICROrMr"s r$ microsecondszTimer.microseconds ut||# $$r&c:tt|jzSr<)rOMILLIrMr"s r$ millisecondszTimer.millisecondsrRr&r<) r-r.r/r0rCrErJr7rMrQrUr8r&r$r:r:sR.6   3 3 % % % %r&r:c6eZdZdZej ddZy)StatsaAn object for tracking stats. This class is dict-like, so stats are accessed/stored like so: stats = Stats() stats["count"] = 1 stats["foo"] = "bar" This class also facilitates collecting timing information via the context manager obtained using the "time" method. Reported timings are in microseconds. Example usage: with stats.time("foo_time"): foo() print(stats["foo_time"]) Nc#rKt|5}|dddj||<y#1swYxYwwr<)r:rQ)r#namerBtimers r$timez Stats.times/ xE k ##DJ s 7+747r<)r-r.r/r0 contextlibcontextmanagerr[r8r&r$rWrWs!&$$r&rWc<eZdZdZdZd dZd dZd dZdZd dZ y) BaseModelz3The base definition of an internal Model interface.c ||_d|_y)zpConstructs a BaseModel. Args: client: An instance of PredictionClient for performing prediction. N)_client_user_processor)r#clients r$rCzBaseModel.__init__s DLDr&Nc y)a|Runs the preprocessing function on the instances. Args: instances: list of instances as provided to the predict() method. stats: Stats object for recording timing information. **kwargs: Additional keyword arguments for preprocessing. Returns: A new list of preprocessed instances. Each instance is as described in the predict() method. Nr8)r#rstatskwargss r$ preprocesszBaseModel.preprocesss r&c y)aRuns the postprocessing function on the instances. Args: predicted_output: list of instances returned by the predict() method on preprocessed instances. original_input: List of instances, before any pre-processing was applied. stats: Stats object for recording timing information. **kwargs: Additional keyword arguments for postprocessing. Returns: A new list of postprocessed instances. Nr8)r#predicted_outputoriginal_inputrerfs r$ postprocesszBaseModel.postprocesss r&c |xs t}|j||jt5|j|fd|i|}ddd|jt 5|j jfd|i|}ddd|jt5|jf||d|}ddd|S#1swY|xYw#1swYKxYw#1swYSxYw)z=Runs preprocessing, predict, and postprocessing on the input.reN)rjre) rW_validate_kwargsr[PREPROCESS_TIMErgENGINE_RUN_TIMErapredictPOSTPROCESS_TIMErk)r#rrerf preprocessedpredicted_outputs postprocesseds r$rpzBaseModel.predicts  UWE&! O $$T__YFeFvFl % O $.$,,.. /#/'-/ % $ %&d&& N,5UNFLNm &  % $ $ $ & s#C( C%CCCC(cy)aValidates and sets defaults for extra predict keyword arguments. Modifies the keyword args dictionary in-place. Keyword args will be included into pre/post-processing and the client predict method. Can raise Exception to error out of request on bad keyword args. If no additional args are required, pass. Args: kwargs: Dictionary (str->str) of keyword arguments to check. Nr8)r#rfs r$rmzBaseModel._validate_kwargs s r&cy)a"Gets model signature of inputs and outputs. Currently only used for Tensorflow model. May be extended for use with XGBoost and Sklearn in the future. Args: signature_name: str of name of signature Returns: (str, SignatureDef): signature key, SignatureDef NNr8)r#rs r$ get_signaturezBaseModel.get_signatures r&r<rw) r-r.r/r0rCrgrkrprmrxr8r&r$r_r_s#;       r&r_cx|tk(xr0t|t xst|j |dS)aDetermines if base64 decoding is required. Returns False if framework is not TF. Returns True if framework is TF and is a user model. Returns True if framework is TF and model contains a str input. Returns False if framework is TF and model does not contain str input. Args: framework: ML framework of prediction app model: model object signature_name: str of name of signature Returns: bool r)TENSORFLOW_FRAMEWORK_NAME isinstancer_does_signature_contain_strrx) frameworkr rs r$should_base64_decoder~)sD" 0 0 O%+ + N %e&9&9.&I!&L MPr&cTt|tr|Dcgc] }t|c}St|trct j |dhk(rt j|dSt j|Dcic]\}}|t|c}}S|Scc}wcc}}w)Nb64) r{list decode_base64dictsixviewkeysbase64 b64decode iteritems)datavalkvs r$rr?sd*. /$3M# $ //$ ||DeW$   d5k **.1mmD.A B.Adaaq!!.A BB K 0 Cs BB$c\|ytd|jjDS)zReturn true if input signature contains a string dtype. This is used to determine if we should proceed with base64 decoding. Args: signature: SignatureDef protocol buffer Returns: bool Tc3jK|]+}|jtjjk(-ywr<)dtyperstringas_datatype_enum).0rs r$ z-does_signature_contain_str..\s+ 1/WW 66 6/s13)anyrvalues) signatures r$r|r|Ks6   1&&--/ 1 11r&c tj}tjd||tjj |stj |tjj|d} tjddd||gtjtjd||tj|z y #tj$rtjdwxYw) aCopy files from gcs to a local path. Copies files directly to the dest_path. Sample behavior: dir1/ file1 file2 dir2/ file3 copy_model_to_local("dir1", "/tmp") After copy: tmp/ file1 file2 dir2/ file3 Args: gcs_path: Source GCS path that we're copying from. dest_path: Destination local path that we're copying to. Raises: Exception: If gsutil is not found. z$Starting to copy files from %s to %s*gsutilcpz-R)stdinz"Could not copy model using gsutil.z+Files copied from %s to %s: took %f secondsN) r[loggingdebugospathexistsmakedirsjoin subprocess check_callPIPECalledProcessError exception)gcs_path dest_pathcopy_start_times r$copy_model_to_localr`s4IIK/ --6)L  "KK  WW\\(C (( $h 3:D//K  --=x499;8:  & &  :;  s *C*Dc|jdrt|tt} tjj |t }tjj |t}tjj|r1|} ddl m } tj d||j#|Stjj|rQ|}tj d|t-|d 5} t/j0| j3cdddSy#t$rR} ddl }nB#t$r6}d}tj|ttj|d}~wwxYwYd}~d}~wwxYw#t$$r@tj d|ddl}|j)}|j+||cYSwxYw#1swYyxYw#t$rz}t5|} d | vr%d j7| t8j:d}nd j7| }tj|ttj|d}~wwxYw) a_Loads either a .joblib or .pkl file from GCS or from local. Loads one of DEFAULT_MODEL_FILE_NAME_JOBLIB or DEFAULT_MODEL_FILE_NAME_PICKLE files if they exist. This is used for both sklearn and xgboost. Arguments: model_path: The path to the directory that contains the model file. This path can be either a local path or a GCS path. Raises: PredictionError: If there is a problem while loading the file. Returns: A loaded scikit-learn or xgboost predictor object or None if neither DEFAULT_MODEL_FILE_NAME_JOBLIB nor DEFAULT_MODEL_FILE_NAME_PICKLE files are found. zgs://r)joblibNzCould not import joblib module.zLoading model %s using joblib.zRLoading model %s using joblib failed. Loading model using xgboost.Booster instead.zLoading model %s using pickle.rbzunsupported pickle protocolzCould not load the model: {}. {}. Please make sure the model was exported using python {}. Otherwise, please specify the correct 'python_version' parameter when deploying the model.z!Could not load the model: {}. {}.) startswithrLOCAL_MODEL_PATHrrrDEFAULT_MODEL_FILE_NAME_JOBLIBDEFAULT_MODEL_FILE_NAME_PICKLErsklearn.externalsr Exceptionrrrr1infoloadKeyErrorr Booster load_modelopenpickleloadsreadstrformatsys version_info) model_pathmodel_file_name_joblibmodel_file_name_picklemodel_file_namere error_msgr boosterf raw_error_msgs r$load_joblib_or_pickle_modelrs"$7# $45!J7KWW\\**HJWW\\**HJ ww~~,-.o Q -  5G{{?++ . /.o ll3_E  &!||AFFH% ' & =Q Q  Q7)   I & D DiP P Q  Q  (*9 ; //#?+  '   KFM$ 5 ABH&}c.>.>q.ACC 6<< =*i i />> JJ KsA)G(D2&FAG(#G' G(2 F <EF F 1E;;FFG(F  G(AGG(GG(G%!G(%G(( I+1A5I&&I+cDdt|jvrtSdt|jvrtSdj t|jt|j }t j|ttj|)aDistinguish scikit-learn and xgboost using model object. Arguments: model_obj: A loaded model object Raises: PredictionError: If there is a problem detecting framework from object. Returns: Either scikit-learn framework or xgboost framework sklearnr z|Invalid model type detected: {}.{}. Please make sure the model file is an exported sklearn model, xgboost model or pipeline.) typer.SCIKIT_LEARN_FRAMEWORK_NAMEXGBOOST_FRAMEWORK_NAMErr-rcriticalrr1) model_objrs r$ detect_sk_xgb_framework_from_objrs$y/,,, &&DO... !! %&,f O & & O $ $'&  Y />> JJr&cd}|D]E}tjjtjj||sA|dz }G|S)a!Count how many specified files exist in model_path. Args: model_path: The local path to the directory that contains the model file. specified_file_names: The file names to be checked Returns: An integer indicating how many specified_file_names are found in model_path. rr)rrrr)rspecified_file_names num_matches file_names r$_count_num_files_in_pathrsD+'i ww~~bggll:y9:Qk( r&ct|t}t|t}t|t}||z|z}|dkDr@dj |}t j |ttj||dk(rtS|dk(rtS|dk(rt|}t|St jdy)acDetect framework from model_path by analyzing file extensions. Args: model_path: The local path to the directory that contains the model file. Raises: PredictionError: If framework can not be identified from model path. Returns: A string representing the identified framework or None (custom code is assumed in this situation). rz4Multiple model files are found in the model_path: {}zFModel files are not found in the model_path.Assumed to be custom code.N)r$TENSORFLOW_SPECIFIC_MODEL_FILE_NAMES!XGBOOST_SPECIFIC_MODEL_FILE_NAMESSCIKIT_LEARN_MODEL_FILE_NAMESrrrrr1rzrrrwarning)rnum_tensorflow_modelsnum_xgboost_modelsnum_sklearn_modelsrrrs r$detect_frameworkr s368/35/ 0MO&(::=OO+1_FMMI Y />> JJa $$Q !!Q+J7I +I 66 OO24 r&ctjjdsytjtjjd}|rt |t sy|jd}|rt |t sytjd|j|||j|S)aYGets the value of field_name in the version being created, if it exists. Args: field_name: Name of the key used for retrieving the corresponding value from version json object. Returns: The value of the given field in the version object or the user provided create version request if it exists. Otherwise None is returned. create_version_requestNversionz:Found value: %s, for field: %s from create_version_request) renvirongetjsonrr{rrr) field_namerequestrs r$get_field_in_version_jsonr1s 0 1  JJrzz~~&>? @'  7D1  KK "'  7D1  ,,K{{:& 4 Z  r&ct|tjs#tdj t |t |vr(tdj t t ||jt S)zParses the predictions from the json response from prediction server. Args: response_json(Text): The JSON formatted response to parse. Returns: Predictions from the response json. Raises: ValueError if response_json is malformed. 4Invalid response received from prediction server: {}=Required field '{}' missing in prediction server response: {})r{collections_libMapping ValueErrorrreprPREDICTIONS_KEYpop response_jsons r$parse_predictionsrJsy M?#:#: ; >EE   ! ""M) GNN T-0 2 33   ? ++r&ct|tjs#tdj t |t |vr(tdj t t ||jt S)zParses the outputs from the json response from prediction server. Args: response_json(Text): The JSON formatted response to parse. Returns: Outputs from the response json. Raises: ValueError if response_json is malformed. rr)r{rrrrr OUTPUTS_KEYrrs r$ parse_outputsrasy M?#:#: ; >EE   ! "" % GNN m, . //   ; ''r&ct|tjs#tdj t |t |vr(tdj t t ||jt S)zParses instances from the json request sent to prediction server. Args: request_json(Text): The JSON formatted request to parse. Returns: Instances from the request json. Raises: ValueError if request_json is malformed. z-Invalid request sent to prediction server: {}zrs0     .fOO/ .  ., "( .0"0!,($ #"!%3!   1( & 0 $ & * ,k,,.0   !Ni!NH  1%F1%h$D$6SSlP, 1*(:VMK`K8$%P!2,.(.)r&