d VdZddlmZddlmZddlmZddlZddlmZGddeZ y) zTA library for streaming prediction results from the Vertex AI PredictionService API.)absolute_import)division)unicode_literalsN)apisc"eZdZdZdZdZdZy)PredictionStreamerz(Streams prediction responses using gRPC.c:tjd||_y)N aiplatform)rGetGapicClientInstanceclient)selfversions >lib/googlecloudsdk/api_lib/ai/endpoints/prediction_streamer.py__init__zPredictionStreamer.__init__s--lGDDKc#K|jjj|}|D]]}|jj |jjj j tj|_|jjj j tj||_ |jjjt|gD]}|yw)a;Streams prediction results from the Cloud Vertex AI PredictionService API. Args: endpoint: The name of the endpoint to stream predictions from. inputs: The inputs to send to the endpoint. parameters: The parameters to send to the endpoint. Yields: Streamed prediction results. )endpointN) r typesStreamDirectPredictRequestinputsappendTensor from_jsonjsondumps parameters predictionstream_direct_predictiter)r rrrrequest curr_inputrs rStreamDirectPredictz&PredictionStreamer.StreamDirectPredict s"kk::H:MG  nn ++   " " , ,TZZ -C D**11;; :Gkk,,BB gY  sD D c#K|jjj|||}|jjj t |gD]}|yw)a8Streams prediction results from the Cloud Vertex AI PredictionService API. Args: endpoint: The name of the endpoint to stream predictions from. method_name: The name of the method to call. input: The input bytes to send to the endpoint. Yields: Streamed prediction results. )r method_nameinputN)r rStreamDirectRawPredictRequestrstream_direct_raw_predictr)r rr$r%r rs rStreamDirectRawPredictz)PredictionStreamer.StreamDirectRawPredict?s`"kk=={%>Gkk,,FF gY  sA"A$N)__name__ __module__ __qualname____doc__rr"r(rrrrs0E>rr) r, __future__rrrrgooglecloudsdk.api_lib.utilrobjectrr-rrr1s&[&' ,==r