SdZddlmZddlmZddlmZddlmZddl m Z ddl m Z ddl m Z d Zd Zd Zej"ej$ej&j(Gd d ej*Zy)z7Outputs benchmarking data for GKE Inference Quickstart.)util)base)commands)profiles_csv_printer) exceptions)log)resource_printerz To get benchmarking data for a given model and model server, run: $ {command} --model=google/gemma-2-27b-it--model-server=vllm cP|j}|sd}||jdz z}|dS)z*Converts cost to a decimal representation.rgeAz.3f)unitsnanos)costr decimal_values 4lib/surface/container/ai/profiles/benchmarks/list.pyamount_to_decimalr s4 **%  EDJJ,,-- # cd}|r'|djrt|dj}d}|r'|djrt|dj}||fS)zpReturns the cost per million normalized output tokens as a decimal. Args: costs: The costs to convert. zN/Ar)costPerMillionOutputTokensrcostPerMillionInputTokens)costsoutput_token_costinput_token_costs rget_decimal_costr)sd  uQx22)%(*M*MN uQx11(q)K)KL - ..rc&eZdZdZedZdZy)ListaList benchmarks for a given model and model server. This command lists all benchmarking data for a given model and model server. By default, the benchmarks are displayed in a CSV format. For examples of visualizing the benchmarking data, see the accompanying Colab notebook: https://colab.research.google.com/github/GoogleCloudPlatform/kubernetes-engine-samples/blob/main/ai-ml/notebooks/giq_visualizations.ipynb c||jddd|jddd|jdd |jd d |jd d tjtjtj |j jtjy)Nz--modelTz The model.)requiredhelpz--model-serverzThe model server.z--model-server-versionzThe model server version. Default is latest. Other options include the model server version of a profile, all which returns all versions.)rz--instance-typezGThe instance type. If not specified, this defaults to anyinstance type.z--formatzThe format to print the output in. Default is csvprofile, which displays the profile information in a CSV format, includingcost conversions.) add_argumentr RegisterFormatterrPROFILES_PRINTER_FORMATProfileCSVPrinter display_info AddFormat)parsers rArgsz List.ArgsEs             &&44.. !!"6"N"NOrcxtjtjj}tj tjj} |j |j|j|j}|j||j}|jj|}|jsgS|jS#tj $rF}t#j$d|t"j&j)d|gcYd}~Sd}~wwxYw)N)model modelServermodelServerVersion)modelServerInfo instanceTypezAn error has occurred: )rGetClientInstancer ReleaseTrackGAGetMessagesModuleModelServerInfor' model_servermodel_server_versionFetchBenchmarkingDataRequest instance_typebenchmarkingDataFetchprofilerErrorrerrorstatusPrint)selfargsclientmessagesmodel_server_inforequestresponsees rRunzList.Runos   # #D$5$5$8$8 9F%%d&7&7&:&:;H"22 ''!663 55+))6g((..w7h        ii)!-. jj045 is%A7C  C D93;D4.D94D9N)__name__ __module__ __qualname____doc__ staticmethodr%rDrrrr8s#'P'PRrrN)rH%googlecloudsdk.api_lib.ai.recommenderrgooglecloudsdk.calliopergooglecloudsdk.command_lib.runr'googlecloudsdk.command_lib.run.printersrgooglecloudsdk.corerrgooglecloudsdk.core.resourcer _EXAMPLErrDefaultUniverseOnly ReleaseTracksr-r.rrJrrrTsy>6(3H*#9   /D%%(()K8==K*Kr