B dZddlmZddlmZddlmZddlZddlmZddl m Z ddl mZddl m Z d Zd Zd Zd ZGd dej$dgdZdZdZdZdZdZededededediZdZGddeZdZdZdZd Z d!Z!y)"z*A library to build a test results summary.)absolute_import)division)unicode_literalsN) exceptions)util)logz Native crashzFor test execution [{0}], a native process crashed on the device. This could be caused by your app, by an app dependency, or by an unrelated cause.zInfrastructure failurezNeed help for test execution [{0}]? Please join the #test-lab Slack channel at https://firebase.community/ and include test matrix ID [{1}] with your question.ceZdZdZy) TestOutcomeaA tuple to hold the outcome for a single test axis value. Fields: outcome: string containing the test outcome (e.g. 'Passed') axis_value: string representing one axis value within the matrix. test_details: string with extra details (e.g. "Incompatible architecture") N)__name__ __module__ __qualname____doc__;lib/googlecloudsdk/api_lib/firebase/test/results_summary.pyr r (srr outcome axis_value test_detailsPassedFlakyFailed InconclusiveSkipped (2chtt|j|j|jgS)zCTransform a TestOutcome to a tuple yielding the desired sort order.)tuple_OUTCOME_SORTINGrrr)xs r_TestOutcomeSortKeyr$Es&  +Q^^Q\\J KKrc^eZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d Zd ZdZy)ToolResultsSummaryFetcherzACreates Test Results summary using data from the ToolResults API.c ||_||_||_|j|_|j |_||_|jjjt|jjjt|jjjt|jjj t"|jjj$t&i|_y)a{Constructs a ToolResultsSummaryFetcher. Args: project: string containing the GCE project id. client: ToolResults API client lib generated by apitools. messages: ToolResults API message classes generated by apitools. tool_results_ids: a ToolResultsIds object holding history & execution IDs. test_matrix_id: test matrix ID from Testing API. N)_project_client _messages history_id _history_id execution_id _execution_id_test_matrix_idOutcomeSummaryValueValuesEnumsuccess_SUCCESSfailure_FAILUREflaky_FLAKYskipped_SKIPPED inconclusive _INCONCLUSIVE_outcome_names)selfprojectclientmessagestool_results_idstest_matrix_ids r__init__z"ToolResultsSummaryFetcher.__init__MsDMDLDN'22D)66D)D//77//77//55v//77//<ToolResultsSummaryFetcher.CreateMatrixOutcomeSummaryUsingStepszsH    E  kk Ro++o%%o6j\\ :AA*MN--d3 ':.,,..88I  #%$ & '$ ( 3 44rcXg}|j}|s%tjd|jS|D]}|j}|j |}|j js6tjdj||jcS|j|}|j|||j jj}|j|}|jt|||t|t S)a5Fetches test results and creates a test outcome summary. Lists all the environments in an execution and creates a high-level outcome summary for each environment (pass/flaky/fail/skipped/inconclusive). Each environment represents a combination of one or more test executions with the same device configuration (e.g. running the tests on a Nexus 5 in portrait mode using the en locale and API level 18). Returns: A list of TestOutcome objects. Raises: HttpException if the ToolResults service reports a back-end error. zSEnvironment has no results, something went wrong. Displaying step outcomes instead.zMEnvironment for [{0}] had no outcome value. Displaying step outcomes instead.rrU)_ListAllEnvironmentsrrXrirYrZenvironmentResultrr[_GetEnvironmentOutcomeDetailsr]r^r_r`r rar$) r=rb environments environmentrerrfrgrhs r+CreateMatrixOutcomeSummaryUsingEnvironmentszEToolResultsSummaryFetcher.CreateMatrixOutcomeSummaryUsingEnvironmentssH,,.L  kk  6 6 88# #22o%%o6j * * 2 2 --3VJ-? A88::22;?g ,#55==EEo66Gkoo !jw PQ$$ ( 3 44rct|vr(tjtj |t |vr4tjt j ||jyy)zALog warnings if there was native crash or infrustructure failure.N) _NATIVE_CRASHrrX_NATIVE_CRASH_DETAILED_FORMATr[_INFRASTRUCTURE_FAILURE'_INFRASTRUCTURE_FAILURE_DETAILED_FORMATr/)r=rfrs rr]z&ToolResultsSummaryFetcher._LogWarningssT kk/66zBC') kk 1 8 8$.. 01*rc i}|D]}|j||j<dj|jdd|jdd|jdd|jddS)Nz{m}-{v}-{l}-{o}Model?VersionLocale Orientation)mvlo)valuerVr[get)r=dimensionvalueaxes dimensions rrZz'ToolResultsSummaryFetcher._GetAxisValuess D# %OOd9==$  $ $ ((7C ((9c " ((8S ! ((=# & % ()rc|jd}g}|j|j|jrC|j|j}|j|j|jrC|S)zLists all steps for a test execution using the ToolResults service. Returns: The full list of steps for a test execution. N) _ListStepsextendrc nextPageToken)r=rPrcs rrWz'ToolResultsSummaryFetcher._ListAllStepssf t$H E LL  !7!78h ll8>>"   LrcZ|jj|j|j|jd|} |j j j|S#tj$r2}dtj|z}tj|d}~wwxYw)agLists one page of steps using the ToolResults service. Args: page_token: A page token to attach to the List request. If it's None, then it returns at most the first 200 steps. Returns: A ListStepsResponse containing a single page's steps. Raises: HttpException if the ToolResults service reports a back-end error. drErFrGpageSize pageTokenz0Http error while listing test results of steps: N)r*6ToolresultsProjectsHistoriesExecutionsStepsListRequestr(r,r.r)#projects_histories_executions_stepsListrKrLrrMrrNr= page_tokenrOrQrRs rrz$ToolResultsSummaryFetcher._ListStepss MMmm&&** N " * \\ = = B B7 KK  ( (* > B c  $ $S ))*$A%%B*8-B%%B*c|jd}g}|j|j|jrC|j|j}|j|j|jrC|S)zLists all environments of a test execution using the ToolResults service. Returns: A ListEnvironmentsResponse containing all environments within execution. N)_ListEnvironmentsrrnr)r=rPrns rrkz.ToolResultsSummaryFetcher._ListAllEnvironmentsss %%d+HL--.  ''(>(>?h(//0   rcZ|jj|j|j|jd|} |j j j|S#tj$r2}dtj|z}tj|d}~wwxYw)a~Lists one page of environments using the ToolResults service. Args: page_token: A page token to attach to the List request. If it's None, then it returns a maximum of 200 Environments. Returns: A ListEnvironmentsResponse containing a single page's environments. Raises: HttpException if the ToolResults service reports a back-end error. rrz'Http error while listing test results: N)r*=ToolresultsProjectsHistoriesExecutionsEnvironmentsListRequestr(r,r.r)*projects_histories_executions_environmentsrrKrLrrMrrNrs rrz+ToolResultsSummaryFetcher._ListEnvironmentss  F Fmm&&** G " * \\ D D I I   ( (* 5 e8L Lc  $ $S ))*rc@ |j|S#t$rYywxYw)zTransforms the outcome enum to a human readable outcome. Args: outcome: An Outcome.SummaryValueValuesEnum value. Returns: A string containing a human readable outcome. Unknown)r< ValueError)r=rs rr_z7ToolResultsSummaryFetcher._GetOutcomeSummaryDisplayName<s*   ))  s  ch|j}|jjj}|jj }|j |jk(rFt|}|jr-|jjrdj|tS|S|j |jk(r0|jr t||S|jsyt!|S|j |j"k(r t%|S|j |j&k(r t)|Sy)CTurn test outcome counts and details into something human readable. {d} ({c})dczUnknown failureUnknown outcome)rr*r0r1testExecutionSteptestSuiteOverviewsr^r2_GetSuccessCountDetails successDetailotherNativeCrashr[rrr4 failureDetail_GetFailureDetail_GetFailureOrFlakyCountDetailsr:_GetInconclusiveDetailr8_GetSkippedDetail)r=rdr summary_enumtest_suite_overviewsrfs rr\z0ToolResultsSummaryFetcher._GetStepOutcomeDetailsJsllG>>))@@L11DD,...'(<=g   7#8#8#I#I!!G}!== L00 0    *>??  # # +,@ AA L55 5 #G ,, L00 0 w ''rc|jj}|jjj}|jj }|j |jk(rFt|}|jr-|jjrdj|tS|S|j |jk(s|j |jk(r#|jr t!||St#|S|j |j$k(r t'|S|j |j(k(r t+|Sy)rrrr)rlrr*r0r1rr^r2rrrr[rrr4r6rrrr:rr8r)r=rorrrrfs rrmz7ToolResultsSummaryFetcher._GetEnvironmentOutcomeDetailsgs++33G>>))@@L&88KK,...'(<=g   7#8#8#I#I!!G}!== L00 0GOO|GYGY4Y    *>?? +,@ AA L55 5 #G ,, L00 0 w ''rN)r r r rrCrSrirpr]rZrWrrkrr_r\rmrrrr&r&JsHI2*((5T+5Z1) *6 *: :rr&c*d}|jjrd}n1|jjrd}n|jjrd}|jjrt nd}|r|rdj ||S|r|S|r|St|S)z-Build a string with failureDetail if present.zApplication crashedzTest timed outzApp failed to installrr)rcrashedtimedOut notInstalledrrrr[r)rrrfcrashs rrrs ' ""#G%%G))%G"00AA-r%    5  11 N L '(< ==rc|jrF|jjry|jjr y|jjryy)z-Build a string with skippedDetail if present.z"Incompatible device/OS combinationzGApp architecture or requested options are incompatible with this devicez#App does not support the OS versionUnknown reason) skippedDetailincompatibleDeviceincompatibleArchitectureincompatibleAppVersionrs rrrsM // 155 33 2 rc|jr3|jjrtS|jjryy)z2Build a string with inconclusiveDetail if present.zTest run aborted by userr)inconclusiveDetailinfrastructureFailurert abortedByUserrs rrrs5 !!77 $$!!// ' rcd}d}|D](}||jxsdz }||jxsdz }*||z }|r)dj|}|rdj||}|Sy)=Build a string with status count sums for testSuiteOverviews.rz{p} test cases passed)p{m}, {s} skippedr|sz--) totalCount skippedCountr[)rtotalr8overviewpassedrRs rrrs % '&h X %A%E x$$))G' 7?& ! ( (6 ( 2C  % %w % 7c J rcd}d}d}d}d}|D]a}||jxsdz }||jxsdz }||jxsdz }||jxsdz }||jxsdz }c|rdj |}||z |z |z |z }|r|rdj ||}|r|sdj |}|rdj ||}|rd j || }|rd j || }|Sy )rrz{f} test cases failed)fz{m}, {f} flaky)r|rz{f} test cases flakyz{m}, {p} passed)r|rz{m}, {e} errors)r|errzTest failed to run)r errorCount failureCountr flakyCountr[) rrrQfailedr8r6rrRrs rrrs@ % % & ' %&h X %A%E X %A%E h##(q(F x$$))G X %A%E ' ! ( (6 ( 2C U]V #g - 5F   # #cU # 3c V " ) )E ) 2c  $ $sf $ 5c  $ $se $ 4c  % %w % 7c J r)"r __future__rrr collectionsapitools.base.pyrrK$googlecloudsdk.api_lib.firebase.testrgooglecloudsdk.calliopegooglecloudsdk.corerrrrsrtru namedtupler r3r7r5r;r9r"r$objectr&rrrrrrrrrs1&'>5.# !J3+ ' K=DF      b B b2 b L vvr >*    r