Test Health Report

Functionize Test Health Report Overview

The Functionize Test Health report allows users to select multiple projects and a date range to quickly assess the status of their tests. This report provides a breakdown of the status of Architect-created test cases, offering insights into the performance and reliability of the testing efforts.

Filters

Project Filter

  • Multi-Select Projects:
    • Use the Projects dropdown in the top left corner of the reports screen to multi-select any number of existing projects.
    • This filter allows you to narrow down the Browser Health report to specific projects or view all projects for an overall perspective.
      Note: Selecting all projects can give the user a sense of how their organization is using Functionize at a glance.

Date Range Filter

  • Select Date Range:

    • Apply a date range filter to the Browser Health Report by selecting a date range.
    • This helps in viewing the test health for a specific period.
  • Confirm or Reset Filters:

    • Click Confirm to apply the filters.
    • Click Reset to remove the Project and/or Date Range filters and reset the report to default settings.

Test Health Report

Overview

  • Total Number of Active Tests:

    • Based on the applied filters, the report shows the total number of active tests.

  • Status Breakdown:

    • The report displays a color-coded number of Passed, Failed, Warning, and Incomplete test cases.
    • Users can hover over and click on any status to get a detailed view of the associated status by test case.

Detailed Status View

  • Failed Tests Example:

    • Clicking on any status, such as Failed, opens a pop-up window displaying a detailed report.
    • The report includes:
      • Project Name
      • Test Name
      • Created By: The creator of the test case.
      • Executed By: The user who executed the test case.
      • Orchestration Name: If executed by orchestration.
      • Execution Method: Indicates if executed by Client or Functionize Support.
      • Execution Date/Time

  • Status by Browser:

    • The status by browser is displayed in a color-coded format along with the Last Run status.
    • Each status icon is a link that opens a new tab, taking the user directly to that test case.
  • Download Report:

    • The detailed report can be downloaded as a .csv file using the download button at the bottom of the report.

Test Case Activity

  • Status Representation:
    • Shows a color-coded representation of the number of test cases by status (Incomplete, Passed, Failed, Warnings) based on the selected projects and date range.

Test Case Creation

  • Number of Created Test Cases:
    • Displays the number of Architect-created test cases for the selected date range and selected projects.

Average Execution Time (sec)

  • Execution Time Overview:
    • Shows the average execution time, in seconds, per day.
    • Based on the date range and selected projects, it includes the number of test cases in each pool.

Refer to the Browser Health Report for more detailed insights on browser-specific test health