Search

Leveraging Insights Hub

Insights Hub provides metrics and data to help users better understand how their teams are using Functionize. This information can inform decisions about test program processes, onboarding and training, and test case enhancement opportunities.

Prerequisites

Insights Hub is available to all customers, however it is being enabled by request for existing customers to ensure that the reporting experience is not disrupted. If it has not been enabled for your team yet and you would like it to be, please get in touch with Customer Success.

Accessing Insights Hub

To access Insights Hub:

  1. Log in to your Functionize account at https://app.functionize.com.
  2. Click the Reports tab at the top of the window.

Leveraging Insights Hub Information

Insights Hub provides two main areas of data: Account Summary and Usage Metrics. All metrics are scoped to the permissions of the logged in user, meaning that while anyone on your team can view Insights Hub, they’ll only be able to see metrics relevant to them.

Account Summary

The Account Summary section of Insights Hub includes:

  • Teams: The Teams card displays the number of teams that you are a member of.
  • Projects: The Projects Card displays the count of projects within your team(s).
  • Total Users: The Total Users card displays the count of users in your team(s).
  • Pending Invites: The Pending Invites card displays the number platform invitations sent within your team(s) that have not yet been accepted.

Usage Metrics

The Usage Metrics section of Insights Hub provides a weekly rollup of testing data with three months of historical data. The default view displays metrics from the most recent full Monday-Sunday week. Metrics are calculated in weekly batches in order to provide a high-level overview of week-over-week trends.

To change the week of metrics shown, click the calendar icon that shows the timeframe, then select the week you’d like to view the metrics for. 

The Usage Metrics section defaults to displaying metrics for all teams that you are a member of. If you are a member of more than one team, the Usage Metrics section can be filtered to a single team by using the dropdown filter. The filter applies to all of the metrics described below.

The Usage Metrics section of Insights Hub includes:

  • Tests Executed: The Tests Run card provides a count of the tests run during the selected week. This includes all test runs that were started, regardless of how they ended. The card also shows a percent change from the previous week.
  • Pass Rate: The Pass Rate card shows the percentage of successful test runs completed during the selected week. The equation in use is (successful test runs / all test runs) * 100. The card also shows a percent change from the previous week.
  • New Tests: The New Tests card shows the count of new tests that were created during the selected week. This includes all test creation, regardless of technique. The card also shows a percent change from the previous week.
  • Agent Executions: The Agent Executions card provides a count of all agent executions performed in the selected week. This includes executions from all Functionize agents: Create, Execute, Maintain, Diagnose, and Document. The card also shows a percent change from the previous week.
  • Active Users: The Active Users card displays the number of users that have logged in to Functionize during the selected week. The card also shows a percent change from the previous week.
  • Activity Change: The Activity Change card provides the delta in activity between the selected week and the previous one. The equation in use is ((selected week events - previous week events) / previous week events) * 100. The equation includes counts of all events:
    • Logins
    • Test creations
    • Test executions
    • Test edits
  • Execution Breakdown: The Execution Breakdown card shows a pie chart detailing the comparative counts of test executions that passed, failed, and have warnings. The legend shows the count of each, as well as their percentage of the total.
  • Time Saved This Week: The Time Saved This Week card provides insight into how much time and money using Functionize has saved your organization in the selected week. These figures are based on an average manual testing time of 20 minutes per test and a cost of $25 per hour.
  • Test Execution Trends: The Test Execution Trends card displays a line graph comparison of test executions that passed, failed, and have warnings over the selected week. The points on the graph are based on daily calculations.
  • Most Active Users: The Most Active Users card provides a list of the top five users based on the total counts of their activities during the selected week. The count includes all events:
    • Logins
    • Test creations
    • Test executions
    • Test edits
  • Most Frequently Executed Tests: The Most Frequently Executed Tests card displays a list of the four tests with the highest execution counts. These counts include all executions, regardless of whether they passed, failed, or had warnings.
  • Team Activity: The Team Activity card shows the teams within your organization with the most activity. The counts include all events:
    • Logins
    • Test creations
    • Test executions
    • Test edits
  • Pass Rate Breakdown by Project: The Pass Rate Breakdown by Project table displays a list of projects and associated metrics for the selected week. The table can be sorted by any column. The following columns are included:
    • Project: This column displays the project name.
    • Tests: This column displays the total count of test executions.
    • Passed: This column displays the count of passed test executions.
    • Failed: This column displays the count of failed test executions.
    • Warning: This column displays the number of test executions that generated warnings.
    • Pass Rate: This column displays the pass rate of test executions. This column uses the same equation as the overall Pass Rate card, scoped per-project: (successful test runs / all test runs) * 100