1. Functionize
  2. User Guide
  3. Test Editing & Debugging

Test Diagnostics

Follow

Diagnostics Feature Overview

 

The Test Diagnostics feature allows you to analyze and troubleshoot test failures in Functionize. By running diagnostics, you can identify root causes of failures, view alternative analysis, and apply suggested solutions to improve test accuracy. Follow these steps to run and utilize the diagnostics feature.

Note: The Diagnostics is available only for test cases that have Failed.


Steps to Use Test Diagnostics

Accessing the Diagnostics Feature

  1. Navigate to the Test: Go to the Projects tab and open the test case that you want to diagnose.

  2. On the test page, locate the Diagnostics  button and click it to begin analyzing the test.

     

Running Diagnostics

  1. After clicking Diagnostics, a panel labeled "Identifying Solutions…" will appear. The diagnostics tool begins evaluating the failure context, analyzing each step in the test to determine potential issues and solutions.


  2. The tool processes a range of data, including screenshots, configuration data, and step analysis, to pinpoint where the test may have deviated from the expected outcome.


Reviewing Diagnostic Results

  1. View Diagnostic Results: Once the diagnostics process completes, the Diagnostic Results window will display a detailed breakdown of the findings. This includes the exact step where the failure occurred and the discrepancy between expected and actual outcomes.

  2. Root Cause Identification: The tool identifies root causes and highlights potential mismatches in data, such as text mismatches or unexpected UI changes.

     

Diagnostics and Maintenance Options in Functionize

The Diagnostic Options available in Functionize when a test encounters issues. The options include Train the AI, Run Maintenance, and Alternative Analysis. These tools are designed to help users diagnose test failures, maintain test stability, and improve Functionize's AI model performance.

  1. Train the AI

  2. Running Maintenance

  3. Alternative Analysis

Each of these tools serves a unique purpose in maintaining and optimizing tests.

Train the AI

The Train the AI feature allows users to provide feedback on test failures. By using this option, users can send details about the failure to the Functionize AI team, helping improve the AI’s learning accuracy.

    1. Click Train the AI after diagnostics 


    2. A dialog box titled Train the AI will appear, prompting you to provide details about the test failure.


    3. Describe the issue that caused the test to fail. This may include details like incorrect element selection, page load issues, or other environment-specific and provide additional context or steps that led to the failure. Include any relevant information that might help the AI team understand the issue in greater depth.

    4. Optionally, check the box to allow Functionize to run the test for support purposes.


    5. Click Submit  to send the report to the Functionize AI team.

 

Running Maintenance

The Running Maintenance option provides insights into the automated maintenance actions that Functionize can perform on the test. This feature identifies and suggests modifications to resolve issues caused by minor UI changes or adjustments in test conditions.

  1. Initiate Maintenance: After viewing the diagnostic results, you have the option to run maintenance on the test. Click Run Maintenance.

  2. Maintenance in Progress: A window will appear showing the maintenance process and after that, you will get the Maintenance Result window. 


  3. Select an Option: In the Maintenance Results window, you will see a list of suggested changes based on the diagnostic findings. Each option includes an explanation of the issue and how the suggested change addresses it.

  4. Apply Changes: Select the most appropriate solution, then click Apply Changes. This initiates a test run with the updated settings to verify if the applied changes resolve the issue.

Alternative Analysis

The Alternative Analysis option is used to explore different potential solutions when a test step fails. Functionize’s AI engine generates alternative approaches to the failed step, allowing the user to select the most appropriate solution to resolve the issue.

  1. Click Alternative Analysis when a test fails at a particular step and requires additional analysis for potential solutions.


  2. The system will run an analysis, which may suggest alternatives or adjustments to resolve the issue.


  3. Review the analysis output for recommendations and apply any necessary changes.

Summary

The Test Diagnostics feature is an essential tool for troubleshooting and optimizing automated tests in Functionize. By using this feature, you can quickly identify issues, apply intelligent solutions, and enhance test reliability.

 

Related articles