Fixing Failed Test Cases Overview
When a test case fails, it's essential to diagnose and fix the issues promptly. Functionize offers various methods and tools to help you update and fix failed tests, ensuring your automated tests are robust and reliable. Here is an overview of the available methods:
SmartFix
Functionize's machine learning (ML) will suggest ways to fix the test with a one-click solution. This feature can help update the test when the wrong element is selected, an incorrect password is entered, or verifications need updating.
Update Action Setting Flags
Each action in a test has certain settings, flags, and information associated with it. These can be accessed via the Test Details page or Slider View. Action settings are useful for handling unexpected pop-ups, optional actions, or skipping actions when a website has changed in one environment.
- See User Guide: Action Settings
- See User Guide: Optional and Skipped Actions
- See User Guide: Action Types
Update the Executor
If a click didn't actually click or an input didn't input text as expected, you can change the Executor to improve the action's performance.
- See User Guide: Customizing Executors
- See Video: How to Update an Executor
Update the Selection Method
Functionize's default ML selection is highly accurate, but sometimes it may select the wrong element. The Selectors Override feature allows you to overrule the ML selection.
- See User Guide: Customizing Tests with Selectors
Force Fail a Passing Test
There are times when self-healing attempts do not perform as expected, resulting in false positives. You can manually mark the test as failed to ensure the ML model does not mistakenly learn incorrect behavior.
- See User Guide: Force Fail a Passing Test Case
- See Video: Force Fail a Passing Test Case
Live Debug
Live Debug is the most robust method for updating a test case. It allows you to interact with a test while it runs on Virtual Machines in the Functionize Cloud, enabling quick diagnosis and modification of tests in a clean execution environment.
- See User Guide: Live Debug
Local Edit
Local Edit recreates all the ML data used to execute the test. This feature allows you to use Architect on your local machine to make changes in test flows, element selections, and verifications.
- See User Guide: Local Edit
Submit a Support Ticket
If you are unable to resolve your test failure with the above options, please reach out to the Functionize Customer Support team.
- See User Guide: Formatting and Submitting Support Tickets
By utilizing these methods and tools, you can efficiently diagnose and fix failed test cases, ensuring the reliability and accuracy of your automated tests in Functionize.