Search

Using Smart Screenshots

Smart Screenshots enhance test maintenance by combining machine learning (ML) data with step-by-step screenshots from every execution.

When a test is created and every time it runs, Functionize collects:

  • ML data to intelligently identify elements.
  • Screenshots to visually capture every step.

By mapping ML data to screenshots, you can edit tests directly from execution results—without needing to re-record or rerun the entire test. This accelerates maintenance and makes diagnosing failures far more intuitive.

Note: Smart Screenshots require ML data from the execution.

  • Only executions from April 2021 onward support Smart Screenshots.
  • Some actions (e.g., PageInit actions) do not collect ML data.
  • If Smart Screenshots are unavailable, re-run the test to regenerate ML data.

Requirements

  • Tests must be Approved for Learning for Smart Screenshot features to work.
  • If ML data is missing, execute the test again after learning is approved.
  • Ensure you are running tests on desktop browsers (Smart Screenshots are not supported for mobile-only runs).

Smart Screenshot Features

Smart Screenshots provide three core capabilities:

  1. Quick Select – Update the element for an action directly from the screenshot.
  2. Quick Add – Insert new actions (Click, Verify, Hover, Wait) without rerunning the test.
  3. SmartFix – Accept system-recommended updates when a test fails.

Quick Select

Quick Select allows you to update the element associated with an action using the screenshot of the last execution.

How it Works

  • Open Slider View for the execution.
  • Navigate to the action to update.
  • Click Quick Select.
  • Hover over the screenshot:
    • Existing selection = highlighted in green.
    • Available elements = highlighted in blue, with element info shown on hover.
      • Enable "Use Filtered Data" in Quick Select when you want the available elements to reflect the current filters on the page.
      • Disable it if you need access to all possible elements, regardless of any active filters.
  • Select the new element, then choose:
    • Save – commit the change and continue reviewing.
    • Save & Run – commit and immediately rerun the test.

After execution, the footer displays the updated selection compared to the original modeled element and any prior successful runs.

Limitations

  • Requires ML data for the step.
  • Tests must be Approved for Learning.
  • If ML data is missing, rerun the test.

Use Case Example: If your site changes and Functionize self-healing doesn’t select the correct element, use Quick Select to instantly re-point the action.

Quick Add

Quick Add allows you to insert new actions directly from a screenshot—no Live Debug or Local Edit required.

Supported Actions

  • Click
  • Verify
  • Hover
  • Wait (standard or Smart Wait)

Adding an Action

  1. Open Slider View.
  2. Navigate to the step where you want to insert the action.
  3. Click Quick Add.
  4. In the Insert Action pop-up:
    • Select Click, Verify, or Hover → then click the element in the screenshot.
      • Enable "Use Filtered Data" in Quick Add when you want the available options to reflect the current filters on the page.
      • Disable it if you need access to all available options, regardless of any filters currently applied in the environment.
    • Select Wait → enter the duration (ms).
    • For Smart Wait, Functionize watches network traffic and continues as soon as the page is ready (the time entered is the max wait time).
  5. Click Insert to save. The Slider View refreshes with the new action.

Error Handling

  • If ML data is missing on the prior step, only Wait actions can be added.
  • A notification will appear when Quick Add is unavailable due to missing ML data.

Use Case Example: Add a Wait before an external process completes, or insert a Verify step where validation was originally overlooked.

SmartFix

SmartFix suggests corrections when a test fails, using Functionize’s ML insights to help you maintain tests without re-recording.

Types of Suggestions

  • Text Verification Suggestions – Update failed assertions (e.g., change “Equals” to “Contains,” or update the expected value).
  • Password Warnings – Identify when a likely incorrect password caused the failure (no fix applied automatically).

Using SmartFix

  1. Open Slider View and scroll to the failed action with a SmartFix tag.
  2. Hover over the tag to review suggestions.
  3. Click Review to open the SmartFix modal.
  4. Choose a suggested fix (e.g., update operator or expected value).
  5. Click Save to apply the change.
  6. Re-run the test to confirm the fix.

Use Case Example: If a text verification fails because “About Us” changed to “Contact Us,” SmartFix will suggest updating the expected value directly.

Summary

Smart Screenshots combine ML data with visual execution steps, giving you powerful ways to maintain tests quickly:

  • Quick Select – Reassign elements in seconds.
  • Quick Add – Insert new actions without reruns.
  • SmartFix – Accept intelligent suggestions when tests fail.

By leveraging Smart Screenshots, you can reduce maintenance time, diagnose issues faster, and keep your test suite aligned with application changes.