Search

Executing Tests

The Functionize Test Cloud allows you to provision and de-provision virtual machines (VMs) on demand. This means you can run as many tests as your subscription allows, across multiple browsers, without worrying about setting up or maintaining infrastructure yourself.

Functionize offers several ways to execute a test:

  • Headless Run (default): Fast, background execution with no browser view.
  • Live Execution: Watch the test as it runs in a VM.
  • Live Debug: Interact with the test, set breakpoints, and inspect errors.
  • Run with Variables: Override variable values before execution.
  • Execute via CLI  or API: Use the Functionize CLI and API to launch executions.

You can run a single test by browser or multiple tests in bulk within the same project.

Executing Tests

Single Tests by Browser

  1. Navigate to the Test Listing page.
  2. Hover over the browser you want to execute against.
  3. Click Run Test.

Multiple Tests in Bulk

  1. On the Test Listing page, select the checkboxes for the tests you want to run.
  2. Open the Bulk Action dropdown.
  3. Click Run Tests.

Execution Modes

Headless Run (Default)

  • Runs the test in the background without any browser UI.
  • Fastest option; ideal for continuous testing during development.

To start a headless run:

  1. Go to the Test Details page.
  2. Click Execute Test → Headless Run.
  3. The VM will provision, process, and execute the test automatically.

Live Execution

  • Provides a real-time view of the browser inside the VM.
  • Useful for observing how Functionize interacts with your application.
  • Runs slightly slower than headless.

To perform a live execution:

  1. Go to the Test Details page.
  2. Click Execute Test → Live Execution → Watch Now.
  3. Wait for the VM to provision (may take a few minutes).
  4. Watch your test run step by step.

Live Debug

  • Lets you interact with the test while it runs.
  • Pause execution, set breakpoints, and edit the test in real time.
  • Includes access to developer tools for inspecting console or network errors.
  • Runs slightly slower than headless. Must be run with Chrome, Firefox, or Edge.

To perform a live debug run:

  1. Go to the Test Details page.
  2. Click Execute Test → Live Debug.
  3. Use breakpoints, pause, or step through execution as needed.

Run with Variables

  • Allows you to update or override variable values before the test begins.
  • Executes in the background after confirmation.

To run with variables:

  1. Go to the Test Details page.
  2. Click Execute Test → Run with Variables.
  3. In the pop-up window, update variable values.
  4. Click Run to execute.

Region Settings for Live Runs

By default, Functionize will automatically select the first available Google Data Center region (usually in the U.S.) to launch your VM. This ensures the fastest startup time.

If you need a specific location, adjusting the region setting will allow the application to select a region for you based on availability and capacity:

  1. Go to Test Actions → Test Settings → Advanced tab.
  2. Set Region to Select Region.
    • Note: Functionize will attempt to run the test in the selected datacenter. If the datacenter is unavailable, Functionize will select another datacenter in the same region.
  3. Save your settings.

Summary

  • Use Headless Runs for speed and scale.
  • Use Live Execution when you want to watch a test run.
  • Use Live Debug when you need to interact with and troubleshoot a test.
  • Use Run with Variables when you need to override input values at runtime.
  • Use the Functionize CLI when you want to integrate test execution into your CI/CD pipelines or automate orchestrations from your devops tools.
  • Run tests individually or in bulk, depending on your workflow.