Search

Creating Orchestrations

Functionize allows you to organize and execute multiple test cases across projects with full control over run order, scheduling, and integrations. Orchestrations let you run tens, hundreds, or even thousands of tests globally — across any browser or mobile device — without manual overhead.

With orchestrations, you can:

  • Group and organize related tests for easier management
  • Set execution order (parallel or sequential)
  • Set browser(s) for all tests in the orchestration
  • Set an execution schedule for all tests in the orchestration
  • Track orchestration performance and stability over time
  • Connect with CI/CD and collaboration tools (e.g., Jenkins, Slack, Jira, GitLab)

Orchestrations can be created as Single or Group types.

Types of Orchestrations

  • Single Orchestration: Runs one bucket of tests, either in parallel or sequential order. Filters can be applied by project, folder, tags, environment, or modules.
  • Group Orchestration: Runs multiple buckets of tests with granular control. For example, one group may run sequentially, while another runs in parallel.

After creation, an orchestration can be switched between single and group from the Advanced tab of the orchestration settings.

Creating a Single Orchestration

  1. Navigate to the Orchestration tab and click Create New Orchestration.
  2. Complete the Details Tab:
    • Title – Enter a unique name for the orchestration.
    • Projects – Select projects containing the tests.
    • Environment – Choose the execution environment.
    • Folders / Tags / Exclude Tags – Filter tests as needed.
    • Test Cases – Select based on applied filters.
    • Schedule – Choose from On-Demand, Hourly, Every 4/12 Hours, Daily, or Monthly.
    • Browser – Pick browsers (must be enabled at the test level).
    • Orchestration Type – Choose Background or TDM Run.
  3. Configure Notifications Tab (optional):
    • Jenkins, Slack, FogBugz, Sentry.io, GitLab, Jira, Rocket.Chat, MSTeams
    • Add required URLs, tokens, or credentials.
  4. Configure Advanced Tab (optional):
    • Run Order – Parallel (default) or Sequential
    • Orchestration type – Single or Group
    • Run without proxy – If selected, the proxy settings configured in the project will not be applied.
    • Re-Run – Automatically re-run incomplete or failed cases. If the Run Order is set to Sequential, Halt After Failure can be selected.
    • Email Alerts – The email recipients for alerts.
    • Email Note – The email content to include.
    • Environment Management – Override URLs as needed
    • Proxy Setting – The tunnel setting for the project
    • Window Resolution – The resolution settings to use for all tests.
    • Alert Delivery – Whether to deliver alerts for all runs, on failure, or not at all.
    • Webhook URLs – Configure delivery methods
    • Submit Linked Tests to TCM – On Demand or Automatic
  5. Configure Cookies / Headers Tabs (optional):
    • Add custom cookies or headers.
  6. Configure Environment Config & Integrations Tabs (if applicable):
    • Map orchestration to external tools (Azure DevOps, etc.).
  7. Confirm & Submit the orchestration.
  8. From the Orchestration list, locate your orchestration and click Start → Confirm.

Creating a Group Orchestration

  1. Navigate to the Orchestration tab → Create New Orchestration.
  2. Complete the Details and Integrations tabs (same as Single).
  3. If needed, modify the settings on the Advanced Tab (same as Single):
  4. Add Groups of test cases:
    • Click Add New Group to create buckets of test cases.
      • Use Bulk Move to move multiple tests between groups.
    • Assign Run Order for each group.
    • For Sequential groups, you can enable Halt on Failure.
  5. Finalize Groups → Submit.
  6. From the Orchestration list, click Execute → Confirm.

Key Benefits of Orchestrations

  • Scalability: Run thousands of tests globally across browsers/devices.
  • Flexibility: Choose between parallel or sequential execution.
  • Scheduling: Set orchestrations to run automatically on the desired schedule.
  • Control: Organize by projects, tags, or modules.
  • Integration: Connect results to Jenkins, Jira, Slack, GitLab, and more.
  • Reliability: Automatically re-run failed cases and track performance trends.

Orchestrations are the backbone of scaling test execution in Functionize — giving you both breadth (massive test runs) and depth (granular organization & control) in one powerful feature.