1. Functionize
  2. User Guide
  3. Test Executions & Orchestrations
  4. Orchestrations

Create an Orchestration

Follow

Create an Orchestration Overview

Functionize offers the ability to execute multiple test cases from various projects, allowing you to set the test execution run order and create better organization for test groups and types. These orchestrations can be used to execute tens, hundreds, or even thousands of test cases from anywhere in the world, across any type of browser or mobile device. With Functionize, a user can create single or group orchestrations.

For every execution of an orchestration, a user can:

  • Check the performance of the orchestration execution over time
  • Check the stability of the test cases executed as part of an orchestration over time

With a single orchestration, the user can have one bucket/group of tests to be executed in parallel or sequential mode, using filters such as projects, tags, and modules.

With a group orchestration, the user can set up multiple buckets, as described in the single orchestration scenario. However, with group orchestrations, there is more granularity in organizing the orchestration further, for example one group is executed in sequential mode and a different group is executed in parallel mode.

 

Create a Single Orchestration:

  1. Open the Orchestration tab at the top of the page and click on Create New Orchestration

  2. In the Create New Orchestration window, begin with the Details tab


    • Title: Give this orchestration a name/title

    • Projects: Select any number of projects in the account to run with this orchestration

    • Environment: Select the environment to run in the orchestration

    • Folders: Select a folder to filter test cases, see How to Create a Folder

    • Tags: Select a tag to further filter test cases, this is optional; available tags must first be created to use as a filter, see How to Create a Tag

    • Test Cases: Select any number of test cases that are available based on the project(s), folder(s) and tag(s) selected previously

    • Schedules: Select the schedule that this orchestration will be run on -On-Demand | Hourly | Every 4 Hours | Every 12 Hours | Daily

    • Select Browser: Select all browsers to run in the orchestration, the has to be enabled at the individual test case level before it will run as part of an orchestration

    • Orchestration Type: Background | TDM Run for the purpose of how the orchestration will be executed:

      • Background: the tests will NOT execute or update in the project(s), but instead, view the test results from the Orchestrations page where all test cases will have a virtual copy made that runs outside of the project(s) - this can be useful when wanting to access test cases within the projects while the orchestration executes, recommended when the user does not need to data drive the tests

      • TDM Run: the orchestration will prompt you to add the Data Sets tied to the test case before you can execute the Orchestration, see To Create an Orchestration with TDM

  3. Move to the Integrations tab to add integrations and select the integrations relevant to your orchestration, if necessary

  4. Move to the Advanced tab, to add advanced features to this orchestration
    Note: This tab is optional, by default, the orchestration will run as a Single Orchestration Type.

    • Run Order: Select how to execute the tests in the orchestration:

      • Parallel (Default): Select this to run the tests simultaneously

      • Sequential:  Select this to run the test sequentially

    • Orchestration Type: Select Single radio button to have just one group of test cases

    • Re-Run: Select to have the orchestration automatically re-run test cases that gone Incomplete or Failed

    • Email Alerts: Enter email addresses for where the alerts should be sent, separated by a comma

    • Email Note: Enter a message to be sent in the Email Alerts

    • Environment Management: If applicable, add original URL::replacement URL and this field supports comma delimited lists if there are multiple URLs to override in the test cases included in the orchestration

    • Proxy String: If necessary, enter IP:Port for proxy server

    • Alerts Delivery: Select from the dropdown based on how/when the alerts should be delivered

    • Webhook URL: If applicable, input the webhook url

    • Submit Linked Tests to TCM: If applicable, and the test cases in the orchestration are linked to a Test Case Management (TCM) system (for example: Xray, TestRail, etc.)

  5. Click Confirm
  6.  The Confirm Test Cases window will open for you to confirm which test cases to include. Click Submit
  7. Locate the orchestration to run in the orchestration list, use the Search field if necessary, and click the Execute icon
  8. In the Run Orchestration window, click Confirm 

 

Create a Group Type Orchestration:

  1. Open the Orchestration tab at the top of the page and click on Create New Orchestration
  2. In the Create New Orchestration window, begin with theDetails tab
  3. Move to the Integrations tab to add integrations and select the integrations relevant to your orchestration

  4. In the Advanced tab, select the Group Orchestration Type

    • Run Order: Select how to execute the tests in the orchestration:

      • Parallel (Default): Select this to run the tests simultaneously

      • Sequential:  Select this to run the test sequentially

    • Orchestration Type: Select Group radio button to have multiple groups of test cases

    • Re-Run: Select to have the orchestration automatically re-run test cases that gone Incomplete or Failed

    • Email Alerts: Enter email addresses for where the alerts should be sent, separated by a comma

    • Email Note: Enter a message to be sent in the Email Alerts

    • Environment Management: If applicable, add original URL::replacement URL and this field supports comma delimited lists if there are multiple URLs to override in the test cases included in the orchestration

    • Proxy String: If necessary, enter IP:Port for proxy server

    • Alerts Delivery: Select from the dropdown based on how/when the alerts should be delivered

    • Webhook URL: If applicable, input the webhook url

    • Submit Linked Tests to TCM: If applicable, and the test cases in the orchestration are linked to a Test Case Management (TCM) system (for example: Xray, TestRail, etc.)

  5. Click Confirm
  6. The Group Orchestration Test Cases window will open for you to create group(s) of test cases with the Add New Group button, select the Run Order for each group
  7. The user can make granular changes to the orchestration by segmenting into multiple buckets as well as organizing each group with an overall serial order and specific test run orders and then click Submit
  8. Locate the orchestration to run in the orchestration list, use the Search field if necessary, and click the Execute icon
  9. In the Run Orchestration window, click Confirm

 

To Create an Orchestration using Test Data Management

Please see User Guide: Test Data Management (TDM) - Orchestrations

 

Related articles