Functionize offers the ability to execute multiple test cases from multiple projects, allowing the ability to set test execution run order and creating a better organization of test groups and types. These orchestrations can be executed on 10's, 100's, and 1000's of test cases, from anywhere in the world, across any type of browser or emulated mobile device. With Functionize, a user can create single or group orchestrations.
With a Single Orchestration, there can be one "bucket" of a group of tests to be executed in parallel or sequentially of any test cases using filters such as projects, tags, and modules.
With a Group Orchestration, there can be multiple buckets of the above single orchestration scenario. However, with group orchestrations there is more granularity capability in organizing the orchestration further.
*Note: Use the Bulk Action = Run Tests action to execute multiple test cases within the same project if that is preferable. See Execute a Test Case.
To Create an Orchestration:
After logging in to Functionize, navigate to the Orchestration tab at the top of the page and click on Create New Orchestration .
- Begin with the Details tab
Title = Give this orchestration a name/title.
Projects =Select any number of projects in the account to run this orchestration on.
Environment = Select the environment to run the orchestration in.
Folders = Select a folder to filter test cases. See How to Create a Folder for further information.
Tags = Select a Tag to further filter test cases *optional; available tags must first be created to use as a categorization
Test Cases = Select any number of test cases that are available based on the project(s) and tag(s) selected above.
Schedules = Select the schedule that this orchestration will be run on. On-Demand | Hourly | Daily
Select Browser = Select all browsers to run the orchestration in.
Orchestration Type = Foreground | Background for the purpose of moving visibility where:
- If Foreground is selected, the test cases within the projects selected will be executed. View the results of the orchestration on the orchestration page or within the actual project(s) that contain those test cases. The user will be alerted if any of the test cases fail.
- If Background is selected, the tests will NOT execute or update in the project(s). Instead, view the test results from the Orchestrations page. All test cases will have a virtual copy made that runs outside of the project(s). This can be useful when wanting to access test cases within the projects while the orchestration runs. We recommend using this option when selecting an Orchestration Run Type.
If TDM Run is selected, the orchestration will execute the selected Test Data along with the test case. See To Create an Orchestration with TDM.
2. Move to the Integrations tab to add integrations. Functionize offers a short sampling list of integrations.
3. Move to the Advanced tab, to add advanced features on this orchestration
-
- *Note - this tab is optional, not required. By default, the orchestration will run as a Single Orchestration Type, unless Group radio button is chosen here. For Groups Orchestration Type instructions, please see To Create a Group Type Orchestration further in this tutorial.
ADVANCED TAB (Single Orchestration)*
Run Order
Parallel (Default): Select this if to run the tests simultaneously.
Sequential: Select this to run the test sequentially.
Orchestration Type
Select Single radio button.
*If running a Group Orchestration Go to Create a Group Type Orchestration further below in this tutorial.
Re-Run
Select as appropriate.
Email Alerts
Enter email addresses for where the alerts should be sent, separated by a comma.
URL Override
Add string::replacement, if applicable
Alerts Delivery
Select from the dropdown based on how/when the alerts should be delivered.
Webhook URL
Input the webhook url, if applicable.
Allowed Test Run Overtime (Max)
Input (in minutes) a time limit to change the status of the test case from provisioning to processing.
4. Click Add New.
5. A pop-up window display with a list of all chosen test cases for the orchestration. Please confirm the list of test cases shown should be a part of this orchestration by clicking Submit.
6.To execute the Orchestration, locate it in the list of Orchestrations and click the Execute icon.
6. Click Run Orchestration to confirm.
To Create a Group Type Orchestration:
- In the Advanced tab, complete for Group Orchestration Type:
ADVANCED TAB (Group Orchestration)*
Run Order
Parallel (Default): Select this to run the tests simultaneously.
Sequential: Select this to run the test sequentially.
Orchestration Type
Select GROUP radio button
Re-Run
Select as appropriate.
URL Override
Add string::replacement, if applicable
Alerts Delivery
Select from the drop-down based on how/when the alerts should be delivered.
Post API URL
Enter the Post API URL, if applicable.
Email Alerts
Enter email addresses for where the alerts should be sent, separated by a comma.
2. Click Add New.
3. A pop-up window display with a list of all chosen test cases for the orchestration. Please confirm the list of test cases shown should be a part of this orchestration by clicking Submit.
4. The following window will display. Now further granularize the group orchestration by segmenting into multiple buckets, organizing each group with an overall serial order and test run order.
5. Click Save
6. To execute the Orchestration, locate it in the list of Orchestrations and click the execute icon.
6. Click Run Orchestration to confirm.
To Create an Orchestration using Test Data Management:
Go to Test Data Management (TDM) - Orchestrations