Search

Using Test Data in Orchestrations

Orchestrations allow you to run groups of test cases together. When combined with Test Data Management (TDM), orchestrations become a powerful way to execute the same tests across multiple datasets, enabling scalable, data-driven testing.

This guide explains how to create and manage TDM orchestrations in Functionize, from setup to execution and results.

Before adding test data to orchestrations, make sure you have created one or more test data sources.

Creating an Orchestration with Test Data

  1. Navigate to Orchestrations Tab
    • Go to the Orchestrations tab.
    • Click Create New Orchestration.
  2. Fill in Required Fields
    • Enter the required details to define the orchestration.
  3. Set Schedule
    • On Demand → no default dataset required.
    • Scheduled (Hourly, Every 4h, Every 12h, or Daily) → must select a Default Dataset to execute on schedule.
  4. Select Run Type
    • Choose TDM Run as the Orchestration Run Type.
  5. Configure Advanced Settings
    • Under the Advanced tab:
      • Parallel Execution (default/ideal) → test cases run at the same time.
      • Sequential Execution → test cases run one after another, in the order defined.
  6. Confirm Creation
    • Click Confirm, review test cases in the modal, then click Submit.
    • You’ll be prompted to create Data Sets for this orchestration.
      • Note: if you click past or do not receive the prompt, you can click the TDM button under the Actions column to add your test data.

Creating Data Sets

Data Sets define which rows from a Data Source will be used during orchestration runs.

  1. Open Create Data Sets
    • The Create Data Sets pop-up should appear automatically.
    • If not, click the TDM button next to your orchestration.
  2. Choose Dataset Creation Method
    • Automatic
      • The system automatically refreshes and creates datasets from the attached data source.
      • Note: This is only available when the orchestration has a single data source attached.
    • Manual
      • Select specific rows from the data source to form a dataset.
      • Click + Add Dataset, select rows, then Submit.
      • Rename datasets using the Dataset Name field if needed.
  3. Edit Default Datasets
    • Default datasets are marked with a star.
    • For scheduled orchestrations, only default datasets execute automatically.
    • Multiple datasets can be marked as default.
      • When using multiple data sources, rows from each must be selected to form a valid, consolidated dataset.
  4. Manage Datasets
    • Expand a dataset using the > icon to view underlying data.
    • Delete outdated datasets using Delete Datasets.
    • Add new datasets with + Add Dataset.
    • Use Select All to quickly select all rows across data sources.

Configuring Orchestrations with Individual TDM Executions

The 'Individual TDM executions' feature allows different tests within a single orchestration to use their own specific TDM (Test Data Management) data sources. This is useful for complex testing scenarios where tests have unique data requirements.


To configure an orchestration for individual TDM executions, follow these steps:

  • Navigate to Orchestration listing page: Go to the configuration page for your orchestration.
  • Prerequisites: Ensure you have a base orchestration created with a "Manual" mapping type. This orchestration must have at least two separate datasets attached that have already been executed.
  • Select Tests: Add the tests to your orchestration. Each test should be associated with its own individual TDM data source.
  • Enable Feature: In the configuration settings, enable the Individual TDM executions option.

Limitations

  • Skipped Executions: A test case within the orchestration will be skipped if it has no data source mapped or if multiple data sources are mapped to that single test.
  • Manual Dataset Creation: When using multiple data sources in an orchestration, you must use the Manual method for dataset creation. The Automatic method is only available for orchestrations with a single data source.
     

Running the Orchestration

  • Scheduled Execution → runs with default dataset(s) at the configured frequency.
  • On Demand Execution → select which dataset(s) to run and click Submit.

Viewing Results

  1. Open Results
    • After execution, click Results under the orchestration’s Actions column.
  2. Review Orchestration Results
    • Each executed test displays along with the dataset used.
    • Results are stored in the History Run drop-down.
    • On Demand Execution → triggered manually by the user.
    • Scheduled Execution → triggered automatically using default datasets.

Best Practices

  • Use Parallel execution whenever possible for faster runs.
    • When using Sequential execution, the Group orchestration type will provide faster results than the Single orchestration type.
  • Keep Default Datasets small and representative if orchestrations are scheduled frequently.
  • Use Automatic dataset creation for workflows that rely on a single, regularly refreshed data source.
  • Use Manual datasets for fine-grained control over which data rows should be tested.

By creating orchestrations with datasets, you can efficiently manage large-scale, data-driven test executions in Functionize—ensuring that your tests are flexible, repeatable, and reflective of real-world scenarios.