Orchestrations in Functionize allow you to execute test cases across multiple projects, making them especially useful for end-to-end workflows and system testing. After running a Single or Group orchestration, Functionize provides a detailed Orchestration Result report.
This report shows:
- Which tests passed, failed, or raised warnings
- Test metrics for total count, total executions, last run orchestrations, skipped tests, and disabled tests
- Any incomplete executions
- Historical executions of the orchestration
- Trends in performance and stability across runs
- Execution details such as run times, durations, and environments
Orchestration Listing Page
From the Orchestrations tab, you’ll see a list of orchestrations, with the most recent runs at the top. Each orchestration includes quick-view results and options for deeper exploration.
Available Actions
- Results → Opens the orchestration results report.
- Total Execution Time – Total queue time, from first test picked up to last test completed.
- Agent Availability Time – Time when one or more agents were actively executing tests.
- Agent Queue Time – Time when no agents were free and test execution was delayed.
- Executed By – Latest user that executed the orchestration.
- Edit → Modify orchestration details such as name, environment, scheduling, and test selection.
- TDM → Modify the test data attached to the orchestration.
- Audit Log → View all changes, including who made them and when.
- Options → Dropdown menu with:
- Reorder (if sequential run order is set)
- Clone (duplicate the orchestration)
- API Calls (access orchestration remotely via API)
- Compare (compare the results of 2 orchestration executions)
- Delete (remove the orchestration)
Viewing Orchestration Results
- Log into the Functionize app.
- Go to the Orchestrations tab.
- Locate your orchestration → under Actions, click Results.
- The Orchestration Results Report opens in a new tab, showing:
- Execution runs (via dropdown)
- Results per browser
- Summary of all included tests
- Performance trends and action durations
Exporting Orchestration Results
You can export orchestration results to PDF or PNG for further analysis and sharing.
- Click Export > PDF or Image on the results page.
- The output includes:
- Test Case – Name of the test
- Project / Environment – Where the test ran
- Browser – Execution browser
- Dataset – Dataset used, with dataset date
- Status – Passed / Failed / Warning
- Actions – Total, passed, and failed actions
- Execution Time – Total duration
- Page Objects (POs) – Number of POs included
- Failing/Warning Step & PO – Exact failure point
- Failure/Warning Comments – Expected vs actual results
- Details – Links to logs/reports
This is especially useful for trend analysis, root-cause investigation, and reporting to stakeholders.
Viewing More Details
- Expand a failed test to view failure point details.
- Click Details for a test → opens a read-only Test Details page in a new tab.
- Information button → High-level test stats
- Action menu → Download PDF or view performance reports
- Slider view → Step-by-step screenshots with read-only details
- Train the AI → Submit actions for AI learning
Rerunning Tests
Functionize allows reruns of individual or multiple tests without executing the entire orchestration.
Single Test Rerun
- Hover over the browser icon → select Rerun.
- The latest result supersedes older ones for that browser/dataset.
Bulk Rerun
- Select test cases via checkbox.
- Use Bulk Actions → Rerun Test.
- Choose browser(s) and click Confirm.
Orchestration History
At the top of the results page, use filters to:
- Select a previous Orchestration run
- Choose a Date/Time
- Filter by Tags or Browser
This allows you to easily compare results across historical runs.
Performance Trends & Action Duration Reports
The results page includes performance analytics to provide visibility into both your orchestration and the application under test.
- Performance Trend Line → Page load time, DOM interactive, visual completion, etc.
- Page Performance (Bar Graphs) → Compare metrics across test cases.
- Performance Details → Filter by metric (DNS, Visual Completion, Page Load, etc.).
- Action Duration → Drill into execution time for each step in a specific test case.
Why This Matters
Orchestration Results turn raw execution data into actionable insights:
- Spot flaky tests by analyzing agent queue time and rerun results
- Identify bottlenecks with action duration metrics
- Share standardized reports via CSV/PDF exports
- Maintain test health with reruns and historical trend tracking
Together, these features ensure that orchestrations not only run at scale but also provide the transparency and control QA teams need for continuous quality.