Batch testing
Batch testing evaluates your rule against a sample of historical transactions to measure its impact at scale.Running a batch test
- Open the Test step in the Rule Builder.
- Select a time range — choose a preset period (last 7 days, last 30 days, etc.) or set a custom date range.
- Set the sample size — up to 1,000 transactions.
- Click Run Test.
Understanding batch results
After the test completes, you see:| Metric | Description |
|---|---|
| Matched transactions | How many transactions triggered the rule. |
| Alert ratio | Percentage of sampled transactions that would generate alerts. |
| Condition paths | Breakdown by which condition group (path) was triggered. |
Managing test tabs
You can run multiple tests with different configurations and compare results:- Each test runs in its own tab.
- Rename tabs to track what you changed between tests (e.g., “Threshold 50k” vs. “Threshold 100k”).
- Delete tabs you no longer need.
Single-transaction testing
Single-transaction mode evaluates your rule against one specific transaction, showing a detailed per-condition breakdown.Running a single-transaction test
- In the Test step, switch to Single transaction mode.
- Enter the transaction ID.
- Click Run.
Understanding single-transaction results
The results show each condition in your rule with its pass/fail status:| Column | Description |
|---|---|
| Condition | The property and operator being checked. |
| Expected | The value your condition requires. |
| Actual | The value found on the transaction. |
| Result | Whether this specific condition passed or failed. |
Formula drift warning
If you modify conditions after running a test, the Rule Builder shows a warning indicating that the test results may no longer reflect the current rule definition. Re-run the test to get accurate results for your updated conditions.Best practices
- Test before activating. Run a batch test over at least 7 days of data to gauge alert volume.
- Watch the alert ratio. A very high ratio (e.g., over 20%) may indicate the rule is too broad and will overwhelm your team with alerts. Consider tightening conditions or raising thresholds.
- Use single-transaction mode for debugging. If a rule unexpectedly matches or misses a transaction, single-transaction testing shows exactly which conditions passed or failed.
- Compare variations. Use multiple test tabs to compare different threshold values or condition combinations side by side.
What’s next?
Building rules
Return to the Rule Builder walkthrough to finalize and activate your rule.
Conditions reference
Adjust conditions using the full operator and aggregation reference.