Rules live in Agent Settings > Evaluation Rules, in the Labels & Red Flags section. Most rules test an eval result or a voice metric, so set those up first.
What are red flags and labels?
A red flag is a tag Tuner attaches to a call when it matches a rule you define. Use red flags for failures that need attention, such as a failed hallucination eval or a severe latency spike. A label is created the same way and categorizes calls without marking them as failures, for examplelong_agent_monologue or sluggish_conversation. Both appear in Call Logs, and red flags also appear on the Overview dashboard.
A rule has one or more conditions. With several, it tags the call when all of them match or when any one matches. To combine AND and OR in one rule, create it through the API with nested groups.
Create a rule
1
Open Labels & Red Flags
In Agent Settings, open the Evaluation Rules tab and scroll to the Labels & Red Flags section.
2
Click Add
Click Add. The Add Rule dialog opens.

3
Set the first condition
Under Conditions, pick a field, then an operator and a value. The operators and values on offer depend on the field; see Condition sources.
4
Add more conditions (optional)
Click Add condition for each extra condition, up to 10. Then choose Match: ALL (AND) (default) to require every condition, or ANY (OR) to require at least one.
5
Set the tag
Choose a Tag Type: Label (categorize and filter calls with contextual tags) or Red Flag (highlight failures that require attention). Enter a Tag Name, the name that appears on matching calls. Optionally add a Description (Optional) saying when the tag is relevant.
6
Save
Click Save. The rule appears in the Labels & Red Flags table and applies to calls Tuner processes from then on.
Voicemail works. On those calls, conditions on Evals, Data Fields and Call Intent don’t match, including Not equal (!=).
Condition sources
The field list in each condition groups everything a rule can test into four sources:Call metadata fields
How rules compare Call Metadata values:
- For text values, Equals (=), Not equal (!=), Contains and Starts with ignore case. For example,
refundmatches an outcome namedRefund, and ContainshangupmatchesCustomer_Hangup. - Not equal (!=) on Call Outcome, Call Intent, Call Outcome Type or Call Ended Reason also matches a call with no value, for example a call on an agent with no outcomes set up. On Call Intent, a call whose outcome has Stop Analysis on doesn’t match.
- A call with no duration or cost never matches a Call Duration or Call Cost rule.
Example rules
Each example starts as one rule with one condition.Hallucination detected
Any hallucination is a trust issue, so flag it whatever the call’s outcome.
Missed disclosure
To flag several compliance evals under one tag, add a condition for each one and choose ANY (OR). For example, add conditions for Identity verification compliance and Prohibited content.
Conversation freeze
A P90 latency above 3,000 ms is likely to feel like a hang or freeze to the caller.
Sluggish conversation (label)
Not every slow call is a failure. A label lets you filter and analyze the pattern without flagging it.
Long call that fails identity verification
This rule has two conditions. With ALL (AND), it flags only calls longer than 5 minutes that also fail the eval.
Where red flags and labels appear
Overview dashboard
Red flags appear in the Recent Red Flags section of the Overview dashboard, a queue of calls that need attention.
Click View on a row to open the call.
Call Logs
Labels and red flags appear as color-coded tags on each call row in Call Logs, and you can filter calls by them.
Triage red flags
1
Check the queue regularly
Review Recent Red Flags on a regular schedule so flags work as an early warning.
2
Prioritize by flag type
Review hallucination and compliance flags first, since they point to a problem with the agent’s behavior. Latency flags can follow.
3
Open the call
Open a flagged call to see its full context before drawing conclusions from the flag name.
Investigate a red flag
Clicking View in Recent Red Flags, or a flagged call in Call Logs, opens the call details page. The recording and transcript sit on the left, so you can read what was said at the point of failure. The tabs on the right are:- Overview: the call’s red flags and labels, sentiment and metadata.
- Evals: every eval result for the call, including the eval that triggered the flag.
- Voice Metrics: latency and other voice metrics for the call.
- Data Extraction: the values extracted from the call.
- Traces: the call’s trace spans, shown only when the call has a trace. This tab takes the full page width.
Investigate patterns across calls
When the same flag recurs across many calls, use the Tuner MCP Diagnose workflow to look at those calls together and find the shared root cause.Get alerted on red flags
Red flags don’t notify anyone on their own. To get notified, create an alert in Agent Settings > Alerts. An alert can use a specific red flag or Red Flag Count as a condition, and can combine several conditions with Match:.
Manage rules
Each row in the Labels & Red Flags table has these actions:- Edit: click the edit icon, change the rule, then click Update.
- Pause or resume: use the switch in the STATUS column. A paused rule doesn’t run on new calls.
- Delete: click the delete icon and confirm. Alerts that use the rule’s red flag pause until you update their conditions, unless another active rule applies the same red flag.
Resume a paused rule
Deleting an eval, data extraction field or voice metric pauses every rule that uses it in any condition. The rule’s row shows the reason, for example Eval deleted. Edit to resume., and has no switch. A red flag rule paused by a deletion can also pause the alerts on its red flag. To resume the rule, click Edit rule to resume, change or remove each condition that uses the deleted item and click Save and resume. If a condition still uses a deleted item or a voice metric that isn’t enabled, the rule stays paused. Otherwise it’s active again.Limits
Limits enforced by the Add Rule dialog:
To manage rules through the API, including rules with nested groups of conditions, see the Agent Settings group in the API Reference, starting with Create Rule and List Rule Conditions.
Next steps
Real-time alerts
Get notified by email or webhook when red flags fire.
Root cause analysis
Walk through a single call in detail.