Skip to main content

​
Why Configure Real-Time Alerts?

Real-time alerts are the cornerstone of proactive monitoring. By setting up alerts, you can:
  • Be the First to Know: Get notified the moment an issue occurs, often before it impacts a significant number of users.
  • Reduce Mean Time to Resolution (MTTR): Alerts provide immediate context, allowing your team to diagnose and fix problems faster.
  • Automate Your Monitoring: Let Tuner watch for issues so you can focus on building a better agent.

​
How to Create an Alert

1

Navigate to the Alerts Tab

From the sidebar, click on Agent Settings, then select the Alerts tab. Here you’ll see a list of your existing alerts along with their status and last triggered time.
2

Click Create Alert

Click the + Create Alert button in the top-right corner to open the alert configuration modal.
3

Fill in Basic Details

  • Alert Name: Give your alert a descriptive name (e.g., “High Failure Rate Alert”).
  • Description (optional): Add a note for your team explaining what this alert monitors.
  • Severity: Choose from Info, Warning, or Critical based on the urgency level.
4

Define the Trigger Condition

Set the condition that will trigger the alert:
  • Select Field: Choose what to monitor (e.g., Hallucination, High Latency, Intent Missed, Identity not verified).
  • Operator: Select how to compare (equals, not equals).
  • Click + Add condition to add multiple conditions if needed.
5

Set the Threshold

Define when the alert should fire:
  • Trigger when: Set the number of matching calls (e.g., 10 calls).
  • Time window: Choose the time period (5 minutes, 15 minutes, 1 hour, or 24 hours).
For example: “Trigger when 10 calls in 1 hour match the conditions above.”
6

Configure Notification Channels

Choose where you want to receive alerts:
  • Email: Enter the email addresses that should receive notifications.
  • Slack: Coming soon!
7

Save the Alert

Click Save alert to activate your new alert. It will appear in the alerts list with an “Active” status.
Creating an alert in Tuner

​
Example Alerts

Here are some common alert configurations to get you started:
Alert Name: Hallucination Spike
Severity: Critical
Condition: Hallucination equals true
Threshold: 5 calls in 1 hourThis alert notifies you when your agent is providing inaccurate information frequently.
Alert Name: Identity Not Verified
Severity: Warning
Condition: Identity not verified equals true
Threshold: 10 calls in 1 hourUseful for agents that require identity verification before proceeding.
Alert Name: Slow Response Times
Severity: Warning
Condition: High Latency equals true
Threshold: 15 calls in 1 hourAlerts you when your agent is experiencing performance issues.

​
Best Practices

Start with High-Signal Alerts

Focus on alerts that indicate clear, critical problems. Quality over quantity.

Avoid Alert Fatigue

Too many alerts lead to important notifications being ignored. Be selective.

Set Meaningful Thresholds

Thresholds that are too low create noise; too high means you miss issues.

Review Regularly

Periodically review your alerts to ensure they’re still relevant and effective.

​
Next Steps

Now that you’ve learned how to configure alerts, check out the FAQs for answers to common questions.

General FAQs

Answers to frequently asked questions about Tuner.