Prerequisites: a Tuner account. Sign up here if you haven’t already.
The agent you create here is the same agent Tuner monitors in production and the same one Call Simulation places test calls against. Simulation only adds a SIP URI or a trigger endpoint to this agent.
Before the wizard: two questions
The first time you sign in, Tuner asks What brings you to Tuner? (Test my agent, Monitor production calls, Both or Just exploring) and What best describes you?. Answer both and click Continue.- If you pick Just exploring, Tuner creates a demo agent with sample data and opens it. You can start the wizard later from the sidebar.
- Otherwise, Tuner opens the wizard below.
Step 1: Add your agent
Under Where does your agent run?, pick a provider: Retell, Vapi, ElevenLabs, LiveKit, Pipecat, Dograh or My own stack. That choice decides the rest of the step.- Retell, Vapi or ElevenLabs
- LiveKit, Pipecat, Dograh or My own stack
Tuner reads your agent’s configuration from the platform, so you connect your platform key first.Tuner sets up the webhook on the platform for you.
1
Connect your platform key
Under Connection, paste your Retell API key, Vapi API key or ElevenLabs API key and click Connect. For Vapi, use your private key. If the workspace already has a key for that platform, Tuner shows Using your workspace’s Retell key (or Vapi, or ElevenLabs) instead, with a Change button.Tuner stores the key in Workspace Settings > General Settings > Third-party Integrations, where you can change or remove it later.
2
Pick your agent
Choose your agent under Which agent?. Tuner fills in its name and, if the platform has one, its system prompt. If Tuner finds no agents on the account, enter the agent’s ID under Agent ID.
3
Check the details and add the agent
Check the Agent name and Call direction (Inbound or Outbound), then click Add agent.

Step 2: Choose how to configure it
Under How do you want to configure it?, pick one of three methods and click Continue.
A template gets you eval results on your first call. Pick the closest match; everything it adds stays editable in Agent Settings.
Available templates
Available templates
The library changes over time, so what you see may differ from this list.
Step 3: Connect your code
Retell, Vapi and ElevenLabs skip this step.
- If the workspace has no Tuner API key yet, Tuner creates one named
Agent setupand puts it in the snippet. This is the only time the key is shown, so store it. - If the workspace already has a key, the snippet shows
<YOUR_API_KEY>. Replace it with a key from API Keys. Existing keys can’t be shown again; create a new one if you don’t have it.
LiveKit
Python and Node plugins for LiveKit Agents.
Pipecat
Observer SDK for Pipecat pipelines.
Dograh
The Tuner node inside your Dograh workflow.
Custom stack
Python observers for your own STT, LLM, and TTS, or the API directly.
Step 4: Get your first evaluated call
The last step is Get your first evaluated call. What it shows depends on your provider.Import recent calls (Retell, Vapi and ElevenLabs)
Tuner first checks your Retell, Vapi or ElevenLabs account for recent calls. If it finds some, it shows Found N recent calls. Click Import & evaluate all N to import and evaluate up to 25 of them. When the import finishes, click View your calls. If Tuner finds no recent calls, it shows the two cards below.Take a real call
The Real call card waits for your first call. Call your agent on the number it’s live on, have a short conversation, and hang up. When the call arrives, the card shows Call received. Click View call to open it.Or run a simulated call
The Simulated call card places a test call for you. Some providers need a one-time route setup first, which is saved to Agent Settings > Simulation Setup:
Once the route is saved, click Run a simulation. Tuner opens Simulations with the run dialog, where you review the settings before anything runs. Credits are only used when you start the run. See Run a simulation.
Click Finish to leave the wizard and go to your agent.
What you should see
Open Call Logs and click into the call. The transcript shows turn by turn next to these tabs:- Overview: the call’s red flags, labels, sentiment and metadata
- Evals: the result of each eval your template or configuration added
- Voice Metrics: per-turn latency, and where in the pipeline the time went
- Data Extraction: the fields Tuner pulled from the conversation
Next steps
API keys and IDs
Create more keys and find your workspace ID and Agent Remote ID.
Call simulation
Test your agent before launch and after every change.