[Go to site: main page, start]

Skip to main content
Sync your Vapi assistants into Bluejay and run simulations against them. Every tool call the assistant makes during a call lands in the results automatically.

Ways to connect

How it connects

Bluejay calls your assistant through Vapi’s web-call bridge, so no phone number is needed. A webhook on the assistant sends call data and tool calls back to Bluejay when the call ends.

Prerequisites

  • Your Vapi public and private API keys
  • At least one Vapi assistant
  • A Bluejay account

Setup

1. Grab your Vapi keys

In Vapi, go to Settings, then API Keys. Copy both the public key and the private key. You need both: the public key secures the webhook, the private key lets Bluejay sync your assistants. Vapi API keys

2. Point your assistant’s webhook at Bluejay

  1. In Vapi, open your assistant and go to the Advanced tab, then the Webhook Server section. (On the classic UI, this lives under Messaging.)
  2. Paste this into Server URL:
  1. Under Authorization, add a credential with a header named secret and your public key as the value, then select it.
  2. Under Server Messages, keep only end-of-call-report enabled.
  3. Click Publish.
Vapi webhook configuration

3. Save your keys in Bluejay and sync

  1. In Bluejay, go to Settings, then Integrations, then the Vapi tab.
  2. Paste both keys and click Save API Key.
  3. Click Sync Agents from Vapi and confirm.
  4. Within a few seconds, every assistant in your Vapi workspace appears in Bluejay as an agent in the Synced from Vapi folder.
Save Vapi keys in Bluejay
You can also do this from the Create Agent modal: pick the VAPI tile and an inline panel saves your key and syncs in one step.

4. Create a simulation

  1. Go to the Simulations page and click Create in the top right, then pick your synced agent.
  2. Add or auto-generate a digital human persona.

5. Run it

  1. In the Simulations tab, click Run on the simulation you want to run.
  2. Click Run calls (the button shows the call count).
  3. When the call finishes, review the transcript, tool calls, and metric scores. Tool calls appear inline in the Transcript tab and consolidated in the Tool Adherence tab.
Re-sync any time from Settings. Assistants are matched by ID and never duplicated; name and prompt changes carry over.

Phone connection

If your assistant is attached to a Vapi phone number, you can also test it the way a real caller reaches it: Bluejay dials the number over the phone network.
  1. Create an agent in Bluejay with type Inbound, mode Voice, and the Phone connection type.
  2. Paste your assistant’s Vapi phone number in full international format (e.g. +15551234567).
  3. Create a simulation and run it. Bluejay dials the number and the digital human holds the conversation.
Use this when you specifically want to exercise the real telephony path: carrier audio, DTMF, the exact number your customers dial. The tradeoff: tool calls aren’t linked to the result over a plain phone call, so results cover the conversation itself (transcript, recording, metrics). For tool call capture, use the web-call setup above.

Testing outbound Vapi assistants

The web-call bridge is inbound-only (the Outbound toggle is greyed out on VAPI-connected agents). To test an assistant that places calls, flip the direction: Bluejay’s digital humans answer on real phone numbers, and your assistant dials them.
  1. Create a separate Bluejay agent with type Outbound and the Phone connection type.
  2. Give each digital human in your simulation a phone number. These are the numbers your assistant will dial.
  3. In Bluejay, add a webhook subscribed to the outbound_simulation_started event (see Webhooks). When you run the simulation, it delivers the list of numbers to dial.
  4. When the webhook fires, have your system place the calls through Vapi’s outbound call API, one call per digital human, with customer.number set to each phone_number from the payload.
  5. The digital humans answer, the conversations run, and results land like any other simulation.

Troubleshooting

Resources

Self-Improve

Let Bluejay automatically diagnose failures and improve this agent’s prompt.

Vapi Observability

Evaluate production Vapi calls with the same webhook.

Simulation Overview

How simulations work in Bluejay end-to-end.

Tool Calls

How Bluejay captures and scores tool calls.

Digital Humans

The personas that play the caller in every simulation.