Run Tests (Batch)

POST

https://api.speechify.ai/v1/agents/tests/runs/batch

POST

/v1/agents/tests/runs/batch

$ curl -X POST https://api.speechify.ai/v1/agents/tests/runs/batch \
>      -H "Authorization: Bearer <token>" \
>      -H "Content-Type: application/json" \
>      -d '{
>   "entries": [
>     {
>       "test_id": "test_01ky612y9cb7dbaj638x46msxv"
>     }
>   ]
> }'

1 {
2   "runs": [
3     {
4       "id": "run_01kpvdq02cbtxqqsca60m5scng",
5       "test_id": "string",
6       "agent_id": "string",
7       "status": "queued",
8       "created_at": "2024-01-15T09:30:00Z",
9       "started_at": "2024-01-15T09:30:00Z",
10       "completed_at": "2024-01-15T09:30:00Z",
11       "result": {
12         "test_type": "reply",
13         "passed": true,
14         "rationale": "The agent greeted Alice by name as required.",
15         "duration_ms": 1240,
16         "reply": {
17           "agent_response": "Hi Alice! How can I help you today?",
18           "passed": true,
19           "rationale": "Response contains the caller's name.",
20           "score": 0.95,
21           "duration_ms": 1240
22         },
23         "tool_call": null,
24         "simulation": null
25       },
26       "error": "string"
27     }
28   ],
29   "suite_run": {
30     "id": "srun_01kpvdq02cbtxqqsca60m5scng",
31     "trigger": "run_all",
32     "status": "queued",
33     "total_runs": 1,
34     "passed_count": 1,
35     "failed_count": 1,
36     "errored_count": 1,
37     "pending_count": 1,
38     "created_at": "2024-01-15T09:30:00Z",
39     "agent_id": "string",
40     "agent_name": "string",
41     "parent_suite_run_id": "string",
42     "completed_at": "2024-01-15T09:30:00Z",
43     "config_override": {
44       "prompt": "string",
45       "model": "string",
46       "tool_ids": [
47         "string"
48       ]
49     },
50     "flow_version_id": "string",
51     "flow_version_number": 1
52   }
53 }

Queue runs for every (test, agent) pair in the body. Entries without an agent_id fan out to every agent the test is attached to. Total expanded runs are capped at 100 per call. Each entry in the response is a queued run; poll GET /v1/agents/tests/runs/{id} for each.

Authentication

AuthorizationBearer

Enter your API key with the Bearer prefix, e.g. ‘Bearer sk_…’.

Request

This endpoint expects an object.

entrieslist of objectsRequired

Response

Runs queued.

runslist of objects

suite_runobject or null

The suite run grouping the queued runs.

Errors

400

Bad Request Error

401

Unauthorized Error