Create a test

Add a test to the agent. An agent holds at most 50 tests.

A test is checked against a version only when a run starts. One that names a tool or disposition the version does not have is saved here and recorded as invalid in the run.

Authorization

bearerAuth

AuthorizationBearer <token>

A Tandem bearer token. Requests are scoped to the organization the token belongs to; no organization header is required.

In: header

Request Body

application/json

TypeScript Definitions

Use the request body type in TypeScript.

name*string

Length1 <= length <= 120

description?string

Lengthlength <= 1000

mode*string

scripted sends fixed caller messages in order. simulated has a model play the caller from a persona and a goal.

Value in

"scripted"
"simulated"

scripted?

simulated?

stubs?

Keyed by tool name. A tool is stubbed by default: with no entry it returns {}, and with an entry it returns response. live: true calls the real tool instead.

Default{}

checks?array<||||||>

Itemsitems <= 20

Default[]

criteria?array<>

Statements an LLM judge grades against the transcript.

Itemsitems <= 10

Default[]

repeat?integer

Attempts per run. Absent means the settings' defaultRepeat.

Range1 <= value <= 5

caller?

Who is calling. ani fills {{sys.telephony.ani}} and is the number the contact and memory belong to. contact is a contact found for that number with these attributes; it exists only in the test, and no real contact is ever read or written. contact requires ani.

workflowVariables?

What the calling workflow passed in, read as {{vars.name}}.

Propertiesproperties <= 20

memory?

A returning caller's memory record, read at the version's memory depth. Requires caller.ani. Without it, memory is off during the test.

source?string

Where the test came from. Any other value is stored as user.

Default"user"

Value in

"user"
"sparky"
"suggestion"

Response Body

`application/json`

curl -X POST "https://example.com/v1/agent-media/agents/string/tests" \  -H "Content-Type: application/json" \  -d '{    "name": "string",    "mode": "scripted"  }'

{  "test": {    "name": "string",    "description": "string",    "mode": "scripted",    "scripted": {      "turns": [        "string"      ]    },    "simulated": {      "persona": "string",      "goal": "string",      "maxTurns": 20    },    "stubs": {},    "checks": [],    "criteria": [],    "repeat": 1,    "caller": {      "ani": "string",      "contact": {        "attributes": {          "property1": "string",          "property2": "string"        }      }    },    "workflowVariables": {      "property1": "string",      "property2": "string"    },    "memory": {      "callCount": 1,      "synopsis": "string",      "rollingSummary": "string",      "openThreads": "string"    },    "testId": "string",    "agentId": "string",    "source": "user",    "createdBy": "string",    "createdAt": "2019-08-24T14:15:22Z",    "updatedAt": "2019-08-24T14:15:22Z"  }}

{  "error": "string",  "errors": [    {      "field": "string",      "message": "string"    }  ]}

{  "error": "string",  "message": "string",  "limit": 0,  "length": 0,  "reason": "string"}

{  "error": "string",  "message": "string",  "limit": 0,  "length": 0,  "reason": "string"}

{  "error": "string",  "message": "string",  "limit": 0,  "length": 0,  "reason": "string"}

Create a test

Authorization

Path Parameters

Request Body

Response Body

201application/json

400application/json

401application/json

404application/json

409application/json

`application/json`

`application/json`

`application/json`

`application/json`

`application/json`