> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.runtype.com/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.runtype.com/_mcp/server.

# Add eval cases

POST https://api.runtype.com/v1/eval/suites/{id}/cases
Content-Type: application/json

Add one or more test cases to an eval suite. Cases are server-authoritative data: adding them does not affect the suite’s config-as-code provenance.

Reference: https://docs.runtype.com/api-reference/runtype-api/evals/add-eval-cases

## Authentication

- `Authorization` header (bearer token, required) — API key or Clerk session token

## Servers

- `https://api.runtype.com` (Production, default)
- `https://api.runtype-staging.com` (Staging)

## Request

### Path parameters

- `id` (string, required)

### Body (application/json)

This endpoint expects an object.

- `cases` (list of V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItems, required)

## Response

### 201

Cases created

- `cases` (list of EvalCase, required)

## Errors

### 400 Bad Request Error

Invalid request

- `error` (string, required)
- `code` (string, optional) — Stable error code. `insufficient_scope` marks an API key that lacks a scope this request needs.
- `details` (list of ErrorDetailsItems, optional)
- `requiredScopes` (list of string, optional) — On `insufficient_scope`: every API key scope this request needs.

### 401 Unauthorized Error

Unauthorized

- `error` (string, required)
- `code` (string, optional) — Stable error code. `insufficient_scope` marks an API key that lacks a scope this request needs.
- `details` (list of ErrorDetailsItems, optional)
- `requiredScopes` (list of string, optional) — On `insufficient_scope`: every API key scope this request needs.

### 403 Forbidden Error

Forbidden

- `error` (string, required)
- `code` (string, optional) — Stable error code. `insufficient_scope` marks an API key that lacks a scope this request needs.
- `details` (list of ErrorDetailsItems, optional)
- `requiredScopes` (list of string, optional) — On `insufficient_scope`: every API key scope this request needs.

### 404 Not Found Error

Not found

- `error` (string, required)
- `code` (string, optional) — Stable error code. `insufficient_scope` marks an API key that lacks a scope this request needs.
- `details` (list of ErrorDetailsItems, optional)
- `requiredScopes` (list of string, optional) — On `insufficient_scope`: every API key scope this request needs.

### 500 Internal Server Error

Internal server error

- `error` (string, required)
- `code` (string, optional) — Stable error code. `insufficient_scope` marks an API key that lacks a scope this request needs.
- `details` (list of ErrorDetailsItems, optional)
- `requiredScopes` (list of string, optional) — On `insufficient_scope`: every API key scope this request needs.

## Types

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItems

- `name` (string, required)
- `enabled` (boolean, optional)
- `expected` (V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsExpected, optional)
- `graders` (list of V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsGradersItems, optional) — Per-case graders. When set, they REPLACE the suite-level graders for this case (not appended). Omit to score the case with the suite graders.
- `input` (V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInput, optional, default: {})
- `notes` (string, optional)
- `origin` (enum, optional) — Case provenance. Defaults to "manual" when omitted. "ensure" is reserved for config-as-code converges.
  - Allowed values: `manual`, `saved_from_run`, `generated`, `imported`, `fpo`

### EvalCase

- `createdAt` (string, required)
- `enabled` (boolean, required)
- `graders` (list of any, required, nullable) — Per-case graders that REPLACE the suite graders for this case, or null when the case uses the suite graders.
- `id` (string, required)
- `name` (string, required)
- `notes` (string, required, nullable)
- `origin` (string, required)
- `suiteId` (string, required)
- `updatedAt` (string, required)
- `expected` (any, optional)
- `input` (any, optional) — \{ variables?, messages?, toolMocks?, endUser?, tenant?, record? } — what the case feeds the target, the identity it runs as, and the record it runs on.

### ErrorDetailsItems

- `message` (string, required)
- `code` (string, optional) — Stable Runtype validation code (e.g. MISSING_REQUIRED_FIELD, INVALID_ENUM).
- `path` (string, optional) — Dotted JSON path to the offending field.
- `suggestion` (string, optional) — Actionable hint (allowed values, accepted range, …).

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsExpected

- `facts` (list of string, optional)
- `json` (any, optional)
- `text` (string, optional)

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsGradersItems

- `kind` (string, required)

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInput

- `checkpoint` (V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputCheckpoint, optional)
- `endUser` (V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputEndUser, optional) — End user this case runs as (exposed to tools as \_endUser.\*, used to mint \{\{\_identity.token}}). Overrides the suite identityDefaults.endUser. Required (or a suite default) when the agent sets config.tenancyStrategy.
- `messages` (list of V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputMessagesItems, optional)
- `record` (V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputRecord, optional) — The record this case runs on, read by the flow as _record.name, _record.type and _record.metadata.*. Omitted fields keep the defaults: a record of type "eval" with empty metadata. Case variables still override same-named metadata fields at the top level.
- `tenant` (V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputTenant, optional) — Product tenant this case runs within (exposed as _tenant.*). Overrides the suite identityDefaults.tenant.
- `toolMocks` (list of V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputToolMocksItems, optional)
- `variables` (map from string to any, optional)

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputCheckpoint

- `forkMessageIndex` (integer, required)
- `sourceConversationId` (string, optional)
- `sourceExecutionId` (string, optional)

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputEndUser

End user this case runs as (exposed to tools as \_endUser.\*, used to mint \{\{\_identity.token}}). Overrides the suite identityDefaults.endUser. Required (or a suite default) when the agent sets config.tenancyStrategy.

- `id` (string, required)
- `email` (string, optional)

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputMessagesItems

- `content` (string, required)
- `role` (string, required)
- `toolCalls` (list of V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputMessagesItemsToolCallsItems, optional)
- `toolResults` (list of V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputMessagesItemsToolResultsItems, optional)

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputRecord

The record this case runs on, read by the flow as _record.name, _record.type and _record.metadata.*. Omitted fields keep the defaults: a record of type "eval" with empty metadata. Case variables still override same-named metadata fields at the top level.

- `metadata` (map from string to any, optional)
- `name` (string, optional)
- `type` (string, optional)

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputTenant

Product tenant this case runs within (exposed as _tenant.*). Overrides the suite identityDefaults.tenant.

- `id` (string, required)

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputToolMocksItems

- `output` (V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputToolMocksItemsOutput, required, nullable)
- `toolName` (string, required)
- `input` (any, optional)
- `isError` (boolean, optional)
- `sourceToolExecutionId` (string, optional)
- `truncated` (boolean, optional)

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputMessagesItemsToolCallsItems

- `toolCallId` (string, required)
- `toolName` (string, required)
- `args` (any, optional)

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputMessagesItemsToolResultsItems

- `toolCallId` (string, required)
- `toolName` (string, required)
- `result` (any, optional)

### V1EvalSuitesIdCasesPostRequestBodyContentApplicationJsonSchemaCasesItemsInputToolMocksItemsOutput

- boolean
- double
- string
- list of any
- map from string to any

## Examples

**Request**

```json
{
  "cases": [
    {
      "name": "string"
    }
  ]
}
```

**Response**

```json
{
  "cases": [
    {
      "createdAt": "string",
      "enabled": true,
      "graders": [
        null
      ],
      "id": "string",
      "name": "string",
      "notes": "string",
      "origin": "string",
      "suiteId": "string",
      "updatedAt": "string",
      "input": null
    }
  ]
}
```

**SDK Code**

```python
import requests

url = "https://api.runtype.com/v1/eval/suites/id/cases"

payload = { "cases": [{ "name": "string" }] }
headers = {
    "Authorization": "Bearer <token>",
    "Content-Type": "application/json"
}

response = requests.post(url, json=payload, headers=headers)

print(response.json())
```

```javascript
const url = 'https://api.runtype.com/v1/eval/suites/id/cases';
const options = {
  method: 'POST',
  headers: {Authorization: 'Bearer <token>', 'Content-Type': 'application/json'},
  body: '{"cases":[{"name":"string"}]}'
};

try {
  const response = await fetch(url, options);
  const data = await response.json();
  console.log(data);
} catch (error) {
  console.error(error);
}
```

```go
package main

import (
	"fmt"
	"strings"
	"net/http"
	"io"
)

func main() {

	url := "https://api.runtype.com/v1/eval/suites/id/cases"

	payload := strings.NewReader("{\n  \"cases\": [\n    {\n      \"name\": \"string\"\n    }\n  ]\n}")

	req, _ := http.NewRequest("POST", url, payload)

	req.Header.Add("Authorization", "Bearer <token>")
	req.Header.Add("Content-Type", "application/json")

	res, _ := http.DefaultClient.Do(req)

	defer res.Body.Close()
	body, _ := io.ReadAll(res.Body)

	fmt.Println(res)
	fmt.Println(string(body))

}
```

```ruby
require 'uri'
require 'net/http'

url = URI("https://api.runtype.com/v1/eval/suites/id/cases")

http = Net::HTTP.new(url.host, url.port)
http.use_ssl = true

request = Net::HTTP::Post.new(url)
request["Authorization"] = 'Bearer <token>'
request["Content-Type"] = 'application/json'
request.body = "{\n  \"cases\": [\n    {\n      \"name\": \"string\"\n    }\n  ]\n}"

response = http.request(request)
puts response.read_body
```

```java
import com.mashape.unirest.http.HttpResponse;
import com.mashape.unirest.http.Unirest;

HttpResponse<String> response = Unirest.post("https://api.runtype.com/v1/eval/suites/id/cases")
  .header("Authorization", "Bearer <token>")
  .header("Content-Type", "application/json")
  .body("{\n  \"cases\": [\n    {\n      \"name\": \"string\"\n    }\n  ]\n}")
  .asString();
```

```php
<?php
require_once('vendor/autoload.php');

$client = new \GuzzleHttp\Client();

$response = $client->request('POST', 'https://api.runtype.com/v1/eval/suites/id/cases', [
  'body' => '{
  "cases": [
    {
      "name": "string"
    }
  ]
}',
  'headers' => [
    'Authorization' => 'Bearer <token>',
    'Content-Type' => 'application/json',
  ],
]);

echo $response->getBody();
```

```csharp
using RestSharp;

var client = new RestClient("https://api.runtype.com/v1/eval/suites/id/cases");
var request = new RestRequest(Method.POST);
request.AddHeader("Authorization", "Bearer <token>");
request.AddHeader("Content-Type", "application/json");
request.AddParameter("application/json", "{\n  \"cases\": [\n    {\n      \"name\": \"string\"\n    }\n  ]\n}", ParameterType.RequestBody);
IRestResponse response = client.Execute(request);
```

```swift
import Foundation

let headers = [
  "Authorization": "Bearer <token>",
  "Content-Type": "application/json"
]
let parameters = ["cases": [["name": "string"]]] as [String : Any]

let postData = JSONSerialization.data(withJSONObject: parameters, options: [])

let request = NSMutableURLRequest(url: NSURL(string: "https://api.runtype.com/v1/eval/suites/id/cases")! as URL,
                                        cachePolicy: .useProtocolCachePolicy,
                                    timeoutInterval: 10.0)
request.httpMethod = "POST"
request.allHTTPHeaderFields = headers
request.httpBody = postData as Data

let session = URLSession.shared
let dataTask = session.dataTask(with: request as URLRequest, completionHandler: { (data, response, error) -> Void in
  if (error != nil) {
    print(error as Any)
  } else {
    let httpResponse = response as? HTTPURLResponse
    print(httpResponse)
  }
})

dataTask.resume()
```