Pull eval suite definition (config-as-code)

{
  "contentHash": "a3f5c9d8e7b2f1a4c6d8e9f0b1a2c3d4e5f67890",
  "definition": {
    "cases": [
      {
        "expect": [
          {
            "kind": "text-match"
          }
        ],
        "name": "GreetingResponseTest",
        "expected": {
          "facts": [
            "response contains greeting"
          ],
          "text": "Hello, how can I assist you today?"
        },
        "input": {
          "messages": [
            {
              "content": "Hi there!",
              "role": "user"
            }
          ],
          "toolMocks": [
            {
              "output": "Hello, how can I assist you today?",
              "toolName": "greeting-generator",
              "isError": false,
              "sourceToolExecutionId": "exec-1234abcd5678efgh",
              "truncated": false
            }
          ],
          "variables": {
            "language": "en"
          }
        }
      }
    ],
    "name": "CustomerSupportEvalSuite",
    "target": {
      "agent": "support-bot-v2",
      "flow": "initial-greeting"
    },
    "recordedToolMode": "next_step",
    "recordedToolUnmatchedPolicy": "fail",
    "virtual": false
  },
  "lastModifiedSource": "2024-06-10T12:45:00Z",
  "suiteId": "suite-9876fedc4321ba09",
  "updatedAt": "2024-06-12T08:30:00Z"
}

Return the canonical config-as-code definition and provenance for an eval suite by name — the absorb-drift direction of the ensure protocol. The contentHash is recomputed from the live suite state.

Authentication

AuthorizationBearer

API key or Clerk session token

Query parameters

namestringRequired>=1 character

Response

Canonical definition + provenance

contentHashstring

definitionobject

lastModifiedSourcestring or null

suiteIdstring

updatedAtstring or null

Errors

401

Unauthorized Error

403

Forbidden Error

404

Not Found Error

500

Internal Server Error

$	curl -G https://api.runtype.com/v1/eval/pull \
>	-H "Authorization: <apiKey>" \
>	-H "Content-Type: application/json" \
>	-d name=name