Decompose grader criteria | Runtype Documentation

curl -X POST https://api.runtype.com/v1/eval/graders/decompose \
     -H "Authorization: <apiKey>" \
     -H "Content-Type: application/json" \
     -d '{
  "criteria": "The AI system must accurately identify and classify images containing multiple objects, ensuring at least 90% precision and recall, and provide a confidence score for each detected object."
}'

{
  "model": "image-classification-v2.3",
  "subChecks": [
    {
      "criteria": "The AI system accurately identifies images containing multiple objects."
    },
    {
      "criteria": "The AI system classifies each detected object with at least 90% precision."
    },
    {
      "criteria": "The AI system classifies each detected object with at least 90% recall."
    },
    {
      "criteria": "The AI system provides a confidence score for each detected object."
    }
  ]
}

Split one plain-language AI-grader criterion carrying several obligations into focused, independently judgeable sub-checks. Authoring assist only: review the proposal, then save each accepted sub-check as its own AI grader (kind “ai”) on the suite. Nothing is persisted by this endpoint.

Authentication

AuthorizationBearer

API key or Clerk session token

Request

This endpoint expects an object.

criteriastringRequired1-4000 characters

One plain-language AI-grader criterion to split into focused sub-checks.

Response

Proposed sub-checks

modelstring

Resolved model id that produced the proposal.

subCheckslist of objects

Proposed focused checks (1-8), ordered as the obligations appear in the original criterion. A single entry means the criterion is already focused. Each accepted sub-check becomes a plain {kind:“ai”} grader row.

Errors

400

Bad Request Error

401

Unauthorized Error

403

Forbidden Error

500

Internal Server Error

502

Bad Gateway Error