Runtype APIEvals

Review an AI-grader verdict

Record a lightweight human review of one AI-grader verdict (“the grader got this right / wrong”). Reviews accumulate into the suite’s judge-trust display (“agrees with you N of M times”) returned on GET /eval/suites/{id}. Only AI-grader score rows are reviewable; check graders are deterministic. Pass verdict null to clear an earlier review.

Authentication

AuthorizationBearer
API key or Clerk session token

Path parameters

scoreIdstringRequired>=1 character

Request

This endpoint expects an object.
verdictenumRequired

Did the grader get this one right? “agree” / “disagree”; null clears an earlier review.

Allowed values:

Response

Review recorded
humanVerdictenum
scoreIdstring

Errors

400
Bad Request Error
401
Unauthorized Error
403
Forbidden Error
404
Not Found Error
500
Internal Server Error