Runtype APIEvals

Get eval results

Get detailed results for a specific eval batch including step results and tool calls.

Authentication

AuthorizationBearer
API key or Clerk session token

Path parameters

idstringRequired
Batch execution ID

Response

Eval results returned
batchExecutionIdstring
caseErrorslist of objects
Every graded case that errored, with the failure text its scores recorded. Empty when no case errored, when the run is not scored yet, or when it was scored before the field shipped.
failedRecordsinteger
flowIdstring or null
processedRecordsinteger
resultsByRecordmap from strings to lists of objects
startedAtstring
statusstring
totalRecordsinteger
agentTargetAliasstring or nullOptional
The release alias the run resolved through, when it resolved through one.
agentTargetResolutionenumOptional
How the run picked its version. Null on a run that predates release aliases.
agentVersionIdstring or nullOptional
The exact Agent version every case of this run executed. Null for a legacy run.
caseManifestHashstring or nullOptional

SHA-256 over the ordered, normalized case set this run executed.

completedAtstringOptional
evalConfiganyOptional
evalGroupIdstringOptional
evalNamestringOptional
evaluatorFingerprintstring or nullOptional

SHA-256 over the evaluator configuration this run scored with.

Errors

401
Unauthorized Error
404
Not Found Error
500
Internal Server Error