Analyze step results | Runtype Documentation

curl -X POST https://api.runtype.com/v1/eval/analyze-steps \
     -H "Authorization: <apiKey>" \
     -H "Content-Type: application/json" \
     -d '{
  "evalGroupId": "evalgrp_01jv0000000000000000000001",
  "searchTerms": [
    "error",
    "success",
    "completed",
    "failed"
  ],
  "stepIds": [
    "step_01jv0000000000000000000001"
  ],
  "caseSensitive": false
}'

{
  "evalGroupId": "string",
  "results": [
    {
      "batchExecutionId": "string",
      "termAnalysis": [
        {
          "occurrenceRate": 1.1,
          "stepsContainingTerm": 1,
          "term": "string",
          "totalOccurrences": 1
        }
      ],
      "totalStepsAnalyzed": 1,
      "evalName": "string"
    }
  ],
  "searchTerms": [
    "string"
  ],
  "stepIds": [
    "string"
  ]
}

Analyze step results for keyword/phrase occurrences across evals.

Authentication

AuthorizationBearer

API key or Clerk session token

Request

This endpoint expects an object.

evalGroupIdstringRequired

searchTermslist of stringsRequired

stepIdslist of stringsRequired

caseSensitivebooleanOptional

Response

Analysis returned

evalGroupIdstring

resultslist of objects

searchTermslist of strings

stepIdslist of strings

Errors

400

Bad Request Error

401

Unauthorized Error

403

Forbidden Error

404

Not Found Error

500

Internal Server Error