> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.runtype.com/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.runtype.com/_mcp/server.

# Analyze step results

POST https://api.runtype.com/v1/eval/analyze-steps
Content-Type: application/json

Analyze step results for keyword/phrase occurrences across evals.

Reference: https://docs.runtype.com/api-reference/runtype-api/evals/analyze-step-results

## Authentication

- `Authorization` header (bearer token, required) — API key or Clerk session token

## Servers

- `https://api.runtype.com` (Production, default)
- `https://api.runtype-staging.com` (Staging)

## Request

### Body (application/json)

This endpoint expects an object.

- `evalGroupId` (string, required)
- `searchTerms` (list of string, required)
- `stepIds` (list of string, required)
- `caseSensitive` (boolean, optional)

## Response

### 200

Analysis returned

- `evalGroupId` (string, required)
- `results` (list of V1EvalAnalyzeStepsPostResponsesContentApplicationJsonSchemaResultsItems, required)
- `searchTerms` (list of string, required)
- `stepIds` (list of string, required)

## Errors

### 400 Bad Request Error

Invalid request

- `error` (string, required)
- `code` (string, optional) — Stable error code. `insufficient_scope` marks an API key that lacks a scope this request needs.
- `details` (list of ErrorDetailsItems, optional)
- `requiredScopes` (list of string, optional) — On `insufficient_scope`: every API key scope this request needs.

### 401 Unauthorized Error

Unauthorized

- `error` (string, required)
- `code` (string, optional) — Stable error code. `insufficient_scope` marks an API key that lacks a scope this request needs.
- `details` (list of ErrorDetailsItems, optional)
- `requiredScopes` (list of string, optional) — On `insufficient_scope`: every API key scope this request needs.

### 403 Forbidden Error

Forbidden

- `error` (string, required)
- `code` (string, optional) — Stable error code. `insufficient_scope` marks an API key that lacks a scope this request needs.
- `details` (list of ErrorDetailsItems, optional)
- `requiredScopes` (list of string, optional) — On `insufficient_scope`: every API key scope this request needs.

### 404 Not Found Error

Not found

- `error` (string, required)
- `code` (string, optional) — Stable error code. `insufficient_scope` marks an API key that lacks a scope this request needs.
- `details` (list of ErrorDetailsItems, optional)
- `requiredScopes` (list of string, optional) — On `insufficient_scope`: every API key scope this request needs.

### 500 Internal Server Error

Internal server error

- `code` (string, required) — Stable error code: `INTERNAL_ERROR` unless the route documents its own.
- `error` (string, required)
- `details` (list of InternalErrorDetailsItems, optional)
- `requiredScopes` (list of string, optional) — On `insufficient_scope`: every API key scope this request needs.
- `message` (string, optional) — Plain-language guidance: retry, then contact support with the `requestId`.
- `requestId` (string, optional) — The `X-Runtype-Request-ID` of the failed request, for support.

### 503 Service Unavailable Error

Database temporarily unavailable; nothing was read or written. Retry after the `Retry-After` interval (seconds).

- `code` (enum, required) — Stable error code. `insufficient_scope` marks an API key that lacks a scope this request needs.
  - Allowed values: `DATABASE_UNAVAILABLE`
- `error` (string, required)
- `details` (list of DatabaseUnavailableErrorDetailsItems, optional)
- `requiredScopes` (list of string, optional) — On `insufficient_scope`: every API key scope this request needs.
- `requestId` (string, optional) — The `X-Runtype-Request-ID` of the failed request, for support.

## Types

### V1EvalAnalyzeStepsPostResponsesContentApplicationJsonSchemaResultsItems

- `batchExecutionId` (string, required)
- `termAnalysis` (list of V1EvalAnalyzeStepsPostResponsesContentApplicationJsonSchemaResultsItemsTermAnalysisItems, required)
- `totalStepsAnalyzed` (integer, required)
- `evalConfig` (any, optional)
- `evalName` (string, optional)

### ErrorDetailsItems

- `message` (string, required)
- `code` (string, optional) — Stable Runtype validation code (e.g. MISSING_REQUIRED_FIELD, INVALID_ENUM).
- `path` (string, optional) — Dotted JSON path to the offending field.
- `suggestion` (string, optional) — Actionable hint (allowed values, accepted range, …).

### InternalErrorDetailsItems

- `message` (string, required)
- `code` (string, optional) — Stable Runtype validation code (e.g. MISSING_REQUIRED_FIELD, INVALID_ENUM).
- `path` (string, optional) — Dotted JSON path to the offending field.
- `suggestion` (string, optional) — Actionable hint (allowed values, accepted range, …).

### DatabaseUnavailableErrorDetailsItems

- `message` (string, required)
- `code` (string, optional) — Stable Runtype validation code (e.g. MISSING_REQUIRED_FIELD, INVALID_ENUM).
- `path` (string, optional) — Dotted JSON path to the offending field.
- `suggestion` (string, optional) — Actionable hint (allowed values, accepted range, …).

### V1EvalAnalyzeStepsPostResponsesContentApplicationJsonSchemaResultsItemsTermAnalysisItems

- `occurrenceRate` (double, required)
- `stepsContainingTerm` (integer, required)
- `term` (string, required)
- `totalOccurrences` (integer, required)

## Examples

**Request**

```json
{
  "evalGroupId": "evalgrp_01jv0000000000000000000001",
  "searchTerms": [
    "error",
    "success",
    "completed",
    "failed"
  ],
  "stepIds": [
    "step_01jv0000000000000000000001"
  ],
  "caseSensitive": false
}
```

**Response**

```json
{
  "evalGroupId": "string",
  "results": [
    {
      "batchExecutionId": "string",
      "termAnalysis": [
        {
          "occurrenceRate": 1.1,
          "stepsContainingTerm": 1,
          "term": "string",
          "totalOccurrences": 1
        }
      ],
      "totalStepsAnalyzed": 1,
      "evalName": "string"
    }
  ],
  "searchTerms": [
    "string"
  ],
  "stepIds": [
    "string"
  ]
}
```

**SDK Code**

```python Analyze Step Results for Keywords
import requests

url = "https://api.runtype.com/v1/eval/analyze-steps"

payload = {
    "evalGroupId": "evalgrp_01jv0000000000000000000001",
    "searchTerms": ["error", "success", "completed", "failed"],
    "stepIds": ["step_01jv0000000000000000000001"],
    "caseSensitive": False
}
headers = {
    "Authorization": "Bearer <token>",
    "Content-Type": "application/json"
}

response = requests.post(url, json=payload, headers=headers)

print(response.json())
```

```javascript Analyze Step Results for Keywords
const url = 'https://api.runtype.com/v1/eval/analyze-steps';
const options = {
  method: 'POST',
  headers: {Authorization: 'Bearer <token>', 'Content-Type': 'application/json'},
  body: '{"evalGroupId":"evalgrp_01jv0000000000000000000001","searchTerms":["error","success","completed","failed"],"stepIds":["step_01jv0000000000000000000001"],"caseSensitive":false}'
};

try {
  const response = await fetch(url, options);
  const data = await response.json();
  console.log(data);
} catch (error) {
  console.error(error);
}
```

```go Analyze Step Results for Keywords
package main

import (
	"fmt"
	"strings"
	"net/http"
	"io"
)

func main() {

	url := "https://api.runtype.com/v1/eval/analyze-steps"

	payload := strings.NewReader("{\n  \"evalGroupId\": \"evalgrp_01jv0000000000000000000001\",\n  \"searchTerms\": [\n    \"error\",\n    \"success\",\n    \"completed\",\n    \"failed\"\n  ],\n  \"stepIds\": [\n    \"step_01jv0000000000000000000001\"\n  ],\n  \"caseSensitive\": false\n}")

	req, _ := http.NewRequest("POST", url, payload)

	req.Header.Add("Authorization", "Bearer <token>")
	req.Header.Add("Content-Type", "application/json")

	res, _ := http.DefaultClient.Do(req)

	defer res.Body.Close()
	body, _ := io.ReadAll(res.Body)

	fmt.Println(res)
	fmt.Println(string(body))

}
```

```ruby Analyze Step Results for Keywords
require 'uri'
require 'net/http'

url = URI("https://api.runtype.com/v1/eval/analyze-steps")

http = Net::HTTP.new(url.host, url.port)
http.use_ssl = true

request = Net::HTTP::Post.new(url)
request["Authorization"] = 'Bearer <token>'
request["Content-Type"] = 'application/json'
request.body = "{\n  \"evalGroupId\": \"evalgrp_01jv0000000000000000000001\",\n  \"searchTerms\": [\n    \"error\",\n    \"success\",\n    \"completed\",\n    \"failed\"\n  ],\n  \"stepIds\": [\n    \"step_01jv0000000000000000000001\"\n  ],\n  \"caseSensitive\": false\n}"

response = http.request(request)
puts response.read_body
```

```java Analyze Step Results for Keywords
import com.mashape.unirest.http.HttpResponse;
import com.mashape.unirest.http.Unirest;

HttpResponse<String> response = Unirest.post("https://api.runtype.com/v1/eval/analyze-steps")
  .header("Authorization", "Bearer <token>")
  .header("Content-Type", "application/json")
  .body("{\n  \"evalGroupId\": \"evalgrp_01jv0000000000000000000001\",\n  \"searchTerms\": [\n    \"error\",\n    \"success\",\n    \"completed\",\n    \"failed\"\n  ],\n  \"stepIds\": [\n    \"step_01jv0000000000000000000001\"\n  ],\n  \"caseSensitive\": false\n}")
  .asString();
```

```php Analyze Step Results for Keywords
<?php
require_once('vendor/autoload.php');

$client = new \GuzzleHttp\Client();

$response = $client->request('POST', 'https://api.runtype.com/v1/eval/analyze-steps', [
  'body' => '{
  "evalGroupId": "evalgrp_01jv0000000000000000000001",
  "searchTerms": [
    "error",
    "success",
    "completed",
    "failed"
  ],
  "stepIds": [
    "step_01jv0000000000000000000001"
  ],
  "caseSensitive": false
}',
  'headers' => [
    'Authorization' => 'Bearer <token>',
    'Content-Type' => 'application/json',
  ],
]);

echo $response->getBody();
```

```csharp Analyze Step Results for Keywords
using RestSharp;

var client = new RestClient("https://api.runtype.com/v1/eval/analyze-steps");
var request = new RestRequest(Method.POST);
request.AddHeader("Authorization", "Bearer <token>");
request.AddHeader("Content-Type", "application/json");
request.AddParameter("application/json", "{\n  \"evalGroupId\": \"evalgrp_01jv0000000000000000000001\",\n  \"searchTerms\": [\n    \"error\",\n    \"success\",\n    \"completed\",\n    \"failed\"\n  ],\n  \"stepIds\": [\n    \"step_01jv0000000000000000000001\"\n  ],\n  \"caseSensitive\": false\n}", ParameterType.RequestBody);
IRestResponse response = client.Execute(request);
```

```swift Analyze Step Results for Keywords
import Foundation

let headers = [
  "Authorization": "Bearer <token>",
  "Content-Type": "application/json"
]
let parameters = [
  "evalGroupId": "evalgrp_01jv0000000000000000000001",
  "searchTerms": ["error", "success", "completed", "failed"],
  "stepIds": ["step_01jv0000000000000000000001"],
  "caseSensitive": false
] as [String : Any]

let postData = JSONSerialization.data(withJSONObject: parameters, options: [])

let request = NSMutableURLRequest(url: NSURL(string: "https://api.runtype.com/v1/eval/analyze-steps")! as URL,
                                        cachePolicy: .useProtocolCachePolicy,
                                    timeoutInterval: 10.0)
request.httpMethod = "POST"
request.allHTTPHeaderFields = headers
request.httpBody = postData as Data

let session = URLSession.shared
let dataTask = session.dataTask(with: request as URLRequest, completionHandler: { (data, response, error) -> Void in
  if (error != nil) {
    print(error as Any)
  } else {
    let httpResponse = response as? HTTPURLResponse
    print(httpResponse)
  }
})

dataTask.resume()
```