Compare traces | Runtype Documentation

curl -X POST https://api.runtype.com/v1/logs/trace/compare \
     -H "Authorization: <apiKey>" \
     -H "Content-Type: application/json" \
     -d '{
  "left": {
    "filters": {}
  },
  "right": {
    "filters": {}
  }
}'

{
  "data": {
    "alignment": [
      {
        "argDrift": 1.1,
        "driftedKeys": [
          "string"
        ],
        "leftIndex": 1.1,
        "op": "match",
        "rightIndex": 1.1,
        "tool": "string"
      }
    ],
    "divergence": {
      "alignmentIndex": 1.1,
      "description": "string",
      "leftIndex": 1.1,
      "rightIndex": 1.1
    },
    "left": {
      "cost": 1.1,
      "durationMs": 1.1,
      "executionId": "string",
      "inputTokens": 1.1,
      "outputTokens": 1.1,
      "source": "string",
      "status": "string",
      "stopReason": "string",
      "toolCalls": 1.1,
      "turns": 1.1
    },
    "mode": "executions",
    "perTool": [
      {
        "argDrift": 1.1,
        "leftCalls": 1.1,
        "leftErrors": 1.1,
        "rightCalls": 1.1,
        "rightErrors": 1.1,
        "tool": "string"
      }
    ],
    "right": {
      "cost": 1.1,
      "durationMs": 1.1,
      "executionId": "string",
      "inputTokens": 1.1,
      "outputTokens": 1.1,
      "source": "string",
      "status": "string",
      "stopReason": "string",
      "toolCalls": 1.1,
      "turns": 1.1
    },
    "truncated": {
      "left": true,
      "right": true
    }
  },
  "success": true
}

Structural diff of two executions (tool-sequence alignment, first divergence, per-side totals, shallow argument drift) or of two cohorts given as query filter sets (tool usage, stop reasons and signal rates over at most 50 sampled runs per side).

Authentication

AuthorizationBearer

API key or Clerk session token

Request

This endpoint expects an object.

leftobjectRequired

rightobjectRequired

fromstringOptional

sampleSizeintegerOptional1-50

tostringOptional

Response

Comparison

dataobject

successboolean

Errors

400

Bad Request Error

401

Unauthorized Error

403

Forbidden Error

404

Not Found Error

500

Internal Server Error

503

Service Unavailable Error