> ## Documentation Index
> Fetch the complete documentation index at: https://docs.veadk.xyz/llms.txt
> Use this file to discover all available pages before exploring further.

# Evaluation

Evaluation sets contain cases used to check agent behavior. An evaluation runs those cases again and records metric results. This page indexes the Agent API Server development evaluation endpoints

These `/dev/...` endpoints require the development UI and evaluation dependencies; see [Agent API Server overview](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/overview.md). Harness deployments use their [corresponding evaluation endpoints](https://docs.veadk.xyz/productions/api-reference/preview/en/harness-runtime/create-eval-set.md)

> [!WARNING]
>
> Evaluation can call models and tools, incur charges, or perform external actions. Review user data, tool permissions, and metric settings when preparing cases

## Evaluation workflow

Create a set, add cases from existing sessions, and run an evaluation with selected metrics. Read, replace, or delete individual cases as needed. Check per-case status and metric results to determine whether the evaluation passed

| Method | Path | Endpoint |
| - | - | - |
| POST | `/dev/apps/{app_name}/eval-sets` | [Create an evaluation set](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/create-eval-set.md) |
| GET | `/dev/apps/{app_name}/eval-sets` | [List evaluation sets](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/list-eval-sets.md) |
| POST | `/dev/apps/{app_name}/eval-sets/{eval_set_id}/add-session` | [Add a session as an evaluation case](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/add-session-to-eval-set.md) |
| GET | `/dev/apps/{app_name}/eval_sets/{eval_set_id}/evals` | [List evaluation cases](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/list-eval-cases.md) |
| GET | `/dev/apps/{app_name}/eval-sets/{eval_set_id}/eval-cases/{eval_case_id}` | [Get an evaluation case](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/get-eval-case.md) |
| PUT | `/dev/apps/{app_name}/eval-sets/{eval_set_id}/eval-cases/{eval_case_id}` | [Update an evaluation case](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/update-eval-case.md) |
| DELETE | `/dev/apps/{app_name}/eval-sets/{eval_set_id}/eval-cases/{eval_case_id}` | [Delete an evaluation case](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/delete-eval-case.md) |
| GET | `/dev/apps/{app_name}/metrics-info` | [List evaluation metrics](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/list-eval-metrics.md) |
| POST | `/dev/apps/{app_name}/eval-sets/{eval_set_id}/run` | [Run an evaluation](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/run-evaluation.md) |
| GET | `/dev/apps/{app_name}/eval-results` | [List evaluation results](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/list-eval-results.md) |
| GET | `/dev/apps/{app_name}/eval-results/{eval_result_id}` | [Get an evaluation result](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/get-eval-result.md) |

## Compatibility endpoints

These endpoints remain available for existing clients. Check each page for request and response differences before migration; changing only the URL can be insufficient. Listing evaluation cases currently uses only the underscore path in the table above

| Method | Path | Endpoint |
| - | - | - |
| PUT | `/dev/apps/{app_name}/eval_sets/{eval_set_id}/evals/{eval_case_id}` | [Update a case using the compatibility path](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/update-eval-case-legacy.md) |
| POST | `/dev/apps/{app_name}/eval_sets/{eval_set_id}/run_eval` | [Run an evaluation using the legacy path](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/run-evaluation-legacy.md) |
| GET | `/dev/apps/{app_name}/eval_results` | [List evaluation results as an array](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/list-eval-results-legacy.md) |
| POST | `/dev/apps/{app_name}/eval_sets/{eval_set_id}/add_session` | [Add a session using the compatibility path](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/add-session-to-eval-set-legacy.md) |
| DELETE | `/dev/apps/{app_name}/eval_sets/{eval_set_id}/evals/{eval_case_id}` | [Delete a case using the compatibility path](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/delete-eval-case-legacy.md) |
| GET | `/dev/apps/{app_name}/eval_sets/{eval_set_id}/evals/{eval_case_id}` | [Get a case using the compatibility path](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/get-eval-case-legacy.md) |
| GET | `/dev/apps/{app_name}/eval_results/{eval_result_id}` | [Get an evaluation result using the legacy path](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/get-eval-result-legacy.md) |
| POST | `/dev/apps/{app_name}/eval_sets/{eval_set_id}` | [Create an evaluation set using a path ID](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/create-eval-set-legacy.md) |
| GET | `/dev/apps/{app_name}/eval_sets` | [List evaluation sets as an array](https://docs.veadk.xyz/productions/api-reference/preview/en/agent-api-server/list-eval-sets-legacy.md) |


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.