Run Templates - Coval Documentation

Run templates save a full evaluation configuration — agents, personas, test sets, metrics, and parameters — so you can re-launch identical runs without specifying every option each time. create and update also accept --input-json (inline JSON, @file, or - for stdin); explicit flags override fields from the JSON. See Input JSON.

List Run Templates

coval run-templates list [OPTIONS]

Option	Type	Default	Description
`--filter`	string	—	Filter expression
`--page-size`	number	50	Results per page
`--order-by`	string	—	Sort order

Output columns: ID, NAME, AGENT, PERSONA, TEST SET, ITERATIONS, CONCURRENCY

# List all templates
coval run-templates list

# JSON output
coval run-templates list --format json

Get Run Template

coval run-templates get <run_template_id>

Argument	Type	Required	Description
`run_template_id`	string	Yes	The run template ID

coval run-templates get rt_abc123

Create Run Template

coval run-templates create [OPTIONS]

Option	Type	Required	Description
`--name`	string	Yes	Display name for the template (1-200 characters)
`--agent-ids`	string	Yes	Comma-separated agent IDs to evaluate
`--persona-ids`	string	Yes	Comma-separated persona IDs for simulations
`--test-set-ids`	string	Yes	Comma-separated test set IDs to use
`--description`	string	No	Optional description
`--metric-ids`	string	No	Comma-separated metric IDs
`--mutation-ids`	string	No	Comma-separated mutation IDs
`--iteration-count`	number	No	Number of iterations per test case
`--concurrency`	number	No	Max concurrent simulations
`--sub-sample-size`	number	No	Number of test cases to sample
`--sub-sample-seed`	number	No	Random seed for sampling
`--tags`	string	No	Comma-separated tag names; pass an empty value to clear all tags

# Create a basic template
coval run-templates create \
  --name "Nightly Regression" \
  --agent-ids ag_abc123 \
  --persona-ids per_xyz789 \
  --test-set-ids ts_123456

# Create a template with metrics and concurrency
coval run-templates create \
  --name "Full Evaluation" \
  --agent-ids "ag_abc123,ag_def456" \
  --persona-ids per_xyz789 \
  --test-set-ids ts_123456 \
  --metric-ids "met_001,met_002,met_003" \
  --iteration-count 3 \
  --concurrency 5 \
  --tags "nightly"

Update Run Template

coval run-templates update <run_template_id> [OPTIONS]

Argument	Type	Required	Description
`run_template_id`	string	Yes	The run template ID to update

Option	Type	Description
`--name`	string	New display name
`--description`	string	New description
`--agent-ids`	string	New comma-separated agent IDs
`--persona-ids`	string	New comma-separated persona IDs
`--test-set-ids`	string	New comma-separated test set IDs
`--metric-ids`	string	New comma-separated metric IDs
`--mutation-ids`	string	New comma-separated mutation IDs
`--iteration-count`	number	New iteration count
`--concurrency`	number	New concurrency limit
`--sub-sample-size`	number	New sample size
`--sub-sample-seed`	number	New sample seed
`--tags`	string	Comma-separated tag names; pass an empty value to clear all tags

coval run-templates update rt_abc123 \
  --concurrency 10 \
  --iteration-count 5

Delete Run Template

coval run-templates delete <run_template_id>

Argument	Type	Required	Description
`run_template_id`	string	Yes	The run template ID to delete

Deleting a run template will fail with a 409 error if it has active scheduled runs. Remove or disable associated scheduled runs first.

coval run-templates delete rt_abc123