Run Templates - Coval Documentation

Run templates save a full evaluation configuration — agent, persona, test set, metrics, and parameters — so you can re-launch identical runs without specifying every option each time.

List Run Templates

coval run-templates list [OPTIONS]

Option	Type	Default	Description
`--filter`	string	—	Filter expression
`--page-size`	number	50	Results per page
`--order-by`	string	—	Sort order

Output columns: ID, NAME, AGENT, PERSONA, TEST SET, ITERATIONS, CONCURRENCY

# List all templates
coval run-templates list

# JSON output
coval run-templates list --format json

Get Run Template

coval run-templates get <run_template_id>

Argument	Type	Required	Description
`run_template_id`	string	Yes	The run template ID

coval run-templates get rt_abc123

Create Run Template

coval run-templates create [OPTIONS]

Option	Type	Required	Description
`--name`	string	Yes	Display name for the template
`--agent-id`	string	No	Agent to evaluate
`--persona-id`	string	No	Persona for simulations
`--test-set-id`	string	No	Test set to use
`--metric-ids`	string	No	Comma-separated metric IDs
`--mutation-ids`	string	No	Comma-separated mutation IDs
`--iteration-count`	number	No	Number of iterations per test case
`--concurrency`	number	No	Max concurrent simulations
`--sub-sample-size`	number	No	Number of test cases to sample
`--sub-sample-seed`	number	No	Random seed for sampling

# Create a basic template
coval run-templates create \
  --name "Nightly Regression" \
  --agent-id ag_abc123 \
  --persona-id per_xyz789 \
  --test-set-id ts_123456

# Create a template with metrics and concurrency
coval run-templates create \
  --name "Full Evaluation" \
  --agent-id ag_abc123 \
  --persona-id per_xyz789 \
  --test-set-id ts_123456 \
  --metric-ids "met_001,met_002,met_003" \
  --iteration-count 3 \
  --concurrency 5

Update Run Template

coval run-templates update <run_template_id> [OPTIONS]

Argument	Type	Required	Description
`run_template_id`	string	Yes	The run template ID to update

Option	Type	Description
`--name`	string	New display name
`--agent-id`	string	New agent ID
`--persona-id`	string	New persona ID
`--test-set-id`	string	New test set ID
`--metric-ids`	string	New comma-separated metric IDs
`--mutation-ids`	string	New comma-separated mutation IDs
`--iteration-count`	number	New iteration count
`--concurrency`	number	New concurrency limit
`--sub-sample-size`	number	New sample size
`--sub-sample-seed`	number	New sample seed

coval run-templates update rt_abc123 \
  --concurrency 10 \
  --iteration-count 5

Delete Run Template

coval run-templates delete <run_template_id>

Argument	Type	Required	Description
`run_template_id`	string	Yes	The run template ID to delete

Deleting a run template will fail with a 409 error if it has active scheduled runs. Remove or disable associated scheduled runs first.

coval run-templates delete rt_abc123

⌘I