Templates

A template saves a full evaluation configuration — agents, personas, test sets, metrics, and run settings — so you can launch the same evaluation again without rebuilding it, or put it on a recurring schedule.

​

What a template stores

A template needs at least one agent, one persona, and one test set.

​

Creating a template

Templates are built from the Launch page, not a separate form — you set up a run as usual, then save it.

1. Go to the Launch page (on the Templates page, Create Template takes you here).
2. Select your agents, personas, and test sets, and choose iterations, concurrency, metrics, and any mutations.
3. Click Launch ▾ → Save as Template, give it a name, and save.

The new template opens on its own detail page, where you can edit it later.

​

Launching from a template

On the Launch page, open the Template dropdown and pick a saved template. Its agents, personas, test sets, metrics, and run settings populate the form. Adjust anything you want for this run, then click Launch.

​

Editing and deleting

Open a template from the Templates list to edit it. You can rename it, change the description, and update any part of the configuration — agents, personas, test sets, metrics, mutations, iterations, concurrency, or sub-sampling — then Save Changes. To delete a template, click Delete and confirm by typing its name. A template can’t be deleted while an active scheduled run still points to it — disable that schedule first.

​

Scheduling recurring runs

Any template can drive a recurring evaluation. From the Launch page, set up the run and choose Launch ▾ → Schedule to run it on an interval (e.g. every 6 hours) or at a set time of day. The schedule always points to a template, so updating the template changes what the schedule runs. See Scheduled Runs for the full scheduling options and how to manage them.