Skip to main content
A template saves a full evaluation configuration — agents, personas, test sets, metrics, and run settings — so you can launch the same evaluation again without rebuilding it, or put it on a recurring schedule.

​
What a template stores

A template needs at least one agent, one persona, and one test set.

​
Creating a template

Templates are built from the Simulate page, not a separate form — you set up a run as usual, then save it.
1

Open the Simulate page

Open Templates (from the sidebar, or the Templates button on the Simulated Conversations page) and click Create Template. This takes you to the Simulate page with the Save as Template dialog already open.You can also save any run you are setting up on the Simulate page: click Launch ▾ → Save as Template.
2

Configure the run

Select your agents, personas, and test sets, and choose iterations, concurrency, metrics, and any mutations.
3

Name and save

In the Save as Template dialog, give the template a name and save.
The Simulate page with the Launch button's dropdown open, showing the Save as Template option The Simulate page with the Launch button's dropdown open, showing the Save as Template option The new template opens on its own detail page, where you can edit it later.

​
Launching from a template

On the Simulate page, open the Template dropdown and pick a saved template. Its agents, personas, test sets, metrics, and run settings populate the form. Adjust anything you want for this run, then click Launch.
Changes you make on the Simulate page apply to that run only — they are not saved back to the template. To change the template itself, edit it on its detail page.

​
Editing and deleting

Open Templates (from the sidebar, or the Templates button on the Simulated Conversations page) and pick a template to edit it. You can rename it, change the description, and update any part of the configuration — agents, personas, test sets, metrics, mutations, iterations, concurrency, or sub-sampling — then Save Changes. To delete a template, click Delete and confirm by typing its name. A template can’t be deleted while an active scheduled run still points to it — disable that schedule first.

​
Scheduling recurring runs

Any template can drive a recurring evaluation. From the Simulate page, set up the run and choose Launch ▾ → Schedule to run it on an interval (e.g. every 6 hours) or at a set time of day. The schedule always points to a template, so updating the template changes what the schedule runs. See Scheduled Runs for the full scheduling options and how to manage them.