METRIC_SQL_FLOAT - Custom SQL query over the simulation's data (set sql_query)
METRIC_PYTHON - Tested Python metric; create and edit through the Python draft publication API.
METRIC_COMPOSITE_EVALUATION - Judges a list of criteria independently and reports how
many were met (set criteria_source, and criteria_path or criteria to match)
IVR flow definition (required for METRIC_IVR_FLOW_ADHERENCE). The same flow tree the
flow builder in the Coval UI produces; binding it here makes the metric runnable
without a UI step.
Show child attributes
Example:
{ "start_node": "greeting", "nodes": [ { "id": "greeting", "prompt": "Welcome to Acme Support. Press 1 for sales, 2 for support." }, { "id": "sales", "prompt": "Connecting you to our sales team.", "terminal": true }, { "id": "support", "prompt": "Please describe your issue after the tone.", "terminal": true } ], "edges": [ { "source": "greeting", "destination": "sales", "input": "1" }, { "source": "greeting", "destination": "support", "input": "2" } ] }
SQL query run against the simulation's data. Required for METRIC_SQL_FLOAT.
The query returns one row per timestamp with a numeric value and a
start_offset_milliseconds; set aggregation_method (SUM, AVERAGE, MIN, MAX,
or COUNT; default AVERAGE) to reduce those rows to a single value, and unit
for the reported unit. SQL metric units use exact result-unit identifiers: s for
seconds, ms for milliseconds, count, percent, or another supported result unit.
Do not use seconds or milliseconds. Omit unit for a unitless result; an
unsupported SQL unit is rejected before the metric is saved.
Maximum string length: 50000
Example:
"SELECT start_offset_milliseconds, latency_milliseconds AS value FROM events"
Where the metric reads its criteria from. Required for METRIC_COMPOSITE_EVALUATION.
test_case reads a field off each test case (most commonly its expected behaviors),
test_case_attribute reads from the test case's attributes, and metric_metadata
uses the fixed list in criteria.
How per-criterion verdicts aggregate into the metric's value. Each criterion is judged
independently as met or not met; percentage_of_criteria_met scores the fraction met
among the criteria the judge could evaluate.
Restrict an audio metric to part of the recording, for example only the caller with
{"include": [{"type": "speaker", "speakers": ["persona"]}]}. Omit or send null to use the metric's
default scope. Supported for METRIC_ABRUPT_PITCH_CHANGES, METRIC_AUDIO_LLM_BINARY, METRIC_AUDIO_LLM_CATEGORICAL, METRIC_AUDIO_LLM_NUMERICAL, METRIC_CLIPPING_ARTIFACT, METRIC_CODEC_ARTIFACT, METRIC_CUSTOM_AGENT_NEEDS_REPROMPTING, METRIC_CUSTOM_AUDIO_FREQUENCY, METRIC_CUSTOM_AUDIO_SENTIMENT, METRIC_DROPOUT_ARTIFACT, METRIC_LOOP_DETECTION, METRIC_LUFS, METRIC_NON_EXPRESSIVE_PAUSES, METRIC_PAUSE_ANALYSIS, METRIC_PHONEME_STRETCH, METRIC_PITCH_VARIABILITY, METRIC_SPEAKING_TIME_PERCENTAGE, METRIC_SPECTROGRAM_PITCH_ANALYSIS, METRIC_SPEECH_ARTIFACT_ANOMALY, METRIC_SYLLABLE_RATE, METRIC_TERMINAL_CONTOUR, METRIC_TIMBRE_DRIFT, METRIC_VOCAL_FRY, METRIC_VOICE_QUALITY, METRIC_VOLUME, METRIC_VOLUME_PITCH_MISALIGNMENT; rejected with 400 for any other type.
Override the LLM model used for metric evaluation. If omitted, the platform default
model is used. Use GET /v1/models/metric to list available models.
Not supported for audio metric types (METRIC_AUDIO_LLM_BINARY,
METRIC_AUDIO_LLM_CATEGORICAL, METRIC_AUDIO_LLM_NUMERICAL),
which always use the platform-default audio model.
Anomaly detection preset (recommended). 'strict' flags more pauses (MAD threshold 2.0), 'normal' is balanced (3.0, default), 'lenient' is conservative (4.0). Omit to use 'normal'.
METRIC_VOLUME threshold preset (recommended). 'strict' flags more level outliers, 'normal' is the default, 'lenient' flags fewer. Omit to use 'normal'.
Source of the aggregated value for METRIC_CUSTOM_TRACE: 'attribute' (default) reads the configured span attribute; 'duration' aggregates the span's own duration in seconds.
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"Coval Documentation","colors":{"primary":"#000000","light":"#D9D9D9","dark":"#333333"},"logo":{"light":"https://mintcdn.com/coval-2e18a559/Notp6opJUCHArykW/logo/coval-logo-vector.svg?fit=max\u0026auto=format\u0026n=Notp6opJUCHArykW\u0026q=85\u0026s=f08474458e9c5bbff1e1d7119fdc8012","dark":"https://mintcdn.com/coval-2e18a559/Notp6opJUCHArykW/logo/coval-logo-vector-white.svg?fit=max\u0026auto=format\u0026n=Notp6opJUCHArykW\u0026q=85\u0026s=ed477a66f2ca12c3c7a0289aa7c5bfb4"},"favicon":"https://mintcdn.com/coval-2e18a559/h96r_q_HmNOhXnSr/favicon.png?fit=max\u0026auto=format\u0026n=h96r_q_HmNOhXnSr\u0026q=85\u0026s=3451522324a1d00b3ad7c50ef0b825b3","api":{"mdx":{"auth":{"method":"key","name":"x-api-key"},"server":"https://api.coval.dev"}},"appearance":{"default":"light"},"background":{"image":"https://mintlify.s3.us-west-1.amazonaws.com/coval-2e18a559/images/background/frame_16opblack.svg","color":{"light":"#F2F1EE","dark":"#000000"}},"navbar":{"links":[{"href":"/changelog","label":"Changelog"},{"href":"mailto:support@coval.dev","label":"Support"},{"href":"https://www.coval.dev","label":"Website"}],"primary":{"type":"button","label":"Dashboard","href":"https://app.coval.dev"}},"footer":{"socials":{"linkedin":"https://www.linkedin.com/company/covaldev","twitter":"https://x.com/covaldev"}},"contextual":{"options":["copy","view"],"display":"header"},"styling":{"latex":true},"navigation":{"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"coval-2e18a559","hasAudioNarration":false,"actualSubdomain":"coval-2e18a559","customDomains":["docs.coval.ai"],"gitSource":{"type":"github","owner":"coval-ai","repo":"docs","deployBranch":"main","contentDirectory":"","isPrivate":true,"mountPath":"","label":""},"feedback":{"thumbs":true,"edits":true,"issues":true},"entitlements":{"AI_CHAT":{"status":"ENABLED"},"WEB_MCP":{"status":"ENABLED"},"NARRATION":{"status":"ENABLED"}},"buildId":"6aef92d05a64506a906a5a99","clientVersion":"0.0.4094","searchFilterCounts":[{"language":"default","tag":"API","count":193},{"language":"default","tag":"Home","count":76},{"language":"default","tag":"Resources","count":44},{"language":"default","tag":"Simulated Conversations","count":41},{"language":"default","tag":"Metrics","count":34},{"language":"default","tag":"Agents","count":29},{"language":"default","tag":"CLI","count":22},{"language":"default","tag":"Test Sets","count":17},{"language":"default","tag":"Reviews","count":17},{"language":"default","tag":"Uploaded Conversations","count":16}]},"assistantConfig":{},"basePath":"","hasChatPermissions":true,"hasWebMcpPermissions":true,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"rbac-expansion","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-metadata","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-serve","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"live-agents","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"comment-mode","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":false},"customCss":[{"filePath":"style.css","content":".cl{position:relative;max-width:880px}.cl-entry{position:relative;display:grid;grid-template-columns:96px 1fr;column-gap:2.5rem;padding-bottom:2.5rem}.cl-entry::before{content:\"\";position:absolute;left:96px;top:8px;bottom:-8px;width:2px;background:#dcdad5}.cl-entry:last-child::before{display:none}.cl-entry::after{content:\"\";position:absolute;left:91px;top:7px;width:12px;height:12px;border-radius:50%;background:#11161f;box-shadow:0 0 0 4px #f2f1ee}.cl-rail{text-align:center}.cl-rail__date{font-size:1.4rem;font-weight:700;color:#1a1a1a;line-height:1.1}.cl-rail__year{font-size:1.05rem;color:#9a958c;font-weight:500}.cl-rail__count{margin-top:0.35rem;font-size:0.8rem;color:#a8a399}.cl-content{min-width:0}.cl-highlights{background:#0f1320;border-radius:16px;padding:1.4rem 1.75rem;margin-bottom:1.25rem}.cl-highlights__label{font-size:0.72rem;letter-spacing:0.12em;text-transform:uppercase;font-weight:600;color:#8b94a5}.cl-highlights__list{margin:0.65rem 0 0;padding:0;list-style:none}.cl-highlights__list li{position:relative;padding-left:1.1rem;margin:0.3rem 0;font-size:1rem;line-height:1.45;color:#f5f6f8}.cl-highlights__list li::before{content:\"\";position:absolute;left:0;top:0.6em;width:5px;height:5px;border-radius:50%;background:#8b94a5}.cl-card{position:relative;background:#fff;border:1px solid #ececec;border-radius:16px;padding:1.5rem 1.75rem;margin-bottom:1rem}.cl-card__title{font-size:1.25rem;font-weight:700;color:#1a1a1a;margin-bottom:0.5rem}.cl-card__desc{color:#5b5b5b;line-height:1.55;margin:0}.cl-card__extra{display:none}.cl-card__divider{border:none;border-top:1px solid #ededed;margin:1.1rem 0}.cl-card__extra p{color:#5b5b5b;line-height:1.55}.cl-card__extra a,.cl-doc-link{color:#15803d;font-weight:600;text-decoration:none}.cl-card__extra a:hover{text-decoration:none;opacity:0.8}.cl-card__footer{display:flex;align-items:center;gap:0.75rem;margin-top:1.1rem}.cl-pill{font-size:0.8rem;font-weight:600;padding:0.25rem 0.7rem;border-radius:999px}.cl-pill--new{background:#d9f0e1;color:#1a7f4b}.cl-pill--improved{background:#dde9fb;color:#1d4ed8}.cl-pill--fixed{background:#fdeccf;color:#b45309}.cl-cat{font-size:0.85rem;color:#9aa0a6}.cl-cb{position:absolute;width:1px;height:1px;padding:0;margin:-1px;overflow:hidden;clip:rect(0, 0, 0, 0);white-space:nowrap;border:0}.cl-toggle{margin-left:auto;cursor:pointer;user-select:none;font-size:0.85rem;font-weight:500;color:#1f2433;border:1px solid #cdd5e3;border-radius:9px;padding:0.45rem 0.85rem;white-space:nowrap}.cl-toggle:hover{background:#f6f8fc}.cl-cb:focus-visible~.cl-card__footer .cl-toggle{outline:2px solid #4f6bed;outline-offset:2px}.cl-toggle .less{display:none}.cl-cb:checked~.cl-card__extra{display:block}.cl-cb:checked~.cl-card__footer .cl-toggle .more{display:none}.cl-cb:checked~.cl-card__footer .cl-toggle .less{display:inline}.dark .cl-entry::before{background:#2a2f3a}.dark .cl-entry::after{background:#e5e7eb;box-shadow:0 0 0 4px #000}.dark .cl-rail__date{color:#f5f6f8}.dark .cl-rail__year{color:#9aa0ad}.dark .cl-rail__count{color:#7e8493}.dark .cl-card{background:#11161f;border-color:#242a36}.dark .cl-card__title{color:#f5f6f8}.dark .cl-card__desc,.dark .cl-card__extra p{color:#aab1bd}.dark .cl-card__divider{border-top-color:#262b36}.dark .cl-card__extra a,.dark .cl-doc-link{color:#4ade80}.dark .cl-pill--new{background:#10301d;color:#5cd98c}.dark .cl-pill--improved{background:#13233f;color:#7aa6f5}.dark .cl-pill--fixed{background:#3a2a10;color:#e0a955}.dark .cl-cat{color:#8b909a}.dark .cl-toggle{color:#cbd2de;border-color:#333a47}.dark .cl-toggle:hover{background:#1a2030}@media (max-width: 640px){.cl-entry{grid-template-columns:1fr;row-gap:1rem}.cl-entry::before,.cl-entry::after{display:none}.cl-rail{display:flex;align-items:baseline;gap:0.5rem;text-align:left}}html:not(.dark) #search-bar-entry,html:not(.dark) #search-bar-entry *,html:not(.dark) #assistant-entry,html:not(.dark) #assistant-entry *{color:#5c5c5c}html:not(.dark) #footer a[href*=\"mintlify\"]{color:#5c5c5c}.dark #footer a[href*=\"mintlify\"]{color:#8c8c8c}html:not(.dark) .chat-assistant-disclaimer-text{color:#5c5c5c}.dark .chat-assistant-disclaimer-text{color:#a3a3a3}html:not(.dark) .method-nav-pill>.text-green-700{color:#166534}html:not(.dark) .method-nav-pill>.text-blue-700{color:#1e40af}html:not(.dark) .method-nav-pill>.text-orange-700{color:#9a3412}html:not(.dark) .method-nav-pill>.text-red-700{color:#991b1b}html:not(.dark) [class*=\"bg-[#FDEAD8]\"]{color:#8a4508}.dark [class*=\"bg-[#FDEAD8]\"]{color:#f5a35c}html:not(.dark) [data-component-part=\"field-required-pill\"]{color:#b91c1c}#chat-assistant-sheet[aria-hidden=\"true\"]>*,#chat-assistant-sheet[role=\"dialog\"]:not([data-open])>*{visibility:hidden}:focus-visible,#root :focus-visible{outline:2px solid #11161f!important;outline-offset:2px!important}.dark :focus-visible,.dark #root :focus-visible{outline-color:#f5f6f8!important}#root [data-radix-scroll-area-viewport]:focus-visible,#root pre:focus-visible,#root div[tabindex=\"0\"]:focus-visible{outline-offset:-2px!important}:has(>.chat-assistant-input:focus-visible){outline:2px solid #11161f;outline-offset:2px}.dark :has(>.chat-assistant-input:focus-visible){outline-color:#f5f6f8}"}],"page":{"pagePath":"api-reference/metrics/create-metric","slug":"/api-reference/metrics/create-metric","pageMetadata":{"title":"Create metric","description":"Create a new custom evaluation metric.\n\n**Required fields vary by metric type:**\n\n| Metric Type | Required Fields |\n|-------------|-----------------|\n| METRIC_AGENT_JUDGE | prompt |\n| METRIC_AGENT_JUDGE_CATEGORICAL | prompt, categories |\n| METRIC_AGENT_JUDGE_NUMERICAL | prompt, min_value, max_value |\n| METRIC_LLM_BINARY | prompt |\n| METRIC_CATEGORICAL | prompt, categories |\n| METRIC_NUMERICAL_LLM_JUDGE | prompt, min_value, max_value |\n| METRIC_AUDIO_LLM_BINARY | prompt |\n| METRIC_AUDIO_LLM_CATEGORICAL | prompt, categories |\n| METRIC_AUDIO_LLM_NUMERICAL | prompt, min_value, max_value |\n| METRIC_TOOLCALL | prompt |\n| METRIC_METADATA_FIELD | metadata_field_type, metadata_field_key |\n| METRIC_TRANSCRIPT_REGEX | regex_pattern |\n| METRIC_PAUSE_ANALYSIS | min_pause_duration_seconds |\n","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics","href":"/api-reference/metrics/create-metric","autogeneratedByOpenApi":true},"description":{"compiledSource":"\"use strict\";\nconst {Fragment: _Fragment, jsx: _jsx, jsxs: _jsxs} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n p: \"p\",\n strong: \"strong\",\n table: \"table\",\n tbody: \"tbody\",\n td: \"td\",\n th: \"th\",\n thead: \"thead\",\n tr: \"tr\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsxs(_Fragment, {\n children: [_jsx(_components.p, {\n children: \"Create a new custom evaluation metric.\"\n }), \"\\n\", _jsx(_components.p, {\n children: _jsx(_components.strong, {\n children: \"Required fields vary by metric type:\"\n })\n }), \"\\n\", _jsxs(_components.table, {\n children: [_jsx(_components.thead, {\n children: _jsxs(_components.tr, {\n children: [_jsx(_components.th, {\n children: \"Metric Type\"\n }), _jsx(_components.th, {\n children: \"Required Fields\"\n })]\n })\n }), _jsxs(_components.tbody, {\n children: [_jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_AGENT_JUDGE\"\n }), _jsx(_components.td, {\n children: \"prompt\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_AGENT_JUDGE_CATEGORICAL\"\n }), _jsx(_components.td, {\n children: \"prompt, categories\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_AGENT_JUDGE_NUMERICAL\"\n }), _jsx(_components.td, {\n children: \"prompt, min_value, max_value\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_LLM_BINARY\"\n }), _jsx(_components.td, {\n children: \"prompt\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_CATEGORICAL\"\n }), _jsx(_components.td, {\n children: \"prompt, categories\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_NUMERICAL_LLM_JUDGE\"\n }), _jsx(_components.td, {\n children: \"prompt, min_value, max_value\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_AUDIO_LLM_BINARY\"\n }), _jsx(_components.td, {\n children: \"prompt\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_AUDIO_LLM_CATEGORICAL\"\n }), _jsx(_components.td, {\n children: \"prompt, categories\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_AUDIO_LLM_NUMERICAL\"\n }), _jsx(_components.td, {\n children: \"prompt, min_value, max_value\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_TOOLCALL\"\n }), _jsx(_components.td, {\n children: \"prompt\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_METADATA_FIELD\"\n }), _jsx(_components.td, {\n children: \"metadata_field_type, metadata_field_key\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_TRANSCRIPT_REGEX\"\n }), _jsx(_components.td, {\n children: \"regex_pattern\"\n })]\n }), _jsxs(_components.tr, {\n children: [_jsx(_components.td, {\n children: \"METRIC_PAUSE_ANALYSIS\"\n }), _jsx(_components.td, {\n children: \"min_pause_duration_seconds\"\n })]\n })]\n })]\n })]\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){return _jsx(_Fragment,{})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"title":"Create metric","description":"Create a new custom evaluation metric.\n\n**Required fields vary by metric type:**\n\n| Metric Type | Required Fields |\n|-------------|-----------------|\n| METRIC_AGENT_JUDGE | prompt |\n| METRIC_AGENT_JUDGE_CATEGORICAL | prompt, categories |\n| METRIC_AGENT_JUDGE_NUMERICAL | prompt, min_value, max_value |\n| METRIC_LLM_BINARY | prompt |\n| METRIC_CATEGORICAL | prompt, categories |\n| METRIC_NUMERICAL_LLM_JUDGE | prompt, min_value, max_value |\n| METRIC_AUDIO_LLM_BINARY | prompt |\n| METRIC_AUDIO_LLM_CATEGORICAL | prompt, categories |\n| METRIC_AUDIO_LLM_NUMERICAL | prompt, min_value, max_value |\n| METRIC_TOOLCALL | prompt |\n| METRIC_METADATA_FIELD | metadata_field_type, metadata_field_key |\n| METRIC_TRANSCRIPT_REGEX | regex_pattern |\n| METRIC_PAUSE_ANALYSIS | min_pause_duration_seconds |\n","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics","href":"/api-reference/metrics/create-metric","autogeneratedByOpenApi":true}}},"mdxSourceWithNoJs":null},"mdxExtracts":{"tableOfContents":[],"codeExamples":{}},"jsLinks":["/_mintlify/custom/coval-2e18a559/96d9833460dc4be2/analytics.js","/_mintlify/custom/coval-2e18a559/37be8295f8507cc8/a11y.js"],"openApiReferenceData":{"operation":{"operationId":"createMetric","summary":"Create metric","description":"Create a new custom evaluation metric.\n\n**Required fields vary by metric type:**\n\n| Metric Type | Required Fields |\n|-------------|-----------------|\n| METRIC_AGENT_JUDGE | prompt |\n| METRIC_AGENT_JUDGE_CATEGORICAL | prompt, categories |\n| METRIC_AGENT_JUDGE_NUMERICAL | prompt, min_value, max_value |\n| METRIC_LLM_BINARY | prompt |\n| METRIC_CATEGORICAL | prompt, categories |\n| METRIC_NUMERICAL_LLM_JUDGE | prompt, min_value, max_value |\n| METRIC_AUDIO_LLM_BINARY | prompt |\n| METRIC_AUDIO_LLM_CATEGORICAL | prompt, categories |\n| METRIC_AUDIO_LLM_NUMERICAL | prompt, min_value, max_value |\n| METRIC_TOOLCALL | prompt |\n| METRIC_METADATA_FIELD | metadata_field_type, metadata_field_key |\n| METRIC_TRANSCRIPT_REGEX | regex_pattern |\n| METRIC_PAUSE_ANALYSIS | min_pause_duration_seconds |\n","tags":["Metrics"],"requestBody":"63db1379-c25e-4711-ad9c-fbea52ddc70a","responses":{"201":"3de7090a-0b44-4a3c-a525-2c79c6cf95bc","400":"e9117918-eb29-4c5f-9797-d7966fbed993","401":"f587ed56-5f7b-473b-a357-26c87f3329da","403":"4c71537d-a063-4a7a-94c7-f34472b447fd","412":"45b1d55f-12a1-498d-9e3b-4d969f45a93d","500":"633b7d84-8699-43ef-99e5-2b95b8e9fa3d"},"method":"post","type":"path","servers":["4658aeec-795e-4e4f-8e70-0c80ef6d48fa"],"security":["a6fa891c-1ec3-4fb3-a6fc-1efc2c818884"],"path":"/metrics","baseUrlOptions":["https://api.coval.dev/v1"],"title":"Create metric","codeSamples":[],"requiredOnlyExamples":false,"requestExampleType":"generated","responseExampleType":"generated"},"dependencies":{"parameters":{"27441f90-8cbd-434d-b265-af614a9d8d01":{"name":"X-Coval-Workspace-Id","in":"header","required":false,"schema":{"type":"string","minLength":1,"maxLength":26,"isRequired":false,"description":"Workspace that scopes this operation. When omitted, the organization's active default workspace is used when one can be resolved.","uniqueKey":"","typeLabel":"string"},"description":"Workspace that scopes this operation. When omitted, the organization's active default workspace is used when one can be resolved."}},"requestBody":{"required":true,"content":{"application/json":{"schema":{"type":"object","description":"Create metric request","required":["description","metric_name","metric_type"],"properties":{"metric_name":{"type":"string","description":"Display name","minLength":1,"maxLength":200,"isRequired":true,"uniqueKey":"metric_name","typeLabel":"string"},"description":{"type":"string","description":"Metric description","minLength":1,"maxLength":1000,"isRequired":true,"uniqueKey":"description","typeLabel":"string"},"metric_type":{"type":"string","description":"Metric evaluation type.\n\n- `METRIC_AGENT_JUDGE` - Agentic binary evaluation with bounded evidence tools\n- `METRIC_AGENT_JUDGE_CATEGORICAL` - Agentic categorical evaluation with bounded evidence tools\n- `METRIC_AGENT_JUDGE_NUMERICAL` - Agentic numerical evaluation with bounded evidence tools\n- `METRIC_LLM_BINARY` - Yes/no LLM evaluation\n- `METRIC_CATEGORICAL` - Multi-class classification\n- `METRIC_NUMERICAL_LLM_JUDGE` - Numerical scoring (1-N)\n- `METRIC_AUDIO_LLM_BINARY` - Audio-based yes/no\n- `METRIC_AUDIO_LLM_CATEGORICAL` - Audio-based classification\n- `METRIC_AUDIO_LLM_NUMERICAL` - Audio-based scoring\n- `METRIC_TOOLCALL` - Tool/function call evaluation\n- `METRIC_METADATA_FIELD` - Extract metadata field\n- `METRIC_TRANSCRIPT_REGEX` - Regex pattern matching\n- `METRIC_PAUSE_ANALYSIS` - Speech pause detection\n- `METRIC_SQL_FLOAT` - Custom SQL query over the simulation's data (set `sql_query`)\n- `METRIC_PYTHON` - Tested Python metric; create and edit through the Python draft publication API.\n- `METRIC_COMPOSITE_EVALUATION` - Judges a list of criteria independently and reports how\n many were met (set `criteria_source`, and `criteria_path` or `criteria` to match)\n","enum":["METRIC_LLM_BINARY","METRIC_AGENT_JUDGE","METRIC_AGENT_JUDGE_CATEGORICAL","METRIC_CATEGORICAL","METRIC_AUDIO_LLM_BINARY","METRIC_AUDIO_LLM_CATEGORICAL","METRIC_TOOLCALL","METRIC_METADATA_FIELD","METRIC_AGENT_JUDGE_NUMERICAL","METRIC_NUMERICAL_LLM_JUDGE","METRIC_AUDIO_LLM_NUMERICAL","METRIC_TRANSCRIPT_REGEX","METRIC_USER_FRUSTRATION","METRIC_AGENT_REFUSAL","METRIC_PAUSE_ANALYSIS","METRIC_SQL_FLOAT","METRIC_PYTHON","METRIC_COMPOSITE_EVALUATION","METRIC_LLM_TTFB","METRIC_TTS_TTFB","METRIC_STT_TTFB","METRIC_LLM_TOKEN_USAGE","METRIC_TOOL_CALL_RATE","METRIC_TRACE_STT_WER","METRIC_TRACE_AUDIO_UPLOAD_STT_WER","METRIC_CUSTOM_TRACE","METRIC_VOICE_QUALITY","METRIC_PHONEME_STRETCH","METRIC_SYLLABLE_RATE","METRIC_LOOP_DETECTION","METRIC_CODEC_ARTIFACT","METRIC_CLIPPING_ARTIFACT","METRIC_DROPOUT_ARTIFACT","METRIC_TIMBRE_DRIFT","METRIC_SPEECH_ARTIFACT_ANOMALY","METRIC_PITCH_VARIABILITY","METRIC_NON_EXPRESSIVE_PAUSES","METRIC_ABRUPT_PITCH_CHANGES","METRIC_TERMINAL_CONTOUR","METRIC_LUFS","METRIC_VOLUME","METRIC_VOCAL_FRY","METRIC_DERIVED_STRICT_LOGIC","METRIC_DERIVED_AGGREGATE","METRIC_IVR_FLOW_ADHERENCE","METRIC_CUSTOM_AGENT_FAILS_TO_RESPOND","METRIC_CUSTOM_AGENT_NEEDS_REPROMPTING","METRIC_CUSTOM_AUDIO_FREQUENCY","METRIC_CUSTOM_AUDIO_SENTIMENT","METRIC_CUSTOM_END_REASON","METRIC_MATCH_EXPECTED_OUTPUT","METRIC_SPEAKING_TIME_PERCENTAGE","METRIC_SPECTROGRAM_PITCH_ANALYSIS","METRIC_VOLUME_PITCH_MISALIGNMENT","METRIC_WORDS_PER_MESSAGE_WITH_THRESHOLD"],"isRequired":true,"uniqueKey":"metric_type","typeLabel":"enum\u003cstring>"},"judge_mode":{"type":"string","description":"LLM Judge execution mode. Agentic mode is available for text LLM Judges only.","default":"STANDARD","enum":["STANDARD","AGENTIC"],"uniqueKey":"judge_mode","typeLabel":"enum\u003cstring>"},"prompt":{"type":"string","description":"LLM evaluation prompt. Required for LLM-based metrics.","uniqueKey":"prompt","typeLabel":"string"},"enabled_tools":{"oneOf":[{"type":"array","items":{"type":"string","description":"Evidence tool available to an Agent Judge metric.","enum":["get_transcript","search_transcript","search_transcript_regex","get_trace_spans","query_simulation_frames","get_run_context","get_evidence_manifest","get_simulation_outcome","get_dependency_metric_outputs"],"uniqueKey":"enabled_tools.oneOf.0.items.[INDEX]","typeLabel":"enum\u003cstring>"},"description":"Agentic LLM Judge tools. Omit to use V1 defaults; pass an empty list to disable all tools.","uniqueKey":"enabled_tools.oneOf.0","typeLabel":"enum\u003cstring>[]"},{"type":"null","items":{"type":"string","description":"Evidence tool available to an Agent Judge metric.","enum":["get_transcript","search_transcript","search_transcript_regex","get_trace_spans","query_simulation_frames","get_run_context","get_evidence_manifest","get_simulation_outcome","get_dependency_metric_outputs"]},"description":"Agentic LLM Judge tools. Omit to use V1 defaults; pass an empty list to disable all tools.","uniqueKey":"enabled_tools.oneOf.1","typeLabel":"null"}],"uniqueKey":"enabled_tools","typeLabel":"enum\u003cstring>[] | null"},"dependency_metric_ids":{"oneOf":[{"type":"array","maxItems":10,"items":{"type":"string","minLength":1,"uniqueKey":"dependency_metric_ids.oneOf.0.items.[INDEX]","typeLabel":"string"},"description":"Agent Judge metric dependencies. Omit for none; dependencies must be selected explicitly in runs.","uniqueKey":"dependency_metric_ids.oneOf.0","typeLabel":"string[]"},{"type":"null","maxItems":10,"items":{"type":"string","minLength":1},"description":"Agent Judge metric dependencies. Omit for none; dependencies must be selected explicitly in runs.","uniqueKey":"dependency_metric_ids.oneOf.1","typeLabel":"null"}],"uniqueKey":"dependency_metric_ids","typeLabel":"string[] | null"},"categories":{"type":"array","items":{"type":"string","uniqueKey":"categories.items.[INDEX]","typeLabel":"string"},"minItems":2,"maxItems":50,"description":"Categories for classification. Required for categorical metrics.","uniqueKey":"categories","typeLabel":"string[]"},"min_value":{"type":"number","description":"Minimum score. Required for numerical metrics.","uniqueKey":"min_value","typeLabel":"number"},"max_value":{"type":"number","description":"Maximum score. Required for numerical metrics.","uniqueKey":"max_value","typeLabel":"number"},"metadata_field_type":{"type":"string","description":"Field type. Required for METRIC_METADATA_FIELD.","enum":["STRING","NUMBER","BOOLEAN"],"uniqueKey":"metadata_field_type","typeLabel":"enum\u003cstring>"},"metadata_field_key":{"type":"string","description":"Metadata key. Required for METRIC_METADATA_FIELD.","uniqueKey":"metadata_field_key","typeLabel":"string"},"regex_pattern":{"type":"string","description":"Regex pattern. Required for METRIC_TRANSCRIPT_REGEX.","uniqueKey":"regex_pattern","typeLabel":"string"},"role":{"type":"string","enum":["agent","persona","user","assistant"],"description":"Speaker role filter. Aliases user and assistant are normalized on write.","uniqueKey":"role","typeLabel":"enum\u003cstring>"},"min_pause_duration_seconds":{"type":"number","minimum":0.5,"description":"Min pause duration in seconds. Required for METRIC_PAUSE_ANALYSIS.","uniqueKey":"min_pause_duration_seconds","typeLabel":"number"},"max_silence_duration_seconds":{"type":"number","exclusiveMinimum":true,"minimum":0,"uniqueKey":"max_silence_duration_seconds","typeLabel":"number"},"min_silence_gap_seconds":{"type":"number","exclusiveMinimum":true,"minimum":0,"uniqueKey":"min_silence_gap_seconds","typeLabel":"number"},"frequency_threshold":{"type":"number","exclusiveMinimum":true,"minimum":0,"uniqueKey":"frequency_threshold","typeLabel":"number"},"direction":{"type":"string","enum":["above","below"],"uniqueKey":"direction","typeLabel":"enum\u003cstring>"},"success_sentiments":{"type":"array","minItems":1,"items":{"type":"string","enum":["Neutral","Happy","Angry","Sad"],"uniqueKey":"success_sentiments.items.[INDEX]","typeLabel":"enum\u003cstring>"},"uniqueKey":"success_sentiments","typeLabel":"enum\u003cstring>[]"},"percent_above":{"type":"number","minimum":0,"maximum":100,"uniqueKey":"percent_above","typeLabel":"number"},"success_end_reasons":{"type":"array","minItems":1,"items":{"type":"string","enum":["UNKNOWN","IDLE_TIMEOUT","DURATION_LIMIT","PERSONA_DISCONNECTED","AGENT_DISCONNECTED","AGENT_END_CUE","PIPELINE_ERROR","REPETITION_LOOP","AUDIO_UPLOAD_PLAYBACK_COMPLETED","SCRIPT_COMPLETED","SCRIPT_DIVERGED"],"uniqueKey":"success_end_reasons.items.[INDEX]","typeLabel":"enum\u003cstring>"},"uniqueKey":"success_end_reasons","typeLabel":"enum\u003cstring>[]"},"observation_name":{"type":"string","minLength":1,"uniqueKey":"observation_name","typeLabel":"string"},"expected_body":{"oneOf":[{"type":"string","minLength":1,"uniqueKey":"expected_body.oneOf.0","typeLabel":"string"},{"type":"object","minProperties":1,"additionalProperties":true,"uniqueKey":"expected_body.oneOf.1","typeLabel":"object"}],"uniqueKey":"expected_body","typeLabel":"string | object"},"match_path":{"type":"string","minLength":1,"description":"Optional dot path; brackets must contain an integer index or comma-separated key=value filters.","uniqueKey":"match_path","typeLabel":"string"},"min_volume_change_for_pitch_misalignment":{"type":"number","exclusiveMinimum":true,"minimum":0,"uniqueKey":"min_volume_change_for_pitch_misalignment","typeLabel":"number"},"threshold":{"type":"integer","minimum":0,"uniqueKey":"threshold","typeLabel":"integer"},"operator":{"type":"string","enum":["\u003c","\u003c=",">",">=","==","!="],"uniqueKey":"operator","typeLabel":"enum\u003cstring>"},"ivr_flow":{"type":"object","description":"IVR flow definition (required for METRIC_IVR_FLOW_ADHERENCE). The same flow tree the\nflow builder in the Coval UI produces; binding it here makes the metric runnable\nwithout a UI step.\n","required":["start_node","nodes"],"example":{"start_node":"greeting","nodes":[{"id":"greeting","prompt":"Welcome to Acme Support. Press 1 for sales, 2 for support."},{"id":"sales","prompt":"Connecting you to our sales team.","terminal":true},{"id":"support","prompt":"Please describe your issue after the tone.","terminal":true}],"edges":[{"source":"greeting","destination":"sales","input":"1"},{"source":"greeting","destination":"support","input":"2"}]},"properties":{"start_node":{"type":"string","description":"Id of the node the flow enters first.","isRequired":true,"uniqueKey":"ivr_flow.start_node","typeLabel":"string"},"nodes":{"type":"array","minItems":1,"maxItems":512,"items":{"type":"object","required":["id","prompt"],"properties":{"id":{"type":"string","isRequired":true,"uniqueKey":"ivr_flow.nodes.items.[INDEX].id","typeLabel":"string"},"prompt":{"type":"string","maxLength":4000,"description":"Expected prompt. Numeric values, negation, menu mappings, and configured critical phrases are protected from fuzzy matching.","isRequired":true,"uniqueKey":"ivr_flow.nodes.items.[INDEX].prompt","typeLabel":"string"},"prompt_alternatives":{"type":"array","maxItems":16,"items":{"type":"string","minLength":1,"maxLength":4000,"uniqueKey":"ivr_flow.nodes.items.[INDEX].prompt_alternatives.items.[INDEX]","typeLabel":"string"},"description":"Complete approved alternative prompts.","uniqueKey":"ivr_flow.nodes.items.[INDEX].prompt_alternatives","typeLabel":"string[]"},"critical_values":{"type":"array","maxItems":32,"items":{"type":"string","minLength":1,"maxLength":4000,"uniqueKey":"ivr_flow.nodes.items.[INDEX].critical_values.items.[INDEX]","typeLabel":"string"},"description":"Domain-specific phrases whose normalized occurrence counts must be preserved.","uniqueKey":"ivr_flow.nodes.items.[INDEX].critical_values","typeLabel":"string[]"},"prompt_variables":{"type":"object","maxProperties":16,"description":"Explicit named {placeholders}. Static text matches exactly after normalization; patterns apply only within the declared slot.","additionalProperties":{"type":"object","required":["pattern"],"properties":{"pattern":{"type":"string","minLength":1,"maxLength":512,"description":"Full-match regex on normalized slot text. Each evaluation has a 50 ms deadline.","isRequired":true,"uniqueKey":"ivr_flow.nodes.items.[INDEX].prompt_variables.additionalProperties.pattern","typeLabel":"string"},"max_characters":{"type":"integer","minimum":1,"maximum":256,"default":64,"uniqueKey":"ivr_flow.nodes.items.[INDEX].prompt_variables.additionalProperties.max_characters","typeLabel":"integer"},"max_tokens":{"type":"integer","minimum":1,"maximum":32,"default":8,"uniqueKey":"ivr_flow.nodes.items.[INDEX].prompt_variables.additionalProperties.max_tokens","typeLabel":"integer"}},"uniqueKey":"ivr_flow.nodes.items.[INDEX].prompt_variables.additionalProperties","typeLabel":"object"},"uniqueKey":"ivr_flow.nodes.items.[INDEX].prompt_variables","typeLabel":"object"},"input_mode":{"type":"string","enum":["dtmf","voice","both"],"description":"Accepted caller modality. Legacy default is keypad, with voice also enabled for spoken fuzzy or explicitly voice-only branches.","uniqueKey":"ivr_flow.nodes.items.[INDEX].input_mode","typeLabel":"enum\u003cstring>"},"input_timeout_seconds":{"type":"number","minimum":0.1,"maximum":3600,"description":"Response window after an observed prompt; required for no_input edges.","uniqueKey":"ivr_flow.nodes.items.[INDEX].input_timeout_seconds","typeLabel":"number"},"voice_end_silence_seconds":{"type":"number","minimum":0.1,"maximum":3600,"default":1,"uniqueKey":"ivr_flow.nodes.items.[INDEX].voice_end_silence_seconds","typeLabel":"number"},"max_retries":{"type":"integer","minimum":0,"maximum":100,"description":"Shared allowed invalid-input/no-input recovery attempts, reset by a valid caller transition. Required for retries_exhausted edges.","uniqueKey":"ivr_flow.nodes.items.[INDEX].max_retries","typeLabel":"integer"},"capture_input_as":{"type":"string","minLength":1,"maxLength":128,"description":"Save the successful normalized input string in context under this name.","uniqueKey":"ivr_flow.nodes.items.[INDEX].capture_input_as","typeLabel":"string"},"dtmf":{"type":"object","properties":{"length":{"type":"integer","minimum":1,"maximum":256,"uniqueKey":"ivr_flow.nodes.items.[INDEX].dtmf.length","typeLabel":"integer"},"max_digits":{"type":"integer","minimum":1,"maximum":256,"default":256,"uniqueKey":"ivr_flow.nodes.items.[INDEX].dtmf.max_digits","typeLabel":"integer"},"terminator":{"type":"string","enum":["#","*"],"description":"Required when configured; removed before branch matching.","uniqueKey":"ivr_flow.nodes.items.[INDEX].dtmf.terminator","typeLabel":"enum\u003cstring>"},"inter_digit_timeout_seconds":{"type":"number","minimum":0.1,"maximum":60,"default":2,"uniqueKey":"ivr_flow.nodes.items.[INDEX].dtmf.inter_digit_timeout_seconds","typeLabel":"number"}},"uniqueKey":"ivr_flow.nodes.items.[INDEX].dtmf","typeLabel":"object"},"terminal":{"type":"boolean","description":"Marks the final node; a terminal node has no outgoing edges.","uniqueKey":"ivr_flow.nodes.items.[INDEX].terminal","typeLabel":"boolean"},"auto_advance_to":{"type":"string","description":"Node id the flow advances to without caller input.","uniqueKey":"ivr_flow.nodes.items.[INDEX].auto_advance_to","typeLabel":"string"}},"uniqueKey":"ivr_flow.nodes.items.[INDEX]","typeLabel":"object"},"isRequired":true,"uniqueKey":"ivr_flow.nodes","typeLabel":"object[]"},"context":{"type":"object","maxProperties":64,"description":"Known context for branch conditions. Values are JSON scalars; strings are limited to 256 characters. Missing facts are unknown, not inferred.","additionalProperties":{"oneOf":[{}],"uniqueKey":"ivr_flow.context.additionalProperties","typeLabel":"any"},"uniqueKey":"ivr_flow.context","typeLabel":"object"},"match_threshold":{"type":"number","minimum":0,"exclusiveMinimum":true,"maximum":1,"description":"Optional flow-level threshold. Metric execution uses metric_metadata.match_threshold (default 0.85).","uniqueKey":"ivr_flow.match_threshold","typeLabel":"number"},"edges":{"type":"array","maxItems":4096,"items":{"type":"object","required":["source","destination"],"properties":{"source":{"type":"string","isRequired":true,"uniqueKey":"ivr_flow.edges.items.[INDEX].source","typeLabel":"string"},"destination":{"type":"string","isRequired":true,"uniqueKey":"ivr_flow.edges.items.[INDEX].destination","typeLabel":"string"},"event":{"type":"string","enum":["input","no_input","invalid_input","retries_exhausted","condition"],"default":"input","description":"Non-input events omit input text. Conditional nodes cannot also have input or recovery branches. Repeat-menu behavior is an input edge back to the same node.","uniqueKey":"ivr_flow.edges.items.[INDEX].event","typeLabel":"enum\u003cstring>"},"input_mode":{"type":"string","enum":["dtmf","voice","both"],"default":"both","uniqueKey":"ivr_flow.edges.items.[INDEX].input_mode","typeLabel":"enum\u003cstring>"},"when":{"type":"object","maxProperties":16,"additionalProperties":{"oneOf":[{}],"uniqueKey":"ivr_flow.edges.items.[INDEX].when.additionalProperties","typeLabel":"any"},"description":"AND of exact JSON scalar equalities against context. Required and non-empty for condition events. Missing values produce unknown_condition. last_input is available during input selection.","uniqueKey":"ivr_flow.edges.items.[INDEX].when","typeLabel":"object"},"input":{"type":"string","minLength":1,"maxLength":256,"description":"Required for input events only. Keypad input excludes the configured terminator; spoken input is normalized. Regexes have a 50 ms execution deadline.","uniqueKey":"ivr_flow.edges.items.[INDEX].input","typeLabel":"string"},"match_type":{"type":"string","enum":["literal","regex","fuzzy"],"default":"literal","uniqueKey":"ivr_flow.edges.items.[INDEX].match_type","typeLabel":"enum\u003cstring>"}},"uniqueKey":"ivr_flow.edges.items.[INDEX]","typeLabel":"object"},"uniqueKey":"ivr_flow.edges","typeLabel":"object[]"}},"uniqueKey":"ivr_flow","typeLabel":"object"},"sql_query":{"type":"string","maxLength":50000,"description":"SQL query run against the simulation's data. Required for METRIC_SQL_FLOAT.\nThe query returns one row per timestamp with a numeric `value` and a\n`start_offset_milliseconds`; set `aggregation_method` (SUM, AVERAGE, MIN, MAX,\nor COUNT; default AVERAGE) to reduce those rows to a single value, and `unit`\nfor the reported unit. SQL metric units use exact result-unit identifiers: `s` for\nseconds, `ms` for milliseconds, `count`, `percent`, or another supported result unit.\nDo not use `seconds` or `milliseconds`. Omit `unit` for a unitless result; an\nunsupported SQL unit is rejected before the metric is saved.\n","example":"SELECT start_offset_milliseconds, latency_milliseconds AS value FROM events","uniqueKey":"sql_query","typeLabel":"string"},"aggregation_method":{"oneOf":[{"type":"string","description":"Aggregation method for custom trace values, or SUM, AVERAGE, MIN, MAX, or COUNT for METRIC_SQL_FLOAT (default AVERAGE).","uniqueKey":"aggregation_method.oneOf.0","typeLabel":"string"},{"type":"null","description":"Aggregation method for custom trace values, or SUM, AVERAGE, MIN, MAX, or COUNT for METRIC_SQL_FLOAT (default AVERAGE).","uniqueKey":"aggregation_method.oneOf.1","typeLabel":"null"}],"uniqueKey":"aggregation_method","typeLabel":"string | null"},"unit":{"oneOf":[{"type":"string","maxLength":32,"description":"Optional display unit. For METRIC_SQL_FLOAT, use a result-unit identifier such as s, ms, count, or percent; null selects a unitless result.","uniqueKey":"unit.oneOf.0","typeLabel":"string"},{"type":"null","maxLength":32,"description":"Optional display unit. For METRIC_SQL_FLOAT, use a result-unit identifier such as s, ms, count, or percent; null selects a unitless result.","uniqueKey":"unit.oneOf.1","typeLabel":"null"}],"uniqueKey":"unit","typeLabel":"string | null"},"criteria_source":{"type":"string","enum":["test_case","test_case_attribute","metric_metadata"],"description":"Where the metric reads its criteria from. Required for METRIC_COMPOSITE_EVALUATION.\n`test_case` reads a field off each test case (most commonly its expected behaviors),\n`test_case_attribute` reads from the test case's attributes, and `metric_metadata`\nuses the fixed list in `criteria`.\n","example":"test_case","uniqueKey":"criteria_source","typeLabel":"enum\u003cstring>"},"criteria_path":{"type":"string","maxLength":200,"description":"Path to the criteria on the source. Required when `criteria_source` is `test_case`\nor `test_case_attribute`.\n","example":"expected_behaviors","uniqueKey":"criteria_path","typeLabel":"string"},"criteria":{"type":"array","items":{"type":"string","uniqueKey":"criteria.items.[INDEX]","typeLabel":"string"},"description":"Literal list of criteria. Required when `criteria_source` is `metric_metadata`.","example":["The agent confirms the appointment time"],"uniqueKey":"criteria","typeLabel":"string[]"},"reporting_method":{"type":"string","enum":["percentage_of_criteria_met","count_of_criteria_met","all_criteria_met"],"description":"How per-criterion verdicts aggregate into the metric's value. Each criterion is judged\nindependently as met or not met; `percentage_of_criteria_met` scores the fraction met\namong the criteria the judge could evaluate.\n","example":"percentage_of_criteria_met","uniqueKey":"reporting_method","typeLabel":"enum\u003cstring>"},"base_prompt_template":{"type":"string","maxLength":50000,"description":"Custom prompt template used to evaluate each criterion. Include a `{criterion}`\nplaceholder; if it is omitted the criterion is appended to the prompt.\n","uniqueKey":"base_prompt_template","typeLabel":"string"},"include_traces":{"type":"boolean","description":"Inject OTel trace context into the LLM judge prompt during evaluation.\nSupported for LLM judge metric types and `METRIC_COMPOSITE_EVALUATION` (`METRIC_LLM_BINARY`,\n`METRIC_CATEGORICAL`, `METRIC_NUMERICAL_LLM_JUDGE`, `METRIC_AUDIO_LLM_BINARY`,\n`METRIC_AUDIO_LLM_CATEGORICAL`, `METRIC_AUDIO_LLM_NUMERICAL`, `METRIC_COMPOSITE_EVALUATION`).\n","uniqueKey":"include_traces","typeLabel":"boolean"},"audio_filter":{"oneOf":[{"type":"object","description":"Restrict an audio metric to part of the recording, for example only the caller with\n`{\"include\": [{\"type\": \"speaker\", \"speakers\": [\"persona\"]}]}`. Omit or send `null` to use the metric's\ndefault scope. Supported for `METRIC_ABRUPT_PITCH_CHANGES`, `METRIC_AUDIO_LLM_BINARY`, `METRIC_AUDIO_LLM_CATEGORICAL`, `METRIC_AUDIO_LLM_NUMERICAL`, `METRIC_CLIPPING_ARTIFACT`, `METRIC_CODEC_ARTIFACT`, `METRIC_CUSTOM_AGENT_NEEDS_REPROMPTING`, `METRIC_CUSTOM_AUDIO_FREQUENCY`, `METRIC_CUSTOM_AUDIO_SENTIMENT`, `METRIC_DROPOUT_ARTIFACT`, `METRIC_LOOP_DETECTION`, `METRIC_LUFS`, `METRIC_NON_EXPRESSIVE_PAUSES`, `METRIC_PAUSE_ANALYSIS`, `METRIC_PHONEME_STRETCH`, `METRIC_PITCH_VARIABILITY`, `METRIC_SPEAKING_TIME_PERCENTAGE`, `METRIC_SPECTROGRAM_PITCH_ANALYSIS`, `METRIC_SPEECH_ARTIFACT_ANOMALY`, `METRIC_SYLLABLE_RATE`, `METRIC_TERMINAL_CONTOUR`, `METRIC_TIMBRE_DRIFT`, `METRIC_VOCAL_FRY`, `METRIC_VOICE_QUALITY`, `METRIC_VOLUME`, `METRIC_VOLUME_PITCH_MISALIGNMENT`; rejected with 400 for any other type.\n","example":{"include":[{"type":"speaker","speakers":["persona"]}]},"properties":{"include":{"type":"array","maxItems":10,"items":{"type":"object","additionalProperties":false,"required":["type"],"description":"One filter, selected by `type`:\n- `speaker`: segments where any of `speakers` is speaking (`agent`, `persona` for the caller, or `music`;\n `user` and `assistant` are accepted as aliases for `persona` and `agent`).\n- `music`: segments where music plays.\n- `overlap`: segments where the agent and the caller speak at once.\n- `silence`: gaps between speech of at least `min_gap_seconds` (default 0.5).\n- `time_range`: a window of `count` seconds; `mode` is `first_n_seconds`, `last_n_seconds`, or\n `middle_n_seconds`.\n- `turn_range`: the first or last `count` turns (`mode` `first_n` or `last_n`), of `speaker` (`agent`,\n `persona`, `music`, or `any`, the default).\n","properties":{"type":{"type":"string","enum":["speaker","music","overlap","silence","time_range","turn_range"],"isRequired":true,"uniqueKey":"audio_filter.oneOf.0.include.items.[INDEX].type","typeLabel":"enum\u003cstring>"},"speakers":{"type":"array","minItems":1,"maxItems":3,"items":{"type":"string","uniqueKey":"audio_filter.oneOf.0.include.items.[INDEX].speakers.items.[INDEX]","typeLabel":"string"},"uniqueKey":"audio_filter.oneOf.0.include.items.[INDEX].speakers","typeLabel":"string[]"},"min_gap_seconds":{"type":"number","exclusiveMinimum":true,"minimum":0,"uniqueKey":"audio_filter.oneOf.0.include.items.[INDEX].min_gap_seconds","typeLabel":"number"},"mode":{"type":"string","enum":["first_n_seconds","last_n_seconds","middle_n_seconds","first_n","last_n"],"uniqueKey":"audio_filter.oneOf.0.include.items.[INDEX].mode","typeLabel":"enum\u003cstring>"},"count":{"type":"number","exclusiveMinimum":true,"minimum":0,"uniqueKey":"audio_filter.oneOf.0.include.items.[INDEX].count","typeLabel":"number"},"speaker":{"type":"string","enum":["agent","persona","music","any"],"uniqueKey":"audio_filter.oneOf.0.include.items.[INDEX].speaker","typeLabel":"enum\u003cstring>"}},"uniqueKey":"audio_filter.oneOf.0.include.items.[INDEX]","typeLabel":"object"},"uniqueKey":"audio_filter.oneOf.0.include","typeLabel":"object[]"},"include_joins":{"type":"array","maxItems":9,"description":"At most one entry fewer than `include`.","items":{"type":"string","enum":["and","or"],"uniqueKey":"audio_filter.oneOf.0.include_joins.items.[INDEX]","typeLabel":"enum\u003cstring>"},"uniqueKey":"audio_filter.oneOf.0.include_joins","typeLabel":"enum\u003cstring>[]"},"exclude":{"type":"array","maxItems":10,"items":{"type":"object","additionalProperties":false,"required":["type"],"description":"One filter, selected by `type`:\n- `speaker`: segments where any of `speakers` is speaking (`agent`, `persona` for the caller, or `music`;\n `user` and `assistant` are accepted as aliases for `persona` and `agent`).\n- `music`: segments where music plays.\n- `overlap`: segments where the agent and the caller speak at once.\n- `silence`: gaps between speech of at least `min_gap_seconds` (default 0.5).\n- `time_range`: a window of `count` seconds; `mode` is `first_n_seconds`, `last_n_seconds`, or\n `middle_n_seconds`.\n- `turn_range`: the first or last `count` turns (`mode` `first_n` or `last_n`), of `speaker` (`agent`,\n `persona`, `music`, or `any`, the default).\n","properties":{"type":{"type":"string","enum":["speaker","music","overlap","silence","time_range","turn_range"],"isRequired":true,"uniqueKey":"audio_filter.oneOf.0.exclude.items.[INDEX].type","typeLabel":"enum\u003cstring>"},"speakers":{"type":"array","minItems":1,"maxItems":3,"items":{"type":"string","uniqueKey":"audio_filter.oneOf.0.exclude.items.[INDEX].speakers.items.[INDEX]","typeLabel":"string"},"uniqueKey":"audio_filter.oneOf.0.exclude.items.[INDEX].speakers","typeLabel":"string[]"},"min_gap_seconds":{"type":"number","exclusiveMinimum":true,"minimum":0,"uniqueKey":"audio_filter.oneOf.0.exclude.items.[INDEX].min_gap_seconds","typeLabel":"number"},"mode":{"type":"string","enum":["first_n_seconds","last_n_seconds","middle_n_seconds","first_n","last_n"],"uniqueKey":"audio_filter.oneOf.0.exclude.items.[INDEX].mode","typeLabel":"enum\u003cstring>"},"count":{"type":"number","exclusiveMinimum":true,"minimum":0,"uniqueKey":"audio_filter.oneOf.0.exclude.items.[INDEX].count","typeLabel":"number"},"speaker":{"type":"string","enum":["agent","persona","music","any"],"uniqueKey":"audio_filter.oneOf.0.exclude.items.[INDEX].speaker","typeLabel":"enum\u003cstring>"}},"uniqueKey":"audio_filter.oneOf.0.exclude.items.[INDEX]","typeLabel":"object"},"uniqueKey":"audio_filter.oneOf.0.exclude","typeLabel":"object[]"},"exclude_joins":{"type":"array","maxItems":9,"description":"At most one entry fewer than `exclude`.","items":{"type":"string","enum":["and","or"],"uniqueKey":"audio_filter.oneOf.0.exclude_joins.items.[INDEX]","typeLabel":"enum\u003cstring>"},"uniqueKey":"audio_filter.oneOf.0.exclude_joins","typeLabel":"enum\u003cstring>[]"}},"additionalProperties":false,"uniqueKey":"audio_filter.oneOf.0","typeLabel":"object"},{"type":"null","uniqueKey":"audio_filter.oneOf.1","typeLabel":"null"}],"uniqueKey":"audio_filter","typeLabel":"object | null"},"runtime_config":{"type":"object","description":"Override the LLM model used for metric evaluation. If omitted, the platform default\nmodel is used. Use `GET /v1/models/metric` to list available models.\nNot supported for audio metric types (`METRIC_AUDIO_LLM_BINARY`,\n`METRIC_AUDIO_LLM_CATEGORICAL`, `METRIC_AUDIO_LLM_NUMERICAL`),\nwhich always use the platform-default audio model.\n","properties":{"model_version":{"oneOf":[{"type":"string","description":"Model identifier in canonical colon-separated format (e.g.\n`\"openai:gpt-4.1-mini-2025-04-14\"`). Use `GET /v1/models/metric` to list\navailable models and their identifiers.\n","example":"openai:gpt-4.1-mini-2025-04-14","uniqueKey":"runtime_config.model_version.oneOf.0","typeLabel":"string"},{"type":"null","description":"Model identifier in canonical colon-separated format (e.g.\n`\"openai:gpt-4.1-mini-2025-04-14\"`). Use `GET /v1/models/metric` to list\navailable models and their identifiers.\n","example":"openai:gpt-4.1-mini-2025-04-14","uniqueKey":"runtime_config.model_version.oneOf.1","typeLabel":"null"}],"uniqueKey":"runtime_config.model_version","typeLabel":"string | null"},"thinking_enabled":{"oneOf":[{"type":"boolean","description":"Enable extended thinking / reasoning mode. Only supported on select enterprise\nmodels (`supports_thinking: true` in the model list). Attempting to enable this\non an unsupported model returns `400 THINKING_NOT_SUPPORTED`.\n","uniqueKey":"runtime_config.thinking_enabled.oneOf.0","typeLabel":"boolean"},{"type":"null","description":"Enable extended thinking / reasoning mode. Only supported on select enterprise\nmodels (`supports_thinking: true` in the model list). Attempting to enable this\non an unsupported model returns `400 THINKING_NOT_SUPPORTED`.\n","uniqueKey":"runtime_config.thinking_enabled.oneOf.1","typeLabel":"null"}],"uniqueKey":"runtime_config.thinking_enabled","typeLabel":"boolean | null"}},"uniqueKey":"runtime_config","typeLabel":"object"},"target_condition":{"oneOf":[{"type":"object","description":"Target condition for metric evaluation","required":["comparison_operator","target_float"],"example":{"comparison_operator":"in","target_values":["YES"]},"properties":{"comparison_operator":{"type":"string","description":"How the metric output is compared to the target. Use a numeric operator (`eq`/`neq`/`gt`/`gte`/`lt`/`lte`) with `target_float`, or a membership operator (`in`/`nin`) with `target_values`.","enum":["eq","neq","gt","gte","lt","lte","in","nin","bt","nbt"],"isRequired":true,"uniqueKey":"target_condition.oneOf.0.comparison_operator","typeLabel":"enum\u003cstring>"},"target_float":{"oneOf":[{"type":"number","description":"Target number for the numeric operators (eq/neq/gt/gte/lt/lte).","isRequired":true,"uniqueKey":"target_condition.oneOf.0.target_float.oneOf.0","typeLabel":"number"},{"type":"null","description":"Target number for the numeric operators (eq/neq/gt/gte/lt/lte).","isRequired":true,"uniqueKey":"target_condition.oneOf.0.target_float.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"target_condition.oneOf.0.target_float","typeLabel":"number | null"},"target_values":{"oneOf":[{"type":"array","items":{"type":"string","uniqueKey":"target_condition.oneOf.0.target_values.oneOf.0.items.[INDEX]","typeLabel":"string"},"minItems":1,"maxItems":50,"description":"Target value(s) for the membership operators (in/nin), e.g. `[\"YES\"]`.","example":["YES"],"uniqueKey":"target_condition.oneOf.0.target_values.oneOf.0","typeLabel":"string[]"},{"type":"null","items":{"type":"string"},"minItems":1,"maxItems":50,"description":"Target value(s) for the membership operators (in/nin), e.g. `[\"YES\"]`.","example":["YES"],"uniqueKey":"target_condition.oneOf.0.target_values.oneOf.1","typeLabel":"null"}],"uniqueKey":"target_condition.oneOf.0.target_values","typeLabel":"string[] | null"}},"uniqueKey":"target_condition.oneOf.0","typeLabel":"object"},{"type":"object","description":"Target condition for metric evaluation","required":["comparison_operator","target_values"],"example":{"comparison_operator":"in","target_values":["YES"]},"properties":{"comparison_operator":{"type":"string","description":"How the metric output is compared to the target. Use a numeric operator (`eq`/`neq`/`gt`/`gte`/`lt`/`lte`) with `target_float`, or a membership operator (`in`/`nin`) with `target_values`.","enum":["eq","neq","gt","gte","lt","lte","in","nin","bt","nbt"],"isRequired":true,"uniqueKey":"target_condition.oneOf.1.comparison_operator","typeLabel":"enum\u003cstring>"},"target_values":{"oneOf":[{"type":"array","items":{"type":"string","uniqueKey":"target_condition.oneOf.1.target_values.oneOf.0.items.[INDEX]","typeLabel":"string"},"minItems":1,"maxItems":50,"description":"Target value(s) for the membership operators (in/nin), e.g. `[\"YES\"]`.","example":["YES"],"isRequired":true,"uniqueKey":"target_condition.oneOf.1.target_values.oneOf.0","typeLabel":"string[]"},{"type":"null","items":{"type":"string"},"minItems":1,"maxItems":50,"description":"Target value(s) for the membership operators (in/nin), e.g. `[\"YES\"]`.","example":["YES"],"isRequired":true,"uniqueKey":"target_condition.oneOf.1.target_values.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"target_condition.oneOf.1.target_values","typeLabel":"string[] | null"},"target_float":{"oneOf":[{"type":"number","description":"Target number for the numeric operators (eq/neq/gt/gte/lt/lte).","uniqueKey":"target_condition.oneOf.1.target_float.oneOf.0","typeLabel":"number"},{"type":"null","description":"Target number for the numeric operators (eq/neq/gt/gte/lt/lte).","uniqueKey":"target_condition.oneOf.1.target_float.oneOf.1","typeLabel":"null"}],"uniqueKey":"target_condition.oneOf.1.target_float","typeLabel":"number | null"}},"uniqueKey":"target_condition.oneOf.1","typeLabel":"object"}],"uniqueKey":"target_condition","typeLabel":"object"},"tags":{"oneOf":[{"type":"array","description":"Tags to associate with this metric. Null or omitted creates the metric with no tags. Pass [] for an empty tag list.","items":{"type":"string","uniqueKey":"tags.oneOf.0.items.[INDEX]","typeLabel":"string"},"example":["production"],"uniqueKey":"tags.oneOf.0","typeLabel":"string[]"},{"type":"null","description":"Tags to associate with this metric. Null or omitted creates the metric with no tags. Pass [] for an empty tag list.","items":{"type":"string"},"example":["production"],"uniqueKey":"tags.oneOf.1","typeLabel":"null"}],"uniqueKey":"tags","typeLabel":"string[] | null"},"case_insensitive":{"oneOf":[{"type":"boolean","description":"Apply case-insensitive matching (default: false)","uniqueKey":"case_insensitive.oneOf.0","typeLabel":"boolean"},{"type":"null","description":"Apply case-insensitive matching (default: false)","uniqueKey":"case_insensitive.oneOf.1","typeLabel":"null"}],"uniqueKey":"case_insensitive","typeLabel":"boolean | null"},"detection_preset":{"oneOf":[{"enum":["strict","normal","lenient"],"type":"string","description":"METRIC_ABRUPT_PITCH_CHANGES / METRIC_NON_EXPRESSIVE_PAUSES / METRIC_VOCAL_FRY preset (recommended). 'strict' flags more, 'normal' is the default, 'lenient' flags fewer. Omit to use 'normal'.","uniqueKey":"detection_preset.oneOf.0","typeLabel":"enum\u003cstring>"},{"enum":["strict","normal","lenient"],"type":"null","description":"METRIC_ABRUPT_PITCH_CHANGES / METRIC_NON_EXPRESSIVE_PAUSES / METRIC_VOCAL_FRY preset (recommended). 'strict' flags more, 'normal' is the default, 'lenient' flags fewer. Omit to use 'normal'.","uniqueKey":"detection_preset.oneOf.1","typeLabel":"null"}],"uniqueKey":"detection_preset","typeLabel":"enum\u003cstring> | null"},"harmonics_to_noise_ratio_threshold_offset_db":{"oneOf":[{"maximum":0,"exclusiveMaximum":true,"minimum":-25,"type":"number","description":"Advanced (dB): offset below baseline HNR under which a frame is fry (less negative flags more).","uniqueKey":"harmonics_to_noise_ratio_threshold_offset_db.oneOf.0","typeLabel":"number"},{"maximum":0,"exclusiveMaximum":true,"minimum":-25,"type":"null","description":"Advanced (dB): offset below baseline HNR under which a frame is fry (less negative flags more).","uniqueKey":"harmonics_to_noise_ratio_threshold_offset_db.oneOf.1","typeLabel":"null"}],"uniqueKey":"harmonics_to_noise_ratio_threshold_offset_db","typeLabel":"number | null"},"jitter_threshold_multiplier":{"oneOf":[{"minimum":1,"exclusiveMinimum":true,"type":"number","description":"Advanced: multiple of baseline jitter above which a frame is fry (lower flags more).","uniqueKey":"jitter_threshold_multiplier.oneOf.0","typeLabel":"number"},{"minimum":1,"exclusiveMinimum":true,"type":"null","description":"Advanced: multiple of baseline jitter above which a frame is fry (lower flags more).","uniqueKey":"jitter_threshold_multiplier.oneOf.1","typeLabel":"null"}],"uniqueKey":"jitter_threshold_multiplier","typeLabel":"number | null"},"loud_threshold_db":{"oneOf":[{"maximum":0,"minimum":-60,"type":"number","description":"Advanced (dBFS): level at/above which audio is flagged loud. Must exceed soft_threshold_db.","uniqueKey":"loud_threshold_db.oneOf.0","typeLabel":"number"},{"maximum":0,"minimum":-60,"type":"null","description":"Advanced (dBFS): level at/above which audio is flagged loud. Must exceed soft_threshold_db.","uniqueKey":"loud_threshold_db.oneOf.1","typeLabel":"null"}],"uniqueKey":"loud_threshold_db","typeLabel":"number | null"},"low_pitch_threshold_multiplier":{"oneOf":[{"maximum":1,"exclusiveMaximum":true,"minimum":0,"exclusiveMinimum":true,"type":"number","description":"Advanced: pitch fraction of baseline below which a frame is fry (higher flags more).","uniqueKey":"low_pitch_threshold_multiplier.oneOf.0","typeLabel":"number"},{"maximum":1,"exclusiveMaximum":true,"minimum":0,"exclusiveMinimum":true,"type":"null","description":"Advanced: pitch fraction of baseline below which a frame is fry (higher flags more).","uniqueKey":"low_pitch_threshold_multiplier.oneOf.1","typeLabel":"null"}],"uniqueKey":"low_pitch_threshold_multiplier","typeLabel":"number | null"},"mad_z_score_threshold":{"oneOf":[{"minimum":0,"exclusiveMinimum":true,"type":"number","description":"Advanced: override the preset's MAD modified z-score threshold.","uniqueKey":"mad_z_score_threshold.oneOf.0","typeLabel":"number"},{"minimum":0,"exclusiveMinimum":true,"type":"null","description":"Advanced: override the preset's MAD modified z-score threshold.","uniqueKey":"mad_z_score_threshold.oneOf.1","typeLabel":"null"}],"uniqueKey":"mad_z_score_threshold","typeLabel":"number | null"},"match_mode":{"oneOf":[{"description":"Match mode: 'presence' (default) returns 1.0 if found, 'absence' returns 1.0 if NOT found","enum":["presence","absence"],"type":"string","uniqueKey":"match_mode.oneOf.0","typeLabel":"enum\u003cstring>"},{"description":"Match mode: 'presence' (default) returns 1.0 if found, 'absence' returns 1.0 if NOT found","enum":["presence","absence"],"type":"null","uniqueKey":"match_mode.oneOf.1","typeLabel":"null"}],"uniqueKey":"match_mode","typeLabel":"enum\u003cstring> | null"},"metric_attribute":{"oneOf":[{"maxLength":200,"type":"string","description":"Span attribute key to measure (required for METRIC_CUSTOM_TRACE)","uniqueKey":"metric_attribute.oneOf.0","typeLabel":"string"},{"maxLength":200,"type":"null","description":"Span attribute key to measure (required for METRIC_CUSTOM_TRACE)","uniqueKey":"metric_attribute.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric_attribute","typeLabel":"string | null"},"metric_metadata":{"oneOf":[{"additionalProperties":true,"type":"object","description":"Derived metric config. For METRIC_DERIVED_STRICT_LOGIC: {derived_type, conditions, join_operator, met_value, not_met_value}. For METRIC_DERIVED_AGGREGATE: {derived_type, aggregation_type, parent_metric_ids, count_where_target?}.","uniqueKey":"metric_metadata.oneOf.0","typeLabel":"object"},{"additionalProperties":true,"type":"null","description":"Derived metric config. For METRIC_DERIVED_STRICT_LOGIC: {derived_type, conditions, join_operator, met_value, not_met_value}. For METRIC_DERIVED_AGGREGATE: {derived_type, aggregation_type, parent_metric_ids, count_where_target?}.","uniqueKey":"metric_metadata.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric_metadata","typeLabel":"object | null"},"min_fry_segment_seconds":{"oneOf":[{"maximum":1,"minimum":0,"type":"number","description":"Advanced (s): minimum kept fry-run duration (lower flags more).","uniqueKey":"min_fry_segment_seconds.oneOf.0","typeLabel":"number"},{"maximum":1,"minimum":0,"type":"null","description":"Advanced (s): minimum kept fry-run duration (lower flags more).","uniqueKey":"min_fry_segment_seconds.oneOf.1","typeLabel":"null"}],"uniqueKey":"min_fry_segment_seconds","typeLabel":"number | null"},"pause_detection_preset":{"oneOf":[{"enum":["strict","normal","lenient"],"type":"string","description":"Anomaly detection preset (recommended). 'strict' flags more pauses (MAD threshold 2.0), 'normal' is balanced (3.0, default), 'lenient' is conservative (4.0). Omit to use 'normal'.","uniqueKey":"pause_detection_preset.oneOf.0","typeLabel":"enum\u003cstring>"},{"enum":["strict","normal","lenient"],"type":"null","description":"Anomaly detection preset (recommended). 'strict' flags more pauses (MAD threshold 2.0), 'normal' is balanced (3.0, default), 'lenient' is conservative (4.0). Omit to use 'normal'.","uniqueKey":"pause_detection_preset.oneOf.1","typeLabel":"null"}],"uniqueKey":"pause_detection_preset","typeLabel":"enum\u003cstring> | null"},"pitch_change_threshold_hz":{"oneOf":[{"minimum":0,"exclusiveMinimum":true,"type":"number","description":"Advanced (Hz): pitch movement near a pause above which the pause counts as expressive.","uniqueKey":"pitch_change_threshold_hz.oneOf.0","typeLabel":"number"},{"minimum":0,"exclusiveMinimum":true,"type":"null","description":"Advanced (Hz): pitch movement near a pause above which the pause counts as expressive.","uniqueKey":"pitch_change_threshold_hz.oneOf.1","typeLabel":"null"}],"uniqueKey":"pitch_change_threshold_hz","typeLabel":"number | null"},"position":{"oneOf":[{"description":"Position constraint: 'any' (default), 'first', or 'last' message of the role","enum":["any","first","last"],"type":"string","uniqueKey":"position.oneOf.0","typeLabel":"enum\u003cstring>"},{"description":"Position constraint: 'any' (default), 'first', or 'last' message of the role","enum":["any","first","last"],"type":"null","uniqueKey":"position.oneOf.1","typeLabel":"null"}],"uniqueKey":"position","typeLabel":"enum\u003cstring> | null"},"significant_changes_threshold_hz":{"oneOf":[{"minimum":0,"exclusiveMinimum":true,"type":"number","description":"Advanced (Hz): pitch jump above which a change counts as abrupt (lower flags more).","uniqueKey":"significant_changes_threshold_hz.oneOf.0","typeLabel":"number"},{"minimum":0,"exclusiveMinimum":true,"type":"null","description":"Advanced (Hz): pitch jump above which a change counts as abrupt (lower flags more).","uniqueKey":"significant_changes_threshold_hz.oneOf.1","typeLabel":"null"}],"uniqueKey":"significant_changes_threshold_hz","typeLabel":"number | null"},"soft_threshold_db":{"oneOf":[{"maximum":0,"minimum":-60,"type":"number","description":"Advanced (dBFS): level at/below which audio is flagged soft.","uniqueKey":"soft_threshold_db.oneOf.0","typeLabel":"number"},{"maximum":0,"minimum":-60,"type":"null","description":"Advanced (dBFS): level at/below which audio is flagged soft.","uniqueKey":"soft_threshold_db.oneOf.1","typeLabel":"null"}],"uniqueKey":"soft_threshold_db","typeLabel":"number | null"},"span_name":{"oneOf":[{"maxLength":200,"type":"string","description":"OTel span name to query (required for METRIC_CUSTOM_TRACE)","uniqueKey":"span_name.oneOf.0","typeLabel":"string"},{"maxLength":200,"type":"null","description":"OTel span name to query (required for METRIC_CUSTOM_TRACE)","uniqueKey":"span_name.oneOf.1","typeLabel":"null"}],"uniqueKey":"span_name","typeLabel":"string | null"},"threshold_preset":{"oneOf":[{"enum":["strict","normal","lenient"],"type":"string","description":"METRIC_VOLUME threshold preset (recommended). 'strict' flags more level outliers, 'normal' is the default, 'lenient' flags fewer. Omit to use 'normal'.","uniqueKey":"threshold_preset.oneOf.0","typeLabel":"enum\u003cstring>"},{"enum":["strict","normal","lenient"],"type":"null","description":"METRIC_VOLUME threshold preset (recommended). 'strict' flags more level outliers, 'normal' is the default, 'lenient' flags fewer. Omit to use 'normal'.","uniqueKey":"threshold_preset.oneOf.1","typeLabel":"null"}],"uniqueKey":"threshold_preset","typeLabel":"enum\u003cstring> | null"},"value_source":{"oneOf":[{"type":"string","description":"Source of the aggregated value for METRIC_CUSTOM_TRACE: 'attribute' (default) reads the configured span attribute; 'duration' aggregates the span's own duration in seconds.","uniqueKey":"value_source.oneOf.0","typeLabel":"string"},{"type":"null","description":"Source of the aggregated value for METRIC_CUSTOM_TRACE: 'attribute' (default) reads the configured span attribute; 'duration' aggregates the span's own duration in seconds.","uniqueKey":"value_source.oneOf.1","typeLabel":"null"}],"uniqueKey":"value_source","typeLabel":"string | null"}},"uniqueKey":"","typeLabel":"object"},"examples":{"binary":{"title":"binary","value":{"metric_name":"Issue Resolved","description":"Did the agent resolve the customer issue?","metric_type":"METRIC_LLM_BINARY","prompt":"Did the agent successfully resolve the customer's issue?"}},"categorical":{"title":"categorical","value":{"metric_name":"Sentiment Analysis","description":"Classify conversation sentiment","metric_type":"METRIC_CATEGORICAL","prompt":"What is the overall sentiment?","categories":["positive","neutral","negative"]}},"numerical":{"title":"numerical","value":{"metric_name":"Response Quality","description":"Rate response quality 1-10","metric_type":"METRIC_NUMERICAL_LLM_JUDGE","prompt":"Rate the quality of the response","min_value":1,"max_value":10}},"metadata":{"title":"metadata","value":{"metric_name":"Satisfaction Score","description":"Extract satisfaction from metadata","metric_type":"METRIC_METADATA_FIELD","metadata_field_type":"NUMBER","metadata_field_key":"satisfaction_score"}},"regex":{"title":"regex","value":{"metric_name":"Greeting Detection","description":"Detect greeting phrases","metric_type":"METRIC_TRANSCRIPT_REGEX","regex_pattern":"(hello|hi|greetings)","role":"agent"}},"pause":{"title":"pause","value":{"metric_name":"Long Pauses","description":"Detect pauses over 2 seconds","metric_type":"METRIC_PAUSE_ANALYSIS","min_pause_duration_seconds":2}},"toolcall":{"title":"toolcall","value":{"metric_name":"Booking Tool Usage","description":"Evaluate if correct tool was called","metric_type":"METRIC_TOOLCALL","prompt":"Did the agent use the booking tool correctly?"}},"audio_binary":{"title":"audio_binary","value":{"metric_name":"Professional Tone","description":"Evaluate if agent maintains professional tone","metric_type":"METRIC_AUDIO_LLM_BINARY","prompt":"Does the agent maintain a professional tone throughout?"}},"audio_categorical":{"title":"audio_categorical","value":{"metric_name":"Speaker Emotion","description":"Classify speaker emotion from audio","metric_type":"METRIC_AUDIO_LLM_CATEGORICAL","prompt":"What emotion does the speaker convey?","categories":["calm","frustrated","happy","neutral"]}},"audio_numerical":{"title":"audio_numerical","value":{"metric_name":"Audio Clarity","description":"Rate audio clarity 1-5","metric_type":"METRIC_AUDIO_LLM_NUMERICAL","prompt":"Rate the audio clarity","min_value":1,"max_value":5}},"binary_with_traces":{"title":"binary_with_traces","value":{"metric_name":"Issue Resolved (with traces)","description":"Evaluate resolution using OTel trace context","metric_type":"METRIC_LLM_BINARY","prompt":"Did the agent resolve the customer issue?","include_traces":true}}},"exampleType":"examples"}},"exampleType":"examples"},"responses":{"3de7090a-0b44-4a3c-a525-2c79c6cf95bc":{"description":"Metric created","content":{"application/json":{"schema":{"type":"object","required":["metric"],"properties":{"metric":{"type":"object","description":"Metric resource","properties":{"created_at":{"oneOf":[{"type":"string","readOnly":true,"format":"date-time","description":"Authoring timestamp; null when unknown.","isRequired":true,"uniqueKey":"metric.created_at.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","readOnly":true,"format":"date-time","description":"Authoring timestamp; null when unknown.","isRequired":true,"uniqueKey":"metric.created_at.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.created_at","typeLabel":"string\u003cdate-time> | null"},"created_by":{"oneOf":[{"type":"string","readOnly":true,"description":"Canonical author user ID; null when unknown.","isRequired":true,"uniqueKey":"metric.created_by.oneOf.0","typeLabel":"string"},{"type":"null","readOnly":true,"description":"Canonical author user ID; null when unknown.","isRequired":true,"uniqueKey":"metric.created_by.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.created_by","typeLabel":"string | null"},"updated_at":{"oneOf":[{"type":"string","readOnly":true,"format":"date-time","description":"Authoring timestamp; null when unknown.","isRequired":true,"uniqueKey":"metric.updated_at.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","readOnly":true,"format":"date-time","description":"Authoring timestamp; null when unknown.","isRequired":true,"uniqueKey":"metric.updated_at.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.updated_at","typeLabel":"string\u003cdate-time> | null"},"updated_by":{"oneOf":[{"type":"string","readOnly":true,"description":"Canonical author user ID; null when unknown.","isRequired":true,"uniqueKey":"metric.updated_by.oneOf.0","typeLabel":"string"},{"type":"null","readOnly":true,"description":"Canonical author user ID; null when unknown.","isRequired":true,"uniqueKey":"metric.updated_by.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.updated_by","typeLabel":"string | null"},"name":{"type":"string","description":"Resource name","example":"metrics/abc123def456ghi789jklm","isRequired":true,"uniqueKey":"metric.name","typeLabel":"string"},"id":{"type":"string","description":"Metric ID","example":"abc123def456ghi789jklm","isRequired":true,"uniqueKey":"metric.id","typeLabel":"string"},"metric_name":{"type":"string","description":"Display name","example":"Customer Satisfaction","isRequired":true,"uniqueKey":"metric.metric_name","typeLabel":"string"},"description":{"type":"string","description":"Metric description","example":"Evaluates customer satisfaction","isRequired":true,"uniqueKey":"metric.description","typeLabel":"string"},"metric_type":{"type":"string","description":"Metric evaluation type.\n\n- `METRIC_AGENT_JUDGE` - Agentic binary evaluation with bounded evidence tools\n- `METRIC_AGENT_JUDGE_CATEGORICAL` - Agentic categorical evaluation with bounded evidence tools\n- `METRIC_AGENT_JUDGE_NUMERICAL` - Agentic numerical evaluation with bounded evidence tools\n- `METRIC_LLM_BINARY` - Yes/no LLM evaluation\n- `METRIC_CATEGORICAL` - Multi-class classification\n- `METRIC_NUMERICAL_LLM_JUDGE` - Numerical scoring (1-N)\n- `METRIC_AUDIO_LLM_BINARY` - Audio-based yes/no\n- `METRIC_AUDIO_LLM_CATEGORICAL` - Audio-based classification\n- `METRIC_AUDIO_LLM_NUMERICAL` - Audio-based scoring\n- `METRIC_TOOLCALL` - Tool/function call evaluation\n- `METRIC_METADATA_FIELD` - Extract metadata field\n- `METRIC_TRANSCRIPT_REGEX` - Regex pattern matching\n- `METRIC_PAUSE_ANALYSIS` - Speech pause detection\n- `METRIC_SQL_FLOAT` - Custom SQL query over the simulation's data (set `sql_query`)\n- `METRIC_PYTHON` - Tested Python metric; create and edit through the Python draft publication API.\n- `METRIC_COMPOSITE_EVALUATION` - Judges a list of criteria independently and reports how\n many were met (set `criteria_source`, and `criteria_path` or `criteria` to match)\n","enum":["METRIC_LLM_BINARY","METRIC_AGENT_JUDGE","METRIC_AGENT_JUDGE_CATEGORICAL","METRIC_CATEGORICAL","METRIC_AUDIO_LLM_BINARY","METRIC_AUDIO_LLM_CATEGORICAL","METRIC_TOOLCALL","METRIC_METADATA_FIELD","METRIC_AGENT_JUDGE_NUMERICAL","METRIC_NUMERICAL_LLM_JUDGE","METRIC_AUDIO_LLM_NUMERICAL","METRIC_TRANSCRIPT_REGEX","METRIC_USER_FRUSTRATION","METRIC_AGENT_REFUSAL","METRIC_PAUSE_ANALYSIS","METRIC_SQL_FLOAT","METRIC_PYTHON","METRIC_COMPOSITE_EVALUATION","METRIC_LLM_TTFB","METRIC_TTS_TTFB","METRIC_STT_TTFB","METRIC_LLM_TOKEN_USAGE","METRIC_TOOL_CALL_RATE","METRIC_TRACE_STT_WER","METRIC_TRACE_AUDIO_UPLOAD_STT_WER","METRIC_CUSTOM_TRACE","METRIC_VOICE_QUALITY","METRIC_PHONEME_STRETCH","METRIC_SYLLABLE_RATE","METRIC_LOOP_DETECTION","METRIC_CODEC_ARTIFACT","METRIC_CLIPPING_ARTIFACT","METRIC_DROPOUT_ARTIFACT","METRIC_TIMBRE_DRIFT","METRIC_SPEECH_ARTIFACT_ANOMALY","METRIC_PITCH_VARIABILITY","METRIC_NON_EXPRESSIVE_PAUSES","METRIC_ABRUPT_PITCH_CHANGES","METRIC_TERMINAL_CONTOUR","METRIC_LUFS","METRIC_VOLUME","METRIC_VOCAL_FRY","METRIC_DERIVED_STRICT_LOGIC","METRIC_DERIVED_AGGREGATE","METRIC_IVR_FLOW_ADHERENCE","METRIC_CUSTOM_AGENT_FAILS_TO_RESPOND","METRIC_CUSTOM_AGENT_NEEDS_REPROMPTING","METRIC_CUSTOM_AUDIO_FREQUENCY","METRIC_CUSTOM_AUDIO_SENTIMENT","METRIC_CUSTOM_END_REASON","METRIC_MATCH_EXPECTED_OUTPUT","METRIC_SPEAKING_TIME_PERCENTAGE","METRIC_SPECTROGRAM_PITCH_ANALYSIS","METRIC_VOLUME_PITCH_MISALIGNMENT","METRIC_WORDS_PER_MESSAGE_WITH_THRESHOLD"],"isRequired":true,"uniqueKey":"metric.metric_type","typeLabel":"enum\u003cstring>"},"create_time":{"type":"string","format":"date-time","description":"Creation timestamp","isRequired":true,"uniqueKey":"metric.create_time","typeLabel":"string\u003cdate-time>"},"python_metric":{"oneOf":[{"type":"object","description":"Exact authored Python configuration for the current version; null for other metric types. Revise through Python drafts, previews and publication.","required":["source","output_type","requirements"],"properties":{"source":{"type":"string","description":"Complete Python source, preserved exactly as published.","isRequired":true,"uniqueKey":"metric.python_metric.oneOf.0.source","typeLabel":"string"},"output_type":{"type":"string","enum":["number","boolean"],"isRequired":true,"uniqueKey":"metric.python_metric.oneOf.0.output_type","typeLabel":"enum\u003cstring>"},"requirements":{"additionalProperties":false,"description":"Distinguish required inputs from optional, unavailable conversation data.","properties":{"audio":{"default":false,"type":"boolean","uniqueKey":"metric.python_metric.oneOf.0.requirements.audio","typeLabel":"boolean"},"traces":{"default":false,"type":"boolean","uniqueKey":"metric.python_metric.oneOf.0.requirements.traces","typeLabel":"boolean"},"frame_tables":{"items":{"type":"string","uniqueKey":"metric.python_metric.oneOf.0.requirements.frame_tables.items.[INDEX]","typeLabel":"string"},"maxItems":32,"type":"array","uniqueKey":"metric.python_metric.oneOf.0.requirements.frame_tables","typeLabel":"string[]"}},"type":"object","isRequired":true,"uniqueKey":"metric.python_metric.oneOf.0.requirements","typeLabel":"object"},"unit":{"oneOf":[{"type":"string","description":"User-facing numeric unit; null when no unit is declared.","uniqueKey":"metric.python_metric.oneOf.0.unit.oneOf.0","typeLabel":"string"},{"type":"null","description":"User-facing numeric unit; null when no unit is declared.","uniqueKey":"metric.python_metric.oneOf.0.unit.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.python_metric.oneOf.0.unit","typeLabel":"string | null"}},"uniqueKey":"metric.python_metric.oneOf.0","typeLabel":"object"},{"type":"null","uniqueKey":"metric.python_metric.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.python_metric","typeLabel":"object | null"},"judge_mode":{"type":"string","description":"LLM Judge execution mode. Agentic mode is available for text LLM Judges only.","enum":["STANDARD","AGENTIC"],"uniqueKey":"metric.judge_mode","typeLabel":"enum\u003cstring>"},"evaluation":{"oneOf":[{"type":"object","description":"Current catalog evaluator metadata. Null means this manager has no catalog entry, not a broken metric. Use this to interpret built-in metrics whose legacy metric_type may be a compatibility fallback. A null prompt alone does not prove an unconfigured evaluator.","required":["evaluator","output_type","output_type_source","semantic_type","semantic_type_source"],"properties":{"evaluator":{"type":"string","description":"Evaluation mechanism from the catalog, such as deterministic or llm_judge.","isRequired":true,"uniqueKey":"metric.evaluation.oneOf.0.evaluator","typeLabel":"string"},"output_type":{"oneOf":[{"type":"string","description":"Catalog output type; null when the type depends on instance config.","isRequired":true,"uniqueKey":"metric.evaluation.oneOf.0.output_type.oneOf.0","typeLabel":"string"},{"type":"null","description":"Catalog output type; null when the type depends on instance config.","isRequired":true,"uniqueKey":"metric.evaluation.oneOf.0.output_type.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.evaluation.oneOf.0.output_type","typeLabel":"string | null"},"output_type_source":{"type":"string","description":"Whether the catalog output type is static or instance-dependent.","isRequired":true,"uniqueKey":"metric.evaluation.oneOf.0.output_type_source","typeLabel":"string"},"semantic_type":{"oneOf":[{"type":"string","description":"Catalog result semantics; null when instance-dependent.","isRequired":true,"uniqueKey":"metric.evaluation.oneOf.0.semantic_type.oneOf.0","typeLabel":"string"},{"type":"null","description":"Catalog result semantics; null when instance-dependent.","isRequired":true,"uniqueKey":"metric.evaluation.oneOf.0.semantic_type.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.evaluation.oneOf.0.semantic_type","typeLabel":"string | null"},"semantic_type_source":{"type":"string","description":"Whether catalog result semantics are static or instance-dependent.","isRequired":true,"uniqueKey":"metric.evaluation.oneOf.0.semantic_type_source","typeLabel":"string"}},"uniqueKey":"metric.evaluation.oneOf.0","typeLabel":"object"},{"type":"null","uniqueKey":"metric.evaluation.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.evaluation","typeLabel":"object | null"},"prompt":{"oneOf":[{"type":"string","description":"LLM evaluation prompt (for LLM-based metrics)","example":"Did the agent resolve the issue?","uniqueKey":"metric.prompt.oneOf.0","typeLabel":"string"},{"type":"null","description":"LLM evaluation prompt (for LLM-based metrics)","example":"Did the agent resolve the issue?","uniqueKey":"metric.prompt.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.prompt","typeLabel":"string | null"},"enabled_tools":{"oneOf":[{"type":"array","items":{"type":"string","description":"Evidence tool that may appear in persisted Agent Judge metric metadata.","enum":["get_transcript","search_transcript","search_transcript_regex","get_trace_spans","query_simulation_frames","get_run_context","query_jev","get_evidence_manifest","get_simulation_outcome","get_dependency_metric_outputs"],"uniqueKey":"metric.enabled_tools.oneOf.0.items.[INDEX]","typeLabel":"enum\u003cstring>"},"description":"Agentic LLM Judge tools. Null selects V1 defaults; an empty list disables all tools.","uniqueKey":"metric.enabled_tools.oneOf.0","typeLabel":"enum\u003cstring>[]"},{"type":"null","items":{"type":"string","description":"Evidence tool that may appear in persisted Agent Judge metric metadata.","enum":["get_transcript","search_transcript","search_transcript_regex","get_trace_spans","query_simulation_frames","get_run_context","query_jev","get_evidence_manifest","get_simulation_outcome","get_dependency_metric_outputs"]},"description":"Agentic LLM Judge tools. Null selects V1 defaults; an empty list disables all tools.","uniqueKey":"metric.enabled_tools.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.enabled_tools","typeLabel":"enum\u003cstring>[] | null"},"dependency_metric_ids":{"oneOf":[{"type":"array","maxItems":10,"items":{"type":"string","minLength":1,"uniqueKey":"metric.dependency_metric_ids.oneOf.0.items.[INDEX]","typeLabel":"string"},"description":"Configured Agent Judge metric dependencies. Null preserves legacy absence; an empty list means none.","uniqueKey":"metric.dependency_metric_ids.oneOf.0","typeLabel":"string[]"},{"type":"null","maxItems":10,"items":{"type":"string","minLength":1},"description":"Configured Agent Judge metric dependencies. Null preserves legacy absence; an empty list means none.","uniqueKey":"metric.dependency_metric_ids.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.dependency_metric_ids","typeLabel":"string[] | null"},"categories":{"oneOf":[{"type":"array","items":{"type":"string","uniqueKey":"metric.categories.oneOf.0.items.[INDEX]","typeLabel":"string"},"maxItems":50,"description":"Classification categories (for categorical metrics)","example":["positive","neutral","negative"],"uniqueKey":"metric.categories.oneOf.0","typeLabel":"string[]"},{"type":"null","items":{"type":"string"},"maxItems":50,"description":"Classification categories (for categorical metrics)","example":["positive","neutral","negative"],"uniqueKey":"metric.categories.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.categories","typeLabel":"string[] | null"},"min_value":{"oneOf":[{"type":"number","description":"Minimum score value (for numerical metrics)","example":1,"uniqueKey":"metric.min_value.oneOf.0","typeLabel":"number"},{"type":"null","description":"Minimum score value (for numerical metrics)","example":1,"uniqueKey":"metric.min_value.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.min_value","typeLabel":"number | null"},"max_value":{"oneOf":[{"type":"number","description":"Maximum score value (for numerical metrics)","example":10,"uniqueKey":"metric.max_value.oneOf.0","typeLabel":"number"},{"type":"null","description":"Maximum score value (for numerical metrics)","example":10,"uniqueKey":"metric.max_value.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.max_value","typeLabel":"number | null"},"metadata_field_type":{"oneOf":[{"type":"string","description":"Field type (for METRIC_METADATA_FIELD)","enum":["STRING","NUMBER","BOOLEAN"],"uniqueKey":"metric.metadata_field_type.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","uniqueKey":"metric.metadata_field_type.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.metadata_field_type","typeLabel":"enum\u003cstring> | null"},"metadata_field_key":{"oneOf":[{"type":"string","description":"Metadata key to extract (for METRIC_METADATA_FIELD)","example":"satisfaction_score","uniqueKey":"metric.metadata_field_key.oneOf.0","typeLabel":"string"},{"type":"null","description":"Metadata key to extract (for METRIC_METADATA_FIELD)","example":"satisfaction_score","uniqueKey":"metric.metadata_field_key.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.metadata_field_key","typeLabel":"string | null"},"regex_pattern":{"oneOf":[{"type":"string","description":"Regex pattern (for METRIC_TRANSCRIPT_REGEX)","example":"(hello|hi)","uniqueKey":"metric.regex_pattern.oneOf.0","typeLabel":"string"},{"type":"null","description":"Regex pattern (for METRIC_TRANSCRIPT_REGEX)","example":"(hello|hi)","uniqueKey":"metric.regex_pattern.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.regex_pattern","typeLabel":"string | null"},"role":{"oneOf":[{"type":"string","description":"Speaker role filter (for METRIC_TRANSCRIPT_REGEX)","enum":["agent","persona"],"example":"agent","uniqueKey":"metric.role.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","description":"Speaker role filter (for METRIC_TRANSCRIPT_REGEX)","enum":["agent","persona"],"example":"agent","uniqueKey":"metric.role.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.role","typeLabel":"enum\u003cstring> | null"},"min_pause_duration_seconds":{"oneOf":[{"type":"number","description":"Minimum pause duration (for METRIC_PAUSE_ANALYSIS)","example":0.5,"uniqueKey":"metric.min_pause_duration_seconds.oneOf.0","typeLabel":"number"},{"type":"null","description":"Minimum pause duration (for METRIC_PAUSE_ANALYSIS)","example":0.5,"uniqueKey":"metric.min_pause_duration_seconds.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.min_pause_duration_seconds","typeLabel":"number | null"},"max_silence_duration_seconds":{"oneOf":[{"type":"number","minimum":0,"exclusiveMinimum":true,"uniqueKey":"metric.max_silence_duration_seconds.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"exclusiveMinimum":true,"uniqueKey":"metric.max_silence_duration_seconds.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.max_silence_duration_seconds","typeLabel":"number | null"},"min_silence_gap_seconds":{"oneOf":[{"type":"number","minimum":0,"exclusiveMinimum":true,"uniqueKey":"metric.min_silence_gap_seconds.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"exclusiveMinimum":true,"uniqueKey":"metric.min_silence_gap_seconds.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.min_silence_gap_seconds","typeLabel":"number | null"},"frequency_threshold":{"oneOf":[{"type":"number","minimum":0,"exclusiveMinimum":true,"uniqueKey":"metric.frequency_threshold.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"exclusiveMinimum":true,"uniqueKey":"metric.frequency_threshold.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.frequency_threshold","typeLabel":"number | null"},"direction":{"oneOf":[{"type":"string","enum":["above","below"],"uniqueKey":"metric.direction.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","enum":["above","below"],"uniqueKey":"metric.direction.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.direction","typeLabel":"enum\u003cstring> | null"},"success_sentiments":{"oneOf":[{"type":"array","minItems":1,"items":{"type":"string","enum":["Neutral","Happy","Angry","Sad"],"uniqueKey":"metric.success_sentiments.oneOf.0.items.[INDEX]","typeLabel":"enum\u003cstring>"},"uniqueKey":"metric.success_sentiments.oneOf.0","typeLabel":"enum\u003cstring>[]"},{"type":"null","minItems":1,"items":{"type":"string","enum":["Neutral","Happy","Angry","Sad"]},"uniqueKey":"metric.success_sentiments.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.success_sentiments","typeLabel":"enum\u003cstring>[] | null"},"percent_above":{"oneOf":[{"type":"number","minimum":0,"maximum":100,"uniqueKey":"metric.percent_above.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"maximum":100,"uniqueKey":"metric.percent_above.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.percent_above","typeLabel":"number | null"},"success_end_reasons":{"oneOf":[{"type":"array","minItems":1,"items":{"type":"string","enum":["UNKNOWN","IDLE_TIMEOUT","DURATION_LIMIT","PERSONA_DISCONNECTED","AGENT_DISCONNECTED","AGENT_END_CUE","PIPELINE_ERROR","REPETITION_LOOP","AUDIO_UPLOAD_PLAYBACK_COMPLETED","SCRIPT_COMPLETED","SCRIPT_DIVERGED"],"uniqueKey":"metric.success_end_reasons.oneOf.0.items.[INDEX]","typeLabel":"enum\u003cstring>"},"uniqueKey":"metric.success_end_reasons.oneOf.0","typeLabel":"enum\u003cstring>[]"},{"type":"null","minItems":1,"items":{"type":"string","enum":["UNKNOWN","IDLE_TIMEOUT","DURATION_LIMIT","PERSONA_DISCONNECTED","AGENT_DISCONNECTED","AGENT_END_CUE","PIPELINE_ERROR","REPETITION_LOOP","AUDIO_UPLOAD_PLAYBACK_COMPLETED","SCRIPT_COMPLETED","SCRIPT_DIVERGED"]},"uniqueKey":"metric.success_end_reasons.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.success_end_reasons","typeLabel":"enum\u003cstring>[] | null"},"observation_name":{"oneOf":[{"type":"string","minLength":1,"uniqueKey":"metric.observation_name.oneOf.0","typeLabel":"string"},{"type":"null","minLength":1,"uniqueKey":"metric.observation_name.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.observation_name","typeLabel":"string | null"},"expected_body":{"oneOf":[{"type":"string","minLength":1,"uniqueKey":"metric.expected_body.oneOf.0","typeLabel":"string"},{"type":"object","minProperties":1,"additionalProperties":true,"uniqueKey":"metric.expected_body.oneOf.1","typeLabel":"object"},{"type":"null","uniqueKey":"metric.expected_body.oneOf.2","typeLabel":"null"}],"uniqueKey":"metric.expected_body","typeLabel":"string | object | null"},"match_path":{"oneOf":[{"type":"string","minLength":1,"description":"Optional dot path; brackets contain an integer index or comma-separated key=value filters.","uniqueKey":"metric.match_path.oneOf.0","typeLabel":"string"},{"type":"null","minLength":1,"description":"Optional dot path; brackets contain an integer index or comma-separated key=value filters.","uniqueKey":"metric.match_path.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.match_path","typeLabel":"string | null"},"min_volume_change_for_pitch_misalignment":{"oneOf":[{"type":"number","minimum":0,"exclusiveMinimum":true,"uniqueKey":"metric.min_volume_change_for_pitch_misalignment.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"exclusiveMinimum":true,"uniqueKey":"metric.min_volume_change_for_pitch_misalignment.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.min_volume_change_for_pitch_misalignment","typeLabel":"number | null"},"threshold":{"oneOf":[{"type":"integer","minimum":0,"uniqueKey":"metric.threshold.oneOf.0","typeLabel":"integer"},{"type":"null","minimum":0,"uniqueKey":"metric.threshold.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.threshold","typeLabel":"integer | null"},"operator":{"oneOf":[{"type":"string","enum":["\u003c","\u003c=",">",">=","==","!="],"uniqueKey":"metric.operator.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","enum":["\u003c","\u003c=",">",">=","==","!="],"uniqueKey":"metric.operator.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.operator","typeLabel":"enum\u003cstring> | null"},"ivr_flow":{"oneOf":[{"type":"object","description":"IVR flow tree bound to the metric (for METRIC_IVR_FLOW_ADHERENCE).","required":["start_node","nodes"],"example":{"start_node":"greeting","nodes":[{"id":"greeting","prompt":"Welcome to Acme Support. Press 1 for sales, 2 for support."},{"id":"sales","prompt":"Connecting you to our sales team.","terminal":true},{"id":"support","prompt":"Please describe your issue after the tone.","terminal":true}],"edges":[{"source":"greeting","destination":"sales","input":"1"},{"source":"greeting","destination":"support","input":"2"}]},"properties":{"start_node":{"type":"string","description":"Id of the node the flow enters first.","isRequired":true,"uniqueKey":"metric.ivr_flow.oneOf.0.start_node","typeLabel":"string"},"nodes":{"type":"array","minItems":1,"maxItems":512,"items":{"type":"object","required":["id","prompt"],"properties":{"id":{"type":"string","isRequired":true,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].id","typeLabel":"string"},"prompt":{"type":"string","maxLength":4000,"description":"Expected prompt. Numeric values, negation, menu mappings, and configured critical phrases are protected from fuzzy matching.","isRequired":true,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].prompt","typeLabel":"string"},"prompt_alternatives":{"type":"array","maxItems":16,"items":{"type":"string","minLength":1,"maxLength":4000,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].prompt_alternatives.items.[INDEX]","typeLabel":"string"},"description":"Complete approved alternative prompts.","uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].prompt_alternatives","typeLabel":"string[]"},"critical_values":{"type":"array","maxItems":32,"items":{"type":"string","minLength":1,"maxLength":4000,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].critical_values.items.[INDEX]","typeLabel":"string"},"description":"Domain-specific phrases whose normalized occurrence counts must be preserved.","uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].critical_values","typeLabel":"string[]"},"prompt_variables":{"type":"object","maxProperties":16,"description":"Explicit named {placeholders}. Static text matches exactly after normalization; patterns apply only within the declared slot.","additionalProperties":{"type":"object","required":["pattern"],"properties":{"pattern":{"type":"string","minLength":1,"maxLength":512,"description":"Full-match regex on normalized slot text. Each evaluation has a 50 ms deadline.","isRequired":true,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].prompt_variables.additionalProperties.pattern","typeLabel":"string"},"max_characters":{"type":"integer","minimum":1,"maximum":256,"default":64,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].prompt_variables.additionalProperties.max_characters","typeLabel":"integer"},"max_tokens":{"type":"integer","minimum":1,"maximum":32,"default":8,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].prompt_variables.additionalProperties.max_tokens","typeLabel":"integer"}},"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].prompt_variables.additionalProperties","typeLabel":"object"},"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].prompt_variables","typeLabel":"object"},"input_mode":{"type":"string","enum":["dtmf","voice","both"],"description":"Accepted caller modality. Legacy default is keypad, with voice also enabled for spoken fuzzy or explicitly voice-only branches.","uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].input_mode","typeLabel":"enum\u003cstring>"},"input_timeout_seconds":{"type":"number","minimum":0.1,"maximum":3600,"description":"Response window after an observed prompt; required for no_input edges.","uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].input_timeout_seconds","typeLabel":"number"},"voice_end_silence_seconds":{"type":"number","minimum":0.1,"maximum":3600,"default":1,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].voice_end_silence_seconds","typeLabel":"number"},"max_retries":{"type":"integer","minimum":0,"maximum":100,"description":"Shared allowed invalid-input/no-input recovery attempts, reset by a valid caller transition. Required for retries_exhausted edges.","uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].max_retries","typeLabel":"integer"},"capture_input_as":{"type":"string","minLength":1,"maxLength":128,"description":"Save the successful normalized input string in context under this name.","uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].capture_input_as","typeLabel":"string"},"dtmf":{"type":"object","properties":{"length":{"type":"integer","minimum":1,"maximum":256,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].dtmf.length","typeLabel":"integer"},"max_digits":{"type":"integer","minimum":1,"maximum":256,"default":256,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].dtmf.max_digits","typeLabel":"integer"},"terminator":{"type":"string","enum":["#","*"],"description":"Required when configured; removed before branch matching.","uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].dtmf.terminator","typeLabel":"enum\u003cstring>"},"inter_digit_timeout_seconds":{"type":"number","minimum":0.1,"maximum":60,"default":2,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].dtmf.inter_digit_timeout_seconds","typeLabel":"number"}},"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].dtmf","typeLabel":"object"},"terminal":{"type":"boolean","description":"Marks the final node; a terminal node has no outgoing edges.","uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].terminal","typeLabel":"boolean"},"auto_advance_to":{"type":"string","description":"Node id the flow advances to without caller input.","uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX].auto_advance_to","typeLabel":"string"}},"uniqueKey":"metric.ivr_flow.oneOf.0.nodes.items.[INDEX]","typeLabel":"object"},"isRequired":true,"uniqueKey":"metric.ivr_flow.oneOf.0.nodes","typeLabel":"object[]"},"context":{"type":"object","maxProperties":64,"description":"Known context for branch conditions. Values are JSON scalars; strings are limited to 256 characters. Missing facts are unknown, not inferred.","additionalProperties":{"oneOf":[{}],"uniqueKey":"metric.ivr_flow.oneOf.0.context.additionalProperties","typeLabel":"any"},"uniqueKey":"metric.ivr_flow.oneOf.0.context","typeLabel":"object"},"match_threshold":{"type":"number","minimum":0,"exclusiveMinimum":true,"maximum":1,"description":"Optional flow-level threshold. Metric execution uses metric_metadata.match_threshold (default 0.85).","uniqueKey":"metric.ivr_flow.oneOf.0.match_threshold","typeLabel":"number"},"edges":{"type":"array","maxItems":4096,"items":{"type":"object","required":["source","destination"],"properties":{"source":{"type":"string","isRequired":true,"uniqueKey":"metric.ivr_flow.oneOf.0.edges.items.[INDEX].source","typeLabel":"string"},"destination":{"type":"string","isRequired":true,"uniqueKey":"metric.ivr_flow.oneOf.0.edges.items.[INDEX].destination","typeLabel":"string"},"event":{"type":"string","enum":["input","no_input","invalid_input","retries_exhausted","condition"],"default":"input","description":"Non-input events omit input text. Conditional nodes cannot also have input or recovery branches. Repeat-menu behavior is an input edge back to the same node.","uniqueKey":"metric.ivr_flow.oneOf.0.edges.items.[INDEX].event","typeLabel":"enum\u003cstring>"},"input_mode":{"type":"string","enum":["dtmf","voice","both"],"default":"both","uniqueKey":"metric.ivr_flow.oneOf.0.edges.items.[INDEX].input_mode","typeLabel":"enum\u003cstring>"},"when":{"type":"object","maxProperties":16,"additionalProperties":{"oneOf":[{}],"uniqueKey":"metric.ivr_flow.oneOf.0.edges.items.[INDEX].when.additionalProperties","typeLabel":"any"},"description":"AND of exact JSON scalar equalities against context. Required and non-empty for condition events. Missing values produce unknown_condition. last_input is available during input selection.","uniqueKey":"metric.ivr_flow.oneOf.0.edges.items.[INDEX].when","typeLabel":"object"},"input":{"type":"string","minLength":1,"maxLength":256,"description":"Required for input events only. Keypad input excludes the configured terminator; spoken input is normalized. Regexes have a 50 ms execution deadline.","uniqueKey":"metric.ivr_flow.oneOf.0.edges.items.[INDEX].input","typeLabel":"string"},"match_type":{"type":"string","enum":["literal","regex","fuzzy"],"default":"literal","uniqueKey":"metric.ivr_flow.oneOf.0.edges.items.[INDEX].match_type","typeLabel":"enum\u003cstring>"}},"uniqueKey":"metric.ivr_flow.oneOf.0.edges.items.[INDEX]","typeLabel":"object"},"uniqueKey":"metric.ivr_flow.oneOf.0.edges","typeLabel":"object[]"}},"uniqueKey":"metric.ivr_flow.oneOf.0","typeLabel":"object"},{"type":"null","uniqueKey":"metric.ivr_flow.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.ivr_flow","typeLabel":"object | null"},"sql_query":{"oneOf":[{"type":"string","description":"SQL query that defines the metric (for METRIC_SQL_FLOAT)","example":"SELECT start_offset_milliseconds, latency_milliseconds AS value FROM events","uniqueKey":"metric.sql_query.oneOf.0","typeLabel":"string"},{"type":"null","description":"SQL query that defines the metric (for METRIC_SQL_FLOAT)","example":"SELECT start_offset_milliseconds, latency_milliseconds AS value FROM events","uniqueKey":"metric.sql_query.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.sql_query","typeLabel":"string | null"},"aggregation_method":{"oneOf":[{"type":"string","description":"Aggregation method for custom trace values, or SUM, AVERAGE, MIN, MAX, or COUNT for METRIC_SQL_FLOAT (default AVERAGE).","uniqueKey":"metric.aggregation_method.oneOf.0","typeLabel":"string"},{"type":"null","description":"Aggregation method for custom trace values, or SUM, AVERAGE, MIN, MAX, or COUNT for METRIC_SQL_FLOAT (default AVERAGE).","uniqueKey":"metric.aggregation_method.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.aggregation_method","typeLabel":"string | null"},"unit":{"oneOf":[{"type":"string","maxLength":32,"description":"Display unit. For METRIC_SQL_FLOAT, use a result-unit identifier such as s, ms, count, or percent; null means unitless.","uniqueKey":"metric.unit.oneOf.0","typeLabel":"string"},{"type":"null","maxLength":32,"description":"Display unit. For METRIC_SQL_FLOAT, use a result-unit identifier such as s, ms, count, or percent; null means unitless.","uniqueKey":"metric.unit.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.unit","typeLabel":"string | null"},"criteria_source":{"oneOf":[{"type":"string","enum":["test_case","test_case_attribute","metric_metadata"],"description":"Where a METRIC_COMPOSITE_EVALUATION metric reads its criteria from.","example":"test_case","uniqueKey":"metric.criteria_source.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","enum":["test_case","test_case_attribute","metric_metadata"],"description":"Where a METRIC_COMPOSITE_EVALUATION metric reads its criteria from.","example":"test_case","uniqueKey":"metric.criteria_source.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.criteria_source","typeLabel":"enum\u003cstring> | null"},"criteria_path":{"oneOf":[{"type":"string","description":"Path to the criteria on the source, when `criteria_source` is `test_case` or `test_case_attribute`.","example":"expected_behaviors","uniqueKey":"metric.criteria_path.oneOf.0","typeLabel":"string"},{"type":"null","description":"Path to the criteria on the source, when `criteria_source` is `test_case` or `test_case_attribute`.","example":"expected_behaviors","uniqueKey":"metric.criteria_path.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.criteria_path","typeLabel":"string | null"},"criteria":{"oneOf":[{"type":"array","items":{"type":"string","uniqueKey":"metric.criteria.oneOf.0.items.[INDEX]","typeLabel":"string"},"description":"Literal criteria, when `criteria_source` is `metric_metadata`.","example":["The agent confirms the appointment time"],"uniqueKey":"metric.criteria.oneOf.0","typeLabel":"string[]"},{"type":"null","items":{"type":"string"},"description":"Literal criteria, when `criteria_source` is `metric_metadata`.","example":["The agent confirms the appointment time"],"uniqueKey":"metric.criteria.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.criteria","typeLabel":"string[] | null"},"reporting_method":{"oneOf":[{"type":"string","enum":["percentage_of_criteria_met","count_of_criteria_met","all_criteria_met"],"description":"How the per-criterion verdicts are aggregated into the metric's value.","example":"percentage_of_criteria_met","uniqueKey":"metric.reporting_method.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","enum":["percentage_of_criteria_met","count_of_criteria_met","all_criteria_met"],"description":"How the per-criterion verdicts are aggregated into the metric's value.","example":"percentage_of_criteria_met","uniqueKey":"metric.reporting_method.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.reporting_method","typeLabel":"enum\u003cstring> | null"},"base_prompt_template":{"oneOf":[{"type":"string","description":"Custom prompt template used to evaluate each criterion.","uniqueKey":"metric.base_prompt_template.oneOf.0","typeLabel":"string"},{"type":"null","description":"Custom prompt template used to evaluate each criterion.","uniqueKey":"metric.base_prompt_template.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.base_prompt_template","typeLabel":"string | null"},"include_traces":{"oneOf":[{"type":"boolean","description":"Whether OTel trace context is injected into the LLM judge prompt during evaluation.\nSupported for LLM judge metric types and `METRIC_COMPOSITE_EVALUATION` (`METRIC_LLM_BINARY`,\n`METRIC_CATEGORICAL`, `METRIC_NUMERICAL_LLM_JUDGE`, `METRIC_AUDIO_LLM_BINARY`,\n`METRIC_AUDIO_LLM_CATEGORICAL`, `METRIC_AUDIO_LLM_NUMERICAL`, `METRIC_COMPOSITE_EVALUATION`).\n","uniqueKey":"metric.include_traces.oneOf.0","typeLabel":"boolean"},{"type":"null","description":"Whether OTel trace context is injected into the LLM judge prompt during evaluation.\nSupported for LLM judge metric types and `METRIC_COMPOSITE_EVALUATION` (`METRIC_LLM_BINARY`,\n`METRIC_CATEGORICAL`, `METRIC_NUMERICAL_LLM_JUDGE`, `METRIC_AUDIO_LLM_BINARY`,\n`METRIC_AUDIO_LLM_CATEGORICAL`, `METRIC_AUDIO_LLM_NUMERICAL`, `METRIC_COMPOSITE_EVALUATION`).\n","uniqueKey":"metric.include_traces.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.include_traces","typeLabel":"boolean | null"},"audio_filter":{"oneOf":[{"type":"object","description":"The part of the recording an audio metric analyzes, returned as stored. `null` means the metric's default\nscope. A filter saved in the metric editor is returned as saved even where it predates this schema.\n","uniqueKey":"metric.audio_filter.oneOf.0","typeLabel":"object"},{"type":"null","description":"The part of the recording an audio metric analyzes, returned as stored. `null` means the metric's default\nscope. A filter saved in the metric editor is returned as saved even where it predates this schema.\n","uniqueKey":"metric.audio_filter.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.audio_filter","typeLabel":"object | null"},"runtime_config":{"oneOf":[{"type":"object","description":"LLM model and thinking configuration for this metric.\nNot supported for audio metric types (`METRIC_AUDIO_LLM_BINARY`,\n`METRIC_AUDIO_LLM_CATEGORICAL`, `METRIC_AUDIO_LLM_NUMERICAL`),\nwhich always use the platform-default audio model.\n","properties":{"model_version":{"oneOf":[{"type":"string","description":"Model identifier in canonical colon-separated format (e.g.\n`\"openai:gpt-4.1-mini-2025-04-14\"`). Use `GET /v1/models/metric` to list\navailable models and their identifiers.\n","example":"openai:gpt-4.1-mini-2025-04-14","uniqueKey":"metric.runtime_config.oneOf.0.model_version.oneOf.0","typeLabel":"string"},{"type":"null","description":"Model identifier in canonical colon-separated format (e.g.\n`\"openai:gpt-4.1-mini-2025-04-14\"`). Use `GET /v1/models/metric` to list\navailable models and their identifiers.\n","example":"openai:gpt-4.1-mini-2025-04-14","uniqueKey":"metric.runtime_config.oneOf.0.model_version.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.runtime_config.oneOf.0.model_version","typeLabel":"string | null"},"thinking_enabled":{"oneOf":[{"type":"boolean","description":"Enable extended thinking / reasoning mode. Only supported on select enterprise\nmodels (`supports_thinking: true` in the model list). Attempting to enable this\non an unsupported model returns `400 THINKING_NOT_SUPPORTED`.\n","uniqueKey":"metric.runtime_config.oneOf.0.thinking_enabled.oneOf.0","typeLabel":"boolean"},{"type":"null","description":"Enable extended thinking / reasoning mode. Only supported on select enterprise\nmodels (`supports_thinking: true` in the model list). Attempting to enable this\non an unsupported model returns `400 THINKING_NOT_SUPPORTED`.\n","uniqueKey":"metric.runtime_config.oneOf.0.thinking_enabled.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.runtime_config.oneOf.0.thinking_enabled","typeLabel":"boolean | null"}},"uniqueKey":"metric.runtime_config.oneOf.0","typeLabel":"object"},{"type":"null","uniqueKey":"metric.runtime_config.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.runtime_config","typeLabel":"object | null"},"target_condition":{"oneOf":[{"type":"object","description":"Target condition for metric evaluation","required":["comparison_operator","target_float"],"example":{"comparison_operator":"in","target_values":["YES"]},"properties":{"comparison_operator":{"type":"string","description":"How the metric output is compared to the target. Use a numeric operator (`eq`/`neq`/`gt`/`gte`/`lt`/`lte`) with `target_float`, or a membership operator (`in`/`nin`) with `target_values`.","enum":["eq","neq","gt","gte","lt","lte","in","nin","bt","nbt"],"isRequired":true,"uniqueKey":"metric.target_condition.oneOf.0.comparison_operator","typeLabel":"enum\u003cstring>"},"target_float":{"oneOf":[{"type":"number","description":"Target number for the numeric operators (eq/neq/gt/gte/lt/lte).","isRequired":true,"uniqueKey":"metric.target_condition.oneOf.0.target_float.oneOf.0","typeLabel":"number"},{"type":"null","description":"Target number for the numeric operators (eq/neq/gt/gte/lt/lte).","isRequired":true,"uniqueKey":"metric.target_condition.oneOf.0.target_float.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.target_condition.oneOf.0.target_float","typeLabel":"number | null"},"target_values":{"oneOf":[{"type":"array","items":{"type":"string","uniqueKey":"metric.target_condition.oneOf.0.target_values.oneOf.0.items.[INDEX]","typeLabel":"string"},"minItems":1,"maxItems":50,"description":"Target value(s) for the membership operators (in/nin), e.g. `[\"YES\"]`.","example":["YES"],"uniqueKey":"metric.target_condition.oneOf.0.target_values.oneOf.0","typeLabel":"string[]"},{"type":"null","items":{"type":"string"},"minItems":1,"maxItems":50,"description":"Target value(s) for the membership operators (in/nin), e.g. `[\"YES\"]`.","example":["YES"],"uniqueKey":"metric.target_condition.oneOf.0.target_values.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.target_condition.oneOf.0.target_values","typeLabel":"string[] | null"}},"uniqueKey":"metric.target_condition.oneOf.0","typeLabel":"object"},{"type":"object","description":"Target condition for metric evaluation","required":["comparison_operator","target_values"],"example":{"comparison_operator":"in","target_values":["YES"]},"properties":{"comparison_operator":{"type":"string","description":"How the metric output is compared to the target. Use a numeric operator (`eq`/`neq`/`gt`/`gte`/`lt`/`lte`) with `target_float`, or a membership operator (`in`/`nin`) with `target_values`.","enum":["eq","neq","gt","gte","lt","lte","in","nin","bt","nbt"],"isRequired":true,"uniqueKey":"metric.target_condition.oneOf.1.comparison_operator","typeLabel":"enum\u003cstring>"},"target_values":{"oneOf":[{"type":"array","items":{"type":"string","uniqueKey":"metric.target_condition.oneOf.1.target_values.oneOf.0.items.[INDEX]","typeLabel":"string"},"minItems":1,"maxItems":50,"description":"Target value(s) for the membership operators (in/nin), e.g. `[\"YES\"]`.","example":["YES"],"isRequired":true,"uniqueKey":"metric.target_condition.oneOf.1.target_values.oneOf.0","typeLabel":"string[]"},{"type":"null","items":{"type":"string"},"minItems":1,"maxItems":50,"description":"Target value(s) for the membership operators (in/nin), e.g. `[\"YES\"]`.","example":["YES"],"isRequired":true,"uniqueKey":"metric.target_condition.oneOf.1.target_values.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.target_condition.oneOf.1.target_values","typeLabel":"string[] | null"},"target_float":{"oneOf":[{"type":"number","description":"Target number for the numeric operators (eq/neq/gt/gte/lt/lte).","uniqueKey":"metric.target_condition.oneOf.1.target_float.oneOf.0","typeLabel":"number"},{"type":"null","description":"Target number for the numeric operators (eq/neq/gt/gte/lt/lte).","uniqueKey":"metric.target_condition.oneOf.1.target_float.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.target_condition.oneOf.1.target_float","typeLabel":"number | null"}},"uniqueKey":"metric.target_condition.oneOf.1","typeLabel":"object"},{"type":"null","uniqueKey":"metric.target_condition.oneOf.2","typeLabel":"null"}],"uniqueKey":"metric.target_condition","typeLabel":"object · object · null"},"tags":{"type":"array","description":"Tags associated with this metric","items":{"type":"string","uniqueKey":"metric.tags.items.[INDEX]","typeLabel":"string"},"default":[],"example":["production","llm"],"uniqueKey":"metric.tags","typeLabel":"string[]"},"update_time":{"oneOf":[{"type":"string","format":"date-time","description":"Last update timestamp","uniqueKey":"metric.update_time.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","format":"date-time","description":"Last update timestamp","uniqueKey":"metric.update_time.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.update_time","typeLabel":"string\u003cdate-time> | null"},"current_version":{"oneOf":[{"type":"object","description":"The metric's live version. Null for pre-versioning metrics that have not yet been saved or run under the versioning system. Full history at GET /v1/metrics/{metric_id}/versions.","required":["ulid","version_number","change_type"],"properties":{"ulid":{"type":"string","description":"Identifier of the current version row (26-char ULID)","example":"01KKWQYSF737ZN6X1Q1RYX8M2D","isRequired":true,"uniqueKey":"metric.current_version.oneOf.0.ulid","typeLabel":"string"},"version_number":{"type":"integer","description":"Per-metric monotonic version number, 1-based","example":3,"isRequired":true,"uniqueKey":"metric.current_version.oneOf.0.version_number","typeLabel":"integer"},"change_type":{"type":"string","description":"How a metric version came about. A revert is a save whose new state mirrors an older version.","enum":["save","revert"],"isRequired":true,"uniqueKey":"metric.current_version.oneOf.0.change_type","typeLabel":"enum\u003cstring>"}},"uniqueKey":"metric.current_version.oneOf.0","typeLabel":"object"},{"type":"null","uniqueKey":"metric.current_version.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.current_version","typeLabel":"object | null"},"case_insensitive":{"oneOf":[{"type":"boolean","description":"Apply case-insensitive matching (default: false)","uniqueKey":"metric.case_insensitive.oneOf.0","typeLabel":"boolean"},{"type":"null","description":"Apply case-insensitive matching (default: false)","uniqueKey":"metric.case_insensitive.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.case_insensitive","typeLabel":"boolean | null"},"detection_preset":{"oneOf":[{"type":"string","description":"METRIC_ABRUPT_PITCH_CHANGES / METRIC_NON_EXPRESSIVE_PAUSES / METRIC_VOCAL_FRY preset: 'strict', 'normal', or 'lenient'.","uniqueKey":"metric.detection_preset.oneOf.0","typeLabel":"string"},{"type":"null","description":"METRIC_ABRUPT_PITCH_CHANGES / METRIC_NON_EXPRESSIVE_PAUSES / METRIC_VOCAL_FRY preset: 'strict', 'normal', or 'lenient'.","uniqueKey":"metric.detection_preset.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.detection_preset","typeLabel":"string | null"},"harmonics_to_noise_ratio_threshold_offset_db":{"oneOf":[{"type":"number","description":"Advanced override (dB): offset below baseline HNR under which a frame is fry.","uniqueKey":"metric.harmonics_to_noise_ratio_threshold_offset_db.oneOf.0","typeLabel":"number"},{"type":"null","description":"Advanced override (dB): offset below baseline HNR under which a frame is fry.","uniqueKey":"metric.harmonics_to_noise_ratio_threshold_offset_db.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.harmonics_to_noise_ratio_threshold_offset_db","typeLabel":"number | null"},"jitter_threshold_multiplier":{"oneOf":[{"type":"number","description":"Advanced override: multiple of baseline jitter above which a frame is fry.","uniqueKey":"metric.jitter_threshold_multiplier.oneOf.0","typeLabel":"number"},{"type":"null","description":"Advanced override: multiple of baseline jitter above which a frame is fry.","uniqueKey":"metric.jitter_threshold_multiplier.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.jitter_threshold_multiplier","typeLabel":"number | null"},"loud_threshold_db":{"oneOf":[{"type":"number","description":"Advanced override (dBFS): level at or above which audio is flagged loud.","uniqueKey":"metric.loud_threshold_db.oneOf.0","typeLabel":"number"},{"type":"null","description":"Advanced override (dBFS): level at or above which audio is flagged loud.","uniqueKey":"metric.loud_threshold_db.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.loud_threshold_db","typeLabel":"number | null"},"low_pitch_threshold_multiplier":{"oneOf":[{"type":"number","description":"Advanced override: pitch fraction of baseline below which a frame is fry.","uniqueKey":"metric.low_pitch_threshold_multiplier.oneOf.0","typeLabel":"number"},{"type":"null","description":"Advanced override: pitch fraction of baseline below which a frame is fry.","uniqueKey":"metric.low_pitch_threshold_multiplier.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.low_pitch_threshold_multiplier","typeLabel":"number | null"},"mad_z_score_threshold":{"oneOf":[{"type":"number","description":"Advanced override: MAD modified z-score threshold for anomalous pauses.","uniqueKey":"metric.mad_z_score_threshold.oneOf.0","typeLabel":"number"},{"type":"null","description":"Advanced override: MAD modified z-score threshold for anomalous pauses.","uniqueKey":"metric.mad_z_score_threshold.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.mad_z_score_threshold","typeLabel":"number | null"},"match_mode":{"oneOf":[{"description":"Match mode: 'presence' (default) returns 1.0 if found, 'absence' returns 1.0 if NOT found","enum":["presence","absence"],"type":"string","uniqueKey":"metric.match_mode.oneOf.0","typeLabel":"enum\u003cstring>"},{"description":"Match mode: 'presence' (default) returns 1.0 if found, 'absence' returns 1.0 if NOT found","enum":["presence","absence"],"type":"null","uniqueKey":"metric.match_mode.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.match_mode","typeLabel":"enum\u003cstring> | null"},"metric_attribute":{"oneOf":[{"maxLength":200,"type":"string","description":"Span attribute key to measure (e.g. 'metrics.ttfb', 'custom.duration_ms')","uniqueKey":"metric.metric_attribute.oneOf.0","typeLabel":"string"},{"maxLength":200,"type":"null","description":"Span attribute key to measure (e.g. 'metrics.ttfb', 'custom.duration_ms')","uniqueKey":"metric.metric_attribute.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.metric_attribute","typeLabel":"string | null"},"min_fry_segment_seconds":{"oneOf":[{"type":"number","description":"Advanced override (s): minimum kept fry-run duration.","uniqueKey":"metric.min_fry_segment_seconds.oneOf.0","typeLabel":"number"},{"type":"null","description":"Advanced override (s): minimum kept fry-run duration.","uniqueKey":"metric.min_fry_segment_seconds.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.min_fry_segment_seconds","typeLabel":"number | null"},"organization_threshold":{"oneOf":[{"type":"object","description":"Org-specific threshold for a metric","required":["id","created_at","created_by","updated_at","updated_by"],"properties":{"created_at":{"oneOf":[{"type":"string","readOnly":true,"format":"date-time","description":"Authoring timestamp; null when unknown.","isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.created_at.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","readOnly":true,"format":"date-time","description":"Authoring timestamp; null when unknown.","isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.created_at.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.created_at","typeLabel":"string\u003cdate-time> | null"},"created_by":{"oneOf":[{"type":"string","readOnly":true,"description":"Canonical author user ID; null when unknown.","isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.created_by.oneOf.0","typeLabel":"string"},{"type":"null","readOnly":true,"description":"Canonical author user ID; null when unknown.","isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.created_by.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.created_by","typeLabel":"string | null"},"updated_at":{"oneOf":[{"type":"string","readOnly":true,"format":"date-time","description":"Authoring timestamp; null when unknown.","isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.updated_at.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","readOnly":true,"format":"date-time","description":"Authoring timestamp; null when unknown.","isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.updated_at.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.updated_at","typeLabel":"string\u003cdate-time> | null"},"updated_by":{"oneOf":[{"type":"string","readOnly":true,"description":"Canonical author user ID; null when unknown.","isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.updated_by.oneOf.0","typeLabel":"string"},{"type":"null","readOnly":true,"description":"Canonical author user ID; null when unknown.","isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.updated_by.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.updated_by","typeLabel":"string | null"},"id":{"oneOf":[{"type":"string","minLength":26,"maxLength":26,"description":"26-character threshold ULID; null when no threshold is configured","example":"01JCQR8Z9PQSTNVWXY12AB34CD","isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.id.oneOf.0","typeLabel":"string"},{"type":"null","minLength":26,"maxLength":26,"description":"26-character threshold ULID; null when no threshold is configured","example":"01JCQR8Z9PQSTNVWXY12AB34CD","isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.id.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"metric.organization_threshold.oneOf.0.id","typeLabel":"string | null"},"name":{"type":"string","description":"Resource name: \"metrics/{metric_id}/threshold\"","example":"metrics/abc123def456ghi789jklm/threshold","uniqueKey":"metric.organization_threshold.oneOf.0.name","typeLabel":"string"},"comparison_operator":{"oneOf":[{"type":"string","description":"Comparison operator for thresholds","enum":["eq","neq","gt","gte","lt","lte","in","nin","bt","nbt"],"uniqueKey":"metric.organization_threshold.oneOf.0.comparison_operator.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","uniqueKey":"metric.organization_threshold.oneOf.0.comparison_operator.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.organization_threshold.oneOf.0.comparison_operator","typeLabel":"enum\u003cstring> | null"},"target_float_upper":{"oneOf":[{"type":"number","description":"Target float value (upper bound for bt/nbt, single value for others)","example":0.8,"uniqueKey":"metric.organization_threshold.oneOf.0.target_float_upper.oneOf.0","typeLabel":"number"},{"type":"null","description":"Target float value (upper bound for bt/nbt, single value for others)","example":0.8,"uniqueKey":"metric.organization_threshold.oneOf.0.target_float_upper.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.organization_threshold.oneOf.0.target_float_upper","typeLabel":"number | null"},"target_float_lower":{"oneOf":[{"type":"number","description":"Lower bound for range operators (bt/nbt)","uniqueKey":"metric.organization_threshold.oneOf.0.target_float_lower.oneOf.0","typeLabel":"number"},{"type":"null","description":"Lower bound for range operators (bt/nbt)","uniqueKey":"metric.organization_threshold.oneOf.0.target_float_lower.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.organization_threshold.oneOf.0.target_float_lower","typeLabel":"number | null"},"target_values":{"oneOf":[{"type":"array","items":{"type":"string","uniqueKey":"metric.organization_threshold.oneOf.0.target_values.oneOf.0.items.[INDEX]","typeLabel":"string"},"description":"Target values for list operators (in/nin)","uniqueKey":"metric.organization_threshold.oneOf.0.target_values.oneOf.0","typeLabel":"string[]"},{"type":"null","items":{"type":"string"},"description":"Target values for list operators (in/nin)","uniqueKey":"metric.organization_threshold.oneOf.0.target_values.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.organization_threshold.oneOf.0.target_values","typeLabel":"string[] | null"},"source":{"oneOf":[{"type":"string","description":"Source of the threshold value","enum":["manual","model"],"uniqueKey":"metric.organization_threshold.oneOf.0.source.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","uniqueKey":"metric.organization_threshold.oneOf.0.source.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.organization_threshold.oneOf.0.source","typeLabel":"enum\u003cstring> | null"},"create_time":{"oneOf":[{"type":"string","format":"date-time","uniqueKey":"metric.organization_threshold.oneOf.0.create_time.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","format":"date-time","uniqueKey":"metric.organization_threshold.oneOf.0.create_time.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.organization_threshold.oneOf.0.create_time","typeLabel":"string\u003cdate-time> | null"},"update_time":{"oneOf":[{"type":"string","format":"date-time","uniqueKey":"metric.organization_threshold.oneOf.0.update_time.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","format":"date-time","uniqueKey":"metric.organization_threshold.oneOf.0.update_time.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.organization_threshold.oneOf.0.update_time","typeLabel":"string\u003cdate-time> | null"}},"uniqueKey":"metric.organization_threshold.oneOf.0","typeLabel":"object"},{"type":"null","uniqueKey":"metric.organization_threshold.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.organization_threshold","typeLabel":"object | null"},"pause_detection_preset":{"oneOf":[{"type":"string","description":"Anomaly detection preset: 'strict', 'normal', or 'lenient'. Controls MAD threshold and minimum pause count. Advanced fields below are optional overrides.","uniqueKey":"metric.pause_detection_preset.oneOf.0","typeLabel":"string"},{"type":"null","description":"Anomaly detection preset: 'strict', 'normal', or 'lenient'. Controls MAD threshold and minimum pause count. Advanced fields below are optional overrides.","uniqueKey":"metric.pause_detection_preset.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.pause_detection_preset","typeLabel":"string | null"},"pitch_change_threshold_hz":{"oneOf":[{"type":"number","description":"Advanced override (Hz): pitch movement around a pause above which it counts as expressive.","uniqueKey":"metric.pitch_change_threshold_hz.oneOf.0","typeLabel":"number"},{"type":"null","description":"Advanced override (Hz): pitch movement around a pause above which it counts as expressive.","uniqueKey":"metric.pitch_change_threshold_hz.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.pitch_change_threshold_hz","typeLabel":"number | null"},"position":{"oneOf":[{"description":"Position constraint: 'any' (default), 'first', or 'last' message of the role","enum":["any","first","last"],"type":"string","uniqueKey":"metric.position.oneOf.0","typeLabel":"enum\u003cstring>"},{"description":"Position constraint: 'any' (default), 'first', or 'last' message of the role","enum":["any","first","last"],"type":"null","uniqueKey":"metric.position.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.position","typeLabel":"enum\u003cstring> | null"},"significant_changes_threshold_hz":{"oneOf":[{"type":"number","description":"Advanced override (Hz): pitch jump above which a change counts as abrupt.","uniqueKey":"metric.significant_changes_threshold_hz.oneOf.0","typeLabel":"number"},{"type":"null","description":"Advanced override (Hz): pitch jump above which a change counts as abrupt.","uniqueKey":"metric.significant_changes_threshold_hz.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.significant_changes_threshold_hz","typeLabel":"number | null"},"soft_threshold_db":{"oneOf":[{"type":"number","description":"Advanced override (dBFS): level at or below which audio is flagged soft.","uniqueKey":"metric.soft_threshold_db.oneOf.0","typeLabel":"number"},{"type":"null","description":"Advanced override (dBFS): level at or below which audio is flagged soft.","uniqueKey":"metric.soft_threshold_db.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.soft_threshold_db","typeLabel":"number | null"},"span_name":{"oneOf":[{"maxLength":200,"type":"string","description":"OTel span name to query (e.g. 'llm', 'tts', 'custom_span')","uniqueKey":"metric.span_name.oneOf.0","typeLabel":"string"},{"maxLength":200,"type":"null","description":"OTel span name to query (e.g. 'llm', 'tts', 'custom_span')","uniqueKey":"metric.span_name.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.span_name","typeLabel":"string | null"},"threshold_preset":{"oneOf":[{"type":"string","description":"METRIC_VOLUME threshold preset: 'strict', 'normal', or 'lenient'.","uniqueKey":"metric.threshold_preset.oneOf.0","typeLabel":"string"},{"type":"null","description":"METRIC_VOLUME threshold preset: 'strict', 'normal', or 'lenient'.","uniqueKey":"metric.threshold_preset.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.threshold_preset","typeLabel":"string | null"},"value_source":{"oneOf":[{"type":"string","description":"Source of the aggregated value: 'attribute' (default) reads the configured span attribute; 'duration' aggregates the span's own duration converted to seconds.","uniqueKey":"metric.value_source.oneOf.0","typeLabel":"string"},{"type":"null","description":"Source of the aggregated value: 'attribute' (default) reads the configured span attribute; 'duration' aggregates the span's own duration converted to seconds.","uniqueKey":"metric.value_source.oneOf.1","typeLabel":"null"}],"uniqueKey":"metric.value_source","typeLabel":"string | null"}},"required":["create_time","id","metric_name","description","name","metric_type","created_at","created_by","updated_at","updated_by"],"isRequired":true,"uniqueKey":"metric","typeLabel":"object"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"metric":{"created_at":"2023-11-07T05:31:56Z","created_by":"\u003cstring>","updated_at":"2023-11-07T05:31:56Z","updated_by":"\u003cstring>","name":"metrics/abc123def456ghi789jklm","id":"abc123def456ghi789jklm","metric_name":"Customer Satisfaction","description":"Evaluates customer satisfaction","metric_type":"METRIC_LLM_BINARY","create_time":"2023-11-07T05:31:56Z","python_metric":{"source":"\u003cstring>","output_type":"number","requirements":{"audio":false,"traces":false,"frame_tables":["\u003cstring>"]},"unit":"\u003cstring>"},"judge_mode":"STANDARD","evaluation":{"evaluator":"\u003cstring>","output_type":"\u003cstring>","output_type_source":"\u003cstring>","semantic_type":"\u003cstring>","semantic_type_source":"\u003cstring>"},"prompt":"Did the agent resolve the issue?","enabled_tools":["get_transcript"],"dependency_metric_ids":["\u003cstring>"],"categories":["positive","neutral","negative"],"min_value":1,"max_value":10,"metadata_field_type":"STRING","metadata_field_key":"satisfaction_score","regex_pattern":"(hello|hi)","role":"agent","min_pause_duration_seconds":0.5,"max_silence_duration_seconds":1,"min_silence_gap_seconds":1,"frequency_threshold":1,"direction":"above","success_sentiments":["Neutral"],"percent_above":50,"success_end_reasons":["UNKNOWN"],"observation_name":"\u003cstring>","expected_body":"\u003cstring>","match_path":"\u003cstring>","min_volume_change_for_pitch_misalignment":1,"threshold":1,"operator":"\u003c","ivr_flow":{"start_node":"greeting","nodes":[{"id":"greeting","prompt":"Welcome to Acme Support. Press 1 for sales, 2 for support."},{"id":"sales","prompt":"Connecting you to our sales team.","terminal":true},{"id":"support","prompt":"Please describe your issue after the tone.","terminal":true}],"edges":[{"source":"greeting","destination":"sales","input":"1"},{"source":"greeting","destination":"support","input":"2"}]},"sql_query":"SELECT start_offset_milliseconds, latency_milliseconds AS value FROM events","aggregation_method":"\u003cstring>","unit":"\u003cstring>","criteria_source":"test_case","criteria_path":"expected_behaviors","criteria":["The agent confirms the appointment time"],"reporting_method":"percentage_of_criteria_met","base_prompt_template":"\u003cstring>","include_traces":true,"audio_filter":{},"runtime_config":{"model_version":"openai:gpt-4.1-mini-2025-04-14","thinking_enabled":true},"target_condition":{"comparison_operator":"in","target_values":["YES"]},"tags":["production","llm"],"update_time":"2023-11-07T05:31:56Z","current_version":{"ulid":"01KKWQYSF737ZN6X1Q1RYX8M2D","version_number":3,"change_type":"save"},"case_insensitive":true,"detection_preset":"\u003cstring>","harmonics_to_noise_ratio_threshold_offset_db":123,"jitter_threshold_multiplier":123,"loud_threshold_db":123,"low_pitch_threshold_multiplier":123,"mad_z_score_threshold":123,"match_mode":"presence","metric_attribute":"\u003cstring>","min_fry_segment_seconds":123,"organization_threshold":{"created_at":"2023-11-07T05:31:56Z","created_by":"\u003cstring>","updated_at":"2023-11-07T05:31:56Z","updated_by":"\u003cstring>","id":"01JCQR8Z9PQSTNVWXY12AB34CD","name":"metrics/abc123def456ghi789jklm/threshold","comparison_operator":"eq","target_float_upper":0.8,"target_float_lower":123,"target_values":["\u003cstring>"],"source":"manual","create_time":"2023-11-07T05:31:56Z","update_time":"2023-11-07T05:31:56Z"},"pause_detection_preset":"\u003cstring>","pitch_change_threshold_hz":123,"position":"any","significant_changes_threshold_hz":123,"soft_threshold_db":123,"span_name":"\u003cstring>","threshold_preset":"\u003cstring>","value_source":"\u003cstring>"}}}},"exampleType":"generated"}},"exampleType":"generated"},"e9117918-eb29-4c5f-9797-d7966fbed993":{"description":"Validation error","content":{"application/json":{"schema":{"type":"object","required":["error"],"properties":{"error":{"type":"object","required":["code","message"],"properties":{"code":{"type":"string","enum":["INVALID_ARGUMENT","UNAUTHENTICATED","PERMISSION_DENIED","NOT_FOUND","ALREADY_EXISTS","INTERNAL"],"isRequired":true,"uniqueKey":"error.code","typeLabel":"enum\u003cstring>"},"message":{"type":"string","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"details":{"type":"array","items":{"type":"object","properties":{"field":{"oneOf":[{"type":"string","uniqueKey":"error.details.items.[INDEX].field.oneOf.0","typeLabel":"string"},{"type":"null","uniqueKey":"error.details.items.[INDEX].field.oneOf.1","typeLabel":"null"}],"uniqueKey":"error.details.items.[INDEX].field","typeLabel":"string | null"},"description":{"type":"string","uniqueKey":"error.details.items.[INDEX].description","typeLabel":"string"}},"uniqueKey":"error.details.items.[INDEX]","typeLabel":"object"},"uniqueKey":"error.details","typeLabel":"object[]"}},"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"uniqueKey":"","typeLabel":"object"},"examples":{"missingField":{"title":"missingField","value":{"error":{"code":"INVALID_ARGUMENT","message":"Missing required field","details":[{"field":"prompt","description":"Required for metric type METRIC_LLM_BINARY"}]}}},"unknownModel":{"title":"unknownModel","value":{"error":{"code":"INVALID_ARGUMENT","message":"'openai:gpt-999' is not a supported model. Use GET /v1/models/metric to list available models.","details":[{"field":"runtime_config.model_version","description":"UNKNOWN_MODEL"}]}}},"thinkingNotSupported":{"title":"thinkingNotSupported","value":{"error":{"code":"INVALID_ARGUMENT","message":"Model 'openai:gpt-4.1-mini-2025-04-14' does not support thinking mode.","details":[{"field":"runtime_config.thinking_enabled","description":"THINKING_NOT_SUPPORTED"}]}}}},"exampleType":"examples"}},"exampleType":"examples"},"f587ed56-5f7b-473b-a357-26c87f3329da":{"description":"Authentication failed","content":{"application/json":{"schema":{"type":"object","required":["error"],"properties":{"error":{"type":"object","required":["code","message"],"properties":{"code":{"type":"string","enum":["INVALID_ARGUMENT","UNAUTHENTICATED","PERMISSION_DENIED","NOT_FOUND","ALREADY_EXISTS","INTERNAL"],"isRequired":true,"uniqueKey":"error.code","typeLabel":"enum\u003cstring>"},"message":{"type":"string","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"details":{"type":"array","items":{"type":"object","properties":{"field":{"oneOf":[{"type":"string","uniqueKey":"error.details.items.[INDEX].field.oneOf.0","typeLabel":"string"},{"type":"null","uniqueKey":"error.details.items.[INDEX].field.oneOf.1","typeLabel":"null"}],"uniqueKey":"error.details.items.[INDEX].field","typeLabel":"string | null"},"description":{"type":"string","uniqueKey":"error.details.items.[INDEX].description","typeLabel":"string"}},"uniqueKey":"error.details.items.[INDEX]","typeLabel":"object"},"uniqueKey":"error.details","typeLabel":"object[]"}},"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"uniqueKey":"","typeLabel":"object"},"example":{"error":{"code":"UNAUTHENTICATED","message":"Authentication failed","details":[{"field":"X-API-Key","description":"Invalid or missing API key"}]}},"examples":{"Example":{"title":"Example","value":{"error":{"code":"UNAUTHENTICATED","message":"Authentication failed","details":[{"field":"X-API-Key","description":"Invalid or missing API key"}]}}}},"exampleType":"examples"}},"exampleType":"examples"},"4c71537d-a063-4a7a-94c7-f34472b447fd":{"description":"Enterprise model access denied","content":{"application/json":{"schema":{"type":"object","required":["error"],"properties":{"error":{"type":"object","required":["code","message"],"properties":{"code":{"type":"string","enum":["INVALID_ARGUMENT","UNAUTHENTICATED","PERMISSION_DENIED","NOT_FOUND","ALREADY_EXISTS","INTERNAL"],"isRequired":true,"uniqueKey":"error.code","typeLabel":"enum\u003cstring>"},"message":{"type":"string","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"details":{"type":"array","items":{"type":"object","properties":{"field":{"oneOf":[{"type":"string","uniqueKey":"error.details.items.[INDEX].field.oneOf.0","typeLabel":"string"},{"type":"null","uniqueKey":"error.details.items.[INDEX].field.oneOf.1","typeLabel":"null"}],"uniqueKey":"error.details.items.[INDEX].field","typeLabel":"string | null"},"description":{"type":"string","uniqueKey":"error.details.items.[INDEX].description","typeLabel":"string"}},"uniqueKey":"error.details.items.[INDEX]","typeLabel":"object"},"uniqueKey":"error.details","typeLabel":"object[]"}},"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"uniqueKey":"","typeLabel":"object"},"example":{"error":{"code":"PERMISSION_DENIED","message":"Model 'anthropic:claude-sonnet-4-6' requires an Enterprise plan. Contact sales@coval.dev to upgrade.","details":[{"field":"runtime_config.model_version","description":"MODEL_TIER_ACCESS_DENIED"}]}},"examples":{"Example":{"title":"Example","value":{"error":{"code":"PERMISSION_DENIED","message":"Model 'anthropic:claude-sonnet-4-6' requires an Enterprise plan. Contact sales@coval.dev to upgrade.","details":[{"field":"runtime_config.model_version","description":"MODEL_TIER_ACCESS_DENIED"}]}}}},"exampleType":"examples"}},"exampleType":"examples"},"45b1d55f-12a1-498d-9e3b-4d969f45a93d":{"description":"FAILED_PRECONDITION. Built-in metric registrations require operator repair.\nContact Coval support; retrying without repairing the configuration will fail again.\nError details identify metric_registration_configuration_invalid; global metrics are not restored as a fallback.\n","content":{"application/json":{"schema":{"type":"object","required":["error"],"properties":{"error":{"type":"object","required":["code","message"],"properties":{"code":{"type":"string","enum":["INVALID_ARGUMENT","UNAUTHENTICATED","PERMISSION_DENIED","NOT_FOUND","ALREADY_EXISTS","INTERNAL"],"isRequired":true,"uniqueKey":"error.code","typeLabel":"enum\u003cstring>"},"message":{"type":"string","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"details":{"type":"array","items":{"type":"object","properties":{"field":{"oneOf":[{"type":"string","uniqueKey":"error.details.items.[INDEX].field.oneOf.0","typeLabel":"string"},{"type":"null","uniqueKey":"error.details.items.[INDEX].field.oneOf.1","typeLabel":"null"}],"uniqueKey":"error.details.items.[INDEX].field","typeLabel":"string | null"},"description":{"type":"string","uniqueKey":"error.details.items.[INDEX].description","typeLabel":"string"}},"uniqueKey":"error.details.items.[INDEX]","typeLabel":"object"},"uniqueKey":"error.details","typeLabel":"object[]"}},"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":{"code":"INVALID_ARGUMENT","message":"\u003cstring>","details":[{"field":"\u003cstring>","description":"\u003cstring>"}]}}}},"exampleType":"generated"}},"exampleType":"generated"},"633b7d84-8699-43ef-99e5-2b95b8e9fa3d":{"description":"Internal server error","content":{"application/json":{"schema":{"type":"object","required":["error"],"properties":{"error":{"type":"object","required":["code","message"],"properties":{"code":{"type":"string","enum":["INVALID_ARGUMENT","UNAUTHENTICATED","PERMISSION_DENIED","NOT_FOUND","ALREADY_EXISTS","INTERNAL"],"isRequired":true,"uniqueKey":"error.code","typeLabel":"enum\u003cstring>"},"message":{"type":"string","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"details":{"type":"array","items":{"type":"object","properties":{"field":{"oneOf":[{"type":"string","uniqueKey":"error.details.items.[INDEX].field.oneOf.0","typeLabel":"string"},{"type":"null","uniqueKey":"error.details.items.[INDEX].field.oneOf.1","typeLabel":"null"}],"uniqueKey":"error.details.items.[INDEX].field","typeLabel":"string | null"},"description":{"type":"string","uniqueKey":"error.details.items.[INDEX].description","typeLabel":"string"}},"uniqueKey":"error.details.items.[INDEX]","typeLabel":"object"},"uniqueKey":"error.details","typeLabel":"object[]"}},"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"uniqueKey":"","typeLabel":"object"},"example":{"error":{"code":"INTERNAL","message":"Internal server error"}},"examples":{"Example":{"title":"Example","value":{"error":{"code":"INTERNAL","message":"Internal server error"}}}},"exampleType":"examples"}},"exampleType":"examples"}},"security":{"a6fa891c-1ec3-4fb3-a6fc-1efc2c818884":{"ApiKeyAuth":{"type":"apiKey","in":"header","name":"X-API-Key","description":"API key for authentication","scopes":[],"schemeName":"ApiKeyAuth"}}},"servers":{"4658aeec-795e-4e4f-8e70-0c80ef6d48fa":{"url":"https://api.coval.dev/v1","description":"Production API"}},"processedSecurityOptions":[{"schemes":[{"scheme":{"type":"apiKey","in":"header","name":"X-API-Key","description":"API key for authentication","scopes":[],"schemeName":"ApiKeyAuth"},"schema":{"title":"X-API-Key","type":"string","description":"API key for authentication","isRequired":true,"typeLabel":"string","deprecated":false},"schemeName":"ApiKeyAuth","name":"X-API-Key"}],"title":"ApiKeyAuth"}]},"originalFileLocation":"api-reference/v1/metrics-v1.yaml"},"subdomain":"coval-2e18a559","siteName":"Coval Documentation","title":"Create metric - Coval Documentation","navMaps":{"firstHrefInVersion":{},"firstHrefInLanguage":{}},"lastModified":"2026-10-29T21:58:23.310Z","originalFileLocation":"api-reference/metrics/create-metric.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"light\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Create a new custom evaluation metric. Required fields vary by metric type: | Metric Type | Required Fields | |-------------|-----------------| | METRIC_AGENT_JUDGE | prompt | | METRIC_AGENT_JUDGE_CATEGORICAL | prompt, categories | | METRIC_AGENT_JUDGE_NUMERICAL | prompt, min_value, max_value | | METRIC_LLM_BINARY | prompt | | METRIC_CATEGORICAL | prompt, categories | | METRIC_NUMERICAL_LLM_JUDGE | prompt, min_value, max_value | | METRIC_AUDIO_LLM_BINARY | prompt | | METRIC_AUDIO_LLM_CATEGORICAL | prompt, categories | | METRIC_AUDIO_LLM_NUMERICAL | prompt, min_value, max_value | | METRIC_TOOLCALL | prompt | | METRIC_METADATA_FIELD | metadata_field_type, metadata_field_key | | METRIC_TRANSCRIPT_REGEX | regex_pattern | | METRIC_PAUSE_ANALYSIS | min_pause_duration_seconds |\">\u003cmeta data-mint-head name=\"application-name\" content=\"Coval Documentation\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/coval-2e18a559/vkF1RiAFS33s2q-K/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/coval-2e18a559/vkF1RiAFS33s2q-K/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/coval-2e18a559/vkF1RiAFS33s2q-K/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/coval-2e18a559/vkF1RiAFS33s2q-K/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/coval-2e18a559/vkF1RiAFS33s2q-K/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/coval-2e18a559/vkF1RiAFS33s2q-K/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/coval-2e18a559/vkF1RiAFS33s2q-K/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/coval-2e18a559/vkF1RiAFS33s2q-K/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/coval-2e18a559/vkF1RiAFS33s2q-K/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Create metric - Coval Documentation\">\u003cmeta data-mint-head property=\"og:description\" content=\"Create a new custom evaluation metric. Required fields vary by metric type: | Metric Type | Required Fields | |-------------|-----------------| | METRIC_AGENT_JUDGE | prompt | | METRIC_AGENT_JUDGE_CATEGORICAL | prompt, categories | | METRIC_AGENT_JUDGE_NUMERICAL | prompt, min_value, max_value | | METRIC_LLM_BINARY | prompt | | METRIC_CATEGORICAL | prompt, categories | | METRIC_NUMERICAL_LLM_JUDGE | prompt, min_value, max_value | | METRIC_AUDIO_LLM_BINARY | prompt | | METRIC_AUDIO_LLM_CATEGORICAL | prompt, categories | | METRIC_AUDIO_LLM_NUMERICAL | prompt, min_value, max_value | | METRIC_TOOLCALL | prompt | | METRIC_METADATA_FIELD | metadata_field_type, metadata_field_key | | METRIC_TRANSCRIPT_REGEX | regex_pattern | | METRIC_PAUSE_ANALYSIS | min_pause_duration_seconds |\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"Coval Documentation\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.coval.ai/api-reference/metrics/create-metric\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://coval-2e18a559.mintlify.site/_mintlify/api/og/v2?division=Metrics\u0026amp;title=Create+metric\u0026amp;description=Create+a+new+custom+evaluation+metric.%0A%0A**Required+fields+vary+by+metric+type%3A**%0A%0A%7C+Metric+Type+%7C+Required+Fields+%7C%0A%7C-------------%7C-----------------%7C%0A%7C+METRIC_A\u0026amp;theme=f645eaefd7d12d5c3c37070d\u0026amp;signature=878261a7908f06d85b6f375bf4686729f434a683d56ec336ebf10b1ed64e960e\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Create metric - Coval Documentation\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Create a new custom evaluation metric. Required fields vary by metric type: | Metric Type | Required Fields | |-------------|-----------------| | METRIC_AGENT_JUDGE | prompt | | METRIC_AGENT_JUDGE_CATEGORICAL | prompt, categories | | METRIC_AGENT_JUDGE_NUMERICAL | prompt, min_value, max_value | | METRIC_LLM_BINARY | prompt | | METRIC_CATEGORICAL | prompt, categories | | METRIC_NUMERICAL_LLM_JUDGE | prompt, min_value, max_value | | METRIC_AUDIO_LLM_BINARY | prompt | | METRIC_AUDIO_LLM_CATEGORICAL | prompt, categories | | METRIC_AUDIO_LLM_NUMERICAL | prompt, min_value, max_value | | METRIC_TOOLCALL | prompt | | METRIC_METADATA_FIELD | metadata_field_type, metadata_field_key | | METRIC_TRANSCRIPT_REGEX | regex_pattern | | METRIC_PAUSE_ANALYSIS | min_pause_duration_seconds |\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://coval-2e18a559.mintlify.site/_mintlify/api/og/v2?division=Metrics\u0026amp;title=Create+metric\u0026amp;description=Create+a+new+custom+evaluation+metric.%0A%0A**Required+fields+vary+by+metric+type%3A**%0A%0A%7C+Metric+Type+%7C+Required+Fields+%7C%0A%7C-------------%7C-----------------%7C%0A%7C+METRIC_A\u0026amp;theme=f645eaefd7d12d5c3c37070d\u0026amp;signature=878261a7908f06d85b6f375bf4686729f434a683d56ec336ebf10b1ed64e960e\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/coval-2e18a559/vkF1RiAFS33s2q-K/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"Coval Documentation\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#000000\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.coval.ai/api-reference/metrics/create-metric\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/api-reference/metrics/create-metric.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.coval.ai/#organization\",\"name\":\"Coval Documentation\",\"url\":\"https://docs.coval.ai\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/coval-2e18a559/Notp6opJUCHArykW/logo/coval-logo-vector.svg?fit=max\u0026auto=format\u0026n=Notp6opJUCHArykW\u0026q=85\u0026s=f08474458e9c5bbff1e1d7119fdc8012\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.coval.ai#website\",\"name\":\"Coval Documentation\",\"url\":\"https://docs.coval.ai\",\"publisher\":{\"@id\":\"https://docs.coval.ai/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.coval.ai/api-reference/metrics/create-metric#webpage\",\"url\":\"https://docs.coval.ai/api-reference/metrics/create-metric\",\"name\":\"Create metric\",\"description\":\"Create a new custom evaluation metric. Required fields vary by metric type: | Metric Type | Required Fields | |-------------|-----------------| | METRIC_AGENT_JUDGE | prompt | | METRIC_AGENT_JUDGE_CATEGORICAL | prompt, categories | | METRIC_AGENT_JUDGE_NUMERICAL | prompt, min_value, max_value | | METRIC_LLM_BINARY | prompt | | METRIC_CATEGORICAL | prompt, categories | | METRIC_NUMERICAL_LLM_JUDGE | prompt, min_value, max_value | | METRIC_AUDIO_LLM_BINARY | prompt | | METRIC_AUDIO_LLM_CATEGORICAL | prompt, categories | | METRIC_AUDIO_LLM_NUMERICAL | prompt, min_value, max_value | | METRIC_TOOLCALL | prompt | | METRIC_METADATA_FIELD | metadata_field_type, metadata_field_key | | METRIC_TRANSCRIPT_REGEX | regex_pattern | | METRIC_PAUSE_ANALYSIS | min_pause_duration_seconds |\",\"dateModified\":\"2026-10-29T21:58:23.310Z\",\"isPartOf\":{\"@id\":\"https://docs.coval.ai#website\"},\"breadcrumb\":{\"@id\":\"https://docs.coval.ai/api-reference/metrics/create-metric#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.coval.ai/api-reference/metrics/create-metric#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Metrics\",\"item\":\"https://docs.coval.ai/api-reference/metrics/list-metrics\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Create metric\",\"item\":\"https://docs.coval.ai/api-reference/metrics/create-metric\"}]},{\"@type\":[\"TechArticle\",\"APIReference\"],\"@id\":\"https://docs.coval.ai/api-reference/metrics/create-metric#apireference\",\"headline\":\"Create metric\",\"name\":\"Create metric\",\"description\":\"Create a new custom evaluation metric. Required fields vary by metric type: | Metric Type | Required Fields | |-------------|-----------------| | METRIC_AGENT_JUDGE | prompt | | METRIC_AGENT_JUDGE_CATEGORICAL | prompt, categories | | METRIC_AGENT_JUDGE_NUMERICAL | prompt, min_value, max_value | | METRIC_LLM_BINARY | prompt | | METRIC_CATEGORICAL | prompt, categories | | METRIC_NUMERICAL_LLM_JUDGE | prompt, min_value, max_value | | METRIC_AUDIO_LLM_BINARY | prompt | | METRIC_AUDIO_LLM_CATEGORICAL | prompt, categories | | METRIC_AUDIO_LLM_NUMERICAL | prompt, min_value, max_value | | METRIC_TOOLCALL | prompt | | METRIC_METADATA_FIELD | metadata_field_type, metadata_field_key | | METRIC_TRANSCRIPT_REGEX | regex_pattern | | METRIC_PAUSE_ANALYSIS | min_pause_duration_seconds |\",\"url\":\"https://docs.coval.ai/api-reference/metrics/create-metric\",\"mainEntityOfPage\":{\"@id\":\"https://docs.coval.ai/api-reference/metrics/create-metric#webpage\"},\"dateModified\":\"2026-10-29T21:58:23.310Z\",\"publisher\":{\"@id\":\"https://docs.coval.ai/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.coval.ai#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"Coval Documentation\",\"creator\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","siteName":"Coval Documentation","nav":{"global":null,"tabs":[{"tab":"Home","icon":"house","pages":[{"title":"Home","href":"/welcome"}]},{"tab":"API","icon":"square-terminal","groups":[{"group":"API","pages":[{"sidebarTitle":"Introduction","title":"API Reference","href":"/api-reference/v1/introduction"},{"title":"Conversation API compatibility","sidebarTitle":"Conversation compatibility","href":"/api-reference/v1/conversations-compatibility"}]},{"group":"Runs","icon":"play","pages":[{"title":"List runs","deprecated":null,"version":null,"openapi":"/api-reference/v1/runs-v1.yaml get /runs","href":"/api-reference/runs/list-runs"},{"title":"Launch run","deprecated":null,"version":null,"openapi":"/api-reference/v1/runs-v1.yaml post /runs","href":"/api-reference/runs/launch-run"},{"title":"Get run","deprecated":null,"version":null,"openapi":"/api-reference/v1/runs-v1.yaml get /runs/{run_id}","href":"/api-reference/runs/get-run"},{"title":"Update run","deprecated":null,"version":null,"openapi":"/api-reference/v1/runs-v1.yaml patch /runs/{run_id}","href":"/api-reference/runs/update-run"},{"title":"Delete run","deprecated":null,"version":null,"openapi":"/api-reference/v1/runs-v1.yaml delete /runs/{run_id}","href":"/api-reference/runs/delete-run"},{"title":"List run tag values","deprecated":null,"version":null,"openapi":"/api-reference/v1/runs-v1.yaml get /runs/tags","href":"/api-reference/runs/list-run-tag-values"}]},{"group":"Simulated Conversations","icon":"rocket","pages":[{"title":"List simulations","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml get /conversations/simulated","href":"/api-reference/simulated-conversations/list-simulations"},{"title":"Get simulation","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml get /conversations/simulated/{simulation_id}","href":"/api-reference/simulated-conversations/get-simulation"},{"title":"Update simulation","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml patch /conversations/simulated/{simulation_id}","href":"/api-reference/simulated-conversations/update-simulation"},{"title":"Delete or cancel simulation","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml delete /conversations/simulated/{simulation_id}","href":"/api-reference/simulated-conversations/delete-or-cancel-simulation"},{"title":"Batch rerun metrics","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml post /conversations/simulated:rerunMetrics","href":"/api-reference/simulated-conversations/batch-rerun-metrics"},{"title":"Discover SDK WebSocket connection","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml get /simulations/{simulation_id}/connect","href":"/api-reference/simulated-conversations/discover-sdk-websocket-connection"},{"title":"Rerun a simulation","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml post /conversations/simulated/{simulation_id}/resimulate","href":"/api-reference/simulated-conversations/rerun-a-simulation"},{"title":"Get audio file URL","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml get /conversations/simulated/{simulation_id}/audio","href":"/api-reference/simulated-conversations/get-audio-file-url"},{"title":"Retrieve a named simulation attribute","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml get /simulations/{simulation_id}/attributes/{attribute_name}","href":"/api-reference/simulated-conversations/retrieve-a-named-simulation-attribute"},{"group":"Metric Outputs","pages":[{"title":"List metrics","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml get /conversations/simulated/{simulation_id}/metrics","href":"/api-reference/metric-outputs/list-metrics"},{"title":"Get simulation metric output(s)","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml get /conversations/simulated/{simulation_id}/metrics/{metric_output_id}","href":"/api-reference/metric-outputs/get-simulation-metric-outputs"}]},{"group":"Conversation Comments","pages":[{"title":"List simulated conversation comments","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml get /conversations/simulated/{conversation_id}/comments","href":"/api-reference/conversation-comments/list-simulated-conversation-comments"},{"title":"Get a simulated conversation comment","deprecated":null,"version":null,"openapi":"/api-reference/v1/simulations-v1.yaml get /conversations/simulated/{conversation_id}/comments/{comment_id}","href":"/api-reference/conversation-comments/get-a-simulated-conversation-comment"}]}]},{"group":"Uploaded Conversations","icon":"messages","pages":[{"title":"Upload audio","deprecated":null,"version":null,"openapi":"/api-reference/v1/conversations-v1.yaml post /audio:upload","href":"/api-reference/audio/upload-audio"},{"title":"Submit conversation for evaluation","deprecated":null,"version":null,"openapi":"/api-reference/v1/conversations-v1.yaml post /conversations/uploaded:submit","href":"/api-reference/uploaded-conversations/submit-conversation-for-evaluation"},{"title":"List conversations","deprecated":null,"version":null,"openapi":"/api-reference/v1/conversations-v1.yaml get /conversations/uploaded","href":"/api-reference/uploaded-conversations/list-conversations"},{"title":"Get conversation details","deprecated":null,"version":null,"openapi":"/api-reference/v1/conversations-v1.yaml get /conversations/uploaded/{conversation_id}","href":"/api-reference/uploaded-conversations/get-conversation-details"},{"title":"Attach audio, add metadata, or assign an agent to a conversation","deprecated":null,"version":null,"openapi":"/api-reference/v1/conversations-v1.yaml patch /conversations/uploaded/{conversation_id}","href":"/api-reference/uploaded-conversations/attach-audio-add-metadata-or-assign-an-agent-to-a-conversation"},{"title":"Delete or cancel conversation","deprecated":null,"version":null,"openapi":"/api-reference/v1/conversations-v1.yaml delete /conversations/uploaded/{conversation_id}","href":"/api-reference/uploaded-conversations/delete-or-cancel-conversation"},{"title":"Get conversation audio","deprecated":null,"version":null,"openapi":"/api-reference/v1/conversations-v1.yaml get /conversations/uploaded/{conversation_id}/audio","href":"/api-reference/audio/get-conversation-audio"},{"group":"Metrics","pages":[{"title":"List conversation metrics","deprecated":null,"version":null,"openapi":"/api-reference/v1/conversations-v1.yaml get /conversations/uploaded/{conversation_id}/metrics","href":"/api-reference/uploaded-conversations/list-conversation-metrics"},{"title":"Get conversation metric output(s)","deprecated":null,"version":null,"openapi":"/api-reference/v1/conversations-v1.yaml get /conversations/uploaded/{conversation_id}/metrics/{metric_output_id}","href":"/api-reference/uploaded-conversations/get-conversation-metric-outputs"}]},{"group":"Conversation Comments","pages":[{"title":"List uploaded conversation comments","deprecated":null,"version":null,"openapi":"/api-reference/v1/conversations-v1.yaml get /conversations/uploaded/{conversation_id}/comments","href":"/api-reference/conversation-comments/list-uploaded-conversation-comments"},{"title":"Get a uploaded conversation comment","deprecated":null,"version":null,"openapi":"/api-reference/v1/conversations-v1.yaml get /conversations/uploaded/{conversation_id}/comments/{comment_id}","href":"/api-reference/conversation-comments/get-a-uploaded-conversation-comment"}]}]},{"group":"Agents","icon":"robot","pages":[{"title":"List agents","deprecated":null,"version":null,"openapi":"/api-reference/v1/agents-v1.yaml get /agents","href":"/api-reference/agents/list-agents"},{"title":"Connect an agent","deprecated":null,"version":null,"openapi":"/api-reference/v1/agents-v1.yaml post /agents","href":"/api-reference/agents/connect-an-agent"},{"title":"Get agent","deprecated":null,"version":null,"openapi":"/api-reference/v1/agents-v1.yaml get /agents/{agent_id}","href":"/api-reference/agents/get-agent"},{"title":"Update agent","deprecated":null,"version":null,"openapi":"/api-reference/v1/agents-v1.yaml patch /agents/{agent_id}","href":"/api-reference/agents/update-agent"},{"title":"Delete agent","deprecated":null,"version":null,"openapi":"/api-reference/v1/agents-v1.yaml delete /agents/{agent_id}","href":"/api-reference/agents/delete-agent"},{"title":"Duplicate an agent","deprecated":null,"version":null,"openapi":"/api-reference/v1/agents-v1.yaml post /agents/{agent_id}/duplicate","href":"/api-reference/agents/duplicate-an-agent"},{"group":"Versions","pages":[{"title":"List agent versions","deprecated":null,"version":null,"openapi":"/api-reference/v1/agents-v1.yaml get /agents/{agent_id}/versions","href":"/api-reference/agents/list-agent-versions"},{"title":"Revert agent version","deprecated":null,"version":null,"openapi":"/api-reference/v1/agents-v1.yaml post /agents/{agent_id}/versions/{version_id}/revert","href":"/api-reference/agents/revert-agent-version"}]}]},{"group":"Mutations","icon":"flask-vial","pages":[{"title":"List mutations","deprecated":null,"version":null,"openapi":"/api-reference/v1/mutations-v1.yaml get /agents/{agent_id}/mutations","href":"/api-reference/mutations/list-mutations"},{"title":"Create mutation","deprecated":null,"version":null,"openapi":"/api-reference/v1/mutations-v1.yaml post /agents/{agent_id}/mutations","href":"/api-reference/mutations/create-mutation"},{"title":"Get mutation","deprecated":null,"version":null,"openapi":"/api-reference/v1/mutations-v1.yaml get /agents/{agent_id}/mutations/{mutation_id}","href":"/api-reference/mutations/get-mutation"},{"title":"Update mutation","deprecated":null,"version":null,"openapi":"/api-reference/v1/mutations-v1.yaml patch /agents/{agent_id}/mutations/{mutation_id}","href":"/api-reference/mutations/update-mutation"},{"title":"Delete mutation","deprecated":null,"version":null,"openapi":"/api-reference/v1/mutations-v1.yaml delete /agents/{agent_id}/mutations/{mutation_id}","href":"/api-reference/mutations/delete-mutation"}]},{"group":"Test Sets","icon":"database","pages":[{"title":"List test sets","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml get /test-sets","href":"/api-reference/test-sets/list-test-sets"},{"title":"Create test set","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml post /test-sets","href":"/api-reference/test-sets/create-test-set"},{"title":"Get test set","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml get /test-sets/{test_set_id}","href":"/api-reference/test-sets/get-test-set"},{"title":"Update test set","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml patch /test-sets/{test_set_id}","href":"/api-reference/test-sets/update-test-set"},{"title":"Delete test set","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml delete /test-sets/{test_set_id}","href":"/api-reference/test-sets/delete-test-set"},{"title":"Duplicate a test set","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml post /test-sets/{test_set_id}/duplicate","href":"/api-reference/test-sets/duplicate-a-test-set"},{"title":"Associate agents with a test set","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml post /test-sets/{test_set_id}/agents:add","href":"/api-reference/test-sets/associate-agents-with-a-test-set"},{"title":"List test set records","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml get /test-sets/{test_set_id}/records","href":"/api-reference/test-sets/list-test-set-records"},{"group":"Versions","pages":[{"title":"List test set versions","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml get /test-sets/{test_set_id}/versions","href":"/api-reference/test-sets/list-test-set-versions"},{"title":"Revert test set version","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml post /test-sets/{test_set_id}/versions/{version_id}/revert","href":"/api-reference/test-sets/revert-test-set-version"}]},{"group":"Agents","pages":[{"title":"List associated agents","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml get /test-sets/{test_set_id}/agents","href":"/api-reference/test-sets/list-associated-agents"},{"title":"Remove an agent association","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-sets-v1.yaml delete /test-sets/{test_set_id}/agents/{agent_id}","href":"/api-reference/test-sets/remove-an-agent-association"}]}]},{"group":"Test Cases","icon":"flask","pages":[{"title":"List test cases","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-cases-v1.yaml get /test-cases","href":"/api-reference/test-cases/list-test-cases"},{"title":"Create test case","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-cases-v1.yaml post /test-cases","href":"/api-reference/test-cases/create-test-case"},{"title":"Get test case","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-cases-v1.yaml get /test-cases/{test_case_id}","href":"/api-reference/test-cases/get-test-case"},{"title":"Update test case","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-cases-v1.yaml patch /test-cases/{test_case_id}","href":"/api-reference/test-cases/update-test-case"},{"title":"Delete test case","deprecated":null,"version":null,"openapi":"/api-reference/v1/test-cases-v1.yaml delete /test-cases/{test_case_id}","href":"/api-reference/test-cases/delete-test-case"}]},{"group":"Personas","icon":"circle-user","pages":[{"title":"List personas","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml get /personas","href":"/api-reference/personas/list-personas"},{"title":"Create persona","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml post /personas","href":"/api-reference/personas/create-persona"},{"title":"Get persona","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml get /personas/{persona_id}","href":"/api-reference/personas/get-persona"},{"title":"Update persona","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml patch /personas/{persona_id}","href":"/api-reference/personas/update-persona"},{"title":"Delete persona","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml delete /personas/{persona_id}","href":"/api-reference/personas/delete-persona"},{"title":"List background sounds","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml get /personas/background-sounds","href":"/api-reference/personas/list-background-sounds"},{"title":"Create background sound upload","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml post /personas/background-sounds","href":"/api-reference/personas/create-background-sound-upload"},{"title":"Update background sound","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml patch /personas/background-sounds/{background_sound_id}","href":"/api-reference/personas/update-background-sound"},{"title":"List phone number mappings","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml get /personas/phone-numbers","href":"/api-reference/personas/list-phone-number-mappings"},{"title":"List available voices","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml get /personas/voices","href":"/api-reference/personas/list-available-voices"},{"title":"List persona tag values","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml get /personas/tags","href":"/api-reference/personas/list-persona-tag-values"},{"title":"Duplicate a persona","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml post /personas/{persona_id}/duplicate","href":"/api-reference/personas/duplicate-a-persona"},{"title":"Complete background sound upload","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml post /personas/background-sounds/{background_sound_id}/complete","href":"/api-reference/personas/complete-background-sound-upload"},{"group":"Versions","pages":[{"title":"List persona versions","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml get /personas/{persona_id}/versions","href":"/api-reference/personas/list-persona-versions"},{"title":"Revert persona version","deprecated":null,"version":null,"openapi":"/api-reference/v1/personas-v1.yaml post /personas/{persona_id}/versions/{version_id}/revert","href":"/api-reference/personas/revert-persona-version"}]}]},{"group":"Metrics","icon":"ballot-check","pages":[{"title":"List metrics","description":"Retrieve a paginated list of evaluation metrics.","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics","href":"/api-reference/metrics/list-metrics"},{"title":"Create metric","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics","href":"/api-reference/metrics/create-metric"},{"title":"List metric template variables","description":"Return the catalog of `{{prefix.key}}` template variables that can be\nused in LLM-judge metric prompts (e.g. `{{agent.company_name}}`,\n`{{expected_output.balance}}`, `{{customer_metadata.call_id}}`). These are\nsubstituted at evaluation time from the agent's `attributes`, the test\ncase's `expected_output`, and the run's `customer_metadata` respectively.\n","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/template-variables","href":"/api-reference/metrics/list-metric-template-variables"},{"title":"Get metric","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/{metric_id}","href":"/api-reference/metrics/get-metric"},{"title":"Update metric","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml patch /metrics/{metric_id}","href":"/api-reference/metrics/update-metric"},{"title":"Delete metric","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml delete /metrics/{metric_id}","href":"/api-reference/metrics/delete-metric"},{"title":"List recently-deleted metrics","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/recently-deleted","href":"/api-reference/metrics/list-recently-deleted-metrics"},{"title":"List available metric models","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /models/metric","href":"/api-reference/metrics/list-available-metric-models"},{"title":"List metric flows","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/flows","href":"/api-reference/metrics/list-metric-flows"},{"title":"Create a metric flow","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics/flows","href":"/api-reference/metrics/create-a-metric-flow"},{"title":"Update a metric flow","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml patch /metrics/flows/{flow_id}","href":"/api-reference/metrics/update-a-metric-flow"},{"title":"Delete a metric flow","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml delete /metrics/flows/{flow_id}","href":"/api-reference/metrics/delete-a-metric-flow"},{"title":"Test a draft SQL metric query","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics/sql:test","href":"/api-reference/metrics/test-a-draft-sql-metric-query"},{"title":"Get the SQL metric schema","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/sql-schema","href":"/api-reference/metrics/get-the-sql-metric-schema"},{"title":"Batch-get metric outputs by ULID","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics/outputs:batchGet","href":"/api-reference/metrics/batch-get-metric-outputs-by-ulid"},{"title":"List metric tag values","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/tags","href":"/api-reference/metrics/list-metric-tag-values"},{"title":"Duplicate a metric","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics/{metric_id}/duplicate","href":"/api-reference/metrics/duplicate-a-metric"},{"title":"Restore a recently-deleted metric","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics/{metric_id}/restore","href":"/api-reference/metrics/restore-a-recently-deleted-metric"},{"title":"Trigger test metric execution","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics/{metric_id}/test","href":"/api-reference/metrics/trigger-test-metric-execution"},{"group":"Versions","pages":[{"title":"List metric versions","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/{metric_id}/versions","href":"/api-reference/metrics/list-metric-versions"},{"title":"Revert metric version","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics/{metric_id}/versions/{version_id}/revert","href":"/api-reference/metrics/revert-metric-version"}]},{"group":"Thresholds","pages":[{"title":"List metric thresholds","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/{metric_id}/thresholds","href":"/api-reference/metrics/list-metric-thresholds"},{"title":"Create metric threshold","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics/{metric_id}/thresholds","href":"/api-reference/metrics/create-metric-threshold"},{"title":"Get metric threshold","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/{metric_id}/threshold","href":"/api-reference/metrics/get-metric-threshold"},{"title":"Update metric threshold","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml patch /metrics/{metric_id}/threshold","href":"/api-reference/metrics/update-metric-threshold"},{"title":"Delete metric threshold","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml delete /metrics/{metric_id}/thresholds/{threshold_id}","href":"/api-reference/metrics/delete-metric-threshold"}]},{"group":"Baselines","pages":[{"title":"List metric baselines","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/{metric_id}/baselines","href":"/api-reference/metrics/list-metric-baselines"},{"title":"Create metric baseline","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml post /metrics/{metric_id}/baselines","href":"/api-reference/metrics/create-metric-baseline"},{"title":"Get metric baseline","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/{metric_id}/baselines/{baseline_id}","href":"/api-reference/metrics/get-metric-baseline"},{"title":"Update metric baseline","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml patch /metrics/{metric_id}/baselines/{baseline_id}","href":"/api-reference/metrics/update-metric-baseline"},{"title":"Delete metric baseline","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml delete /metrics/{metric_id}/baselines/{baseline_id}","href":"/api-reference/metrics/delete-metric-baseline"},{"title":"Get baseline history","deprecated":null,"version":null,"openapi":"/api-reference/v1/metrics-v1.yaml get /metrics/{metric_id}/baselines/{baseline_id}/history","href":"/api-reference/metrics/get-baseline-history"}]}]},{"group":"Run Templates","icon":"puzzle-piece","pages":[{"title":"List run templates","deprecated":null,"version":null,"openapi":"/api-reference/v1/run-templates-v1.yaml get /run-templates","href":"/api-reference/run-templates/list-run-templates"},{"title":"Create run template","deprecated":null,"version":null,"openapi":"/api-reference/v1/run-templates-v1.yaml post /run-templates","href":"/api-reference/run-templates/create-run-template"},{"title":"Get run template","deprecated":null,"version":null,"openapi":"/api-reference/v1/run-templates-v1.yaml get /run-templates/{run_template_id}","href":"/api-reference/run-templates/get-run-template"},{"title":"Update run template","deprecated":null,"version":null,"openapi":"/api-reference/v1/run-templates-v1.yaml patch /run-templates/{run_template_id}","href":"/api-reference/run-templates/update-run-template"},{"title":"Delete run template","deprecated":null,"version":null,"openapi":"/api-reference/v1/run-templates-v1.yaml delete /run-templates/{run_template_id}","href":"/api-reference/run-templates/delete-run-template"}]},{"group":"Scheduled Runs","icon":"clock","pages":[{"title":"List scheduled runs","deprecated":null,"version":null,"openapi":"/api-reference/v1/scheduled-runs-v1.yaml get /scheduled-runs","href":"/api-reference/scheduled-runs/list-scheduled-runs"},{"title":"Create scheduled run","deprecated":null,"version":null,"openapi":"/api-reference/v1/scheduled-runs-v1.yaml post /scheduled-runs","href":"/api-reference/scheduled-runs/create-scheduled-run"},{"title":"Get scheduled run","deprecated":null,"version":null,"openapi":"/api-reference/v1/scheduled-runs-v1.yaml get /scheduled-runs/{scheduled_run_id}","href":"/api-reference/scheduled-runs/get-scheduled-run"},{"title":"Update scheduled run","deprecated":null,"version":null,"openapi":"/api-reference/v1/scheduled-runs-v1.yaml patch /scheduled-runs/{scheduled_run_id}","href":"/api-reference/scheduled-runs/update-scheduled-run"},{"title":"Delete scheduled run","deprecated":null,"version":null,"openapi":"/api-reference/v1/scheduled-runs-v1.yaml delete /scheduled-runs/{scheduled_run_id}","href":"/api-reference/scheduled-runs/delete-scheduled-run"},{"title":"List a scheduled run's produced runs","deprecated":null,"version":null,"openapi":"/api-reference/v1/scheduled-runs-v1.yaml get /scheduled-runs/{scheduled_run_id}/runs","href":"/api-reference/scheduled-runs/list-a-scheduled-runs-produced-runs"}]},{"group":"Reviews","icon":"clipboard-check","pages":[{"title":"List review annotations","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml get /review-annotations","href":"/api-reference/review-annotations/list-review-annotations"},{"title":"Create review annotation","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml post /review-annotations","href":"/api-reference/review-annotations/create-review-annotation"},{"title":"Get review annotation","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml get /review-annotations/{annotation_id}","href":"/api-reference/review-annotations/get-review-annotation"},{"title":"Update review annotation","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml patch /review-annotations/{annotation_id}","href":"/api-reference/review-annotations/update-review-annotation"},{"title":"Delete review annotation","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml delete /review-annotations/{annotation_id}","href":"/api-reference/review-annotations/delete-review-annotation"},{"title":"List review projects","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml get /review-projects","href":"/api-reference/review-projects/list-review-projects"},{"title":"Create review project","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml post /review-projects","href":"/api-reference/review-projects/create-review-project"},{"title":"Get review project","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml get /review-projects/{project_id}","href":"/api-reference/review-projects/get-review-project"},{"title":"Update review project","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml patch /review-projects/{project_id}","href":"/api-reference/review-projects/update-review-project"},{"title":"Delete review project","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml delete /review-projects/{project_id}","href":"/api-reference/review-projects/delete-review-project"},{"title":"Get review disagreement state","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml post /review-projects/disagreement-state","href":"/api-reference/review-projects/get-review-disagreement-state"},{"title":"Get metric health stats","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml get /review-annotations/metric-health-stats","href":"/api-reference/review-annotations/get-metric-health-stats"},{"title":"Get annotations with metric outputs","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml post /review-annotations:withMetricOutputs","href":"/api-reference/review-annotations/get-annotations-with-metric-outputs"},{"title":"Get project metric agreement","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml get /review-projects/{project_id}/metric-agreement","href":"/api-reference/review-projects/get-project-metric-agreement"},{"title":"Get review project progress","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml get /review-projects/{project_id}/progress","href":"/api-reference/review-projects/get-review-project-progress"},{"title":"Get project insights","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml get /review-projects/{project_id}/insights","href":"/api-reference/review-projects/get-project-insights"},{"title":"Complete a review-project conversation","deprecated":null,"version":null,"openapi":"/api-reference/v1/reviews-v1.yaml post /review-projects/{project_id}/complete-conversation","href":"/api-reference/review-projects/complete-a-review-project-conversation"}]},{"group":"Dashboards","icon":"chart-line","pages":[{"title":"List dashboards","deprecated":null,"version":null,"openapi":"/api-reference/v1/dashboards-v1.yaml get /dashboards","href":"/api-reference/dashboards/list-dashboards"},{"title":"Create dashboard","deprecated":null,"version":null,"openapi":"/api-reference/v1/dashboards-v1.yaml post /dashboards","href":"/api-reference/dashboards/create-dashboard"},{"title":"Get dashboard","deprecated":null,"version":null,"openapi":"/api-reference/v1/dashboards-v1.yaml get /dashboards/{dashboard_id}","href":"/api-reference/dashboards/get-dashboard"},{"title":"Update dashboard","deprecated":null,"version":null,"openapi":"/api-reference/v1/dashboards-v1.yaml patch /dashboards/{dashboard_id}","href":"/api-reference/dashboards/update-dashboard"},{"title":"Delete dashboard","deprecated":null,"version":null,"openapi":"/api-reference/v1/dashboards-v1.yaml delete /dashboards/{dashboard_id}","href":"/api-reference/dashboards/delete-dashboard"},{"group":"Widgets","pages":[{"title":"List widgets","deprecated":null,"version":null,"openapi":"/api-reference/v1/dashboards-v1.yaml get /dashboards/{dashboard_id}/widgets","href":"/api-reference/widgets/list-widgets"},{"title":"Create widget","deprecated":null,"version":null,"openapi":"/api-reference/v1/dashboards-v1.yaml post /dashboards/{dashboard_id}/widgets","href":"/api-reference/widgets/create-widget"},{"title":"Get widget","deprecated":null,"version":null,"openapi":"/api-reference/v1/dashboards-v1.yaml get /dashboards/{dashboard_id}/widgets/{widget_id}","href":"/api-reference/widgets/get-widget"},{"title":"Update widget","deprecated":null,"version":null,"openapi":"/api-reference/v1/dashboards-v1.yaml patch /dashboards/{dashboard_id}/widgets/{widget_id}","href":"/api-reference/widgets/update-widget"},{"title":"Delete widget","deprecated":null,"version":null,"openapi":"/api-reference/v1/dashboards-v1.yaml delete /dashboards/{dashboard_id}/widgets/{widget_id}","href":"/api-reference/widgets/delete-widget"}]}]},{"group":"Alerts","icon":"bell","pages":[{"title":"List alerts","deprecated":null,"version":null,"openapi":"/api-reference/v1/alerts-v1.yaml get /alerts","href":"/api-reference/alerts/list-alerts"},{"title":"Create an alert","deprecated":null,"version":null,"openapi":"/api-reference/v1/alerts-v1.yaml post /alerts","href":"/api-reference/alerts/create-an-alert"},{"title":"Get an alert","deprecated":null,"version":null,"openapi":"/api-reference/v1/alerts-v1.yaml get /alerts/{alert_id}","href":"/api-reference/alerts/get-an-alert"},{"title":"Update an alert","deprecated":null,"version":null,"openapi":"/api-reference/v1/alerts-v1.yaml patch /alerts/{alert_id}","href":"/api-reference/alerts/update-an-alert"},{"title":"Delete an alert","deprecated":null,"version":null,"openapi":"/api-reference/v1/alerts-v1.yaml delete /alerts/{alert_id}","href":"/api-reference/alerts/delete-an-alert"},{"title":"List alert events","deprecated":null,"version":null,"openapi":"/api-reference/v1/alerts-v1.yaml get /alerts/{alert_id}/events","href":"/api-reference/alert-events/list-alert-events"},{"title":"Test evaluate an alert","deprecated":null,"version":null,"openapi":"/api-reference/v1/alerts-v1.yaml post /alerts/{alert_id}/test-evaluate","href":"/api-reference/alerts/test-evaluate-an-alert"}]},{"group":"Reports","icon":"file-chart-column","pages":[{"title":"List reports","deprecated":null,"version":null,"openapi":"/api-reference/v1/reports-v1.yaml get /reports","href":"/api-reference/reports/list-reports"},{"title":"Create report","deprecated":null,"version":null,"openapi":"/api-reference/v1/reports-v1.yaml post /reports","href":"/api-reference/reports/create-report"},{"title":"Get report","deprecated":null,"version":null,"openapi":"/api-reference/v1/reports-v1.yaml get /reports/{report_id}","href":"/api-reference/reports/get-report"},{"title":"Update report","deprecated":null,"version":null,"openapi":"/api-reference/v1/reports-v1.yaml patch /reports/{report_id}","href":"/api-reference/reports/update-report"},{"title":"Delete report","deprecated":null,"version":null,"openapi":"/api-reference/v1/reports-v1.yaml delete /reports/{report_id}","href":"/api-reference/reports/delete-report"},{"title":"List report rows","deprecated":null,"version":null,"openapi":"/api-reference/v1/reports-v1.yaml get /reports/{report_id}/rows","href":"/api-reference/reports/list-report-rows"}]},{"group":"Tags","icon":"tags","pages":[{"title":"List tags","deprecated":null,"version":null,"openapi":"/api-reference/v1/tags-v1.yaml get /tags","href":"/api-reference/tags/list-tags"},{"title":"Create tag","deprecated":null,"version":null,"openapi":"/api-reference/v1/tags-v1.yaml post /tags","href":"/api-reference/tags/create-tag"},{"title":"Get tag","deprecated":null,"version":null,"openapi":"/api-reference/v1/tags-v1.yaml get /tags/{tag_id}","href":"/api-reference/tags/get-tag"},{"title":"Update tag","deprecated":null,"version":null,"openapi":"/api-reference/v1/tags-v1.yaml patch /tags/{tag_id}","href":"/api-reference/tags/update-tag"},{"title":"Delete tag","deprecated":null,"version":null,"openapi":"/api-reference/v1/tags-v1.yaml delete /tags/{tag_id}","href":"/api-reference/tags/delete-tag"}]},{"group":"Webhooks","icon":"webhook","pages":[{"title":"List webhooks","deprecated":null,"version":null,"openapi":"/api-reference/v1/webhooks-v1.yaml get /webhooks","href":"/api-reference/webhooks/list-webhooks"},{"title":"Create a webhook","deprecated":null,"version":null,"openapi":"/api-reference/v1/webhooks-v1.yaml post /webhooks","href":"/api-reference/webhooks/create-a-webhook"},{"title":"Update a webhook","deprecated":null,"version":null,"openapi":"/api-reference/v1/webhooks-v1.yaml patch /webhooks/{webhook_id}","href":"/api-reference/webhooks/update-a-webhook"},{"title":"Delete a webhook","deprecated":null,"version":null,"openapi":"/api-reference/v1/webhooks-v1.yaml delete /webhooks/{webhook_id}","href":"/api-reference/webhooks/delete-a-webhook"}]},{"group":"Traces","icon":"bezier-curve","pages":[{"title":"Ingest OTLP traces","deprecated":null,"version":null,"openapi":"/api-reference/v1/traces-v1.yaml post /traces","href":"/api-reference/traces/ingest-otlp-traces"},{"title":"Search trace-bearing calls","deprecated":null,"version":null,"openapi":"/api-reference/v1/traces-v1.yaml post /traces/search","href":"/api-reference/traces/search-trace-bearing-calls"},{"title":"Inspect trace quality and signal coverage","deprecated":null,"version":null,"openapi":"/api-reference/v1/traces-v1.yaml get /traces/summary","href":"/api-reference/traces/inspect-trace-quality-and-signal-coverage"},{"title":"List trace spans for a simulation output","deprecated":null,"version":null,"openapi":"/api-reference/v1/traces-v1.yaml get /traces/spans","href":"/api-reference/traces/list-trace-spans-for-a-simulation-output"}]},{"group":"Conversations Config","icon":"building","pages":[{"title":"List organization users","deprecated":null,"version":null,"openapi":"/api-reference/v1/organization-v1.yaml get /organization/users","href":"/api-reference/organization-users/list-organization-users"},{"title":"Get conversation metrics config","deprecated":null,"version":null,"openapi":"/api-reference/v1/organization-v1.yaml get /organization/conversation-metrics","href":"/api-reference/organization-conversations-config/get-conversation-metrics-config"},{"title":"Update conversation metrics config","deprecated":null,"version":null,"openapi":"/api-reference/v1/organization-v1.yaml patch /organization/conversation-metrics","href":"/api-reference/organization-conversations-config/update-conversation-metrics-config"},{"title":"Get conversation metrics config using the legacy path","deprecated":true,"version":null,"openapi":"/api-reference/v1/organization-v1.yaml get /organization/monitoring-metrics","href":"/api-reference/organization-conversations-config/get-conversation-metrics-config-using-the-legacy-path"},{"title":"Update conversation metrics config using the legacy path","deprecated":true,"version":null,"openapi":"/api-reference/v1/organization-v1.yaml patch /organization/monitoring-metrics","href":"/api-reference/organization-conversations-config/update-conversation-metrics-config-using-the-legacy-path"}]},{"group":"API Keys","icon":"key","pages":[{"title":"List API keys","deprecated":null,"version":null,"openapi":"/api-reference/v1/api-keys-v1.yaml get /api-keys","href":"/api-reference/api-keys/list-api-keys"},{"title":"Create API key","deprecated":null,"version":null,"openapi":"/api-reference/v1/api-keys-v1.yaml post /api-keys","href":"/api-reference/api-keys/create-api-key"},{"title":"Update API key status","deprecated":null,"version":null,"openapi":"/api-reference/v1/api-keys-v1.yaml patch /api-keys/{api_key_id}","href":"/api-reference/api-keys/update-api-key-status"},{"title":"Delete API key","deprecated":null,"version":null,"openapi":"/api-reference/v1/api-keys-v1.yaml delete /api-keys/{api_key_id}","href":"/api-reference/api-keys/delete-api-key"}]},{"group":"Workspaces","icon":"layer-group","pages":[{"title":"List workspaces","deprecated":null,"version":null,"openapi":"/api-reference/v1/workspaces-v1.yaml get /workspaces","href":"/api-reference/workspaces/list-workspaces"},{"title":"Create workspace","deprecated":null,"version":null,"openapi":"/api-reference/v1/workspaces-v1.yaml post /workspaces","href":"/api-reference/workspaces/create-workspace"},{"title":"Get workspace","deprecated":null,"version":null,"openapi":"/api-reference/v1/workspaces-v1.yaml get /workspaces/{workspace_id}","href":"/api-reference/workspaces/get-workspace"},{"title":"Update workspace","deprecated":null,"version":null,"openapi":"/api-reference/v1/workspaces-v1.yaml patch /workspaces/{workspace_id}","href":"/api-reference/workspaces/update-workspace"},{"title":"Delete workspace","deprecated":null,"version":null,"openapi":"/api-reference/v1/workspaces-v1.yaml delete /workspaces/{workspace_id}","href":"/api-reference/workspaces/delete-workspace"},{"title":"Archive workspace","deprecated":null,"version":null,"openapi":"/api-reference/v1/workspaces-v1.yaml post /workspaces/{workspace_id}/archive","href":"/api-reference/workspaces/archive-workspace"}]},{"group":"Integrations","icon":"plug","pages":[{"title":"Get Slack integration status","deprecated":null,"version":null,"openapi":"/api-reference/v1/slack-v1.yaml get /integrations/slack","href":"/api-reference/integrations/get-slack-integration-status"},{"title":"Disconnect Slack integration","deprecated":null,"version":null,"openapi":"/api-reference/v1/slack-v1.yaml delete /integrations/slack","href":"/api-reference/integrations/disconnect-slack-integration"},{"title":"Connect a Slack workspace","deprecated":null,"version":null,"openapi":"/api-reference/v1/slack-v1.yaml post /integrations/slack/connect","href":"/api-reference/integrations/connect-a-slack-workspace"}]}]},{"tab":"CLI","icon":"terminal","pages":[{"title":"CLI","href":"/cli/overview"}]},{"tab":"Developers","icon":"code","pages":[{"title":"Developers","href":"/sdks/overview"}]},{"tab":"Agents","icon":"microchip","pages":[{"title":"Agents","href":"/agents/overview"}]},{"tab":"Connectors","icon":"diagram-project","pages":[{"title":"Connectors","href":"/mcp/overview"}]}]},"basePath":"","title":"Create metric - Coval Documentation","buildId":"dpl_42LwxxU1kGN114H4XzwGYXa9ZDah","deploymentId":"dpl_42LwxxU1kGN114H4XzwGYXa9ZDah","dynamics":["c2aa737661","2b790eda92","b0f84f53ff","a9bb46feb3"],"chunks":["OpenApiReferenceProvider-C-hEh3I2.js","utils-CnF4QiUD.js","cloneDeep-izs3Hzxb.js","_Uint8Array-BVIqJ90l.js","isObjectLike-C8vmzPEN.js","isArray-Dcu1dQ5t.js","utils-C7PVNbel.js","toString-BX-iyh8G.js","isSymbol-CSH9U2Gm.js","addUniqueKeysToSchema-8ytevL2A.js","snippetPresets-BT1alx3v.js","style-to-object-BY3JEAdk.js","v4-DIgz8zy6.js","conditional-requirements-CFM0id0Q.js","ApiExamples-BLXC0i_W.js","isEqual-BfaiBbcl.js","usePlaygroundInputsStore-CyLIGI9_.js","shallow-DC0lGVIW.js","getApiPlaygroundDisplay-CgDQ85tN.js","CodeSnippet-6-I-Gpv9.js","CodeSnippets-BAk1kDdu.js","Page-C945cI-W.js","getPastedJson-B276RuWN.js","icon-BqP8etTm.js","MethodPill-DM6sbxG1.js","DuplicateIcon-PyJglOaE.js","createIcon-CMeOMAc_.js","DynamicMarkdown-BoyYAA8K.js","SectionHeading-DAYv3gvZ.js","axios-vUo_bRtp.js","Markdown-BhTTmazV.js","clsx-CR-RHrVC.js","lib-DuNMoZ05.js","lib-B8HbPgcC.js","html-void-elements-mCSPHezU.js","dist-CBUH0-zX.js","katex-YMM-FMeD.js","marked.esm-CZWythHk.js","AssistantPageLink-BmARFYNC.js"]}