Requires version 1.1.12 or later of the Archetype platform.
Overview
This endpoint returns one eval by its evl_ id. An eval in a
project you cannot see returns 404.Fields beyond the always-present ones are populated as the eval progresses:
started_at is populated when scoring begins.
output_artifacts fills in while the eval runs. An entry whose metadata.status is partial
holds the rows scored so far, which is also what a failed or cancelled mid-run eval leaves
behind.
metrics_report is populated once the eval is completed.
completed_at is populated when the eval reaches a terminal status.
error is populated when the eval failed.
The metrics_report answers the question “is this agent good enough?” To answer “where is this
agent bad?” page through List Eval Examples.
The HTTP status code returned is 404 both if the specified eval ID is unknown and if the ID
exists but belongs to another organization.
Request
string
required
Eval evl_ id.
Response
string
required
The eval’s evl_ id.
string
required
Human label given on create. Empty when none was given.
string
required
The organization that owns the eval.
string
required
The blueprint being evaluated.
string
required
The run’s headline, as <target>.<objective> — resolved at creation, so this is what was
actually scored rather than what was asked for.
object
required
The objectives this run computes, keyed by target name; each value is an array of objectives,
each a bare name or written in full with its arguments, as in a target
override. This
is the blueprint’s own declaration folded together with the request’s per-target overrides,
resolved at creation. primary names one of these, as <target>.<name>.
examples records what the run actually read; that is, resolved names, the CRC32C of the
bytes scored, and fully-resolved ground-truth declarations, rather than what the request asked
for.
Each input’s metadata carries the service-written targets and example_name keys; see
Resolved input ref.
array
required
The bounds the run reports a verdict on, resolved at creation: the request’s, or else the
blueprint’s. Empty when there are none. See
Constraint. v2.0.0+
boolean
required
Whether the run emits the predictions artifacts alongside the metrics report, one per target,
as the request asked. When true, they appear in output_artifacts as the run produces them.
array
required
The examples the eval was created against, as resolved: each carries the name its results are
keyed by, and inputs stamped with the CRC32C of the bytes scored. See Resolved example
object for the format of the objects in this array.
string
required
The eval’s current lifecycle status: pending, running, completed, failed, or
cancelled.
Evals are always created with the status pending. Once they’re dispatched, their state
changes to running. From there, it will eventually enter one of the three terminal states:
completed, failed, or cancelled. A pending eval can also be cancelled directly.
string
The project the eval is in: its blueprint’s. This value is null outside any
project. v2.0.0+
string
required
Subject id (usr_... or key_...) that created this eval.
string
required
When the eval was created (date-time).
string
When scoring began (date-time). Absent while pending.
string
When the eval reached a terminal status (date-time). Absent until then.
object
What the run measured: its headline score and what was measured for each target. Present once
the eval is completed; absent while it is pending or running, and on a cancelled or failed
eval. See Metrics report for the format of this object.
array
Refs to the files the run produced. Each id is a data-service file id, so an artifact is
downloadable through the files API, and each carries metadata saying which artifact it is.
See Output artifact ref for the format of the objects
in this array.Populated while the run goes, not only at the end: each batch of scored rows is appended to
the predictions file and updates the entry, whose metadata.status stays partial until the
run’s final push marks it complete. An eval that failed or was cancelled mid-run keeps its
partial entry — the rows scored so far are still readable.
string
Why the eval failed. Present only when status is failed.
Resolved example object (examples[])
One example of a run, as the run recorded it: named, positioned, and with its inputs pinned to
the bytes it read.
string
required
How this example is identified in the run’s results. Unique within the eval.
integer
required
The example’s 1-based position in the run, fixing the order results are listed in.
array
required
The data handed to the agent, each ref carrying the CRC32C of the bytes scored, in its crc32c
field.
object
The ground truth the example was created with, if it declared any. Same shape as the
ground_truth of a request
example.
object
Which targets each of the example’s ground truths serves, as it was created with, if it said.
object
The free-form tags the example was created with, if any.
Metrics report (metrics_report)
What an eval run measured over the whole run: its headline score, and what was measured for
each target.schema_version says which fields are present. Reports from v2 on carry the example counts,
the headline’s aggregation, and each target’s pairing, item counts, and per-example summary;
v1 reports carry none of them.
string
required
The report’s schema version, v1 or v2.
object
required
The run’s headline score. Repeats a value that also appears in the named target’s aggregate,
so a reader wanting the one number the run is judged by gets it without following a pointer.
target (string, required) — the target this headline is about.
name (string, required) — the objective’s name, e.g. macro_f1.
value (number) — its value, or null when nothing was scored.
aggregation (string) — how the value was computed from the run’s examples: pooled or
per_example. From v2.
object
required
One entry per scored target, keyed by target name. See Target
report for the format of a target
record.
array
What the run measured against each of its constraints, over the whole run. See Constraint
verdict. Absent when the run has no
constraints. Missing a constraint does not fail the run. v2.0.0+
boolean
Whether every constraint holds: false when one is missed, null when none is missed but one
cannot be judged because its objective has no value. Present whenever constraints is. v2.0.0+
integer
How many examples the run has. From v2.
integer
How many examples could not be scored at all, and are left out of every figure. From v2.
integer
How many examples were scored, but with part of their ground truth unusable. From v2.
integer
How many ground-truth records, over every example scored, could not be matched to any
prediction and were dropped. An example that failed is not counted. From v2.
Constraint verdict (metrics_report.constraints[])
What a run measured against one of its constraints. v2.0.0+
object
required
The constraint judged: its objective, and its min, max, or both.
number
The objective’s value. null when it has none, as when nothing it reads was scored.
boolean
Whether the value respects the bounds. null when there is no value to judge.
What was measured for one target, over the whole run or over one example. The fields after
aggregate depend on the target’s type.
object
required
Every objective computed for the target, by name, over what the report covers: for the whole
run, computed as the headline’s aggregation says. A value is null when nothing was scored.
object
What each objective was declared with, by name, for every objective declared with arguments or
under a name other than its catalog objective’s: its arguments, plus the catalog objective as
objective when the name is not its own. For example,
{"recall_anomaly": {"objective": "recall", "class": "anomaly"}}. v2.0.0+
Starting with version 2.0.1, an objective declared with an
if_undefined is listed here too, with its if_undefined.
array
The objectives in aggregate that have no value of their own and report the value they were
declared to take in that case (their if_undefined) instead. Over the whole run, only
objectives computed pooled are listed; for an objective computed per_example, see
per_example.defaulted. Absent when empty. v2.0.1+
string
required
The target’s type: category (one class per scored item) or binary (one of two classes per
scored item, one of them its positive class). binary is from v2; reports of schema v1
also describe a binary target as category.
array
required
The class vocabulary, fixing the order of every per-class list and of the confusion matrix.
object
required
Per-class figures, each a list in class_names order. A figure is null where there is
nothing to compute it from, rather than 0.
Starting with version 2.0.0, a per-class figure with nothing to compute it from is null. Earlier
versions reported 0.
precision (array of numbers) — of the items predicted as the class, the fraction that truly
were. null for a class never predicted.
recall (array of numbers) — of the items truly of the class, the fraction predicted as it.
null for a class that never occurs.
f1 (array of numbers) — harmonic mean of precision and recall, per class. null for a class
neither occurring nor predicted.
support (array of integers) — how many items truly of the class were scored.
array
required
Row = true class, column = predicted class, both in class_names order. Counts the items where
both a prediction and a ground truth were found.
string
binary targets only, and required for them: the class standing for the condition the target
detects, one of class_names.
string
category targets only: the class meaning that nothing happened, one of class_names, when
the target names one. This is the class the foreground and detection objectives set apart.
array
Per true class, the ground truths that got no prediction. From v2.
array
Per predicted class, the predictions that had no ground truth. From v2.
object
How many scored items ended in each outcome, for a target whose pairing can leave a prediction
or a ground truth unmatched. From v2.
matched (integer, required) — items with both a prediction and a truth.
missed (integer, required) — truths with no prediction.
false_alarms (integer, required) — predictions with no truth.
unscored (integer, required) — predictions outside the annotated coverage, counted in no
denominator.
failed (integer, required) — items whose ground truth could not be read, counted in no
denominator.
string
How the target’s predictions were paired with its ground truth into scored items. Currently
always by_time. From v2.
integer
How many items were scored. From v2.
integer
How many of those items could not be judged, their ground truth being unreadable. From v2.
object
Over the whole run only: each objective’s per-example values summarized, keyed by objective
name. Only the examples where the objective has a value count, including the value it takes from its if_undefined. An objective’s summary is null
when no example has a value for it. From v2.
mean (number, required) — the mean of the values.
min (number, required) — the lowest value.
median (number, required) — the median value; the mean of the two middle ones for an even
count.
max (number, required) — the highest value.
p90 (number, required) — the 90th percentile, interpolating linearly between values.
excluded (integer, required) — how many examples had no value, and are left out of every
figure here.
defaulted (integer) — how many examples had no value of their own and count with the
objective’s if_undefined value in every figure here. Absent when none did. v2.0.1+
stderr (number) — the standard error of the mean, or null with fewer than two values.
Output artifact ref (output_artifacts[])
string
required
Storage kind, e.g. file.
string
required
Data-service file id, so the artifact is downloadable through the files API.
string
Optional format hint.
string
Whole-file CRC32C checksum of the referenced bytes, base64-encoded exactly as S3 emits it.
null when the data service has no checksum for the file.
object
For one of an eval’s predictions files: which file it is, and how complete.
kind (string, required) — which artifact this is among the eval’s outputs: predictions
for a predictions file.
status (string, required) — complete when the file holds every scored item, or partial
when it holds only the items scored so far.
row_count (integer, required) — rows in the file: how many scored items a reader will find
in it, one per row.
target (string) — the target whose predictions the file holds: an eval writes one
predictions file per target it scores. Absent on a file from an eval that wrote a single
predictions file for all its targets.
The run-level figure is every example pooled, never the mean of the per-example results from
List Eval Examples.
Was this page helpful?
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"Archetype AI Documentation","colors":{"primary":"#0047FF","light":"#9EBBFF","dark":"#0047FF"},"logo":{"light":"https://mintcdn.com/archetypeai-bd6fb3cf/Fml2i7FmPyxjLCP7/logo/light.svg?fit=max\u0026auto=format\u0026n=Fml2i7FmPyxjLCP7\u0026q=85\u0026s=4b1f94a0bc6c65c3905d1a55d725b05f","dark":"https://mintcdn.com/archetypeai-bd6fb3cf/Fml2i7FmPyxjLCP7/logo/dark.svg?fit=max\u0026auto=format\u0026n=Fml2i7FmPyxjLCP7\u0026q=85\u0026s=b652785f67f97925eb5177264ffc9e50"},"favicon":"https://mintcdn.com/archetypeai-bd6fb3cf/PEoHdVWOSWJmHgSg/favicon.svg?fit=max\u0026auto=format\u0026n=PEoHdVWOSWJmHgSg\u0026q=85\u0026s=4ea6587ffdd8e925003e9e12319702aa","api":{"mdx":{"auth":{"method":"bearer"},"server":"https://platform.u1.archetypeai.app/api"}},"appearance":{"default":"system"},"navbar":{"links":[{"href":"https://platform.u1.archetypeai.app/","label":"Console"}]},"footer":{"socials":{"twitter":"https://x.com/physicalai","github":"https://github.com/archetypeai","linkedin":"https://www.linkedin.com/company/archetype-ai"}},"search":{"prompt":"Search Archetype Platform docs..."},"seo":{"indexing":"navigable"},"styling":{"codeblocks":"system","latex":false},"integrations":{"amplitude":{"apiKey":"84e8a1610cf8b3c7d8a49d945917606d"}},"markdown":{"instructions":"Start with /introduction/getting-started. Use the Inference API's Direct Query endpoint (POST /api/inference/query) with the newton-c-2.6 or newton-fusion-1.0 model (text, image, and video reasoning) or the omega-embedding encoder (time-series embeddings). ATAI_API_ENDPOINT is the base URL https://platform.u1.archetypeai.app with no version path; every endpoint path begins with /api. Pages whose descriptions are marked (Archived) document the legacy Lens runtime — do not use them for new projects."},"navigation":{"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"archetypeai-bd6fb3cf","hasAudioNarration":false,"actualSubdomain":"archetypeai-bd6fb3cf","customDomains":["docs.archetypeai.app"],"gitSource":{"type":"github","owner":"archetypeai","repo":"mintlify-docs","deployBranch":"main","contentDirectory":"","isPrivate":true,"mountPath":"","label":"","_id":"6ae399f43888be9481e90634"},"feedback":{"thumbs":true},"entitlements":{"AI_CHAT":{"status":"ENABLED"},"CONTEXTUAL_FEEDBACK":{"status":"ENABLED"},"CODE_SNIPPET_FEEDBACK":{"status":"ENABLED"},"WEB_MCP":{"status":"ENABLED"},"NARRATION":{"status":"ENABLED"}},"buildId":"6afb61d4ffd86b9df9e42a1b","clientVersion":"0.0.4227","searchFilterCounts":[{"language":"default","tag":"API Reference","count":272},{"language":"default","tag":"Documentation","count":82},{"language":"default","tag":"Agents API","count":55},{"language":"default","tag":"Archive","count":28},{"language":"default","tag":"Core Concepts","count":25},{"language":"default","tag":"Agents","count":24},{"language":"default","tag":"Batch Processing API","count":20},{"language":"default","tag":"Developer Console","count":18},{"language":"default","tag":"Files API","count":16},{"language":"default","tag":"Sessions","count":14}]},"assistantConfig":{"deflection":{"enabled":true,"email":"[email protected]"}},"basePath":"","hasChatPermissions":true,"hasWebMcpPermissions":true,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-rbac-roles","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"rbac-expansion","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-metadata","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-serve","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"live-agents","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"starter-pricing","enabled":true,"variant":{"name":"treatment","enabled":true,"payload":{"type":"string","value":"treatment"},"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"wildcard-email-auth","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":false},"customCss":[{"filePath":"style.css","content":"*{border-radius:0px!important}[data-theme=\"light\"] pre,[data-theme=\"light\"] pre code{background-color:#f6f8fa!important;color:#24292e!important}[data-theme=\"dark\"] pre,[data-theme=\"dark\"] pre code{background-color:#161b22!important;color:#e1e4e8!important}[data-theme=\"light\"] code:not(pre code){color:#0969da!important;background-color:#f6f8fa!important;padding:2px 4px;border-radius:3px}[data-theme=\"dark\"] code:not(pre code){color:#79c0ff!important;background-color:#161b22!important;padding:2px 4px;border-radius:3px}"}]}
{"page":{"pagePath":"api-reference/agents/evals/get-eval","slug":"/api-reference/agents/evals/get-eval","pageMetadata":{"title":"Get Eval","api":"GET /agents/evals/{eval_id}","description":"Retrieve one eval, its status, and its metrics report","tag":"v1.1.12+","href":"/api-reference/agents/evals/get-eval"},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsx(_components.p, {\n children: \"Retrieve one eval, its status, and its metrics report\"\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,code:`code`,em:`em`,li:`li`,p:`p`,ul:`ul`,..._provideComponents(),...props.components},{Badge,Callout,Heading,Note,ParamField,ResponseField}=_components;if(!Badge)_missingMdxReference(`Badge`,true);if(!Callout)_missingMdxReference(`Callout`,true);if(!Heading)_missingMdxReference(`Heading`,true);if(!Note)_missingMdxReference(`Note`,true);if(!ParamField)_missingMdxReference(`ParamField`,true);if(!ResponseField)_missingMdxReference(`ResponseField`,true);return _jsxs(_Fragment,{children:[_jsx(Callout,{icon:`clock`,color:`#3064E3`,iconType:`solid`,children:_jsxs(_components.p,{children:[`Requires `,_jsx(_components.a,{href:`/release-notes/1.1.x#v1-1-12`,children:`version 1.1.12`}),` or later of the Archetype platform.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`overview`,children:`Overview`}),`\n`,_jsxs(_components.p,{children:[`This endpoint returns one eval by its `,_jsx(_components.code,{children:`evl_`}),` id. An eval in a\n`,_jsx(_components.a,{href:`/api-reference/projects/about`,children:`project`}),` you cannot see returns `,_jsx(_components.code,{children:`404`}),`.`]}),`\n`,_jsx(_components.p,{children:`Fields beyond the always-present ones are populated as the eval progresses:`}),`\n`,_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`started_at`}),` is populated when scoring begins.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`output_artifacts`}),` fills in while the eval runs. An entry whose `,_jsx(_components.code,{children:`metadata.status`}),` is `,_jsx(_components.code,{children:`partial`}),`\nholds the rows scored so far, which is also what a failed or cancelled mid-run eval leaves\nbehind.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`metrics_report`}),` is populated once the eval is `,_jsx(_components.code,{children:`completed`}),`.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`completed_at`}),` is populated when the eval reaches a terminal status.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`error`}),` is populated when the eval `,_jsx(_components.code,{children:`failed`}),`.`]}),`\n`]}),`\n`,_jsxs(_components.p,{children:[`The `,_jsx(_components.code,{children:`metrics_report`}),` answers the question “is this agent good enough?” To answer “where is this\nagent bad?” page through `,_jsx(_components.a,{href:`/api-reference/agents/evals/list-eval-examples`,children:`List Eval Examples`}),`.`]}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`The HTTP status code returned is `,_jsx(_components.code,{children:`404`}),` both if the specified eval ID is unknown and if the ID\nexists but belongs to another organization.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`request`,children:`Request`}),`\n`,_jsx(ParamField,{path:`eval_id`,type:`string`,required:true,id:`param-eval-id`,children:_jsxs(_components.p,{children:[`Eval `,_jsx(_components.code,{children:`evl_`}),` id.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`response`,children:`Response`}),`\n`,_jsx(ResponseField,{name:`id`,type:`string`,required:true,id:`param-id`,children:_jsxs(_components.p,{children:[`The eval’s `,_jsx(_components.code,{children:`evl_`}),` id.`]})}),`\n`,_jsx(ResponseField,{name:`name`,type:`string`,required:true,id:`param-name`,children:_jsx(_components.p,{children:`Human label given on create. Empty when none was given.`})}),`\n`,_jsx(ResponseField,{name:`org_id`,type:`string`,required:true,id:`param-org-id`,children:_jsx(_components.p,{children:`The organization that owns the eval.`})}),`\n`,_jsx(ResponseField,{name:`blueprint_id`,type:`string`,required:true,id:`param-blueprint-id`,children:_jsx(_components.p,{children:`The blueprint being evaluated.`})}),`\n`,_jsx(ResponseField,{name:`primary`,type:`string`,required:true,id:`param-primary`,children:_jsxs(_components.p,{children:[`The run’s headline, as `,_jsx(_components.code,{children:`\u003ctarget>.\u003cobjective>`}),` — resolved at creation, so this is what was\nactually scored rather than what was asked for.`]})}),`\n`,_jsxs(ResponseField,{name:`resolved_targets`,type:`object`,required:true,id:`param-resolved-targets`,children:[_jsxs(_components.p,{children:[`The objectives this run computes, keyed by target name; each value is an array of objectives,\neach a bare name or written in full with its arguments, as in a `,_jsx(_components.a,{href:`/api-reference/agents/evals/create-eval#target-override-targets-%3Ctarget-name%3E`,children:`target\noverride`}),`. This\nis the blueprint’s own declaration folded together with the request’s per-target overrides,\nresolved at creation. `,_jsx(_components.code,{children:`primary`}),` names one of these, as `,_jsx(_components.code,{children:`\u003ctarget>.\u003cname>`}),`.`]}),_jsx(Note,{children:_jsxs(_components.p,{children:[_jsx(_components.code,{children:`examples`}),` records what the run actually read; that is, resolved names, the CRC32C of the\nbytes scored, and fully-resolved ground-truth declarations, rather than what the request asked\nfor.`]})}),_jsxs(_components.p,{children:[`Each input’s `,_jsx(_components.code,{children:`metadata`}),` carries the service-written `,_jsx(_components.code,{children:`targets`}),` and `,_jsx(_components.code,{children:`example_name`}),` keys; see\n`,_jsx(_components.a,{href:`/api-reference/agents/evals/create-eval#resolved-input-ref-examples-inputs`,children:`Resolved input ref`}),`.`]})]}),`\n`,_jsx(ResponseField,{name:`constraints`,type:`array`,required:true,id:`param-constraints`,children:_jsxs(_components.p,{children:[`The bounds the run reports a verdict on, resolved at creation: the request’s, or else the\nblueprint’s. Empty when there are none. See\n`,_jsx(_components.a,{href:`/api-reference/agents/evals/create-eval#constraint-constraints`,children:`Constraint`}),`. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]})}),`\n`,_jsx(ResponseField,{name:`emit_predictions`,type:`boolean`,required:true,id:`param-emit-predictions`,children:_jsxs(_components.p,{children:[`Whether the run emits the predictions artifacts alongside the metrics report, one per target,\nas the request asked. When `,_jsx(_components.code,{children:`true`}),`, they appear in `,_jsx(_components.code,{children:`output_artifacts`}),` as the run produces them.`]})}),`\n`,_jsx(ResponseField,{name:`examples`,type:`array`,required:true,id:`param-examples`,children:_jsxs(_components.p,{children:[`The examples the eval was created against, as resolved: each carries the name its results are\nkeyed by, and inputs stamped with the CRC32C of the bytes scored. See `,_jsx(_components.a,{href:`#resolved-example-object-examples`,children:`Resolved example\nobject`}),` for the format of the objects in this array.`]})}),`\n`,_jsxs(ResponseField,{name:`status`,type:`string`,required:true,id:`param-status`,children:[_jsxs(_components.p,{children:[`The eval’s current lifecycle status: `,_jsx(_components.code,{children:`pending`}),`, `,_jsx(_components.code,{children:`running`}),`, `,_jsx(_components.code,{children:`completed`}),`, `,_jsx(_components.code,{children:`failed`}),`, or\n`,_jsx(_components.code,{children:`cancelled`}),`.`]}),_jsx(Note,{children:_jsxs(_components.p,{children:[`Evals are always created with the status `,_jsx(_components.code,{children:`pending`}),`. Once they’re dispatched, their state\nchanges to `,_jsx(_components.code,{children:`running`}),`. From there, it will eventually enter one of the three terminal states:\n`,_jsx(_components.code,{children:`completed`}),`, `,_jsx(_components.code,{children:`failed`}),`, or `,_jsx(_components.code,{children:`cancelled`}),`. A `,_jsx(_components.code,{children:`pending`}),` eval can also be cancelled directly.`]})})]}),`\n`,_jsx(ResponseField,{name:`project_id`,type:`string`,id:`param-project-id`,children:_jsxs(_components.p,{children:[`The `,_jsx(_components.a,{href:`/api-reference/projects/about`,children:`project`}),` the eval is in: its blueprint’s. This value is `,_jsx(_components.code,{children:`null`}),` outside any\nproject. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]})}),`\n`,_jsx(ResponseField,{name:`created_by`,type:`string`,required:true,id:`param-created-by`,children:_jsxs(_components.p,{children:[`Subject id (`,_jsx(_components.code,{children:`usr_...`}),` or `,_jsx(_components.code,{children:`key_...`}),`) that created this eval.`]})}),`\n`,_jsx(ResponseField,{name:`created_at`,type:`string`,required:true,id:`param-created-at`,children:_jsx(_components.p,{children:`When the eval was created (date-time).`})}),`\n`,_jsx(ResponseField,{name:`started_at`,type:`string`,id:`param-started-at`,children:_jsxs(_components.p,{children:[`When scoring began (date-time). Absent while `,_jsx(_components.code,{children:`pending`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`completed_at`,type:`string`,id:`param-completed-at`,children:_jsx(_components.p,{children:`When the eval reached a terminal status (date-time). Absent until then.`})}),`\n`,_jsx(ResponseField,{name:`metrics_report`,type:`object`,id:`param-metrics-report`,children:_jsxs(_components.p,{children:[`What the run measured: its headline score and what was measured for each target. Present once\nthe eval is `,_jsx(_components.code,{children:`completed`}),`; absent while it is pending or running, and on a cancelled or failed\neval. See `,_jsx(_components.a,{href:`#metrics-report-metrics_report`,children:`Metrics report`}),` for the format of this object.`]})}),`\n`,_jsxs(ResponseField,{name:`output_artifacts`,type:`array`,id:`param-output-artifacts`,children:[_jsxs(_components.p,{children:[`Refs to the files the run produced. Each `,_jsx(_components.code,{children:`id`}),` is a data-service file id, so an artifact is\ndownloadable through the files API, and each carries `,_jsx(_components.code,{children:`metadata`}),` saying which artifact it is.\nSee `,_jsx(_components.a,{href:`#output-artifact-ref-output_artifacts`,children:`Output artifact ref`}),` for the format of the objects\nin this array.`]}),_jsxs(_components.p,{children:[`Populated `,_jsx(_components.em,{children:`while the run goes`}),`, not only at the end: each batch of scored rows is appended to\nthe predictions file and updates the entry, whose `,_jsx(_components.code,{children:`metadata.status`}),` stays `,_jsx(_components.code,{children:`partial`}),` until the\nrun’s final push marks it `,_jsx(_components.code,{children:`complete`}),`. An eval that failed or was cancelled mid-run keeps its\npartial entry — the rows scored so far are still readable.`]})]}),`\n`,_jsx(ResponseField,{name:`error`,type:`string`,id:`param-error`,children:_jsxs(_components.p,{children:[`Why the eval failed. Present only when `,_jsx(_components.code,{children:`status`}),` is `,_jsx(_components.code,{children:`failed`}),`.`]})}),`\n`,_jsxs(Heading,{level:`3`,id:`resolved-example-object-examples`,children:[`Resolved example object (`,_jsx(_components.code,{children:`examples[]`}),`)`]}),`\n`,_jsx(_components.p,{children:`One example of a run, as the run recorded it: named, positioned, and with its inputs pinned to\nthe bytes it read.`}),`\n`,_jsx(ResponseField,{name:`name`,type:`string`,required:true,id:`param-name-1`,children:_jsx(_components.p,{children:`How this example is identified in the run’s results. Unique within the eval.`})}),`\n`,_jsx(ResponseField,{name:`ordinal`,type:`integer`,required:true,id:`param-ordinal`,children:_jsx(_components.p,{children:`The example’s 1-based position in the run, fixing the order results are listed in.`})}),`\n`,_jsx(ResponseField,{name:`inputs`,type:`array`,required:true,id:`param-inputs`,children:_jsxs(_components.p,{children:[`The data handed to the agent, each ref carrying the CRC32C of the bytes scored, in its `,_jsx(_components.code,{children:`crc32c`}),`\nfield.`]})}),`\n`,_jsx(ResponseField,{name:`ground_truth`,type:`object`,id:`param-ground-truth`,children:_jsxs(_components.p,{children:[`The ground truth the example was created with, if it declared any. Same shape as the\n`,_jsx(_components.a,{href:`/api-reference/agents/evals/create-eval#param-ground-truth`,children:_jsx(_components.code,{children:`ground_truth`})}),` of a request\nexample.`]})}),`\n`,_jsx(ResponseField,{name:`binding`,type:`object`,id:`param-binding`,children:_jsx(_components.p,{children:`Which targets each of the example’s ground truths serves, as it was created with, if it said.`})}),`\n`,_jsx(ResponseField,{name:`metadata`,type:`object`,id:`param-metadata`,children:_jsx(_components.p,{children:`The free-form tags the example was created with, if any.`})}),`\n`,_jsxs(Heading,{level:`3`,id:`metrics-report-metrics_report`,children:[`Metrics report (`,_jsx(_components.code,{children:`metrics_report`}),`)`]}),`\n`,_jsx(_components.p,{children:`What an eval run measured over the whole run: its headline score, and what was measured for\neach target.`}),`\n`,_jsxs(_components.p,{children:[_jsx(_components.code,{children:`schema_version`}),` says which fields are present. Reports from `,_jsx(_components.code,{children:`v2`}),` on carry the example counts,\nthe headline’s `,_jsx(_components.code,{children:`aggregation`}),`, and each target’s `,_jsx(_components.code,{children:`pairing`}),`, item counts, and per-example summary;\n`,_jsx(_components.code,{children:`v1`}),` reports carry none of them.`]}),`\n`,_jsx(ResponseField,{name:`schema_version`,type:`string`,required:true,id:`param-schema-version`,children:_jsxs(_components.p,{children:[`The report’s schema version, `,_jsx(_components.code,{children:`v1`}),` or `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsxs(ResponseField,{name:`primary`,type:`object`,required:true,id:`param-primary-1`,children:[_jsxs(_components.p,{children:[`The run’s headline score. Repeats a value that also appears in the named target’s `,_jsx(_components.code,{children:`aggregate`}),`,\nso a reader wanting the one number the run is judged by gets it without following a pointer.`]}),_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`target`}),` (string, required) — the target this headline is about.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`name`}),` (string, required) — the objective’s name, e.g. `,_jsx(_components.code,{children:`macro_f1`}),`.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`value`}),` (number) — its value, or `,_jsx(_components.code,{children:`null`}),` when nothing was scored.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`aggregation`}),` (string) — how the value was computed from the run’s examples: `,_jsx(_components.code,{children:`pooled`}),` or\n`,_jsx(_components.code,{children:`per_example`}),`. From `,_jsx(_components.code,{children:`v2`}),`.`]}),`\n`]})]}),`\n`,_jsx(ResponseField,{name:`targets`,type:`object`,required:true,id:`param-targets`,children:_jsxs(_components.p,{children:[`One entry per scored target, keyed by target name. See `,_jsx(_components.a,{href:`#target-report-metrics_report-targets-%3Ctarget-name%3E`,children:`Target\nreport`}),` for the format of a target\nrecord.`]})}),`\n`,_jsx(ResponseField,{name:`constraints`,type:`array`,id:`param-constraints-1`,children:_jsxs(_components.p,{children:[`What the run measured against each of its constraints, over the whole run. See `,_jsx(_components.a,{href:`#constraint-verdict-metrics_report-constraints`,children:`Constraint\nverdict`}),`. Absent when the run has no\nconstraints. Missing a constraint does not fail the run. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]})}),`\n`,_jsx(ResponseField,{name:`feasible`,type:`boolean`,id:`param-feasible`,children:_jsxs(_components.p,{children:[`Whether every constraint holds: `,_jsx(_components.code,{children:`false`}),` when one is missed, `,_jsx(_components.code,{children:`null`}),` when none is missed but one\ncannot be judged because its objective has no value. Present whenever `,_jsx(_components.code,{children:`constraints`}),` is. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]})}),`\n`,_jsx(ResponseField,{name:`example_count`,type:`integer`,id:`param-example-count`,children:_jsxs(_components.p,{children:[`How many examples the run has. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`examples_failed`,type:`integer`,id:`param-examples-failed`,children:_jsxs(_components.p,{children:[`How many examples could not be scored at all, and are left out of every figure. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`examples_partial`,type:`integer`,id:`param-examples-partial`,children:_jsxs(_components.p,{children:[`How many examples were scored, but with part of their ground truth unusable. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`ground_truth_records_rejected`,type:`integer`,id:`param-ground-truth-records-rejected`,children:_jsxs(_components.p,{children:[`How many ground-truth records, over every example scored, could not be matched to any\nprediction and were dropped. An example that failed is not counted. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsxs(Heading,{level:`3`,id:`constraint-verdict-metrics_report-constraints`,children:[`Constraint verdict (`,_jsx(_components.code,{children:`metrics_report.constraints[]`}),`)`]}),`\n`,_jsxs(_components.p,{children:[`What a run measured against one of its constraints. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]}),`\n`,_jsx(ResponseField,{name:`constraint`,type:`object`,required:true,id:`param-constraint`,children:_jsxs(_components.p,{children:[`The constraint judged: its `,_jsx(_components.code,{children:`objective`}),`, and its `,_jsx(_components.code,{children:`min`}),`, `,_jsx(_components.code,{children:`max`}),`, or both.`]})}),`\n`,_jsx(ResponseField,{name:`value`,type:`number`,id:`param-value`,children:_jsxs(_components.p,{children:[`The objective’s value. `,_jsx(_components.code,{children:`null`}),` when it has none, as when nothing it reads was scored.`]})}),`\n`,_jsx(ResponseField,{name:`satisfied`,type:`boolean`,id:`param-satisfied`,children:_jsxs(_components.p,{children:[`Whether the value respects the bounds. `,_jsx(_components.code,{children:`null`}),` when there is no value to judge.`]})}),`\n`,_jsxs(Heading,{level:`3`,id:`target-report-metrics_report-targets-\u003ctarget-name>`,children:[`Target report (`,_jsx(_components.code,{children:`metrics_report.targets.\u003ctarget name>`}),`)`]}),`\n`,_jsxs(_components.p,{children:[`What was measured for one target, over the whole run or over one example. The fields after\n`,_jsx(_components.code,{children:`aggregate`}),` depend on the target’s `,_jsx(_components.code,{children:`type`}),`.`]}),`\n`,_jsx(ResponseField,{name:`aggregate`,type:`object`,required:true,id:`param-aggregate`,children:_jsxs(_components.p,{children:[`Every objective computed for the target, by name, over what the report covers: for the whole\nrun, computed as the headline’s `,_jsx(_components.code,{children:`aggregation`}),` says. A value is `,_jsx(_components.code,{children:`null`}),` when nothing was scored.`]})}),`\n`,_jsxs(ResponseField,{name:`objective_params`,type:`object`,id:`param-objective-params`,children:[_jsxs(_components.p,{children:[`What each objective was declared with, by name, for every objective declared with arguments or\nunder a name other than its catalog objective’s: its arguments, plus the catalog objective as\n`,_jsx(_components.code,{children:`objective`}),` when the name is not its own. For example,\n`,_jsx(_components.code,{children:`{\"recall_anomaly\": {\"objective\": \"recall\", \"class\": \"anomaly\"}}`}),`. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]}),_jsx(Note,{children:_jsxs(_components.p,{children:[`Starting with `,_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-1`,children:`version 2.0.1`}),`, an objective declared with an\n`,_jsx(_components.code,{children:`if_undefined`}),` is listed here too, with its `,_jsx(_components.code,{children:`if_undefined`}),`.`]})})]}),`\n`,_jsx(ResponseField,{name:`defaulted`,type:`array`,id:`param-defaulted`,children:_jsxs(_components.p,{children:[`The objectives in `,_jsx(_components.code,{children:`aggregate`}),` that have no value of their own and report the value they were\ndeclared to take in that case (their `,_jsx(_components.code,{children:`if_undefined`}),`) instead. Over the whole run, only\nobjectives computed `,_jsx(_components.code,{children:`pooled`}),` are listed; for an objective computed `,_jsx(_components.code,{children:`per_example`}),`, see\n`,_jsx(_components.code,{children:`per_example.defaulted`}),`. Absent when empty. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-1`,children:`v2.0.1+`})})]})}),`\n`,_jsx(ResponseField,{name:`type`,type:`string`,required:true,id:`param-type`,children:_jsxs(_components.p,{children:[`The target’s type: `,_jsx(_components.code,{children:`category`}),` (one class per scored item) or `,_jsx(_components.code,{children:`binary`}),` (one of two classes per\nscored item, one of them its positive class). `,_jsx(_components.code,{children:`binary`}),` is from `,_jsx(_components.code,{children:`v2`}),`; reports of schema `,_jsx(_components.code,{children:`v1`}),`\nalso describe a `,_jsx(_components.code,{children:`binary`}),` target as `,_jsx(_components.code,{children:`category`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`class_names`,type:`array`,required:true,id:`param-class-names`,children:_jsx(_components.p,{children:`The class vocabulary, fixing the order of every per-class list and of the confusion matrix.`})}),`\n`,_jsxs(ResponseField,{name:`per_class`,type:`object`,required:true,id:`param-per-class`,children:[_jsxs(_components.p,{children:[`Per-class figures, each a list in `,_jsx(_components.code,{children:`class_names`}),` order. A figure is `,_jsx(_components.code,{children:`null`}),` where there is\nnothing to compute it from, rather than `,_jsx(_components.code,{children:`0`}),`.`]}),_jsx(Note,{children:_jsxs(_components.p,{children:[`Starting with `,_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`version 2.0.0`}),`, a per-class figure with nothing to compute it from is `,_jsx(_components.code,{children:`null`}),`. Earlier\nversions reported `,_jsx(_components.code,{children:`0`}),`.`]})}),_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`precision`}),` (array of numbers) — of the items predicted as the class, the fraction that truly\nwere. `,_jsx(_components.code,{children:`null`}),` for a class never predicted.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`recall`}),` (array of numbers) — of the items truly of the class, the fraction predicted as it.\n`,_jsx(_components.code,{children:`null`}),` for a class that never occurs.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`f1`}),` (array of numbers) — harmonic mean of precision and recall, per class. `,_jsx(_components.code,{children:`null`}),` for a class\nneither occurring nor predicted.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`support`}),` (array of integers) — how many items truly of the class were scored.`]}),`\n`]})]}),`\n`,_jsx(ResponseField,{name:`confusion_matrix`,type:`array`,required:true,id:`param-confusion-matrix`,children:_jsxs(_components.p,{children:[`Row = true class, column = predicted class, both in `,_jsx(_components.code,{children:`class_names`}),` order. Counts the items where\nboth a prediction and a ground truth were found.`]})}),`\n`,_jsx(ResponseField,{name:`positive`,type:`string`,id:`param-positive`,children:_jsxs(_components.p,{children:[_jsx(_components.code,{children:`binary`}),` targets only, and required for them: the class standing for the condition the target\ndetects, one of `,_jsx(_components.code,{children:`class_names`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`background`,type:`string`,id:`param-background`,children:_jsxs(_components.p,{children:[_jsx(_components.code,{children:`category`}),` targets only: the class meaning that nothing happened, one of `,_jsx(_components.code,{children:`class_names`}),`, when\nthe target names one. This is the class the foreground and detection objectives set apart.`]})}),`\n`,_jsx(ResponseField,{name:`missed`,type:`array`,id:`param-missed`,children:_jsxs(_components.p,{children:[`Per true class, the ground truths that got no prediction. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`false_alarms`,type:`array`,id:`param-false-alarms`,children:_jsxs(_components.p,{children:[`Per predicted class, the predictions that had no ground truth. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsxs(ResponseField,{name:`outcomes`,type:`object`,id:`param-outcomes`,children:[_jsxs(_components.p,{children:[`How many scored items ended in each outcome, for a target whose pairing can leave a prediction\nor a ground truth unmatched. From `,_jsx(_components.code,{children:`v2`}),`.`]}),_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`matched`}),` (integer, required) — items with both a prediction and a truth.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`missed`}),` (integer, required) — truths with no prediction.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`false_alarms`}),` (integer, required) — predictions with no truth.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`unscored`}),` (integer, required) — predictions outside the annotated coverage, counted in no\ndenominator.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`failed`}),` (integer, required) — items whose ground truth could not be read, counted in no\ndenominator.`]}),`\n`]})]}),`\n`,_jsx(ResponseField,{name:`pairing`,type:`string`,id:`param-pairing`,children:_jsxs(_components.p,{children:[`How the target’s predictions were paired with its ground truth into scored items. Currently\nalways `,_jsx(_components.code,{children:`by_time`}),`. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`items`,type:`integer`,id:`param-items`,children:_jsxs(_components.p,{children:[`How many items were scored. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`items_failed`,type:`integer`,id:`param-items-failed`,children:_jsxs(_components.p,{children:[`How many of those items could not be judged, their ground truth being unreadable. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsxs(ResponseField,{name:`per_example`,type:`object`,id:`param-per-example`,children:[_jsxs(_components.p,{children:[`Over the whole run only: each objective’s per-example values summarized, keyed by objective\nname. Only the examples where the objective has a value count, including the value it takes from its `,_jsx(_components.code,{children:`if_undefined`}),`. An objective’s summary is `,_jsx(_components.code,{children:`null`}),`\nwhen no example has a value for it. From `,_jsx(_components.code,{children:`v2`}),`.`]}),_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`mean`}),` (number, required) — the mean of the values.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`min`}),` (number, required) — the lowest value.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`median`}),` (number, required) — the median value; the mean of the two middle ones for an even\ncount.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`max`}),` (number, required) — the highest value.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`p90`}),` (number, required) — the 90th percentile, interpolating linearly between values.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`excluded`}),` (integer, required) — how many examples had no value, and are left out of every\nfigure here.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`defaulted`}),` (integer) — how many examples had no value of their own and count with the\nobjective’s `,_jsx(_components.code,{children:`if_undefined`}),` value in every figure here. Absent when none did. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-1`,children:`v2.0.1+`})})]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`stderr`}),` (number) — the standard error of the mean, or `,_jsx(_components.code,{children:`null`}),` with fewer than two values.`]}),`\n`]})]}),`\n`,_jsxs(Heading,{level:`3`,id:`output-artifact-ref-output_artifacts`,children:[`Output artifact ref (`,_jsx(_components.code,{children:`output_artifacts[]`}),`)`]}),`\n`,_jsx(ResponseField,{name:`type`,type:`string`,required:true,id:`param-type-1`,children:_jsxs(_components.p,{children:[`Storage kind, e.g. `,_jsx(_components.code,{children:`file`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`id`,type:`string`,required:true,id:`param-id-1`,children:_jsx(_components.p,{children:`Data-service file id, so the artifact is downloadable through the files API.`})}),`\n`,_jsx(ResponseField,{name:`format`,type:`string`,id:`param-format`,children:_jsx(_components.p,{children:`Optional format hint.`})}),`\n`,_jsx(ResponseField,{name:`crc32c`,type:`string`,id:`param-crc32c`,children:_jsxs(_components.p,{children:[`Whole-file CRC32C checksum of the referenced bytes, base64-encoded exactly as S3 emits it.\n`,_jsx(_components.code,{children:`null`}),` when the data service has no checksum for the file.`]})}),`\n`,_jsxs(ResponseField,{name:`metadata`,type:`object`,id:`param-metadata-1`,children:[_jsx(_components.p,{children:`For one of an eval’s predictions files: which file it is, and how complete.`}),_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`kind`}),` (string, required) — which artifact this is among the eval’s outputs: `,_jsx(_components.code,{children:`predictions`}),`\nfor a predictions file.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`status`}),` (string, required) — `,_jsx(_components.code,{children:`complete`}),` when the file holds every scored item, or `,_jsx(_components.code,{children:`partial`}),`\nwhen it holds only the items scored so far.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`row_count`}),` (integer, required) — rows in the file: how many scored items a reader will find\nin it, one per row.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`target`}),` (string) — the target whose predictions the file holds: an eval writes one\npredictions file per target it scores. Absent on a file from an eval that wrote a single\npredictions file for all its targets.`]}),`\n`]})]}),`\n`,`\n`,`\n`,_jsx(Heading,{level:`2`,id:`important-notes`,children:`Important Notes`}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`The run-level figure is every example pooled, never the mean of the per-example results from\n`,_jsx(_components.a,{href:`/api-reference/agents/evals/list-eval-examples`,children:`List Eval Examples`}),`.`]})})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"codeStyling":"system","config":{},"pageMetadata":{"title":"Get Eval","api":"GET /agents/evals/{eval_id}","description":"Retrieve one eval, its status, and its metrics report","tag":"v1.1.12+","href":"/api-reference/agents/evals/get-eval"}}},"mdxSourceWithNoJs":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,code:`code`,em:`em`,li:`li`,p:`p`,pre:`pre`,span:`span`,ul:`ul`,..._provideComponents(),...props.components},{Badge,Callout,CodeBlock,Heading,Note,ParamField,RequestExample,ResponseExample,ResponseField}=_components;if(!Badge)_missingMdxReference(`Badge`,true);if(!Callout)_missingMdxReference(`Callout`,true);if(!CodeBlock)_missingMdxReference(`CodeBlock`,true);if(!Heading)_missingMdxReference(`Heading`,true);if(!Note)_missingMdxReference(`Note`,true);if(!ParamField)_missingMdxReference(`ParamField`,true);if(!RequestExample)_missingMdxReference(`RequestExample`,true);if(!ResponseExample)_missingMdxReference(`ResponseExample`,true);if(!ResponseField)_missingMdxReference(`ResponseField`,true);return _jsxs(_Fragment,{children:[_jsx(Callout,{icon:`clock`,color:`#3064E3`,iconType:`solid`,children:_jsxs(_components.p,{children:[`Requires `,_jsx(_components.a,{href:`/release-notes/1.1.x#v1-1-12`,children:`version 1.1.12`}),` or later of the Archetype platform.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`overview`,children:`Overview`}),`\n`,_jsxs(_components.p,{children:[`This endpoint returns one eval by its `,_jsx(_components.code,{children:`evl_`}),` id. An eval in a\n`,_jsx(_components.a,{href:`/api-reference/projects/about`,children:`project`}),` you cannot see returns `,_jsx(_components.code,{children:`404`}),`.`]}),`\n`,_jsx(_components.p,{children:`Fields beyond the always-present ones are populated as the eval progresses:`}),`\n`,_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`started_at`}),` is populated when scoring begins.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`output_artifacts`}),` fills in while the eval runs. An entry whose `,_jsx(_components.code,{children:`metadata.status`}),` is `,_jsx(_components.code,{children:`partial`}),`\nholds the rows scored so far, which is also what a failed or cancelled mid-run eval leaves\nbehind.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`metrics_report`}),` is populated once the eval is `,_jsx(_components.code,{children:`completed`}),`.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`completed_at`}),` is populated when the eval reaches a terminal status.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`error`}),` is populated when the eval `,_jsx(_components.code,{children:`failed`}),`.`]}),`\n`]}),`\n`,_jsxs(_components.p,{children:[`The `,_jsx(_components.code,{children:`metrics_report`}),` answers the question “is this agent good enough?” To answer “where is this\nagent bad?” page through `,_jsx(_components.a,{href:`/api-reference/agents/evals/list-eval-examples`,children:`List Eval Examples`}),`.`]}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`The HTTP status code returned is `,_jsx(_components.code,{children:`404`}),` both if the specified eval ID is unknown and if the ID\nexists but belongs to another organization.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`request`,children:`Request`}),`\n`,_jsx(ParamField,{path:`eval_id`,type:`string`,required:true,id:`param-eval-id`,children:_jsxs(_components.p,{children:[`Eval `,_jsx(_components.code,{children:`evl_`}),` id.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`response`,children:`Response`}),`\n`,_jsx(ResponseField,{name:`id`,type:`string`,required:true,id:`param-id`,children:_jsxs(_components.p,{children:[`The eval’s `,_jsx(_components.code,{children:`evl_`}),` id.`]})}),`\n`,_jsx(ResponseField,{name:`name`,type:`string`,required:true,id:`param-name`,children:_jsx(_components.p,{children:`Human label given on create. Empty when none was given.`})}),`\n`,_jsx(ResponseField,{name:`org_id`,type:`string`,required:true,id:`param-org-id`,children:_jsx(_components.p,{children:`The organization that owns the eval.`})}),`\n`,_jsx(ResponseField,{name:`blueprint_id`,type:`string`,required:true,id:`param-blueprint-id`,children:_jsx(_components.p,{children:`The blueprint being evaluated.`})}),`\n`,_jsx(ResponseField,{name:`primary`,type:`string`,required:true,id:`param-primary`,children:_jsxs(_components.p,{children:[`The run’s headline, as `,_jsx(_components.code,{children:`\u003ctarget>.\u003cobjective>`}),` — resolved at creation, so this is what was\nactually scored rather than what was asked for.`]})}),`\n`,_jsxs(ResponseField,{name:`resolved_targets`,type:`object`,required:true,id:`param-resolved-targets`,children:[_jsxs(_components.p,{children:[`The objectives this run computes, keyed by target name; each value is an array of objectives,\neach a bare name or written in full with its arguments, as in a `,_jsx(_components.a,{href:`/api-reference/agents/evals/create-eval#target-override-targets-%3Ctarget-name%3E`,children:`target\noverride`}),`. This\nis the blueprint’s own declaration folded together with the request’s per-target overrides,\nresolved at creation. `,_jsx(_components.code,{children:`primary`}),` names one of these, as `,_jsx(_components.code,{children:`\u003ctarget>.\u003cname>`}),`.`]}),_jsx(Note,{children:_jsxs(_components.p,{children:[_jsx(_components.code,{children:`examples`}),` records what the run actually read; that is, resolved names, the CRC32C of the\nbytes scored, and fully-resolved ground-truth declarations, rather than what the request asked\nfor.`]})}),_jsxs(_components.p,{children:[`Each input’s `,_jsx(_components.code,{children:`metadata`}),` carries the service-written `,_jsx(_components.code,{children:`targets`}),` and `,_jsx(_components.code,{children:`example_name`}),` keys; see\n`,_jsx(_components.a,{href:`/api-reference/agents/evals/create-eval#resolved-input-ref-examples-inputs`,children:`Resolved input ref`}),`.`]})]}),`\n`,_jsx(ResponseField,{name:`constraints`,type:`array`,required:true,id:`param-constraints`,children:_jsxs(_components.p,{children:[`The bounds the run reports a verdict on, resolved at creation: the request’s, or else the\nblueprint’s. Empty when there are none. See\n`,_jsx(_components.a,{href:`/api-reference/agents/evals/create-eval#constraint-constraints`,children:`Constraint`}),`. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]})}),`\n`,_jsx(ResponseField,{name:`emit_predictions`,type:`boolean`,required:true,id:`param-emit-predictions`,children:_jsxs(_components.p,{children:[`Whether the run emits the predictions artifacts alongside the metrics report, one per target,\nas the request asked. When `,_jsx(_components.code,{children:`true`}),`, they appear in `,_jsx(_components.code,{children:`output_artifacts`}),` as the run produces them.`]})}),`\n`,_jsx(ResponseField,{name:`examples`,type:`array`,required:true,id:`param-examples`,children:_jsxs(_components.p,{children:[`The examples the eval was created against, as resolved: each carries the name its results are\nkeyed by, and inputs stamped with the CRC32C of the bytes scored. See `,_jsx(_components.a,{href:`#resolved-example-object-examples`,children:`Resolved example\nobject`}),` for the format of the objects in this array.`]})}),`\n`,_jsxs(ResponseField,{name:`status`,type:`string`,required:true,id:`param-status`,children:[_jsxs(_components.p,{children:[`The eval’s current lifecycle status: `,_jsx(_components.code,{children:`pending`}),`, `,_jsx(_components.code,{children:`running`}),`, `,_jsx(_components.code,{children:`completed`}),`, `,_jsx(_components.code,{children:`failed`}),`, or\n`,_jsx(_components.code,{children:`cancelled`}),`.`]}),_jsx(Note,{children:_jsxs(_components.p,{children:[`Evals are always created with the status `,_jsx(_components.code,{children:`pending`}),`. Once they’re dispatched, their state\nchanges to `,_jsx(_components.code,{children:`running`}),`. From there, it will eventually enter one of the three terminal states:\n`,_jsx(_components.code,{children:`completed`}),`, `,_jsx(_components.code,{children:`failed`}),`, or `,_jsx(_components.code,{children:`cancelled`}),`. A `,_jsx(_components.code,{children:`pending`}),` eval can also be cancelled directly.`]})})]}),`\n`,_jsx(ResponseField,{name:`project_id`,type:`string`,id:`param-project-id`,children:_jsxs(_components.p,{children:[`The `,_jsx(_components.a,{href:`/api-reference/projects/about`,children:`project`}),` the eval is in: its blueprint’s. This value is `,_jsx(_components.code,{children:`null`}),` outside any\nproject. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]})}),`\n`,_jsx(ResponseField,{name:`created_by`,type:`string`,required:true,id:`param-created-by`,children:_jsxs(_components.p,{children:[`Subject id (`,_jsx(_components.code,{children:`usr_...`}),` or `,_jsx(_components.code,{children:`key_...`}),`) that created this eval.`]})}),`\n`,_jsx(ResponseField,{name:`created_at`,type:`string`,required:true,id:`param-created-at`,children:_jsx(_components.p,{children:`When the eval was created (date-time).`})}),`\n`,_jsx(ResponseField,{name:`started_at`,type:`string`,id:`param-started-at`,children:_jsxs(_components.p,{children:[`When scoring began (date-time). Absent while `,_jsx(_components.code,{children:`pending`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`completed_at`,type:`string`,id:`param-completed-at`,children:_jsx(_components.p,{children:`When the eval reached a terminal status (date-time). Absent until then.`})}),`\n`,_jsx(ResponseField,{name:`metrics_report`,type:`object`,id:`param-metrics-report`,children:_jsxs(_components.p,{children:[`What the run measured: its headline score and what was measured for each target. Present once\nthe eval is `,_jsx(_components.code,{children:`completed`}),`; absent while it is pending or running, and on a cancelled or failed\neval. See `,_jsx(_components.a,{href:`#metrics-report-metrics_report`,children:`Metrics report`}),` for the format of this object.`]})}),`\n`,_jsxs(ResponseField,{name:`output_artifacts`,type:`array`,id:`param-output-artifacts`,children:[_jsxs(_components.p,{children:[`Refs to the files the run produced. Each `,_jsx(_components.code,{children:`id`}),` is a data-service file id, so an artifact is\ndownloadable through the files API, and each carries `,_jsx(_components.code,{children:`metadata`}),` saying which artifact it is.\nSee `,_jsx(_components.a,{href:`#output-artifact-ref-output_artifacts`,children:`Output artifact ref`}),` for the format of the objects\nin this array.`]}),_jsxs(_components.p,{children:[`Populated `,_jsx(_components.em,{children:`while the run goes`}),`, not only at the end: each batch of scored rows is appended to\nthe predictions file and updates the entry, whose `,_jsx(_components.code,{children:`metadata.status`}),` stays `,_jsx(_components.code,{children:`partial`}),` until the\nrun’s final push marks it `,_jsx(_components.code,{children:`complete`}),`. An eval that failed or was cancelled mid-run keeps its\npartial entry — the rows scored so far are still readable.`]})]}),`\n`,_jsx(ResponseField,{name:`error`,type:`string`,id:`param-error`,children:_jsxs(_components.p,{children:[`Why the eval failed. Present only when `,_jsx(_components.code,{children:`status`}),` is `,_jsx(_components.code,{children:`failed`}),`.`]})}),`\n`,_jsxs(Heading,{level:`3`,id:`resolved-example-object-examples`,children:[`Resolved example object (`,_jsx(_components.code,{children:`examples[]`}),`)`]}),`\n`,_jsx(_components.p,{children:`One example of a run, as the run recorded it: named, positioned, and with its inputs pinned to\nthe bytes it read.`}),`\n`,_jsx(ResponseField,{name:`name`,type:`string`,required:true,id:`param-name-1`,children:_jsx(_components.p,{children:`How this example is identified in the run’s results. Unique within the eval.`})}),`\n`,_jsx(ResponseField,{name:`ordinal`,type:`integer`,required:true,id:`param-ordinal`,children:_jsx(_components.p,{children:`The example’s 1-based position in the run, fixing the order results are listed in.`})}),`\n`,_jsx(ResponseField,{name:`inputs`,type:`array`,required:true,id:`param-inputs`,children:_jsxs(_components.p,{children:[`The data handed to the agent, each ref carrying the CRC32C of the bytes scored, in its `,_jsx(_components.code,{children:`crc32c`}),`\nfield.`]})}),`\n`,_jsx(ResponseField,{name:`ground_truth`,type:`object`,id:`param-ground-truth`,children:_jsxs(_components.p,{children:[`The ground truth the example was created with, if it declared any. Same shape as the\n`,_jsx(_components.a,{href:`/api-reference/agents/evals/create-eval#param-ground-truth`,children:_jsx(_components.code,{children:`ground_truth`})}),` of a request\nexample.`]})}),`\n`,_jsx(ResponseField,{name:`binding`,type:`object`,id:`param-binding`,children:_jsx(_components.p,{children:`Which targets each of the example’s ground truths serves, as it was created with, if it said.`})}),`\n`,_jsx(ResponseField,{name:`metadata`,type:`object`,id:`param-metadata`,children:_jsx(_components.p,{children:`The free-form tags the example was created with, if any.`})}),`\n`,_jsxs(Heading,{level:`3`,id:`metrics-report-metrics_report`,children:[`Metrics report (`,_jsx(_components.code,{children:`metrics_report`}),`)`]}),`\n`,_jsx(_components.p,{children:`What an eval run measured over the whole run: its headline score, and what was measured for\neach target.`}),`\n`,_jsxs(_components.p,{children:[_jsx(_components.code,{children:`schema_version`}),` says which fields are present. Reports from `,_jsx(_components.code,{children:`v2`}),` on carry the example counts,\nthe headline’s `,_jsx(_components.code,{children:`aggregation`}),`, and each target’s `,_jsx(_components.code,{children:`pairing`}),`, item counts, and per-example summary;\n`,_jsx(_components.code,{children:`v1`}),` reports carry none of them.`]}),`\n`,_jsx(ResponseField,{name:`schema_version`,type:`string`,required:true,id:`param-schema-version`,children:_jsxs(_components.p,{children:[`The report’s schema version, `,_jsx(_components.code,{children:`v1`}),` or `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsxs(ResponseField,{name:`primary`,type:`object`,required:true,id:`param-primary-1`,children:[_jsxs(_components.p,{children:[`The run’s headline score. Repeats a value that also appears in the named target’s `,_jsx(_components.code,{children:`aggregate`}),`,\nso a reader wanting the one number the run is judged by gets it without following a pointer.`]}),_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`target`}),` (string, required) — the target this headline is about.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`name`}),` (string, required) — the objective’s name, e.g. `,_jsx(_components.code,{children:`macro_f1`}),`.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`value`}),` (number) — its value, or `,_jsx(_components.code,{children:`null`}),` when nothing was scored.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`aggregation`}),` (string) — how the value was computed from the run’s examples: `,_jsx(_components.code,{children:`pooled`}),` or\n`,_jsx(_components.code,{children:`per_example`}),`. From `,_jsx(_components.code,{children:`v2`}),`.`]}),`\n`]})]}),`\n`,_jsx(ResponseField,{name:`targets`,type:`object`,required:true,id:`param-targets`,children:_jsxs(_components.p,{children:[`One entry per scored target, keyed by target name. See `,_jsx(_components.a,{href:`#target-report-metrics_report-targets-%3Ctarget-name%3E`,children:`Target\nreport`}),` for the format of a target\nrecord.`]})}),`\n`,_jsx(ResponseField,{name:`constraints`,type:`array`,id:`param-constraints-1`,children:_jsxs(_components.p,{children:[`What the run measured against each of its constraints, over the whole run. See `,_jsx(_components.a,{href:`#constraint-verdict-metrics_report-constraints`,children:`Constraint\nverdict`}),`. Absent when the run has no\nconstraints. Missing a constraint does not fail the run. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]})}),`\n`,_jsx(ResponseField,{name:`feasible`,type:`boolean`,id:`param-feasible`,children:_jsxs(_components.p,{children:[`Whether every constraint holds: `,_jsx(_components.code,{children:`false`}),` when one is missed, `,_jsx(_components.code,{children:`null`}),` when none is missed but one\ncannot be judged because its objective has no value. Present whenever `,_jsx(_components.code,{children:`constraints`}),` is. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]})}),`\n`,_jsx(ResponseField,{name:`example_count`,type:`integer`,id:`param-example-count`,children:_jsxs(_components.p,{children:[`How many examples the run has. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`examples_failed`,type:`integer`,id:`param-examples-failed`,children:_jsxs(_components.p,{children:[`How many examples could not be scored at all, and are left out of every figure. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`examples_partial`,type:`integer`,id:`param-examples-partial`,children:_jsxs(_components.p,{children:[`How many examples were scored, but with part of their ground truth unusable. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`ground_truth_records_rejected`,type:`integer`,id:`param-ground-truth-records-rejected`,children:_jsxs(_components.p,{children:[`How many ground-truth records, over every example scored, could not be matched to any\nprediction and were dropped. An example that failed is not counted. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsxs(Heading,{level:`3`,id:`constraint-verdict-metrics_report-constraints`,children:[`Constraint verdict (`,_jsx(_components.code,{children:`metrics_report.constraints[]`}),`)`]}),`\n`,_jsxs(_components.p,{children:[`What a run measured against one of its constraints. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]}),`\n`,_jsx(ResponseField,{name:`constraint`,type:`object`,required:true,id:`param-constraint`,children:_jsxs(_components.p,{children:[`The constraint judged: its `,_jsx(_components.code,{children:`objective`}),`, and its `,_jsx(_components.code,{children:`min`}),`, `,_jsx(_components.code,{children:`max`}),`, or both.`]})}),`\n`,_jsx(ResponseField,{name:`value`,type:`number`,id:`param-value`,children:_jsxs(_components.p,{children:[`The objective’s value. `,_jsx(_components.code,{children:`null`}),` when it has none, as when nothing it reads was scored.`]})}),`\n`,_jsx(ResponseField,{name:`satisfied`,type:`boolean`,id:`param-satisfied`,children:_jsxs(_components.p,{children:[`Whether the value respects the bounds. `,_jsx(_components.code,{children:`null`}),` when there is no value to judge.`]})}),`\n`,_jsxs(Heading,{level:`3`,id:`target-report-metrics_report-targets-\u003ctarget-name>`,children:[`Target report (`,_jsx(_components.code,{children:`metrics_report.targets.\u003ctarget name>`}),`)`]}),`\n`,_jsxs(_components.p,{children:[`What was measured for one target, over the whole run or over one example. The fields after\n`,_jsx(_components.code,{children:`aggregate`}),` depend on the target’s `,_jsx(_components.code,{children:`type`}),`.`]}),`\n`,_jsx(ResponseField,{name:`aggregate`,type:`object`,required:true,id:`param-aggregate`,children:_jsxs(_components.p,{children:[`Every objective computed for the target, by name, over what the report covers: for the whole\nrun, computed as the headline’s `,_jsx(_components.code,{children:`aggregation`}),` says. A value is `,_jsx(_components.code,{children:`null`}),` when nothing was scored.`]})}),`\n`,_jsxs(ResponseField,{name:`objective_params`,type:`object`,id:`param-objective-params`,children:[_jsxs(_components.p,{children:[`What each objective was declared with, by name, for every objective declared with arguments or\nunder a name other than its catalog objective’s: its arguments, plus the catalog objective as\n`,_jsx(_components.code,{children:`objective`}),` when the name is not its own. For example,\n`,_jsx(_components.code,{children:`{\"recall_anomaly\": {\"objective\": \"recall\", \"class\": \"anomaly\"}}`}),`. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`v2.0.0+`})})]}),_jsx(Note,{children:_jsxs(_components.p,{children:[`Starting with `,_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-1`,children:`version 2.0.1`}),`, an objective declared with an\n`,_jsx(_components.code,{children:`if_undefined`}),` is listed here too, with its `,_jsx(_components.code,{children:`if_undefined`}),`.`]})})]}),`\n`,_jsx(ResponseField,{name:`defaulted`,type:`array`,id:`param-defaulted`,children:_jsxs(_components.p,{children:[`The objectives in `,_jsx(_components.code,{children:`aggregate`}),` that have no value of their own and report the value they were\ndeclared to take in that case (their `,_jsx(_components.code,{children:`if_undefined`}),`) instead. Over the whole run, only\nobjectives computed `,_jsx(_components.code,{children:`pooled`}),` are listed; for an objective computed `,_jsx(_components.code,{children:`per_example`}),`, see\n`,_jsx(_components.code,{children:`per_example.defaulted`}),`. Absent when empty. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-1`,children:`v2.0.1+`})})]})}),`\n`,_jsx(ResponseField,{name:`type`,type:`string`,required:true,id:`param-type`,children:_jsxs(_components.p,{children:[`The target’s type: `,_jsx(_components.code,{children:`category`}),` (one class per scored item) or `,_jsx(_components.code,{children:`binary`}),` (one of two classes per\nscored item, one of them its positive class). `,_jsx(_components.code,{children:`binary`}),` is from `,_jsx(_components.code,{children:`v2`}),`; reports of schema `,_jsx(_components.code,{children:`v1`}),`\nalso describe a `,_jsx(_components.code,{children:`binary`}),` target as `,_jsx(_components.code,{children:`category`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`class_names`,type:`array`,required:true,id:`param-class-names`,children:_jsx(_components.p,{children:`The class vocabulary, fixing the order of every per-class list and of the confusion matrix.`})}),`\n`,_jsxs(ResponseField,{name:`per_class`,type:`object`,required:true,id:`param-per-class`,children:[_jsxs(_components.p,{children:[`Per-class figures, each a list in `,_jsx(_components.code,{children:`class_names`}),` order. A figure is `,_jsx(_components.code,{children:`null`}),` where there is\nnothing to compute it from, rather than `,_jsx(_components.code,{children:`0`}),`.`]}),_jsx(Note,{children:_jsxs(_components.p,{children:[`Starting with `,_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-0`,children:`version 2.0.0`}),`, a per-class figure with nothing to compute it from is `,_jsx(_components.code,{children:`null`}),`. Earlier\nversions reported `,_jsx(_components.code,{children:`0`}),`.`]})}),_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`precision`}),` (array of numbers) — of the items predicted as the class, the fraction that truly\nwere. `,_jsx(_components.code,{children:`null`}),` for a class never predicted.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`recall`}),` (array of numbers) — of the items truly of the class, the fraction predicted as it.\n`,_jsx(_components.code,{children:`null`}),` for a class that never occurs.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`f1`}),` (array of numbers) — harmonic mean of precision and recall, per class. `,_jsx(_components.code,{children:`null`}),` for a class\nneither occurring nor predicted.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`support`}),` (array of integers) — how many items truly of the class were scored.`]}),`\n`]})]}),`\n`,_jsx(ResponseField,{name:`confusion_matrix`,type:`array`,required:true,id:`param-confusion-matrix`,children:_jsxs(_components.p,{children:[`Row = true class, column = predicted class, both in `,_jsx(_components.code,{children:`class_names`}),` order. Counts the items where\nboth a prediction and a ground truth were found.`]})}),`\n`,_jsx(ResponseField,{name:`positive`,type:`string`,id:`param-positive`,children:_jsxs(_components.p,{children:[_jsx(_components.code,{children:`binary`}),` targets only, and required for them: the class standing for the condition the target\ndetects, one of `,_jsx(_components.code,{children:`class_names`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`background`,type:`string`,id:`param-background`,children:_jsxs(_components.p,{children:[_jsx(_components.code,{children:`category`}),` targets only: the class meaning that nothing happened, one of `,_jsx(_components.code,{children:`class_names`}),`, when\nthe target names one. This is the class the foreground and detection objectives set apart.`]})}),`\n`,_jsx(ResponseField,{name:`missed`,type:`array`,id:`param-missed`,children:_jsxs(_components.p,{children:[`Per true class, the ground truths that got no prediction. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`false_alarms`,type:`array`,id:`param-false-alarms`,children:_jsxs(_components.p,{children:[`Per predicted class, the predictions that had no ground truth. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsxs(ResponseField,{name:`outcomes`,type:`object`,id:`param-outcomes`,children:[_jsxs(_components.p,{children:[`How many scored items ended in each outcome, for a target whose pairing can leave a prediction\nor a ground truth unmatched. From `,_jsx(_components.code,{children:`v2`}),`.`]}),_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`matched`}),` (integer, required) — items with both a prediction and a truth.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`missed`}),` (integer, required) — truths with no prediction.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`false_alarms`}),` (integer, required) — predictions with no truth.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`unscored`}),` (integer, required) — predictions outside the annotated coverage, counted in no\ndenominator.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`failed`}),` (integer, required) — items whose ground truth could not be read, counted in no\ndenominator.`]}),`\n`]})]}),`\n`,_jsx(ResponseField,{name:`pairing`,type:`string`,id:`param-pairing`,children:_jsxs(_components.p,{children:[`How the target’s predictions were paired with its ground truth into scored items. Currently\nalways `,_jsx(_components.code,{children:`by_time`}),`. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`items`,type:`integer`,id:`param-items`,children:_jsxs(_components.p,{children:[`How many items were scored. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`items_failed`,type:`integer`,id:`param-items-failed`,children:_jsxs(_components.p,{children:[`How many of those items could not be judged, their ground truth being unreadable. From `,_jsx(_components.code,{children:`v2`}),`.`]})}),`\n`,_jsxs(ResponseField,{name:`per_example`,type:`object`,id:`param-per-example`,children:[_jsxs(_components.p,{children:[`Over the whole run only: each objective’s per-example values summarized, keyed by objective\nname. Only the examples where the objective has a value count, including the value it takes from its `,_jsx(_components.code,{children:`if_undefined`}),`. An objective’s summary is `,_jsx(_components.code,{children:`null`}),`\nwhen no example has a value for it. From `,_jsx(_components.code,{children:`v2`}),`.`]}),_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`mean`}),` (number, required) — the mean of the values.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`min`}),` (number, required) — the lowest value.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`median`}),` (number, required) — the median value; the mean of the two middle ones for an even\ncount.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`max`}),` (number, required) — the highest value.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`p90`}),` (number, required) — the 90th percentile, interpolating linearly between values.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`excluded`}),` (integer, required) — how many examples had no value, and are left out of every\nfigure here.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`defaulted`}),` (integer) — how many examples had no value of their own and count with the\nobjective’s `,_jsx(_components.code,{children:`if_undefined`}),` value in every figure here. Absent when none did. `,_jsx(Badge,{color:`blue`,children:_jsx(_components.a,{href:`/release-notes/2.0.x#v2-0-1`,children:`v2.0.1+`})})]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`stderr`}),` (number) — the standard error of the mean, or `,_jsx(_components.code,{children:`null`}),` with fewer than two values.`]}),`\n`]})]}),`\n`,_jsxs(Heading,{level:`3`,id:`output-artifact-ref-output_artifacts`,children:[`Output artifact ref (`,_jsx(_components.code,{children:`output_artifacts[]`}),`)`]}),`\n`,_jsx(ResponseField,{name:`type`,type:`string`,required:true,id:`param-type-1`,children:_jsxs(_components.p,{children:[`Storage kind, e.g. `,_jsx(_components.code,{children:`file`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`id`,type:`string`,required:true,id:`param-id-1`,children:_jsx(_components.p,{children:`Data-service file id, so the artifact is downloadable through the files API.`})}),`\n`,_jsx(ResponseField,{name:`format`,type:`string`,id:`param-format`,children:_jsx(_components.p,{children:`Optional format hint.`})}),`\n`,_jsx(ResponseField,{name:`crc32c`,type:`string`,id:`param-crc32c`,children:_jsxs(_components.p,{children:[`Whole-file CRC32C checksum of the referenced bytes, base64-encoded exactly as S3 emits it.\n`,_jsx(_components.code,{children:`null`}),` when the data service has no checksum for the file.`]})}),`\n`,_jsxs(ResponseField,{name:`metadata`,type:`object`,id:`param-metadata-1`,children:[_jsx(_components.p,{children:`For one of an eval’s predictions files: which file it is, and how complete.`}),_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`kind`}),` (string, required) — which artifact this is among the eval’s outputs: `,_jsx(_components.code,{children:`predictions`}),`\nfor a predictions file.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`status`}),` (string, required) — `,_jsx(_components.code,{children:`complete`}),` when the file holds every scored item, or `,_jsx(_components.code,{children:`partial`}),`\nwhen it holds only the items scored so far.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`row_count`}),` (integer, required) — rows in the file: how many scored items a reader will find\nin it, one per row.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.code,{children:`target`}),` (string) — the target whose predictions the file holds: an eval writes one\npredictions file per target it scores. Absent on a file from an eval that wrote a single\npredictions file for all its targets.`]}),`\n`]})]}),`\n`,_jsxs(RequestExample,{children:[_jsx(CodeBlock,{filename:`cURL`,numberOfLines:`2`,language:`shellscript`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`shellscript`,children:_jsxs(_components.code,{language:`shellscript`,numberOfLines:`2`,children:[_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#DCDCAA`},children:`curl`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`$ATAI_API_ENDPOINT`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`/agents/evals/evl_01jcb0h2m6t4xr9nv3k7pdzs5y\"`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D7BA7D`},children:` \\\\`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` -H`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"Authorization: Bearer `}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`$ATAI_API_KEY`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"`})]}),`\n`]})})}),_jsx(CodeBlock,{filename:`Python`,numberOfLines:`24`,language:`python`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`python`,children:_jsxs(_components.code,{language:`python`,numberOfLines:`24`,children:[_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:`import`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` os`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:`import`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` time`})]}),`\n`,_jsx(_components.span,{className:`line`}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:`import`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` requests`})]}),`\n`,_jsx(_components.span,{className:`line`}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`base_url `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` os.environ[`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"ATAI_API_ENDPOINT\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`]`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`api_key `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` os.environ[`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"ATAI_API_KEY\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`]`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`headers `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"Authorization\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`f`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"Bearer `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`{`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`api_key`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})]}),`\n`,_jsx(_components.span,{className:`line`}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`eval_id `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"evl_01jcb0h2m6t4xr9nv3k7pdzs5y\"`})]}),`\n`,_jsx(_components.span,{className:`line`}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:`while`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` True`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`:`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` response `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` requests.get(`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`f`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`{`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`base_url`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`/agents/evals/`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`{`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`eval_id`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:`headers`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`headers)`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` evaluation `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` response.json()`})]}),`\n`,_jsx(_components.span,{className:`line`}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:` if`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` evaluation[`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`] `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`in`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` (`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"completed\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"failed\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"cancelled\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`):`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:` break`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` time.sleep(`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`5`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`)`})]}),`\n`,_jsx(_components.span,{className:`line`}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:`if`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` evaluation[`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`] `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`==`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"completed\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`:`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` headline `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` evaluation[`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"metrics_report\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`][`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"primary\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`]`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#DCDCAA`},children:` print`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`(`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`f`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`{`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`headline[`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`'target'`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`]`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`.`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`{`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`headline[`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`'name'`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`]`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` = `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`{`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`headline[`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`'value'`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`]`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`)`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:`else`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`:`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#DCDCAA`},children:` print`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`(`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`f`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`{`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`evaluation[`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`'status'`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`]`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`: `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`{`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`evaluation.get(`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`'error'`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`)`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`)`})]}),`\n`]})})}),_jsx(CodeBlock,{filename:`JavaScript`,numberOfLines:`20`,language:`javascript`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`javascript`,children:_jsxs(_components.code,{language:`javascript`,numberOfLines:`20`,children:[_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`const`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#4FC1FF`},children:` response`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:` =`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:` await`}),_jsx(_components.span,{style:{color:`#8250DF`,\"--shiki-dark\":`#DCDCAA`},children:` fetch`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`(`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:\" `\"}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:\"${\"}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`process`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`env`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#4FC1FF`},children:`ATAI_API_ENDPOINT`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:\"/agents/evals/evl_01jcb0h2m6t4xr9nv3k7pdzs5y`\"}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:` headers:`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` 'Authorization'`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`:`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:\" `Bearer \"}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:\"${\"}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`process`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`env`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#4FC1FF`},children:`ATAI_API_KEY`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:\"`\"})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`);`})}),`\n`,_jsx(_components.span,{className:`line`}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:`const`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#4FC1FF`},children:` body`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:` =`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:` await`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:` response`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#8250DF`,\"--shiki-dark\":`#DCDCAA`},children:`json`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`();`})]}),`\n`,_jsx(_components.span,{className:`line`}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:`if`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` (`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`response`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`ok`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`) {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:` console`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#8250DF`,\"--shiki-dark\":`#DCDCAA`},children:`log`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`(`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:\"`\"}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:\"${\"}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`body`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`name`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` [`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:\"${\"}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`body`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`status`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:\"]`\"}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`);`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:` if`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` (`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`body`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`metrics_report`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`) {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#569CD6`},children:` const`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` { `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#4FC1FF`},children:`target`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#4FC1FF`},children:`name`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#4FC1FF`},children:`value`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` } `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:` body`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`metrics_report`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`primary`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`;`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:` console`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#8250DF`,\"--shiki-dark\":`#DCDCAA`},children:`log`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`(`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:\"`\"}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:\"${\"}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`target`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`.`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:\"${\"}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`name`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` = `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:\"${\"}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`value`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#569CD6`},children:`}`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:\"`\"}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`);`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`} `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#C586C0`},children:`else`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:` console`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#8250DF`,\"--shiki-dark\":`#DCDCAA`},children:`error`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`(`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`'Error:'`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`body`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`.`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`errors`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`);`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})}),`\n`]})})})]}),`\n`,_jsxs(ResponseExample,{children:[_jsx(CodeBlock,{filename:`200 - Completed`,numberOfLines:`115`,language:`json`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`json`,children:_jsxs(_components.code,{language:`json`,numberOfLines:`115`,children:[_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`{`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"evl_01jcb0h2m6t4xr9nv3k7pdzs5y\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"name\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"Pump A regression\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"org_id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"org_01jc8m5r2vq9xt4bn7h3kdzs6w\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"blueprint_id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"blp_01jc9n7k3xf8mbq2v5t0ary6de\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"primary\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"state.macro_f1\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"resolved_targets\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"state\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"macro_f1\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"accuracy\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`]`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"constraints\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"objective\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"state.macro_f1\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"min\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.8`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ],`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"emit_predictions\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:`true`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"examples\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"name\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"site-a-morning\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"ordinal\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`1`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"inputs\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"file\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"file_abc123\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"format\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"csv\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"crc32c\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"AAAAAA==\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ],`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"metadata\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"site\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"a\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"shift\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"morning\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"name\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"site-b-night\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"ordinal\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`2`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"inputs\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"file\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"file_def456\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"format\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"csv\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"crc32c\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"AAAAAA==\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ],`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"metadata\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"site\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"b\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"shift\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"night\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ],`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"completed\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"metrics_report\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"schema_version\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"v2\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"primary\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"target\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"state\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"name\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"macro_f1\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"value\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.84`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"aggregation\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"pooled\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"example_count\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`2`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"examples_failed\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"examples_partial\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"ground_truth_records_rejected\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"constraints\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"constraint\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"objective\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"state.macro_f1\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"min\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.8`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`},`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"value\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.84`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"satisfied\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:`true`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ],`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"feasible\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:`true`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"targets\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"state\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"category\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"aggregate\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"macro_f1\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.84`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:`\"accuracy\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.92`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`},`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"class_names\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"running\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"idle\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"fault_bearing\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`],`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"per_class\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"precision\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.94`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.9`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.67`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`],`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"recall\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.96`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.85`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.69`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`],`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"f1\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.95`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.87`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.68`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`],`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"support\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`4120`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`1880`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`260`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`]`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"confusion_matrix\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` [`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`3955`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`140`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`25`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`],`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` [`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`220`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`1598`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`62`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`],`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` [`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`45`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`36`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`179`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`]`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ],`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"missed\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`],`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"false_alarms\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`, `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`],`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"pairing\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"by_time\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"items\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`6260`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"items_failed\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"per_example\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"macro_f1\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"mean\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.84`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"min\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.81`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"median\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.84`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"max\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.87`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"p90\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.864`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"excluded\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"stderr\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.03`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"accuracy\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"mean\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.92`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"min\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.9`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"median\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.92`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"max\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.94`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"p90\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.936`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"excluded\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"stderr\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`0.02`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` },`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"output_artifacts\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"type\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"file\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"file_jkl012\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"format\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"ndjson\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"crc32c\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"AAAAAA==\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"metadata\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: {`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"kind\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"predictions\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"complete\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"row_count\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`6260`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"target\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"state\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ],`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"created_by\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"usr_01jc8m4p3rt6vx9qn2h5kdzb7y\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"created_at\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"2026-09-18T11:24:03Z\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"started_at\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"2026-09-18T11:24:09Z\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"completed_at\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"2026-09-18T11:31:52Z\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})}),`\n`]})})}),_jsx(CodeBlock,{filename:`404 - Eval not found`,numberOfLines:`10`,language:`json`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`json`,children:_jsxs(_components.code,{language:`json`,numberOfLines:`10`,children:[_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`{`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"errors\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"code\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"\u003cerror_code>\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"message\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"Eval not found.\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"suggestion\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:`null`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"error_uid\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"err-xxxxxxxx\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ]`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})}),`\n`]})})})]}),`\n`,_jsx(Heading,{level:`2`,id:`important-notes`,children:`Important Notes`}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`The run-level figure is every example pooled, never the mean of the per-example results from\n`,_jsx(_components.a,{href:`/api-reference/agents/evals/list-eval-examples`,children:`List Eval Examples`}),`.`]})})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"codeStyling":"system","config":{},"pageMetadata":{"title":"Get Eval","api":"GET /agents/evals/{eval_id}","description":"Retrieve one eval, its status, and its metrics report","tag":"v1.1.12+","href":"/api-reference/agents/evals/get-eval"}}}},"mdxExtracts":{"tableOfContents":[{"title":"Overview","slug":"overview","depth":2,"children":[]},{"title":"Request","slug":"request","depth":2,"children":[]},{"title":"Response","slug":"response","depth":2,"children":[{"title":"Resolved example object (examples[])","slug":"resolved-example-object-examples","depth":3,"children":[]},{"title":"Metrics report (metrics_report)","slug":"metrics-report-metrics_report","depth":3,"children":[]},{"title":"Constraint verdict (metrics_report.constraints[])","slug":"constraint-verdict-metrics_report-constraints","depth":3,"children":[]},{"title":"Target report (metrics_report.targets.\u003ctarget name>)","slug":"target-report-metrics_report-targets-\u003ctarget-name>","depth":3,"children":[]},{"title":"Output artifact ref (output_artifacts[])","slug":"output-artifact-ref-output_artifacts","depth":3,"children":[]}]},{"title":"Important Notes","slug":"important-notes","depth":2,"children":[]}],"codeExamples":{"request":{"type":"RequestExample","children":[{"filename":"cURL","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"shellscript\">\u003ccode language=\"shellscript\" numberOfLines=\"2\">\u003cspan class=\"line\">\u003cspan style=\"color:#953800;--shiki-dark:#DCDCAA\">curl\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> \"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">$ATAI_API_ENDPOINT\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">/agents/evals/evl_01jcb0h2m6t4xr9nv3k7pdzs5y\"\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D7BA7D\"> \\\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> -H\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> \"Authorization: Bearer \u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">$ATAI_API_KEY\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"},{"filename":"Python","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"python\">\u003ccode language=\"python\" numberOfLines=\"24\">\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\">import\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> os\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\">import\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> time\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\">import\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> requests\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">base_url \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> os.environ[\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"ATAI_API_ENDPOINT\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">]\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">api_key \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> os.environ[\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"ATAI_API_KEY\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">]\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">headers \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"Authorization\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">f\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"Bearer \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">{\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">api_key\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">eval_id \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> \"evl_01jcb0h2m6t4xr9nv3k7pdzs5y\"\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\">while\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> True\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">:\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> response \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> requests.get(\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">f\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">{\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">base_url\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">/agents/evals/\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">{\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">eval_id\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#953800;--shiki-dark:#9CDCFE\">headers\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">headers)\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> evaluation \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> response.json()\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\"> if\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> evaluation[\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"status\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">] \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">in\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> (\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"completed\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"failed\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"cancelled\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">):\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\"> break\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> time.sleep(\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">5\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">)\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\">if\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> evaluation[\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"status\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">] \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">==\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> \"completed\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">:\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> headline \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> evaluation[\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"metrics_report\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">][\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"primary\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">]\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#DCDCAA\"> print\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">(\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">f\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">{\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">headline[\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">'target'\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">]\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">.\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">{\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">headline[\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">'name'\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">]\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> = \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">{\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">headline[\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">'value'\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">]\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">)\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\">else\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">:\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#DCDCAA\"> print\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">(\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">f\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">{\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">evaluation[\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">'status'\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">]\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">: \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">{\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">evaluation.get(\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">'error'\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">)\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">)\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"},{"filename":"JavaScript","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"javascript\">\u003ccode language=\"javascript\" numberOfLines=\"20\">\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">const\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#4FC1FF\"> response\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\"> =\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\"> await\u003c/span>\u003cspan style=\"color:#8250DF;--shiki-dark:#DCDCAA\"> fetch\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">(\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> `\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">${\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">process\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">env\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#4FC1FF\">ATAI_API_ENDPOINT\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">/agents/evals/evl_01jcb0h2m6t4xr9nv3k7pdzs5y`\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\"> headers:\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> 'Authorization'\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">:\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> `Bearer \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">${\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">process\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">env\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#4FC1FF\">ATAI_API_KEY\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">`\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">);\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\">const\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#4FC1FF\"> body\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\"> =\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\"> await\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\"> response\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#8250DF;--shiki-dark:#DCDCAA\">json\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">();\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\">if\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> (\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">response\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">ok\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">) {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\"> console\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#8250DF;--shiki-dark:#DCDCAA\">log\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">(\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">`\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">${\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">body\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">name\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> [\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">${\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">body\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">status\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">]`\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">);\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\"> if\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> (\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">body\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">metrics_report\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">) {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#CF222E;--shiki-dark:#569CD6\"> const\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> { \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#4FC1FF\">target\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#4FC1FF\">name\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#4FC1FF\">value\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> } \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\"> body\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">metrics_report\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">primary\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">;\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\"> console\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#8250DF;--shiki-dark:#DCDCAA\">log\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">(\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">`\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">${\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">target\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">.\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">${\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">name\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> = \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">${\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">value\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#569CD6\">}\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">`\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">);\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">} \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#C586C0\">else\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\"> console\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#8250DF;--shiki-dark:#DCDCAA\">error\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">(\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">'Error:'\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">body\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">.\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">errors\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">);\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"}],"attributes":[]},"response":{"type":"ResponseExample","children":[{"filename":"200 - Completed","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"json\">\u003ccode language=\"json\" numberOfLines=\"115\">\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">{\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"evl_01jcb0h2m6t4xr9nv3k7pdzs5y\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"name\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"Pump A regression\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"org_id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"org_01jc8m5r2vq9xt4bn7h3kdzs6w\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"blueprint_id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"blp_01jc9n7k3xf8mbq2v5t0ary6de\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"primary\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"state.macro_f1\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"resolved_targets\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"state\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"macro_f1\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"accuracy\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">]\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> },\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"constraints\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"objective\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"state.macro_f1\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"min\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.8\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> ],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"emit_predictions\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\">true\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"examples\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"name\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"site-a-morning\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"ordinal\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">1\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"inputs\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"type\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"file\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"file_abc123\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"format\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"csv\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"crc32c\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"AAAAAA==\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> ],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"metadata\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"site\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"a\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"shift\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"morning\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> },\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"name\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"site-b-night\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"ordinal\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">2\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"inputs\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"type\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"file\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"file_def456\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"format\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"csv\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"crc32c\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"AAAAAA==\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> ],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"metadata\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"site\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"b\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"shift\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"night\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> ],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"status\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"completed\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"metrics_report\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"schema_version\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"v2\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"primary\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"target\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"state\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"name\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"macro_f1\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"value\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.84\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"aggregation\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"pooled\"\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> },\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"example_count\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">2\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"examples_failed\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"examples_partial\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"ground_truth_records_rejected\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"constraints\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"constraint\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"objective\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"state.macro_f1\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"min\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.8\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">},\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"value\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.84\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"satisfied\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\">true\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> ],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"feasible\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\">true\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"targets\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"state\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"type\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"category\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"aggregate\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"macro_f1\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.84\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\">\"accuracy\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.92\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">},\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"class_names\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"running\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"idle\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"fault_bearing\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"per_class\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"precision\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.94\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.9\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.67\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"recall\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.96\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.85\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.69\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"f1\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.95\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.87\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.68\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"support\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">4120\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">1880\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">260\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">]\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> },\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"confusion_matrix\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> [\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">3955\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">140\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">25\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> [\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">220\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">1598\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">62\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> [\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">45\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">36\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">179\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">]\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> ],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"missed\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"false_alarms\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">, \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"pairing\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"by_time\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"items\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">6260\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"items_failed\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"per_example\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"macro_f1\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"mean\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.84\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"min\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.81\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"median\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.84\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"max\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.87\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"p90\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.864\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"excluded\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"stderr\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.03\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> },\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"accuracy\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"mean\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.92\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"min\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.9\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"median\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.92\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"max\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.94\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"p90\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.936\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"excluded\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"stderr\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">0.02\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> },\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"output_artifacts\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"type\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"file\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"file_jkl012\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"format\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"ndjson\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"crc32c\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"AAAAAA==\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"metadata\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"kind\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"predictions\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"status\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"complete\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"row_count\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">6260\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"target\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"state\"\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> ],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"created_by\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"usr_01jc8m4p3rt6vx9qn2h5kdzb7y\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"created_at\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"2026-09-18T11:24:03Z\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"started_at\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"2026-09-18T11:24:09Z\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"completed_at\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"2026-09-18T11:31:52Z\"\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"},{"filename":"404 - Eval not found","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"json\">\u003ccode language=\"json\" numberOfLines=\"10\">\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">{\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"errors\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"code\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"\u0026#x3C;error_code>\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"message\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"Eval not found.\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"suggestion\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\">null\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"error_uid\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"err-xxxxxxxx\"\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> ]\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"}],"attributes":[]}},"endpoint":{"title":"Get Eval","path":"/agents/evals/{eval_id}","servers":[{"url":"https://platform.u1.archetypeai.app/api"}],"method":"get","request":{"security":[{"title":"Bearer Auth","parameters":{"header":{"Authorization":{"type":"http","scheme":"bearer","description":"Bearer authentication header of the form `Bearer \u003ctoken>`, where `\u003ctoken>` is your auth token."}},"query":{},"cookie":{}}}],"parameters":{"query":{},"header":{},"cookie":{},"path":{"eval_id":{"schema":[{"type":"string","description":"Eval `evl_` id.","required":true}]}}},"body":{}},"response":{"200":{"application/json":{"schemaArray":[{"type":"object","properties":{"id":[{"type":"string","description":"Data-service file id, so the artifact is downloadable through the files API.","required":true}],"name":[{"type":"string","description":"How this example is identified in the run’s results. Unique within the eval.","required":true}],"org_id":[{"type":"string","description":"The organization that owns the eval.","required":true}],"blueprint_id":[{"type":"string","description":"The blueprint being evaluated.","required":true}],"primary":[{"type":"object","properties":{},"description":"The run’s headline score. Repeats a value that also appears in the named target’s `aggregate` , so a reader wanting the one number the run is judged by gets it without following a pointer. `target` (string, required) — the target this headline is about. `name` (string, required) — the objective’s name, e.g. `macro_f1` . `value` (number) — its value, or `null` when nothing was scored. `aggregation` (string) — how the value was computed from the run’s examples: `pooled` or `per_example` . From `v2` .","required":true}],"resolved_targets":[{"type":"object","properties":{},"description":"The objectives this run computes, keyed by target name; each value is an array of objectives, each a bare name or written in full with its arguments, as in a target override . This is the blueprint’s own declaration folded together with the request’s per-target overrides, resolved at creation. `primary` names one of these, as `\u003ctarget>.\u003cname>` . Each input’s `metadata` carries the service-written `targets` and `example_name` keys; see Resolved input ref .","required":true}],"constraints":[{"type":"array","items":[{"type":"object","properties":{}}],"description":"What the run measured against each of its constraints, over the whole run. See Constraint verdict . Absent when the run has no constraints. Missing a constraint does not fail the run."}],"emit_predictions":[{"type":"boolean","description":"Whether the run emits the predictions artifacts alongside the metrics report, one per target, as the request asked. When `true` , they appear in `output_artifacts` as the run produces them.","required":true}],"examples":[{"type":"array","items":[{"type":"object","properties":{}}],"description":"The examples the eval was created against, as resolved: each carries the name its results are keyed by, and inputs stamped with the CRC32C of the bytes scored. See Resolved example object for the format of the objects in this array.","required":true}],"status":[{"type":"string","description":"The eval’s current lifecycle status: `pending` , `running` , `completed` , `failed` , or `cancelled` .","required":true}],"project_id":[{"type":"string","description":"The project the eval is in: its blueprint’s. This value is `null` outside any project."}],"created_by":[{"type":"string","description":"Subject id ( `usr_...` or `key_...` ) that created this eval.","required":true}],"created_at":[{"type":"string","description":"When the eval was created (date-time).","required":true}],"started_at":[{"type":"string","description":"When scoring began (date-time). Absent while `pending` ."}],"completed_at":[{"type":"string","description":"When the eval reached a terminal status (date-time). Absent until then."}],"metrics_report":[{"type":"object","properties":{},"description":"What the run measured: its headline score and what was measured for each target. Present once the eval is `completed` ; absent while it is pending or running, and on a cancelled or failed eval. See Metrics report for the format of this object."}],"output_artifacts":[{"type":"array","items":[{"type":"object","properties":{}}],"description":"Refs to the files the run produced. Each `id` is a data-service file id, so an artifact is downloadable through the files API, and each carries `metadata` saying which artifact it is. See Output artifact ref for the format of the objects in this array. Populated while the run goes , not only at the end: each batch of scored rows is appended to the predictions file and updates the entry, whose `metadata.status` stays `partial` until the run’s final push marks it `complete` . An eval that failed or was cancelled mid-run keeps its partial entry — the rows scored so far are still readable."}],"error":[{"type":"string","description":"Why the eval failed. Present only when `status` is `failed` ."}],"ordinal":[{"type":"integer","description":"The example’s 1-based position in the run, fixing the order results are listed in.","required":true}],"inputs":[{"type":"array","items":[{"type":"object","properties":{}}],"description":"The data handed to the agent, each ref carrying the CRC32C of the bytes scored, in its `crc32c` field.","required":true}],"ground_truth":[{"type":"object","properties":{},"description":"The ground truth the example was created with, if it declared any. Same shape as the `ground_truth` of a request example."}],"binding":[{"type":"object","properties":{},"description":"Which targets each of the example’s ground truths serves, as it was created with, if it said."}],"metadata":[{"type":"object","properties":{},"description":"For one of an eval’s predictions files: which file it is, and how complete. `kind` (string, required) — which artifact this is among the eval’s outputs: `predictions` for a predictions file. `status` (string, required) — `complete` when the file holds every scored item, or `partial` when it holds only the items scored so far. `row_count` (integer, required) — rows in the file: how many scored items a reader will find in it, one per row. `target` (string) — the target whose predictions the file holds: an eval writes one predictions file per target it scores. Absent on a file from an eval that wrote a single predictions file for all its targets."}],"schema_version":[{"type":"string","description":"The report’s schema version, `v1` or `v2` .","required":true}],"targets":[{"type":"object","properties":{},"description":"One entry per scored target, keyed by target name. See Target report for the format of a target record.","required":true}],"feasible":[{"type":"boolean","description":"Whether every constraint holds: `false` when one is missed, `null` when none is missed but one cannot be judged because its objective has no value. Present whenever `constraints` is."}],"example_count":[{"type":"integer","description":"How many examples the run has. From `v2` ."}],"examples_failed":[{"type":"integer","description":"How many examples could not be scored at all, and are left out of every figure. From `v2` ."}],"examples_partial":[{"type":"integer","description":"How many examples were scored, but with part of their ground truth unusable. From `v2` ."}],"ground_truth_records_rejected":[{"type":"integer","description":"How many ground-truth records, over every example scored, could not be matched to any prediction and were dropped. An example that failed is not counted. From `v2` ."}],"constraint":[{"type":"object","properties":{},"description":"The constraint judged: its `objective` , and its `min` , `max` , or both.","required":true}],"value":[{"type":"number","description":"The objective’s value. `null` when it has none, as when nothing it reads was scored."}],"satisfied":[{"type":"boolean","description":"Whether the value respects the bounds. `null` when there is no value to judge."}],"aggregate":[{"type":"object","properties":{},"description":"Every objective computed for the target, by name, over what the report covers: for the whole run, computed as the headline’s `aggregation` says. A value is `null` when nothing was scored.","required":true}],"objective_params":[{"type":"object","properties":{},"description":"What each objective was declared with, by name, for every objective declared with arguments or under a name other than its catalog objective’s: its arguments, plus the catalog objective as `objective` when the name is not its own. For example, `{\"recall_anomaly\": {\"objective\": \"recall\", \"class\": \"anomaly\"}}` ."}],"defaulted":[{"type":"array","items":[{"type":"object","properties":{}}],"description":"The objectives in `aggregate` that have no value of their own and report the value they were declared to take in that case (their `if_undefined` ) instead. Over the whole run, only objectives computed `pooled` are listed; for an objective computed `per_example` , see `per_example.defaulted` . Absent when empty."}],"type":[{"type":"string","description":"Storage kind, e.g. `file` .","required":true}],"class_names":[{"type":"array","items":[{"type":"object","properties":{}}],"description":"The class vocabulary, fixing the order of every per-class list and of the confusion matrix.","required":true}],"per_class":[{"type":"object","properties":{},"description":"Per-class figures, each a list in `class_names` order. A figure is `null` where there is nothing to compute it from, rather than `0` . `precision` (array of numbers) — of the items predicted as the class, the fraction that truly were. `null` for a class never predicted. `recall` (array of numbers) — of the items truly of the class, the fraction predicted as it. `null` for a class that never occurs. `f1` (array of numbers) — harmonic mean of precision and recall, per class. `null` for a class neither occurring nor predicted. `support` (array of integers) — how many items truly of the class were scored.","required":true}],"confusion_matrix":[{"type":"array","items":[{"type":"object","properties":{}}],"description":"Row = true class, column = predicted class, both in `class_names` order. Counts the items where both a prediction and a ground truth were found.","required":true}],"positive":[{"type":"string","description":"`binary` targets only, and required for them: the class standing for the condition the target detects, one of `class_names` ."}],"background":[{"type":"string","description":"`category` targets only: the class meaning that nothing happened, one of `class_names` , when the target names one. This is the class the foreground and detection objectives set apart."}],"missed":[{"type":"array","items":[{"type":"object","properties":{}}],"description":"Per true class, the ground truths that got no prediction. From `v2` ."}],"false_alarms":[{"type":"array","items":[{"type":"object","properties":{}}],"description":"Per predicted class, the predictions that had no ground truth. From `v2` ."}],"outcomes":[{"type":"object","properties":{},"description":"How many scored items ended in each outcome, for a target whose pairing can leave a prediction or a ground truth unmatched. From `v2` . `matched` (integer, required) — items with both a prediction and a truth. `missed` (integer, required) — truths with no prediction. `false_alarms` (integer, required) — predictions with no truth. `unscored` (integer, required) — predictions outside the annotated coverage, counted in no denominator. `failed` (integer, required) — items whose ground truth could not be read, counted in no denominator."}],"pairing":[{"type":"string","description":"How the target’s predictions were paired with its ground truth into scored items. Currently always `by_time` . From `v2` ."}],"items":[{"type":"integer","description":"How many items were scored. From `v2` ."}],"items_failed":[{"type":"integer","description":"How many of those items could not be judged, their ground truth being unreadable. From `v2` ."}],"per_example":[{"type":"object","properties":{},"description":"Over the whole run only: each objective’s per-example values summarized, keyed by objective name. Only the examples where the objective has a value count, including the value it takes from its `if_undefined` . An objective’s summary is `null` when no example has a value for it. From `v2` . `mean` (number, required) — the mean of the values. `min` (number, required) — the lowest value. `median` (number, required) — the median value; the mean of the two middle ones for an even count. `max` (number, required) — the highest value. `p90` (number, required) — the 90th percentile, interpolating linearly between values. `excluded` (integer, required) — how many examples had no value, and are left out of every figure here. `defaulted` (integer) — how many examples had no value of their own and count with the objective’s `if_undefined` value in every figure here. Absent when none did. `stderr` (number) — the standard error of the mean, or `null` with fewer than two values."}],"format":[{"type":"string","description":"Optional format hint."}],"crc32c":[{"type":"string","description":"Whole-file CRC32C checksum of the referenced bytes, base64-encoded exactly as S3 emits it. `null` when the data service has no checksum for the file."}]}}],"examples":{"example":{"value":{"id":"\u003cstring>","name":"\u003cstring>","org_id":"\u003cstring>","blueprint_id":"\u003cstring>","primary":{},"resolved_targets":{},"constraints":[{}],"emit_predictions":true,"examples":[{}],"status":"\u003cstring>","project_id":"\u003cstring>","created_by":"\u003cstring>","created_at":"\u003cstring>","started_at":"\u003cstring>","completed_at":"\u003cstring>","metrics_report":{},"output_artifacts":[{}],"error":"\u003cstring>","ordinal":123,"inputs":[{}],"ground_truth":{},"binding":{},"metadata":{},"schema_version":"\u003cstring>","targets":{},"feasible":true,"example_count":123,"examples_failed":123,"examples_partial":123,"ground_truth_records_rejected":123,"constraint":{},"value":123,"satisfied":true,"aggregate":{},"objective_params":{},"defaulted":[{}],"type":"\u003cstring>","class_names":[{}],"per_class":{},"confusion_matrix":[{}],"positive":"\u003cstring>","background":"\u003cstring>","missed":[{}],"false_alarms":[{}],"outcomes":{},"pairing":"\u003cstring>","items":123,"items_failed":123,"per_example":{},"format":"\u003cstring>","crc32c":"\u003cstring>"}}}}}},"deprecated":false}},"jsLinks":[],"subdomain":"archetypeai-bd6fb3cf","siteName":"Archetype AI Documentation","title":"Get Eval - Archetype AI Documentation","relatedPagesConfig":{"enabled":true,"limit":5,"mode":"manual"},"navMaps":{"firstHrefInVersion":{},"firstHrefInLanguage":{}},"lastModified":"2026-11-12T16:08:42.516Z","originalFileLocation":"api-reference/agents/evals/get-eval.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Retrieve one eval, its status, and its metrics report\">\u003cmeta data-mint-head name=\"application-name\" content=\"Archetype AI Documentation\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/archetypeai-bd6fb3cf/k6xQEXnXaSGa-p6g/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/archetypeai-bd6fb3cf/k6xQEXnXaSGa-p6g/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/archetypeai-bd6fb3cf/k6xQEXnXaSGa-p6g/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/archetypeai-bd6fb3cf/k6xQEXnXaSGa-p6g/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/archetypeai-bd6fb3cf/k6xQEXnXaSGa-p6g/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/archetypeai-bd6fb3cf/k6xQEXnXaSGa-p6g/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/archetypeai-bd6fb3cf/k6xQEXnXaSGa-p6g/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/archetypeai-bd6fb3cf/k6xQEXnXaSGa-p6g/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/archetypeai-bd6fb3cf/k6xQEXnXaSGa-p6g/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Get Eval - Archetype AI Documentation\">\u003cmeta data-mint-head property=\"og:description\" content=\"Retrieve one eval, its status, and its metrics report\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"Archetype AI Documentation\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.archetypeai.app/api-reference/agents/evals/get-eval\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://archetypeai-bd6fb3cf.mintlify.site/_mintlify/api/og/v2?division=Evals\u0026amp;title=Get+Eval\u0026amp;description=Retrieve+one+eval%2C+its+status%2C+and+its+metrics+report\u0026amp;theme=baca9d5089929997d797e9d7\u0026amp;signature=80ec080bd4a6bc8da8f5c9b7ada60b15431db9540aae49f006ec05c578f18880\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Get Eval - Archetype AI Documentation\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Retrieve one eval, its status, and its metrics report\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://archetypeai-bd6fb3cf.mintlify.site/_mintlify/api/og/v2?division=Evals\u0026amp;title=Get+Eval\u0026amp;description=Retrieve+one+eval%2C+its+status%2C+and+its+metrics+report\u0026amp;theme=baca9d5089929997d797e9d7\u0026amp;signature=80ec080bd4a6bc8da8f5c9b7ada60b15431db9540aae49f006ec05c578f18880\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/archetypeai-bd6fb3cf/k6xQEXnXaSGa-p6g/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"Archetype AI Documentation\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#0047FF\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.archetypeai.app/api-reference/agents/evals/get-eval\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/api-reference/agents/evals/get-eval.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.archetypeai.app/#organization\",\"name\":\"Archetype AI Documentation\",\"url\":\"https://docs.archetypeai.app\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/archetypeai-bd6fb3cf/Fml2i7FmPyxjLCP7/logo/light.svg?fit=max\u0026auto=format\u0026n=Fml2i7FmPyxjLCP7\u0026q=85\u0026s=4b1f94a0bc6c65c3905d1a55d725b05f\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.archetypeai.app#website\",\"name\":\"Archetype AI Documentation\",\"url\":\"https://docs.archetypeai.app\",\"publisher\":{\"@id\":\"https://docs.archetypeai.app/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.archetypeai.app/api-reference/agents/evals/get-eval#webpage\",\"url\":\"https://docs.archetypeai.app/api-reference/agents/evals/get-eval\",\"name\":\"Get Eval\",\"description\":\"Retrieve one eval, its status, and its metrics report\",\"dateModified\":\"2026-11-12T16:08:42.516Z\",\"isPartOf\":{\"@id\":\"https://docs.archetypeai.app#website\"},\"breadcrumb\":{\"@id\":\"https://docs.archetypeai.app/api-reference/agents/evals/get-eval#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.archetypeai.app/api-reference/agents/evals/get-eval#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"API Reference\",\"item\":\"https://docs.archetypeai.app/api-reference/introduction\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Agents API\",\"item\":\"https://docs.archetypeai.app/api-reference/agents/about\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Evals\",\"item\":\"https://docs.archetypeai.app/api-reference/agents/evals/cancel-eval\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Get Eval\",\"item\":\"https://docs.archetypeai.app/api-reference/agents/evals/get-eval\"}]},{\"@type\":[\"TechArticle\",\"APIReference\"],\"@id\":\"https://docs.archetypeai.app/api-reference/agents/evals/get-eval#apireference\",\"headline\":\"Get Eval\",\"name\":\"Get Eval\",\"description\":\"Retrieve one eval, its status, and its metrics report\",\"url\":\"https://docs.archetypeai.app/api-reference/agents/evals/get-eval\",\"mainEntityOfPage\":{\"@id\":\"https://docs.archetypeai.app/api-reference/agents/evals/get-eval#webpage\"},\"dateModified\":\"2026-11-12T16:08:42.516Z\",\"publisher\":{\"@id\":\"https://docs.archetypeai.app/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.archetypeai.app#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"Archetype AI Documentation\",\"publisher\":{\"@type\":\"Organization\",\"name\":\"Archetype AI Documentation\"},\"provider\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","agentPointerHref":"/api-reference/agents/evals/get-eval.md","siteName":"Archetype AI Documentation","nav":{"global":null,"tabs":[{"tab":"Documentation","pages":[{"title":"Documentation","href":"/introduction/overview"}]},{"tab":"API Reference","directory":"accordion","groups":[{"group":"API Reference","public":true,"pages":[{"title":"Overview","href":"/api-reference/introduction"},{"title":"Quick Reference","href":"/api-reference/quick-reference"},{"title":"Error Handling","href":"/api-reference/errors"},{"title":"Direct Query","api":"POST /lens/query","deprecated":true,"href":"/api-reference/query"},{"group":"Agents API","root":{"title":"About the Agents API","sidebarTitle":"About","href":"/api-reference/agents/about"},"pages":[{"group":"Blueprints","pages":[{"title":"Copy Blueprint","api":"POST /agents/blueprints/{reference}/copy","tag":"v2.0.0+","href":"/api-reference/agents/blueprints/copy-blueprint"},{"title":"Create Blueprint","api":"POST /agents/blueprints","tag":"v1.1.9+","href":"/api-reference/agents/blueprints/create-blueprint"},{"title":"Delete Blueprint","api":"DELETE /agents/blueprints/{reference}","tag":"v1.1.9+","href":"/api-reference/agents/blueprints/delete-blueprint"},{"title":"Get Blueprint","api":"GET /agents/blueprints/{reference}","tag":"v1.1.9+","href":"/api-reference/agents/blueprints/get-blueprint"},{"title":"List Blueprint Versions","api":"GET /agents/blueprints/{reference}/versions","tag":"v1.1.12+","href":"/api-reference/agents/blueprints/list-blueprint-versions"},{"title":"List Blueprints","api":"GET /agents/blueprints","tag":"v1.1.9+","href":"/api-reference/agents/blueprints/list-blueprints"}]},{"group":"Bundles","pages":[{"title":"Create Bundle","api":"POST /agents/bundles","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/bundles/create-bundle"},{"title":"Delete Bundle","api":"DELETE /agents/bundles/{bundle_id}","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/bundles/delete-bundle"},{"title":"Get Bundle","api":"GET /agents/bundles/{bundle_id}","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/bundles/get-bundle"},{"title":"List Bundles","api":"GET /agents/bundles","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/bundles/list-bundles"},{"title":"Run Bundle","api":"POST /agents/bundles/{bundle_id}/run","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/bundles/run-bundle"}]},{"group":"Deployments","pages":[{"title":"Create Deployment","api":"POST /api/agents/deployments","tag":"v2.0.1+","href":"/api-reference/agents/deployments/create-deployment"},{"title":"Delete Deployment","api":"DELETE /api/agents/deployments/{deployment_id}","tag":"v2.0.1+","href":"/api-reference/agents/deployments/delete-deployment"},{"title":"Get Deployment","api":"GET /api/agents/deployments/{deployment_id}","tag":"v2.0.1+","href":"/api-reference/agents/deployments/get-deployment"},{"title":"List Deployments","api":"GET /api/agents/deployments","tag":"v2.0.1+","href":"/api-reference/agents/deployments/list-deployments"},{"title":"Stop Deployment","api":"POST /api/agents/deployments/{deployment_id}/stop","tag":"v2.0.1+","href":"/api-reference/agents/deployments/stop-deployment"},{"title":"Update Deployment","api":"PATCH /api/agents/deployments/{deployment_id}","tag":"v2.0.1+","href":"/api-reference/agents/deployments/update-deployment"}]},{"group":"Evals","pages":[{"title":"Cancel Eval","api":"POST /agents/evals/{eval_id}/cancel","tag":"v1.1.12+","href":"/api-reference/agents/evals/cancel-eval"},{"title":"Create Eval","api":"POST /agents/evals","tag":"v1.1.12+","href":"/api-reference/agents/evals/create-eval"},{"title":"Delete Eval","api":"DELETE /agents/evals/{eval_id}","description":"Delete a terminal eval by id","tag":"v1.1.12+","href":"/api-reference/agents/evals/delete-eval"},{"title":"Get Eval","api":"GET /agents/evals/{eval_id}","tag":"v1.1.12+","href":"/api-reference/agents/evals/get-eval"},{"title":"List Eval Examples","api":"GET /agents/evals/{eval_id}/examples","description":"Page through what an eval measured for each of its examples","tag":"v1.1.12+","href":"/api-reference/agents/evals/list-eval-examples"},{"title":"List Evals","api":"GET /agents/evals","tag":"v1.1.12+","href":"/api-reference/agents/evals/list-evals"}]},{"group":"Instances","pages":[{"title":"Cancel Agent","api":"POST /agents/instances/{agent_id}/cancel","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/instances/cancel-agent"},{"title":"Create Agent","api":"POST /agents/instances","tag":"v2.0.0+","deprecated":true,"href":"/api-reference/agents/instances/create-agent"},{"title":"Delete Agent","api":"DELETE /agents/instances/{agent_id}","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/instances/delete-agent"},{"title":"Get Agent Logs","api":"GET /agents/instances/{agent_id}/logs","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/instances/get-agent-logs"},{"title":"Get Agent Results","api":"GET /agents/instances/{agent_id}/results","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/instances/get-agent-results"},{"title":"Get Agent","api":"GET /agents/instances/{agent_id}","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/instances/get-agent"},{"title":"List Agent Events","api":"GET /agents/instances/{agent_id}/events","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/instances/list-agent-events"},{"title":"List Agents","api":"GET /agents/instances","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/instances/list-agents"},{"title":"Pause Agent","api":"POST /agents/instances/{agent_id}/pause","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/instances/pause-agent"},{"title":"Connect to Agent","api":"GET /agents/instances/{agent_id}/connect","tag":"v1.1.13+","deprecated":true,"href":"/api-reference/agents/instances/connect-agent"},{"title":"Query Agent","api":"POST /agents/instances/{agent_id}/query","tag":"v1.1.12+","deprecated":true,"href":"/api-reference/agents/instances/query-agent"},{"title":"Resume Agent","api":"POST /agents/instances/{agent_id}/resume","tag":"v1.1.9+","deprecated":true,"href":"/api-reference/agents/instances/resume-agent"}]},{"group":"Nodes","pages":[{"title":"List Node Registry","api":"GET /agents/nodes/registry","tag":"v1.1.9+","href":"/api-reference/agents/nodes/list-node-registry"}]},{"group":"Optimizations","pages":[{"title":"Cancel Optimization","api":"POST /agents/optimizations/{optimization_id}/cancel","tag":"v1.1.12+","href":"/api-reference/agents/optimizations/cancel-optimization"},{"title":"Create Optimization","api":"POST /agents/optimizations","tag":"v1.1.12+","href":"/api-reference/agents/optimizations/create-optimization"},{"title":"Delete Optimization","api":"DELETE /agents/optimizations/{optimization_id}","tag":"v1.1.12+","href":"/api-reference/agents/optimizations/delete-optimization"},{"title":"Get Optimization","api":"GET /agents/optimizations/{optimization_id}","tag":"v1.1.12+","href":"/api-reference/agents/optimizations/get-optimization"},{"title":"List Optimization Trials","api":"GET /agents/optimizations/{optimization_id}/trials","tag":"v1.1.12+","href":"/api-reference/agents/optimizations/list-optimization-trials"},{"title":"List Optimizations","api":"GET /agents/optimizations","tag":"v1.1.12+","href":"/api-reference/agents/optimizations/list-optimizations"},{"title":"Promote Trial","api":"POST /agents/optimizations/{optimization_id}/trials/{trial_id}/promote","tag":"v1.1.12+","href":"/api-reference/agents/optimizations/promote-trial"}]},{"group":"Packages","pages":[{"title":"Create Package","api":"POST /agents/packages","tag":"v2.0.0+","href":"/api-reference/agents/packages/create-package"},{"title":"Delete Package","api":"DELETE /agents/packages/{package_id}","tag":"v2.0.0+","href":"/api-reference/agents/packages/delete-package"},{"title":"Get Package","api":"GET /agents/packages/{package_id}","tag":"v2.0.0+","href":"/api-reference/agents/packages/get-package"},{"title":"List Packages","api":"GET /agents/packages","tag":"v2.0.0+","href":"/api-reference/agents/packages/list-packages"}]},{"group":"Sessions","pages":[{"title":"Cancel Session","api":"POST /api/agents/sessions/{session_id}/cancel","tag":"v2.0.1+","href":"/api-reference/agents/sessions/cancel-session"},{"title":"Create Session","api":"POST /api/agents/sessions","tag":"v2.0.1+","href":"/api-reference/agents/sessions/create-session"},{"title":"Delete Session","api":"DELETE /api/agents/sessions/{session_id}","tag":"v2.0.1+","href":"/api-reference/agents/sessions/delete-session"},{"title":"Get Session","api":"GET /api/agents/sessions/{session_id}","tag":"v2.0.1+","href":"/api-reference/agents/sessions/get-session"},{"title":"Get Session Results","api":"GET /api/agents/sessions/{session_id}/results","tag":"v2.0.1+","href":"/api-reference/agents/sessions/get-session-results"},{"title":"List Session Events","api":"GET /api/agents/sessions/{session_id}/events","tag":"v2.0.1+","href":"/api-reference/agents/sessions/list-session-events"},{"title":"List Sessions","api":"GET /api/agents/sessions","tag":"v2.0.1+","href":"/api-reference/agents/sessions/list-sessions"},{"title":"Query Session","api":"POST /api/agents/sessions/{session_id}/query","tag":"v2.0.1+","href":"/api-reference/agents/sessions/query-session"}]}]},{"group":"Projects API","root":{"title":"About the Projects API","sidebarTitle":"About","tag":"v2.0.0+","href":"/api-reference/projects/about"},"pages":[{"title":"Create Project","api":"POST /projects","tag":"v2.0.0+","href":"/api-reference/projects/create-project"},{"title":"Delete Project","api":"DELETE /projects/{project_id}","tag":"v2.0.0+","href":"/api-reference/projects/delete-project"},{"title":"Get Project","api":"GET /projects/{project_id}","tag":"v2.0.0+","href":"/api-reference/projects/get-project"},{"title":"List Projects","api":"GET /projects","tag":"v2.0.0+","href":"/api-reference/projects/list-projects"},{"title":"Update Project","api":"PATCH /projects/{project_id}","tag":"v2.0.0+","href":"/api-reference/projects/update-project"}]},{"group":"Inference API","root":{"title":"About the Inference API","sidebarTitle":"About","tag":"v2.0.1+","href":"/api-reference/inference/about"},"pages":[{"title":"Inference: Direct Query","sidebarTitle":"Direct Query","api":"POST /api/inference/query","tag":"v2.0.1+","href":"/api-reference/inference/query"},{"title":"Inference: Chat Completions","sidebarTitle":"Chat Completions","api":"POST /api/inference/chat/completions","tag":"v2.0.1+","href":"/api-reference/inference/chat-completions"},{"title":"Inference: Responses","sidebarTitle":"Responses","api":"POST /api/inference/responses","tag":"v2.0.1+","href":"/api-reference/inference/responses"},{"group":"Sessions","pages":[{"title":"Create Model Session","api":"POST /api/inference/sessions","tag":"v2.0.1+","href":"/api-reference/inference/sessions/create-session"},{"title":"List Model Sessions","api":"GET /api/inference/sessions","tag":"v2.0.1+","href":"/api-reference/inference/sessions/list-sessions"},{"title":"Get Model Session","api":"GET /api/inference/sessions/{session_id}","tag":"v2.0.1+","href":"/api-reference/inference/sessions/get-session"},{"title":"Query a Model Session","api":"POST /api/inference/sessions/{session_id}/query","tag":"v2.0.1+","href":"/api-reference/inference/sessions/query-session"},{"title":"Cancel Model Session","api":"POST /api/inference/sessions/{session_id}/cancel","tag":"v2.0.1+","href":"/api-reference/inference/sessions/cancel-session"},{"title":"Delete Model Session","api":"DELETE /api/inference/sessions/{session_id}","tag":"v2.0.1+","href":"/api-reference/inference/sessions/delete-session"}]},{"title":"Migrating from the Direct Query API","sidebarTitle":"Direct Query API → Inference","tag":"v2.0.1+","href":"/api-reference/inference/migrate-from-direct-query"},{"title":"Migrating Omega from the Direct Query API","sidebarTitle":"Direct Query API → Omega","tag":"v2.0.1+","href":"/api-reference/inference/migrate-omega-from-direct-query"}]},{"group":"Lens API","root":{"title":"About the Lens API","sidebarTitle":"About","href":"/api-reference/lens/about"},"pages":[{"title":"Register Lens","api":"POST /lens/register","tag":"v1.1.5+","href":"/api-reference/lens/lens-register"},{"title":"Clone Lens","api":"POST /lens/clone","tag":"v1.1.5+","href":"/api-reference/lens/lens-clone"},{"title":"Modify Lens","api":"POST /lens/modify","tag":"v1.1.5+","href":"/api-reference/lens/lens-modify"},{"title":"Delete Lens","api":"POST /lens/delete","tag":"v1.1.5+","href":"/api-reference/lens/lens-delete"},{"title":"Get Lens Info","api":"GET /lens/info","tag":"v1.1.5+","href":"/api-reference/lens/get-info"},{"title":"Get Lens Metadata","api":"GET /lens/metadata","tag":"v1.1.5+","href":"/api-reference/lens/get-metadata"},{"title":"Create Lens Session","api":"POST /lens/sessions/create","tag":"v1.1.5+","href":"/api-reference/lens/create-session"},{"title":"Destroy Lens Session","api":"POST /lens/sessions/destroy","tag":"v1.1.5+","href":"/api-reference/lens/destroy-session"},{"title":"Get Sessions Info","api":"GET /lens/sessions/info","tag":"v1.1.5+","href":"/api-reference/lens/get-sessions-info"},{"title":"Get Sessions Metadata","api":"GET /lens/sessions/metadata","tag":"v1.1.5+","href":"/api-reference/lens/get-sessions-metadata"},{"title":"Session Events Process","api":"POST /lens/sessions/events/process","tag":"v1.1.5+","href":"/api-reference/lens/sessions-events-process"},{"title":"Lens Events API (WebSocket)","href":"/api-reference/lens/websocket-events"},{"title":"Consume Session Events (SSE)","api":"GET /lens/sessions/consumer/{session_id}","tag":"v1.1.5+","href":"/api-reference/lens/consumer"},{"title":"Lens API Examples","href":"/api-reference/lens/examples"}]},{"group":"Files API","root":{"title":"About the Files API","sidebarTitle":"About","href":"/api-reference/files/about"},"pages":[{"title":"Upload File","api":"POST /files","tag":"v1.1.5+","href":"/api-reference/files/upload"},{"title":"Upload Base64 File","api":"POST /files/base64","tag":"v1.1.5+","href":"/api-reference/files/upload-base64"},{"title":"Delete File by ID","api":"DELETE /files/{file_id}","tag":"v2.0.0+","href":"/api-reference/files/delete-file-by-id"},{"title":"Delete File","api":"DELETE /files/delete/{file_id}","tag":"v1.1.5+","href":"/api-reference/files/delete-file"},{"title":"Download File Content","api":"GET /files/{file_id}/content","tag":"v2.0.0+","href":"/api-reference/files/download-file-content"},{"title":"Download File","api":"GET /files/download/{file_id}","tag":"v1.1.5+","href":"/api-reference/files/download-file"},{"title":"Get Files Info","api":"GET /files/info","tag":"v1.1.5+","href":"/api-reference/files/get-info"},{"title":"Get File","api":"GET /files/{file_id}","tag":"v2.0.0+","href":"/api-reference/files/get-file"},{"title":"Get File Metadata","api":"GET /files/metadata/{file_id}","tag":"v1.1.5+","href":"/api-reference/files/get-metadata"},{"title":"List Files","api":"GET /files","tag":"v2.0.0+","href":"/api-reference/files/list-files"},{"title":"List Files Metadata","api":"GET /files/metadata","tag":"v1.1.5+","href":"/api-reference/files/get-all-metadata"},{"title":"Initiate Upload","api":"POST /files/uploads/initiate","tag":"v1.1.5+","href":"/api-reference/files/initiate-upload"},{"title":"Generate Upload Part URLs","api":"POST /files/uploads/{upload_id}/parts/urls","tag":"v1.1.5+","href":"/api-reference/files/generate-part-urls"},{"title":"Checkpoint Upload Parts","api":"POST /files/uploads/{upload_id}/parts/checkpoint","tag":"v1.1.5+","href":"/api-reference/files/checkpoint-parts"},{"title":"Complete Upload","api":"POST /files/uploads/{upload_id}/complete","tag":"v1.1.5+","href":"/api-reference/files/complete-upload"},{"title":"Abort Upload","api":"POST /files/uploads/{upload_id}/abort","tag":"v1.1.5+","href":"/api-reference/files/abort-upload"}]},{"group":"Fine-Tuning Service","root":{"title":"About the Fine-Tuning Service API","sidebarTitle":"About","href":"/api-reference/fine-tuning/about"},"pages":[{"title":"Create Fine-tuning Job","sidebarTitle":"Create Job","api":"POST /fine-tuning/jobs","tag":"v1.1.5+","href":"/api-reference/fine-tuning/create-job"},{"title":"Get Fine-tuning Job Details","sidebarTitle":"Get Job Details","api":"GET /fine-tuning/jobs/{id}","tag":"v1.1.5+","href":"/api-reference/fine-tuning/get-job"},{"title":"List Fine-tuning Jobs","sidebarTitle":"List Jobs","api":"GET /fine-tuning/jobs","tag":"v1.1.5+","href":"/api-reference/fine-tuning/list-jobs"},{"title":"Pause Fine-tuning Job","sidebarTitle":"Pause Job","api":"POST /fine-tuning/jobs/{id}/pause","tag":"v1.1.5+","href":"/api-reference/fine-tuning/pause-job"},{"title":"Resume Fine-tuning Job","sidebarTitle":"Resume Job","api":"POST /fine-tuning/jobs/{id}/resume","tag":"v1.1.5+","href":"/api-reference/fine-tuning/resume-job"},{"title":"Cancel Fine-tuning Job","sidebarTitle":"Cancel Job","api":"POST /fine-tuning/jobs/{id}/cancel","tag":"v1.1.5+","href":"/api-reference/fine-tuning/cancel-job"},{"title":"List Job Checkpoints","api":"GET /fine-tuning/jobs/{id}/checkpoints","tag":"v1.1.5+","href":"/api-reference/fine-tuning/list-job-checkpoints"},{"title":"List Job Events","api":"GET /fine-tuning/jobs/{id}/events","tag":"v1.1.5+","href":"/api-reference/fine-tuning/list-job-events"},{"title":"List Job Logs","api":"GET /fine-tuning/jobs/{id}/logs","tag":"v1.1.5+","href":"/api-reference/fine-tuning/list-job-logs"},{"title":"List Job Metrics","api":"GET /fine-tuning/jobs/{id}/metrics","tag":"v1.1.5+","href":"/api-reference/fine-tuning/list-job-metrics"},{"title":"List Checkpoint Options","api":"GET /fine-tuning/checkpoints","tag":"v1.1.5+","href":"/api-reference/fine-tuning/list-checkpoint-options"}]},{"group":"Batch Processing API","root":{"title":"About the Batch Processing API","sidebarTitle":"About","href":"/api-reference/batch/about"},"pages":[{"group":"Jobs","pages":[{"title":"Create Job","api":"POST /batch/jobs","tag":"v1.1.0+","href":"/api-reference/batch/jobs/create-job"},{"title":"List Jobs","api":"GET /batch/jobs","tag":"v1.1.0+","href":"/api-reference/batch/jobs/list-jobs"},{"title":"Get Job","api":"GET /batch/jobs/{id}","tag":"v1.1.0+","href":"/api-reference/batch/jobs/get-job"},{"title":"Retry Job","api":"POST /batch/jobs/{id}/retry","tag":"v1.1.0+","href":"/api-reference/batch/jobs/retry-job"},{"title":"Pause Job","api":"POST /batch/jobs/{id}/pause","tag":"v1.1.5+","href":"/api-reference/batch/jobs/pause-job"},{"title":"Resume Job","api":"POST /batch/jobs/{id}/resume","tag":"v1.1.5+","href":"/api-reference/batch/jobs/resume-job"},{"title":"Delete Job","api":"DELETE /batch/jobs/{id}","tag":"v1.1.0+","href":"/api-reference/batch/jobs/delete-job"},{"title":"Cancel Job","api":"POST /batch/jobs/{id}/cancel","tag":"v1.1.0+","href":"/api-reference/batch/jobs/cancel-job"},{"title":"Get Queue Depths","api":"GET /batch/jobs/queue","tag":"v1.1.0+","href":"/api-reference/batch/jobs/get-queue-depths"}]},{"group":"Events","pages":[{"title":"List Job Events","api":"GET /batch/jobs/{id}/events","tag":"v1.1.0+","href":"/api-reference/batch/events/list-job-events"}]},{"group":"I/O","pages":[{"title":"List Inputs","api":"GET /batch/jobs/{id}/inputs","tag":"v1.1.0+","href":"/api-reference/batch/io/list-inputs"},{"title":"List Outputs","api":"GET /batch/jobs/{id}/outputs","tag":"v1.1.0+","href":"/api-reference/batch/io/list-outputs"},{"title":"List Inputs With Progress","api":"GET /batch/jobs/{id}/inputs/progress","tag":"v1.1.0+","href":"/api-reference/batch/io/list-inputs-progress"},{"title":"Get Inputs Progress Counts","api":"GET /batch/jobs/{id}/inputs/progress/counts","tag":"v1.1.0+","href":"/api-reference/batch/io/get-inputs-progress-counts"},{"title":"Get Inputs Progress Traces","api":"GET /batch/jobs/{id}/inputs/progress/traces","tag":"v1.1.0+","href":"/api-reference/batch/io/get-inputs-progress-traces"},{"title":"Validate Prospective Inputs","api":"POST /batch/jobs/inputs/validation","tag":"v1.1.5+","href":"/api-reference/batch/io/validate-inputs"}]},{"group":"Progress","pages":[{"title":"List Job Progress","api":"GET /batch/jobs/{id}/progress","tag":"v1.1.0+","href":"/api-reference/batch/progress/list-job-progress"}]},{"group":"Registry","pages":[{"title":"List Pipelines","api":"GET /batch/registry/pipelines","tag":"v1.1.0+","href":"/api-reference/batch/registry/pipelines/list-pipelines"},{"title":"Get Pipeline","api":"GET /batch/registry/pipelines/{id}","tag":"v1.1.0+","href":"/api-reference/batch/registry/pipelines/get-pipeline"},{"title":"Get Pipeline Schema","api":"GET /batch/registry/pipelines/{id}/schema","tag":"v1.1.0+","href":"/api-reference/batch/registry/pipelines/get-pipeline-schema"}]}]}]}]},{"tab":"For Agents","pages":[{"title":"For Agents","href":"/for-agents/agent-skills"}]},{"tab":"Admin","pages":[{"title":"Admin","href":"/developer-console/org-admin/overview"}]}]},"basePath":"","title":"Get Eval - Archetype AI Documentation","deploymentId":"dpl_vSEmv961Ncyvz1psVwgUnTXQMSYk","buildId":"dpl_vSEmv961Ncyvz1psVwgUnTXQMSYk","dynamics":["c2aa737661","2b790eda92","b0f84f53ff"],"chunks":["OpenApiReferenceProvider-CrDfRf61.js","snippetPresets-Dv-cOUrx.js","utils-BUTreAgv.js","style-to-object-BY3JEAdk.js","utils-wsznt9RM.js","v4-DIgz8zy6.js","addUniqueKeysToSchema-DEsMlaPy.js","conditional-requirements-CFM0id0Q.js","cloneDeep-DontW4xJ.js","_Uint8Array-pP7X6_RM.js","isObject-FP1Yky1u.js","ApiExamples-CU_aGGP0.js","usePlaygroundInputsStore-7dNmUIbS.js","shallow-fTtruD8x.js","isEqual-BRfNFpSD.js","CodeSnippets-52884wUJ.js","CodeSnippet-eoRjC4Le.js","getApiPlaygroundDisplay-CZyAPlR2.js","Page-Cr9IwkK7.js","DynamicMarkdown-NFqqduU7.js","SectionHeading-DQ-mJoAt.js","icon-DXTBUt6s.js","MethodPill-2v-b3js5.js","getPastedJson-v_8Y1_4v.js","DuplicateIcon-DXIkhZIo.js","createIcon-DRpYuPZs.js","axios-CsQoIw0U.js"]}