Eval templates
Built-in templates define what Evals can check without pretending provider evidence already exists. Templates that require BrowserOps, Sandbox, Claws, AgentUI, reports, or protected execution remain explicit about their boundary.
Required Route Compliance
discoveryEvaluate all required public discovery and platform routes.
Sitemap No-Dead-Link Compliance
discoveryValidate sitemap URLs and ensure no protected mutation route is listed.
LLMS Readability
discoveryCheck llms.txt, llms-full.txt, and llms-index.json readability and counts.
OpenAPI Validity
openapiValidate OpenAPI schema, auth, examples, and public/protected route clarity.
MCP Initialize/List/Call
mcpValidate public MCP JSON-RPC methods and protected rejection.
Protected Action Rejection
policyConfirm protected operations require PLATPHORM_API_KEY.
AgentUI Form Render
agentuiRender MCP tool schemas and inspect required fields.
BrowserOps Page Load
browseropsRun page-load and no-stuck-loading checks through BrowserOps.
Sandbox Command Execution
sandboxRun a bounded command and validate real command output.
Claws Tool Orchestration
clawsValidate public Claws tool registry and orchestration metadata.
Docs Publish
reportPublish a public-safe evaluation methodology or report to Docs.
Sheets Export
reportExport run matrices and scorecards to Sheets.
OpenContent Ingest
workflowValidate OpenContent public submit and docs export workflow.
Dictionary Search/Submit
workflowCheck dictionary search and protected submission boundary.
Reader Translation
workflowCheck public reader translation degraded states and protected actions.
Echo Content Monitor
workflowCheck content monitor public status and alert delivery boundaries.
Calendar/Kanban Task Flow
workflowEvaluate task handoff across calendar and kanban surfaces.
PlatPhorm CLI Harness Run
workflowValidate CLI-generated evidence against Evals scorecard requirements.
x-vercel-ja4-digest Redaction
policyEnsure fingerprint-adjacent request metadata is hashed or redacted before public display.
BrowserOps Link Check
browseropsTraverse public links through BrowserOps when a real provider run is configured.
BrowserOps Run API Protected POST Check
browseropsConfirm BrowserOps run triggers reject unauthenticated protected POSTs.
API Catalog Contract Check
openapiValidate API Catalog OpenAPI entries, auth naming, and response envelope shape.
MCP Gateway Truth Model Check
mcpCompare MCP Hub registry state with public JSON-RPC introspection.
AgentUI Phorm-to-Workflow Check
agentuiValidate AgentUI Phorm rendering, submission state, and workflow handoff metadata.
MSI Static Check
workflowValidate MSI static checks and JSON/XML export boundaries when that target is present.
DESA Script Health
workflowValidate DESA script health, bounded execution notes, and remediation-card handoff.
JSON/XML/Markdown Report
workflowValidate generated artifacts across JSON, XML, and Markdown validators.
Podcasts Feed Ingest
workflowValidate podcast feed ingestion, Reader summary handoff, and Docs export boundaries.
Reader Summary Docs Export
workflowValidate Reader summaries and Docs export as public-safe evidence.
Claws Remediation Card
clawsValidate Claws orchestration metadata and Kanban remediation-card creation boundary.
Release Gate Decision
release_gateBuild a release decision from required suites, blockers, evidence links, and trace links.