AgentOps Dashboard
The real-time monitoring interface that tracks agent execution status, pipeline health, and compute costs across a squad.
Definition
The AgentOps Dashboard is the real-time monitoring interface that tracks agent execution status across a squad. It provides the operational visibility needed to manage agentic workflows, replacing traditional project management boards with live telemetry.
The dashboard surfaces several categories of information:
- Pipeline Health — queue depth, wait times, error rates, and the number of agents currently stuck or waiting for human input.
- Evaluation Metrics — pass rates, failure categories, cycle times, and retry patterns from the Eval Harness.
- Cost Tracking — real-time token consumption against the weekly budget, broken down by task, agent, and model.
- Blocker Detection — alerts when agents raise Blocker Flags, with context about the failure type and recommended triage priority.
The Flow Manager leads a daily review of the AgentOps Dashboard during the Daily Flow Sync, which replaces the traditional standup meeting. This review identifies bottlenecks, flags at-risk tasks, and ensures that Rescue Missions are prioritized appropriately. When a task completes, the dashboard logs the token consumption against the weekly budget for ongoing cost governance.