list_teams
List teams Read only ViewList the teams you can reach, each with its agent count and whether evaluations are switched on. Start here: most other tools need a team slug.
No inputs.
Connect ChatGPT, Claude, Cursor, VS Code, Codex or Claude Code to your AgentPing account and ask which agents failed, why a run went wrong, what it cost and whether it actually worked. 21 tools, one URL, on every plan including Free.
Agents get fixed where you code and incidents get handled where you are talking, not on a dashboard. With AgentPing connected, the assistant reads the run, the cost and the evaluation where you already are, and can fix the code in the same session.
“Why did invoicer fail last night?”
Finds the failed runs in the window, reads the evaluation on each, and tells you what actually went wrong rather than what errored.
calls search_runs · get_run_evaluation
“Which agent cost the most this week, and for which customer?”
Spend is attributed per agent, per customer and per feature, so the answer is a name and a number, not a total.
calls list_agents · search_runs
“Show me every run the evaluator marked as not achieved since Monday.”
Quality drift shows up as runs that completed cleanly and still did the wrong thing. This surfaces them.
calls search_runs · get_run_evaluation
“Walk me through run run_8f3a step by step.”
Every model call, tool call and log line for the run, in order, with tokens and cost per step.
calls get_run_events
“Acknowledge the open incident on support-triage. I am looking at it.”
Stops the reminders for everyone on the channel and records who has it. Needs the Act permission.
calls acknowledge_incident
“That evaluation was wrong, the reply was fine. Tell the evaluator.”
Feedback corrects the verdict and feeds the calibration of future evaluations on that agent.
calls submit_evaluation_feedback
“Snooze the cost spike rule on researcher for two hours while I run the backfill.”
Quiet a rule for a known burst without turning it off and forgetting to turn it back on.
calls snooze_rule
“Set a $500 monthly budget on the outreach agent that warns at 80%.”
Budgets warn, they never throttle. Needs the Configure permission and an admin role.
calls create_budget
“This run failed on the parse step. Fix the code.”
In Cursor, VS Code or Claude Code the assistant reads the step, the input and the error, and edits the handler in the same session.
calls get_run_events
Every client needs the URL and a sign-in. The first tool call sends you to an AgentPing consent screen where you choose what the assistant may do: view, act, or configure. Approve once and the assistant gets a token for exactly those permissions. No API keys to paste.
claude mcp add -s user --transport http agentping https://agentping.io/mcp
claude mcp login agentping
The -s user flag registers the server for every project. The second command opens the consent screen; pick the permissions you want the assistant to have.
codex mcp add agentping --url https://agentping.io/mcp
codex mcp login agentping
.cursor/mcp.json
{
"mcpServers": {
"agentping": {
"url": "https://agentping.io/mcp"
}
}
}
Cursor opens the consent screen the first time a tool is called.
.vscode/mcp.json
{
"servers": {
"agentping": {
"type": "http",
"url": "https://agentping.io/mcp"
}
}
}
Or run MCP: Add Server from the command palette, choose HTTP and paste the URL.
Server URL: https://agentping.io/mcp
Server URL: https://agentping.io/mcp
Works on claude.ai and in Claude Desktop.
gemini mcp add --transport http -s user agentping https://agentping.io/mcp
~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"agentping": {
"serverUrl": "https://agentping.io/mcp"
}
}
}
Any other client that speaks Streamable HTTP works with the same URL. Full setup notes and troubleshooting are in the MCP guide.
This list is read from the running server, so it is exactly what a connected assistant sees. Tools are grouped by the permission they need, which is also how the consent screen groups them: view on every plan, act on paid plans, configure on paid plans with an admin role. Every tool carries hints that tell the assistant whether it only reads, changes something, or cannot be undone.
List the teams you can reach, each with its agent count and whether evaluations are switched on. Start here: most other tools need a team slug.
No inputs.
List the agents in a team with their recent health pass rate, quality, last-seen time, and month-to-date cost. Use this to see the workforce at a glance.
Search a team's runs, newest first. Filter by status (success/failed/timeout/running), agent, and an ISO date range. Returns a page of run summaries (max 100) plus a next_cursor; pass it back as cursor to page. This is the run explorer.
Get the step-by-step events of one run in order (LLM calls, tool calls, logs). Large payloads come back as a payload_url you can fetch separately, never inlined.
Get the evaluation verdict for one run: whether it achieved its goal, a 0-5 quality, issues, and reasoning. Status may be complete, pending, covered_by_routine_baseline, or returned_to_allowance.
Acknowledge an open incident: stops reminders, keeps it open until the condition clears. Idempotent.
Resolve an incident now (for conditions that do not auto-resolve). Idempotent.
Snooze an alert rule for 1 hour (60), 24 hours (1440), or 7 days (10080), optionally for a single agent.
Tell AgentPing whether you agree with a run's evaluation verdict. A disagreement (with an optional note) feeds rubric tuning.
Create an alert rule. condition is one of run_failed, evaluation_failed, consecutive_failures, health_rate, quality_drop, agent_silent. scope is "team" or "agent" (give agent then). channels are channel ids to route to; params tune thresholds.
Update an alert rule's params, channels, severity, reminder cadence, or active flag.
Delete an alert rule. Destructive: requires confirm true and confirm_name matching the rule's description exactly.
Create an alert channel. type is email, slack, discord, webhook, teams, or pagerduty. config carries the type-specific fields (e.g. {"url":"https://hooks.slack.com/..."} for slack). Telegram is dashboard-only.
Delete an alert channel. Destructive: requires confirm true and confirm_name matching the channel label exactly.
Create a monthly spend budget. scope is "team", "agent" (give the agent as scope_value), or "model". thresholds are alert percentages, default [50,80,100]. AgentPing never stops agents; a budget only warns.
Update a budget's name, amount, or alert thresholds.
Delete a budget. Destructive: requires confirm true and confirm_name matching the budget name.
Update the team's name or its "evaluate runs" switch (true turns AI evaluations on for this team).
Create a status page for some of the team's agents. visibility is "link" (anyone with the link), "password" (give a passcode), or "internal" (signed-in team members only). Each agent shows a daily track per enabled pillar: availability (default on), quality, and spend. The spend track shows state only, never figures, driven by spend_source (budget breaches and/or anomalies). States only, never data.
Rotate a status page's link, invalidating the old URL and any passcode cookies immediately. Destructive: requires confirm true and confirm_name matching the page title.
Delete a status page. Destructive: requires confirm true and confirm_name matching the page title.
The consent screen offers view, act and configure separately. Give a chat assistant view only and it can never change anything, whatever it is asked. Every tool re-checks its permission, your team membership, the plan and your role on each call, so a downgrade takes effect immediately.
Almost every tool takes a team slug and refuses any team you are not a member of. list_teams shows the assistant what it can reach and nothing else.
Every connected assistant is listed under Connected apps in Settings. Disconnect revokes its tokens immediately. Tokens expire after an hour and refresh silently for up to 90 days, so a forgotten connection does not live forever.
Deleting a rule, channel, budget or status page needs confirm: true and a confirm_name that matches the thing exactly, so a wrong guess cannot remove the wrong rule.
A connected assistant cannot change your plan, invite or remove people, create or revoke API keys, or delete your account or your data. Those stay in the dashboard on purpose.
Budgets and rules only warn; nothing the assistant does can throttle or halt a running agent. Every change is written to your Activity log with who, when, through which app, and from what to what.
Viewing runs, costs and evaluations through an assistant is on the Free plan, no card required. Acting on what it finds comes with any paid plan.