DigitalOcean previews production agent toolchain
DigitalOcean launched preview features including Signals, Simulations and Agent Data Services that turn failing production agent sessions into replayable eval cases.
A TOOL CALL RETURNED 200 AND THE ANSWER WAS STILL WRONG, THAT IS THE BUG NO DASHBOARD CATCHES DigitalOcean just launched the stack for agents that are already in production. Before: agent misbehaves -> logs say 200 -> you find out 400 users later. Now: Signals flags the session -> one click makes it an eval -> Simulations replays it against your fix. • What @digitalocean shipped, all in preview > Signals watches production traffic and flags frustrated users, failing tools and timeouts with nothing to instrument. > Simulations replays real multi-turn sessions on your actual harness, mock tools for the risky steps. • The part I did not expect > Agent Data Services turns call recordings, PDFs, video and agent traces into one catalog you query by API, vector search and SQL. > Insights follows one agent request through every tool call and policy check, logs attached. A human still approves every fix, the agent just brings the evidence -> production failures become tests instead of tickets. Agent Data Services is private preview, the rest is public preview, links in the first reply ↓
This post quotes another post: x.com/digitalocean/status/2109658000612835374