2.14

Warm pools for long-running agents

Agents that run longer than a minute now keep their worker warm between steps. Tool calls no longer pay a cold start.

Until this release, an agent that paused for a tool call could lose its worker. When the call came back, the run waited for a fresh worker to boot. On long runs that added up to seconds.

What changed

Workers now stay attached to a run for up to ten minutes of idle time. The next step lands on a process that already has the model weights and the run’s context in memory.

Median step time on runs longer than a minute dropped from 610 ms to 340 ms in our own traffic. Warm pools are on by default for every plan; there is nothing to configure.

Create a free website with Framer, the website builder loved by startups, designers and agencies.