Back to news

AWS adds terminal shells to agent sessions; Cloudflare caps runaway AI spend

Two major infrastructure updates this week give developers deeper control over AI agent execution and cost management.

AWS adds terminal shells to agent sessions; Cloudflare caps runaway AI spend

What happened

Amazon Web Services expanded its Bedrock AgentCore Runtime with a new InvokeAgentRuntimeCommandShell API that opens a persistent, PTY-backed terminal directly inside a live agent session via WebSocket. Unlike the existing one-shot command execution API, this interactive shell delivers a full terminal experience — including color output, tab completion, and keyboard interrupt support — inside an isolated microVM. Separately, Cloudflare announced real-time spend limits for its AI Gateway product, allowing organizations to set hard budget caps across multiple AI providers and tie spending policies to individual user identities through an integration with Cloudflare Access.

Why it matters for your business

The AWS terminal capability closes a meaningful gap for engineering teams building autonomous agents that need to inspect runtime state, debug in-session behavior, or dynamically modify agent logic without tearing down and restarting an execution environment. This reduces iteration cycles and makes complex agentic workflows more observable in production. On the cost side, Cloudflare's spend controls address one of the most common operational fears around AI adoption: an unchecked inference bill. Identity-driven budget policies mean finance and platform teams can enforce per-team or per-user AI spending limits without blocking access entirely — a practical middle ground between full restriction and unlimited consumption. Organizations using multiple AI providers through a single gateway now have a centralized enforcement point for both access and cost.

What to watch next

Expect AWS to deepen the AgentCore Runtime toolset as agentic workloads move from experimentation into production pipelines, with observability and debugging features likely to follow. On the Cloudflare side, the combination of identity-aware access control and real-time spend enforcement sets a template that other API gateway and security vendors may replicate. The broader trend — treating AI inference as managed, policy-governed infrastructure rather than open-ended compute — is accelerating.

Sources

Want this kind of clarity applied to your own systems?

HashWhales can review your website, infrastructure, security posture, and growth bottlenecks, then send a prioritized action plan.

Free AuditChat on WhatsApp