Back to news

Cloudflare and AWS Expand Agent and Spark Infrastructure for Developers

Cloudflare opens its Agents SDK to third-party frameworks while AWS adds Spark Connect support to Glue Interactive Sessions, reducing friction for both AI and data workloads.

Cloudflare and AWS Expand Agent and Spark Infrastructure for Developers

What happened

Cloudflare has repositioned its Agents SDK as a general-purpose runtime that external agent frameworks can build on, with Flue becoming the first third-party framework to target the SDK. Alongside this, Cloudflare is rolling out agent management capabilities directly inside its dashboard. Separately, AWS announced that Glue Interactive Sessions now support Apache Spark Connect, allowing developers to write and run Spark applications from local environments — including Jupyter, VS Code, and SageMaker Unified Studio notebooks — against Glue's serverless infrastructure without provisioning or managing clusters.

Why it matters for your business

For teams building AI-driven workflows, Cloudflare's move lowers the barrier to deploying agents by letting developers stick with familiar frameworks rather than adopting proprietary tooling from scratch. The dashboard integration means operations teams can monitor and manage agents without diving into code. On the data engineering side, AWS's Spark Connect support eliminates the context-switching penalty developers faced when moving between local development and cloud execution — code written in a preferred IDE now runs directly on serverless Spark infrastructure, accelerating iteration cycles and reducing the overhead of cluster lifecycle management. Both announcements push toward a model where infrastructure concerns are abstracted away so product and data teams can focus on logic rather than plumbing.

What to watch next

Cloudflare's SDK opening is an early signal; the pace at which other agent frameworks — beyond Flue — adopt it will determine whether this becomes a genuine multi-framework ecosystem or remains niche. On the AWS side, watch for broader IDE and notebook support as Spark Connect matures, and whether AWS extends similar serverless-remote execution patterns to other Glue job types beyond interactive sessions.

Sources

Want this kind of clarity applied to your own systems?

HashWhales can review your website, infrastructure, security posture, and growth bottlenecks, then send a prioritized action plan.

Free AuditChat on WhatsApp