Artificial Intelligence

Improve TTFT for multi-turn agentic workloads with bi-directional KV transfer in vLLM

Improve TTFT for multi-turn agentic workloads with bi-directional KV transfer in vLLM

Multi-turn agentic workloads reprocess growing conversation context each turn, driving up latency. See how bi-directional KV cache transfer lets prefill and decode nodes reuse previously computed context across turns, cutting time to first token by up to 1.6x for Qwen3-32B and 3.3x for GLM-5-FP8 on Amazon EC2 P5en instances with EFA.

Building trust in AI agents: A production-ready evaluation framework with Amazon Bedrock AgentCore

Building trust in AI agents: A production-ready evaluation framework with Amazon Bedrock AgentCore

Autonomous AI agents fail softly: latency stays flat while answer quality quietly erodes. This post shares a nine-stage evaluation framework, built on Amazon Bedrock AgentCore, that catches silent quality regressions across the full agent lifecycle, from first commit to live production.

Introducing Reflection Beam: an open-weight model for agentic coding on AWS

Introducing Reflection Beam: an open-weight model for agentic coding on AWS

Reflection AI’s Beam is an open-weight model for agentic coding and long-horizon tasks. This post shows how to deploy Beam on AWS: start with an Amazon SageMaker JumpStart real-time endpoint, or use Amazon SageMaker HyperPod Inference with JumpStart, SGLang, or vLLM for Kubernetes-native control over distributed GPU infrastructure.

Trust in Depth: Giving agents more autonomy without losing control

Enterprise leaders want AI agents to take on more work but don’t fully trust them to act correctly every time. Trust in Depth is AWS’s layered approach-scope, know, bound, observe, and prove-that lets agents act on their own when their actions can be verified, reserving human judgment for the decisions that need it.

Build self-improving document processing using Amazon Bedrock AgentCore

Build self-improving document processing using Amazon Bedrock AgentCore

Learn how to build an agentic intelligent document processing (IDP) system using Amazon Bedrock AgentCore that classifies, extracts, validates, and learns from business documents with minimal human intervention, automatically handling new document formats without manual template configuration.

How Tamnoon built AI-powered cloud security remediation with Amazon Bedrock

How Tamnoon built AI-powered cloud security remediation with Amazon Bedrock

Learn how Tamnoon built Tami, an agentic cloud remediation orchestrator on Amazon Bedrock that autonomously investigates and safely remediates cloud security findings from CNAPP and cloud-native sources. The approach drove a 90%+ reduction in critical cloud exposure in 90 days with zero production issues.

Building agents that transact with Anchor Browser and AgentCore payments

Building agents that transact with Anchor Browser and AgentCore payments

Learn how the AWS Generative AI Innovation Center Partner Agent Factory and Anchor Browser built AI agents that autonomously pay for x402-protected web resources and APIs. Amazon Bedrock AgentCore payments checks budgets, signs transactions, and retries requests without exposing wallet credentials to the agent runtime.