Amazon Bedrock AgentCore is the managed, framework-agnostic foundation for running AI agents in production on AWS. Instead of stitching together your own execution sandbox, memory store, tool layer and auth, AgentCore gives you five production primitives — Runtime, Memory, Gateway, Identity and Policy — plus built-in Observability. It went GA in October 2025, and fine-grained Policy authorization with Cedar reached GA in March 2026. This guide explains how the pieces fit, how MCP tools plug in, and how to troubleshoot the session, tool and authorization failures that actually page you.
The five building blocks
- Runtime — executes your agent with strong per-session isolation, so one user's session cannot see another's state. It handles scaling and lifecycle; you bring the agent logic (any framework — Strands, LangGraph, CrewAI, or your own).
- Memory — managed short-term (within a session) and long-term (across sessions) memory, so the agent remembers context and learned facts without you running a database.
- Gateway — turns existing APIs, Lambda functions and services into agent tools, increasingly exposed over the Model Context Protocol (MCP), so tools are discoverable and reusable across agents.
- Identity — authenticated, delegated access to AWS and third-party resources on behalf of a user, so the agent acts with the right scoped credentials rather than a shared god-role.
- Policy — fine-grained authorization with Cedar (GA March 2026): declarative rules for which agent/user can call which tool or resource, evaluated at request time.
You can adopt these individually. A common path is Runtime + Memory first, then Gateway for tools, then Identity and Policy as security requirements harden. The conceptual model is covered in the AgentCore architecture guide.
A typical agent request flow
- The client sends a request to your agent endpoint; Runtime spins up an isolated session.
- The agent loads relevant state from Memory and constructs its reasoning context.
- It calls a foundation model on Bedrock to decide the next step (often a tool call).
- The tool call goes through Gateway; Identity supplies delegated credentials and Policy authorizes the action with Cedar.
- The tool result returns, the agent iterates, and Observability records each reasoning step and tool call as a trace.
- Memory is updated; the final answer streams back.
Tools, MCP and Gateway
Gateway is where most integration value lives. Rather than hand-coding each API call into the agent, you register APIs, Lambdas and MCP tool servers once and let the agent discover and invoke them. Using MCP means a tool server you build for one agent is reusable by any MCP-aware agent or framework — the same "USB-C for tools" idea that makes the ecosystem composable. For how this compares to building agents directly on a framework, see AgentCore vs LangGraph.
Troubleshooting: isolate the layer first
AgentCore problems are easiest to fix when you map the symptom to a layer instead of blindly editing the prompt. Read the Observability trace end to end, then:
Runtime — session, timeout, cold start
- Sessions timing out on long tool chains → increase timeouts, parallelize independent tool calls, or break the task into steps.
- Cold-start latency on first request → keep the agent warm or accept the first-call penalty in SLAs.
- State bleeding between users → verify you are relying on Runtime's session isolation, not a shared global.
Memory — wrong or missing context
- Agent "forgets" mid-session → short-term memory not being read/written on each turn.
- Agent ignores prior sessions → long-term memory not configured or not queried.
- Stale or contradictory facts → memory write strategy needs deduplication or recency weighting.
Gateway — tool not called or failing
- Tool never invoked → the tool schema/description is unclear, so the model does not select it; sharpen the tool definition.
- Tool errors → connectivity, request-shape or MCP registration problems; test the tool directly, outside the agent.
- Timeouts → the downstream API is slow; add its own retry/timeout budget.
Identity & Policy — AccessDenied on a tool
- An authorization failure on a tool call is almost always Identity (missing/expired delegated credentials) or Policy (a Cedar rule denies the action). Check the policy decision in the trace before touching IAM.
- Over-broad access → tighten Cedar policies to least privilege per agent and per user.
Observability — loops and cost
- Runaway token cost or latency → the trace will show a reasoning loop or repeated tool calls; add a step limit and a stop condition.
For live help on a failing agent, see AgentCore troubleshooting support and the component pages for Runtime, Memory, Gateway, Identity and Policy.
Interview implications
Agent system-design rounds increasingly ask you to design a production agent: how you isolate sessions, where memory lives, how tools are authorized, and how you observe reasoning. Being able to name Runtime/Memory/Gateway/Identity/Policy and explain the request flow is a strong signal — prep with the Amazon Bedrock interview questions and the AgentCore interview support page.
Frequently asked questions
What is AgentCore?
Managed, framework-agnostic building blocks for production agents — Runtime, Memory, Gateway, Identity, Policy and Observability. GA October 2025; Policy/Cedar GA March 2026.
How do you troubleshoot AgentCore?
Isolate the layer: Runtime for session/timeout, Memory for context, Gateway for tools, Identity/Policy for authorization, Observability for loops and cost. Read the trace before editing the prompt.
Does AgentCore support MCP?
Yes — Gateway increasingly exposes tools over MCP so tool servers are reusable across agents and frameworks.
Related resources
- Concepts: AgentCore architecture guide
- Architecture context: Bedrock production architecture in 2026
- Hub: Amazon Bedrock AgentCore support · AWS AI/ML hub
Fighting a production agent issue?
Our AWS AI engineers debug live AgentCore systems — Runtime, Memory, Gateway, Identity and Cedar policies. Get AgentCore job support or message us: WhatsApp +91 96606 14469.