You're Building AI Agents on Layers That Won't Exist in 18 Months
Video: You're Building AI Agents on Layers That Won't Exist in 18 Months. (What this Means for You) (22:53) → https://www.youtube.com/watch?v=7HP1jFJ9W1c
Abstract: A new agent infrastructure stack is rapidly being assembled — billions in capital, dozens of startups — and most builders don't understand what they're building on top of. Nate breaks down the six foundational layers every AI agent depends on today, explains which are production-ready vs. still in flux, and warns that many of the current "primitives" are temporary shims that will be replaced within 18 months. Stack literacy — knowing which layer you're betting on and why — is now a core survival skill for any builder or business leader deploying agents.
Highlights
- [01:30] We've seen this movie twice before. Cloud (2006–2010) and microservices (2012–2016) each redefined infrastructure. The shift from human-first tools to agent-first primitives is at least as big — and just as poorly understood mid-transition.
- [04:20] Layer 1 — Compute & Sandboxing: most mature. E2B (Firecracker microVMs), Daytona (Docker, 90ms cold starts), Modal (GPU workloads), and Browserbase (headless browser) each make a different architectural bet: ephemeral vs persistent agent sessions. Pick based on your workload, not the marketing.
- [08:50] Layer 2 — Identity & Communication: in flux. Agent Mail ($6M seed, General Catalyst) gives agents real email inboxes. But email is a pragmatic shim, not an agent-native protocol — brittle threading, rate limits, and terrible signal/noise. On-chain identity, A2A communication standards, and MCP-based discovery are all competing. No winner yet.
- [13:10] Layer 3 — Memory & State: early but real. Mem0 ($24M, 41K GitHub stars, exclusive AWS memory provider) uses a hybrid graph/vector/KV store for active curation rather than raw conversation storage — outperforming OpenAI's built-in memory by 26% accuracy, 91% faster, 90% fewer tokens. Platform risk: every frontier lab is building memory into their models. Portability of your context layer matters.
- [17:00] Layer 4 — Tools & Integration: growing explosively. Composio ($29M, Lightspeed) solves the N×M enterprise integration problem — managed auth, pre-built connectors, per-call observability. Long-term risk: if MCP becomes universal, the value of managed integration diminishes. For now, enterprise adoption is slow enough that this layer stays relevant.
- [19:30] Layer 5 — Provisioning & Billing: brand new. Stripe Projects launched this week — the first trust layer for agent-to-service transactions. Agents can self-provision databases and services (ready in ~350ms) using tokenised credentials, no human needed for auth. Missing: agent-to-agent payments, metered billing, and dynamic budget controls.
- [21:00] Layer 6 — Orchestration & Coordination: the biggest gap and biggest opportunity. LangChain-style frameworks exist, but the gap between "3 agents in a notebook" and "50 agents in production with failure recovery, cost controls, and audit trails" is being hand-rolled by every team. What needs to exist: agent lifecycle management, merge/conflict infrastructure, supervision hierarchies, FinOps for agents, and standard failure-recovery patterns. Whoever solves this owns the most valuable position in the stack — structurally analogous to what Kubernetes did for containers.
- [22:00] Three builder truisms for 2026: (1) Reliability compounds in the wrong direction — five layers at 97% each = 86% end-to-end. (2) Transitional lock-in is real — every shim you adopt creates future migration cost. (3) Agent sprawl is the microservices-2018 problem arriving for agents — invest in orchestration now before it becomes unmanageable.
References & Links
- 📺 Video: https://www.youtube.com/watch?v=7HP1jFJ9W1c
- 🌐 Nate's site: https://natebjones.com
- 📰 Full story + prompts (Substack): https://natesnewsletter.substack.com/p/your-ai-agent-depends-on-six-layers
- E2B (compute sandboxing): https://e2b.dev
- Daytona (fast Docker containers): https://www.daytona.io
- Browserbase (headless browser): https://www.browserbase.com
- Agent Mail (agent email identity): https://agentmail.to
- Mem0 (agent memory): https://mem0.ai
- Composio (agent tool integration): https://composio.dev
- Stripe Projects (agent provisioning/billing): https://stripe.com/blog/projects