Memory Now 63% of AI Chip Cost: HBM Spend Hits $32B

Epoch AI's latest analysis reveals that high-bandwidth memory (HBM) now accounts for nearly two-thirds of AI chip component costs. Between Q1 2024 and Q4 2025, HBM's share rose from 52% to 63% across chips designed by Nvidia, AMD, Google, and Amazon, weighted by production volume. Total component spending on AI chips grew from $22 billion in 2024 to $52 billion in 2025, with HBM alone contributing $20 billion of that increase.
Key Numbers
- Memory (HBM): 52% → 63% share. Absolute spend grew from ~$12B (2024) to $32B (2025).
- Logic dies: Roughly flat at 13–14% share.
- Advanced packaging (CoWoS): Fell from 19% to 15% share.
- Auxiliary components: Fell from 15% to 9% share.
Why It Matters
Memory is now the dominant cost driver in AI accelerators. Epoch models per-chip costs from financial disclosures, supplier filings, and analyst reports across four categories: HBM stacks (HBM3, HBM3e), advanced-node logic dies (3–5nm), TSMC CoWoS packaging, and auxiliary components (substrate, power delivery). The shift is driven by tight memory supply and rising HBM prices. Hyperscalers are already incorporating this into capex guidance: Microsoft's $190B FY2026 capex outlook includes ~$25B from higher component prices; Meta raised its 2026 capex range by $10B citing the same factor.
Uncertainty Ranges
Epoch provides 90% confidence intervals and two bound metrics:
- Range from memory's cost alone: 60–67% in Q4 2025.
- Range with all components at extremes: 54–73% in Q4 2025.
The trend suggests memory's share will grow further in 2026 as HBM supply remains constrained.
📖 Read the full source: HN AI Agents
👀 See Also

Claude Opus 4.6 effort=low parameter causes lazy agent behavior
When using effort=low with Claude Opus 4.6, agents made fewer tool calls, were less thorough in cross-referencing, and ignored parts of system prompts about web research. Switching to effort=medium resolved the issues.

Codestrap founders critique AI coding metrics and warn of quality issues
Codestrap founders argue AI coding tools are being measured incorrectly with metrics like lines of code and pull requests, while quality metrics show problems like a 3.7x larger codebase performing 2,000 times worse in an SQLite-to-Rust rewrite.

Claude Code v2.1.129: Autonomous Loop Persistence Guidance and Background Agent State Classifier
Claude Code v2.1.129 adds CLAUDE_CODE_LOOP_PERSISTENT system prompt for autonomous work loops, removes verification specialist subagent, and expands background agent state classifier with detailed boundaries.

Claude Code 2.1.83 Release: Prompt Caching, Verify Skill, and SDK Updates
Claude Code 2.1.83 adds prompt caching with design guidance, replaces the verification specialist skill with a new Verify skill, and updates SDK references across seven languages including PHP beta tool runner support.