← Feed Deep Dive Matrix Subscribe

Programmable Memory Controller Eases Adoption of New DRAM Techniques (ETH Zürich, CISPA, NYU)

semiengineering.com 2026-10-07
Entities
Industry Analysis
Terracotta is not a "better controller"—it is the first credible academic push to make the DRAM interface software-defined, the closest the memory subsystem has come to an architectural reset in two decades. The chain reaction is structural. AI inference is bandwidth-bound, not compute-bound. Samsung's HBM-PIM and SK Hynix's AiM have been throttled by rigid interfaces that cannot dynamically reroute data flows. A programmable controller shifts scheduling authority from silicon to firmware, forcing redesign across the stack: DRAM PHY upstream, Synopsys/Cadence controller IP midstream, NVIDIA/AMD ASICs downstream. The CXL precedent is instructive—in 2014, "programmable memory interfaces" sounded like vaporware; by 2024, CXL 2.0 is shipping. Supply-chain repricing: if this paradigm enters the JEDEC standards track, the HBM ramp paths of CXMT and packaging capacity in Taiwan, China get revalued. Programmable interfaces cut NRE costs of locking to a specific DRAM generation, eroding the ecosystem moat Samsung and SK Hynix built through proprietary interfaces. Strategic counter: Samsung will likely internalize programmability into HBM4 dies to neutralize the threat. Synopsys faces IP disintermediation and may accelerate in-house programmable PHY development. 12–24 month tail: CXL 3.1 memory pooling becomes genuinely viable; controller IP valuation in AI inference BOMs overtakes logic die for the first time; the academic-to-industry window is roughly 18 months, and the JEDEC boardroom becomes the real battlefield.
Read Original Article →
Related
This page displays AI-generated summaries and metadata for research purposes. Original content belongs to the respective publishers.