SK Hynix seeks to embed cooling inside HBM to beat the heat - digitimes

SK Hynix is developing a new high-bandwidth memory technology to address thermal challenges in next-generation AI systems, as increasing computing density makes thermal management a critical issue for... Read original →

SK Hynix embedding cooling directly into HBM marks a paradigm shift—thermal management is migrating from system-level to chip-level. This forces TSV and microfluidic packaging integration, compelling TSMC’s CoWoS and Samsung’s I-Cube to overhaul thermal design rules for 2.5D/3D stacks. Under tightening U.S.-Japan-Netherlands export controls, combining EUV-based 3nm processes with novel cooling structures will sharply increase capex and supply chain fragility, especially straining Taiwan, China’s OSAT flexibility. Micron and Samsung will accelerate in-house liquid-cooled HBM prototyping to avoid falling behind in AI server memory. Within 18 months, thermal dissipation capacity will become a core metric for HBM4+ standards, prompting JEDEC to revise thermal reliability specs and pushing NVIDIA and AMD to embed thermal density into procurement criteria—fundamentally reshaping memory vendor competition.