SK hynix pushes hybrid bonding HBM5 as AI memory hits 775-micron ceiling — firm extends MR-MUF through Nvidia Rubin

NVIDIA Corp. — sK hynix doesn’t expect hybrid bonding to be ready for HBM4E, Jaesik Lee, VP of package engineering at SK hynix America, said during a presentation at Hot Chips 2026 on August 23, pushing the industry’s most anticipated memory packaging transition out to HBM5 at the earliest. The problem, as he describes it, is that HBM cubes are capped at a total thickness of 775 microns — the standard thickness of a 300mm logic wafer — so every additional DRAM layer must come from thinner dies and narrower gaps.

16-Hi HBM4, now in customer qualification at 48GB per cube while 12-Hi is in mass production, thins its core dies to around 50 microns and halves the gap between them compared with 12-Hi. Lee’s session also went into detail about the company’s iHBM cooling architecture three months after its May unveiling. Attaching a constraint to it, Lee explains that the heat blocks can’t be applied to any HBM generation already in design. (Image When a GPU package gets its cold plate attached, both the logic die and the memory stacks are ground back to expose bare silicon, Lee said, and because logic wafers are 775 microns thick, a memory cube that grew any taller would stand proud of the processor beside it. “That’s the kind of limit that we can go up so far, because the logic wafer thickness is also 775 microns,” Lee said.Thinner dies leave the stack with proportionally more oxide, which conducts heat poorly compared with silicon, while pin speeds that have risen from 1 Gbps in early HBM to 8 Gbps in HBM4 concentrate more power in the same footprint. SK hynix’s own figures put the thermal burden at 2.2 times higher across the HBM generations shown, while stack counts double every two generations. (Image Hybrid bonding keeps slippingSamsung publicly committed to hybrid bonding for HBM4 in May last year, with SK hynix holding the copper-to-copper technique as a backup behind advanced MR-MUF. The JEDEC thickness relaxation then removed the immediate need, and industry discussions now weigh a further move to 825 to 900 microns for 20-Hi stacks, which would push the copper-bonding crossover out again. Back in March, it was claimed by industry sources that SK hynix placed its first mass-production hybrid bonding order, a single inline system pairing Applied Materials and Besi tools worth around 20 billion won ($15 million), and Counterpoint Research expects the technique to enter full-scale HBM production with HBM5 around 2029 to 2030.Hybrid bonding remains at the research stage for stacks of 20 layers and above, per the deck’s roadmap, and SK hynix is still deciding which product gets it first. Lee didn’t name a target generation, but ruling out HBM4E leaves HBM5 as the earliest slot. The technique joins flattened copper pads and oxide surfaces at room temperature, then relies on copper’s thermal expansion during a cure step to form the bond. (Image “We are talking about 16 layers and 20 layers that we need to make the hybrid bonding, so it’s very different from the one-layer stacking.” Removing micro-bumps entirely lets core dies grow up to 24% thicker at 20-Hi, cuts thermal resistance by roughly 35% versus MR-MUF at that height, and takes bump pitch below 18 microns, per the deck, against the 30 microns where MR-MUF is today. At HBM4’s bump pitch, conventional micro-bumps still work, and each time JEDEC has raised the thickness ceiling, MR-MUF has stayed viable for another generation.iHBMThe iHBM concept embeds thermally conductive, electrically insulating blocks into the base die’s die-to-die PHY region, the interface hotspot where power density peaks, for a claimed thermal resistance reduction of more than 30%. Lee’s slides benchmarked it directly against Samsung’s Heat Path Block approach, which routes heat out of the stack through dedicated pillars, and Micron’s base-die circuit redesign, which claims over 20% better energy efficiency. All three are vendor claims measured on different metrics, and the SK hynix and Samsung designs are both slated for HBM5, with neither expected in mass production before 2028.