NVIDIA expands NVLink Fusion with NVHBM memory

NVIDIA has announced an expansion of NVLink Fusion with NVHBM, a next-generation high-bandwidth memory technology for semi-custom AI infrastructure.

• NVHBM is integrated into the HBM base die rather than the XPU die, and NVIDIA says it delivers up to 30% greater memory bandwidth, 15% lower HBM power consumption, and up to 25% more area on the XPU compute die versus standard HBM4E.
• Amazon’s Annapurna Labs will be the first partner to work on NVHBM as part of its broader collaboration with NVIDIA; it will support NVLink Fusion with its next-generation Trainium chips starting with Trainium4.