HPE Ships Its First NVIDIA Grace Blackwell System - NVIDIA GB200 NVL72

• 14 Feb 2025
• TM Team
• 0 Comments

Hewlett Packard Enterprise (HPE) announced that it has shipped its first NVIDIA Blackwell family-based solution, the NVIDIA GB200 NVL72. This rack-scale system by HPE is designed to help service providers and large enterprises quickly deploy very large, complex AI clusters with advanced, direct liquid cooling solutions to optimize efficiency and performance.

"AI service providers and large enterprise model builders are under tremendous pressure to offer scalability, extreme performance and fast time-to-deployment," said Trish Damkroger, senior vice president and general manager of HPC and AI Infrastructure Solutions, HPE. "As builders of the world's top three fastest systems with direct liquid cooling, HPE offers customers lower cost per token training and best-in-class performance with industry-leading services expertise."

The NVIDIA GB200 NVL72 features shared-memory, low-latency architecture with the latest GPU technology designed for extremely large AI models of over a trillion parameters, in one memory space. GB200 NVL72 offers seamless integration of NVIDIA CPUs, GPUs, compute and switch trays, networking and software, bringing together extreme performance to address heavily parallelizable workloads, like generative AI (GenAI) model training and inferencing, along with NVIDIA software applications.

"Engineers, scientists and researchers need cutting-edge liquid cooling technology to keep up with increasing power and compute requirements," said Bob Pette, ,vice president of enterprise platforms, NVIDIA. "Building on continued collaboration between HPE and NVIDIA, HPE's first shipment of NVIDIA GB200 NVL72 will help service providers and large enterprises efficiently build, deploy and scale large AI clusters."

With escalating power requirements and data center density dynamics, HPE has five decades of liquid cooling expertise that uniquely positions the company to help customers bring fast deployment and an extensive infrastructure support system for complex liquid-cooled environments

With escalating power requirements and data center density dynamics, HPE has five decades of liquid cooling expertise that uniquely positions the company to help customers bring fast deployment and an extensive infrastructure support system for complex liquid-cooled environments. This experience has enabled HPE to deliver eight of the top 15 supercomputers on the Green500 list, which ranks the world's most energy-efficient supercomputers. HPE is recognized as a leader in direct liquid cooling technology, having built seven of the top 10 world's fastest supercomputers.

Features of NVIDIA GB200 NVL72 by HPE:
- 72 NVIDIA Blackwell GPUs and 36 NVIDIA Grace CPU's interconnected via high-speed NVIDIA NVLink
- Up to 13.5 TB total HBM3e memory with 576 TBps bandwidth
- HPE direct liquid cooling technology

Industry Leading Services and Support:

HPE is able to deliver AI solutions at a global scale, with proven ability to support massive, custom AI clusters with superior serviceability including expert on-site support, customized services, sustainability services and more. HPC and AI Custom Support Services are tailored to meet customer needs. With several levels of SLA coverage, HPE provides enhanced incident management with proactive support through dedicated remote engineers, ensuring rapid installation and faster time-to-value. Available services include:

- Onsite engineering resources: Comprehensive on-site support through highly trained resident engineers who work closely with a customer's IT teams to ensure optimal system performance and availability.

- Performance and benchmarking engagements: Industry-leading team of experts to fine tune solutions throughout the life of a system.

- Sustainability services: Energy and emissions reporting, sustainability workshops and resource monitoring to reduce environmental impact.