NVIDIA DGX H100

SKU DGX H100 Category NVIDIA DGX Brand: NVIDIA

8X NvidiaH100 Gpus With 640 Gigabytes of total gpu memory
4x Nvidia Nvswitches
8X Nvidia Connect-7 and 2x Nvidia bluefield dpu 400 gigabits-per-second network interface
Dual x86 CPUs and 2 Terabytes of system memory
30 Terabytes NVME SSD

About

Artificial intelligence has become the go-to approach for solving difficult business
challenges. Whether improving customer service, optimizing supply chains, extracting
business intelligence, or designing cutting-edge products and services across nearly
every industry, AI gives organizations the mechanism to realize innovation. And as a
pioneer in AI infrastructure, NVIDIA DGX™ systems provide the most powerful and
complete AI platform for bringing these essential ideas to fruition.
NVIDIA DGX H100 powers business innovation and optimization. The latest iteration of
NVIDIA’s legendary DGX systems and the foundation of NVIDIA DGX SuperPOD™, DGX
H100 is an AI powerhouse that features the groundbreaking NVIDIA H100 Tensor Core
GPU. The system is designed to maximize AI throughput, providing enterprises with a
highly refined, systemized, and scalable platform to help them achieve breakthroughs
in natural language processing, recommender systems, data analytics, and much
more. Available on-premises and through a wide variety of access and deployment
options, DGX H100 delivers the performance needed for enterprises to solve the
biggest challenges with AI.

Specification

GPUs

8x NVIDIA H100 Tensor Core GPUs

GPU memory

640GB total

Performance

32 petaFLOPS FP8

NVIDIA® NVSwitch™

System power usage

~10.2kW max

CPU

Dual x86

System memory

2TB

Networking

4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 400Gb/s InfiniBand/Ethernet 2x dual-port NVIDIA BlueField-3 DPUs VPI 1x 400Gb/s InfiniBand/Ethernet 1x 200Gb/s InfiniBand/Ethernet

Management network

10Gb/s onboard NIC with RJ45 50Gb/s Ethernet optional NIC Host baseboard management controller (BMC) with RJ45 2x NVIDIA BlueField-3 DPU BMC (with RJ45 each)

Storage

OS: 2x 1.9TB NVMe M.2 Internal storage: 8x 3.84TB NVMe U.2

System software

DGX H100 systems come preinstalled with DGX OS, which is based on Ubuntu Linux and includes the DGX software stack (all necessary packages and drivers optimized for DGX). Optionally, customers can install Ubuntu Linux or Red Hat Enterprise Linux and the required DGX software stack separately.

Operating temperature range

5–30°C (41–86°F)