NVIDIA DGX GH200
- 32x NVIDIA Grace Hopper Superchips, interconnected with NVIDIA NVLink
- Massive, shared GPU memory space of 19.5TB
- 900 gigabytes per second (GB/s) GPU-to-GPU bandwidth
- 128 petaFLOPS of FP8 AI performance
About
The NVIDIA DGX GH200’s massive shared memory space uses NVLink interconnect technology with the NVLink Switch System to combine 256 GH200 superchips, allowing them to perform as a single GPU. This provides 1 exaflop of performance and 144 terabytes of shared memory — nearly 500x more memory than the previous generation NVIDIA DGX A100, which was introduced in 2020.
Specification
Specification
CPU and GPU
32x NVIDIA Grace Hopper Superchips
CPU Cores
2,304 Arm® Neoverse V2 Cores with SVE2 4X 128b
Shared Memory
19.5 TB
Performance
128 petaFLOPS of FP8 AI performance
Networking
32x OSFP single-port NVIDIA ConnectX-7 VPI with 400Gb/s InfiniBand
16x dual-port NVIDIA BlueField®-3 VPI with 200Gb/s InfiniBand and Ethernet
NVIDIA NVLink Switch System
9x L1 NVIDIA NVLink Switches
Management Network
Host baseboard management controller
(BMC) with RJ45
Networking
4x OSFP ports serving 8x single-port
NVIDIA ConnectX-7
400Gb/s InfiniBand/Ethernet
2x dual-port NVIDIA BlueField-3
DPUs VPI
1x 400Gb/s InfiniBand/Ethernet
1x 200Gb/s InfiniBand/Ethernet
Software
NVIDIA AI Enterprise (optimized AI software)
NVIDIA Base Command (orchestration, scheduling, and cluster management)
DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky (operating system)
You May Also Like
Related products
-
NVIDIA DGX Spark GB10
SKU: N/AMore Information- Built on NVIDIA GB10 Grace Blackwell Superchip
- NVIDIA Blackwell GPU with fifth-generation Tensor Core technology
- NVIDIA Grace CPU with 20- core high-performance Arm architecture
- Up to 1 petaFLOP of AI performance using FP4
- 128 GB of coherent, unified system memory
- Support for up to 200 billion parameter model
- NVIDIA ConnectX™ networking to link two systems to work with models up to 405 billion parameters
- Up to 4 TB of NVMe storage
- Compact desktop form factor
-
NVIDIA DGX GB300
SKU: N/AMore Information- Built on NVIDIA GB300 Grace Blackwell Ultra Superchips
- Scalable up to tens of thousands of GB300 Superchips with NVIDIA DGX SuperPO
- 72 NVIDIA Blackwell Ultra GPUs connected as one with NVIDIA® NVLink®
- Efficient, 100% liquid-cooled, rack- scale design
- NVIDIA networking
- Leverages NVIDIA AI Enterprise and NVIDIA Mission Control software
-
NVIDIA HGX A100 (8-GPU)
SKU: N/AMore Information- 8X NVIDIA A100 GPUS WITH 320 GB TOTAL GPU MEMORY
- 6X NVIDIA NVSWITCHES
- 320 GB MEMORY
- 4.8 TB/s TOTAL AGGREGATE BANDWIDTH
Our Customers
Previous
Next