NVIDIA H200 NVL
About
Specification
H200 NVL
FP64
34 TFLOPS
FP64 Tensor Core
67 TFLOPS
FP32
67 TFLOPS
TF32 Tensor Core
989 TFLOPS2²
BFLOAT16 Tensor Core
1,979 TFLOPS²
FP16 Tensor Core
1,979 TFLOPS²
FP8 Tensor Core
3,958 TFLOPS²
INT8 Tensor Core
3,958 TFLOPS²
GPU memory
141GB
GPU memory bandwidth
4.8TB/s
Decoders
7 NVDEC
7 JPEG
Confidential Computing
Supported
Max thermal design power (TDP)
Up to 600W (configurable)
Multi-Instance GPUs
Up to 7 MIGs @16.5GB each
Form factor
PCIe
Interconnect
2- or 4-way NVIDIA NVLink bridge: 900GB/s PCIe Gen5: 128GB/s
Server options
NVIDIA MGX™ H200 NVL partner and NVIDIA-Certified Systems with up to 8 GPUs
NVIDIA AI Enterprise
Included
You May Also Like
Related products
-
NVIDIA RTX 5880 Ada Generation Graphics Card
SKU: NVIDIA RTX 5880 Ada GenerationMore Information- 48GB GDDR6 of GPU memory
- 960 GB/s of memory bandwidth
- 285 W of Power consumption
- Max simultaneous displays:
4x 4096 x 2160 @ 120hz
4x 5120 x 2880 @ 60hz
2x 7680 x 4320 @ 60hz
-
NVIDIA RTX PRO 6000 Blackwell Server Edition
SKU: NVIDIA RTX PRO 6000 Blackwell Server EditionMore Information- Fifth-generation Tensor Cores deliver up to 3X the performance of the previous generation and add support for FP4 precision and DLSS 4 Multi Frame Generation technology.
- Fourth-generation RT Cores deliver up to 2X the performance of the previous generation
- 96GB of GPU Memory
- Ninth-generation NVIDIA NVENC engines significantly accelerate video encoding speed
- Sixth-generation NVIDIA NVDEC engines provide up to double H.264 decoding throughput and offer support for 4:2:2 H.264 and HEVC decode.
- Multi-Instance GPU
- Support for PCI Express Gen 5 provides double the bandwidth of PCIe Gen 4
-
NVIDIA QUADRO RTX8000
SKU: N/AMore Information- GPU Memory: 48 GB GDDR6 with ECC
- CUDA Cores: 4608
- NVIDIA Tensor Cores: 576
- NVIDIA RT Cores: 72
Our Customers
Previous
Next