NVIDIA DGX B300

Category NVIDIA DGX Tags gpu, nvidia Brand: NVIDIA

Built with NVIDIA Blackwell Ultra GPUs
2.3TB of GPU memory space
72 petaFLOPS of training performance
144 petaFLOPS of inference performance
NVIDIA networking
Intel® Xeon® 6776P Processors
Foundation of NVIDIA DGX BasePOD™ and NVIDIA DGX SuperPOD™
Leverages NVIDIA AI Enterprise and NVIDIA Mission Control software

About

NVIDIA DGX™ B300 is a purpose-built AI infrastructure solution tailored to meet the computational demands of generative AI. Powered by NVIDIA Blackwell Ultra GPUs, DGX B300 delivers an 11x inference and 4x training performance increase than the previous generation, all in a new form factor designed to fit seamlessly into the modern data center. Compatible with NVIDIA MGX™ and traditional enterprise racks and with full-stack software, it simplifies and streamlines AI deployment, enabling any enterprise to run like a hyperscaler.

Specification

Specifications

GPU

NVIDIA Blackwell Ultra GPUs

Total GPU Memory

2.3TB

Performance

144 PFLOPS FP4 inference* 72 PFLOPS FP8 training*

NVIDIA NVLink Switch System

NVIDIA NVLink™ Bandwidth

14.4 TB/s aggregate bandwidth

Power Consumption

~14kW

CPU

Intel® Xeon® 6776P Processors

Networking

8x OSFP ports serving 8x NVIDIA ConnectX-8 VPI >Up to 800Gb/s NVIDIA InfiniBand/Ethernet 2x dual-port QSFP112 NVIDIA BlueField-3 DPU >Up to 400Gb/s NVIDIA InfiniBand/Ethernet

Management Network

1GbE onboard NIC with RJ45 1GbE RJ45 Host baseboard management controller (BMC)

Storage

OS: 2x 1.9TB NVMe M.2 Internal storage: 8x 3.84TB NVMe E1.S

Software

NVIDIA DGX OS / NVIDIA Mission Control / NVIDIA Base Command Manager / NVIDIA AI Enterprise Supports Red Hat Enterprise Linux / Rocky / Ubuntu

Rack Units

10RU

Operating Temperature

10C° - 35C°