Inspur NF5688M6

NF5688M6 is a new generation of NVLink AI server developed by Inspur for ultra-large-scale data centers with high performance, high compatibility and strong expansion. It is the first to support 2 Intel latest Ice Lake CPUs and 8 NVIDIA latest NVSwitch fully interconnected in 6U space. 500W A100 GPU. NF5688M6 is the industry's first air-cooled product that supports 500W A100 GPU, and can provide up to 12 PCIe expansion products, and supports self-developed dual-wide N20X, NV DPU and other smart network cards. Combined with the leading AI computing resource sched -uleing platform AIStation, it fully releases the powerful AI computing performance of up to 5 pe-taFLOPS.

Leading Technology

  • 2 Intel Ice Lake processors, using 10nm process
  • 8 NVIDIA A100 GPUs, 600GB/s bandwidth NVSwitch fully interconnected
  • Support multi-instance GPU (MIG), greatly improving GPU resource utilization
  • Up to 10 200G HDR InfiniBand, high-speed interconnection expansion

Stable Quality

  • Support hard/soft RAID scheme to ensure data security
  • N+N redundant power supply to ensure reliable operation of the system
  • Optimized heat dissipation design to support stable work under high ambient temperature
  • Intelligent remote management to quickly locate faults

Optimal Qesign

  • The industry's only air-cooled support 500W A100 GPU
  • High performance ratio, GPU: computing IB: storage IB=8:8:2
  • Modular design, flexible operation, easy operation and maintenance
  • Leading support for Inspur N20X, NV-DPU, A/T customer smart network card

Excellent Ecology

  • Extensive and mature x86+CUDA global development ecology
  • Leading deep learning framework support, TensorFlow/PyTorch/flying paddle, etc.
  • Efficiently support large-scale CV/NLP/NMT/DLRM model training and inference
  • Easily connect with Yuannao ecosystem partners and provide rich industry AI solutions

Technical Specifications

Model NF5688M6
Height 6U
GPU 1* HGX A100 8GPU
CPU 2* 3rd Intel® Xeon® IceLake scalable processors, TDP 270W, support 3 UPI interconnections
Chipset Intel® C621A Series Chipset (Lewisburg-R)
Memory 32* DDR4 RDIMM/LRDIMM, up to 3200MT/s
Storage 8* 2.5’’ NVMe SSD or 16* 2.5’’ SATA/SAS SSD
M.2 On-board 2* NVMe/SATA M.2
PCIe 10* PCIe 4.0 x16 slots,2* PCIe 4.0 x16 slots (PCIe 4.0 x8 rate)
or 6*PCIe 4.0 x16
RAID Optional support RAID0/1/10/5/50/6/60, etc., support Cache super capacitor protection, provide RAID state migration, RAID configuration memory
NIC Optional 1 PCIe 4.0 x16 OCP 3.0 network card, rate support 10G/25G/100G
Front I/O 1* USB 3.0,1* USB 2.0,1* VGA,1* RJ45 management port
Rear I/O 1* USB 3.0,1* VGA 
Management Built-in BMC remote management module, support Redfish/IPMI/SOL/KVM, etc.
OS Red Hat Enterprise 7.8 64bit、CentOS 7.8、Ubuntu 18.04 or higher version
Cooling N+1 redundant hot-swappable fans
Power 6* 3000W 80Plus platinum power supply, support 3+3 redundancy
Size (W*H*D) 447mm * 263.9mm * 850mm
Temperature 10℃~35℃/50℉~95℉
Full Load Weight ≤88kg

/en/resource/cms/2022/08/2022082418434251096.pdf

Inspur Server NF5688M6 White Paper V1.0.pdf

Inspur NF5688M6