News

Nvidia puts 192 Vera CPUs in a rack for scientific computing

The liquid cooled system shares its chassis, power distribution and cooling infrastructure with NVL72 and uses serviceable SOCAMM2 memory.
Frontier supercomputer cabinets at Oak Ridge National Laboratory.

Nvidia has introduced a scientific computing rack containing 192 Vera CPUs, aimed at workloads such as climate modelling and molecular simulation. Around 300 TB of memory and 1 PB of storage sit across the liquid cooled system, whose nodes communicate over InfiniBand while sharing chassis, cooling and power distribution elements with Nvidia’s NVL72 design.

Eight processors fit into each 1U tray alongside NVMe storage and management hardware. Each Vera CPU has 88 Olympus cores and 176 threads, fed by LPDDR5X memory on replaceable SOCAMM2 modules at up to 1.2 TB/s. Across the rack, Nvidia quotes aggregate peak memory bandwidth above 200 TB/s, with that bandwidth distributed among the CPUs and their local memory.

Moving results between those nodes adds another demand on the system. A large simulation may alternate between calculations on a local grid and exchanges with neighbouring partitions, or require results from many nodes to be combined before it can proceed. Nvidia uses Quantum-X800 InfiniBand with SHARP technology to carry out some collective operations within the network, reducing the combining work left to the processors.

In its OpenFOAM motorBike Large airflow benchmark, Nvidia reports 1.9 times the performance and 2.4 times the performance per watt of its x86 comparison systems. Those results apply to the tested workload and configurations; the company also projects performance and energy improvements for the Weather Research and Forecasting model from its benchmarking.

The German Climate Computing Centre has selected Vera for HLRE-5, a Bull supercomputer expected in early 2028. The installation will combine the CPUs with GB200 Grace Blackwell systems and Quantum-2 InfiniBand, using a different configuration from the newly announced Quantum-X800 rack to bring CPU and GPU resources into the same climate computing project.

Dell Technologies, HPE, Lenovo and Supermicro are expected to offer Vera CPU racks from early 2027. Software support is arriving ahead of those systems through Nvidia’s available HPC SDK 26.11 and a new Fortran compiler being released as a public beta.

Sources: Nvidia Vera platform announcement; Nvidia Vera CPU specifications.

Continue reading