Skip to main content
BSS/OSS Academy
All developments

Chapter 7 · ComputeCES 2026 (previewed as “Vera Rubin NVL144” at GTC, March 2025)

NVIDIA Vera Rubin NVL72: the rack-scale system after Blackwell Ultra

NVIDIA

Seventy-two Rubin GPUs and 36 Vera CPUs in one liquid-cooled rack, joined by sixth-generation NVLink, with HBM4 memory. NVIDIA’s product page says it is available now and shipping is ramping.

ShippingLast checked against its sources on 2 November 2026

What was announced?

NVIDIA launched the Rubin platform at CES on 5 January 2026, with Vera Rubin NVL72 as its rack-scale system: 72 Rubin GPUs and 36 Vera CPUs, connected by NVLink 6 switches, with ConnectX-9 SuperNICs and BlueField-4 processors. It was shown as “Vera Rubin NVL144” at GTC in March 2025; the new name counts GPU packages rather than dies. NVIDIA has not stated the rename itself; trade press reported the reason.

Per GPU, NVIDIA’s product page lists 288 GB of HBM4. Each Vera CPU has 88 custom NVIDIA Olympus Arm cores (176 threads) and up to 1.5 TB of LPDDR5X memory.

Why does it matter?

Each rack generation moves the limits that decide what a cluster can do: how large a model fits without splitting, how many users’ context fits in memory, and how fast GPUs exchange data during training and inference. Vera Rubin raises all three over Blackwell Ultra, at a higher rack power.

NVIDIA claims “up to 10x lower cost per token” and training mixture-of-experts models “with 4x fewer GPUs” against Blackwell. These are NVIDIA’s measurements on chosen workloads.

What has changed?

AspectGB300 NVL72 (Blackwell Ultra)Vera Rubin NVL72
CPU36 Grace (Arm Neoverse V2)36 Vera (88 Olympus cores each)
GPU memory per rack20 TB HBM3e, up to 576 TB/s20.7 TB HBM4, 1.4 PB/s
Scale-up (NVLink) per rackNVLink 5, 130 TB/sNVLink 6, 216 TB/s (launch material said 260 TB/s)
FP4, headline (sparse) per rack1.44 EFLOPS3.6 EFLOPS (NVFP4 inference)
FP4, dense per rack1.08 EFLOPS2.52 EFLOPS (NVFP4 training)
Network cardConnectX-8ConnectX-9, 1.6 Tb/s per GPU
CoolingHybrid: liquid to compute and switch trays, air for the rest100% liquid, 45 °C inlet

Figures are from NVIDIA’s product pages as read on 2 November 2026; the Vera Rubin page’s NVLink figure is lower than the January launch release. The Compute Rack page compares the two racks row by row with sources.

How does it work?

NVLink 6 is NVIDIA’s chip-to-chip interconnect: the NVLink switch trays in the middle of the rack let all 72 GPUs read each other’s memory directly, so the rack behaves like one large accelerator for a model split across it. NVIDIA’s January release gave 3.6 TB/s per GPU; the current product page gives 3 TB/s (216 TB/s for the rack).

HBM4 is the fourth generation of high-bandwidth memory, stacked beside the GPU die. More capacity per GPU means larger models or more users’ context per rack; more bandwidth means faster token generation, which is usually limited by how fast weights and cache can be read.

For the facility, Vera Rubin is fully liquid-cooled with 45 °C inlet water, which allows heat rejection without chillers in many climates, and it runs at a higher rack power than Blackwell (NVIDIA’s power-software blog cites 136 kW for a rack before power capping).

Figures and claims, and what backs them

  • Published specificationNVIDIA’s product page lists 288 GB HBM4 per GPU, 20.7 TB and 1.4 PB/s per rack, NVLink 6 at 216 TB/s per rack, and NVFP4 at 3.6 EFLOPS (inference, sparse) and 2.52 EFLOPS (training, dense).
  • Manufacturer claimNVIDIA says Rubin delivers “up to 10x lower cost per token” and trains mixture-of-experts models “with 4x fewer GPUs” than Blackwell.

Impact on AI infrastructure delivery

Construction
Halls built for air-cooled or hybrid racks may need rework for liquid distribution and floor loading.
Power & Cooling
Higher rack power and 100% liquid cooling: the facility needs liquid-cooling capacity per rack position and power distribution sized above Blackwell-era designs.
IT Infrastructure
A new rack generation to receive, qualify and integrate alongside existing Blackwell fleets, with new firmware and software baselines.
Networking
ConnectX-9 at 1.6 Tb/s per GPU doubles scale-out port speed, which drives switch and optics choices (see USFP and Spectrum-X Ethernet Photonics).

Commercial availability

  1. AnnouncedDescribed publicly; no date for customers to buy it.
  2. PlannedA stated availability window that has not arrived yet.
  3. Shipping (current stage)In production and reaching early customers or partners.
  4. Generally availableOrderable by any customer through normal channels.
  5. DeployedRunning in customers’ production environments, confirmed by them or the manufacturer.

NVIDIA said in January 2026 that Rubin was “in full production” and “available from partners the second half of 2026”; on 31 May that production shipments were “set to begin starting this fall”. Its product page now says “Available Now” and that partners are shipping Vera Rubin-based systems. First customer deliveries are reported in trade press but were not confirmed at the server makers for this entry.

Not yet confirmed

  • NVIDIA has not itself stated why NVL144 became NVL72; the reason given is trade press reporting.
  • NVIDIA’s product page and launch release give different NVLink figures (3 TB/s and 3.6 TB/s per GPU); the product page is used here.

Learn more in BSS/OSS Academy

Official sources

  1. NVIDIA Kicks Off the Next Generation of AI With Rubin(opens in a new tab)NVIDIA Newsroom · 5 January 2026 · Manufacturer
  2. NVIDIA Vera Rubin NVL72 (product page, read 2 November 2026)(opens in a new tab)NVIDIA · Technical documentation
  3. NVIDIA Vera Rubin Ramps Into Full Production(opens in a new tab)NVIDIA Newsroom · 31 May 2026 · Manufacturer
  4. NVIDIA GB300 NVL72 (product page, read 2 November 2026)(opens in a new tab)NVIDIA · Technical documentation

Figures are as the manufacturer states them unless marked otherwise. None has been independently tested by BSS/OSS Academy.