Hot-Tub Water Is Keeping NVIDIA's Hottest Data Center Chips Alive

Liquid coolant running at 113°F — hotter than most people shower — is still cold enough to pull heat off NVIDIA's latest data center silicon, and that gap is the whole engineering story.

NVIDIA data center hardware is now being cooled with liquid coolant at 113°F, above typical hot-tub temperature of around 104°F.
The approach is called warm-water liquid cooling, and it works because the chip junction temperatures run far hotter — the delta is what moves heat, not the absolute coolant number.
The tradeoff is infrastructure: facilities must plumb liquid to the rack, replacing or supplementing the air-handling systems most data centers were built around.
Warm coolant is an advantage over chilled water because it can reject heat directly to a cooling tower without a chiller unit, cutting facility energy overhead.
The spec only holds as long as coolant flow rate and rack thermal density stay matched — exceed either limit and the margin collapses fast.

The number is 113°F. That is the coolant inlet temperature NVIDIA is now specifying for liquid-cooled data center hardware. It sounds wrong. It is not.

Heat moves from hot to less hot. The chip junction on a loaded NVIDIA data center accelerator runs well above 80°C. Water at 45°C — that 113°F figure — is still cold enough to pull heat away because the delta between junction and coolant is large enough to drive transfer through the cold plate. The absolute coolant temperature is almost beside the point. The gap is the mechanism.

The practical consequence is that 45°C warm water can be rejected to a cooling tower directly. No chiller. Chillers are the expensive, power-hungry machines that conventional data centers use to drive coolant temperatures down toward 50–60°F. Remove the chiller and you cut a significant slice of facility power overhead. That is the win NVIDIA is pointing at.

The cost is pipe. Every rack needs a liquid supply and return. That is a retrofit problem for existing facilities and a design constraint for new ones. Air-cooled infrastructure — raised floors, CRAC units, hot-aisle containment — does not disappear overnight. It gets displaced gradually, at capital expense, as rack power density makes air cooling geometrically impossible.

The underlying driver is density. NVIDIA's current data center accelerators are pushing rack loads that air simply cannot handle at acceptable inlet temperatures anymore. Warm-water liquid cooling is not a preference. It is what the power envelope left room for.

The machine sets the terms. The cooling follows.