Liquid Cooling vs. Air Cooling for AI-Density Racks
Air cooling ran the data center industry for decades. GPU rack densities are ending that run faster than most facilities can retrofit for it.
Air cooling works by moving enough cold air across a server to carry its heat away, and it scaled fine for decades of data center growth. The problem is physics, not engineering effort: air has a much lower heat capacity than liquid, so as rack power density climbs, the volume of air — and the fan power to move it — needed to keep pace grows faster than most facilities can practically deliver. Racks running well above roughly 20–30kW commonly exceed what air cooling can remove without extraordinary airflow, and modern GPU racks for AI training and inference routinely run at multiples of that.
Direct-to-chip cooling
The most common liquid cooling approach in new deployments: cold plates mounted directly on the highest-heat components — CPUs and GPUs — circulate coolant that carries heat away at the source. Lower-heat components on the same board (memory, storage, networking) are usually still air-cooled, making this a hybrid approach rather than a fully liquid-cooled server. It's the least disruptive liquid-cooling retrofit path for an existing air-cooled hall, since the room-level air system can often stay in place for everything the cold plates don't cover.
Immersion cooling
Submerges entire servers in a dielectric fluid that doesn't conduct electricity, removing heat from every component at once rather than just the highest-heat ones. Single-phase immersion circulates the fluid in liquid form throughout; two-phase immersion uses a fluid that boils at the operating temperature, carrying heat away as it changes phase and condenses for reuse. Immersion removes heat more thoroughly than direct-to-chip but requires a fundamentally different rack and server form factor — not a bolt-on retrofit to standard rack-mount hardware.
Rear-door heat exchangers
A hybrid that sits between air and liquid cooling: a liquid-cooled heat exchanger mounted on the back of a standard air-cooled rack captures hot exhaust air before it reaches the room, rather than cooling components directly. Servers inside the rack stay conventional and air-cooled internally — only the room-level heat rejection changes. It's a lower-disruption way to raise a facility's effective density ceiling without redesigning server hardware, though it doesn't reach the density levels direct-to-chip or immersion can support.
| Approach | What it cools | Retrofit disruption |
|---|---|---|
| Rear-door heat exchanger | Room air, at the rack exhaust | Low — servers stay conventional |
| Direct-to-chip | CPU/GPU only; rest stays air-cooled | Moderate — needs cold plates + CDU |
| Immersion | Entire server | High — different rack/server form factor |
Where the CDU fits in
A coolant distribution unit (CDU) is the interface between the facility's main cooling loop and the rack-level liquid cooling loop, transferring heat between the two — often through a heat exchanger — while keeping the fluids and pressures on each side independently managed and monitored. It's become a standard electrical/mechanical BOM line on new data center builds rather than a specialty item, tracked on the Data Center Power Equipment pillar page alongside transformers and switchgear.
What this means for PUE
Liquid cooling generally lowers PUE — moving heat with liquid is more efficient than moving it with fans and mechanical chillers — but the mechanism matters: rear-door heat exchangers still lean on the room-level cooling plant behind them, while direct-to-chip and immersion cut the amount of heat that plant has to handle in the first place. The market for liquid cooling overall is forecast to keep growing at roughly 20% a year as direct-to-chip deployments become standard on new high-density builds.
Related guides
- PUE Explained — how cooling choice shows up in the efficiency number
- Arc-Flash Boundary Basics — safety checks on the electrical side of a high-density retrofit
Where Voltfield fits in
Cooling capacity is one of the sizing inputs on the POD & Skid Designer — set a critical load and the tool flags whether cooling capacity is present for it. For the electrical side of a liquid-cooling retrofit or new build, configure equipment directly on the Data Centers sector and get a real indicative lead time.
Frequently asked questions
Why is air cooling struggling with modern GPU racks?
Air has a much lower heat capacity than liquid, so moving enough air to cool a high-density GPU rack requires increasingly large volumes of airflow and fan power. Racks running well above 20–30kW commonly exceed what air cooling can practically remove, pushing designs toward liquid.
What is direct-to-chip liquid cooling?
Cold plates mounted directly on the highest-heat components (CPUs, GPUs) circulate coolant that carries heat away, while lower-heat components on the same board are usually still air-cooled — a hybrid approach, not a fully liquid-cooled server.
What does a CDU do?
A coolant distribution unit (CDU) is the interface between the facility's cooling loop and the rack-level liquid cooling loop, transferring heat between the two (often through a heat exchanger) while keeping the fluids and pressures on each side independently managed.
Specifying cooling for a high-density build?
Look up CDUs and cooling equipment against real specifications, each carrying an indicative lead time.
Equipment category
- Data Center Cooling — CDUs, CRAH units, rear-door exchangers and chillers, with lead times.