Hank Elsner Live Wire
Tech, crypto and space news, read live while the laser runs. · RSS
Home / Deep Dive · · By Hank Elsner · about 4 min read aloud

Inside an AI Data Center: Power, Heat and Noise

Why the buildings that run AI are measured in megawatts, why they are mostly about cooling, and what really happens when the power goes out.

Inside an AI Data Center: Power, Heat and Noise

Picture a building with no windows. You badge in through two doors. The second one won't open until the first one closes behind you. And then you hear it. A roar. Not loud like a concert. Loud like standing next to a waterfall that never stops.

That's a data center. That noise is fans. Thousands of them. And the reason they never stop is the most important thing about AI that nobody talks about.

It's a heat business

Here's the secret. A data center isn't really a computer building. It's a cooling building that happens to have computers in it.

Every bit of electricity that goes into a chip comes out as heat. All of it. A computer is, in physics terms, a very complicated space heater that does math along the way. And an AI chip is an extremely powerful one.

For years, a typical rack, which is a cabinet about the size of a tall refrigerator, full of servers, might draw a few kilowatts, maybe ten. An AI rack packed with the newest chips can draw well over a hundred kilowatts. That's the same space, more than ten times the heat.

At that level, blowing air doesn't cut it anymore. So the newest AI systems use liquid cooling. Cold plates sit right on the chips, with liquid running through them, carrying the heat away to giant coolers outside.

Gigawatts

This week you heard Anthropic has a deal with AMD for up to two gigawatts of computing. Let's make that number mean something.

A gigawatt is a billion watts. A big nuclear reactor puts out roughly a gigawatt. So when AI companies talk about gigawatts of compute, they're talking about the output of entire power plants, just to run and cool computers. That's why you're seeing data centers built next to power plants, and power companies building new plants just for data centers.

When the power goes out

So what happens if the power goes out? This is the part I love.

Step one: the moment the utility power flickers, batteries take over. Big rooms full of them, called a UPS, an uninterruptible power supply. The servers don't even notice. No blink.

Step two: within seconds, diesel generators start. Huge ones, the size of shipping containers. They spin up, sync to the right frequency, and take over the load from the batteries.

Step three: fuel. Serious data centers keep enough diesel on site to run for many hours, sometimes days, and they have contracts for trucks to bring more.

The industry word for this is redundancy, and you'll hear people say "N plus one." N is the number of machines you need. Plus one is the spare. Some places go "two N," meaning a complete second copy of everything. Two power feeds into every server, from two separate paths, so if one whole side dies, the other carries it.

The cables, again

And between all of it, fiber. Every server connects to switches, every switch connects up the chain, and the chain goes out of the building to the rest of the internet. In an AI cluster, the chips have to talk to each other constantly, so the amount of fiber inside one of these buildings is enormous. Thousands of strands in a single room, every one of them labeled, tested and documented. That's the work.

Remember the Nvidia benchmark, ninety-seven percent efficiency going from 256 chips to 1,024? That number lives or dies on the network. If the chips can't talk to each other fast enough, they sit around waiting. That's why the cables matter as much as the chips.

Why you should care

Every time you ask an AI a question, a chip in one of these buildings heats up for a moment, a fan spins a little faster, and a power plant somewhere burns a little more. That's not a reason to feel guilty. It's a reason to understand why the biggest fights in tech right now are about electricity, land and water. AI isn't just software. It's a construction project.

Ask the chatWould you want a data center built in your town? Type YES, NO, or DEPENDS.
On the laserEngraving "N+1" on a keychain. Goes to whoever explains in chat what it means, in their own words.