I started reading about how modern data centers are designed and the scale of infrastructure
surprised me.
It is not just racks of servers. There are power delivery systems, backup generators, cooling
networks, and a lot of electrical hardware just to keep everything stable.
One thing that stood out was how much heat comes from electrical systems themselves during
power conversion.
It made me wonder how much improvement is still possible in that part of the system.
The scale of infrastructure behind large data centers is kind of insane
byu/SPARK525 inenergy
Posted by SPARK525
2 Comments
The compute per electrical Watt continuously improves, and compute scheduling improves. The next step is liquid cooling. It is already being used.
A data center is basically a giant machine built to move heat somewhere else.