For those who may be unfamiliar with CFD – Computational Fluid Dynamics – it is the science of modeling the movement of liquids or gasses and their interaction with obstacles and other influences. Utilizing CFD we can look at the three critical elements that make up the heat removal (and think heat removal, not COOLING): Air Pressure, Air Flow and Air Temperature. There is a lot of focus on Temperatures, and it may surprise many to find that of the three elements, Temperature is the least important. This is how many mistakes in setting up the heat removal from the data center occur.
It is no secret in the data center industry that if you want to reduce your energy costs, the first place to start looking is at the cooling. Cooling costs account for over 50 percent of a data center’s operating budget, and continues to grow as density rises and heat loads increase. Getting your cooling right is critical to not just controlling those costs, but also of reeling them in.
This is just as true for an existing data center as it is for one that is still on the design table. We have seen, many times, assumptions made about cooling. Is this scenario familiar?
Case Study (We have seen this scenario on more than one occasion)
You spent months designing the data center, and carefully calculating the loads. The cabinets have been designed with an expected distribution of 6 kilowatts per cabinet in your 100 rack space. That’s 600kW of heat load. Your UPS is nicely sized at 2(N+1) with 3 x 300 kVA UPSs on each feed. You have 8 Cooling units (CRAC/CRAH/PAC, etc.) at 90kW each, giving you N+1 capacity in your cooling.
Its commissioning day, and you crank up the load banks in the racks to a nice 6kW each… 600kW of heat is pouring into the room. Your cooling units are pouring cold air out at 22C (72F)… and in 10 minutes, the room temp is climbing out of control. After 12 minutes you start to reach temperatures of 33C (92F) at the top of the racks. Something is terribly, terribly wrong. Are the cooling units broken? Weren’t they Startup Tested properly? A check shows, they are working as expected.
You stop the test, the room’s getting too hot and everyone is sweating. If there had been real gear in the racks, it might have been a disaster. What is going wrong?
What’s Really Happening
You start to investigate. First you discover that the Cooling machine that was specified by the vendor is actually 90kW Total Cooling capacity, and a sensible cooling load (what you can really cool) is much lower. (This is a function of outlet temperature vs return temperature, but we’ll not dig into that detail here). The real capacity is actually closer, you discover in horror, to 79kW. (That’s a loss now of 88kW cooling capacity across your 8 units! There goes your redundancy! But that still isn’t the only issue, as the room temp soared).
It’s time to call in CFD for some answers. The room is modeled, taking all the key elements that impact heat removal in the room. Are there obstructions to supply air? Are there obstructions to return air? What is the volume of air coming from the cooling unit? Where is that air going? How fast is it moving under the floor? Is it delivered overhead? Are cold and hot air mixing? How bad is it? What capacity can the heat removal solution really provide?
To answer these questions, we use state of the art Future Facilities 6SigmaDCX CFD modeling solution to build detailed models, no matter how simple or complex they may be. (We have even shown that CFD in a single rack environment can have profound impact on reducing operating costs, as well as maintenance from excessive wear and tear on poorly placed components).
On average, we reduce the operating costs of our clients’ facilities by 25%. (In extreme cases we have reduced electrical costs by over 50%). That typically means an ROI of less than 8 months.
What Else Does CFD Do For the Data Center
As we mentioned in the Case Study, there can be a lot wrong with the heat removal strategy. Room design, cooling unit arrangement, misunderstood ratings and “pretty” all contributed to the room failing to meet expectations on the initial commissioning and capacity maximums. It is a low cost way to know these problems exist through modeling before BUILDING the environment. And yes, even the cooling unit capacity issues for sensible versus total cooling capacity would have been discovered had they been modeled prior to. (We utilize the manufacturers’ specification to create the module capacity, complete with variable set points for cooling targets, and air flow). Hundreds of thousands of dollars can be cost avoided in both capital and operating expenses through low-cost CFD.
So How Affordable Is It
GDCE has made it a goal to make CFD affordable to everyone. We offer a cost per kilowatt model for CFD modeling of $125USD per kW from 1kW to 30kW. Above 30kW we offer a fixed rate based on your data center rack size and kW to be utilized. (kW is based on either total IT load or total Cooling Capacity, whichever is greater… and we know that sounds counter intuitive, but we’ve seen plenty of cooling capacities not able to cover their IT loads).
This includes 4 scenarios for a single model. (Scenarios allow you to examine “What if this Cooling Unit isn’t available?” How does leaving the door open for long periods of time impact my data center? Will installing the raised floor at 600mm really give me an advantage over installing it at 300mm?
The choices of what scenarios you wish are yours, and we will work with you to determine what is most valuable to you. Additional scenarios can also be run at a cost of $25USD per kW up to 30kW, and negotiated for sizes higher at about %20 of the base cost. It will also include a highly detailed report of the results and analysis, which will cover:
Temperature at four planes:
10cm from floor
1 meter from floor (center rack)
Top of rack (42U, 45U, 48U, 50U your option)
Below the raised floor (if present)
Above the raised floor
To Grills (if present)
To Cooling Units
Air Pressure (for raised floors):
Grill pressures (2D and 3D)
Vent Temperatures (for non-raised floors):
Rack front and back temperatures
Cooling Unit Supply and return temperatures
Let us provide a detailed scope of works for your CFD needs. Contact us, and we will discuss how we can reduce the cost of your data center, whether still on the design table, or already in operation.