Latest / Engineering Influence from ACEC / AI, Power & the Future of Data Centers
Transcript
- 0:04Hello, and welcome to another episode of the Engineering Influence Podcast.
- 0:09My name is Diana O'Leary, and I'm with ACEC National. And today's show is brought
- 0:13to you by The Market Edge, a new podcast series that was created by ACEC National
- 0:18members who participate in a new committee,
- 0:21and it's the Market Intelligence Committee here.
- 0:24And so today we have with us Peter Nopan, a geotechnical engineer and business
- 0:30strategist for a member firm, ECS.
- 0:32And today's conversation is really going to focus on the data center market.
- 0:36We'll cover co-location and tech bubble fears, and we'll really dive in.
- 0:41So, Peter, happy holidays, and thank you so much for joining us today.
- 0:45Yeah, happy holidays to you, Diana, and it's my pleasure. It's my absolute pleasure
- 0:49to be here and talk about this very exciting topic. I mean, it's on everyone's minds.
- 0:55Yeah, so before we get into some questions, I did want to share a little bit
- 1:00more about Peter, so you know who you're listening to.
- 1:02So as I mentioned, he's with ECS Group of Companies.
- 1:06They're an ENR Top 100 firm. He focuses on scaling national accounts,
- 1:11building new service lines, and helping clients and teams really navigate complex
- 1:16multi-market developments.
- 1:17He's led major programs across healthcare and retail, for example,
- 1:22and now he's the firm's head and leads mission critical practice there.
- 1:26He's also a top 20 under 40 healthcare leader and founder at AE Centric.
- 1:31You'll have to tell me if I said that right, an AI advisory firm.
- 1:34And he's also a member of our market intelligence committee.
- 1:38We're really happy to have him.
- 1:39So when you and I spoke before, Peter, you know, before this call,
- 1:43you mentioned that somehow you're also involved in your company's internal board
- 1:47or working group for how ECS is going to use AI.
- 1:51So is that right? Can you tell us a little bit about that and how that happened?
- 1:56Yeah, absolutely. So obviously, every company is looking to enhance their processes,
- 2:03is looking to improve delivery for customers.
- 2:07And for us, we call it broadly technology. It's a technology committee.
- 2:11And we're focused on helping our people deliver better to our customers.
- 2:17And some of it's going to be evaluating AI technologies or AI products or even
- 2:23developing our own AI processes or AI-enabled processes.
- 2:28But that's the intent behind this is making fulfillment of our services more streamlined.
- 2:35We have better speed to market and just using AI tools.
- 2:39And I think it's very important to have committees around this so you can have
- 2:43early The adopters understand the use case.
- 2:47You can have people on the front line, attest, evaluate, iterate technologies,
- 2:52because nothing is a one size fits all.
- 2:55I think companies tend to rush to go and buy this extremely expensive piece
- 3:01of software or AI enabled tool, but no one uses it.
- 3:05And then they sunset it within 12 months. So that's not what we're trying to do.
- 3:10We go through a committee, we evaluate things. You know, we have we have a northern
- 3:13star, but we move slowly and we do things that solve business problems.
- 3:18Everybody's got a technology committee. Even ACC National here has one.
- 3:24Digital transformation has become the hot buzzword in addition to just AI in
- 3:30our industry, among many others, if not all.
- 3:32So how do you see the AI boom driving data center development?
- 3:38Like what are the big trends you're seeing out there that our members should know about? up.
- 3:42The way I see it, I would say it's not driving, it's completely changing the equation.
- 3:49It's skyrocketing data center development.
- 3:53And the easy way to understand it is data centers are evaluated from a power
- 3:59standpoint, or what they call the power to compute, so energy.
- 4:03A few years ago, prior to AI, the data center asset was sized or developed for,
- 4:12you know, cloud enterprise, small loads, stuff that's manageable,
- 4:16that doesn't require a lot of power.
- 4:19Today, these AI have GPUs, which is graphic processing units.
- 4:24They have racks and racks and racks of GPUs, which use a tremendous amount of
- 4:29power, and they generate a lot of heat.
- 4:33Which you need to cool it. So you have that combination of the two.
- 4:37If I look at your report that you published, the 2025 market intelligence brief,
- 4:42the estimate for the AI power consumption is four gigawatts in 2024.
- 4:49That's expected to go to 123 by 2035.
- 4:55That's a 40% compounded annual growth rate, which is mind-blowing.
- 5:03So you can imagine how many, the extent of data center needed to accommodate
- 5:09that increase in power to compute.
- 5:12Now we're seeing campuses, large campuses being developed over 100 megawatts,
- 5:18which, let's say a few years ago, was not something people would even wrap their heads around.
- 5:24So we think it's a fundamental transformation.
- 5:28And it's not just for data center development. It's also for energy. the grids.
- 5:33And we are, to an extent, becoming an AI-based economy.
- 5:37Yeah, it's really interesting. It's not just about the data centers,
- 5:41which a lot of engineers kind of refer to it as a simple box.
- 5:45You know, it's not very sexy. It's a box.
- 5:47But it's really the ancillary services that come with it. It's the water use.
- 5:51It's the energy application. And that's where some engineering firms are really
- 5:54seeing the bulk of the work or in these other markets. So let's talk about one
- 6:00in particular. We've got hyperscalers.
- 6:03So can you explain the role of them in the market today and why co-locating
- 6:07data centers with power sources is becoming so critical or at least interesting?
- 6:12Right no it's it's true and you
- 6:15look at the so how much do hyperscalers own
- 6:19how much of the market do hyperscalers own they own close to 50 of the power
- 6:25to compute and that is expected to go up and if you combine the hyperscalers
- 6:30with the car with the large co-locators which hyperscalers also lease space
- 6:35from, you're looking at 70%.
- 6:38So their needs dominate the industry, as you can imagine.
- 6:43If you have that much of the industry, your needs dominate the industry.
- 6:48And now once you start looking at these massive campuses, you have to have an
- 6:53energy source readily available.
- 6:55Because if you don't, those upgrades to the grid take years.
- 7:01And we don't have years. We're looking to lead AI as a country.
- 7:07So it's so critical to be near those power sources.
- 7:11And then you especially with these mega campuses, you need space a lot of times
- 7:17more than 100 acres because you're not just putting data halls.
- 7:20Data halls is a small is a small percentage of the occupancy of the physical space.
- 7:27You'll need to have cooling yards. You need to have a substation is very important.
- 7:31You need to have storage for redundancy so your data center doesn't go down.
- 7:36You need to have generator fields.
- 7:38So you're looking at a large, maybe 100 plus acre campus.
- 7:42I would say then the land limitation is you have to be near a power source.
- 7:46You have to have transmission, line transmission access, somewhat readily available, high voltage nearby.
- 7:53You need to have space for your cooling and mechanical systems.
- 7:57And of course, you need to have buffer zones to minimize your community impact.
- 8:01You live, understand you live in Maryland, so maybe not very close to data center,
- 8:05but your neighbors in Northern Virginia, they have noise, a lot of noise living next to the data center.
- 8:12People do not enjoy that. So you need some setbacks.
- 8:18That's something that the industry is working on improving for sure.
- 8:22All right. So why don't we talk about the water story? We kind of talked about
- 8:26co-locating with power, but how about the water story and data center development?
- 8:31It turns out it's a little bit more nuanced than we had originally thought.
- 8:34How are firms balancing cooling needs with the big sustainability concerns that
- 8:40are really out there, Peter?
- 8:42It's a very important topic, especially in certain states where the water supply is stressed.
- 8:50From my standpoint, the water story is more relevant to older data center developments
- 8:57that were high consumers of water.
- 8:59But now the new data centers, a lot of them use either closed loop or low water
- 9:06cooling, maybe air cooling.
- 9:07So there's not a whole lot of water usage.
- 9:11However, there's still that perception in places like Arizona that you're in
- 9:17the desert. So you don't have a lot of water.
- 9:19Your older data centers used to consume water. The new campuses do not consume as much water.
- 9:25Actually, they consume very little water comparatively. But there's still that
- 9:29perception that, well, a data center development is going to come and run the wells dry.
- 9:34And that's where you have to work with the community, reshape that understanding, work with...
- 9:41We'd work with the broader community so you don't have those challenges in your development.
- 9:47And the hyperscalers did have that commitment.
- 9:50They have a commitment for water positive operations by 2030, which is very good.
- 9:56That's helping anchor the goal
- 9:58of we're not using a lot of water or we're offsetting our water usage.
- 10:03So it becomes less critical as we develop. The industry is addressing that,
- 10:09targeting those sustainability goals, as we mentioned.
- 10:12But yeah, it's still an ongoing thing in places like Arizona,
- 10:16maybe Colorado, Montana, where the water supply is always in jeopardy.
- 10:22So you talked a little bit about Northern Virginia earlier.
- 10:25We know that's kind of like the primary area of growth. Are there other hot
- 10:29markets that you all are tracking for new data center development that you can share?
- 10:34Absolutely. Absolutely. And that's not something we're under NDA for.
- 10:38So the data center alley, that is by far the world leader in data center development.
- 10:48And the reason why is they have a unbelievable, you know, positive regulatory
- 10:53environment and they have a very strong grid.
- 10:56So Dominion Energy started back in the 70s to develop that grid,
- 11:01create those very strong backbones.
- 11:02But now you look at other markets, you look at old industrial markets.
- 11:07So Columbus, Ohio, that's a very strong market from a power standpoint.
- 11:11They're getting heavy data center development.
- 11:15Cities like Atlanta, Georgia Power has also done a very good job.
- 11:19So there's readily available power in Atlanta.
- 11:22Chicago, old industrial, low risk.
- 11:26There's no really any environmental or weather issues that happen in Chicago.
- 11:31So Chicago gets a lot of data center development.
- 11:34The DFW market, Phoenix. And I think you did a great job, by the way,
- 11:38in your report mentioning those top 10 markets for development.
- 11:42And I do think any city technically can become a hotspot if you have a favorable
- 11:47power generation structure and you have somewhat expedited permitting processes
- 11:55or easy permitting processes.
- 11:57So, yeah, there's opportunities everywhere in many, many states.
- 12:01But at this point, we're still looking at those five to ten large, large markets.
- 12:08Well, thanks for the shout out on the brief, Peter. And for those that aren't
- 12:11aware, the Market Intelligence Brief is a quarterly series that comes out.
- 12:17It's a four-page report that we work with the Market Intelligence Committee
- 12:21on to get the latest trends and data out on a specific market.
- 12:24So we'll make sure to include a link to access that in the show notes for today's session.
- 12:29I wanted to move on to this bubble talk. You know, I'm a regular listener to,
- 12:34you know, Bloomberg 99.1 and some fear the bubble tech, the tech bubble's got to pop.
- 12:40And so do you see signs of oversupply or things slowing down?
- 12:46You know, how do you feel actually being out there pursuing this work?
- 12:49Yeah, that's a lot of times the media like to say things like bubble because
- 12:54that gets people to click and watch and gets your eye, gets the eyeballs paying attention.
- 13:00Maybe we should say bubble on the podcast if people watch it, listen to it more often.
- 13:04But yes, there is a bubble pattern developing in technology or AI companies.
- 13:10Because some of them, it's just a function of excitement. People get too excited.
- 13:15There's no real fundamental revenue model to generate cash.
- 13:19And you have these insane valuations, which is somewhat similar to back in the
- 13:25dot-com bust back in 2000. And you had a lot of companies that went under,
- 13:31but the strong companies continued.
- 13:34That is one side of the story, but the reality from a data center development
- 13:39standpoint, actually we're way undersupplied.
- 13:43So the demand by far exceeds the supply currently.
- 13:46You know, you did mention in
- 13:48your report, you know, you're going from four gigawatts to 123 gigawatts.
- 13:52So we need a lot more capacity. And actually vacancies, all time low,
- 13:59close to zero percent. There is no speculative development as far as I know yet.
- 14:06A lot of the sites under construction, they're pre-leased.
- 14:09The constraint that we're hitting is power. That's our constraint.
- 14:15It's not that we're oversupplied at all. We're actually undersupplied and we're
- 14:21supply constrained by power.
- 14:24Where I hear a lot of data center, if you're in the business,
- 14:27if you're in the AEC business, expect a lot more data center construction.
- 14:33You heard it here first, everybody, for Peter at ECS. Keep on going.
- 14:38So the way I hear about the tech bubble is a lot, you know, in conversations
- 14:44with day traders in the stock market.
- 14:46And it's because of them moving into their phase two, the magnificent seven
- 14:51or this big four or whatever we're calling them now.
- 14:54Is that they need phase two to happen for them to be successful.
- 15:00Right now, everybody is signing up for the free version of AI.
- 15:05They need enterprise-wide adoption like your firm and our association to buy
- 15:11the paid-for version and implement it enterprise-wide so that they can take
- 15:16those revenue expectations to the next level.
- 15:19And so it'd be really interesting to see how that plays out.
- 15:22What do you think? Do you think people stay with the freed versions or do you
- 15:26think they finally take the next step and start implementing? And what's ECS doing?
- 15:30Yeah, no, I would on that topic. It's it's a function of most importantly,
- 15:36are you solving a pain for someone?
- 15:38And if you are solving a pain, if you're solving a problem, then they will pay
- 15:43for it. People pay for their time.
- 15:45That's the most important thing. People pay for your time. So if you save them
- 15:48time, then they will pay for it. And we've seen with SaaS, software as a service,
- 15:56that freemium model or subscription-based model.
- 16:00Very successful. I know from myself, I have probably all the memberships you
- 16:05can imagine, because I can either click of a button, have things delivered to my house.
- 16:09I don't have to go to a store. I don't have to get in a car,
- 16:13park, find parking, park, do all that.
- 16:17I think we have a great technology. Now we're looking at use cases,
- 16:22and there's a lot of nuance from a use case standpoint,
- 16:25because what ECS needs, like my top three priorities as a company's are going
- 16:30to be very different than what ACEC needs from an AI enabled tool.
- 16:35So yeah, that's, that's the transition. And in the transition,
- 16:39the strong companies with the valid and valuable products will make it to that
- 16:45phase two that you're mentioning.
- 16:47And then the ones with a product that doesn't really solve the problem will just evaporate.
- 16:54So I want to get back a little bit to the physical infrastructure of the data
- 16:59center, you know, and you talked about the power concerns. And so we talked
- 17:03a little bit about connecting to the grid.
- 17:05So can you share examples of how they are connecting and how your firm is approaching
- 17:11what might be challenges that are arising from this?
- 17:15Yeah, that's a very important topic.
- 17:19So to connect to the grid, a lot of times it's major upgrades.
- 17:25So it's not just a substation on site.
- 17:28That is a very key thing for a data center, but it's also your high-voltage transmission lines.
- 17:34Sometimes you have to do upstream upgrades, transmission upgrades.
- 17:38A company like us, ECS, what we've done actually this past year is we've hired an energy director.
- 17:46So someone that is pursuing power generation and transmission.
- 17:51That is, as we mentioned, that
- 17:53is the critical supply issue that data centers have now, is the power.
- 17:59Our company, we're an environmental geotech firm, Construction Material Testing.
- 18:04So what we provide is we help companies, power companies or data center development
- 18:10companies or hyperscalers,
- 18:11help them de-risk their projects by providing them environmental or environmental
- 18:16risks or geotechnical subsurface issues, maybe we help them with NEPA reviews,
- 18:23wetland permitting, regulatory support. So that's the type of stuff that we provide.
- 18:27So your permitting is faster, your design is more effective.
- 18:32We help with the geotechnical design so your design is more effective. So
- 18:35your speed to market increases and we're
- 18:38talking about how important it is to move at speed because again
- 18:42we need a lot more power and we
- 18:44need a lot more power to compute and in
- 18:48order to hit that 40 50 compound annual growth rate things need to move fast
- 18:53but that's that's essentially how ecs is supporting the space and i will add
- 18:59a caveat you might have heard this some of the hyperscalers even co-location
- 19:04companies they're exploring the model of generating energy on site.
- 19:09It's called the SMR or the Small Modular Reactor. Have you heard of that? Yep.
- 19:16I've heard it could take longer, though, to actually happen.
- 19:22Like we're further away from nuclear clean energy as a power source for data centers than we think.
- 19:27I mean, what are you seeing? I heard it was 10 years. Now I heard it's maybe five years.
- 19:32I mean, you're out there. What are you hearing? We're not seeing it happen.
- 19:37So we're very involved in the development life cycle. So we're not seeing it happen.
- 19:42But the, I said the research or the, if you go and look at some of these resources,
- 19:50they are pushing big companies, hyperscares, they're investing a lot of money
- 19:54into this concept, into this new technology.
- 19:57I would assume there's some viability to it. Obviously, they're making big bets.
- 20:02They make asymmetric bets.
- 20:03If it's successful, then it's something that might be huge.
- 20:07If not, we'll continue to get power to their site, I guess the good old-fashioned
- 20:12way, the way we're doing it now.
- 20:15So there were some locations already selected for co-location opportunities,
- 20:21and that is available on the Market Intel Brief.
- 20:24So if you haven't checked it out, go ahead and get into that.
- 20:27That is probably about all the time we're going to have for today.
- 20:30Listeners, please don't forget to like and subscribe ACAC's Engineering Influence
- 20:34podcast and YouTube channel today.
- 20:37Peter, thank you so much for joining me today.
- 20:39It's been my pleasure. Thank you so much for having me. And please continue
- 20:43to publish your content. Those were very valuable four pages.
- 20:47Probably the most valuable four pages I've read recently.
- 20:51Awesome. Glad to hear it. And thank you everyone else for joining the Market
- 20:55Edge today. See you next time.