Latest / Best of LinkedIn: Digital Transformation & Tech / Best of LinkedIn: Green ICT & Sustainable AI CW 38/ 39

Transcript

Best of LinkedIn: Green ICT & Sustainable AI CW 38/ 39 · Best of LinkedIn: Digital Transformation & Tech

• 0:00
  Speaker 0: This episode is provided by Thomas Allgaier and Frenties, based on the most relevant linked in-posts about green ICT and sustainable AI from CW-Thirty-Eight & Thirty-Nine.
• 0:11
  Speaker 0: Frentie supports ICT enterprises in the form of delivering precise ICT market and pricing intelligence that analyst subscriptions an existing databases cannot provide.
• 0:21
  Speaker 0: You can find more info in description.
• 0:23
  Speaker 1: So, uh did you know that processing just a handful of really complex AI prompts could You know consume the exact same amount of energy as boiling a kettle of water?
• 0:33
  Speaker 0: Wow.
• 0:34
  Speaker 0: Just a kettle-of-water for a few prompts?
• 0:36
  Speaker 1: Yeah But well here is the catch.
• 0:39
  Speaker 1: That's actually only true if your request gets routed to a server sitting in a very specific Geographic region.
• 0:45
  Speaker 0: right
• 0:45
  Speaker 1: If it gets routeds somewhere else like a different grid entirely that carbon footprint might drop by.
• 0:51
  Speaker 1: I mean a factor of twelve.
• 0:52
  Speaker 0: That is just wild, a factor of twelve.
• 0:55
  Speaker 0: Well welcome to today's deep dive everyone!
• 0:57
  Speaker 0: We are looking at the physical collision between our digital ambitions and quite frankly...our ecological reality.
• 1:04
  Speaker 1: Exactly because
• 1:05
  Speaker 0: it's huge bottleneck right now
• 1:07
  Speaker 1: It really is
• 1:08
  Speaker 0: So for you, The Digital Transformation & Tech Professionals navigating all this we're pulling together the absolute most critical insights on green ICT and sustainable AI trends that are circulating across LinkedIn Right Now.
• 1:21
  Speaker 1: Yeah, we're trying to figure out how the industry is actually dealing with this because you know The cloud has this illusion of being
• 1:27
  Speaker 0: completely invisible
• 1:27
  Speaker 1: right?
• 1:28
  Speaker 1: Invisible.
• 1:28
  Speaker 1: You write some code you hit enter and it just feels totally weightless.
• 1:32
  Speaker 0: But I think you all know that behind every single API call there was just this massive heavily constrained physical infrastructure.
• 1:40
  Speaker 1: yeah We are rapidly moving away from this world where software was treated as just you know abstract logic.
• 1:45
  Speaker 0: Now it's firmly tethered to the ground.
• 1:47
  Speaker 0: It is pulling just unbelievable amounts of water and power from local communities
• 1:52
  Speaker 1: And, um...the entire industry is waking up this reality at basically exact same time.
• 1:57
  Speaker 1: The limits aren't about processor speed anymore
• 2:01
  Speaker 0: Right!
• 2:01
  Speaker 0: Its not just memory limits.
• 2:02
  Speaker 1: No its literally gigawatts of electricity Millions gallons of water.
• 2:07
  Speaker 0: So let us start by looking how the industry measuring footprint right now Because logically, you can't optimize a system if your baseline metrics are lying to right?
• 2:16
  Speaker 1: Right exactly.
• 2:17
  Speaker 1: If you measure the wrong thing You optimize the wrong things
• 2:22
  Speaker 0: Exactly and we're seeing this major shift away from isolated endpoint metrics.
• 2:27
  Speaker 0: Pavel Kamiaku brought up a really fantastic point about this.
• 2:31
  Speaker 1: Oh yeah his post was great.
• 2:33
  Speaker 0: Yeah He argues that software efficiency needs to be measured per unit of business work not just by looking at A single endpoint in a complete vacuum
• 2:42
  Speaker 1: because that can be super misleading.
• 2:44
  Speaker 0: Totally, like he gives this example of a .NET API endpoint let's say a developer makes that end point I know thirty percent faster by trading CPU processing time for some extra database queries.
• 2:57
  Speaker 1: right.
• 2:57
  Speaker 1: so on paper that benchmark looks absolutely incredible!
• 3:01
  Speaker 0: Right the developer probably gets a bonus for making things faster.
• 3:05
  Speaker 0: But what's actually happening to the backend infrastructure?
• 3:08
  Speaker 0: Well,
• 3:09
  Speaker 1: The cloud bill goes up for one and so does the carbon footprint.
• 3:12
  Speaker 0: Exactly
• 3:13
  Speaker 1: Because by shifting that computational burden away from the web server And just dumping it onto the database cluster...the database load totally spikes.
• 3:21
  Speaker 0: So this system as a whole is working harder.
• 3:24
  Speaker 1: exactly It's consuming way more total resources To complete exact same business transaction.
• 3:30
  Speaker 1: Its like if you make a conveyor belt thirty percent faster Just by pushing the load to the packaging department?
• 3:36
  Speaker 0: The factory itself isn't actually more efficient.
• 3:39
  Speaker 1: Right, you're just moving the bottleneck around and basically playing a shell game with your emissions.
• 3:43
  Speaker 1: Efficient code does not always equal an efficient system...the system boundary really matters here
• 3:49
  Speaker 0: Which kind of brings us directly into end user side of this equation.
• 3:53
  Speaker 0: Allison Freeman shared his interesting development.
• 3:56
  Speaker 1: Oh, the calculator.
• 3:57
  Speaker 0: Yeah there is now a free AI impact calculator out there that estimates energy use for your daily prompts.
• 4:04
  Speaker 1: That's pretty cool.
• 4:05
  Speaker 0: It breaks down energy, carbon emissions and water consumption based on whether you're just drafting text emails or generating those heavy high resolution images.
• 4:14
  Speaker 1: it's brilliant awareness tool For sure.
• 4:17
  Speaker 0: But she makes this really crucial point.
• 4:19
  Speaker 0: We can't blame end users.
• 4:21
  Speaker 0: prompting habits.
• 4:23
  Speaker 1: Absolutely not
• 4:24
  Speaker 0: Right, like we can't solve a massive infrastructure crisis by just telling everyday people to you know prompt less.
• 4:30
  Speaker 1: No because putting the burden of sustainability on every day users I mean it's just a distraction from the actual structural problems.
• 4:37
  Speaker 0: Exactly!
• 4:38
  Speaker 0: It is systemic issue.
• 4:39
  Speaker 1: Yeah, technology leaders have to architect solutions.
• 4:42
  Speaker 1: They need to engineer grid-aware infrastructure from the ground up like The system should be smart enough to route say non urgent batch processing two regions where renewable energy is currently peaking
• 4:55
  Speaker 0: instead of relying on the user To decide if their prompt is like environmentally justified today
• 5:00
  Speaker 1: exactly and that structural shift Is already hitting corporate budgets really hard?
• 5:06
  Speaker 0: Oh Definitely.
• 5:07
  Speaker 0: Micah Conrad's actually gave a really good look inside her company Newland regarding this.
• 5:12
  Speaker 0: Yeah,
• 5:12
  Speaker 1: they rely heavily on agentic coding right?
• 5:14
  Speaker 0: Right and They actually built their own token dashboard to track there AI usage across all these different cloud providers.
• 5:21
  Speaker 1: And what did they find?
• 5:22
  Speaker 0: well they discovered something absolutely terrifying for any CFO.
• 5:27
  Speaker 0: They realized that moving entirely to a token-based LLM billing model could actually raise their costs by a factor of ten.
• 5:34
  Speaker 1: Ten, wow.
• 5:35
  Speaker 1: Yeah
• 5:35
  Speaker 0: a factor of ten.
• 5:36
  Speaker 0: compared to traditional cloud hosting cost and carbon footprint are becoming well deeply intertwined.
• 5:43
  Speaker 1: Let's actually break down why that happens because it's fascinating.
• 5:46
  Speaker 1: you know Traditional Cloud pricing is largely based on reserved instances or just server uptime.
• 5:51
  Speaker 0: You're paying for the machine did?
• 5:53
  Speaker 0: Just be there
• 5:54
  Speaker 1: exactly.
• 5:54
  Speaker 1: you pay for availability.
• 5:56
  Speaker 1: But generative AI brings in this token-based billing.
• 5:59
  Speaker 1: you are paying per inference literally per word generated.
• 6:04
  Speaker 0: So compute intensive bursts become incredibly expensive.
• 6:08
  Speaker 1: Right, and Newland actually expanded their dashboard.
• 6:10
  Speaker 1: they worked with a green IT expert to estimate the CO-II footprint right alongside the financial cost
• 6:16
  Speaker 0: Which makes sense because every token processed requires A specific fraction of compute which draws a fraction Of energy which emits a fraction of carbon.
• 6:25
  Speaker 1: Precisely so when you reduce unnecessary token consumption just to save your budget You're simultaneously pulling down your estimated emissions.
• 6:33
  Speaker 0: The financial incentive and the ecological incentive are just perfectly aligned for once.
• 6:38
  Speaker 0: Yeah,
• 6:39
  Speaker 1: they finally line up.
• 6:40
  Speaker 0: But you know I want to throw a wrench into that logic for a second.
• 6:43
  Speaker 1: uh-oh okay well
• 6:45
  Speaker 0: You might assume that to save tokens in energy?
• 6:47
  Speaker 0: You should just automatically use a smaller leaner AI model right?
• 6:51
  Speaker 1: yeah That's the standard thinking right now Right.
• 6:54
  Speaker 0: but Anita sure points out this really critical nuance that i think most developers Are completely missing.
• 6:59
  Speaker 0: Smaller ai models are not Automatically greener.
• 7:03
  Speaker 1: See that sounds completely counterintuitive to me, right?
• 7:06
  Speaker 1: I mean a smaller parameter model requires less memory.
• 7:10
  Speaker 1: It takes less processing power.
• 7:12
  Speaker 1: how on earth could it possibly burn more energy?
• 7:15
  Speaker 0: think of it kind like Hiring an interned to save money.
• 7:18
  Speaker 1: okay
• 7:19
  Speaker 0: the interns hourly rate is way lower than a senior engineers rate.
• 7:22
  Speaker 0: Right
• 7:22
  Speaker 1: sure obviously.
• 7:23
  Speaker 1: but
• 7:24
  Speaker 0: if that intern struggles with a complex task and Takes ten hours to do it loops through five different revisions and needs constant oversight.
• 7:33
  Speaker 0: Ah,
• 7:33
  Speaker 1: you haven't actually saved any money?
• 7:35
  Speaker 0: Exactly!
• 7:36
  Speaker 0: You've spent way more... And it's the exactly mechanism with AI.
• 7:40
  Speaker 0: If a smaller model struggles with complex reasoning tasks It requires way more retries.
• 7:45
  Speaker 1: Or if takes heavier like reasoning effort to get equality results
• 7:49
  Speaker 0: Yes..if have to force into loop until he gets right it actually burns massive amounts of energy.
• 7:56
  Speaker 1: So basically just spends time spending its wheels.
• 7:59
  Speaker 0: A larger, more capable model might consume more power per second.
• 8:03
  Speaker 0: Sure but it does the job right on their very first try in a fraction of time.
• 8:08
  Speaker 1: That makes total sense.
• 8:09
  Speaker 0: And plus if developers are constantly switching models back and forth to optimize things they have to continually refill the cash which is just another huge energy drain.
• 8:19
  Speaker 1: Right!
• 8:19
  Speaker 1: The Total Energy To Reach The Destination Is What Actually Matters Not Just The Size Of The Engine.
• 8:24
  Speaker 0: Exactly
• 8:25
  Speaker 1: And honestly, that is a massive blind spot in how organizations are forecasting their AI emissions right now.
• 8:31
  Speaker 0: It really is!
• 8:32
  Speaker 1: Those blind spots get even more severe when we start looking at geography.
• 8:36
  Speaker 1: Lilabeth Bustos-Lanaris actually shared some cool findings from SOMA AI.
• 8:40
  Speaker 1: Oh
• 8:41
  Speaker 0: they're a carbon footprint tool?
• 8:42
  Speaker 1: Yeah exactly They found.
• 8:44
  Speaker 1: just misclassifying an AI model's tier can throw your emission estimates off by four to five times
• 8:50
  Speaker 0: Four to Five Times Just From Tier Misclassification.
• 8:53
  Speaker 1: But the real shocker is the geography part.
• 8:56
  Speaker 1: Running the exact same model with the exactsame query in a different geographic region can swing your emissions by a factor of twelve.
• 9:03
  Speaker 0: A twelve-time difference just based on where server physically sets?
• 9:07
  Speaker 0: I mean, how's that even
• 9:08
  Speaker 0: possible?!
• 9:09
  Speaker 0: Is it really just the difference in local power grids?
• 9:12
  Speaker 1: It's all about the base load power of that specific local grid.
• 9:15
  Speaker 1: Okay, like if you route a workload to a data center in a region That heavily relies on coal or natural gas The carbon intensity per kilowatt hour is just massive
• 9:24
  Speaker 0: right?
• 9:25
  Speaker 0: They make sense
• 9:25
  Speaker 1: but If you route that exact same work load To a facility and say Quebec Or the Pacific Northwest where they run almost entirely On hydroelectric power
• 9:34
  Speaker 0: the carbon footprint completely plummets.
• 9:36
  Speaker 0: Exactly,
• 9:37
  Speaker 1: and this is exactly why having sourced versioned and tier data is so incredibly critical for enterprise buyers.
• 9:43
  Speaker 0: You can't just use a generic global average.
• 9:46
  Speaker 1: No using a global average multiplier for carbon accounting Just renders the data completely useless.
• 9:51
  Speaker 1: that
• 9:51
  Speaker 0: Is fascinating?
• 9:53
  Speaker 0: Before we zoom out from the software layer in really dive into the physical infrastructure side of these data centers Just a quick reminder for y'all listening.
• 10:01
  Speaker 0: Yeah, subscribe exactly.
• 10:03
  Speaker 0: hit that subscribe button if you want to make sure You don't miss future deep dives into these curated industry insights.
• 10:08
  Speaker 0: We curate all these trends so you don't have to spend hours scrolling linked in yourself.
• 10:12
  Speaker 1: Well we do the heavy lifting for you.
• 10:14
  Speaker 1: So let's talk about the physical site now because If The software measurement is zooming out from the endpoint To the whole business system?
• 10:21
  Speaker 1: The hardware layer Is doing exact same thing.
• 10:23
  Speaker 1: yeah
• 10:23
  Speaker 0: data centers are definitely no longer just isolated buildings
• 10:27
  Speaker 1: right.
• 10:28
  Speaker 1: Paul Chernoch framed this brilliantly.
• 10:30
  Speaker 1: He argues that the physical facility itself is no longer the right boundary for optimization.
• 10:35
  Speaker 0: It's way bigger than the building
• 10:36
  Speaker 1: now.
• 10:36
  Speaker 1: Exactly AI infrastructure must be optimized as this deeply coupled system of power, compute and economics
• 10:44
  Speaker 0: Which is a huge shift.
• 10:46
  Speaker 1: Yeah
• 10:46
  Speaker 0: Because for twenty years The industry basically just optimized the building
• 10:50
  Speaker 1: Right?
• 10:50
  Speaker 1: They minimized electrical losses they bought slightly more efficient air conditioners
• 10:55
  Speaker 0: Right, and he treated the actual useful work produced by servers as just somebody else's problem.
• 11:00
  Speaker 1: Totally!
• 11:01
  Speaker 1: And AI absolutely shatters that separation.
• 11:04
  Speaker 1: Chernot calls this new paradigm fuel-to-token efficiency.
• 11:08
  Speaker 0: Fuel to token?
• 11:09
  Speaker 0: Yeah I like it.
• 11:10
  Speaker 1: It is no longer about how efficiently power reaches server rack but effectively the entire ecosystem converts raw energy into economically useful output.
• 11:20
  Speaker 0: Factoring in things like grid constraints
• 11:22
  Speaker 0: right?!
• 11:23
  Speaker 1: Yes, grid constraints water availability even community acceptance.
• 11:28
  Speaker 0: But you know here is the paradox with just optimizing a facility You can have the absolute most efficient power delivery in the world but if the servers inside are running garbage code... ...you're just efficiently wasting energy.
• 11:42
  Speaker 1: Exactly!
• 11:43
  Speaker 1: Your'e doing really good job at wasting power Right.
• 11:47
  Speaker 0: And that's why industry veterans like Greg Bodenheimer and Vinod Balani Are arguing PUE.
• 11:53
  Speaker 1: Oh, power usage effectiveness?
• 11:55
  Speaker 1: Yeah.
• 11:56
  Speaker 0: Power usage effectiveness which has been the golden metric for data centers for twenty years They're saying it's no longer enough.
• 12:03
  Speaker 0: The industry really needs to transition toward metrics like watts per token
• 12:08
  Speaker 1: Or a useful AI output per megawatt.
• 12:10
  Speaker 1: I think they called it
• 12:11
  Speaker 0: Exactly!
• 12:12
  Speaker 1: Have to play devil's advocate here.
• 12:13
  Speaker 1: for second though Go
• 12:14
  Speaker 0: for it
• 12:15
  Speaker 1: Because we can't throw PUE out window just yet.
• 12:18
  Speaker 1: Like Watts Per Token is definitely Holy Grail but base facility efficiency still moves massive markets.
• 12:25
  Speaker 0: Oh, for sure!
• 12:26
  Speaker 1: Vinod Bajlani actually ran the math on this to show why PUE still matters at hyperscale?
• 12:31
  Speaker 0: What did The Math Show?
• 12:32
  Speaker 1: Well if you take a one gigawatt AI factory which is the crazy scale we're moving toward right now and you cut its PUE from the industry average Which is about one point five four okay And You get it down To A highly Efficient One Point O nine The physical Savings Are Just Staggering.
• 12:48
  Speaker 0: Okay, wait.
• 12:48
  Speaker 0: A gigawatt is roughly the power draw of like a medium-sized city.
• 12:52
  Speaker 0: So what does it drop?
• 12:53
  Speaker 0: Of zero point four five and pue actually yield.
• 12:57
  Speaker 0: in reality
• 12:58
  Speaker 1: you save about three thousand nine hundred forty gigawatts hours of energy every single year.
• 13:02
  Speaker 0: Wow
• 13:03
  Speaker 1: Yeah And in financial terms that translates to roughly three hundred fifteen million dollars in lower annual energy costs.
• 13:10
  Speaker 0: Three hundred and fifteen million Dollars.
• 13:13
  Speaker 0: yep
• 13:14
  Speaker 1: And that is before you even generate a single AI token or run a single line of code.
• 13:19
  Speaker 1: Facility efficiency is absolutely still the bedrock of economics.
• 13:23
  Speaker 0: Okay, yeah Saving three hundred and fifteen million dollars Is pretty compelling reason to keep tracking PUE.
• 13:29
  Speaker 0: We'll give ya That
• 13:30
  Speaker 1: Just A little bit.
• 13:31
  Speaker 0: But driving that number down actually brings us To probably The most contentious physically demanding part Of data center design right now.
• 13:39
  Speaker 0: Which is cooling?
• 13:40
  Speaker 1: Oh Yeah The heat is a massive problem.
• 13:43
  Speaker 0: Anil Velecha and Ravi Shankar Bhashbhai weighed in on this, they noted that cooling is just a brutal trade-off.
• 13:49
  Speaker 0: there's literally no single best cooling method out there.
• 13:52
  Speaker 0: Right
• 13:52
  Speaker 1: it's the tight rope walk between water use and energy use.
• 13:55
  Speaker 0: Exactly!
• 13:56
  Speaker 0: It's entirely dependent upon local Water Energy Nexus.
• 13:59
  Speaker 0: Like if you want to use less energy to cool your facility You often have evaporate millions of gallons through these massive cooling towers
• 14:07
  Speaker 1: Which local communities hate?
• 14:09
  Speaker 0: But if you want to save water by using closed-loop mechanical air cooling, your energy consumption spikes dramatically.
• 14:16
  Speaker 1: Especially in really hot climates?
• 14:18
  Speaker 0: Yes because you have run these massive compressors!
• 14:21
  Speaker 1: There are some breakthroughs bypassing this entirely
• 14:23
  Speaker 1: right?!
• 14:23
  Speaker 1: And
• 14:24
  Speaker 0: they'll actually share the wild success story from a company called Viridian.
• 14:28
  Speaker 1: Oh The Immersion Cooling one
• 14:29
  Speaker 0: Exactly.
• 14:30
  Speaker 0: They took this legacy air cooled data hall and entirely retrofitted it with immersion cooling.
• 14:36
  Speaker 0: literally dunk the servers into these specialized non-conductive liquid tanks.
• 14:40
  Speaker 1: Which sounds crazy, but let's explain why that actually works because liquid conducts heat significantly better than air does
• 14:47
  Speaker 0: way better.
• 14:47
  Speaker 1: so when you submerge The hardware You completely eliminate the need for those tiny high rpm mechanical fans inside the servers themselves.
• 14:54
  Speaker 0: and Those fans alone can consume what?
• 14:57
  Speaker 0: Ten to fifteen percent of the racks total power
• 14:59
  Speaker 1: exactly.
• 15:01
  Speaker 1: Plus you eliminate them massive air handlers that are just pushing cold air across the room.
• 15:06
  Speaker 0: And, the transformation for Viridian was staggering!
• 15:09
  Speaker 0: They went from over forty-six hundred legacy servers down to just three hundred and fifty seven liquid cooled ones.
• 15:15
  Speaker 0: Wow
• 15:16
  Speaker 1: that's a huge footprint reduction.
• 15:18
  Speaker 0: It is.
• 15:19
  Speaker 0: they swapped traditional CPUs for GPUs and managed get four times of total compute power.
• 15:25
  Speaker 1: Four Times The Compute.
• 15:27
  Speaker 1: Yes
• 15:27
  Speaker 0: but...the kicker Is the energy draw..they actually cut their total power used eight hundred and forty-eight kilowatts down to six hundred and fourty five kilowattes.
• 15:37
  Speaker 1: So wait, more than quadruple the compute in exact same footprint?
• 15:42
  Speaker 1: And they used less energy overall?
• 15:44
  Speaker 1: Yes
• 15:45
  Speaker 0: that is exactly what happens when you rethink infrastructure from physics up rather then bolting bigger air conditioners onto legacy designs.
• 15:53
  Speaker 1: That's incredible!
• 15:55
  Speaker 1: It isn't just cooling physics changing right now The entire geographical strategy of industry shifting.
• 16:01
  Speaker 0: How so
• 16:01
  Speaker 1: Well, Meg's and Cheng highlighted this fascinating pivot happening with Chinese renewable energy giants.
• 16:07
  Speaker 0: Oh!
• 16:07
  Speaker 0: With the solar farms?
• 16:08
  Speaker 1: Yeah they are currently dealing with this massive solar-and-wind overcapacity in really remote regions.
• 16:14
  Speaker 1: so their generating all of these green power but face severe grid curtailment
• 16:18
  Speaker 0: Meaning transmission lines were just too congested to actually transport that electricity back into big cities.
• 16:24
  Speaker 0: right.
• 16:25
  Speaker 1: Exactly So the power is essentially stranded.
• 16:27
  Speaker 1: it was wasted.
• 16:29
  Speaker 0: What s there solution?
• 16:30
  Speaker 0: do build more lines?
• 16:31
  Speaker 1: No, instead of waiting a decade to build new high voltage transmission lines.
• 16:36
  Speaker 1: They are literally building AI data centers directly next to the massive desert solar and wind farms.
• 16:41
  Speaker 0: Wow!
• 16:42
  Speaker 1: Yeah it's a strategy that is known as East Data West Compute.
• 16:45
  Speaker 0: It basically the modern digital equivalent of Building The Steel Mill right Next To Iron Mine
• 16:50
  Speaker 1: Exactly its such brilliant business mechanism.
• 16:53
  Speaker 1: they completely bypassed grid bottlenecks.
• 16:55
  Speaker 1: Right
• 16:55
  Speaker 0: because they don't need to transport power anymore
• 16:58
  Speaker 1: exactly.
• 16:58
  Speaker 1: They're pivoting from being pure power generators to becoming these fully integrated compute and energy providers because selling green electricity in the form of cloud compute yields vastly higher margins than trying to sell really cheap, stranded electricity back to a congested grid.
• 17:13
  Speaker 0: That makes total sense!
• 17:15
  Speaker 0: At this level of integration isn't just about power grids either – it's also extending into local ecology….
• 17:21
  Speaker 1: Oh like bio-mimicry stuff?
• 17:23
  Speaker 0: Yeah Joris Shonis and Ard Bleeker shared updates on Microsoft's biomimicry pilot in Middenmere over the Netherlands.
• 17:30
  Speaker 1: Right, where they're designing data center campuses to actually function in harmony with native habitats Which
• 17:36
  Speaker 0: sounds like PR but it is real!
• 17:39
  Speaker 0: It means stepping away from that traditional model of just paving a massive plot of land into this sterile concrete fortress.
• 17:47
  Speaker 1: So what does it look like?
• 17:49
  Speaker 0: They are planting native trees, they're creating pollinator corridors and their actively restoring wetlands right around the facility.
• 17:56
  Speaker 1: That's amazing!
• 17:58
  Speaker 1: But it isn't just for aesthetics...right?
• 17:59
  Speaker 0: Not at all.
• 18:00
  Speaker 0: Restoring those wetlands provides natural groundwater retention which actually actively lowers the ambient microclimate temperature around the entire facility.
• 18:10
  Speaker 1: Oh wow so cooler ambient air means less mechanical cooling is required for servers inside.
• 18:15
  Speaker 0: Exactly its this incredible feedback loop.
• 18:18
  Speaker 0: It's been so successful from a pure operational standpoint that Microsoft is now expanding this biomimicry approach to over twenty sites across the US and Germany.
• 18:28
  Speaker 1: It really represents this profound shift in engineering mindset.
• 18:32
  Speaker 1: Infrastructure is finally blending with ecology!
• 18:35
  Speaker 0: Yes, but let us be realistic here – not every operator is taking this pro-active beautifully integrated approach….
• 18:43
  Speaker 1: Oh definitely
• 18:44
  Speaker 0: And with gigawatts of power and massive water resources at stake, regulators in corporate buyers are completely losing patience.
• 18:52
  Speaker 1: Yeah we're working on it is just no longer an acceptable answer for these regulators.
• 18:57
  Speaker 0: No transparency is shifting from this nice to have corporate PR talking point To a really strict operational requirement
• 19:05
  Speaker 1: And the policy landscape is hardening much, much faster than the tech sector anticipated.
• 19:10
  Speaker 1: Like Matthias Heimoth pointed out that Scotland has effectively drawn a line in the sand regarding data center development.
• 19:16
  Speaker 0: What did they do?
• 19:17
  Speaker 1: Their parliament officially mandated full environmental impact assessments for any data center over fifty megawatts and That has to be done before planning permission can even be considered.
• 19:28
  Speaker 0: Wow I mean a fifty-megawatt facility.
• 19:30
  Speaker 0: it's pretty substantial.
• 19:32
  Speaker 0: Why are they putting up so much friction upfront?
• 19:34
  Speaker 1: Because a facility that size places a massive, sudden strain on the local grid queue and the local water rights.
• 19:41
  Speaker 1: Regulators need to see the forecasted impact up front... ...to ensure grid stability for actual residents.
• 19:47
  Speaker 1: Proof of sustainability is now literally the strict price of admission to build!
• 19:52
  Speaker 0: And thats happening across Europe too right?
• 19:54
  Speaker 0: Christoph Kluzzo and Michael Kaye noted that EU Commission has officially adopted A-G ratings for data centers energy & water use.
• 20:03
  Speaker 1: Oh right, just like the energy efficiency labels you see on household appliances.
• 20:07
  Speaker 1: Exactly
• 20:07
  Speaker 0: Like that!
• 20:08
  Speaker 0: And very first public labels are expected by twenty-twenty seven.
• 20:12
  Speaker 1: Think about operational risk for a facility operator though You will not be able to hide an inefficient water guzzling facility anymore
• 20:20
  Speaker 0: Because data is totally public.
• 20:22
  Speaker 1: Right
• 20:23
  Speaker 0: But I do have ask Will G rated datacenter actually lose customers?
• 20:28
  Speaker 0: I mean, with AI compute demand being as high it is right now.
• 20:32
  Speaker 0: Will buyers even care or will they just take whatever service space?
• 20:35
  Speaker 0: They can possibly get?
• 20:37
  Speaker 1: no they will definitely care mostly because of scope.
• 20:40
  Speaker 1: three emissions compliance
• 20:41
  Speaker 0: ah Right
• 20:42
  Speaker 1: and that actually makes this a next example from Mark Butcher highly relevant.
• 20:46
  Speaker 1: he reviewed AWS's recent submission to the Australian Senate regarding their data centers down there.
• 20:51
  Speaker 0: okay what was in?
• 20:53
  Speaker 1: Well, AWS has been very vocal about investing over twenty billion dollars into Australian facilities right?
• 20:58
  Speaker 0: Yeah that was a huge announcement.
• 21:00
  Speaker 1: But in their thirty-four page submission to the Senate they completely omitted there absolute energy and water use.
• 21:07
  Speaker 0: Wait...they left out raw consumption numbers entirely?
• 21:10
  Speaker 1: Entirely They provided regional averages for PUE & WUE which is Water Usage Effectiveness.
• 21:17
  Speaker 0: Right The efficiency ratios.
• 21:19
  Speaker 1: But an efficiency ratio only tells a regulator how efficiently a resource is utilized inside the building.
• 21:26
  Speaker 1: It tells them absolutely nothing about total volume being drained from local grid or water shed,
• 21:31
  Speaker 0: which raises a huge red flag.
• 21:33
  Speaker 0: I mean are tech giants weaponizing ratios like PUE to hide their massive absolute consumption of regulators and communities?
• 21:42
  Speaker 1: it definitely looks that way for people Because when regulators are trying to manage grid capacity or, you know secure drinking water during a drought.
• 21:49
  Speaker 1: A ratio is practically useless.
• 21:52
  Speaker 0: They need the peak megawatt demand
• 21:54
  Speaker 1: Exactly and millions of gallons of water required.
• 21:57
  Speaker 1: The lack absolute disclosure creating really severe friction
• 22:02
  Speaker 0: And this lack transparency hitting software buyers just as hard too.
• 22:06
  Speaker 0: Richard Tarboton shared that right now AI products are bought, sold and deployed with almost zero environmental data attached to the specific product layer.
• 22:15
  Speaker 1: Which is crazy!
• 22:16
  Speaker 1: Imagine being a corporate procurement officer today.
• 22:19
  Speaker 1: you're choosing between two enterprise AI products that perform the exact same business function but one amidst say twenty grams of CO₂ per million tokens, and the poorly optimized one emits a thousand grams.
• 22:31
  Speaker 1: That's
• 22:31
  Speaker 0: massive difference!
• 22:33
  Speaker 1: Huge!
• 22:34
  Speaker 1: And if you're a buyer trying to meet strict corporate climate targets that difference alters your entire procurement decision.
• 22:40
  Speaker 0: But because suppliers do not actually provide this information buyers are flying completely blind Right... ...and that is exactly why major corporate buyers now demanding product level carbon disclosure.
• 22:51
  Speaker 0: They want the specific traceable footprint of the AI product before they sign.
• 23:18
  Speaker 0: So it's transitioning from the marketing department directly into operations?
• 23:22
  Speaker 1: Yes.
• 23:23
  Speaker 1: It is being embedded directly in to core operating model.
• 23:26
  Speaker 1: Executives are relying heavily on technology to close gap between their climate ambitions and reality
• 23:32
  Speaker 0: But a CIO cannot operationalize what they can not actually trace Exactly,
• 23:37
  Speaker 1: if AI tools that procure remain black box of emissions They just cant balance carbon ledgers.
• 23:44
  Speaker 0: We have covered incredible ground today.
• 23:47
  Speaker 0: I mean, we started at the micro level of software metrics and token billing.
• 23:51
  Speaker 0: We moved through the physical realities of emerging cooling in grid stranding And ended up with macroeconomic regulatory shifts.
• 23:58
  Speaker 1: It really proves how deeply interconnected this entire ecosystem is.
• 24:02
  Speaker 0: it Really does.
• 24:03
  Speaker 0: every single prompt you type sets off this physical chain reaction with thermal electrical and ecological consequences.
• 24:11
  Speaker 1: The boundary between the digital and the physical just basically no longer exists.
• 24:16
  Speaker 0: he really doesn't.
• 24:17
  Speaker 0: But I want to leave you with one final provocative thought to mull over, which was brought forward by MD Satakwad Hussein.
• 24:25
  Speaker 1: Oh this is such a good post!
• 24:27
  Speaker 0: Right?
• 24:27
  Speaker 0: We spent so much time analyzing how cool these gigawatt data centers and construct massive nuclear powered AI facilities.
• 24:36
  Speaker 0: but consider the biology.
• 24:37
  Speaker 0: we already have
• 24:39
  Speaker 1: Our own brains.
• 24:40
  Speaker 0: Exactly The human brain contains roughly eighty six billion neurons.
• 24:44
  Speaker 0: It remains the absolute most capable general intelligence we know of, adapting to complex unstructured environments instantly.
• 24:52
  Speaker 1: And it operates on about twelve watts of power.
• 24:54
  Speaker 0: Twelve Watts?
• 24:55
  Speaker 0: That is energy required for a single small LED light bulb.
• 25:00
  Speaker 1: A lightbulb!
• 25:01
  Speaker 0: Meanwhile... ...a single modern AI training system consumes one hundred megawatts which has enough to power an entire town.
• 25:09
  Speaker 0: Perhaps the ultimate future of AI isn't about building exponentially larger power-hungry models.
• 25:15
  Speaker 0: Maybe the true frontier of AI lies in discovering how biological intelligence achieves so much with so incredibly little?
• 25:23
  Speaker 1: That is something to think about!
• 25:25
  Speaker 0: Definitely, if you enjoy this episode new episodes drop every two weeks.
• 25:29
  Speaker 0: also check out our other editions on cloud insights and sovereignty digital products and services AI energetic systems health tech ICT and Tech Insights defense tech, and health tech.