Latest / Best of LinkedIn: Digital Transformation & Tech / Best of LinkedIn: Sustainability & Green ICT CW 40/ 41

Transcript

Best of LinkedIn: Sustainability & Green ICT CW 40/ 41 · Best of LinkedIn: Digital Transformation & Tech

• 0:00
  Speaker 0: This episode is provided by Thomas Allgeier and Freeness, based on the most relevant LinkedIn posts about sustainability and green ICT in CW-Forty and Forty-One.
• 0:09
  Speaker 0: Freeness supports ICT enterprises with market and competitive intelligence, decoding green software developments, benchmarking emerging standards, tracking regulatory shifts, and analyzing competitor strategies.
• 0:22
  Speaker 0: Welcome back to the deep dive.
• 0:24
  Speaker 0: Our mission for you today, well... It's pretty clear.
• 0:27
  Speaker 0: We're distilling the absolute top operational shifts and trends in sustainability and green ICT stuff that really dominated LinkedIn over the last couple of weeks.
• 0:37
  Speaker 0: This deep dive is all about getting you past the buzzwords straight into the actionable insights, you know, drawn directly from our sources.
• 0:43
  Speaker 1: And what's really striking, I think, is seeing how fast the conversation has shifted.
• 0:48
  Speaker 1: It's not just should we do this anymore.
• 0:49
  Speaker 1: Right.
• 0:50
  Speaker 1: It's, okay, how do we get... measurable cost effective efficiency.
• 0:54
  Speaker 1: The sources show this like laser focus on optimization that actually hits the bottom line.
• 0:58
  Speaker 1: It covers everything from, you know, how we write AI prompts all the way up to global data center strategies.
• 1:03
  Speaker 0: That's a great point.
• 1:04
  Speaker 0: And to make it all digestible, we've kind of broken down this flood of information into four main themes, interconnected ones.
• 1:11
  Speaker 0: We'll kick off with the human and code layer thing.
• 1:14
  Speaker 0: AI efficiency and governance.
• 1:16
  Speaker 0: Then we'll dive into the physical stuff data center infrastructure.
• 1:19
  Speaker 0: The hardware.
• 1:20
  Speaker 0: Exactly.
• 1:21
  Speaker 0: Third, we'll look at some really practical green software levers, the granular stuff.
• 1:26
  Speaker 0: And finally, we zoom out for the strategic big picture, alignment and sovereignty.
• 1:32
  Speaker 1: Makes sense.
• 1:33
  Speaker 1: So let's start with AI then.
• 1:34
  Speaker 1: It's probably the hottest topic.
• 1:37
  Speaker 1: everywhere right now.
• 1:38
  Speaker 1: There's this really rising urgency to get a handle on the massive energy footprint of these advanced models.
• 1:44
  Speaker 1: It's
• 1:44
  Speaker 0: a huge footprint.
• 1:45
  Speaker 1: Yeah, and you see the hyperscalers now actively positioning greener AI data centers, not just as like a compliance thing, but as key levers for their own decarbonization efforts.
• 1:54
  Speaker 1: Right.
• 1:55
  Speaker 1: The challenge is pretty straightforward, really.
• 1:57
  Speaker 1: How do we stop this exponential AI innovation from automatically jacking up our collective carbon footprint?
• 2:02
  Speaker 0: Okay, so let's unpack that at the most fundamental level, like the code itself.
• 2:07
  Speaker 0: Wilco Bergraf flagged a really interesting study on something called green prompt engineering.
• 2:13
  Speaker 0: Ah, yes.
• 2:14
  Speaker 0: It showed that the way you actually design your prompt, specifically how readable it is, how long it is, that directly impacts energy use and the quality of the output.
• 2:25
  Speaker 1: It's kind of counterintuitive, isn't it?
• 2:26
  Speaker 1: Usually we obsess over the model's complexity, not the text we feed it.
• 2:29
  Speaker 0: Yeah, exactly.
• 2:31
  Speaker 1: If you think about the actual computation needed to process a really dense, badly written prompt versus something concise and clean, well, the difference in energy use starts to make sense.
• 2:41
  Speaker 1: Totally.
• 2:42
  Speaker 1: The study basically concluded that, yeah, choosing an efficient model is number one, but optimizing the prompts.
• 2:48
  Speaker 1: That's the next crucial step.
• 2:50
  Speaker 0: Right.
• 2:50
  Speaker 0: The takeaway seems to be tune for readability.
• 2:54
  Speaker 0: Actively avoid that sort of.
• 2:56
  Speaker 0: ornamental complexity.
• 2:57
  Speaker 0: If you overcomplicate the prompt with jargon or just too many words, the energy use goes up, but you don't get a better answer.
• 3:03
  Speaker 0: You're literally burning watts for nothing useful.
• 3:06
  Speaker 1: Burning watts for complexity.
• 3:07
  Speaker 1: that doesn't pay back.
• 3:09
  Speaker 1: And that leads nicely into the financial side.
• 3:12
  Speaker 1: Shankarama Swami warns, quite rightly, that unchecked AI innovation will increase the global carbon footprint.
• 3:18
  Speaker 0: No doubt.
• 3:19
  Speaker 1: but the market is responding.
• 3:21
  Speaker 1: We saw this great example.
• 3:23
  Speaker 1: A cloud provider managed to cut their emissions by twenty one percent and save two point four million dollars annually.
• 3:31
  Speaker 1: And that was just by focusing on model efficiency and using energy-aware training schedules.
• 3:36
  Speaker 1: That's the kind of ROI that really grabs attention.
• 3:39
  Speaker 1: Yeah,
• 3:39
  Speaker 0: absolutely.
• 3:40
  Speaker 0: That's real money.
• 3:41
  Speaker 0: And here's where things get even more connected.
• 3:43
  Speaker 0: The ethical and environmental sides, they have to merge.
• 3:46
  Speaker 0: Dr.
• 3:47
  Speaker 0: Sasha Luchione and Giada Pastilli really stressed this point.
• 3:50
  Speaker 1: Yeah, they did.
• 3:50
  Speaker 0: Ethics and sustainability, they argue, must evolve together for AI to be truly responsible.
• 3:56
  Speaker 0: Yeah.
• 3:56
  Speaker 0: You can't really claim an AI is ethical if it's wrecking the planet in the process.
• 4:01
  Speaker 1: No, exactly.
• 4:01
  Speaker 1: Their argument is we have to move beyond just looking at accuracy metrics.
• 4:05
  Speaker 1: We need to measure the full environmental and social costs.
• 4:08
  Speaker 1: And that's why tools like the AI energy score are becoming so important.
• 4:12
  Speaker 1: It helps developers actually quantify the environmental impact of running their models, makes those hidden costs carbon resources visible and measurable.
• 4:21
  Speaker 1: It forces accountability.
• 4:22
  Speaker 0: And accountability is definitely needed.
• 4:24
  Speaker 0: Montgomery Singman raised a flag about a potential AI bubble brewing.
• 4:29
  Speaker 0: Oh, interesting.
• 4:30
  Speaker 0: Yeah, he notes this kind of disconnect between the really bold high level promises of AI and, well, it's practical, sustainable adoption in actual vertical markets.
• 4:41
  Speaker 1: The reality check.
• 4:42
  Speaker 0: Pretty much.
• 4:43
  Speaker 0: He suggests longevity won't come from hype.
• 4:45
  Speaker 0: It'll come from companies demonstrating real world value and sustainable integration, focusing on applications that actually pass both the environmental and the economic
• 4:54
  Speaker 1: test.
• 4:55
  Speaker 1: Makes sense.
• 4:55
  Speaker 1: Focus on the substance.
• 4:56
  Speaker 0: And speaking of practical applications, we are seeing tools emerge to help with this.
• 5:01
  Speaker 0: Alexis Normand announced Greenleys EcoPilot.
• 5:03
  Speaker 0: Ah,
• 5:04
  Speaker 1: the AI Copilot.
• 5:05
  Speaker 0: That's the one designed specifically to automate carbon accounting and generate actual reduction plans.
• 5:11
  Speaker 0: It tries to take those measurement complexities that can really bog companies down.
• 5:15
  Speaker 1: Yeah, they can be a nightmare.
• 5:16
  Speaker 0: And push them directly towards taking action.
• 5:19
  Speaker 1: Okay, so let's shift gears now.
• 5:21
  Speaker 1: from the let's say invisible complexity of code to the very visible demands of the physical stack.
• 5:28
  Speaker 1: data centers
• 5:29
  Speaker 0: for structure.
• 5:29
  Speaker 0: Right.
• 5:30
  Speaker 0: If AI needs more power, where is it coming from and how do we deliver it efficiently?
• 5:34
  Speaker 0: Exactly.
• 5:34
  Speaker 0: And this is critical because, I mean, the numbers are stark.
• 5:38
  Speaker 0: Global electricity demand from data centers is projected to double by twenty thirty.
• 5:42
  Speaker 1: Double.
• 5:43
  Speaker 1: That's huge.
• 5:44
  Speaker 1: It
• 5:44
  Speaker 0: is.
• 5:45
  Speaker 0: So we need fundamental shifts in power distribution.
• 5:48
  Speaker 0: Morten, we already mentioned the collaboration between ABB and NVIDIA.
• 5:51
  Speaker 0: They're working to accelerate high efficiency power tech, specifically focusing on next-gen, eight hundred volt DC data centers.
• 5:58
  Speaker 0: Okay,
• 5:58
  Speaker 1: wait, eight hundred VDC.
• 6:00
  Speaker 1: Why is that specific voltage such a big deal right
• 6:02
  Speaker 0: now?
• 6:03
  Speaker 0: Good question.
• 6:04
  Speaker 0: So traditionally, data centers run on AC power, right?
• 6:07
  Speaker 0: But that involves multiple conversion steps, AC grid to DC for servers, then often stepped down again.
• 6:13
  Speaker 0: Each conversion loses energy.
• 6:14
  Speaker 1: Okay, inefficiencies.
• 6:16
  Speaker 1: Exactly.
• 6:16
  Speaker 1: Direct current or DC, especially at a higher voltage like eight hundred V, allows for fewer conversions.
• 6:23
  Speaker 1: That dramatically cuts power loss and actually increases system resilience, too.
• 6:28
  Speaker 1: It's a foundational change needed if we're going to handle that doubling demand efficiently.
• 6:32
  Speaker 0: Got it.
• 6:33
  Speaker 0: Fewer steps, less waste.
• 6:34
  Speaker 0: Makes sense.
• 6:35
  Speaker 0: But doubling power also means more heat, right?
• 6:39
  Speaker 0: So intensifying scrutiny on cooling and water use.
• 6:42
  Speaker 1: Absolutely.
• 6:43
  Speaker 1: Sanisa Nicolik from Lenovo.
• 6:45
  Speaker 1: highlighted their Neptune liquid cooling tech.
• 6:48
  Speaker 1: Apparently it can cut the power used just for cooling by up to forty percent.
• 6:52
  Speaker 1: Forty
• 6:52
  Speaker 0: percent.
• 6:53
  Speaker 0: That's significant.
• 6:54
  Speaker 1: And it lets you pack servers more densely too.
• 6:56
  Speaker 1: We're definitely seeing liquid cooling become a key differentiator in new builds.
• 7:00
  Speaker 1: Joe Bell noted net mountains VL one data center in Germany.
• 7:03
  Speaker 0: They're using direct liquid cooling DLC.
• 7:05
  Speaker 1: Yep, DLC, which is a big step because it targets the heat right at the source, the CPUs and GPUs, which is way more efficient than just blasting cold air through the whole room.
• 7:15
  Speaker 0: Right, much more targeted.
• 7:16
  Speaker 0: However, we probably need a bit of caution with all these green labels.
• 7:19
  Speaker 0: Nigel Green made a really valid point.
• 7:21
  Speaker 0: Given how much power they inherently consume, no data center is truly green in an absolute sense.
• 7:27
  Speaker 0: The realistic goal has to be incremental, measurable improvements, smarter cooling, optimized compute, all aimed at cutting operational costs.
• 7:36
  Speaker 1: Yeah, it's about greener, not perfectly green.
• 7:39
  Speaker 1: And that focus on operational costs leads straight to resource management.
• 7:44
  Speaker 1: especially water.
• 7:45
  Speaker 1: Douglas Mootin reported that Microsoft's Mount Pleasant Campus, just as one example, could use up to eight point four million gallons of water a year.
• 7:54
  Speaker 1: Eight million
• 7:54
  Speaker 0: gallons.
• 7:55
  Speaker 0: That puts huge pressure on local resources, particularly if you're building in water stressed areas.
• 8:00
  Speaker 1: Huge pressure, which really underscores the strategic importance of where you build.
• 8:04
  Speaker 1: Lewis Vaughn detailed how it north is specifically leveraging the cooler climates and abundant renewable energy in the Nordics for their expansion.
• 8:12
  Speaker 1: Smart move.
• 8:13
  Speaker 1: Yeah, and it mirrors what Solano is doing with their Hunderbilla W campus in Finland.
• 8:17
  Speaker 1: Location becomes the first layer of sustainability really.
• 8:20
  Speaker 1: It cuts cooling needs and reduces reliance on fossil fuels right off the bat.
• 8:23
  Speaker 0: And that sustainability thinking needs to extend to the hardware life cycle too, right?
• 8:28
  Speaker 1: Absolutely.
• 8:29
  Speaker 1: Maddie Backer and shared some fascinating stuff on Rack Renew.
• 8:32
  Speaker 1: They remanufacture OCP IT racks.
• 8:36
  Speaker 0: OCP, that's the open compute project.
• 8:38
  Speaker 0: Standardized racks.
• 8:39
  Speaker 1: Exactly.
• 8:40
  Speaker 1: Standardized open source designs.
• 8:42
  Speaker 1: Bakren highlighted the sheer volume of these racks being scrapped prematurely.
• 8:46
  Speaker 1: He basically said remanufacturing them is a massive opportunity.
• 8:50
  Speaker 1: It's cost effective and sustainable, really pushing towards that circular economy idea for data center hardware.
• 8:56
  Speaker 0: That's great.
• 8:56
  Speaker 0: to see a concrete example of circularity in action.
• 8:59
  Speaker 1: Okay, so moving up the stack again, let's talk about practical efficiency gains right at the application and developer level.
• 9:05
  Speaker 1: green software.
• 9:06
  Speaker 0: Yeah, the small, powerful levers that developers actually control day to day.
• 9:10
  Speaker 1: Precisely.
• 9:11
  Speaker 1: And sometimes the biggest wins come from, well, seemingly tiny code changes.
• 9:15
  Speaker 1: Yeah.
• 9:15
  Speaker 1: R.W.L.O.N.
• 9:16
  Speaker 1: offered a specific SAP green core tip.
• 9:18
  Speaker 0: Oh, yeah.
• 9:19
  Speaker 0: What was it?
• 9:19
  Speaker 1: It's about SQL select statements, specifically in column-oriented databases like SAP ANA.
• 9:25
  Speaker 1: The tip.
• 9:26
  Speaker 1: Stop using select add.
• 9:27
  Speaker 0: Huh.
• 9:27
  Speaker 0: The wild card.
• 9:28
  Speaker 0: Why is that such a resource hog in ANA?
• 9:30
  Speaker 0: Well,
• 9:30
  Speaker 1: because HA is column-oriented, Using forces the system to do a lot of unnecessary CPU and IO work.
• 9:37
  Speaker 1: It has to read and process every single column header in definition, even if you only actually need data from two columns.
• 9:43
  Speaker 0: Ah, I see.
• 9:44
  Speaker 0: So it reads everything, even if unused.
• 9:46
  Speaker 1: Exactly.
• 9:47
  Speaker 1: By just specifying the exact column names you need, you drastically cut down that churn.
• 9:52
  Speaker 1: Less CPU, lower emissions.
• 9:55
  Speaker 1: It's tangible efficiency baked right into the query.
• 9:58
  Speaker 1: Simple, but effective.
• 10:00
  Speaker 0: I love those kinds of deep in the weeds, practical tips.
• 10:03
  Speaker 0: On a much broader scale though, we are finally seeing standards start to solidify for the web.
• 10:08
  Speaker 0: Tim Frick highlighted the new W-three-C web sustainability guidelines draft.
• 10:12
  Speaker 1: Yeah, that's a big deal.
• 10:13
  Speaker 1: It's got what, ninety-two guidelines?
• 10:14
  Speaker 1: Something
• 10:14
  Speaker 0: like that.
• 10:15
  Speaker 1: Aimed at standardizing low-impact design choices for web products.
• 10:19
  Speaker 1: Covers everything from network requests to image handling.
• 10:22
  Speaker 1: These standards are vital because they give developers a clear roadmap, like a baseline for sustainable design.
• 10:27
  Speaker 0: And standards help drive governance, which brings us to green ops.
• 10:30
  Speaker 0: Kevin Leslie noted its growing importance, putting it right alongside fine ops.
• 10:34
  Speaker 1: Makes sense.
• 10:35
  Speaker 1: Cost and carbon are linked.
• 10:37
  Speaker 1: Exactly.
• 10:38
  Speaker 0: The hidden infrastructure costs of inefficient software are just getting too big to ignore anymore.
• 10:44
  Speaker 1: And enabling that green ops thinking is carbon aware computing, which really cool.
• 10:48
  Speaker 1: here is the rise of practical tools.
• 10:50
  Speaker 1: Aiden Mir Mohamedi discussed the carbon aware SDK.
• 10:53
  Speaker 1: The
• 10:53
  Speaker 0: SDK.
• 10:54
  Speaker 0: What does that let developers do?
• 10:56
  Speaker 1: It lets them basically time shift compute heavy jobs.
• 11:00
  Speaker 0: Time shifting.
• 11:01
  Speaker 0: You mean running them when the grid energy is cleaner?
• 11:04
  Speaker 1: Precisely.
• 11:04
  Speaker 1: The SDK can check the real-time carbon intensity of the local electricity grid.
• 11:10
  Speaker 1: So developers can programmatically delay non-urgent tasks until, say, there's more wind or solar power available.
• 11:17
  Speaker 1: Oh, wow.
• 11:18
  Speaker 1: Yeah, so you could potentially shift a job from running when the grid intensity is say, seven hundred grams of CO two per kilowatt hour down to a time when it's only fifty grams.
• 11:27
  Speaker 0: That's a massive difference just from timing.
• 11:29
  Speaker 1: Huge reduction, purely driven by intelligence scheduling based on real grid data.
• 11:33
  Speaker 0: That is powerful.
• 11:35
  Speaker 0: And ultimately, as Crystal Love and Kaia pointed out, green software isn't just a technical nice to have anymore.
• 11:40
  Speaker 0: It's becoming a key strategic advantage.
• 11:43
  Speaker 0: It compounds efficiency, builds resilience, and it's now standing right alongside speed and security as a core requirement in RFPs and public contracts.
• 11:52
  Speaker 0: If your software isn't green, you might not even get considered.
• 11:55
  Speaker 1: Yeah, the bar is definitely rising.
• 11:58
  Speaker 1: And that strategic relevance, it brings us neatly to our final theme, the bigger picture.
• 12:03
  Speaker 1: geopolitical strategy, technological sovereignty.
• 12:07
  Speaker 1: Sustainability is now being explicitly used as a competitive edge by, well, entire economic blocks.
• 12:14
  Speaker 1: Right.
• 12:14
  Speaker 0: T. Ganbold detailed the EU's strategic vision.
• 12:17
  Speaker 0: They're aiming to build green, cyber-secure AI infrastructure.
• 12:21
  Speaker 0: And this isn't just about, you know, being good global citizen.
• 12:24
  Speaker 0: Oh, it's
• 12:24
  Speaker 1: hard strategy.
• 12:25
  Speaker 0: It absolutely is.
• 12:26
  Speaker 0: It's aimed squarely at achieving technological sovereignty.
• 12:28
  Speaker 0: And
• 12:29
  Speaker 1: how are they planning to pull that off?
• 12:30
  Speaker 1: Yeah.
• 12:30
  Speaker 1: By leveraging what they already have, right, Europe's leadership in renewable energy, Germany, for instance, already hitting a sixty-two percent renewable mix in their grid.
• 12:38
  Speaker 0: Wow, sixty-two percent.
• 12:39
  Speaker 0: Yeah.
• 12:40
  Speaker 1: So the EU is essentially turning sustainability requirements, like demanding low-carbon IT, into a competitive advantage for their own digital industry.
• 12:49
  Speaker 1: They're creating a market for highly efficient tech that others then have to scramble to meet.
• 12:54
  Speaker 1: That's
• 12:54
  Speaker 0: a clever strategic move.
• 12:56
  Speaker 0: using constraints to drive innovation, which brings us, I think, to the core philosophical challenge that Barney Race-Jones laid out.
• 13:03
  Speaker 0: He frames this whole thing as an evolutionary test.
• 13:07
  Speaker 1: An evolutionary test.
• 13:08
  Speaker 1: That sounds serious.
• 13:09
  Speaker 1: It
• 13:09
  Speaker 0: is.
• 13:10
  Speaker 0: He argues that AI's ultimate impact on the planet hinges entirely on one thing.
• 13:15
  Speaker 0: Can we decouple intelligence growth from energy growth?
• 13:18
  Speaker 1: Right.
• 13:19
  Speaker 1: We can't just keep throwing more and more power at these models indefinitely.
• 13:22
  Speaker 1: Exactly.
• 13:22
  Speaker 0: So what's the answer?
• 13:23
  Speaker 0: If AI is going to consume all this energy, it has to, as he put it, earn its keep.
• 13:28
  Speaker 1: Earn its keep.
• 13:29
  Speaker 0: By pointing AI's capabilities at the world's biggest energy hogs, the electrical grid itself, steel production, cement manufacturing, massive logistics operations.
• 13:38
  Speaker 1: Okay, so use AI to optimize the biggest emitters.
• 13:42
  Speaker 0: Precisely.
• 13:43
  Speaker 0: Ensure that the efficiency gains AI delivers in those sectors dramatically outweigh its own energy consumption costs.
• 13:49
  Speaker 0: The goal has to be a net positive environmental impact.
• 13:54
  Speaker 0: AI needs to solve more problems than it creates, environmentally speaking.
• 13:58
  Speaker 1: Okay, so to sort of synthesize the key takeaway here for you, the listener, the shift we're seeing right now.
• 14:05
  Speaker 1: It's fundamentally about systemic change.
• 14:07
  Speaker 1: It's moving way beyond just isolated projects.
• 14:10
  Speaker 1: It's about integrating efficiency from the absolute micro level, like prompt design, those specific SQL queries we talked about, all the way through the infrastructure level, eight hundred VVC power, liquid cooling and right up to governance like phenops and green ops and even global strategy.
• 14:26
  Speaker 1: It's efficiency woven through the entire stack.
• 14:28
  Speaker 0: That really is the crux of it, isn't it?
• 14:30
  Speaker 0: Companies that manage to anchor the sustainable thinking early on, right in the design and planning phase, they don't just increase efficiency and save money today.
• 14:38
  Speaker 0: They also make their systems genuinely fit for the future.
• 14:41
  Speaker 0: They ensure their innovation actually passes that evolutionary test, Barney Rice-Jones mentioned, and stays competitive in the long run.
• 14:47
  Speaker 1: Will put.
• 14:48
  Speaker 0: If you enjoyed this deep dive, new episodes drop every two weeks.
• 14:51
  Speaker 0: Also check out our other editions on cloud, digital products and services, artificial intelligence and ICT and tech insights, health tech, defense tech.
• 14:59
  Speaker 0: Thank you for joining us and remember to subscribe.