Latest / Cables2Clouds / AI Got Export Controlled And Everyone Got Grounded - Monthly News Update
Transcript
- 0:13Tim: Hello and welcome to another episode of the Cables to Clouds monthly news update.
- 0:18Tim: Uh I'm Tim McConnaughy, your host, as usual.
- 0:22Tim: Uh Chris is not with us today because he's busy sleeping or something.
- 0:25Tim: And of course, uh with me now, uh hopefully as always, is uh our other co-host, uh Catherine McNamara.
- 0:33Tim: Say hi, Kat.
- 0:34Tim: Hi, Kat.
- 0:36Tim: Oh, I'm sorry, Catherine.
- 0:38Tim: I should have said Catherine.
- 0:39Tim: Anyway.
- 0:40Tim: All right.
- 0:41Tim: Uh let's get going right on these stories here.
- 0:44Tim: Uh we'll jump right into it.
- 0:46Tim: Obviously, the big one, uh, Cisco Live happened in June.
- 0:50Tim: Uh both Catherine and I were there.
- 0:53Tim: Chris working for Fortnite was not there.
- 0:55Tim: Also, he's in Australia, so but uh it was a good time.
- 0:59Tim: But there were some good news stories that came out, some good product launches and announcements, so we'll go ahead and cover them.
- 1:04Tim: Um, you know, setting aside the obvious, we both work for Cisco.
- 1:08Tim: This is not a marketing pitch or a sales pitch, just report in the news.
- 1:12Tim: So, two big things to come out of Cisco Live.
- 1:14Tim: Uh, one was uh Cisco Cloud, or sorry, it's now called Cloud Control.
- 1:19Tim: Sorry, it's been called internally, they've been calling it Cisco Cloud Control, and then they took off Cisco uh when they launched it because it was obviously a Cisco product.
- 1:28Tim: Um, but we've been calling it uh Cisco Cloud Control for so long internally, it's hard to drop it now.
- 1:33Tim: So Cloud Control, which is a unified uh management platform, right?
- 1:38Tim: So um anybody who's been following the podcast for a long period of time uh knows that I've been railing, even even when I didn't work for Cisco, when I was working for Aviatrix, I was saying a long time ago that if uh if Cisco could just unify the products, just bring together all of the products that they have in the portfolio, uh, they would be, you know, kind of unstoppable as a single vendor because no other vendor has the width, the width and breadth of the uh portfolio.
- 2:07Tim: So I was really excited to see that cloud controls being unveiled.
- 2:11Tim: Uh people have listened, you know, Cisco has listened.
- 2:14Tim: Uh obviously lots of customers have asked for this for a very long time, right?
- 2:17Tim: So this is kind of a manager of managers.
- 2:19Tim: Uh it's bringing together all of the different management platforms into one place and not just the not just the management platforms, but also things like telemetry and and logging and whatnot.
- 2:30Tim: So, you know, really, really excited to uh to see this personally.
- 2:35Tim: Um I'll I'll cover the next one next, but I'm curious.
- 2:38Tim: Do you have any any thoughts or opinions there, Catherine?
- 2:41Katherine McNamara: Uh no, it just uh it looks uh awesome.
- 2:44Katherine McNamara: Uh obviously it's early stages, so I'm curious to see how the rollout will be.
- 2:50Katherine McNamara: Um, but yeah, I mean I've been uh I've been handling like security cloud control, uh, which was basically for the security product side of things for like the last year.
- 3:02Katherine McNamara: And uh that part has been pretty successful.
- 3:05Katherine McNamara: So it's interesting to see like the net operations and and sim and uh and collaboration get rolled into it.
- 3:10Katherine McNamara: And like uh we've been actually internally calling it uh on our side the security side where I work uh security cloud control, and that's what's been rolled out my marketing-wise.
- 3:20Katherine McNamara: So it's interesting to see it now change to you know cloud control in in general.
- 3:26Katherine McNamara: Um and I think it was also called C3 internally too, Cisco Cloud Control, so they were shortening with C3.
- 3:32Katherine McNamara: So that's gonna be hard to unlearn as well.
- 3:35Tim: Yeah, but you know, uh certain, you know, some people really hate the acronyms, so we were told not to use the acronyms.
- 3:41Tim: Everybody uses acronyms anyway, right?
- 3:43Tim: But um, no, I completely agree.
- 3:45Tim: Security Cloud Control was also a really cool product, and I I mean it's just really just become cloud control.
- 3:51Tim: Uh what was cool about security cloud control, I thought, was the idea of unifying security policy over all the different uh security products.
- 3:58Tim: So hopefully they'll continue that and that will just kind of be the the marching orders forward as we move into the other products with uh with cloud control.
- 4:05Tim: So yeah, really, really excited to see that.
- 4:08Tim: Um, so go ahead.
- 4:10Katherine McNamara: I was gonna say, I suspect just like with security cloud control, at first it'll be like here's the uh one place you can go to jump to the different products in inside inside of it.
- 4:20Katherine McNamara: But what will be cool is see how they unify like the management of it.
- 4:24Katherine McNamara: Like, I mean, they say the unified management platform, but like in reality, like I think you still have to click into like different products inside of inside of cloud control and manage it like you know, jumping from inside of cloud control.
- 4:37Katherine McNamara: What I would like to see though eventually, and I I suspect that that's probably on the roadmap, is uh on the network side of things, kind of having like a unified policy engine as well, like what they were doing with security cloud control.
- 4:49Tim: Yeah, no, 100%.
- 4:50Tim: And I I'm sure that's the case.
- 4:52Tim: Um, it's yeah, right now it's more like, hey, here's your one-stop shop to get into all of your different uh management uh planes for the different products.
- 5:02Tim: Uh, but I've seen, you know, they're already working on on kind of taking that feeling about security cloud control and kind of moving it forward with the other products.
- 5:09Tim: So yeah, I'm really excited to see what what comes out of it.
- 5:12Katherine McNamara: Yeah, and I was gonna say, like, I think from the troubleshooting side of things too, like the AI canvas they also talked about uh is supposed to be helping with some of that as well, which will probably be easy to pivot from cloud control, but being able to like actually like grab troubleshooting data from different products just by asking, like, you know, like AI will be really cool too.
- 5:34Tim: Yep, absolutely.
- 5:34Tim: So, yeah, AI Canvas should be able to grab all the go to each product that's integrated with cloud control and pull the relevant uh data for troubleshooting anyway.
- 5:44Tim: Sorry, starting to sound like a sales pitch, but it is something that I've been waiting for for a long time.
- 5:48Tim: So uh I am really excited about it.
- 5:50Tim: Um okay.
- 5:51Tim: And then uh the second announcement, which I'm also very excited with uh about to finally get to talk about, um, you know, when I came back to Cisco back in September of last year, uh I got involved with this project.
- 6:04Tim: I was invited to be part of to just to get involved and help in some way with this project.
- 6:09Tim: Um, they Cisco just announced uh they've renamed it Multi-Cloud Fabric, which is a uh network as a service offering that connects is uh connects branches, data centers, cloud uh environments, multi-cloud, right?
- 6:23Tim: It's called multi-cloud fabric.
- 6:24Tim: So think of it um if you're if you're trying to think about where it kind of fits with the re the other multi-cloud, you know, deployment styles or vendors, it's it's a little closer to like an Alkira than like an Aviatrix or uh or well, yes, prosimo's gone, but uh, but like that.
- 6:42Tim: So it's very much a managed connectivity offering where you can onboard you know sites, you can onboard uh you know data centers, uh pops, whatever, but also connect your cloud workloads to the same fabric and do routing policy and uh eventually security enforcement.
- 7:01Tim: Now, this just got announced.
- 7:02Tim: It's actually, I think they're taking beta signups.
- 7:06Tim: So uh if this is something that isn't, again, this is not a sales pitch, but if that sounds interesting, you want to check it out, you can actually go, you know, talk to your Cisco account team, I guess.
- 7:15Tim: I don't know, I'm not sure, right?
- 7:16Tim: I'm I'm not involved with the sales part of it, but uh if you I know they're taking beta signups and you can check it out um if you're interested.
- 7:23Tim: So let's see, which I sorry, go ahead, Catherine.
- 7:26Katherine McNamara: Uh I was just gonna say, uh yeah, obviously anyone watching this are gonna feel like, oh, we're Cisco employees, so we have to like tone down the excitement.
- 7:34Katherine McNamara: Apologies, but we're we're not really trying to like position it as a sales pitch, which is why I mentioned that like it'll be cool to see where it goes initially, like you know, with security cloud control, like initially it was just click into each product one by one, and then they created the hybrid mesh firewall engine.
- 7:51Katherine McNamara: So, you know, just like uh everything else, like it'll be cool to see where it goes, but like obviously we're not like throwing up powerpoints of marketing powerpoints and going through this.
- 8:01Tim: Yeah, yeah, right, exactly.
- 8:02Tim: So, I mean, obviously, like I said at the beginning, right?
- 8:05Tim: We're we both work for Cisco, it is what it is.
- 8:07Tim: Um, Chris isn't with us, but uh at the same time, Cisco Live did just happen and they had two major announcements, so we thought it was important to cover those things on the news just as part of our normal news coverage.
- 8:19Tim: Um, okay, so I I won't say too much more about uh the multi-cloud fabric.
- 8:24Tim: I am really excited about it.
- 8:25Tim: I there's probably a lot more I could say, but again, um, you know, I'm not here to uh set a sales pitch.
- 8:30Tim: It's just I'm excited because I finally get to talk about it.
- 8:32Tim: But um anyway, let's go ahead and move on to the second story, which I think is really hilarious and it probably is.
- 8:40Katherine McNamara: Big ways to the third story.
- 8:42Katherine McNamara: Okay, so I'll I'll cover this one.
- 8:44Katherine McNamara: Um so uh last week, I think it was what Monday, uh, you know, uh Claude uh Anthropic's Claude Fable 5 came out with Mythos 5.
- 8:56Katherine McNamara: It was a heavily neutered version of Mythos, by the way.
- 8:59Katherine McNamara: I just want to say that.
- 9:00Katherine McNamara: Heavily neutered, like they they they put some clue like anti-security um uh blocks on there.
- 9:09Katherine McNamara: Like, so if you said something like, uh create this app for me, okay, cool, builds the app.
- 9:14Katherine McNamara: Uh now check the code for you know that to make sure it's secure, it would block you and and downgrade down to four, uh I think it was Opus uh 4.8.
- 9:24Katherine McNamara: 4-8, yeah.
- 9:25Katherine McNamara: Um and it would just be like, nope, we're gonna go anything security related, even checking the code that it was producing.
- 9:33Katherine McNamara: Like if you explicitly tell it, like, hey, do this, uh, make sure what you just created was secure, it would just downgrade you.
- 9:40Katherine McNamara: And I had a lot of security practitioner friends who are playing around with it, uh security researchers, and they were really, really annoyed by how neutered it was.
- 9:49Katherine McNamara: It's like, we're not even asking you to check for vulnerabilities of X, you know, some third-party code or anything like that.
- 9:55Katherine McNamara: I'm just asking you to check to see if what you made is secure, and uh it would just downgrade it.
- 10:00Katherine McNamara: People got really frustrated.
- 10:02Katherine McNamara: But on the other side of things, like non-security folks I talked to said that the workflows were a lot more focused, clear, things like that, than though it did burn tokens at like a two-time, yeah, like a double rate.
- 10:14Katherine McNamara: But they said that they really liked it.
- 10:16Katherine McNamara: Um, it was out last week, uh, people were playing around with it, security researchers and security folks were not very happy, regular folks who are like developers, network people, uh, you know, other folks uh were very happy with it.
- 10:30Katherine McNamara: Um, you know, as folks uh have heard from us and others, there's a lot of hype that was created around mythos.
- 10:37Katherine McNamara: Oh, it's too dangerous to release in its unneutered form.
- 10:40Katherine McNamara: It's it's going to you know rock cybersecurity, it's finds bugs in everything.
- 10:46Katherine McNamara: Um and so, you know, previous story we had covered was you know, Project Glasswing was formed, which was a uh which was a um special collaboration between some large companies like Cisco, Microsoft, Cloudflare, like really big companies to uh use un you know uh unchained mythos to look for bugs and things in their code.
- 11:08Katherine McNamara: So for like the last month or so, um all these companies have been eating tokens and and and paying to use mythos uh you know for security reasons.
- 11:20Katherine McNamara: And so uh, but it was so hyped up, like, you know, uh the folks at Anthropic were back in the White House after being kicked out for you know refusing to unchain their AI for the Department of War.
- 11:33Katherine McNamara: And uh, you know, there was just a lot of hype built about like how this thing was about finding bugs in uh you know, mythos was finding bugs in like, you know, 20-year-old bugs in like FreeBSD and other places, and it was just so good at finding vulnerabilities.
- 11:47Katherine McNamara: So uh, you know, all that hype for the last month or or two, and you know, and uh, you know, mythos or anthropic getting invited back in the White House after getting kicked out of it, uh uh and all that segues to our third story.
- 12:02Katherine McNamara: Um, so as I said, it was a heavily neutered version of uh of Mythos that came out that you just couldn't use it for security purposes.
- 12:11Katherine McNamara: Uh the only people who were allowed to use it for mythos for security purposes were these companies that were part of Glasswing.
- 12:17Katherine McNamara: Well, that all changed.
- 12:18Katherine McNamara: Uh Mythos was out for approximately, what, three or four days?
- 12:22Katherine McNamara: And the government decided, nope, we are going to go ahead and put an export control directive uh against Anthropic to disable access for mythos for any country that's not the US or any national within or outside of the US uh from using it.
- 12:40Katherine McNamara: Now, inside the US creates other problems, obviously.
- 12:43Katherine McNamara: Um, Anthropic has a lot of non-US citizens working for it.
- 12:48Katherine McNamara: So now even the people who may have contributed to the creation of mythos can't even touch our own product.
- 12:54Katherine McNamara: A lot of the companies in Glasswing uh that are allowed to use it are um for, you know, might have H1Bs or for nationals or people dual citizenship.
- 13:04Katherine McNamara: Now they can't use it.
- 13:05Katherine McNamara: So all the so basically Anthropic had to pull access not only to like the Glasswing partners, but also anyone who is using uh Fable 5 or Mythos 5, the neutered public version.
- 13:17Katherine McNamara: And that's because uh my understanding is that Amazon basically uh or AWS basically created a report about uh jailbreaking techniques and other things.
- 13:27Katherine McNamara: And because of the hype that was created around uh Mythos, like this is where Anthropic may have shot themselves in the foot a little bit, uh, they created so much hype about how dangerous it was.
- 13:38Katherine McNamara: US government smacked that down and and just basically said, nope, no foreign nationals at all in and outside the country.
- 13:45Katherine McNamara: So uh now it had to get revoked from ever use from everyone in the meantime, even within Anthropic, most people can't use it now.
- 13:54Katherine McNamara: And uh so Anthropics are pretty pissed about it.
- 13:58Katherine McNamara: Like they're they'll say that you know, jailbreaking, the same vulnerability exists in other models and other competitors, but you know, they created their own hype and they made it sound so dangerous that it it uh it certainly is uh yeah, I I I question some of the government's motives in this case.
- 14:15Katherine McNamara: Is it is it just their own, you know, them anthropic's own hype biting them in the butt?
- 14:20Katherine McNamara: Is it revenge for you know yeah, retali retaliation for anthropic saying no to the Department of War?
- 14:27Katherine McNamara: I don't know.
- 14:28Katherine McNamara: But uh one of the things it does remind me of is back like 20, 25 years ago, we used to have export controls on really uh on strong encryption.
- 14:38Katherine McNamara: So three folks that may not remember, like uh the only encryption we could export or use with inside and outside the United States used to be three DES, which was really easily broken.
- 14:50Katherine McNamara: The NSA could do that in like seconds.
- 14:52Katherine McNamara: They they basically said the government, the US government basically said years ago, this is too dangerous for uh you know, he strong encryption is too dangerous.
- 15:02Katherine McNamara: We could steal secrets, people could do bad things with it.
- 15:05Katherine McNamara: So they actually had an export control against it.
- 15:08Katherine McNamara: And um it wasn't until like there was a I think the EFF was involved years ago, decades ago, and several other uh groups that finally had to like, you know, finally got the government to reverse, uh reverse that.
- 15:22Katherine McNamara: But you know, now we're back at, you know, it feels a little reminiscent of that.
- 15:26Katherine McNamara: Now we're back at where the government is creating export controls on technology because it might be dangerous.
- 15:32Katherine McNamara: But meanwhile, China and other countries are gonna develop these similar models, and as long as they don't hype them up too much, what what's you know, what is the US government gonna do about it?
- 15:43Katherine McNamara: We're pretty much stifling competition based on on more hype than anything else, I feel like.
- 15:50Tim: Vibes.
- 15:51Tim: Uh yeah.
- 15:52Katherine McNamara: Or retaliation.
- 15:53Katherine McNamara: We we're not 100% sure.
- 15:55Katherine McNamara: Obviously, we're not in the minds of the government, but you know, it it does feel a little bit like it could be retaliatory.
- 16:01Katherine McNamara: Not hunt like obviously I'm not a politician.
- 16:04Katherine McNamara: I don't I'm not in their heads, but uh it also could be just uh really bad, um uh bad uh uh you know reaction, you know, reaction without anyone really technical you know helping make that decision.
- 16:21Katherine McNamara: I'm not a hundred percent sure, but uh obviously Anthropic's not happy.
- 16:26Katherine McNamara: They just filed for IPO, I think, last week as well, as they released this.
- 16:29Katherine McNamara: And now, you know, their next models basically had to be pull back.
- 16:35Katherine McNamara: It's not you know, not a great uh great uh intro to their IPO.
- 16:40Katherine McNamara: And I also I was gonna mention we didn't put this as a news story, but also OpenAI also um uh filed to have an IPO as well.
- 16:50Katherine McNamara: So like I think that both happened last week.
- 16:52Tim: Yeah, yeah.
- 16:53Tim: So I mean there's a lot to unpack here, right?
- 16:56Tim: First of all, the the recent SD WAN vulnerabilities that were released um were all from Project Glasswing, right?
- 17:02Tim: They were like all that there's a ton of them that came out within the last, I think the last month.
- 17:06Tim: Not a ton, there was like three, three or four, but they were pretty decently, you know, impactful.
- 17:11Tim: They were patched really quickly because they were found via Glasswing, and therefore we, you know, Cisco had time to patch them.
- 17:18Tim: But just to point out that like, you know, maybe the unredacted version of Mythos is really is um stronger, certainly, than you know, I don't know if it's I don't know if it meets the hype, but certainly there were vulnerabilities that all the major vendors that were involved with Glasswing were able to find in their products and patch as a result of having access to it.
- 17:39Tim: So there at least is some amount of of truth to that.
- 17:43Tim: Now the question I would have here is if if we had taken, you know, Opus 4.8 or or the equivalent model and and pointed it at um the same code base and said find vulnerabilities, I would have loved to have seen the delta between those.
- 17:56Tim: Just so you really get a a sense of what the difference is, you know, how really if it really because I agree with you.
- 18:03Tim: I think I think they definitely shot themselves in the foot, and there was some there's definitely marketing hype and and you know, the timing of the IPO and all of this, right?
- 18:11Tim: It's it's it doesn't take a it doesn't take a conspiracy theorist to to to be up on the wall with the push pins and the the the the threads and the pictures and all that to to figure some of the stuff out, right?
- 18:22Tim: Um but you know you you do wonder was the was the mythos or of you know w the unredacted version of f of the fable model so incredibly dangerous that we couldn't have it, you know what I mean?
- 18:37Katherine McNamara: So So I'm gonna eat my words a little bit from last time we did news.
- 18:41Katherine McNamara: Um so I've actually talked to some folks who have had the chance to play around with the uh the unneutered, uh uh unchained version of Mythos.
- 18:51Katherine McNamara: They said it did actually a pretty good job.
- 18:53Katherine McNamara: Um they actually found a lot of vulnerabilities with it.
- 18:56Katherine McNamara: Um and these are folks in multiple companies that I just water cooler conversation I've had online with them and stuff.
- 19:02Katherine McNamara: Um and they these are security researchers I actually trust.
- 19:06Katherine McNamara: And they did say it actually did a really good job.
- 19:08Katherine McNamara: Um so I'm kind of reversing what I said before.
- 19:12Katherine McNamara: I think the last news story I was like saying, oh, you know, I'm not I I I don't think it's quite at the hype level that they that Anthropic obviously was putting out, but it was better that from what folks I trust are telling me, it was better than what I actually originally clocked it as.
- 19:31Katherine McNamara: It's not quite a nothing burger.
- 19:33Katherine McNamara: It actually does a really good job at finding some vulnerabilities.
- 19:36Katherine McNamara: So um, you know, that being said, uh, does will it replace um, you know, like bug bounty programs and threat security researchers altogether?
- 19:48Katherine McNamara: No, um, not at all.
- 19:49Katherine McNamara: Far from it.
- 19:50Katherine McNamara: Um, but I I it does definitely find a lot of good stuff.
- 19:56Katherine McNamara: And, you know, I I think though that there's a real uh and this might actually be kind of an unofficial news story as well, but like let me give an example.
- 20:06Katherine McNamara: A lot of the security bug bounty programs, especially from big companies, we've seen, you know, in the past and even recently can be very stingy when it comes to paying for bugs.
- 20:16Katherine McNamara: Um, there was this real big controversy that happened over the last couple weeks with um uh Microsoft.
- 20:23Katherine McNamara: Um, somebody uh a security researcher found another really bad bug uh in like Zero Day, and uh uh and they tried to report it to Microsoft.
- 20:32Katherine McNamara: And this is like the umpteenth millionth time this person had tried to uh I believe the researcher's name is like Nightmare Eclipse.
- 20:39Katherine McNamara: Um and this is like the umpteenth millionth time they've tried to like report bugs to Microsoft.
- 20:44Katherine McNamara: It they get really bad.
- 20:45Katherine McNamara: They Microsoft had a tendency to take reported bugs and say it's not a vulnerability, whatever, and then silently patch it.
- 20:52Katherine McNamara: And security researchers were got really upset.
- 20:55Katherine McNamara: So this this uh I think uh this person um ended up publishing it and just saying, you know, screw you, Microsoft.
- 21:02Katherine McNamara: And Microsoft canceled their GitHub, their GitL, and tried to like get their blog taken down.
- 21:07Katherine McNamara: All sorts of nonsense uh in ensued.
- 21:10Katherine McNamara: And it got really it became a public news story that uh essentially uh Microsoft is really bad about patching or about uh paying bug bounty and then yeah.
- 21:20Katherine McNamara: Yeah.
- 21:21Katherine McNamara: So the reason why I mentioned this is um the average from what I was reading in industry like news is that the average bug bounty cost for running Mythos to find a bug um is $36,000 per bug.
- 21:36Katherine McNamara: So $36,000 for every every single bug.
- 21:39Katherine McNamara: Um and that doesn't matter if it's a big bug, like a like severity, you know, like you know, CV is like a 10 versus a one.
- 21:46Katherine McNamara: Um so you we see a lot of these programs are really stingy.
- 21:51Katherine McNamara: They pay like 500th, a couple thousand at most, like to s for some of these like you know, security researchers who who submit their bug bounties and And and um they're not getting rich off of this.
- 22:03Katherine McNamara: Like they could go and sell these these vulnerabilities on the black market or gray market and make a lot more money, but they're trying to do the ethical thing.
- 22:11Katherine McNamara: And um so do I even if mythos was all that it was hyped up to be, um, and it's not it it's better than what I originally forecasted, but it's not like as bad as what Anthropic said.
- 22:25Katherine McNamara: Uh do I feel like companies are gonna spend 36k for a bug big or small?
- 22:31Katherine McNamara: I'm not 100% sure.
- 22:33Tim: Yeah, just for any bug.
- 22:34Tim: You don't even know what you're gonna get, right?
- 22:36Katherine McNamara: Yeah, and I had this interesting debate in uh Discord uh just recently with someone.
- 22:41Katherine McNamara: I I don't know if you were in that conversation or not, but um, you know, somebody was saying that like uh, you know, uh the companies will pay to not have the bad reputation hit.
- 22:51Katherine McNamara: But what we've seen in recent years is like bugs and vulnerabilities haven't been the major reason people have moved away from vendors.
- 22:58Katherine McNamara: So I'm curious to see if how even if like mythos comes back out unrest like unchained and you know, and with the bar of the the cost being so high to run it to find every single bug, how many larger companies that have the money to do so are are they gonna continue burning through those tokens?
- 23:18Katherine McNamara: So that's another concern.
- 23:19Katherine McNamara: You know, we'll you know, I'm gonna you know footnote on there.
- 23:23Katherine McNamara: But you know, I I I will say it my personal opinion, just me as a person, I don't feel like it should be uh uh uh control export controlled.
- 23:34Katherine McNamara: I don't think it's it it's not quite the hype uh uh anthropic made it to be, but at the same time, um, and I think it's going to stifle competition.
- 23:44Katherine McNamara: Deepseek's gonna shoot ahead eventually.
- 23:46Katherine McNamara: And what what then?
- 23:48Katherine McNamara: What you can't you the US has no control over export controls on Deep Seek or any other platform AI platform that happens outside the United States, so people just go and use that, and it you know, it feels like we're we're putting a uh finger on the scale against one company.
- 24:03Tim: Well, I mean, there is I mean there is the the potential, and I don't know if it's true or not, but like I mean the the White House is still pretty friendly with uh with Elon and his his clan.
- 24:15Tim: So I mean it could be that could be uh a grok equalizer.
- 24:19Tim: It could be attempting to equalize things for grok.
- 24:21Tim: I mean, there's so many potential with this administration especially, there's so many potential angles of like why they would do this, but I I do believe it's part is the is the hype, the vibes, if you will.
- 24:32Tim: Um I don't know about the the AI, uh the AI um tech race, I don't know what you'd call it, is that's a whole other thing.
- 24:39Tim: We could spend an hour on or more on that easy.
- 24:42Tim: I don't know what the answer is.
- 24:43Tim: Like in theory, uh you know, humanity should protect humanity if we're getting to the point where we're thinking we're gonna have these super dangerous AI.
- 24:51Tim: I don't think we're anywhere near that, and I'm not even sure that exists, if I'm being honest.
- 24:55Tim: But, you know, yeah, I agree with you, just generally.
- 24:58Tim: It's uh you know, China's not gonna the EU now is starting to figure out that, oh, by the way, the US isn't the ally it used to be.
- 25:05Tim: We need to be developing our own models and and all of this other stuff too, right?
- 25:09Tim: So it's polarizing.
- 25:11Tim: And um, I'm not sure what the answer is.
- 25:14Tim: I I do think um yeah, I uh I'm not I'm I'm not sure that here's what I know for sure.
- 25:19Tim: The money that we're the $36,000 that you're paying per bug is like a fraction of what it actually costs to find those bugs, right?
- 25:27Tim: Like, because it's all still being being very heavy as heavily subsidized.
- 25:30Tim: If once the cost starts getting passed along, it's so much of the stuff is gonna be way out of reach, I I think.
- 25:37Katherine McNamara: Yeah, it it it I mean we could try for better efficiency, and like some models do get more efficient depending on um depending on w how they work.
- 25:47Katherine McNamara: Like like I I think Deep Seek is you know, it's still like behind in certain models, but it it does I believe my understanding is that it was more efficient than some some of the models that we're using heavily here in the US.
- 25:59Katherine McNamara: And um, you know, it'll be interesting to see where it goes, but obviously I feel like um, you know, just putting export controls on AI just because they could be, you know, open to a a jailbreaking attack or uh or like a prompt injection, like every AI m LLM model you have out there, every AI model is going to be vulnerable to that.
- 26:22Katherine McNamara: Like, are you gonna export control everything?
- 26:24Katherine McNamara: Obviously not.
- 26:25Katherine McNamara: Um and what happens if if uh like I mean obviously open AI, uh you know, Grok and everything like that, uh they're gonna probably not try to claim that their models are so dangerous they can't release them because they've seen what happens at Anthropic.
- 26:41Katherine McNamara: But here's the problem with anthropic now.
- 26:43Katherine McNamara: If they say this model is better than Fable 5 or Mythos, they're gonna get slapped with another one.
- 26:50Tim: Now you've already set the bar, which is uh a bit of a problem.
- 26:53Tim: So yeah, I completely agree.
- 26:55Tim: The um all right, so let's let's move on to the next one, which is a good segue, actually.
- 27:00Tim: So our last story, I mean there was a lot of stories, right?
- 27:02Tim: But we try to keep these things fairly tight.
- 27:04Tim: Uh the last story is about uh is about AWS kind of, but it's really about it it's about um AI's uh AI data center efficiency, right?
- 27:14Tim: So anybody who hasn't had their head under a rock realize you know has has read a lot of stories now about communities uh all across the nation, probably, I mean, I don't know about the rest of the world, but certainly all across this nation, pushing back on having AI data centers built in their backyard, right?
- 27:29Tim: There's there's an ongoing fight in Colorado, which is under already under severe drought, and you know, the Colorado River is not what it once was, about uh, you know, I forget who it is, if it's Google or who it is that's building a data center there.
- 27:42Tim: And then there's the one in Utah that Kevin O'Leary is famously, you know, trying to get built, and the people in Utah are pushing back against.
- 27:50Tim: And a lot of it has to do with just you know, water, uh, how much water these things take.
- 27:54Tim: So uh this this uh article just came out, you know, a couple days ago.
- 27:58Speaker 1: I was gonna say water and energy as well.
- 28:00Speaker 1: Well, because energy is driving up cost of the energy grade.
- 28:04Tim: No, that's absolutely right.
- 28:05Tim: Yeah, yeah.
- 28:05Tim: I mean, just really resources in general, but it's really the big ones are water and energy.
- 28:09Tim: The two the two big ones are water and energy.
- 28:11Tim: Yeah, absolutely.
- 28:12Tim: Water being an actual physical resource that you know has to be consumed.
- 28:17Tim: Energy has to be consumed as well, but it's harder to track track that back because, you know, it's thousand miles away in a, you know, they they have to build more power infrastructure, and that burns coal, uses a nuclear, you know, whatever, whatever it's using.
- 28:30Tim: But uh anyway, so this particular article is specifically focusing on uh water efficiency, which uh as you pointed out does not do anything for the energy efficiency.
- 28:39Tim: Maybe it's even worse, but we'll we'll focus on the water uh for this article.
- 28:43Tim: So Amazon is saying basically that they are receiving hey they have achieved 0.12 liters of water per kilowatt hour in its data centers compared to the industry average of 0.84 liters per kilowatt hour, which is a 52% improvement in water efficiency over the last five years.
- 29:02Tim: So I'm trying to think about the math there because these these uh these data centers, these AI data centers put out gigawatts, you know, of power.
- 29:10Tim: They need, you know, or need sorry, not put out, uh need gigawatts of of power.
- 29:15Tim: So um if you have to do the math on that one, so efficiency is good, right?
- 29:19Tim: A 52% improvement over five years, that's great.
- 29:22Tim: Um, they're still using absolutely insane amounts of water, but it basically, you know, and what Amazon is saying is that, you know, hey, we we're using free air cooling, evaporative cooling, we're operating at higher temperatures, you know, we're just kind of so so we're just kind of eating the the temperature uh rise and and not cooling it to the degree we used to cool it, which you know, industry analysts are saying, okay, well, that's pretty much going to be the normal.
- 29:48Tim: Like any new data centers built have to do these things because the uh consumption is so high.
- 29:53Tim: So I what I think is interesting about this, you know, this article in general is just the the wider discussion, you know, 0.12 liters per kilowatt hour.
- 30:02Tim: Um less, obviously, uh a lot less than almost a liter per kilowatt hour.
- 30:07Tim: That's a huge improvement.
- 30:09Tim: But is it enough?
- 30:10Tim: You know, for where they're building these data centers, is this enough of an improvement to say, oh well, problem solved.
- 30:17Tim: Let's let's keep building data centers.
- 30:19Tim: Um, I don't know.
- 30:20Tim: I know North Carolina just uh pushed back.
- 30:23Tim: I think we stopped uh some data.
- 30:25Tim: I don't remember who it was, but uh might have been Google.
- 30:28Tim: Uh but building a data center, you know, here in the tr uh near the triangle, I believe.
- 30:32Tim: But I don't know.
- 30:33Tim: What are you what are you seeing out there in in California?
- 30:36Katherine McNamara: Um well I would say that like they probably care like from what I've seen, people building their own AI infrastructure and stuff like that, they care about energy uh like being energy efficient because that's resources they have to pay for uh as well, which are more expensive than water for most of the time.
- 30:52Katherine McNamara: But yeah, it's it's interesting.
- 30:55Katherine McNamara: Um, you know, like these data centers are getting plopped down all over the country, uh in places I don't I don't I haven't heard of any community that was like welcoming them welcoming them with open arms because it's not like it produces a ton of new jobs unless like data center security personnel is what not exactly like the most prestigious job that you're gonna you're gonna get out of it.
- 31:16Tim: It's like ten people, ten people when it's done, you know.
- 31:20Katherine McNamara: Yeah, and maybe construct some construction on building it, but even then they're finding more efficient ways to build this with uh you know to pop them up and pop you know, expand them as they need to.
- 31:30Katherine McNamara: I I think it's gonna be something that like bites us, like bite bites us as a society in the butt later on when like some of these these communities get really uh really expensive to live in because water and and energy become you know uh like we've already seen like the energy costs and water costs uh uh drive up in certain communities.
- 31:50Katherine McNamara: Um one thing I did uh did find interesting though is uh it's kind of related to this, is like the gov US government uh is actually making a watch list now of people who are uh like AI data center resistant.
- 32:04Katherine McNamara: Um I mean I guess the majority of the country is gonna be on a watch list because there's a lot of people that are resistant.
- 32:14Katherine McNamara: Um but it it'll be interesting.
- 32:16Katherine McNamara: Like I uh it it's nice that Amazon is working on on efficiency and in general, I think it's trying their attempt at trying to endear the public to them and you know get people to uh be more accepting of data centers because at the end of the day, like these communities could potentially drive drive the data center out before they're built.
- 32:35Katherine McNamara: Um they have some local power.
- 32:38Katherine McNamara: Like I don't know, like I not to get too political here, but when it comes to like um being able to sway things from a political level, the closer you get to the people, the less typically like the more malleable the politicians are.
- 32:52Katherine McNamara: So like if you go to the federal level, good luck trying to get them to like do anything unless you're a multi-billionaire donor.
- 32:58Katherine McNamara: But when you get down to the local level, state, um, city, county, um, those politicians tend to be more amend amendable to uh what their constituents says say.
- 33:11Katherine McNamara: So I I do see I I mean I'm glad that Amazon is do making these moves, but also that they're probably also announcing these things, not just for the other techies out there, but also to to try to get the those communities to be more accepting of data centers and not like um not block them from being able to build them in certain places.
- 33:30Tim: Yeah, no, I agree.
- 33:31Tim: I mean I've I've been keeping up with this actually.
- 33:34Tim: So there's there's uh I was reading so many stories.
- 33:37Tim: I I should have collected them.
- 33:38Tim: Maybe I will find go find them all and collect them all.
- 33:41Tim: So but um there was one where they built a data center, like there first there was a residential neighborhood, and then they build a data center basically next to it, and the people that live in that neighborhood, like they're having trouble sleeping and stuff because of the subsonic uh machinery sounds and stuff like this.
- 33:57Tim: So it's like there's like a whole thing.
- 33:59Tim: It's like, man, what would you do if you're you know you bought your house, you're living in it, you're paying off the mortgage, and then they plop a data center next to it, and all of a sudden you can't, you know, it's like impossible to live there.
- 34:08Tim: There's there's so much, you know, and then and then there's also I agree with you generally that you know the closer you get to people, the more politicians have to pay attention or they're gonna get voted out.
- 34:17Tim: Um, but there's there's also stories of you know count city councils being voted out basically because they they approved a data center above above uh public uh outcry, and then the data center gets built anyway.
- 34:31Tim: Like there's a lot of stuff going on here.
- 34:33Tim: The federal government's talking about national security reasons to like build AI data centers, you know, for the AI arms race that's heating up, like this whole thing.
- 34:41Katherine McNamara: I mean the AI AI arms race that they're export controlling and neutering.
- 34:46Katherine McNamara: Well, I mean that's probably just for certain companies, one company.
- 34:50Tim: Yeah, who just who just happened to, you know, refuse them before.
- 34:54Tim: So anyway, let's let's not go down that rabbit hole.
- 34:57Tim: But that that's kind of my point, right?
- 34:59Tim: Is that there's there's a lot being shoved down people's throats on this thing, and making it efficient is a good thing, right?
- 35:04Tim: This is a good thing.
- 35:05Tim: Uh Amazon, I mean, there let's be honest, no, no person who makes things more efficient, generally no company that makes things more efficient is doing it because they want the you know, that's all they need is the goodwill of the people, right?
- 35:17Tim: They're also trying to save money and whatnot, but then you have to get into the deals that these guys are these data centers are having for like the you know, low cost energy, low cost water, like just below what the public play pays.
- 35:29Tim: And you start to see that just man, this is this is all kind of screwed up.
- 35:33Tim: But anyway, before we get too far down that rabbit hole, um, I don't know.
- 35:38Tim: I think we should I we're I think we're coming up on time.
- 35:40Tim: We'll go ahead and close this up.
- 35:42Tim: Uh any final any final thoughts for this week?
- 35:45Katherine McNamara: It'll be interesting to see where this is all at in five to ten years.
- 35:48Katherine McNamara: Um terrifying and interesting.
- 35:50Katherine McNamara: Um you know, one of the ongoing things that like, you know, just even in the last month is, you know, like you know, Q1 of this year, like um, or even last year.
- 36:01Katherine McNamara: Um, you know, a lot of companies were like, we're going do we're doing AI first.
- 36:05Katherine McNamara: We we're gonna have leaderboards for whoever is using the most AI and celebrate them.
- 36:09Katherine McNamara: And the the prices of AI, uh like using AI tokens, everything has gone up and people have, you know, companies are now asking people to to you know to uh stop using it as much.
- 36:21Katherine McNamara: Not sp not spend as much money.
- 36:23Katherine McNamara: So like this rush to build as many uh AI data centers as possible and stuff like that, it'll be interesting because we're we're kind of getting to this this point where these two colliding interests are gonna hit, like the the the need to buy like to create new AI data centers and build more resources, but also companies starting to realize this might be more exing AI might be more expensive than actually having human bodies.
- 36:48Katherine McNamara: And so I'm wondering if i I'm I'm interested to see in five, ten years time, do these models become efficient enough that they're not no longer more expensive than human beings?
- 36:58Katherine McNamara: Um are these all these data centers that they're building, you know, uh, you know, to try to be competitive, are they going to really be used, you know, in five, ten years if the model prices keep going up?
- 37:11Katherine McNamara: Um and how are companies going to react if the prices do go up?
- 37:15Katherine McNamara: Are they gonna cut back on AI and basically make this all this whole thing like void?
- 37:21Katherine McNamara: Or, you know, it'll be interesting to see where this goes.
- 37:24Katherine McNamara: Obviously, think this is like our our industry, like any tech tech changes all the time.
- 37:29Katherine McNamara: Things change, sentiment changes.
- 37:31Katherine McNamara: So it'll be interesting to see where it goes.
- 37:34Katherine McNamara: And that's just kind of my final thought on it.
- 37:35Katherine McNamara: Obviously, I don't have a crystal ball, neither do you.
- 37:38Katherine McNamara: We're just kind of vibing it out as well and watching things change on like a monthly or quarterly basis.
- 37:44Katherine McNamara: Like last quarter, use more AI.
- 37:46Katherine McNamara: This quarter, a lot of companies are like, use less AI, wait, stop.
- 37:50Katherine McNamara: Like Microsoft told everyone to stop uh to cut back on token usage and start canceling subscriptions because it got to be too expensive.
- 37:57Tim: Yeah, yeah, yeah.
- 37:58Tim: So uh one thing uh you reminded me, and then we'll we'll close it out.
- 38:01Tim: Um, so one thing I've been saying this for a while, Chris has been saying this for a while.
- 38:05Tim: So, way back our our like fourth episode, maybe like this is you know almost three years ago now or whatever, we were talking about cloud, and we were talking about where are the savings that we were promised.
- 38:19Tim: Because part of the whole thing about going cloud first was we're gonna give you an economy of scale.
- 38:23Tim: Like AWS, all the people were like, we're gonna give you an economy of scale because we have all this gear, we have all this capacity, we can make it more affordable for you to run your stuff with us than you could build your own.
- 38:36Tim: Now that was the promise.
- 38:37Tim: And why the reason it never materialized, which we posited at the time, was right, it they couldn't actually lower costs because if they lowered costs, you would have so many people come in that you'd be DDoSing your own, like every customer would be be snatching the the limited capacity.
- 38:53Tim: And I think I've been saying again for a while that a the the the AI thing is very close to what the cloud how the cloud thing played out is that it's the same thing, right?
- 39:05Tim: So that what they're doing is frantically trying to build capacity, but they've run up against physics, right?
- 39:10Tim: There's there's not enough rare earth that you can't get the rare earths out of the ground fast enough, you can't fab the the chips fast enough, you can't build, you can't stand up the materials fast or the data centers.
- 39:20Tim: Can't buy RAM fast enough.
- 39:22Tim: Can't buy RAM fast.
- 39:23Tim: That's what I'm saying.
- 39:24Tim: You can't create it fast enough, and that's why half of these data centers have been canceled or mothballed for a while, not just because they've been pushed out, but even the ones that were accepted, simply that there's nothing to put in them, right?
- 39:35Tim: Like so um I think we're gonna see, and now that we are in real time seeing the same, and now people are saying things like AI first, the you know, they used to say cloud first.
- 39:45Tim: It was the same thing.
- 39:46Tim: We'll do everything with AI, we'll do everything with cloud.
- 39:48Tim: It's really interesting to see the cycle repeat itself with a with a different technology, and I know it's the same as it ever was.
- 39:56Tim: You go back and and that's always been the case, right?
- 39:58Tim: But it's it's really interesting to live through two cycles that are so closely put together and see the same exact type of uh behavior anyway.
- 40:08Katherine McNamara: I was also gonna say, like, one of the weird things about this day and age, like cloud, like when c cloud first happened though, like it wasn't about replacing people.
- 40:17Katherine McNamara: Like, though I did hear a lot of people saying, Oh, we're not gonna need network engineers anymore and stuff like that, and I'm like, You're still gonna have to connect to the cloud, you idiot.
- 40:26Speaker 1: Yeah, yeah, yeah, exactly.
- 40:27Katherine McNamara: I mean, you still are gonna need infrastructure at you know at offices.
- 40:30Katherine McNamara: But um, yeah, cloud was you know initially gonna be some savings, and then there's like, okay, it's not savings, it's just opex cost instead of capex cost.
- 40:39Speaker 1: Right.
- 40:40Katherine McNamara: And then um, yeah, it it certainly hasn't made it cheaper for anyone uh at at this point.
- 40:44Katherine McNamara: But AI first has been interesting because the promise is to replace humans in a lot of these things, or at least like the idea is, and it's interesting because the stock market is actually like 10 years ago, five years ago, if you laid off if you were a company laying off a cr a shit ton of people, uh, pardon my French, um, you basically it was a sign of instability of like you're not doing well.
- 41:08Katherine McNamara: These it's so stock prices would potentially get hit.
- 41:11Katherine McNamara: These days, you lay off 30,000 people, it's seen as innovative.
- 41:15Katherine McNamara: It's innovative because you're doing so much with AI.
- 41:18Katherine McNamara: So you're actually rewarded and you get a stock price bump.
- 41:21Katherine McNamara: I'm more curious to see how long that'll last for.
- 41:24Tim: Yeah, I agree.
- 41:25Tim: And I don't think I think the the chickens have to come home to a roost on that one.
- 41:28Tim: You can't cut, but so far without impact.
- 41:30Tim: So all right, let's go ahead.
- 41:32Katherine McNamara: It's starting to with the the cost of AI raise uh rising.
- 41:35Tim: Yeah, yeah, yeah.
- 41:36Tim: Agreed, agreed.
- 41:37Tim: So all right, we'll go ahead and wrap it up here.
- 41:39Tim: Uh thanks for joining us um this month on the Cables Clouds monthly update.
- 41:43Tim: Hopefully next time we'll have Chris with us.
- 41:46Tim: And uh oh yeah, Chris wanted to make sure to apologize.
- 41:49Tim: I'm sorry we missed our our uh release.
- 41:51Tim: It's our first time ever missing a release.
- 41:53Tim: Catherine and I were super busy with Cisco Live, and Chris was, I don't know, I don't know, maybe he was drinking.
- 42:00Tim: I'm I'm not sure what he was up to, but I'm just kidding.
- 42:02Katherine McNamara: He was yelling at us to get unbusy.
- 42:04Katherine McNamara: Oh yeah, that's right, he was yelling us to record it.
- 42:06Katherine McNamara: But no, it's it's it's all good.
- 42:10Katherine McNamara: We actually have a bunch of people lined up for interviews and and uh and shows.
- 42:15Katherine McNamara: We might actually end up having a backlog of uh of stuff soon enough.
- 42:19Tim: Which will be nice.
- 42:20Tim: So, okay, we'll see everybody on the next episode, and thanks for joining us to go.