Latest / Engineering Influence from ACEC / Engineering in the Age of AI: Navigating Infrastructure and Security
Transcript
- 0:04Welcome to Engineering Influence, a podcast from the American Council of Engineering
- 0:08Companies. We're coming to you live from our annual convention and legislative
- 0:12summit in Washington, D.C.
- 0:13I'm very pleased to be joined today by Nick Decker, Director of Engineering for Ignite.
- 0:18Welcome to the show. Pleasure to be here.
- 0:21So if you think about everything happening across the engineering industry,
- 0:27let's talk just a little bit about infrastructure and
- 0:31how companies are managing files
- 0:36what are you seeing in the industry right now what kind of changes are
- 0:38we seeing this is going to be a long-winded question but i i
- 0:41mean with ai and everything's moving
- 0:44so fast what what's what's happening like give us a lay of the land yeah i i
- 0:48think a couple trends are happening at once which is a little bit difficult
- 0:52for firms to move at the speed that that they need to to adopt everything at
- 0:56once So those trends in macro are firms are growing and they're growing geographically.
- 1:04So not everyone is in a singular office all day, every day anymore.
- 1:08In addition to that, the work product themselves needs to move at a certain
- 1:14pace and keep up with client demands and schedule-driven timelines and things like that.
- 1:20So what we're seeing, particularly with our, you know, our clients in the industry
- 1:24are moving toward away from on-prem models and everyone needing to be in the
- 1:29office as much as possible.
- 1:30Right. Or only being able to collaborate with your team that's in your regional
- 1:34base. So people are able to, you know, potentially collaborate across the country
- 1:38and pull in talent from offices as they see fit.
- 1:42You know, when you're talking about a firm that has dozens, if not hundreds
- 1:45of offices, that's a, you know, that's a differentiator for them to pull the best in class.
- 1:51Regardless of where that talent is, you know, located. So before we,
- 1:56this interview started, we were talking a little bit about the Intuit Dome in LA.
- 1:59So I know you're an Indy guy. Yep.
- 2:02Is that a use case? Like, is there a team in Indy? They're in LA,
- 2:06they need access. Is that- Totally.
- 2:09To collaborate. Yeah, no, it's interesting, you know, particularly on the design
- 2:12side, you'll have folks who are, you know, based in the Indianapolis office,
- 2:17the field team, you know, doing the CA work is, you know, out in LA,
- 2:22you have a number of, you know.
- 2:25Cross consultants that are, you know, working all over from,
- 2:29from, you know, all over North America.
- 2:31And then we have some, you know, in particular design offices in London or,
- 2:35or, you know, Asia that are collaborating in off hours.
- 2:38So it is, it really is, you know, as the sun, as the sun goes,
- 2:43so does the, you know, the requirement for collaboration.
- 2:46Right. And so it's, it's fascinating to see that be able to have that pace of play.
- 2:51Given that, you know, that wasn't even an option, like no one,
- 2:55no one even considered that three, four years ago.
- 2:58Right. So it really has changed in lightning pace as far as the engineering
- 3:03world is concerned. So is this a workforce?
- 3:05Is this is an output of workforce? COVID?
- 3:08Is this just the nature of the business kind of shifting?
- 3:12Yeah, I think, you know, as with anything, COVID was an interesting forcing function.
- 3:16Everyone went home and they go, oh, well, I need my data with me while I'm on
- 3:21the couch at home, just like I was in the office, or I moved to the country
- 3:25and now I'm on Starlink, those types of things.
- 3:27And so that, I think people got a little bit more comfortable with it.
- 3:32But at the same time, you do have, you know, this backlog of work that had built
- 3:38up and people needed to work faster.
- 3:41And so it wasn't just a matter of, you know, can I do my work?
- 3:45It's, can I do an extra 30 or 40% of my work in the same amount of hours? Right.
- 3:50So that's, I think it was, you know, five years on at this point,
- 3:54I think we've now kind of settled into a new normal and people are more comfortable with it.
- 3:58Right. The next phase is certainly going to be, you know, how do you apply AI
- 4:01and these other automation tools to, you know, kind of amplify it even further.
- 4:06To further enhance it. And that's been a big discussion at convention.
- 4:08I mean, AI has been a buzzword. I feel like it's been a buzzword,
- 4:11what, since for past four years, we're moving lightning fast.
- 4:15And with AI and with the project we were just talking about comes a level of
- 4:19security that I think makes firms nervous, concerned.
- 4:26Maybe it'll keep your security director up at night thinking about,
- 4:29man, what's the next thing I have to face? Yes. So...
- 4:33The project that has consultants here and then you have the team on site,
- 4:38they're all tapping in or accessing data that is being shared across the project.
- 4:44So what does that look like from a security standpoint and protection?
- 4:48Yeah, I think it's interesting to really understand how the users are going
- 4:56to work within the context of an AI-enabled world.
- 4:59To be totally honest, people aren't going to be patient. there's this concept
- 5:03of shadow AI that's floating around where people will essentially download.
- 5:08Documents or information from a project and then
- 5:11they'll upload it to some public chat GPT and things like
- 5:13that and that is when you talk about a security you know chief security officer
- 5:18staying up at night it's that type of stuff like my client's data is now training
- 5:22some public model and things like that so you know certainly our stance is you
- 5:28know keep your AI deployments private as much as possible.
- 5:31And, you know, we enable that through, you know, not training third party models
- 5:34and the like, but more broadly,
- 5:37you know, we've heard statistics where something like 80% of the registered
- 5:43users on chat GPT are conducting essentially like work and it's not just personal use.
- 5:50And so these emails and things like that are work emails.
- 5:53And so it's, you know, that they're using this for work and their IT team,
- 5:58their security teams have no knowledge of it.
- 6:01So it's a difficult thing for them to, you know, as an IT team,
- 6:05you don't want to put the brakes on innovation, but you also can't expose additional
- 6:10risk that wasn't there before.
- 6:12You don't want to put on the brakes, but you want to put in the guardrails, right? Correct.
- 6:17Is there a case study? Is there more information about how someone can learn
- 6:21more about how to put those guardrails on, keep innovation going,
- 6:24and keep productivity up.
- 6:25Yeah, I think the short of it is ensure that you give your users the tools to
- 6:33do their job, and that includes AI.
- 6:35But in order to have those tools, they need to be privately deployed.
- 6:39So in that context of cloud computing, that just makes sure that,
- 6:43you know, the third-party models are not being trained on your data.
- 6:47That's where a tool like Ignite can come into play. But it's also something where,
- 6:53you can also just pay for the corporate license of ChatGPT and basically say,
- 6:59under no purpose can you utilize these responses to train your next LLM and things like that.
- 7:06Right, it trains internal, it will not train external.
- 7:09Is that fair? Exactly, train on your company data. And I think that's the important part.
- 7:14It's you don't become the product. Correct. Correct. Because we're the customer,
- 7:19right, of those products. Exactly.
- 7:22So what else? What else we need to cover here, Nick? I mean,
- 7:24we've talked a lot, right, about using the cloud, security, collaboration amongst these teams.
- 7:32Is there anything we're missing in this puzzle we're piecing together here?
- 7:35Yeah, I think the other piece that we're seeing a lot of is actually tech consolidation.
- 7:42So we've seen a growth of tools in the industry over the last decade.
- 7:50And there's now a fatigue of, I have to go to this tool to do this thing.
- 7:53And I have to go to this tool to do this thing. And, oh, I forgot I saved this here.
- 7:56And so the users are coming back to the IT team. This is kind of backwards and saying, we need less.
- 8:03We actually, we need to be able to do our job, but we need to be able to do
- 8:06it from at one place or two places, not seven or 10 places.
- 8:10Right. right exactly that's it's solving
- 8:13multiple things at once which which i'm very excited for but that
- 8:16tech consolidation is not something i expected to hear
- 8:19from the end users i expected to hear it from it they're like we want
- 8:22to spend less money i think the end users are actually saying we can work faster
- 8:27if we have less stuff that we need to deal with right and so that consolidation
- 8:33is has been a an interesting macro trend as well so that that consolidation
- 8:37is that happening now is that is are we in that is it like
- 8:41this is stage one of a, excuse me, there goes the mic.
- 8:45Let me just rerecord that. Is that like a stage one of a three-stage process?
- 8:49Where are we in that journey? Yeah, I think it's early days.
- 8:52You know, there's more tools popping up all the time, which is kind of slowing
- 8:57the process. You may get rid of one tool and then adopt another.
- 9:00So it's a bit of a whack-a-mole, I would say, but in general,
- 9:03you know, in the next two to three years, we'll see firms that used to have
- 9:07a tech stack that was, you know, hundreds of applications long, get down to 20, 30.
- 9:13I think that's ultimately the goal from CIOs that we're talking to.
- 9:17Okay. And that's good information to have to plan for the future.
- 9:21Yeah. Right. So, well, anything else that we need to cover? I think,
- 9:25again, I covered a lot, but Nick, I want to give you the last word.
- 9:28I think I'm an eternal optimist that the engineering industry is on a positive
- 9:34path and things are only going to get better and more efficient and more collaborative.
- 9:39And tech is just an enabler. It's a tool within that process,
- 9:42but the industry as a whole is doing a great job on the advocacy and the coming
- 9:47to the table and being more open and excited for the next phase.
- 9:52And we're on board with that a hundred percent.
- 9:54Well, great. Nick, thank you again for your time. A great conversation.
- 9:57Everybody, thank you to Nick Decker for making.
- 9:59Music.