Latest / Microsoft Cloud IT Pro Podcast / Episode 440: The J Factor: Bringing Your Experience to Generative AI
Transcript
- 0:00Welcome to Episode 440 of the Microsoft Cloud IT Pro Podcast, recorded live at the North American Collaboration Summit in Branson, Missouri.
- 0:12This is a show about Microsoft 365 and Azure from the perspective of IT pros and end users, where we discuss a topic or recent news and how it relates to you.
- 0:21In this MS Cloud on the Road conversation, Ben sits down with Jay Leask of Microsoft and Microsoft MVP Norm Young.
- 0:30Norm actually turns hosts and asks what Ben and Jay's work looked like before generative AI.
- 0:36They also discuss whether your own experience, the Ben factor or the Jay factor, still shows up in AI-assisted work, and if so, what does that look like?
- 0:48Jay Leask.
- 0:49Ben Stegink.
- 0:50And Norm Young.
- 0:51Hey, Norm, tell us a little bit about yourself.
- 0:54I'm coming to you from St. Catharines, Ontario, Canada.
- 0:59I would like you to know that you're in Branson, Missouri.
- 1:02In the U.S., not Canada.
- 1:05Right.
- 1:06I will be forgiven for my choice of words, and you too will also be forgiven for not knowing where St. Catharines, Ontario, Canada is on a map, and that's totally fine, and I like to start that way.
- 1:18I'd like to say that you didn't even ask if we knew before you made the assumption.
- 1:23No, don't ask now.
- 1:24I know you don't know.
- 1:25I know you don't know.
- 1:27And the last time I talked to Ben, we were on the other end of the U.S. in Seattle.
- 1:31I don't know exactly where it is in Ontario.
- 1:35I know a few places in Ontario, but not St. Catharines.
- 1:38St. Catharines is maybe 10 minutes from Niagara Falls, the U.S. and the Canadian one, and about an hour and a half, two hours to downtown Toronto, which most people know.
- 1:47So, not in a touristy place, not in a busy downtown place, but a place where you can raise a family, you can have a nice life.
- 1:53I have a nice view of Lake Ontario from my front porch, and it's a blessed life.
- 1:58I should have stopped and said hi to you when I was at Niagara Falls in June.
- 2:02You brought that up in Seattle.
- 2:03Do you remember?
- 2:04I kind of do now.
- 2:05That's the worst.
- 2:06I remember that too.
- 2:08And Norm clearly has a better memory than I do.
- 2:10And I bring this up, that's home for me, and things that we're famous for back home are, if you're a music fan, and you know a band called Rush, Canadian, one of the all-time great Canadian rock and roll bands.
- 2:22Yes.
- 2:23The drummer lived in my neighborhood, the late, great Neil Peart.
- 2:27Okay, okay.
- 2:28Yep, so that's kind of what we're known for, and we're also near all of these vineyards and hard stone fruit type farms because we're so close to the lake and we have an escarpment.
- 2:38And so winters in my part of Canada are quite mild.
- 2:41What is a hearthstone fruit?
- 2:43A peach.
- 2:44Oh, okay.
- 2:44An apricot.
- 2:45Hard stone.
- 2:46Peaches?
- 2:47Yes, they have a hard stone.
- 2:48The pit.
- 2:49The pit is hard.
- 2:50Hard stone.
- 2:50Yeah, hard.
- 2:51I missed the D. I heard hearth.
- 2:52Like a hearthstone is what you put over your fireplace.
- 2:55Well, you know, the truth is my-
- 2:57It's also known as a hearthstone.
- 2:58My articulation of all words at the moment is being impeded by this microphone that's in a very uncomfortable position.
- 3:06That's that, sir.
- 3:07I don't know.
- 3:07By the way, I tried to start playing Rush just for like three to five seconds of it just to get like the drum beat that everyone in the world knows.
- 3:15It's playing on my headphones.
- 3:17Oh.
- 3:17Which did you guys know good?
- 3:19Ah, this is true.
- 3:20You should have told me I could have pulled it up on Spotify and played it.
- 3:23You could have thought of it yourself.
- 3:25I was busy talking to our guest.
- 3:27And so now that you know where I come from, and we are in Branson, Missouri.
- 3:34No, that's fine.
- 3:35It's by Niagara Falls.
- 3:36By Niagara Falls.
- 3:37What is Branson, Missouri near?
- 3:39For those of us who don't know American geography.
- 3:42Not an airport.
- 3:42Not an airport.
- 3:43Springfield, Missouri, which is also near nothing.
- 3:46There's an airport in Springfield.
- 3:47There is an airport.
- 3:48Yeah.
- 3:49Yeah.
- 3:49No, not much.
- 3:50There's a small river here, and everything is beautiful here.
- 3:53It is beautiful here.
- 3:54You know what?
- 3:55I've heard Bransoners referred to.
- 3:57It's like the Bible Belt version of Vegas.
- 3:59Yes.
- 4:00Which is not something I knew I needed in my life.
- 4:04This is my second time coming to Branson.
- 4:06I hear it might be the last time I'm coming to Branson, not because I did a poor job at
- 4:10my last session.
- 4:11The police have put your photo on the walls out there.
- 4:14They're like, do not let this guy in, eh?
- 4:16Here comes security right here.
- 4:18Oh my God, it's true.
- 4:21Thankfully, my credit card was accepted this time.
- 4:24So that all worked out well.
- 4:25But that's not what I'm talking about.
- 4:26Was there another time it wasn't?
- 4:27I'm not going to disclose anything on a live broadcast.
- 4:30Okay.
- 4:31My accountant can speak to all of them.
- 4:33And my defense attorney, of course.
- 4:36But I understand that Branson is, the event that we're doing here is probably going to
- 4:41not happen next year, which is very sad.
- 4:43But I do love coming here.
- 4:44And I love that this event has got the right size of people who just want to learn.
- 4:49And it's not in my last session.
- 4:51I don't know what it was like for you two.
- 4:53But it wasn't just sit back and receive.
- 4:55They were sharing.
- 4:56They were engaging.
- 4:57It was like, it's what you want when you come to these things.
- 4:59When you come far as from St. Catharines, Ontario, Canada, across the U.S. border to
- 5:04fly out of Buffalo and take multiple planes to come to St. Louis Airport.
- 5:08Is that where we all arrived?
- 5:09A Springfield.
- 5:09Springfield.
- 5:10Thank you.
- 5:10Well, I don't know.
- 5:11You may have flown into St. Louis, but that would have been a long drive.
- 5:14Yeah.
- 5:14I hope you didn't fly into St. Louis.
- 5:16Well, it's not that long of a drive.
- 5:17It was an hour drive.
- 5:17You don't even know which it is.
- 5:18That's Springfield.
- 5:19An hour is Springfield.
- 5:20St. Louis is probably like two and a half hours.
- 5:22Yeah.
- 5:23Two hours.
- 5:23I flew to Tulsa, which is about two and a half hours.
- 5:25But I flew into Tulsa, stayed the night, and then drove to Springfield to pick you up
- 5:28and then came here.
- 5:29So bring up Branson.
- 5:30Yeah.
- 5:31Question.
- 5:31Yes.
- 5:32Are we in what the U.S. would consider the South?
- 5:35No, we're in the Midwest.
- 5:36Yeah.
- 5:37In the Midwest.
- 5:38Right.
- 5:38Yeah.
- 5:38Okay.
- 5:39All right.
- 5:39The conference food has been fantastic.
- 5:41And breakfast today, I had my very first experience with biscuits and gravy.
- 5:46That was your first experience with biscuits and gravy?
- 5:48I've eaten biscuits before, but that is not a thing in Canada.
- 5:51I mean, you guys have poutine, so.
- 5:53I was going to say, that's not even a thing in Michigan.
- 5:56Like, biscuits and gravy is not.
- 5:57Biscuits is a thing anywhere there's a Denny.
- 5:59Biscuits and gravy.
- 6:01It's not a thing.
- 6:02And on first-
- 6:03I'm with Norm.
- 6:03I don't eat biscuits and gravy.
- 6:05On first bite-
- 6:06First of all, sir, that's all I have to say.
- 6:08Okay.
- 6:09First bite, I didn't see what all the hype was about.
- 6:11And then a very nice lady beside me suggested I have it with some sausage.
- 6:15Yes.
- 6:16And then it changed your world.
- 6:17It's a game changer.
- 6:18It is.
- 6:18It is.
- 6:18It's a total game changer.
- 6:19The biscuits and gravy here, the biscuits were super fluffy.
- 6:22Loved that.
- 6:22The gravy could have used a little bit more peppercorn.
- 6:25The heat from a peppercorn does change it.
- 6:27And then the flavor from the sausage absolutely made it.
- 6:31I don't even, did you try it?
- 6:33I've tried it before.
- 6:35Maybe I need to try it again.
- 6:36Did you try it here?
- 6:37I haven't tried it here.
- 6:38Okay.
- 6:38Well, tomorrow morning for breakfast, biscuit.
- 6:41You take a biscuit, you break it in half.
- 6:43You take a sausage, you cut that into pieces, and then you pour the gravy on top of it.
- 6:48And if you can find some good peppercorn, throw that on top.
- 6:50Throw that on there.
- 6:50I'm learning something about you today, Jay, that I don't know that I do.
- 6:54That the fat guy likes food?
- 6:55No.
- 6:56Between lunch and this, you seem like you are borderline a bit of a foodie.
- 7:01Oh, yeah.
- 7:02Yeah.
- 7:02I don't know that I really...
- 7:03I cooked in a kitchen for a while.
- 7:05Did you?
- 7:05Did you really?
- 7:06Yeah.
- 7:06When I was a teenager.
- 7:07What kind of cooking would you have done?
- 7:09So I worked for Pizzeria Unos, but I worked the whole line.
- 7:13So I started at the pizza side, and then I worked my way to the chef side, and I spent
- 7:18about six months on the chef side.
- 7:20Yep.
- 7:21And then I went to college.
- 7:22Learned your lesson.
- 7:24That if I wanted to make money, it wasn't going to be in the kitchen of a Pizzeria Unos.
- 7:27I'm glad you brought that up.
- 7:28Yeah.
- 7:29Because all of us have done something in the past.
- 7:31You were a line chef at a pizzeria doing all the different things.
- 7:36Now, we'll start with you, Ben.
- 7:38Whose show is this?
- 7:39Apparently not ours.
- 7:40I'm helping out.
- 7:41I'm helping out.
- 7:41This is an audition, I hope.
- 7:43What was your work focus like two or three years ago before Copilot hit?
- 7:47What were you doing?
- 7:48You know what I was doing.
- 7:49I'm going to let Ben go, but...
- 7:50What was I doing before I was spending a lot more time...
- 7:56It has definitely been a time saver.
- 7:58I was spending a lot more time writing PowerShell scripts by hand that were not commented
- 8:02nearly as well, nor had nearly as much error checking and fault protection in them.
- 8:09They were purpose-built to do one thing and to only account for the scenarios I encountered.
- 8:16They were not nearly as robust as they are now that I have Copilot.
- 8:20Yep.
- 8:20The other thing I was doing before Copilot was I was manually looking through a lot more data.
- 8:27Conditional access policies.
- 8:29I was manually reviewing each conditional access policy, jotting notes, trying to figure out
- 8:34where there are gaps, where there are discrepancies, health checks, audits of Microsoft 365 environments.
- 8:40I was clicking through the UI, I was running some PowerShell scripts, but I was just getting a lot of data
- 8:45that I still had to manually look through and look for misconfigurations, that type of thing.
- 8:52Now that I have Copilot, I'm getting a lot more data and letting Copilot do a lot of the hard work of analyzing the data.
- 8:59Oh, you're letting Copilot do it.
- 9:00Now that there's a normie in front of us, you're going to call it Copilot.
- 9:05Well, he said before Copilot came, what if I sent Copilot stuff to the anthropic models?
- 9:11You could have just said generative AI.
- 9:12I use Claude.
- 9:13Yeah, you're right.
- 9:13I should have said generative AI.
- 9:15Yeah, before generative AI, because I do a lot more of that with Claude, because I will end up with like a thousand.
- 9:21Well, that's for a different scenario.
- 9:23I will end up with a lot of files in my file system, and it's a lot easier to use like the command line in Claude
- 9:27to work with those than to upload a bunch of them to a SharePoint site.
- 9:30Well, what about you, Jay?
- 9:31What was life like for you professionally before generative AI?
- 9:35I spent a lot more time doing boring parts of my job than I do now.
- 9:39I spent a lot more time reading emails and trying to find content, like you said, trying to search for stuff.
- 9:47I considered myself pretty good at searching for things, but it was a significant part of my job.
- 9:53I spent a lot more time creating documents.
- 9:56When I worked for AvePoint, I did a workshop for the U.S. Army and for Lon Lane, the sales guy.
- 10:03And it took me two weeks to get my deliverable from that engagement out to him and the customer because I was just so busy.
- 10:10I didn't have time to spend six or eight hours building this deliverable.
- 10:14And now that I've got Copilot and Cowork and generative AI, I can knock that out in under 45 minutes.
- 10:21And it's a better deliverable than it ever was when I was doing it by hand because I wasn't relying on my memory to write it.
- 10:28And I wasn't relying on the hours of search to find the documentation for it.
- 10:32I now take a transcript and I give that transcript to a Cowork skill, which knows what the document should be formatted like.
- 10:41It knows to search learn.microsoft.com to find documentation on the major topics.
- 10:46It pulls all of that together in between the transcript, which replaces the need for my memory to be so, well, I've got a terrible memory.
- 10:52It's really completely changed how I do the menial parts of my job so I can spend more time either tinkering, which I had no time to do when I was at AvePoint because that's when Copilot became a thing for me is when I switched to Microsoft.
- 11:07But I now have time to tinker, like so much time.
- 11:10I'm writing skills and generative AI things that I just didn't even have time to think about before.
- 11:15That's amazing.
- 11:16I want to hear Norm's answer and then I have some interesting thoughts around what you said and some of the stuff you said versus some of the things I'm feeling.
- 11:24He's good.
- 11:25He's feeling.
- 11:26What?
- 11:26He's what?
- 11:27It is his turn.
- 11:28I agree.
- 11:28Thank you.
- 11:29We actually have an audience here.
- 11:31And if I had the camera, I would show you.
- 11:32I think most of my time pre-generative AI would have been focused on thought organization, collating content in a way that even though it made sense in my head, it was never going to make sense to anyone else.
- 11:46Yeah.
- 11:46And it has become, I don't want to use the word game changer, but it has significantly made my content more consumable for people.
- 11:55I am able to just brain dump at all times and have something else organize it.
- 11:59So the quality of my work has probably improved.
- 12:03The value chain has, I've definitely moved up as a result of it.
- 12:06The but part, and it was the thing that I wanted to ask both of you is, Ben, when you first started talking about your pre-generative AI work, a lot of it sounded like it was based on your experience, your trained knowledge, and all of these things that would make it possible for you to go through those autolog files to perform that health check and so on.
- 12:24You can't assume that generative AI knows those things.
- 12:28It knows a lot of things, but it doesn't know those things.
- 12:31And I was going to tie it back to what you said about the two weeks it took you to generate a deliverable for a very important customer.
- 12:39Now you can do it in the span of hours instead of weeks, but it's still not the same.
- 12:43And I'm not suggesting that generative AI is better or worse or whatever.
- 12:47Do you feel that the Ben factor and the J factor is still representative in your current day work and your outputs?
- 12:53Yes.
- 12:54And I would say because I will generate those a lot quicker.
- 12:59That being said, I will spend a lot of time reviewing it yet.
- 13:03Okay.
- 13:04I will generate, I will have it analyze the data, but I will still read it line by line.
- 13:09And there are times, to your point, normal, I will read it and I'm like, that doesn't feel right.
- 13:14That doesn't look right.
- 13:16Like there's something that because of those 20 years of experience, there's something off here.
- 13:22And I need to go dig into it further or validate the source or something to that effect.
- 13:29Or even PowerShell scripts, I will go review them and look for certain things.
- 13:34Like if I'm writing a PowerShell script to go get a bunch of information,
- 13:39I will go through it and make sure there are no update dashes or add dashes.
- 13:45Or those types of things.
- 13:47I want to make sure everything is a get, a read, something to that effect.
- 13:52So I think there are certain things where it's quicker, but it's not exponentially quicker
- 13:57because I'm still spending a lot of time on the validation of what it generated.
- 14:03Got it.
- 14:04What about you, Jay?
- 14:04Like you're, you're spending all of this new free time building things like skills and having time to tinker.
- 14:11Do you think there's a way for someone like myself and others who are, I don't feel like I'm losing my voice or my,
- 14:19I'm not losing my voice to AI, but I'm, the lines are blurring.
- 14:23And I still want to make sure that my authentic self, my approach to problem solving or articulating solutions to users,
- 14:31customers and so on is still there.
- 14:33What does the future look like for us?
- 14:35Yeah.
- 14:35And I ask you in particular, because you're like, you're at this table.
- 14:39I think you're the one who's probably the most informed at where the Microsoft technology side is going.
- 14:43I think there's still a lot of unknown in that.
- 14:46Part of that is society and government are still trying to figure out how to influence where the technology is going.
- 14:52My eight-year-old stays up until 10 p.m. after being sent to bed talking to Alexa about life.
- 15:00Literally, he had a conversation one night about how unique am I as an individual.
- 15:06And Alexa would ask questions about his eye color, his hair color, his height, his weight.
- 15:10Are you skinny?
- 15:11Are you a little bit bigger?
- 15:12And Alexa helped him figure out, like, he is one in one blah, blah, blah, blah, blah, billionth unique.
- 15:18Like, it was really cool.
- 15:20Like, it was also kind of creepy, but it was really cool.
- 15:23My 14-year-old hates AI, which is understandable.
- 15:26My 14-year-old is a cosplayer.
- 15:28He considers himself an artist.
- 15:29And those are areas that AI is really encroaching negatively on.
- 15:36It's using publicly accessible art to be trained.
- 15:40It's pulling.
- 15:42People are using AI videos to, or AI to create videos of themselves in cosplay rather than putting the work into doing the cosplay and then claiming they did.
- 15:53And so my 14-year-old is very against it.
- 15:56The 8-year-old is growing up with it, which is really interesting.
- 15:59It kind of feels like phones were for, mostly for all three of us, where, like, at one point, it was take a quarter so you can use the pay phone.
- 16:07And then it was take a quarter so you can use the pay phone when I paid you.
- 16:12And then it was, here's a phone.
- 16:14And then it was, here's a phone, text me.
- 16:16And then it was, here's location tracking.
- 16:18And, like, we lived through this change.
- 16:20And the 14-year-old is living through that change.
- 16:23Meanwhile, the 8-year-old's like, what?
- 16:24No, AI's just in everything.
- 16:25So I think we're still, as a society, and then through the government, trying to figure out what the technology should look like.
- 16:33Yes.
- 16:33So it's hard to say what it will look like.
- 16:36If you're managing file storage today, you've probably felt the pressure.
- 16:41Refresh cycles are harder to plan.
- 16:43Costs and complexity are increasing, especially as file workloads scale across regions.
- 16:48That's why Microsoft customers trust Nasuni.
- 16:51As an Azure-certified software, Nasuni provides a global file system designed for enterprise-scale environments,
- 16:58keeping file data secure, governed, and accessible across Azure environments without added infrastructure complexity.
- 17:05It's the foundation to keep your unstructured data stable, even as your infrastructure evolves.
- 17:11To see how much you could save while keeping your initiatives on track, visit nasuni.com slash TCO.
- 17:19That's N-A-S-U-N-I dot com slash TCO.
- 17:25And your question is interesting, Norm, because I'm still bringing my experience to it in my history.
- 17:33But I do feel, and that's what, similar to even what you started alluding to, Jay, where you were like,
- 17:38it takes away the boring parts of mine.
- 17:39In some respects, I feel like it took away some of the fun parts of mine.
- 17:45Because I enjoyed, similar to your 14-year-old, I enjoyed writing the PowerShell script.
- 17:51I enjoyed some of the creativity aspects of writing a script, of problem-solving.
- 17:58How do I write a script?
- 18:00How do I account for this error?
- 18:02There was a lot more thought that went into what I was creating in a PowerShell script.
- 18:09Now I'm to the point where I legitimately, and to your other point,
- 18:14I don't get to free up my time in Tinker because I'm billable.
- 18:18And this is a conversation Scott and I have had.
- 18:20Now it's like, I feel bad charging a client for spending eight hours writing a PowerShell script
- 18:26when AI can write the exact same PowerShell script in 30 minutes.
- 18:31I can't now go bill eight hours in Tinker for seven and a half.
- 18:36I'm trying to do more and more and more work because the work I'm getting done happens faster and faster.
- 18:44So it's also brought about an interesting aspect of how do I bill for some of this stuff?
- 18:49Can I still do a pure T&M?
- 18:52So I have a whole bunch of those thoughts where there are days where I do struggle with it
- 18:58because I feel like some of the fun, some of the creativity,
- 19:01some of the exploration of an audit log, the mystery of how did this happen?
- 19:09Let me dig through and problem solve is going away.
- 19:12And I've watched some other people talk about that's going to be a danger of the younger generation.
- 19:19I can still spot stuff because I've done that.
- 19:21How does somebody growing up now that's eight, nine, ten, AI isn't everything,
- 19:26are they going to be able to think as logically through problems and problem solve?
- 19:33Is it going to matter?
- 19:34Like, what is that going to do to the whole, even the brain development of younger generations?
- 19:42Absolutely.
- 19:42And I think the pendulum is still swinging.
- 19:44We don't know where the line should be where you know the human must be in the decision-making process.
- 19:52When you know where that point is, then you'll know that, yes, you still need those diagnostic skills
- 19:58that would let you spend hours writing a PowerShell script or going through an audit log to do forensic work.
- 20:03That still has to be there because right now, AI is just creating velocity in our work.
- 20:09And things at high speed will not always have the same quality.
- 20:14And I hesitated there and I corrected myself because knowing that it's going to be based on a large corpus of reference material
- 20:21as it's doing these things.
- 20:22But when we loop all the way back to what you did prior to generative AI coming out,
- 20:27your experiences may not be representative in that learning base.
- 20:31Your customers may want Ben J and Norm and not vendor of choice you're using for AI.
- 20:37Right.
- 20:38And I didn't ask these questions to go down like this.
- 20:40Existential crisis.
- 20:41Exactly.
- 20:42Philosophical.
- 20:43This is very much a philosophical IT discussion.
- 20:47It is.
- 20:47No, it's wonderful.
- 20:48Because we must concede that we are all pro-technology being at an event like this in Branson, Missouri,
- 20:55advocating for technology and how it can help.
- 20:58But at the same time, realizing that it's still early days.
- 21:01Oh, yeah.
- 21:02No one is an expert.
- 21:03Some people just have a little more experience than others.
- 21:05And we're still trying to figure out like, what does this look like for the next generation
- 21:09to your point?
- 21:10And are we going to be able to read an audit log anymore?
- 21:13Will audit logs not exist?
- 21:14And I don't believe that's the case.
- 21:16I think it's going to be right-sized at some point when it's just like too many mistakes
- 21:19are going to be made because the models are just, the human in the loop is being too lazy
- 21:23or something like that.
- 21:24But I don't feel like my job's in jeopardy.
- 21:27It's only in jeopardy if I don't adapt to this new tool set.
- 21:29So I love that you brought up the analogy, Jay, of the quarter to the payphone,
- 21:33to moving to the pager world, to the cell phone world, and so on.
- 21:36This is where we are.
- 21:37It's just a new tool.
- 21:37I have a buddy of mine who is an Amazon fulfillment center operations manager.
- 21:46He manages the 6,000 person fulfillment center that loads the trucks to be able to go out
- 21:53and do deliveries.
- 21:55And he also is a local political leader in his community.
- 22:01And the conversation I have had with him is really unexpected to me.
- 22:04I'm a knowledge worker.
- 22:06It's where I live.
- 22:07He said, the fulfillment center they're building three towns over is bigger than mine.
- 22:11And because of technological enhancements, it will only have 1,000 people.
- 22:16And he goes, and if you think about that, where do the other 5,000 people go when that job
- 22:22is automated?
- 22:22Because these are not all people who can go just skill up.
- 22:26They're not all people who have, they don't necessarily speak the local language very well.
- 22:31They may have had skills when they came to the country, but have not worked those skills
- 22:37in a long time.
- 22:38They can't all go become mechanics or they can't all go work construction or in a kitchen because
- 22:44eventually those industries don't need more people.
- 22:47That's right.
- 22:48And so that's a big part of the philosophical side of this discussion.
- 22:52is how are we supporting the community?
- 22:54Because I've always said to my customers, yes, AI may replace your specific job, but it's
- 23:02up to your company and you to make sure you're staying ahead and that you are learning new
- 23:07things and that you are putting yourself in a position to take a new or enhanced role.
- 23:12So AI doesn't replace you.
- 23:14It helps you go somewhere new.
- 23:16And his response to that was, that's great, but what does the cleaning person at my facility
- 23:22go do?
- 23:22What is the person who literally stands in front of a conveyor belt and checks a box?
- 23:27That's right.
- 23:27Like, that's not something I can just quick skill up.
- 23:30And I don't have an answer for that.
- 23:32Neither do I.
- 23:33And I bet if you talk to people and their guard comes down a bit and ask them, are you having
- 23:39like an identity crisis with all of these effects of generative AI and how they're affecting
- 23:43your current job?
- 23:44Like even in my own space, like I like to focus on power platform and I can see a time when
- 23:49some of these apps and services, you're probably not going to need someone to do it.
- 23:52You just say what the outcome is going to be and the rest just kind of takes care of itself.
- 23:57Yep.
- 23:57So do I continue to invest or do I embrace generative AI?
- 24:01Do I start?
- 24:02Like, how do you?
- 24:02I heard your big sigh.
- 24:03So I looked at you.
- 24:04Oh.
- 24:05Did you not have a big sigh?
- 24:06I don't know that I had a big sigh.
- 24:08Are you having an identity crisis?
- 24:09Or I did.
- 24:10I am having an identity.
- 24:11I feel like there are certain days I absolutely feel like I'm having an identity crisis of where,
- 24:17again, going to, I feel like some of the fun things of what I used to do are disappearing.
- 24:22I'm not experiencing that problem, but I can totally see that it exists.
- 24:26And I love building skills.
- 24:27Like, I will not lie.
- 24:28I have had a ton of fun building skills for Claude to go analyze audit logs, to do in-tune
- 24:37security reviews, like coming up with prompts to say, go look at how this tenant is configured
- 24:43and figure out how you would compromise it based on current known vulnerabilities out
- 24:49there, based on attacks you're seeing.
- 24:51Like, building skills to go do some of that work that would literally take me hours or days
- 24:59to do is fun.
- 25:00Yeah.
- 25:01But I can only build so many skills and clients are not paying me right now to build skills.
- 25:08They're paying me for the outcomes.
- 25:09So it's, yeah, I have fun doing some things, but I'm losing the fun in other things.
- 25:14And the things I'm having fun doing are not as repeatable.
- 25:18Sure.
- 25:18As building PowerShell scripts or digging through audit logs or trying to find some error buried
- 25:25deep within a log somewhere.
- 25:28Yeah, that's fair.
- 25:29So you brought up tinkering with skills.
- 25:31Now I know Ben's building them when he can.
- 25:33If you're one of our fellow IT professionals out there and you were thinking that you're suffering
- 25:41from this impending identity crisis about what your previous work was like and trying to reconcile
- 25:46it to what it's looking like today and in the future, would you say like creating generative
- 25:51AI skills is probably like this, one of the safest first steps you can make to start future-proofing
- 25:57yourself?
- 25:57So for me, creating an AI generated skill is not more than documenting the process which
- 26:06I use to do something.
- 26:07It's not necessarily, and this is where things will get interesting, is every ounce of my
- 26:1325 plus year career is going into the definition of those skills because it's the process I use
- 26:21to do things.
- 26:22That's the J.
- 26:23That's the J factor.
- 26:25The kid coming out of college can't build that skill, can build a skill, can't build that
- 26:32skill.
- 26:33And so it is a really interesting time where the people with experience, if we can latch
- 26:42onto AI, this AI wave, we have the opportunity to make sure it's doing things really well.
- 26:49And then if we are actually concerned about that younger generation, we have a responsibility
- 26:57to share with them, how are we doing this?
- 27:00Because they have to see what it takes to be able to figure this out.
- 27:04And the response might be, well, by the time you retire, old man, AI is going to know what
- 27:10you know.
- 27:10And to a degree, that's not wrong.
- 27:13But as I like to tell my customers, AI does have the potential for infinite knowledge, but
- 27:18it has no concept of how to pull that knowledge together into a thought, into a process.
- 27:23It really doesn't.
- 27:25And so that's where this experience comes in.
- 27:27So yeah, youngster, you're right.
- 27:30AI will have lots of my knowledge, if not all of it.
- 27:33Maybe one day we'll figure out how to data dump my brain.
- 27:36But the things that connect that knowledge, that's stuff that it takes experience.
- 27:41So it's not a check yourself moment.
- 27:43It's a recognize that you as a person still matter because you as a person, that inference
- 27:50you bring to the table is something AI cannot do.
- 27:53The technology is not there yet.
- 27:55And I don't know when or if it will be there.
- 27:59So yeah, you matter.
- 28:01And you got to put an effort in to be able to then have the J or the Ben or the norm to
- 28:06put into the AI so it can do cool things.
- 28:09So that could bring about a whole nother conversation of, I'm also curious, do you think AI will continue
- 28:17to improve at this rate or do you think at some point in time will actually start regressing
- 28:22due to what you said, a lot of the AI that we have now, and I've heard this argument a few
- 28:28times now, is because the knowledge that was used to build AI is the J knowledge, the norm
- 28:35knowledge, the Ben knowledge, from blog posts we wrote, from videos that we created, all
- 28:41of this human thought created content.
- 28:45And Claude just came out and said they're starting to watermark their content now so that it can
- 28:51be identified.
- 28:52And this is a conversation Scott and I had is one thought behind that or one of the reasons
- 28:57they do that is if Anthropic trains its new models on content that Anthropic created, the
- 29:04models start regressing.
- 29:06So as, and I've seen stats about the amount of content online that is generated by AI, are
- 29:12we going to create so much AI generated content that is watermarked that AI is going
- 29:19to continue to improve models or it's going to start training models on what's available, which
- 29:32is AI created content, causing it to actually start regressing to the point where we're going
- 29:37to need humans to start creating real content again.
- 29:41Well, what a great question.
- 29:43And the way you frame it up, it does seem that we can expect a plateau of performance.
- 29:49It's going to have a bias based on its own generated content.
- 29:53And so maybe this becomes the new era, the transition point where human generated original
- 29:59content is going to be the most important factor.
- 30:02And it's less of just creating velocity and outcomes and more about making sure that the
- 30:07information that it's based on is still going to be relevant for today and the changes in
- 30:12technology.
- 30:13Sorry guys, I'm...
- 30:14It's okay.
- 30:15It's a heavy conversation.
- 30:16Yes.
- 30:18It is.
- 30:19It's fascinating.
- 30:20It's your point.
- 30:21It's so new.
- 30:22We don't know.
- 30:22Yeah.
- 30:23We don't know.
- 30:23We don't.
- 30:24I'm intrigued by the idea of the knowledge plateau.
- 30:27I'm intrigued by the idea of regression of the AI just starting to learn from itself.
- 30:32I don't know that...
- 30:34I don't necessarily think we'll go backwards so much as slow down a little bit.
- 30:40I think that a couple factors will cause that.
- 30:42One, the recognition of the content being its own generated content.
- 30:47As we start to see that, we'll start to see the patterns that come out of it.
- 30:51But I do think that regulatory controls may start to slow things down a little bit, at
- 30:55least for a little while.
- 30:57But also, we aren't going to stop generating our human content.
- 31:02We may generate much less.
- 31:04I don't see it ceasing.
- 31:06The trick is going to be separating the wheat from the chaff, the human content versus the
- 31:11AI content.
- 31:12And if companies like Claude are going to start putting watermarks on it, that's going to help
- 31:16us be able to do that.
- 31:17I can see the slowdown coming.
- 31:19I don't know about a full regret.
- 31:20I think we also might start seeing a slowdown with costs.
- 31:23We've talked about this already.
- 31:25The fewer costs and the amount of money people are spending on it.
- 31:28Yeah.
- 31:29Can that continue at its current pace?
- 31:32I mean, at this point, we're...
- 31:33I won't lie.
- 31:34My stock market investments have loved the pace of this.
- 31:38Oh, sure.
- 31:39Who hasn't?
- 31:40But it's...
- 31:40Waiting for that bubble to pop.
- 31:43I have definitely been interested in the conversation of whether or not this is a bubble or as
- 31:48we saw in the earlier 2000s and such, the late 90s.
- 31:53But yeah, Norm, I'd love your thoughts on this one.
- 31:57I don't play the stocks.
- 31:58I just know that these announcements can be very volatile to the actions on Wall Street.
- 32:05Every new announcement seems to be the next thing that everyone must have if they want
- 32:09to be on the generative AI frontier.
- 32:12I pause because I'm still thinking about the state that we're in today, what it looks like
- 32:18in two to three years from now.
- 32:20Yeah.
- 32:20Is it going to keep costing as much?
- 32:23I don't think so.
- 32:23I think that because there's going to be...
- 32:25There's possibly going to be this plateau regression.
- 32:29I don't know.
- 32:29But also in a plateau, maybe there's an optimization of that current knowledge base.
- 32:34That means it doesn't need the same compute.
- 32:36That means that it can be more distributable.
- 32:38It means that it's more trustworthy, more applicable to daily operations.
- 32:41And people actually know how to use it and aren't always going to the most expensive,
- 32:46the most complex option inside of those generative AI tools to always try and get the best when
- 32:51they don't need the best.
- 32:52Because I still don't know, am I using option one through option five when I'm using that
- 32:57model picker and whatever AI tool I'm using?
- 33:00I still don't know the difference.
- 33:01But conceivably, there's a time when that happens or it's obscured from the user.
- 33:06And there's another layer that is making that right decision for us in a consistent way,
- 33:11in as consistent as we can have in generative AI.
- 33:13And then all of a sudden, maybe things are more consistent.
- 33:17And as we get consistency with how people use AI, then the spend becomes more consistent,
- 33:22predictable.
- 33:23And it's not less of this thing where everyone's racing to save their business,
- 33:27improve their skills, become the next great thing, jump on the bubble if it were in a bubble.
- 33:31And it's just another tool in the toolbox.
- 33:33Yeah.
- 33:34I definitely think we're going to stop talking about AI soon as a capability where we're very close
- 33:41to everything having AI inside of it.
- 33:44Like every technology having AI as a significant portion of what it is.
- 33:48Part of it as a tool within that product.
- 33:51Yeah.
- 33:51So we'll stop selling AI is what I'm trying to say.
- 33:55And at that point, yeah, I think there's going to have to be an optimization for it.
- 33:59Because I'm a big believer that if you want to build something a certain way,
- 34:03you should have the ability to do so.
- 34:05And that's one of the things I love about AI Foundry.
- 34:07You have that full control.
- 34:08You can pick the model.
- 34:09You can pick the machine learning algorithm.
- 34:11You can do all of that stuff.
- 34:13But I'm a bigger believer that it should be abstracted from the user.
- 34:16And that's what I love about how Copilot works is it's on auto.
- 34:20It selects the right language model based on the way it thinks it should.
- 34:25And it's trying to optimize.
- 34:27Frankly, it's trying to optimize because I'm only charging you $30.
- 34:30Hey, Hat.
- 34:31I'm only charging you $30 a month to use this tool, whether it costs you $1 or $50.
- 34:36And so it's in our best interest to build the facilitator to figure out what is the best tool for it.
- 34:43And if you're a power user, if you have a preference, go ahead.
- 34:45Select you want to think deeper or select Claude 5.1, whatever.
- 34:50I think we're going to stop talking about AI as a capability and we're just going to keep talking about the business that we're trying to run.
- 34:57I would not mind that.
- 34:59I am ready to get done with every announcement.
- 35:03And not just from Microsoft.
- 35:04I think this is across the board.
- 35:05Every announcement being, AI can now do this.
- 35:08AI can now do that.
- 35:09I'm ready to get back to, here's new features.
- 35:13Yeah.
- 35:13And to your point, AI just becomes a natural part of it.
- 35:18Yeah.
- 35:18It's a natural component or a natural feature.
- 35:21I think kind of like identity.
- 35:23Identity is a natural feature, a natural component of just about any solution.
- 35:27Yeah.
- 35:27AI gets to that point and we start getting back to what are tools we can build, what are features we can build for the business.
- 35:35How can we improve SharePoint where it's not adding AI to another aspect of it?
- 35:40How can we improve the power platform without AI being the thing to build my latest flow or power app or all of that?
- 35:47But what are some of those, getting back to what are the features we can build to make these products better for the business that it's not a focus on AI.
- 35:55AI is just there.
- 35:56Yeah.
- 35:57That's right.
- 35:57All of this should just be an enabler of an outcome, usually a business outcome.
- 36:02Yeah.
- 36:02The real person signing the checks, like the CIO, they don't care what feature's there.
- 36:07They want the outcome.
- 36:08Yes.
- 36:09100%.
- 36:09We do.
- 36:10Our trusted advisors at companies like Microsoft, they care about the features, but we just want outcomes.
- 36:15Or the business users really just want outcomes.
- 36:18And having a, the more abstracted the features are, the better it is for them.
- 36:21Yep.
- 36:22Yep.
- 36:22Absolutely.
- 36:23Wow.
- 36:23We went deep, boys.
- 36:24Yeah, we did.
- 36:25And Jay needs another drink.
- 36:27And Jay's all choked up about it.
- 36:28Yeah, Jay is all choked up.
- 36:29I think Jay probably needs to take a break here.
- 36:32Yes.
- 36:32Norm, we should have you on again tomorrow.
- 36:34What a pleasure.
- 36:37All right, boys.
- 36:38My brain's going to have to go recover before we have Norm out again.
- 36:41Yeah.
- 36:42That was...
- 36:43Too deep?
- 36:43No, it was beautiful.
- 36:44It was a great conversation.
- 36:45It was not too deep.
- 36:46It was refreshingly deep.
- 36:48Yeah.
- 36:48Yeah.
- 36:49If there were still an audience here, I'm sure they would cheer loudly for us.
- 36:52Oh, I'm sure we'll get at least one like and subscribe.
- 36:54Yeah.
- 36:54I mean, actually, we need to start saying that.
- 36:57I forgot about that.
- 36:58Oh, yeah.
- 36:58Like, don't forget to like and subscribe.
- 37:00If we start saying that, I might mute your mic because...
- 37:03You don't want me to like things?
- 37:04I would love people to like and subscribe.
- 37:06I am so tired of hearing that in every single YouTube video that I watch.
- 37:11Because, frankly, even for the podcast, I do it because I want to do it,
- 37:14not because I want another like and subscribe.
- 37:16All right.
- 37:16Well, don't like and subscribe.
- 37:17Go tell your friends how amazing this was and catch us up tomorrow.
- 37:21Yes.
- 37:21Thank you both.
- 37:23Later, y'all.
- 37:25If you enjoyed the podcast, go leave us a five-star rating in iTunes.
- 37:29It helps to get the word out so more IT pros can learn about Office 365 and Azure.
- 37:35If you have any questions you want us to address on the show or feedback about the show,
- 37:40feel free to reach out via our website, Twitter, or Facebook.
- 37:44Thanks again for listening and have a great day.