Latest / Microsoft Cloud IT Pro Podcast / Episode 345 – Microsoft 365 Backup and Microsoft 365 Archive
Transcript
- 0:03Welcome to episode 345 of the Microsoft Cloud IT Pro
- 0:07Podcast recorded live on August 1st, 2023.
- 0:11This is a show about Microsoft 365 and Asher from the perspective of it pros and
- 0:16end users where we discuss a topic or recent news and how it relates to you.
- 0:21We are back this week with some more updates from Inspire as we discuss
- 0:26Microsoft 365 backup and Microsoft 365 archive.
- 0:30Hopefully both services coming to a Microsoft 365 tenant near you later
- 0:35this year.
- 0:36We also spend a little more time discussing Microsoft 365 co-pilot
- 0:40licensing. Now that we've had a little more time to noodle on it,
- 0:46everything's recording and we're ready to go and nobody's here to celebrate with
- 0:49us. And.
- 0:49You're recording an O B SS and your pro caster.
- 0:52And my pro caster. Okay. But my screen caster, whatever this my,
- 0:58my stream deck buttons are broken. I think my add-in crashed ,
- 1:02my MIDI stuff is not showing up on my stream deck today.
- 1:04Ah, that's all right. I broke home assistant earlier today.
- 1:07That was interesting.
- 1:08Did you update it or did you just randomly decide to break it? No.
- 1:12I updated it.
- 1:13I decided to do some new stuff with some helpers and some groups and things
- 1:18like that. And you know,
- 1:20ya ML'S hard and it doesn't always validate the YAML the right way.
- 1:23and then tries to load plugins that don't exist and you haven't backed
- 1:26up your YAML configuration and blah blah blah. You know,
- 1:29like you gotta have backups so that you can restore from your backups to make
- 1:33life easier.
- 1:34I have a video here that I have not gone and watched,
- 1:39but it is all about,
- 1:43it's share your home assistant configs on GitHub automatically.
- 1:46But if you set it up with like a private repo essentially you can back up
- 1:51your home assistant stuff to GitHub
- 1:55automatically. Maybe you should go do that.
- 1:58Maybe it's gotta be like minimal effort though.
- 2:01at this point it's easier for me just to like log into the NASS or S S H
- 2:06it and and play around with uh, just you know,
- 2:08VI or something like that and try and bang my head.
- 2:11How do you save a file again? Oh yeah.
- 2:13Escape bang q oh no .
- 2:18Something like that. Uh.
- 2:20It's the thing I tell you. Any who Anyw who I tried to lead you into it,
- 2:23backup spend backups. It's important to have backups so that you can restore,
- 2:27restore.
- 2:27From. That's backup. Backup backups. So you know what I do today?
- 2:30I completely missed that. That's what happens when we record on a Tuesday.
- 2:34That's the first of the month and I've got invoicing and end of the month stuff
- 2:38and beginning of the month stuff and all that on my mind.
- 2:41But backups is indeed a thing and up until
- 2:46now if you want it to back up, well not up until now,
- 2:50up until later this year,
- 2:52if you wanted to back up Microsoft 365,
- 2:56it was very much a third party
- 3:01effort product, what have you.
- 3:05And now as of inspire,
- 3:08welcome to Microsoft Inspire 2023 introducing Microsoft
- 3:12365 backup and Microsoft 365 archive.
- 3:18Scott,
- 3:18we have some new options here for not only backing up data in
- 3:23Microsoft 365 but you know that expensive SharePoint storage.
- 3:28We talk so frequently about when people do things like try to migrate file
- 3:32shares into SharePoint and try to pull all of their data because
- 3:37data retention just isn't necessarily a thing. Yeah.
- 3:41Now we are going to eventually,
- 3:44hopefully 'cause there's not really pricing on this,
- 3:47but have a new Microsoft 365 backup service
- 3:52providing recovery of OneDrive,
- 3:55SharePoint and exchange at unprecedented speeds
- 4:00for large volumes of data with a restore service level agreement while keeping
- 4:04it all within Microsoft 365. So backup SharePoint sites, OneDrive accounts,
- 4:08exchange mailboxes, restore, said things, search and filter.
- 4:13Scott, do you know why they can achieve unprecedented speeds?
- 4:16because they don't have to rely on the a P I that all the third parties
- 4:19do.
- 4:20Yes and no I, I don't know.
- 4:22I mean they may, I don't know what they're doing but .
- 4:25So if you go back and you watch the Inspire session for this one, uh,
- 4:30they do call out that backup partners
- 4:35have access to the same set of APIs.
- 4:39But typically what happens when you're using a Microsoft 365
- 4:44or O 365 backup provider is they are backing
- 4:49up your contents someplace else. Like yeah it could be in Azure,
- 4:53it could be in a w s could be in a data center someplace, but it's going.
- 4:57Out. It's not like.
- 4:58To someone else's premises. Yeah. Which could give you warm fuzzies, right?
- 5:03There's the whole like rule of three with backups, you know like right,
- 5:07you know, I should have one here,
- 5:08I should have one over there and I should have one offsite.
- 5:11And that generally like works out okay. So if,
- 5:15if I was a backup vendor,
- 5:17I don't know that I'm like sitting here and shaking my boots and going like ooh,
- 5:20I have no value that I can offer to customers because there's tons of value in
- 5:25just saying like I've egress your data out of Microsoft's data centers or
- 5:30I've egress it out of that tenant so that it potentially does exist in
- 5:35another place elsewhere. And,
- 5:37and there could be value there for some segment of customers but for those who
- 5:41are like all in the ecosystem, you know,
- 5:43this is something I think customers have been asking for for a long time.
- 5:47Like it's been a space that's been traditionally filled by partners and ISVs and
- 5:51now Microsoft is kind of dipping their toe in the water and saying like,
- 5:55Hey let us have a go at this and,
- 5:58and I think it's good to see kind of cross categorical services in
- 6:03here. So things like SharePoint sites,
- 6:06your OneDrive for business accounts which are SharePoint sites.
- 6:10So good job Microsoft.
- 6:11Yeah like you keep calling any different things but they're the same thing.
- 6:14And then exchange mailboxes and kind of having one stop shopping to get out.
- 6:18All of that is good.
- 6:20The other good thing that comes along with this is a
- 6:24restoration time SS l a.
- 6:27So there's going to be a hard SS l a that you'll be able to measure Microsoft
- 6:31against when it comes to restoration times for these things.
- 6:36Which is something that can be a little bit iffy with some of the third party
- 6:40backup stuff.
- 6:41Like you just don't know like are they gonna be throttled by a given a p I
- 6:45surface, something like that. And you know it, it is what it is, right? Uh,
- 6:49but it can be detrimental. So I,
- 6:51I think in this case like if there was anything that was like secret sauce,
- 6:54it's like hey, Microsoft already already had your it's already store.
- 6:57Yeah Microsoft already had your primary data.
- 6:59They can kind of choose the best place to co-locate your backup
- 7:04data and also the best medium to store that backup data on to
- 7:09meet those restoration SLAs so they have in place and then they can
- 7:14just offer that to you as a service. Like you said ,
- 7:18no pricing yet to be announced. So we'll see where that one goes.
- 7:23I really wonder over time like just how much more money Microsoft can kind of
- 7:27squeeze out of existing customers since it seems like growth
- 7:32has plateaued a little bit in the surfaces. Like they,
- 7:34they grow but they're not growing by leaps and bounds.
- 7:37It's more incremental compared to what it used to be.
- 7:40Right? Yeah. I'm curious to see pricing.
- 7:42I use a third party right now to back up.
- 7:44So I back up teams SharePoint and that's the one thing that's not mentioned in
- 7:48here interestingly is teams but they are backing up exchange and a lot of
- 7:53conversations are there. So teams may be kind of sorta in here a little bit ish,
- 7:58but my third party,
- 7:59I'm 99% sure that mine goes out to a w s for
- 8:04a backup.
- 8:05Going back to your scenario of it's not necessarily in a
- 8:10Microsoft data center, it's out in a W s but it is slower. And to your point,
- 8:14if they had to restore and now I'm pulling out of a W s,
- 8:18I don't know what kind of speeds they have coming out of a W Ss how quick it is
- 8:22to write back in that type of stuff. To your point,
- 8:26it does say in here too that these partners can start leveraging,
- 8:31it sounds like this is going to be an update to the backup APIs,
- 8:35some changes to the backup APIs to achieve these
- 8:40speeds kind of across the board. 'cause it does say by leveraging these APIs,
- 8:44partner apps can deliver the same unprecedented backup and restore speeds.
- 8:49Again, it does kind of depend on to your point, where is it coming out of?
- 8:53Do they back it up to colo that they owned? Did they back it up to a w s,
- 8:57did they back it up to G C P and what is that speed that you can achieve going
- 9:02in and out of something like that versus in and out of a Microsoft data center.
- 9:06Yeah.
- 9:07Interesting times ahead. I think we'll see it.
- 9:09It'll be good to see how pricing falls out on this one.
- 9:14One other thing that they did offer here and it, it was kind of it,
- 9:19it was weird the way they were announced 'cause they,
- 9:21they kind of were both together in the same keynote and blog post.
- 9:25They also announced the Microsoft 365 archive service.
- 9:29Yeah. This one I'm actually more excited about than backup.
- 9:33Yeah like like this is good,
- 9:34this is effectively in place cold or cool,
- 9:38cool to coldish data storage for you.
- 9:41So as you have data that's becoming inactive,
- 9:45just like you might take an object in like a blob storage account and move it
- 9:49from hot to cool to cold to archive like as it extends its life and as you
- 9:54access it less frequently and you realize kind of the niceties that come along
- 9:58with the cost savings of saying hey this is infrequently accessed so let me move
- 10:01it to a cooler tier of storage kind of thing.
- 10:05You can do the same thing over in Microsoft 365 now or
- 10:10soon anyway soon co coming to a tenant near you in the second half of
- 10:142024 maybe. Yes. Depending on, depending on the functionality you need .
- 10:18Right? I was gonna say sort of and this one I think I'm more excited about.
- 10:22'cause again third parties, there's a lot of, there's backup options out there.
- 10:25Backup, restore, archive, we've talked about this before.
- 10:28Like SharePoint storage is not inexpensive especially when
- 10:33you compare it to something like Azure blob storage and even more so if you get
- 10:38into the cool and the cold storage, it's expensive.
- 10:41And I've run into this with clients of my own where I mean we're getting on what
- 10:45we're approaching 12 ish,
- 10:4713 years now where Office 365 and SharePoint online have been a thing.
- 10:52It's been a hot minute.
- 10:53Now. Yeah, I think there are some archive solutions out there.
- 10:56But really for the everyday customer, I think especially SMBs,
- 11:00I have some customers that are 25, 30 employees.
- 11:04They don't have a ton of SharePoint storage 'cause they're only have 30 licenses
- 11:08plus the one terabyte.
- 11:09I absolutely have customers buying additional SharePoint storage because
- 11:15they have data from 2011, 2012,
- 11:182013 that they wanna keep around.
- 11:21They don't wanna mess with do we just go download this outta SharePoint?
- 11:25We don't really want to go pay for a third party.
- 11:28This will be really nice where you can start hopefully along with like retention
- 11:33labels and purview and some of that and theory.
- 11:36This is kind of me crossing my fingers and hoping that you can like
- 11:41set off tiered type of archiving what's content hits a certain age.
- 11:46You have like group reviews now around deleting groups and that type of stuff
- 11:50that some of this archiving will come into play there.
- 11:53And you'll be able to more cheaply store older
- 11:58content in a place that it could be restored to SharePoint.
- 12:03And some of the other things they say is you still maintain like the admin level
- 12:06search when you start doing e-discovery cases,
- 12:10it'll still remain some of the sensitivity labels,
- 12:13D L P access control settings.
- 12:16You keep all of that other functionality while still being able to archive these
- 12:21off. Like you said,
- 12:22site level archiving it sounds like is gonna be maybe close to when
- 12:28backup comes out.
- 12:29They say the initial re release of Microsoft 365 arch Archive provides
- 12:34site level archiving.
- 12:35File level archiving will be available next year.
- 12:40And then in another part they say file level archiving will be in the second
- 12:44half of 2024. So 12 ish months.
- 12:48The backup public preview will be Q four of 2023.
- 12:53So hopefully in the next three or four months here. So.
- 12:56Yeah, it's uh,
- 12:57the wording kind of throws me off in this one and it's probably because we just
- 13:01launched a new tier of storage called cold And for us,
- 13:05like in blob storage cold is an online tier and this really
- 13:10sounds like an archive, like an almost like an offline ish kind of thing.
- 13:15Like inaccessible to you and and your users and day-to-day kinds of things.
- 13:20But once the indices are populated for things like D L P content search,
- 13:24all that, like great, they maintain those indices.
- 13:27So you can continue to search, find that data potentially rehydrated if needed.
- 13:32This will be another one of those like it'll be interesting to see what
- 13:36reactivation looks like.
- 13:38Like is it truly like an offline storage medium?
- 13:42Is it something that takes like hours to restore a site?
- 13:46Like is it quicker to back up your site and then delete it and then just
- 13:51retain the backup and restore the backup with that unprecedented speed or,
- 13:55and you'll miss that on the indices and things like that for content search.
- 13:58But like maybe that's okay or is it easier for you to do
- 14:03archive and send things down that path. So I don't know.
- 14:08And another interesting thing about these,
- 14:10I I don't know if you kind of caught this one.
- 14:14So both of these newer service announcements,
- 14:18so Microsoft 365 backup and Microsoft 365 archive.
- 14:23They're under the syntax branding and under syntax management,
- 14:28which I thought was kind of interesting.
- 14:31Like you go and you look for these things and the way you actually land is like,
- 14:36you know,
- 14:36if you're on like the Microsoft adoption site like adoption@microsoft.com,
- 14:40you're on Microsoft dot uh adoption at microsoft.com/syntex and
- 14:45it's totally part of that hierarchy,
- 14:47which is different . Yeah.
- 14:51I don't know how it ended up under the syntax banner but you know.
- 14:54I don't know either.
- 14:55I have some theories 'cause it's also interesting that in
- 15:00the announcement itself, like it talked,
- 15:04it doesn't mention syntax and the title,
- 15:06it's all Microsoft 365 backup archive.
- 15:10But then it says like Microsoft syntax announced last fall AI
- 15:15stuff,
- 15:16recent syntax innovations are O C R at content assembly and plugins for
- 15:21co-pilot volume grows. And then it talks about backup an archive.
- 15:25But I don't think it mentions syntax anywhere else except when you
- 15:30start getting under the partner stuff.
- 15:32Now here's my theory around this is I also
- 15:37believe, and I'm looking for it to pull it up now,
- 15:42licensing for Syntex, that's what I was looking for.
- 15:46Microsoft Syntax is an add-on Microsoft per user
- 15:51licenses as of July 1st, 2023 are no longer available for purchase.
- 15:55But you'll need to set up pay as you go billing.
- 15:58This is the only service I know of
- 16:03that's pay as you go other than there's some Dataverse stuff now in
- 16:08the power platform.
- 16:10But I think Microsoft 365 syntex is the only pay as you go
- 16:14licensing infrastructure thing. And I'm wondering if that's part of it.
- 16:19If by rolling it under Syntex,
- 16:21maybe they're gonna take advantage of pay as you go and you're gonna get pay as
- 16:26you go pricing for archiving and backup versus buying like SharePoint
- 16:30online, you, it's not really pay as you go, right?
- 16:33You buy it per gigabyte per month.
- 16:36If they can structure this where based on how much content you pay based on
- 16:41backup content and archived content, maybe there's just some billing,
- 16:47I don't,
- 16:47I don't know if you'd call it billing infrastructure or billing constructs that
- 16:52are there for syntax.
- 16:53And by rolling it under there they can take advantage of that. Your.
- 16:55Guess is as good as mine.
- 16:59We shall see. That's just some wild speculations based on that recent change.
- 17:03And I kind of missed that, that as of July 20,
- 17:07July 1st, 2023,
- 17:09that they pulled the per user licenses from syntax that it is only
- 17:14pay-as-you-go now for syntax. Yeah.
- 17:16I think the other thing too is, you know,
- 17:19there's segment of customers who probably looks at things like this and says
- 17:23like, Ooh, great, you've got APIs and you can build this service yourself.
- 17:27And you're saying you're working with all these partners,
- 17:29like what can I just go sling myself?
- 17:31Like maybe I need like my ideal minimal backup product is different than
- 17:36what's offered by Microsoft.
- 17:38And it looks like these APIs like 'cause they are locked behind syntax
- 17:43and you've got different ones for backup and archive.
- 17:47They're going to be kind of either Microsoft first or
- 17:52partner driven. So they do go into detail like,
- 17:55hey inspire's a partner event first of all.
- 17:57So you gotta like keep that in mind too. But they go into, hey,
- 18:00here's how to join our content AI program. Microsoft, you know,
- 18:05tends to see a lot of value derived from partners.
- 18:09And partners can certainly grow healthy businesses on top of Microsoft services.
- 18:13Like that's all kind of proven out. So you know, like there,
- 18:16there's a path potentially to go down and join something like the content AI
- 18:20partner program.
- 18:21The reality is like all the regular folks who you think of at least in the
- 18:25backup and archive space, so Veeam, Commvault, AV Point,
- 18:29Barracuda, Rubrik, you know,
- 18:31they're all ready all in there and ready to go. Yep.
- 18:35Like I would anticipate, I don't know if they'll have it for public preview,
- 18:38but as soon as this hits general availability sounds like a lot of these
- 18:43partners will have something in place or be really close to having
- 18:47something in place. And to your point,
- 18:49it's not like small partners that are doing this.
- 18:54These are well-known partners in that backup space.
- 18:57We'll see where it all lands out. But uh, but I'm looking forward to it.
- 19:01I I wonder how Microsoft can be competitive. Like most of the,
- 19:06back to the pricing thing,
- 19:07like most of the partners are gonna be a couple bucks per user per month
- 19:10depending on workloads and what's backed up.
- 19:12And I don't imagine many of them changing their pricing meaningfully unless they
- 19:16like really need to because the a p i pricing is atrocious in some way,
- 19:21shape or form.
- 19:22Like everybody see Reddit and the crap they pulled this year , you know,
- 19:26like, like that's a possibility. Yeah.
- 19:28But we'll see where it all fans out more to come in 2024.
- 19:33Do you think Microsoft will be able to take advantage,
- 19:36like going back to pricing of this,
- 19:38that a lot of partners do per user that Microsoft will do back
- 19:43to the pay as you go, like per gigabyte of backup and they don't,
- 19:47they won't care how many users are there. I.
- 19:49Don't know. I don't know. It seems easier to be in the per user,
- 19:52per month model and just let it ride that way because that's the way the rest of
- 19:56your tenant is purchased and set up at this point with, you know,
- 20:00just a couple of side services, like additional SharePoint space,
- 20:03things like that per user per month is something easy. Customers rock it,
- 20:07they get it. If the value's there, the value's there and you'll pay for it.
- 20:11Like copilot. .
- 20:12Like copilot. Yes.
- 20:18Do you feel overwhelmed by trying to manage your Office 365 environment?
- 20:22Are you facing unexpected issues that disrupt your company's productivity?
- 20:26Intelligent is here to help much like you take your car to the mechanic that has
- 20:30specialized knowledge on how to best keep your car running Intelligent helps you
- 20:34with your Microsoft Cloud environment because that's their expertise.
- 20:38Intelligent keeps up with the latest updates in the Microsoft cloud to help keep
- 20:42your business running smoothly and ahead of the curve.
- 20:44Whether you are a small organization with just just a few users up to an
- 20:48organization of several thousand employees,
- 20:50they want to partner with you to implement and administer your Microsoft Cloud
- 20:55technology. Visit them at intelligent.com/podcast.
- 21:00That's I N T E L L I
- 21:04k.com/podcast for more information or to schedule a 30
- 21:09minute call to get started with them today.
- 21:12Remember intelligent focuses on the Microsoft cloud so you can focus on your
- 21:16business. I did it Scott. I brought it up. Uh.
- 21:21Well yeah, I don't understand co-pilot pricing. Sorry, I just, okay. I don't,
- 21:26I don't get it. It doesn't make any sense to me.
- 21:27Okay. In that case, moving on. I actually don't either. I don't know,
- 21:32do you really wanna talk about that or do you wanna talk about other news?
- 21:34We can mention like you and I have been going back and about back and forth
- 21:37about it briefly. So like for me there's a ton of value in
- 21:43some of these co-pilots.
- 21:44Like I use GitHub co-pilot every single day just about,
- 21:49so for the per user per month price of GitHub co-pilot, you know,
- 21:53if you consider my salary and other things like it's a no brainer to spend a
- 21:57couple hundred bucks a year and get somebody a co-pilot to go ahead
- 22:02and help them do their job. Like if that's the way it comes in.
- 22:06If it's an employee who's paid a hundred thousand per year and they can get
- 22:11a 20% increase in productivity from a co-pilot,
- 22:15like would it be worth spending 20 k a year, you know,
- 22:19per user to get that benefit? Like if you could consistently get it,
- 22:24I bet there would be some organizations that would pay for it, but you know,
- 22:27it's still only like 10 20% of you know,
- 22:31that person's total cost to you, whatever it happens to be.
- 22:34The thing that I keep coming back to with the Office 365 and M
- 22:39365 copilot pricing is the additive cost
- 22:44on top of an E five.
- 22:46So if you're just looking at retail pricing in the,
- 22:51in the us so an Office 365 E five is what?
- 22:5537 30 $8? Like it's not too bad. It's reasonable office.
- 22:59Yes. Office not Microsoft. Yeah.
- 23:01Great. So, so it comes with everything you need, right?
- 23:03It comes with SharePoint and OneDrive for business and you get
- 23:09Exchange and Outlook and all the desktop apps and,
- 23:12and all the things you throw copilot on top of that. Like,
- 23:17sorry, but $30 per user per month,
- 23:20that's 79% of the cost of my base license.
- 23:23Like is it worth 79% of my cost to go and license a
- 23:28copilot for somebody? Like, I don't know, like that feels like a lot to me.
- 23:32And then even if you go up to the Microsoft 365 E five,
- 23:36which is 57 per user per month,
- 23:39you are still greater than 50%.
- 23:42You're like 52, 50 3% of the cost.
- 23:45It's just like an insane number for me to wrap my head around.
- 23:47Like I keep wondering like,
- 23:49am I gonna get 53% of the value out of that thing?
- 23:53Like I have to be using it not just every day.
- 23:56I have to be using it all the time. and I, like,
- 24:00I've really gotta be leaning into it heavily.
- 24:03And I don't know that's the part that I'm really having trouble like
- 24:07rationalizing, like I keep putting on like my finance hat and like, okay great,
- 24:11I've gotta go explain to my leadership like why this is valuable,
- 24:14why we should get it.
- 24:14Like here's all like the whizzbang things and sometimes like they make it easy,
- 24:18right? Like I,
- 24:19I could make a huge argument for backup kind of regardless of the cost 'cause
- 24:23it's an important thing. Are copilots important? I don't know.
- 24:27And then like,
- 24:29is the value there like D B D I really gotta see it and it's gotta be one of
- 24:33those like just magical experiences.
- 24:35Like it's gotta be way better than like demoware, vaporware,
- 24:39like whatever we've seen so far. Like if,
- 24:42if that's the experience that Microsoft wants us to have,
- 24:44like that better be the experience and then some, and then maybe it's worth it.
- 24:49I think that's going to be the big selling point.
- 24:53'cause to your point playing a little bit of,
- 24:58I guess maybe the devil's advocate here is Microsoft 365, E three, E five.
- 25:03It is a lot compared to those for what you get. Like you said, I mean E fives,
- 25:08you're getting power bi, you get audio conferencing,
- 25:11you get SharePoint exchange teams, you get all the security features,
- 25:14you get all the extra logging.
- 25:16There's a lot of stuff in an E five and for this to be an
- 25:20additional 30 on top of it. Do you get that?
- 25:23Now I also get what I th this is the way I think Microsoft is gonna try
- 25:28to sell it and looking at some of the demos,
- 25:31like you go into a Word document and they do it in a loop component and
- 25:36they say draft a proposal for this company based on this template.
- 25:41And it goes in and fills out that entire document.
- 25:46That entire draft proposal puts in company information based on meeting notes,
- 25:51puts stuff in the right place in the template if that actually works.
- 25:55I mean maybe $360 a year at 30 bucks a
- 26:00month. I mean let's say you're paying someone,
- 26:04the hard part is this is gonna affect admins.
- 26:06Let's say I'm paying an admin 15 bucks an hour,
- 26:09maybe they're a really good admin and I'm paying them 30 bucks an hour and
- 26:13they're drafting 20 proposals a month for me.
- 26:16And now they can draft 60 proposals or 80 proposals
- 26:21and save themselves five or six days worth of time.
- 26:26I think that's the angle you take,
- 26:28but it still feels very expensive compared to
- 26:33what you're paying now for your licensing.
- 26:35And I don't know how easy that is necessarily to rationalize,
- 26:40okay, they're saving that much time,
- 26:42but are they actually actually getting more stuff done?
- 26:44Like what is that extra time now being filled with?
- 26:47Is it actually being filled with productive stuff or I don't know,
- 26:52I am, I'm still with you. It feels like a lot for what you're gonna get.
- 26:57You have to like, these are still large language models.
- 27:00Like they're not magic. They're.
- 27:02Not gonna be perfect outta the box.
- 27:04It's computer science and it feels magical,
- 27:07but it's not like you still gotta go do your research,
- 27:10you gotta finish things up.
- 27:11Like would I love it if I could have like copilot write all my,
- 27:15like PRDs for me, like, like my, my product requirement documents.
- 27:19Like absolutely.
- 27:20But the reality is like I'm still gonna have to go check all that stuff.
- 27:25I'm gonna have to rewrite it anyway and put it in my voice so it doesn't seem
- 27:30like an AI came out of it. So I like sometimes is this like,
- 27:34it's just like I just go do it myself, , it'd be easier.
- 27:38That's like that. That's okay. So yeah, I, I don't know.
- 27:42We'll see. I really wanna get hands on with to,
- 27:45I think that's gonna be a big thing to, to figure it out.
- 27:47Like I need to have that just like mind blown moment
- 27:52for hey,
- 27:53this is how it works and it all comes together and because it has
- 27:58crawled and has access to and predefined meta,
- 28:02meta prompts around all of the data in my tenancy,
- 28:05like that's great, right? Like all security trimmed, all those things.
- 28:09Like we'll see what it can do.
- 28:12And maybe that's where the magic of some things like even like, like being chat,
- 28:15like g PT four with plugins and things like that.
- 28:18Like you and I have both been playing around with like open AI and just token
- 28:21usage and like pay as you go and things like that. Like it's okay,
- 28:25it has a tendency to hallucinate and give it disinformation a whole bunch.
- 28:30And,
- 28:31and that's just because of the corpus of data that it's built on top of which I,
- 28:35I I get.
- 28:36So we'll see how it goes when it can respond back
- 28:41with your data, right?
- 28:42Like does it bring you like that true tribal knowledge of like, hey,
- 28:46here's the culture of your business and here's the process and how things are
- 28:51documented and we can kind of give that back to you in a consistent way.
- 28:54Like if, if that's what happens, I'm all in, right? Like I like.
- 28:58Is it gonna have the data though to learn like I look at my tenant,
- 29:03do I truly have enough data in my tenant going back on the other side of it,
- 29:07I can argue both sides of this pretty effectively, Scott,
- 29:10is it gonna have enough data in my tenant to actually learn anything from my
- 29:13tenant?
- 29:13Because large language models relies on quantities of data
- 29:19to actually understand it. And I guess I've even looked at it from the podcast,
- 29:23like you said, we've been playing with some of the a p I stuff,
- 29:25the tokens and doing that.
- 29:28I actually take a transcript of our podcast and I take the whole audio
- 29:33from the whole 30, 45 minutes or whatever,
- 29:36feed it into G P T 3.5,
- 29:40turbo 16 K. 'cause I need that much space to fit that much text in .
- 29:45I haven't tried it with G P T four yet. 'cause I can't get,
- 29:48I don't have access to G P T four anywhere either in open AI or
- 29:53in Azure. And I like ask it to summarize our entire transcript.
- 29:57And to your point, I look at it and I'm like, eh, it's okay,
- 30:02but I absolutely have to go fix stuff.
- 30:04There was one of ours I did recently and I was like, uh,
- 30:07that's just flat out wrong.
- 30:08Like I know where it pulled the different bits of information from
- 30:13in the context of the podcast,
- 30:16but the way it summarized the bits of information it pulled together was just
- 30:21wrong. And everything we talk about on the podcast is out there on the internet.
- 30:26I don't know what they use to train it, but all the Microsoft services,
- 30:28all of that,
- 30:29you would think it would be able to understand the podcast a lot
- 30:34better in the topics we covered and not hallucinate about
- 30:39the flow of our conversation or the summary of those topics.
- 30:43Then I go back to thinking about, well my tenant,
- 30:46I have very minimal information in it compared to what they've trained these
- 30:50with already.
- 30:52Is it going to be that intelligent or will it be able to take what it's
- 30:57learned from other data and kind of mash it all together?
- 30:59But then how accurate is it'll be like you said,
- 31:02I really need to see it.
- 31:03It's tough. I think you,
- 31:03you need to like take a step back and kind of disambiguate like the models
- 31:08themselves and then the capabilities of the systems that
- 31:13like actually tie it all together.
- 31:15So Microsoft 365 copilot will not be trained on your
- 31:20data. Like they're, they're already trained models. Like they're out there,
- 31:25they're ready to go.
- 31:27What it does is by having access to your data,
- 31:31you're able to give the prompts context. So just like you're doing,
- 31:36generating the transcription for the podcast and then putting it in like
- 31:41the AI model like G P T three five in that case that you've used mm-hmm.
- 31:45, like it doesn't know your podcast from like a fart in the wind.
- 31:49Like it just doesn't, right? Like the,
- 31:51but it has context and you've provided it the context and then
- 31:56it has all of the training that it had on whatever corpus it was built on.
- 32:01So it kind of mashes those things two things together and spits it out the other
- 32:04side. So that's what I'm saying, like these things need to be fricking magical,
- 32:09right? like, like when, like when they come out to get it.
- 32:12'cause if all of a sudden you crank it out and you turn it on and you go like,
- 32:15oh wow,
- 32:15this thing is just a bunch of gibberish or
- 32:20disinformation because your business maybe doesn't have the right context
- 32:25in it, right?
- 32:26Like you like the context of say like the way your documents are written,
- 32:30maybe it doesn't mash with, you know, that large language model,
- 32:33which is really what's happening.
- 32:35Like when you're pumping in that transcript and you're saying,
- 32:37summarize this for me, it's taking a look and it's saying like, okay great,
- 32:40you gave me some context,
- 32:41but it turns out I really don't know much about any of this stuff.
- 32:44So here you go, here's a response back. And then, you know, you might,
- 32:47here's the best I can do and you might give an additional prompt and feed it
- 32:50through more and more and more like,
- 32:52so we'll have to see like there's a whole bunch, like I've,
- 32:56I've been trying to kind of play around and take some courses on the side on
- 33:00just prompt engineering to kind of figure some of that stuff out.
- 33:04And it's really interesting like the more time you spend with
- 33:09some of the large language models, like, you know,
- 33:11I really wanna go play with like llama two one now just announced with Meta and
- 33:16Microsoft as well just to kinda see like where it sits and,
- 33:19and where it compares. But like you,
- 33:21you run into this pretty consistent like formulaic thing, right? Of like,
- 33:24okay great, I need to provide a prompt.
- 33:27So the very first thing we need to do is set some context.
- 33:30We additionally need to set some tone.
- 33:33We also need to give some guidance around like desired outputs,
- 33:38right? Like what are my desired outcomes here?
- 33:41And once you've started going down that path,
- 33:44like some of these like prompt you know, mazes that you start going down,
- 33:48they get pretty complex and pretty involved.
- 33:51And if Microsoft has kind of solved some of that for the everyday person,
- 33:56like I'd be happy not to have to do those things every single time.
- 33:59Like , I, I'm kind of over having to type in like, hey, use this tone,
- 34:03pretend you're, you know, blah blah blah with this many years of experience,
- 34:06right? You know,
- 34:07give your answer in this particular framework or this particular format.
- 34:11Like if I didn't have to do that every time, like yeah,
- 34:14that'd be awesome , like that might actually save me. That'd nice.
- 34:16Save me a bunch of time back to like, hey, is it worth the money? Like maybe,
- 34:20so the magic sauce is gonna have to be in the meta prompts,
- 34:24the ability to kind of pull that information in and provide enough context to
- 34:28you,
- 34:28the backend engine and then spit it out to us as users on
- 34:33the other side, which I'm all about, like I said, like I, I've seen, you know,
- 34:37from some of the demos things like, hey,
- 34:39just add a loop component and go ahead and, and like you said,
- 34:42like draft a response to this R F P based on our meeting notes from yesterday
- 34:46and you just pointed over to the OneNote where you went and you talked about
- 34:49that R F P and wrote down all your notes with your sales team and your product
- 34:52team and yeah. You know,
- 34:54and delivery and everybody who needed to be involved in that process.
- 34:57Like if it can do that, great , right? Uh, but.
- 35:02But do all my meeting notes have to be in the right format and like I know my
- 35:05meeting notes,
- 35:05sometimes I have to go back and retype them for me to even
- 35:10understand them, let alone for AI to understand what I talked about .
- 35:15But again, maybe if I go back and retype 'em,
- 35:17clean 'em up a little bit and then I can generate the R F P based on some
- 35:20cleaned up meeting notes. I don't know, uh.
- 35:23You know, there, there's always a chance.
- 35:24I think that's the initial, that's the initial feedback is your initial point.
- 35:28Like at 30 bucks a month,
- 35:30that's almost the same price as a Microsoft 365 E three,
- 35:35it's,
- 35:35there's nothing that even comes close to being that much of an increase
- 35:40on top of your bill that they've introduced. It just feels like a lot of money,
- 35:44especially if you're a big company that has 10,000 employees and all
- 35:49of a sudden now you're looking at spending $300,000 to
- 35:55at ai I to your tenant, uh.
- 35:57Yeah.
- 35:58A month, sorry, $300,000 a month. We'll see where.
- 36:01Three point where it falls out million,
- 36:02I think it's really gonna be worth it for some people.
- 36:04I think some people are gonna hop on the train and and potentially be
- 36:08disappointed early on just in some of the capabilities or lack thereof.
- 36:13I do worry that you kinda like you burn customer credit there .
- 36:18'cause you're gonna want them to come back and, and you know, for the most part,
- 36:21like once you're into a lot of these SaaS products,
- 36:24like it's not just Microsoft stuff.
- 36:25Like there's other sassy things that I pay for as well and like I'm very happy
- 36:29to do it because they bring me a bunch of value.
- 36:32But if that derived value isn't there upfront and like they lose you, like,
- 36:36I don't know, when do you come back? Like what do they do it when you back over?
- 36:39It's hard. It's, it's super hard, right? Once you've turned it out that way.
- 36:42So we'll see.
- 36:42It's the whole trust thing.
- 36:43It's a whole lot easier to lose trust than it is to gain it back.
- 36:47And I think that's some of this is once you lose trust in that co-pilot,
- 36:52can you get it back and hopefully it'll be good enough that no one will
- 36:55and I will absolutely be one of those that signs up for it as soon as I can get
- 36:58it and we'll test it out. But with that, Scott,
- 37:02I don't have a co-pilot telling me I have a meeting,
- 37:04but I have calendar announcements and appointments and alerts bleeping
- 37:09in my ear and telling me that I need to go to a meeting. Yeah.
- 37:13Yeah it is. Uh, it's one of those things that happens, huh?
- 37:17Yes. Now if I could, here's an now co-pilot.
- 37:19If I could send a co-pilot to the meeting and have the meeting for me and use my
- 37:23voice and use prompts for my other meetings to conduct the meeting for me
- 37:29and then deliver the notes to me, that might be worth paying for.
- 37:32Yeah, there you go. I don't know we'll, we'll see how that one, uh, uh,
- 37:37we'll see how that one pans out for you.
- 37:39Robot meeting Robot Ben, instead of the Gilfoyle bot.
- 37:44.
- 37:46Uh, there you go. Hopefully.
- 37:47Oh man. All right with that, Scott,
- 37:50I will let you go get back to catching up on email and I am going to go attend a
- 37:55meeting.
- 37:55All right, well thanks Ben, I appreciate it. All.
- 37:57Right, thanks Scott. Yep. We'll talk to you later this week. Yep.
- 38:02Bye-bye.
- 38:05If you enjoyed the podcast, go leave us a five star rating in iTunes.
- 38:09It helps to get the word out so more it pros can learn about Office 365 and
- 38:14Azure.
- 38:15If you have any questions you want us to address on the show or feedback about
- 38:19the show, feel free to reach out via our website, Twitter, or Facebook.
- 38:23Thanks again for listening and have a great day.