Latest / Microsoft Cloud IT Pro Podcast / Episode 340 – A little bit of DDoS in your life
Transcript
- 0:03Welcome to episode 340 of the Microsoft Cloud IT Pro Podcast.
- 0:08Recorded live on June 23rd, 2023.
- 0:11This is a show about Microsoft 365 and Azure from the perspective of it pros and
- 0:16end users. Where we discuss the topic or recent news and how it relates to you,
- 0:21Microsoft has released a response to the denial of service attack that occurred
- 0:25in early June against Azure and some details about how you can protect
- 0:30yourself against similar attacks.
- 0:32We also discuss some Terraform news with the June updates as well as a new
- 0:36module to manage Azure AD with Terraform. Finally,
- 0:40we wrap up talking about copilot as the release gets closer and Microsoft has
- 0:45released guidance around preparing your Microsoft 365 tenant for its release
- 0:50and adding it to your environment.
- 0:54I feel like we should talk about news,
- 0:55but I don't know that I really wanna talk about news.
- 0:58. Fair enough?
- 1:01Yeah. Okay, so I have one for you Scott. I forgot to send you this.
- 1:05This was on my list and I have to find it now.
- 1:08I think I sent it to you in a text message. Remember how, okay.
- 1:12A couple weeks ago,
- 1:15I think it was a couple weeks ago or a week ago,
- 1:18we talked about that outage in Azure
- 1:23and Microsoft kind of did everything in that news article to not say
- 1:27denial of service. They just talked about a spike in traffic. Mm-hmm.
- 1:31, I do remember that one. They.
- 1:33Did come out now with the official response to that and
- 1:38it is Microsoft's response to a layer seven distributed denial of service
- 1:43attack.
- 1:44So they did come out and say that it was a denial of service attack.
- 1:49It was interesting, it started in early June.
- 1:51I don't know when that actual outage was,
- 1:54but it sounds like this was actually a denial of service attack that occurred
- 1:59across maybe multiple days that temporarily impacted
- 2:04availability.
- 2:05They did open an investigation tracking it to a threat actor that
- 2:10Microsoft tracks as storm 1359 .
- 2:16I wish I had a cool name like that.
- 2:18Yeah.
- 2:18Yeah. But they did dive into kind of what was going on.
- 2:21They did say no evidence of customer data being accessed or
- 2:26compromised. It was layer seven rather than layer three or four.
- 2:30And it was a combination of attacks, an htt P https,
- 2:35flood attack, a cash bypass and a slowloris.
- 2:40Is that how you pronounce it? Slowloris? Mm-hmm.
- 2:43. Yeah. Effectively a client that opens a, a connection.
- 2:48So think like, hey, I make,
- 2:49may I make an HTP request and so I've,
- 2:53I've got that TCP socket open and I'm ready to go and the client then
- 2:59just, it just sits there. Yep.
- 3:01Keeps it open, consumes resources. Yep.
- 3:05The other interesting thing about this,
- 3:07or nice thing though is Microsoft's also because it was against Azure
- 3:11and like Azure uses Azure,
- 3:14which is kind of odd to think about in and of itself ,
- 3:17but they talk about how you can use layer seven protections such
- 3:22as the web application firewall or the waf not to be
- 3:27confused with the well architected framework or the wife acceptance factor to
- 3:32help protect against those.
- 3:33So they also not only kinda said this is what happened,
- 3:37but also gave recommendations how even you as a customer hosting
- 3:42things in Azure could take advantage of the WAF to help prevent some of these
- 3:47layer seven DDO o s attacks.
- 3:49Yeah. It's another thing that's just happened over time, right?
- 3:54As web applications become more prevalent,
- 3:57stuff starts to move up the stack and I guess in this case the O
- 4:02S I stack and you know, you start to go from layer three,
- 4:06layer four and then you hit up to the application layer on layer seven
- 4:11and it starts to get more interesting where clients can do like really weird
- 4:15things like not just even like the,
- 4:17the slowloris kinds of things where you maybe open a connection and then you
- 4:21purposefully go slow with it.
- 4:23There are clients that misbehave even when they don't intend to,
- 4:28like sometimes they see storage customers that do weird things with like
- 4:33HDB connection, pooling like,
- 4:34like they don't understand the way like sockets are pooled inside of SDKs or
- 4:39inside of some of the frameworks that exist.
- 4:41So they start to do weird things like you know,
- 4:44occasionally I'll have a customer where they go, oh, you know,
- 4:46I thought I had enough of the data so I just stopped downloading it and then I
- 4:49start seeing all these network errors in my storage account.
- 4:52Why do we see network errors? It's like, well let's go read our documentation.
- 4:56A,
- 4:56a network error is when a client suddenly disconnects and we're still sending
- 5:01data so we don't know if the client ever got it and they look at us and
- 5:04they go, oh well we got all the data so we walked away. It's like,
- 5:07but you didn't walk away in the right way. You know,
- 5:10like sometimes I have customers who do things like they send us like RSTs and
- 5:14we're like, no, you shouldn't do that.
- 5:15We should send you the R S T cuz we're done and it's just weird.
- 5:20So I think the more of that like just underlying implementation stuff that's
- 5:25been abstracted away from developers,
- 5:27sometimes it's a little easier to lose sight of how this stuff
- 5:31works now and and how it comes together and and what that all looks like.
- 5:37I was actually,
- 5:37I was same kind of vein of like weird client behaviors and maybe you don't
- 5:41understand or think enough it's that people don't understand.
- 5:44I think it's just that they don't kind of think end to end about how it comes
- 5:47together. Yep. Is we were working with a customer on easy copy.
- 5:52So easy copy client tool,
- 5:54it copies data from on-prem service to service, like all those kinds of things.
- 5:59So it's a multi-threaded application and it also
- 6:04has concurrency built into it.
- 6:06So within these threads you can spin off kind of n HTP connections because
- 6:10you have to fire off HTP requests to the storage service to be able to do your
- 6:14copies. And we were working with a customer and they're like, Hey,
- 6:17we're getting this weird air on Linux where we're running out of sockets.
- 6:22And it was like, huh,
- 6:23you really shouldn't like ever run out of sockets cuz we purposefully
- 6:28limit the number of threads that can go up.
- 6:30So that doesn't happen cuz like most Linux clients,
- 6:33like a default installation on like a modern Linux kernel.
- 6:36You've probably got something from like 20,000 to 40,000 ephemeral sockets to
- 6:41work with locally and it's like wow, that's a lot for you to run out of.
- 6:45Like what are you doing?
- 6:46Oh well we're running multiple instances of AZ copy on the same server and then
- 6:51each one of those instances has this concurrency setting and it's doing this
- 6:55thing and we're like,
- 6:57oh we never really intended for you to run multiple instances of AZ copy
- 7:02on the same server .
- 7:03You can certainly run multiple instances but you should kind of like fan that
- 7:06out, right? Maybe you have this one, go look at this directory, this one,
- 7:08go look at this directory. And the response we got back,
- 7:11which I kind of went like fair enough, but was,
- 7:16well your documentation doesn't say that we shouldn't run multiple instances on
- 7:21the same server. So I was like, okay, fair enough. Right? Like I'll,
- 7:24I'll go update the documentation so that that doesn't happen so that, you know,
- 7:28future customers can take that into consideration. Yeah.
- 7:31But it was a weird one to me like I,
- 7:32like I hadn't even thought about ephemeral T c p
- 7:37port exhaustion on Linux clients in like a long time.
- 7:41It's like something that's been so far abstracted and so far outside of my head
- 7:44like, like why would that be top of mind for me or anybody else?
- 7:48Un until you run into a weird edge case, right?
- 7:51So things like this do happen.
- 7:54I think in the case of like the DDoS attack that that you pulled up and some of
- 7:59the things in there,
- 7:59like you do have to think about kind of multi-layered mitigation and how you're
- 8:04gonna mitigate risk there for yourself.
- 8:06So you can't really protect at just layer four or
- 8:11layer three. Like you,
- 8:12you probably do need some things at the application level as well and
- 8:17you know, that often comes at the expense of operational overhead
- 8:23and money as well.
- 8:24Like sometimes these advanced security solutions do cost you more to pick up
- 8:28those things like web application firewalls and, and all that kind of stuff.
- 8:32But I think it's worth it for customers to consider and kind of do that like,
- 8:38you know, risk reward kind of thing, right? Like put it on the scales,
- 8:42see where it balances out and what makes sense for your business, your workload,
- 8:46all that good kind of stuff.
- 8:48Absolutely. I'm still this,
- 8:50this whole running multiple copies of AZ copy on the same server still has me
- 8:55going, huh?
- 8:56I don't know that I ever would've even tried that or thought to try that. Uh.
- 8:59Yeah, I I mean you can certainly do that. Uh, there's no.
- 9:02Limitation.
- 9:03And it, it was never explicitly not recommended.
- 9:06Now it's not recommended cause we we updated the docs and,
- 9:09and put that fair enough there. But should,
- 9:11should you wanna find a way to exhaust tens of thousands of ephemeral ports
- 9:16on your client very quickly. Yeah.
- 9:19Just spin up a couple copies of AZ copy, I mean,
- 9:22and tell it to copy a couple hundred thousand objects at the same time. I was.
- 9:26Gonna say they must have also set the concurrency really high. Yes.
- 9:31I would assume.
- 9:32concurrency high plus number of objects really high.
- 9:35So one of the interesting things about like easy copy as a client tool and and I
- 9:39sometimes forget about this, like I tend to view it as a,
- 9:45and not to sell it short but like it should be used more for I think more
- 9:49manageable migrations and data movement scenarios, right?
- 9:51Especially if you're doing like an on-premises client to the cloud for a whole
- 9:56bunch of reasons and you know, over time like the maturity of that tooling,
- 10:01like it's good today. Like you can throw 50 million o object,
- 10:06you know, job at easy copy and it'll churn through it and do it like that.
- 10:11But just because you can do 50 million objects in a single job,
- 10:14does that mean you should well initial, well again,
- 10:16we're back to like weigh the risk reward thing. Like how big's my client? Uh,
- 10:21you know, what's my network throughput?
- 10:23What what's my CPU and and all these other things that you've gotta kind of put
- 10:28together on the client side and just think about a little bit, right?
- 10:32It's not that it can't be done,
- 10:33it's that you have to like think through it end to end and rationalize it and
- 10:38you know, we're all moving so fast that you know, you just kind of go, go,
- 10:43go, go, go.
- 10:44And sometimes you don't know that you've haven't like passed a point of no
- 10:48return but that you've passed a point that you maybe could have caught
- 10:51sooner and come back to. So I always think it's very,
- 10:56very interesting to go work on those kinds of things and I am 100% happy to be
- 11:01putting more prescriptive guidance like you know,
- 11:05yes you should do this. Yes,
- 11:06you shouldn't do this right into documentation and things like that.
- 11:09I think that moves everybody forward.
- 11:11Oh absolutely. I wish everybody did that with documentation. And again,
- 11:15I think it just like that's what they ran out of first. To your point,
- 11:19I've never thought about doing that because I always feel like you'd choke out
- 11:23your throughput whether it's the nick going through the switch or
- 11:28the CPU or the memory or the IOPS on the hard drive,
- 11:33but to choke out the available connections and the available
- 11:37sockets before you hit any of that other stuff.
- 11:41Cuz that's why I've always run AZ copy or other SharePoint migration tools when
- 11:46I've done something similar, probably not this amount of data,
- 11:49you spread it out for that, right? I think.
- 11:51Any tool that does this, right? Like I not to not to single out easy copy,
- 11:54but anything that's gonna open an h e p connection call an API and orchestrate
- 11:58this type of movement.
- 11:59Like ultimately bits like when you're doing an on-premises to like cloud,
- 12:04cloud integration scenario, right?
- 12:06That stuff needs to move over the wire and it's going to consume resources,
- 12:11it's gonna be cpu,
- 12:12it's gonna be memory like say you wanna like hash objects before you send them
- 12:16with like, you know, I don't know,
- 12:17an MD five or a Shaw hash or something like that. Like guess what?
- 12:21You've gotta do all that someplace. So that takes CPU and then you know,
- 12:24potentially increases the size of your responses even minimally because it's
- 12:28gotta go in headers and be stored in a service, blah blah blah.
- 12:31So it's one of those things like nobody should have to think about it.
- 12:34But then when you get into those kind of edge cases you go like, yeah okay,
- 12:38.
- 12:38Right? Yeah for sure. Huh, interesting.
- 12:45Do you feel overwhelmed by trying to manage your Office 365 environment?
- 12:49Are you facing unexpected issues that disrupt your company's productivity?
- 12:53Intelligent is here to help much like you take your car to the mechanic that has
- 12:57specialized knowledge on how to best keep your car running intelligent helps you
- 13:01with your Microsoft cloud environment because that's their expertise.
- 13:05Intelligent keeps up with the latest updates on the Microsoft cloud to help keep
- 13:09your business running smoothly and ahead of the curve.
- 13:11Whether you are a small organization with just a few users up to an organization
- 13:15of several thousand employees they want to partner with you to implement and
- 13:20administer your Microsoft Cloud technology,
- 13:23visit them at intelligent.com/podcast.
- 13:27That's I N T E L L I G I N
- 13:31k.com/podcast for more information or to schedule a 30 minute
- 13:36call to get started with them today.
- 13:38Remember intelligent focuses on the Microsoft cloud so you can focus on your
- 13:43business. All right, so with that,
- 13:49what else do we have? Which one of these do you wanna go?
- 13:52There were a couple of interesting ones. I've got two interesting ones.
- 13:56I would like to chat about something that you brought to
- 14:01my attention.
- 14:02So why don't we do Terraform and Azure AD Azure
- 14:07ad cause I didn't even, I didn't even know this was possible through a,
- 14:12through like an HCF F script.
- 14:13Well I don't think this was possible up until very recently
- 14:19and I don't even know, I'll be fair,
- 14:21I don't know where this came from in my R ss feed I have some searches that just
- 14:24pull random stuff into my RSS feed.
- 14:26I may have seen this on Twitter but yet this was an article from
- 14:30June 20th so just three days ago about Azure
- 14:35AD with Terraform examples and I agree I didn't know this was possible.
- 14:40So I've done some with Terraform and I've looked at Terraform,
- 14:45I've written some Terraform,
- 14:47we've talked about Terraform and Bicep on the podcast before but it's always
- 14:51been in like provisioning resources,
- 14:53whether it's managing VMs or app services or
- 14:58firewalls and the whole infrastructure is code type of thing.
- 15:02And then I saw Azure ad intro with Terraform and I was like huh,
- 15:08this is gonna be interesting because I never,
- 15:12I never thought about this before and I wasn't quite sure what this even
- 15:17was.
- 15:17And then you start reading through the article and it is even more interesting.
- 15:22So it,
- 15:23the article kind of starts out with your Terraform set up for Azure ad kind of
- 15:27what you need to do,
- 15:28what providers you need to specify how you would go in and set this up with a
- 15:33client id, client secrets, tenants ID subscription IDs.
- 15:37And then the next thing is managing users in Azure ad.
- 15:41So it's all about how you can create and manage
- 15:47users with Terraform. I don't even know where do you wanna start with this?
- 15:51Like it goes through again, it just kind of caught me off guard.
- 15:55Yeah with you can go through and set these user properties.
- 15:59So I think it's an interesting idea.
- 16:02A couple of things just from like looking at the article and I guess the way the
- 16:06kind of provider operates, it's all fairly straightforward.
- 16:10It's an official kind of thing looks like supported on the HashiCorp side.
- 16:15So they've got kind of their own Azure ID provider just to plug
- 16:20into you pump in a tenant id.
- 16:23So pretty easy to figure all that out.
- 16:26And as far as how the provider interacts with Azure ad,
- 16:31it looks like it's all just a service principle. So uh,
- 16:36you know you go create a new service principle grant that service principle
- 16:40contributor rights over to your Azure active
- 16:46directory and then you end up, you know, with a client ID, client secret,
- 16:49all that good kind of stuff which can just be exported out,
- 16:53you know just environment variables that sit on the client side and then get it
- 16:58running management look pretty rich like it doesn't look too bad to get started
- 17:01with, you know, you can create users, you can assign roles,
- 17:04it even works with administrative units. , that was kind of good.
- 17:08Yeah like uh,
- 17:09I didn't even know like most people read the documentation and and knew those
- 17:12existed group membership applications licensing,
- 17:16which I think is really cool devices as well.
- 17:20So if you're thinking about devices and groups and dynamic security groups
- 17:24that's all in here and all good and ready to go I think like it seems like it
- 17:29has a good surface area. The really interesting thing to me would be,
- 17:34hey this is Terraform so it can do things like state
- 17:38management.
- 17:39So can it start to manage state of group memberships inside of
- 17:44my Terraform scripts?
- 17:46I think that could be a little bit interesting like as you start to extend your
- 17:49scripts like maybe application deployment now. Like here's a cool one, right?
- 17:53Like cuz now you have the ability to create users and all these kinds of things.
- 17:58You could go ahead and say like when you're deploying,
- 18:01say your new web app and your web app has a specific set of maybe
- 18:07security groups that are already in your Azure ED that are gonna be associated
- 18:10with some r a roles on the resources in Azure that are spun up now you can go
- 18:15ahead and kind of apply that user security,
- 18:19that R a C and kind of do all the identity and access management things as part
- 18:24of your native Terraform script and not have to reach out and run like
- 18:28a separate BA script or a power shell script on the side. So,
- 18:33and then you get all the state management across,
- 18:34you know all those resources within there and I think that's pretty
- 18:39nifty. I'm gonna have to go play around with this one.
- 18:41Yeah, I was looking at it, I don't see much about state management here,
- 18:46but I think that was my first thought that I had with this as well.
- 18:50Like I mean you could use dynamic groups, right?
- 18:53If you have dynamic groups and you are managing users and their group
- 18:57membership that way technically based on user attributes,
- 19:00it would automatically undo and redo things but then people could change
- 19:04attributes.
- 19:05You could still manually create security groups but if you could kinda lock down
- 19:09your Azure ad environment by forcing state management of
- 19:15security groups,
- 19:16I guess I see pros and cons to this too because you start thinking through,
- 19:20if I'm managing group membership users and groups with Terraform and managing
- 19:24their state.
- 19:25I'm thinking like Terraform State.
- 19:27So you know when you spin up a Terraform script you can create a plan and then
- 19:31you can apply that plan. So if this works the way other Terraform modules do,
- 19:36I should be able to do something like create a security group in Terraform
- 19:41and then populate group membership in that group and I run it the first time
- 19:45like let me do a plan and apply it and then when I come back and run it again,
- 19:49if there's no changes it's just gonna skip it,
- 19:51it knows I don't need to do it right? Or if I run it again and I've changed it,
- 19:55say like I've gone and added a user like hey we hired Ben,
- 19:58he's onboarded ready to go.
- 20:00You just put that in it and that's the only change that fires off against the
- 20:03environment. So,
- 20:04but not so much like Azure D State but actual like be the ability to retain
- 20:09state like group memberships within the plan on the Terraform side.
- 20:11But what if you're creating other groups like I'm gonna assume this
- 20:16is only security groups maybe.
- 20:20Oh no there's Microsoft 365 groups too,
- 20:22but you might not necessarily want it to main state maintain state of Microsoft
- 20:27365 groups or if you were using that,
- 20:31what would happen as you create new teams?
- 20:35I mean you'd really have to think through how you would do all of that .
- 20:38Cause you wouldn't want it deleting teams because it wasn't in your terraform.
- 20:42Welcome to everybody's big problem with Terraform or,
- 20:46or the thing that they run into, right?
- 20:48Like Terraform only knows what Terraform knows, right?
- 20:50And the things that it doesn't know so,
- 20:52so the more you manage outside of your Terraform scripts,
- 20:57the less iept they become over time or I think kind kind of you lose some of
- 21:02that power. So should you go down a path like this,
- 21:04quite often you are getting to the point where you're making the decision of
- 21:07saying like,
- 21:07Hey I'm gonna use Terraform as a management tool and really with the
- 21:12management plane of these services that I work with to go ahead and affect
- 21:16change within them. It's the same kind of thing.
- 21:18Like if you think about Terraform and maybe there's an update to
- 21:23a service or a new service in Azure and that isn't available in Terraform yet,
- 21:26the answer is usually well hey if there's not a provider for
- 21:31Terraform for the, to the resource provider in Azure,
- 21:34just go ahead and fire off an arm template.
- 21:36Well the problem is when you fire off an ARM template,
- 21:39all Terraform does is it knows it ran an arm template,
- 21:42it doesn't know like what was in the template and what resources were created
- 21:47within it. So you lost like that state management piece, which I,
- 21:51I think is why people become a little kind of like zealots around like oh my
- 21:55gosh like I need native Terraform support for these kinds of things.
- 21:58Which again, you know like makes sense if,
- 22:01if you kind of walk it end to end like you can understand the desire and
- 22:06why you would want it to be that way.
- 22:08So I view this as like this is probably pretty cool for standing up new stuff
- 22:12and then kind of maintaining it going forward. The stuff that's there,
- 22:15it's gonna be a little bit harder, right?
- 22:17Cuz Terraforms not gonna have any idea that it ever existed in the first place.
- 22:20But all about having like new providers that are integrated into the ecosystem,
- 22:25they work really well without having to do things like arm templates or
- 22:30kind of sideways machinations like that so that you can maintain like TF State
- 22:35and all those kinds of things. Like that's goodness.
- 22:38Yeah and this, it does force you to do a password too.
- 22:41So they also include in this article a random password generator from
- 22:46Terraform. So you can use that in combination with it.
- 22:49I think the other place I thought this could be useful too is I've done things
- 22:53before with different solutions where you have a service account and you need to
- 22:58create a service account, you need to have a password,
- 23:00maybe that service account needs to maintain certain permissions.
- 23:03I've had issues before where you create a service account,
- 23:05you give it permissions,
- 23:06it's doing something and some overzealous administrator comes in and sees that
- 23:11said service account has permissions and maybe they don't know why and they
- 23:16take 'em away and it breaks stuff.
- 23:18never happens.
- 23:19No. If you can maintain, maybe you're not doing all your user management,
- 23:22but if you build a solution that requires a service account and requires
- 23:27the service account to be a member of certain groups or have certain permissions
- 23:31being able to both create and then kinda your point manage the state so that if
- 23:36somebody comes in and does alter certain settings, permissions groups,
- 23:40whatever on the service account,
- 23:42Terraform goes in and says or redoes it the next time you run it.
- 23:45There could be some benefits there. I I could see with this as well.
- 23:48Yeah, it's an interesting idea.
- 23:52While we're talking Terraform real quick,
- 23:54I'll put a link in the chat and show notes for everybody as well.
- 23:58If you go out on tech community,
- 24:00the Terraform is HashiCorp and Yep. You know they,
- 24:04they write the things they write and then there's also Microsoft which
- 24:09contributes back to HashiCorp and in some cases holistically
- 24:14maintains some of those Terraform modules and kind of the,
- 24:18the management of how those map back to the resource providers in Azure and all
- 24:22that kind of stuff. So if you're into Terraform, there is an Azure tools blog,
- 24:27you might want to go follow that blog on tech community,
- 24:29like throw it into an RSS reader like we've talked about in the past or you
- 24:33know, however you choose to consume that.
- 24:34But they do monthly updates for what's come out in Terraform.
- 24:38But I don't know if you've been paying attention to some of the things but like
- 24:41they've been pushing new updates to the export tools.
- 24:45So being able to go back between native concepts of uh,
- 24:49Terraform and Azure can be a little bit hard sometimes in this kind of
- 24:55clouds scenario that's out there. They also host community calls,
- 25:00I believe they do those monthly or B or bimonthly,
- 25:04I forget the exact cadence for them,
- 25:05but folks can go out and register for those community calls.
- 25:09It's like aka ms slash Azure Terraform, you can just register,
- 25:13join the community and uh,
- 25:16go ahead and do that and then they're always pushing out new quick starts,
- 25:19all that kind of thing.
- 25:20So super helpful for kind of keeping up with what's going on on the
- 25:25Microsoft side of Terraform,
- 25:27which is potentially different than the HashiCorp side of Terraform and,
- 25:30and what it's doing as like HashiCorp uh, as a whole.
- 25:33Yeah, I saw this too.
- 25:34I haven't read through what was new in June but excellent call out,
- 25:38good resources.
- 25:40Export tool and yeah some,
- 25:42some new documentation and and quick starts and things like that,
- 25:45which is probably one of like the other big asks that I see a lot. It's like,
- 25:48hey how do you do this? It's like, it's not documented yet. Okay,
- 25:51we should go fix that. Yeah and.
- 25:53The LA the last community call that's mentioned in here was yesterday on
- 25:57June 22nd, it looks like it's maybe like every other month.
- 26:00They had one on April 6th.
- 26:02Doesn't look like they had one in May and then they had one on June 22nd.
- 26:05So if you're interested like use the sketch,
- 26:08just go sign up and watch for notifications and emails about those
- 26:13community calls because they don't look to be particularly
- 26:17consistent. You can also be a speaker if you're interested.
- 26:21Fill out a form at a K M S A Z,
- 26:24uh T F C C speakers and we'll reach out if you like your topic,
- 26:28if you want to co-present on a community call.
- 26:31So if you don't wanna just observe but you wanna participate and have something
- 26:35interesting to talk about.
- 26:36I know from running user groups in the past with you Scott,
- 26:39that people are always looking for speakers that are interested
- 26:44in speaking.
- 26:45Yes. Uh, what they are hard to find.
- 26:47So I have one more Scott that is not Azure related or
- 26:52Terraform related but is one I have been anxiously waiting for is there was
- 26:57an article published this past week about how to prepare
- 27:02for Microsoft 365 co-pilot.
- 27:05This is not an announcement about co-pilots being out there or
- 27:09getting public preview access to it. It is still in the early access program.
- 27:15There's a link to it if you want to go apply and find out more about that.
- 27:21But the fact that they are now publicly talking about what you need to do
- 27:26to prepare to me means that maybe,
- 27:28hopefully this is right around the corner and I can go give Microsoft some more
- 27:32money for yet another license.
- 27:34. Oh yeah.
- 27:38I always love things like this. You're like huh,
- 27:40what do I really need to prepare for? Right? Like I already,
- 27:44if you're a Microsoft 365 Office 365 customer,
- 27:48you would think like you already have a lot of the
- 27:52groundwork in place but you might not,
- 27:57the licensing is probably gonna be a big one upfront.
- 28:00Like do you have the right types of licenses?
- 28:04So copilot is like as far as what they've said so far for
- 28:09Microsoft 365, you're gonna need either an M 365,
- 28:13E three or E five license. Yep. You need the Azure ID account.
- 28:17Like that all makes sense.
- 28:19And then all those apps and services that co-pilot is going to work with
- 28:24like Word, Excel, PowerPoint, OneDrive, all that kind of stuff.
- 28:28Turns out you're gonna need that. And I,
- 28:30I think that's probably one of the more interesting things like having done the
- 28:35M 365 office 365 administrator thing for multi-thousand
- 28:40person orgs. You have clients who are kind of multi-thousand,
- 28:44it gets like weird sometimes, right?
- 28:46With some of those organizational requirements or just things they've put in
- 28:49place like oh yeah, you know we,
- 28:50we let this business group run this thing but we don't do this over here,
- 28:54we haven't deployed this yet or turn this on.
- 28:56And I think for like co-pilot to work across the stack,
- 28:59you're back to one of these inflection points where you kind of gotta like get
- 29:03ready to turn everything on and live with it.
- 29:06, right? And they did so they did say too further down,
- 29:09there's a footnote all the way down and I saw it in the comments for SMB
- 29:14Business standard and Business Premium are also eligible base licenses.
- 29:18So this was not called out in the initial technical requirements but
- 29:23is a footnote that if you're an SMB you can also
- 29:28use either of those. I'm curious about this Scott,
- 29:32from the preparing for it with the word Excel, PowerPoint, OneDrive,
- 29:36outlook loop and more,
- 29:38it says you need access to the Microsoft 365 apps and services.
- 29:44Is this going to be that you need the desktop license of those apps
- 29:49or do you think it'll just be like if you have just the online version
- 29:54of Word Excel, PowerPoint, is that gonna be an enough?
- 29:56That's not specifically clear in here from a
- 30:01licensing perspective.
- 30:02It also does say you need to be on current channel or monthly enterprise channel
- 30:06for Microsoft 365 apps to have access to copilot.
- 30:11Yeah.
- 30:11So doesn't the channel thing for apps apply to the web desktop
- 30:16clients?
- 30:17I think it's desktop and web.
- 30:19And and web. Yeah.
- 30:20Yeah.
- 30:21So I would speculate it would work on the web particularly because a lot of
- 30:26these features do tend to come to the web before the desktop.
- 30:30I'd have to dig it out.
- 30:31I thought there was an announcement the other day that like when the new version
- 30:33of Outlook drops,
- 30:35like you know that new like web-based version of Outlook at that point like
- 30:38Outlook is basically like a glorified PWI glorified. Yeah and I,
- 30:42I'm way over simplifying it but like I guess I'm allowed to do that. You.
- 30:45Can absolutely do that. So those are some of the technical requirements.
- 30:48It also talks about permissions.
- 30:51There's some stuff in here about security, privacy,
- 30:54data residency that it's gonna follow Microsoft's principles around those.
- 30:59I think that's gonna be super interesting with GDPR and some of the things that
- 31:03are going on in the EU around ai.
- 31:05Like are you going to be able to do this organizationally let alone like can you
- 31:10configure the stat, can you light everything up?
- 31:12Like are you okay with that organizationally,
- 31:15just like the broader question of like,
- 31:17is machine learning things like this kind of hate that we're calling 'em ai,
- 31:21but are AI things like this allowed in your country or in your geography
- 31:26is gonna be another big question for folks.
- 31:28And then what do you do like if you're a global organization,
- 31:31like how are you gonna handle this and what's that gonna look like and how is
- 31:35Microsoft gonna handle it?
- 31:36I think those are gonna be super gnarly kind of questions to dig into.
- 31:40So this whole thing is interesting.
- 31:41I saw an article about this and I can't find the one I saw recently,
- 31:46but it did pull up one bag from April where there was a leak at Samsung
- 31:51where Samsung employees entered sensitive information into chat G P
- 31:56T. And depending on where this data goes from
- 32:02co-pilot and from,
- 32:05I mean even chat G P T is the bigger one because it's just open public is
- 32:10you're giving these models confidential information that they then turn around
- 32:14and get trained on and could technically leak out to a competitor who uses
- 32:19it to look for the same information. Um,
- 32:21which kind of ties into this whole data residency security privacy as when I
- 32:26start having all these internal documents presentations that's learning from the
- 32:31graph and it's generating these models and learning,
- 32:35making sure that data does stay secure and private.
- 32:38So my understanding for copilot and, and I could be off, I've,
- 32:41I've gotta go watch some of this stuff about the indexing service for it.
- 32:45Mm-hmm . So the base model,
- 32:48like the foundational model was not trained and will not be trained on customer.
- 32:53Data. Customer data, yes.
- 32:54So you're effectively, like Microsoft Mechanics had a pretty good video on it,
- 32:59I think that kind of laid it out. I'll try and dig up a link to it,
- 33:02but you're kind of running through this series of like meta prompts.
- 33:06So it's a meta prompt that builds on a meta prompt that builds on a response and
- 33:10another meta prompt from there and then is augmented with kind of security
- 33:13controls in Azure AD and making sure they've got the guardrails and and ring
- 33:18fencing and things there.
- 33:19So if you think about it for like large language model to say summarize this
- 33:23meeting for you for it to be able to respond to that,
- 33:27really it's gotta go back to the transcript of the meeting.
- 33:29It's not training on that data,
- 33:31but it is eventually running that data like through one of the meta prompts so
- 33:36that it can feed in that document or whatever it needs to do and go summarize.
- 33:39But how it learned to summarize and what it thought a good summarization was
- 33:43like that's all in the foundational model and and none of that was trained on
- 33:49customer data. So we shall see.
- 33:52Yeah, and it does get into that in that security privacy and data residency.
- 33:56It says copilot does not use customer data or user prompts train the foundation.
- 34:01Copilot does not use open AIS publicly available services.
- 34:05It uses Azure open a AI services only the
- 34:11L L M calls are routed to the closest data centers but can go into
- 34:16other regions where capacity is available.
- 34:19No customer data is written outside the user's home region. Starting in July,
- 34:24the early access program for Microsoft 365 copilot will align with our
- 34:28commitments under the EU data boundary.
- 34:31So they do have a bunch of that type of information in here.
- 34:34If you're curious about it, it's interesting that starting in July,
- 34:36the early access program will adhere to that.
- 34:38Is that an EU thing or is that a hint at that maybe we'll see this in July
- 34:43because they're getting ready for public preview and wanna make sure it aligns
- 34:47with all that when it hits public preview? I have no idea.
- 34:50Me reading between the lines.
- 34:51I don't know, I haven't,
- 34:52I haven't been paying attention to some of like more deeply some of the stuff
- 34:57that's going on over in the eu.
- 35:00I know there was the initial hubbub with, you know,
- 35:03Italy banning some of those things,
- 35:04which they've kind of dialed back a little bit and walk back some of that.
- 35:08But we'll see.
- 35:09I don't think you'll know like the fallout until all of this is broadly
- 35:14available. People can kind of see what it does and understand where it's going.
- 35:19And then I would imagine that given the kind of, you know,
- 35:23government tour that some of the CEOs of,
- 35:26of these companies like Sam Altman and OpenAI, like they,
- 35:29they're going around and kind of visiting with governments now I'd imagine this
- 35:33stuff is just gonna be litigated for a while as well once it launches and gets
- 35:38ready to go.
- 35:39But I imagine also a number of organizations will be kind of hampered by that
- 35:44in the beginning,
- 35:45especially cuz there's gonna be lack of clarity there.
- 35:49I just don't know how they'd get to like a 100% locked in kind of
- 35:55prescriptive set of guidance around that. Like I, I haven't seen it done yet.
- 35:58It'd be interesting if it could get done for this. Yeah.
- 36:01And then the last big thing I would say is the license management.
- 36:04We already talked about you need a base license.
- 36:07Needing a base license implies that this is not in included in a base license,
- 36:12that it is an add-on. But then yes,
- 36:14further down they also say co-pilot license management as with other apps and
- 36:19services admins will be able to manage Microsoft 365 co-pilot licenses using
- 36:24the admin center, blah blah blah blah blah.
- 36:26That very much implies as well that there is a Microsoft 365 co-pilot license
- 36:32that you will have to buy.
- 36:34So for all of you hoping that this was going to be just a free addition
- 36:38to maybe even the E five plan,
- 36:41kind of reading between the lines here where it talks about base licenses and
- 36:45then it also talks about Microsoft 365 licenses.
- 36:48Very much my expectation is,
- 36:51is that this is absolutely going to be a paid add-on to all of
- 36:56the existing license plans that you may have. This is not coming,
- 37:01well I won't say an add-on to any of them. An add-on to the base licenses.
- 37:05There are not gonna be licenses that automatically include this.
- 37:08You're gonna have to go spend money to get copilot is how I would interpret
- 37:13everything in this article.
- 37:14Yeah, you ready for an E six or an E seven or an E 42?
- 37:19Like, like whatever the answer is.
- 37:21I mentioned that to somebody the other day. I was like,
- 37:24I would actually love an E seven or an E nine that just includes everything.
- 37:28I get it.
- 37:29It's going to be an expensive license if it's $97 or a
- 37:34$125 per user per month. For me,
- 37:38I am getting tired of trying to manage, I'm gonna license everything for my job,
- 37:42for what I have to do.
- 37:43I am going to have at least one license of everything for myself so that I can
- 37:48adequately talk about it, test it out, validate it, that type of stuff.
- 37:52I am getting so tired of adding on add-ons to my license that
- 37:57even if it's the same price I would pay for an E seven or an E nine that
- 38:01includes everything. Just to simplify my management,
- 38:04to align everything together.
- 38:06Just to have one big product to know exactly how much it is.
- 38:11I mean maybe Microsoft, if they bundled everything,
- 38:14they'd be able to knock off a few bucks. I'm just tired of add-ons.
- 38:17I want one license that includes it all. .
- 38:21I don't miss my days of having to worry about those kinds of things and
- 38:26I've mostly forgotten about it. Right? Like with my current employer,
- 38:30it's like stuff is just there and I just use it and consume it and it's fine.
- 38:34, there's really not, you don't have.
- 38:35To think about it. Microsoft gives you your licenses for their products.
- 38:39Uh, they, they give me that and a lot of early release broken software. Yes.
- 38:43That makes it so like I have to reboot multiple times a day. Yeah,
- 38:46that's that's pretty much how I live my life. .
- 38:49Yeah, sorry but kind of not.
- 38:52You kind of signed up for it when you took the job, Scott.
- 38:54I mean just saying little bit. All right with that,
- 38:57I don't know that I have anything too exciting in terms of news.
- 39:01There's even more Viva stuff. I'm doing some stuff on Viva.
- 39:04We might have to do a circle back around to Viva.
- 39:07There are new Viva products that didn't even know existed that have been
- 39:09announced. .
- 39:12Viva the one that sneaks up on you. Yes, I,
- 39:14I've been playing around with Viva goals a little bit lately so there is some
- 39:17stuff out there. How.
- 39:18About Viva Amplify, have you heard about Viva Amplify?
- 39:21No idea what it is.
- 39:22See exactly.
- 39:23I'm gonna put it right up there with like syntax indexes and syntax
- 39:27repositories and like all the crazy stuff you hear about like later about these
- 39:32products as they come together. So I don't know.
- 39:34We'll see if you wanna talk about Viva sometime, we can talk about Viva. We.
- 39:37Would just need to catch up. There was amplifying.
- 39:40There was one other one that was out there that I just ran across the other day
- 39:44that I was like, huh, who knew? Apparently some of this came from Glint.
- 39:47Microsoft acquired a company Glint.
- 39:49Mm-hmm and some of these new Viva stuff came from Glint and
- 39:53there's gonna be a Viva glint now as well. Microsoft, Viva and Glint. Yeah,
- 39:57Microsoft, Viva and Glint I saw somewhere. Microsoft. Yeah, Microsoft.
- 40:02Microsoft, Viva Glint, Microsoft Adoption. like Viva's like a bunny.
- 40:07It just keeps having babies or something like that. Anyways,
- 40:11we do not need to talk about Viva anymore,
- 40:14but there's more Viva stuff we can talk about if we decide to talk about Viva.
- 40:18Done and done, we'll get that sorted.
- 40:20Too. And with that, I'll let you go enjoy your weekend.
- 40:23I'm gonna go work this weekend because I have
- 40:28end of the month deadlines that I need to make some progress on. Yeah.
- 40:31Got I got some. We're in the middle of a semester, so yeah, ,
- 40:35I gotta get all my like retros done and mid-semester reviews and all that stuff.
- 40:39So.
- 40:40Have fun with those. The.
- 40:41Work never stops. Yeah, the beatings will continue until morale improves.
- 40:45Let's just put it.
- 40:46That way. All right, well thanks Scott. Enjoy your weekend. Don't work too hard.
- 40:51Hopefully we'll get some non rainy weather and we will talk to you next week.
- 40:55As it's been getting darker and darker behind me. As I'm sitting here, I'm like,
- 40:58should I turn up my key light? Should I have to, my lights on .
- 41:01We just had a thunderstorm roll through here. Maybe it's coming your way.
- 41:05All right.
- 41:06. All good. Thanks guys. All right.
- 41:07Appreciate it. Thanks Scott. If you enjoyed the podcast,
- 41:12go leave us a five star rating in iTunes.
- 41:14It helps to get the word out so more it pros can learn about Office 365 and
- 41:19Azure.
- 41:20If you have any questions you want us to address on the show or feedback about
- 41:24the show, feel free to reach out via our website, Twitter, or Facebook.
- 41:28Thanks again for listening and have a great day.