Latest / Microsoft Cloud IT Pro Podcast / Episode 367 – Azure Files vs a Server with an SMB Share
Transcript
- 0:03- Welcome to episode 367
- 0:06of the Microsoft Cloud IT Pro Podcast
- 0:09recorded live on December 29th, 2023.
- 0:12This is a show about Microsoft 365
- 0:14and dasher from the perspective of it pros at end users
- 0:18where we discuss a topic or recent news
- 0:20and how it relates to you to kick off the new year.
- 0:23We start out talking about some changes coming
- 0:26to the podcast in 2024.
- 0:28After that, we dive into hosting file shares on Azure
- 0:32and some things to consider.
- 0:33We briefly touch on comparing this to SharePoint,
- 0:36but then spend the bulk of our time on a hosted Azure server
- 0:40with an SMB share
- 0:41or using Azure storage in the file share
- 0:44functionality of that service.
- 0:48Oh, we made it Scott, our last recording
- 0:52of 2023, our
- 0:54- Last recording of 2023.
- 0:55And it's gonna be our first recording of 2024. Yes.
- 0:58- Because we are live with those
- 1:02Discord members in 2023 and this will come out.
- 1:07So we didn't talk about this, Scott,
- 1:09and this is a good segue maybe is this is, I'm assuming,
- 1:12going to come out January,
- 1:15six days from now. Four, five,
- 1:18- Something like that.
- 1:19- Thursday, - It should be January
- 1:20four, Thursday the fourth.
- 1:22- Yes. And then you
- 1:24and I, so we do this every once in a while.
- 1:26We'll go out for breakfast, out for coffee
- 1:28and discuss Podcasty stuff and what we wanna do
- 1:31and what we're going to do.
- 1:34And we went out for coffee a week or so ago, right
- 1:38before the Christmas holiday
- 1:41and discussed the podcast in 2024.
- 1:45And as such, are going to make some changes going into 2024.
- 1:50- Yeah, real quick, let's, let's get through this.
- 1:52So, all right, this will be episode 367 when it comes out.
- 1:56So if you do some quick back of the napkin math,
- 2:00that's at least one episode a week for the past seven years.
- 2:03Give, give or take, we're like six
- 2:05and a half pluses coming on seven.
- 2:06Sometimes we've released more episodes.
- 2:08- Yeah, I think March will be seven.
- 2:11- Yeah. During conferences and things like that.
- 2:13But it's been a while. Like we've been on this kind
- 2:15of continuous march to, to get this thing out the door.
- 2:18So in 2024 we're going to do that
- 2:21and we're absolutely gonna keep it going,
- 2:23but we are going to change a few things up.
- 2:26So first is, you and I kind of both talked about this
- 2:30and we wanna get back into deeper dives on specific areas
- 2:35either you know, that could be like a service in Azure,
- 2:38could be a new, you know, component
- 2:41that's released in the Microsoft
- 2:42365 stack, something like that.
- 2:43But I think we like taking deeper dives on things
- 2:46and generally that's like where we'd want to land
- 2:50and we'll still deal the occasional like broader tech space,
- 2:53random news thing, but that should be far less frequent.
- 2:58Like we do wanna be a little bit more kind
- 3:00of focused on what we're putting out there.
- 3:02Second is, like I said, we've released at least,
- 3:06at least one episode a week
- 3:07for almost seven years straight.
- 3:09Some weeks, especially during conferences,
- 3:11we've cranked out multiple episodes.
- 3:13I remember like Ignite one year we did like 10
- 3:15or 13 episodes like that,
- 3:17like something crazy that was nuts.
- 3:19It all takes its toll. Burnout is definitely a real thing.
- 3:22You and I have talked a bunch about it.
- 3:24We both love putting this podcast together
- 3:27and figuring out the content, what to chat about each week
- 3:29and to go through that and,
- 3:31and you know, thanks to everyone who listens
- 3:33and puts up with it, but you know, you
- 3:36and I both need to be mindful of our mental health,
- 3:38certainly like where we are in our respective careers.
- 3:41And I think realistic just about the amount
- 3:43of time we spend on what's ultimately something
- 3:46that like you and I do for our enjoyment.
- 3:47Yep. We don't do this for any monetary gain.
- 3:51Like if people think that oh you've got memberships
- 3:54and you make money off that, or you've got a YouTube channel
- 3:56and maybe you make money over there, like we don't,
- 3:58we spend money, we don't make any money.
- 4:00We, we in fact lose a bunch on that.
- 4:03So with that all in mind, we're just gonna be cutting back
- 4:06to one episode every other week.
- 4:08So the intention here is to put out more quality content.
- 4:13So we wanna get back into those deep dives,
- 4:16do more interviews, ultimately be more intentional
- 4:21and less of what's on our mind in the moment.
- 4:24So I, I hope that kind of works out and comes across.
- 4:27And then third is we've been dual releasing
- 4:30to both the podcast site.
- 4:32So that comes out in your podcaster of choice.
- 4:34Could be like Apple Podcasts, could be Spotify,
- 4:38Google Podcasts, YouTube, any, anything like that.
- 4:41And we've been pushing to YouTube video at the same time.
- 4:45I think we've been a little lax on the YouTube side.
- 4:47So for any viewers that are coming in that way,
- 4:49we're gonna be working on some new things there.
- 4:52We wanna incorporate more of
- 4:53what we're talking about directly into the recordings
- 4:55and hopefully bring everyone all around on kind
- 4:58of all sides, a better all around experience.
- 5:02So with that out of the way you want
- 5:04to get into today's episode, sure.
- 5:06- Okay. So no one more thing.
- 5:08And I think with a YouTube thing too,
- 5:10and this was something that some members brought up in
- 5:13Discord, Scott, was when we're recording these in the past
- 5:17it's always just been talking heads, right?
- 5:20It's been yours
- 5:22and i's heads for those people
- 5:23that watch in Discord, they just see us.
- 5:25For those of you that watched on YouTube, it was just us.
- 5:29Uh, we are going to be starting to play around with
- 5:33actually doing, showing the screen when we're doing these.
- 5:36So if you are watching in Discord, you'll see maybe some
- 5:40of the articles that we're referencing.
- 5:41It's not necessarily gonna be demoing things,
- 5:43but as we look at different articles referenced different
- 5:46things, trying to highlight those.
- 5:48And I think this will also help if you do wanna go watch
- 5:50afterwards on YouTube doing some YouTube clips again,
- 5:53different things we'll play with with there.
- 5:55We're going to start trying to incorporate a little bit more
- 5:58of a visual aspect for those of you that are interested
- 6:02but still not take away from the audio.
- 6:04Still make sure we're explaining things in detail,
- 6:06talking through things.
- 6:07For those of you that still wanna listen to audio.
- 6:09So as we go into 2024, it might bear with us
- 6:13as we figure out some of that balance
- 6:15to really create this in a way that it works for both
- 6:19audiences a little bit better. Yeah.
- 6:21- Yes. See where it all goes. We're open
- 6:22to feedback too. Let us know.
- 6:23- Yes, absolutely end with that.
- 6:26Let's dive into it now Scott,
- 6:27with our first deep dive ish topic.
- 6:31Deep dive of 2024.
- 6:34And this is one, oh, were you gonna say something?
- 6:36I was gonna say this is one that came out of a client
- 6:40discussion that I have had in the last couple of weeks.
- 6:44It was interesting to talk through this.
- 6:47And this is around a topic
- 6:49that we have talked about on several occasions in different
- 6:52capacities around where you put your files in the cloud
- 6:56and the particular client discussion started with
- 7:01SharePoint and wanting
- 7:03to put all their files in SharePoint from a file share.
- 7:05And then their plan was just to map the SharePoint site
- 7:08as a network drive.
- 7:10So they'd still have their network drive, they'd still do
- 7:12that, but the files would just be in SharePoint
- 7:14and brought up the fact that web daf,
- 7:17which is the technology behind it, is now deprecated.
- 7:19Some of that even relies on Internet Explorer,
- 7:21which is now gone.
- 7:23And that quickly pivoted to, okay,
- 7:26so maybe SharePoint isn't the best place,
- 7:28we should still do a file share.
- 7:30Which resulted in an interesting conversation
- 7:34of do we do Azure files
- 7:36or do we stand up a 20 22, 20 19
- 7:41server in Azure
- 7:43and do a typical SMB share from this Azure server.
- 7:48And so we landed on today, well let's talk about this
- 7:52around Azure files deployment, maybe even some comparison
- 7:56between doing Azure files and an Azure server
- 7:59and what those thoughts are and maybe some of the pros
- 8:02and cons, some of the parts of this customer discussion
- 8:05that came up around the decision that they made,
- 8:08which I can share at some point in time as well.
- 8:11- I think it's always an interesting conversation.
- 8:13So anything that starts outta my head with Azure files
- 8:18versus, and you mentioned versus something like just a
- 8:22traditional Windows server that's maybe out there
- 8:25and it sounded like it could have been even like an Azure
- 8:28hosted Windows server
- 8:29with just an SMB share presented from it.
- 8:32Like in the back of my head immediately I hear that,
- 8:34I'm like, why not do both , you can really have kind
- 8:38of the best of all worlds here if that's a path that you
- 8:42potentially willing to go down.
- 8:46So like if your requirement is
- 8:48SMB shares Azure files is interesting in
- 8:52that it's a kind of managed service for you.
- 8:54It's a, it's a managed storage service
- 8:57and you can access those files that are in
- 9:01that managed share in multiple ways.
- 9:03So you can do that by directly mounting
- 9:06and directly attaching to that file share that's in Azure,
- 9:09like just in a storage account.
- 9:11You know, there's considerations for networking there.
- 9:14You need line of sight from clients
- 9:16to servers, all those kinds of things.
- 9:19The other interesting thing that you can potentially do is,
- 9:21and Azure files is uniquely suited for this,
- 9:24is you confront Azure files
- 9:27with what's called a Azure file sync server.
- 9:30It's effectively a cash but it's a near cache
- 9:35and it's a hot cache that can sit closer to your clients
- 9:40and not just sit closer to your clients
- 9:41but potentially give your clients
- 9:43other functionality as well.
- 9:44So there's things that like the managed
- 9:46service might not be able to do.
- 9:48One of the ones that comes to mind for me off the top
- 9:51of my head is quick QUIC
- 9:54and being able to do SMB over quick.
- 9:57That's something that's relatively new-ish in Windows
- 9:59server, but it only exists in Windows server.
- 10:02It doesn't exist inside of Azure files,
- 10:05the managed service yet.
- 10:06But because Azure files has this Azure file sync server
- 10:10that can sit in front of it, you can kind
- 10:12of enjoy the benefits of a managed service, managed storage
- 10:16and kind of that provisioned unit of storage that sits
- 10:19behind things and all the capabilities
- 10:21that come along with that.
- 10:22Be it redundancy, data protection, anything like that.
- 10:25And then you can also front it with
- 10:29what's fundamentally just a traditional SMB server
- 10:32and do everything off of that
- 10:34and get the advantages of things like SMB over quick
- 10:37for your clients as well.
- 10:40So you don't have to worry about maybe something like,
- 10:42oh let me stand up a server, let me provision some disks,
- 10:45let me stripe a bunch of disks together.
- 10:47Maybe I build out a storage pool
- 10:49and then I create an SMB share.
- 10:51I do DFS namespace
- 10:52and present a share out
- 10:53of A DFS namespace back to my clients.
- 10:56Like it's more just, Hey, I'm gonna stand up a server,
- 10:58I'm gonna put SMB in front of it
- 11:00and rather than presenting back to local disk,
- 11:03I'm just gonna do a direct amount of my Azure file share
- 11:06or do Azure file sync into that
- 11:08and then have those components come back to your clients.
- 11:12It's kind of like the best of both worlds if you're looking
- 11:16for things like high availability,
- 11:19potentially better disaster recovery, you're looking for
- 11:23richer data protection features within your stack.
- 11:26So things like soft delete
- 11:29for accidental data protection comes to mind
- 11:32for me there you can turn on soft delete you,
- 11:35you've got managed Azure resources,
- 11:37you do Azure resource locks, all that kind of stuff.
- 11:41Or managed shares also are supported with vaulted backup.
- 11:46So you can do backups into something like Azure backup
- 11:49as well and then just kind of get all
- 11:52that wired up and running.
- 11:54So I don't know, like for me it's not a if this or that.
- 11:58It's more like hey, which one of these should you do?
- 12:01And then should you maybe do both of them together?
- 12:03Because there's, there are some real
- 12:04advantages for you there.
- 12:06- So I'm curious your thoughts.
- 12:07I have mixed feelings on doing both of them.
- 12:11I have one client that does both,
- 12:13that sometimes accesses files from Azure files directly,
- 12:17sometimes accesses them from the server.
- 12:20They have an on-premises server.
- 12:21They have run into some challenges with that,
- 12:24particularly in the frequency
- 12:26that Azure files sync happens.
- 12:29So I think there's some scenarios to think
- 12:31through there when you're comparing a both
- 12:33or comparing which one is, I would say,
- 12:36where are you accessing these files from
- 12:39and then where's your server sitting?
- 12:41And then I'm also curious on your thoughts of like benefits
- 12:45of Azure files in the cloud.
- 12:48And I know you mentioned some things like Azure backup
- 12:50and stuff, but you can also backup a VM
- 12:54and Azure is, is there a real advantage
- 12:56that you see when it comes to Azure files in the cloud
- 13:01and doing a server with a file share in the cloud
- 13:04or is this a little bit more of a
- 13:06that stretch type scenario?
- 13:07You have an on-premises server, you want the speed
- 13:10of the on-premises server when you're on-premises
- 13:13and you wanna do some of that backup,
- 13:15that redundancy et cetera up to a file share in Azure.
- 13:19I think some of those are,
- 13:22and not the discussions that I went to in this client,
- 13:24they were going to go one way or the other.
- 13:26They weren't necessarily looking for that environment
- 13:30and they were emphatic
- 13:31that everything was gonna be in Azure.
- 13:32They were getting rid of all their on-prem servers .
- 13:35And that was a discussion I started having
- 13:36with them was it never even approached the do we do both at
- 13:40what's always, do we do one or do we do the other
- 13:41because whatever we do is gonna sit in Azure. I
- 13:44- Think it's where you have to do a little bit of
- 13:46that TCO analysis.
- 13:47So one of the things that comes to mind immediately
- 13:50for me is if you're talking about things like it's
- 13:54all in Azure anyway, right?
- 13:55It's, it's a virtual machine.
- 13:56Virtual machines have disks associated with them
- 13:58so you're gonna need to probably bring in
- 14:00some data discs Yep.
- 14:02To actually host the data and get that in.
- 14:05So data disks are like a managed disk in Azure.
- 14:09Say you did like a premium V two disc, like whatever it is,
- 14:13it really doesn't matter for the most part.
- 14:15Every single one of them is pay for what you provision,
- 14:19not pay for what you use.
- 14:21So you're gonna go ahead and maybe bring in say 128 gig disc
- 14:25or 2 56 you're bringing a terabyte here, a terabyte there,
- 14:29whatever it is, you're potentially overpaying.
- 14:30So one of the TCO things is
- 14:33with Azure files you can set up your shares at potentially
- 14:36smaller sizes and just grow them over time.
- 14:40Like you don't need to stand up a new disc, you don't need
- 14:42to migrate data between them, anything like that.
- 14:44Like it's just a share that you attach to
- 14:48and you don't have to over-provision on day one.
- 14:51So I think that's kind of an important TCO consideration
- 14:54for you is just what you're putting together
- 14:57and what you're doing there.
- 14:59The other piece is you know resiliency on the backend.
- 15:04So if you think about a managed disc, you can have a disc
- 15:08that you know ultimately the end of the day like a disc has
- 15:12to live in the same zone as your vm.
- 15:14Like yeah I get their ZRS discs and things like that
- 15:17but still they really home
- 15:19to like a single data center within a region.
- 15:22So if you're looking for additional resiliency
- 15:25redundancy on the storage plane for those things,
- 15:28that's all just included in Azure files
- 15:32because it's just a standard storage account.
- 15:34So you can do things like locally redundant storage,
- 15:37you can do zone redundant storage,
- 15:39you can even do geo replicated stuff.
- 15:41So if you want to do GRS
- 15:42or GZRS, that's all available to you.
- 15:45And then you get kind of multiple flavors
- 15:47of potentially IOPS and
- 15:49and performance with things like premium versus
- 15:54standard along along the way.
- 15:56I also see a lot of customers like this
- 15:58discussion comes up quite a bit.
- 15:59Like I don't work in with a lot
- 16:00of our files customers directly
- 16:02'cause I'm more on the object side.
- 16:03But one of the things that always comes up is
- 16:05how can they use things like replication technologies like
- 16:09DFSR and stand that up
- 16:11and do they use that in their on-prem environments today
- 16:13and how does that translate to the cloud?
- 16:15Well the cool thing is it's just one managed share
- 16:18'cause all your data can live in that chair.
- 16:20It has all the data protection features, redundancy,
- 16:22resiliency, all that good kind of stuff.
- 16:24And then you can just front it
- 16:25with those file syncs wherever you want.
- 16:28So you could front it with a file sync server
- 16:30that's hosted in Azure in the case of maybe this customer
- 16:33that you're coming to talking to today
- 16:35or maybe it's a customer who really does have on-prem needs
- 16:38and cloud needs and you could have a file sync server
- 16:41that's in Azure and both on premises back
- 16:44closer to those clients.
- 16:45So having that hot cache component there I think
- 16:49is is important to you.
- 16:51You know I mentioned Azure backup having like off
- 16:54effectively like offsite backup for these kinds of things
- 16:57is something that you would have to wire up
- 16:59and do yourself like sure it's a virtual machine
- 17:01and maybe you tie that into Azure backup.
- 17:03Is it going to offer you the consistency
- 17:06model that you're looking for?
- 17:07Is it application consistent? Is it crash consistent?
- 17:11Like what's the consistency model
- 17:12and are you gonna be able to restore it
- 17:14and get it back together versus just having it in a managed
- 17:16share and then you know, if the VM goes away, who cares?
- 17:20I just spin up another VM and
- 17:22and my Azure, you know file share is still sitting there
- 17:27and then you know the last thing on TCO is it kind
- 17:30of goes back to that costing component
- 17:31and not over provisioning.
- 17:33So you have access to things like reservations
- 17:37and being able to do reserve capacity in storage,
- 17:40which depending on the amount that you're going to,
- 17:44you know potentially provision
- 17:45and leverage within your environment,
- 17:47there could be very real savings for you there
- 17:49to be in a managed storage offering over something like just
- 17:53discs which are going to be expensive for you over time.
- 17:56Either on the management plane to kind
- 17:59of wrangle things together and get it all wired up
- 18:01and make sure that hey if it does go away,
- 18:03how do we restore it and what does that look like?
- 18:05Or just the general cost of a disc versus
- 18:09a backend storage service like Azure files.
- 18:13- Right. And that's the way we started going
- 18:15with this client is, you know what,
- 18:17why don't we just do Azure files?
- 18:19You want it all in Azure anyways.
- 18:21Kinda like you mentioned with Azure files you only pay for
- 18:25what you use instead of paying for the fully managed disc
- 18:28and the capacity that you're doing.
- 18:31But I think, and here's
- 18:33what I would say about if you're doing Azure files,
- 18:35if you're accessing it from Azure files
- 18:36and then I want maybe we focus a little bit more on Azure
- 18:39files is the one client I had where it stretch
- 18:41and you do talk about the hot cash,
- 18:44this is the biggest issue I have found with Azure files
- 18:48and then syncing to an on-prem server on-prem servers
- 18:53have the ability to recognize when a file is changed
- 18:57or modified and sync it up
- 18:59to Azure files relatively quickly.
- 19:03I mean we're talking a few minutes
- 19:05think OneDrive sync type of functionality.
- 19:08It recognizes it as they're changed
- 19:10and synchronizes them up.
- 19:11Yep. However, what this client has run into is if they're
- 19:14accessing Azure files and Azure files
- 19:16and then need to access it from that server,
- 19:19Azure files does not have that same capability.
- 19:22It doesn't have,
- 19:24and I can't remember exactly what it's called,
- 19:26it's essentially a trigger to know
- 19:29this file's been modified, it needs to be synchronized,
- 19:32it relies on a job that runs every 24 hours
- 19:36to synchronize files down
- 19:38depending on when you hit like this client was running into
- 19:41issues where I modified this file
- 19:43during the day in Azure files
- 19:45or I modified this file in the evening from Azure files
- 19:49and went in the next day to the office
- 19:51and the server did not have the most recent version
- 19:55'cause that job hadn't run yet.
- 19:56Yep. So what I've found is if you are in
- 19:59that synchronized scenario, you really,
- 20:01I mean I don't wanna say you only should access 'em from the
- 20:03server, but you kind of need to decide
- 20:05where you're gonna access these files from.
- 20:07What's that source of truth
- 20:09and stick
- 20:10with only one versus having some people access it from Azure
- 20:14files and other people access it from the server.
- 20:16If you find yourself in that synchronized environment,
- 20:20I haven't found a good solution for it.
- 20:21I've found some people that like run scripts to try
- 20:24to trigger that synchronization more often,
- 20:27set it in an Azure runbook, run
- 20:28that runbook every 30 minutes every hour
- 20:31to trigger that job.
- 20:33But it all feels kind of hack ish to
- 20:38keep those in sync enough
- 20:40where you can access files from either location
- 20:43and not cause a bunch of conflicts.
- 20:46- It it is so it, it's rough to do that.
- 20:48I don't know that there's a pit of success
- 20:50that you fall into if you think about it that way.
- 20:53It's more about recognizing that change detection does take
- 20:59some time and in large file shares like large managed
- 21:03shares, it can actually take longer than once every
- 21:0724 hours depending on the size of the namespace.
- 21:11So a a couple of things there.
- 21:12One is you don't want to be triggering that
- 21:16change detection PowerShell commandlet
- 21:19every 30 minutes like that.
- 21:21Like a, it's more infrastructure you have
- 21:23to stand up even if it is something like Azure automation
- 21:26B is, it's the, the way that job works is
- 21:31it works by enumerating each
- 21:34and every file that's in your file share.
- 21:37So if you have a large file share with a large number
- 21:40of objects, you are going to incur cost to have
- 21:44that happen right there.
- 21:45There's a measure of time that's associated
- 21:48with enumerating all the files in there to detect changes.
- 21:51There's also just, hey we're basically doing a a a read
- 21:56or a get on every single file that's out there
- 21:58and there's transaction charges
- 21:59associated with that and other things.
- 22:01So you need to recognize that that limitation exists
- 22:04and if you're in a world
- 22:05where you do something like dual home to like
- 22:07that dual home isn't a great idea, you really do want a home
- 22:10to one and pick it as the source of truth
- 22:13probably the file sync server.
- 22:14So even that, in that case like your Azure hosted clients,
- 22:17you should really be thinking about like your file server
- 22:20and the sync group for your file servers.
- 22:22'cause you can have multiple file sync servers all in the
- 22:25same sync group and tied back to the same share is,
- 22:29you should think about those as the kind of management unit
- 22:32for you and and the place
- 22:33where clients are going to access things.
- 22:35So nobody, like once you go down a file sync path
- 22:38and you're expecting like immediate sync between them,
- 22:41like don't bother with accessing the managed share .
- 22:44Like just recognize that that's a thing
- 22:45and it's, it's not worth you trying to work your way
- 22:48around like wait for the service to catch up.
- 22:51I think everybody knows that hey this is a potential
- 22:53limitation and yeah we'd love to change it over time
- 22:56but there's a whole bunch of constraints that exist there
- 22:59that make it, you know, maybe not the most performant thing,
- 23:02like the way it works today is it's gotta enumerate every
- 23:05file in your file share and that's a pretty big downer
- 23:08but if you just put another file sync server up in Azure
- 23:11say in that case, so you end up
- 23:12with managed files share Azure files
- 23:15and then you end up with a file sync server in Azure
- 23:17that sits in front of that and then in the same sync group
- 23:19maybe you have like two on-premises places
- 23:21where you're doing business great those are two more sync
- 23:25servers that then sit down there
- 23:26and those three sync servers can all sit in a group,
- 23:29they can do what they need to do
- 23:30and everything's kind of hunky hunky dory.
- 23:34But as soon as you start walking down the path
- 23:36and you start thinking about like,
- 23:37oh this client's gonna go here
- 23:39but this client's gonna access some other thing in a totally
- 23:41different way like that is not putting yourself into the pit
- 23:44of success or or a customer into
- 23:46the pit of success at that point.
- 23:48And I kind of wish it was called out in the documentation
- 23:50better, like it's a little bit buried in some
- 23:53of the FAQs today
- 23:54and you kind of like don't run into it until you run into it
- 23:57but it is good to know upfront that
- 23:59that limitation does exist.
- 24:01- Yeah. In these FAQs they have things
- 24:04like if I create it in one location,
- 24:07how long does it take to sync?
- 24:09It talks through if the file changes
- 24:13on two servers at approximately the same time what happens?
- 24:16But to your point, the fact that all of this type
- 24:19of stuff is in FAQs versus like
- 24:22the deployment documentation when you're setting all
- 24:24of this up, it would be nice if that was a little bit more
- 24:27- Clear.
- 24:28I don't know there's a lot of other stuff in front
- 24:29of you like you have to figure out, you know,
- 24:31your redundancy needs like even figuring out do I need like
- 24:35an LRS or a ZRS storage account can be a heavy enough lift
- 24:38for some customers , you know,
- 24:40how do I view redundancy in a second region?
- 24:43Like how many nines are actually important to me?
- 24:46What does that look like?
- 24:47Do I require things like additional data protection
- 24:51capabilities on there?
- 24:52You know like uh, you know I mentioned like soft deletes
- 24:54earlier and you know preventing accident deletes
- 24:57like that's stuff's all great.
- 24:59You also have anti-malware capabilities
- 25:02so you can potentially tie in defender for storage
- 25:06directly into your file share and not have to run
- 25:08that on your quote unquote like on-premises server.
- 25:11Like whether that actually lived on-premises
- 25:13or it was just an Azure VM running in the cloud.
- 25:16Like how do you view threat detection?
- 25:18What kind of logging do you need?
- 25:21What's your identity surface?
- 25:23Like how do clients access these things?
- 25:25Oh is it just SMB or is it SMB and NFS?
- 25:28Like maybe you have needs on that side as well.
- 25:31Like what does monitoring and operations look for you?
- 25:34Like there's a whole bunch of other questions to answer
- 25:36before you get to how does file sync actually work
- 25:40- that's a good point
- 25:41and that's where we ended up
- 25:42with this client was we started having that conversation
- 25:46and again they were comparing do we do native Azure file
- 25:49share or do we do a server and create a file share on there?
- 25:54They're coming from an on-premises environment
- 25:57and looking to move all of this into the cloud And
- 26:00that was one of those conversations we started having was
- 26:04how does authentication work to Azure file share.
- 26:08Let's say they were like okay let's put the server aside
- 26:12and let's think through some of this stuff is things
- 26:16that maybe you run on a server
- 26:18and you mentioned one, what are we authenticating against?
- 26:21Are we doing Azure ad, are we doing active directory?
- 26:25How does that authentication permissioning mapping network
- 26:29drives, look if you're gonna do Azure files,
- 26:32what is our backup scenario?
- 26:35If we have Azure files
- 26:37and we want to have backups of this data
- 26:41and we need to retain our data for X number of days, months,
- 26:46years, et cetera, what does
- 26:48that look like if we're gonna do Azure files,
- 26:51you mentioned antivirus typically on a file server you may
- 26:54have an antivirus agent running for how you're monitoring
- 26:58all of your other servers and your other endpoints
- 27:01and users devices and all of those.
- 27:04What are we doing about antivirus on all of these servers?
- 27:08And there are a lot of solutions.
- 27:11You mentioned those like the Microsoft Defender for storage
- 27:16is some of the benefits of that
- 27:18and using that for your malware scanning
- 27:22but then also using it
- 27:23for extra stuff like sensitive data protection
- 27:26and different levels of protection
- 27:30that you can do in Azure files.
- 27:32But it was interesting
- 27:34because they also found themselves in that boat of
- 27:38this is all brand new to us.
- 27:40We're not using defender for cloud for anything.
- 27:43We already have antivirus that we want to use.
- 27:46We already have a backup solution,
- 27:47we're not using Azure backup for anything yet.
- 27:50And sitting down
- 27:51and from their perspective it was a little bit too of
- 27:53what are we familiar with
- 27:56and they did find themselves in a bit of a time crunch is
- 28:00do we wanna go stand up Azure files
- 28:02but now maybe we have to go pay for Microsoft defender
- 28:06for storage and now maybe we have to pay for Azure backup
- 28:10to get our backups and how does our data retention look,
- 28:14which is a problem we've already solved in our current SMB
- 28:17share on-prem that we need to move to the cloud.
- 28:20And really working through that whole discussion of
- 28:25not just even a feature for feature comparison
- 28:28between server and Azure files,
- 28:30but what are those other things that we have
- 28:35as an organization that we use it
- 28:36as the organization requirements that we have in
- 28:39as an organization that we need to adhere to
- 28:42and account for where this file share ends up landing.
- 28:46- I think it's tough, like if you're in a time crunch
- 28:49to figure that stuff out, I, I think I'd be asking a lot
- 28:52of other questions do along the way like hey you wanna host
- 28:55this in Azure but you're not familiar with you know maybe
- 29:01Azure terminology and Azure constructs.
- 29:03Like I get that you've got a time crunch
- 29:05but you're gonna have a lot of the
- 29:06same questions on the other side.
- 29:07Like so you mentioned, hey we already have backup in place.
- 29:11Well if you're running that on an Azure vm,
- 29:13is it supported, is it licensed?
- 29:16Are you able to run that backup software in Azure?
- 29:19Same thing for like malware, like a lot of antivirus
- 29:22and anti-malware, things that run on-prem,
- 29:25they don't work the same way when they're running on a
- 29:27hypervisor especially uh, bespoke version
- 29:31that's sitting in Azure.
- 29:33Uh, same thing happens in AWS, right?
- 29:35Like the hypervisors behave in certain ways.
- 29:37They expect clients to behave in certain ways.
- 29:40Like you know, you don't wanna put some errant process out
- 29:43there that's gonna start spiking CPU all of a sudden
- 29:46and get you evicted for some weird reason right
- 29:48that you just weren't ready for or
- 29:50or anything like that along the way.
- 29:52So at some point you've gotta spend the time
- 29:55and answer those questions either way you can't just go
- 29:57like, you know, willy-nilly and stand up a server in Azure
- 30:01and then roll all your on-prem software onto it
- 30:03and then think it's gonna work out for you and
- 30:05and be hunky dory as well.
- 30:07Like that too is not having you
- 30:09fall into the pit of success.
- 30:10- Yeah, it was
- 30:12and they did, I mean to kinda wrap it up,
- 30:14they did end up going with a server for now I think it's,
- 30:18it was a time crunch, it was quick, it'll work for now,
- 30:21but it also very much opened eyes to
- 30:26really thinking through maybe there is something in the
- 30:29future that needs
- 30:30to go into Azure files maybe in the future we take this
- 30:34and there is some of what we put in files
- 30:36that can go into SharePoint
- 30:38and this is an issue I've run into a lot
- 30:40where people find themselves in a time crunch.
- 30:42They really want to do that lift
- 30:44and shift file dump type of migration from on-prem
- 30:48to the cloud without really taking the time and sitting down
- 30:51and thinking through a lot of
- 30:54what we talked about is does this belong in a server,
- 30:56does this belong in Azure files,
- 30:59does this belong in SharePoint
- 31:01and how do we need
- 31:03to think about things differently based on
- 31:05where we're gonna go with these files
- 31:07because none of them
- 31:09are an on-premises file server like you're used to.
- 31:12There's all different limitations, different
- 31:16constructs, different ways, how you can work with files,
- 31:19different challenges that you really need
- 31:21to consider when you are working
- 31:24through that type of a migration.
- 31:25- I guess one of the things you can do is there's a bunch
- 31:27of, you know, kind of like worksheets that you can sit down
- 31:29and, and you can think about like how to go
- 31:31through these things on your own and
- 31:34and start to rationalize some of it even down
- 31:37to hey should I do the SharePoint thing versus Azure files
- 31:41versus just you know, SMB share
- 31:43or something like that and how it comes together.
- 31:45So I, I'll put a link in the show notes for everybody just
- 31:49for kind of the all up migration article FRAGER files,
- 31:52which takes you through some of those considerations like
- 31:57where's the data coming from, how do your clients access it,
- 32:00what's the metadata that those clients use?
- 32:03Like do you use full on NTFS permissions,
- 32:07do you use some other kind of ?
- 32:10Do you rely on things like file locks,
- 32:12you know like global file locks, read-only files.
- 32:16What's your view on timestamps and how that works?
- 32:18Like how do you want those to migrate across like think
- 32:21maybe like created time
- 32:22and last access time, things like that.
- 32:24Do you have other non-standard properties
- 32:28that are potentially associated with those files?
- 32:30Like are they going to work in a managed share metadata, all
- 32:34that stuff and even down to like the version
- 32:36of like Windows server that you potentially run on.
- 32:39Like if you're presenting SMB shares to clients today,
- 32:42are you doing that on Windows server 2019?
- 32:46Are you doing that on Windows server 2022?
- 32:48Are you doing that on something older like you running like
- 32:51a really old legacy version of Windows server,
- 32:53like Windows Server 2012 or something like that?
- 32:56Are you not even running Windows server?
- 32:58Are you running Linux and presenting like SMB
- 33:00shares from Linux clients?
- 33:02Like how does your environment look today?
- 33:04How does it manifest and
- 33:05how can it come across to the other side?
- 33:08There is this kind of like crawl, walk, run strategy
- 33:10of hey let's potentially do a lift and shift
- 33:12and go to a server, maybe look for managed services
- 33:16later on downstream.
- 33:17Uh, I think generally like the path to success
- 33:20with the cloud is trying to get yourself away from servers
- 33:24and into those managed services as long
- 33:27as they fit the constraints of your requirements
- 33:30and they, they might always not fit the
- 33:31constraints of your requirements.
- 33:32Like you mentioned, you know, the whole confabulation
- 33:36with having to figure out sync between a cloud share
- 33:40and a hot cache server over here
- 33:42and how that actually manifests within the, the the service.
- 33:45Like if that stuff doesn't work
- 33:46for you then it doesn't work for you, right?
- 33:48Like there, there's a bunch of different ways to get around
- 33:50that and plan for whatever the next thing is.
- 33:56- Do you feel overwhelmed by trying
- 33:57to manage your Office 365 environment?
- 34:00Are you facing unexpected issues
- 34:01that disrupt your company's productivity?
- 34:03Intelligent is here to help much like you take your car
- 34:06to the mechanic that has specialized knowledge on how
- 34:08to best keep your car running Intelligent helps you
- 34:12with your Microsoft cloud environment
- 34:13because that's their expertise.
- 34:15Intelligent keeps up
- 34:16with the latest updates in the Microsoft cloud
- 34:18to help keep your business running
- 34:20smoothly and ahead of the curve.
- 34:21Whether you are a small organization
- 34:23with just a few users up to an organization
- 34:26of several thousand employees they want to partner with you
- 34:29to implement and administer your Microsoft Cloud technology,
- 34:33visit them at intelligent.com/podcast,
- 34:37that's I-N-T-E-L-L-I-G-I-N
- 34:41k.com/podcast for more information
- 34:45or to schedule a 30 minute call to get started
- 34:47with them today.
- 34:49Remember intelligent focuses on the Microsoft cloud
- 34:52so you can focus on your business
- 34:56And there are a bunch of those migration guides.
- 34:59You pulled it up where you're coming from different sources,
- 35:01whether it's Windows Server 2012,
- 35:05whether you're coming from a nas, if you're coming from
- 35:09Linux with SMB
- 35:11and then are you going into that hybrid deployment
- 35:13or are you going into a cloud only deployment?
- 35:15Different recommendations around tools to do it, articles
- 35:19to walk through how you start thinking through what
- 35:23that process is
- 35:24because that's the other thing is based on the amount
- 35:28of files and where these are going
- 35:30and how often people are using these files
- 35:33and constraints around how quickly files can move,
- 35:37another thing to think about is
- 35:39how do you get all these files from on-premises to the cloud
- 35:43or from one location to the other while not losing data
- 35:46and still allowing people to work.
- 35:47So there's a lot of different articles guidance
- 35:50around these in this migration SMB
- 35:54and the other thing we haven't even touched on is migrating
- 35:57to NFS Azure file shares
- 35:59because as your file shares can be SMB
- 36:02or NFS depending on your needs, which is,
- 36:07I mean there's so much to think about here Scott,
- 36:09like we have all these articles we thought about talking
- 36:11through and I feel like in some respects we've only
- 36:14scratched the surface of things
- 36:16to think about in considerations
- 36:17with these file shares. There
- 36:19- Is a whole bunch.
- 36:20So I think with all things it's worth taking the time
- 36:23to sit down and read the manual, right?
- 36:26Like go through that. Like I find myself doing that a lot
- 36:29and you mentioned this like with this customer like hey
- 36:31they're in a time crunch, they're potentially like bringing
- 36:33you in for your expertise at some point, you know, no matter
- 36:36how much expertise like you
- 36:37or I bring to a customer conversation,
- 36:40the customers still need to sit down
- 36:41and digest some of that information for themselves.
- 36:43Like it's worth it.
- 36:45You know, if you're somebody who's looking at this stuff
- 36:46and you're going like, oh my gosh there's you know,
- 36:48a whole bunch of articles that I need
- 36:50to read like yeah sorry, like you gotta go read a bunch
- 36:53of articles, it's gonna take you an hour
- 36:55to two hours or go watch a video.
- 36:57Like there's tons of videos on YouTube
- 36:59and a bunch of other things that can get you like
- 37:01to the point where you know enough to be dangerous rapidly
- 37:05and that's
- 37:06really what you want to be able to do, right?
- 37:07Like just understand hey I know enough to be dangerous.
- 37:10You don't have to be like Neo in the nature matrix, right?
- 37:12Where you get plugged in the first time
- 37:13and you go like I know kung fu.
- 37:15You just need to go like, oh yeah, I know how
- 37:17to put one foot in front of the other great, you know,
- 37:19let's get you onto the next step along the way.
- 37:22- Oh this was interesting.
- 37:24Did you see this, this article that was posted in Discord?
- 37:28Mm-hmm . So this one Robocop these cloud tier,
- 37:31I mean this is something else to think about, right?
- 37:33Because technically when you,
- 37:36I believe when you copy a file from your server up
- 37:40to something like data box,
- 37:42it is gonna update the modified date.
- 37:44Those files and data box are not the same files as
- 37:50what's on premises.
- 37:51So if you try to use something like Robocopy
- 37:54with a data box, yeah you're absolutely gonna get different
- 37:57modified dates for those
- 37:59- .
- 38:00This is where things like go ahead
- 38:02and just extoll the virtues of your own products.
- 38:05So one of the other things that I walk
- 38:07after is AzCopy, it's near and dear to my heart.
- 38:10Like I'm, I'm the product manager for AzCopy.
- 38:13We handle this scenario very, very well.
- 38:16I know there's this section in the Azure files documentation
- 38:19that says don't use AZ copy and use robocopy
- 38:24but it doesn't give you a good answer as to why that is.
- 38:28And I've been trying to hunt this down
- 38:29with the file folks for a while.
- 38:30Like I fundamentally believe that everything
- 38:33that Robocopy does we do
- 38:36and we actually probably do it better.
- 38:39But you're reading an article
- 38:40that hasn't been updated on docs in years and years
- 38:42and years that I've just gotta go find the right person to
- 38:46convince them to convince them to get there.
- 38:48Like the cool thing about it like easy copy versus something
- 38:51like a RO robocop or even a data box is we live
- 38:55and breathe by the Azure files rest API
- 38:58and what methods are presented back in
- 39:01that restful API interface.
- 39:02So we support all those things like preserving file creation
- 39:06time, preserving last modified times, like all
- 39:09that stuff just works with something like AZ copy
- 39:12and it's likely more performant as well.
- 39:15You know use my fake like dictionary word for the day. Yep.
- 39:18Robocopy is kind of cool
- 39:20but it's not multi-threaded in the way
- 39:22that we are in easy Z copy.
- 39:24Like we basically built a client to we,
- 39:26we built a copy client that hogs all the resources
- 39:29of the client that you run it on
- 39:32and it's meant to do that like by design,
- 39:33it's a very resource hungry application
- 39:36but it's meant to be multithreaded
- 39:37and just get this stuff done fast
- 39:40and the right way kind of the first time.
- 39:42So we support all those scenarios and do all that stuff.
- 39:46It's on my list for 2024 to go find whichever person
- 39:51in the files team decided
- 39:53that we were gonna say easy copy isn't the right tool
- 39:55for this job and either convince them that it is
- 39:59or if they're convinced that it's not, I'll go fix
- 40:01that in easy copy and I'll make it better
- 40:03than robocopy. That
- 40:04- Is interesting because this migrate SMB to Azure files,
- 40:08everything that they have in here
- 40:11to migrate is all Azure file sync,
- 40:14Azure data box and robo copy.
- 40:17They never mention okay an Azure storage mover,
- 40:20they don't ever mention AC copy in here.
- 40:22It's also interesting I don't uh see anywhere in here
- 40:24where they say data box
- 40:26and robocopy, if you're using databox,
- 40:29the recommendation is Azure file sync, which again probably
- 40:33I would think accomplishes that better than Robocop does
- 40:37and the way it would maybe synchronize those files
- 40:40and handle that is use databox
- 40:43to get the bulk of your files.
- 40:45I mean if you're moving terabytes, petabytes,
- 40:49my my daughter asked me what starts coming
- 40:52after you get into like it wasn't bytes
- 40:54but it was when you start getting up into like numbers
- 40:57above trillion in quadrillion
- 40:58and all of those really big numbers.
- 41:01- Petabytes. Is that Zetabytes? Yeah.
- 41:03Yeah , . Lots of zeroes
- 41:05- But once you start getting into those like Azure file sync
- 41:08or AZ copy
- 41:10or something like that just is not gonna work due
- 41:12to the sheer amount of data
- 41:14and the time it would take where I get it you have
- 41:17to use a data box but I think that goes back into like
- 41:21with this person in Reddit was talking about is they use
- 41:24Databox and robocop technically if you go look at the
- 41:27documentation that is not any of those recommendations
- 41:30for Microsoft is to use robocop after databox.
- 41:34It's always Azure file sync
- 41:36and if they listen to those podcasts they would know
- 41:38that they could use AZ copy as well. We
- 41:40- Should talk about this one maybe at some point too.
- 41:42Put it on the backlog. Oh
- 41:44- You just added one.
- 41:45I want everybody to know that was not me that said that.
- 41:48That was Scott . Okay, keep going.
- 41:50- We should talk about online versus offline migrations.
- 41:53Kind of like the data box versus AZ copy versus
- 41:58whatever data factory kind of thing.
- 42:00I think there's a general misconception
- 42:02that if you have a lot of data that it's gonna be quicker
- 42:05for you to do something like databox,
- 42:07like you mentioned like terabyte
- 42:09to potentially like petabyte scale migration.
- 42:13I actually wouldn't use a data box for
- 42:15most petabyte scale migrations.
- 42:17I would do those as online migrations
- 42:19and ensure that we have kind of a big enough pipe in place
- 42:22to, to get all that stuff working and and ready to go.
- 42:27Like I know there's customers out there who they go like,
- 42:30oh I've got like 10 terabytes or 20 terabytes
- 42:33or a hundred terabytes of data and that's a whole bunch.
- 42:35I work with the other like broad end of customers,
- 42:40like you're at one end of the spectrum on that side
- 42:42and I'd argue like potentially like quite small like you
- 42:46know like we'd rather be working
- 42:47with like petabyte scale customers
- 42:50and I've seen customers that even like
- 42:52with AZ copy they're copying tens of petabytes a week,
- 42:57you know to Azure for a single workload
- 43:00just to get those up there.
- 43:01Like there are workloads that are at that scale
- 43:03and they're doing online migrations
- 43:05and they're doing it quite successfully.
- 43:08So yeah, don't view like Databox as an end all be all a lot
- 43:12of the time like once you look at it
- 43:14and you look at like the shipping times and the turnaround
- 43:16and the potential loss
- 43:17of fidelity along the way when it comes
- 43:19to things like metadata that you'd really might want to
- 43:23consider online migration along the way
- 43:25and there's a whole bunch of tools particularly
- 43:28for like Azure files that can potentially get you there
- 43:30or just for object storage in general.
- 43:32- Alright. And even though the docs don't recommend AZ copy
- 43:35Scott, you can take Solace
- 43:38and the fact that chat GPT recommends using AZ copy ,
- 43:42- There you go.
- 43:43Like I said, this is on my my 2024 list.
- 43:46I don't know like a lot
- 43:47of the files documentation was written kind of like
- 43:50before my time with AZ copy
- 43:53and a lot of the things
- 43:54that they call out like hey you're gonna lose some fidelity.
- 43:57Like the only way that you lose fidelity is if the rest API
- 44:00doesn't support something which you know, the rest
- 44:03of API doesn't support any everything.
- 44:04There have been gaps there
- 44:06and we've been kind of pushing the files team
- 44:07to make those things better
- 44:09and they have been like they recently introduced OAuth over
- 44:11rest, so on files rest you can actually do OAuth now,
- 44:15which is an interesting thing
- 44:17and opens up, opens up a whole bunch of broad scenarios
- 44:20to like our SDK customers
- 44:22and ultimately tools like easy copy or
- 44:25or anything like that along the way.
- 44:27So yeah, yeah, put it in the backlog.
- 44:29We should come back maybe like mid-year
- 44:31and talk about online versus offline migrations.
- 44:34- Sounds like a plan. We will add it to the list.
- 44:38Scott is adding this to the list
- 44:40for once instead of me .
- 44:42But I think does that wrap us up for today?
- 44:45Anything else that likely
- 44:46- Does wrap us up for today?
- 44:48- Alright, well thank you Scott.
- 44:50This is an interesting discussion
- 44:51and we didn't even get into comparing this to SharePoint,
- 44:54which we do have other podcast episodes.
- 44:57If you're curious and more
- 44:58of a SharePoint versus Azure files discussion,
- 45:01we can go hunt down one of those episodes.
- 45:03I don't know that some of the guidance,
- 45:05there's changed a whole lot,
- 45:06but we'll put that in the show notes if there's a topic you
- 45:09want us to dive deeper into.
- 45:11We have not done an outstanding job either, Scott,
- 45:14of we don't get a ton of listener questions,
- 45:16but we haven't always done a great job
- 45:18of addressing them timely.
- 45:20We should also add that to our 2024 goals
- 45:22of if there is a topic someone wants more of a deep dive on
- 45:26to let us know and we will
- 45:29do a better job than maybe we have in the past
- 45:31of addressing those questions and pulling some of those in.
- 45:35So you can reach out via probably threads, Mastodon,
- 45:40iWatch, Twitter, Scott does not watch Twitter
- 45:43or just head over to our website, ms cloud it pro.com
- 45:48and look for the contact form
- 45:50and send us recommendations there.
- 45:52Or if you're one of the members in Discord,
- 45:54you can always post stuff there as well.
- 45:56But with that Scott, we will wrap up on
- 46:002023 from a live perspective
- 46:02and welcome to 2024 to those
- 46:05of you listening to the recording.
- 46:07Perfect. Thanks Ben. Thanks God, If you enjoyed the podcast,
- 46:12go leave us a five star rating in iTunes.
- 46:14It helps to get the word out
- 46:16so more IT pros can learn about Office 365 and Azure.
- 46:20If you have any questions you want us to address on the show
- 46:23or feedback about the show, feel free
- 46:25to reach out via our website, Twitter, or Facebook.
- 46:28Thanks again for listening and have a great day.