Latest / Microsoft Cloud IT Pro Podcast / Episode 427: Copilot Cowork Hands-On Experiences
Transcript
- 0:03Welcome to episode 427
- 0:06of the Microsoft Cloud IT Pro podcast,
- 0:09recorded live on 04/30/2026.
- 0:12This is a show about Microsoft three sixty
- 0:14five and Azure from the perspective of IT
- 0:17pros and end users, where we discuss a
- 0:19topic or recent news and how it relates
- 0:21to you. In this episode, Ben and Scott
- 0:24open with a quick peek at Merrill's latest
- 0:26project, Yako, a browser extension to make navigating
- 0:30to your Microsoft three sixty five services quicker.
- 0:34Then they move into an extended follow-up on
- 0:36Copilot CoWork and some of the recent hands
- 0:39on hardships,
- 0:40artifact management, and integration
- 0:43with Anthropic,
- 0:44including a potential security risk related to sensitive
- 0:48data.
- 0:50So we're trying something new today, Scott. We
- 0:52are recording in Riverside
- 0:54so that we can maybe try to do
- 0:56some shorts. And who knows? Maybe we'll even
- 0:59broadcast live to LinkedIn and YouTube here in
- 1:02the future. Start incorporating some video. I've been
- 1:04told we should do actually, nobody's told me
- 1:06we should do video. The SEO
- 1:09people and everybody that grows podcasts tell me
- 1:12we should do video. Our AI overlords are
- 1:14back. They're just gonna have us do this
- 1:16until we're done with it. We've tried it
- 1:18before and then quit. I don't know, Scott.
- 1:20Maybe this time it'll stick. Maybe Riverside will
- 1:24make it easier.
- 1:25The AI has definitely made some of it.
- 1:27It's compelling stuff here. We we should probably
- 1:30get into,
- 1:31get get into our topic of the day.
- 1:32Yeah. Before we get into our topic, though,
- 1:35did you see Merrill's latest
- 1:37invention development project,
- 1:40etcetera? I have not. Okay. So go into
- 1:43whatever browser you use and go search for
- 1:47Yako, y a
- 1:49c o, or you can go to the
- 1:51website, get Yako, yaya,
- 1:54not c,yako,.com.
- 1:56I'll send you a link. I should've done
- 1:57this earlier because now I don't know where
- 1:59our Teams chat is. It is a browser
- 2:01extension
- 2:03that
- 2:03changes the home page of your browser. So
- 2:06he created it for Edge, Chrome, and Firefox.
- 2:09And now when you click a new tab
- 2:10in your browser, it gives you
- 2:14the
- 2:15like, it gives you a bunch of links
- 2:16that you can customize to whatever Office March
- 2:20well, Microsoft Cloud, really, Cloud links. So, like,
- 2:23mine,
- 2:24I hit a new tab, and I can
- 2:25pick OneDrive, Outlook, Loop, Copilot,
- 2:27Azure, Sentinel, Intune,
- 2:30Admin Center,
- 2:31all
- 2:32the different things. Then I can customize what
- 2:34I want on there. That's a nifty one.
- 2:36I can see how that would be helpful
- 2:38in a work context.
- 2:40I I don't know that I'd use it
- 2:41too much on my personal one, but def
- 2:43definitely on the work side of things. Yeah.
- 2:45I don't know that it's a personal one,
- 2:46but for work and, frankly, I don't really
- 2:49care about the news that normally pops up,
- 2:50and I know you can tweak it. And
- 2:53I don't really wanna set portal to office.com
- 2:55since that doesn't even get me to my
- 2:57apps anymore. It just gets me to Copilot
- 2:59chat.
- 3:00Admin.microsoft.com.
- 3:03Yeah. Or use, like, Copilot
- 3:05or quad or chat GPT or whatever and
- 3:08pin pin that one in there. I use
- 3:10the Copilot one on personal edge. Like, it
- 3:13tends to do pretty good. The only thing
- 3:15I hate about it is it uses Bing
- 3:17as the search engine. So if it can't,
- 3:19like, auto resolve to yako.com
- 3:22or get yako.com,
- 3:23it fires me off into Bing. Then I'm
- 3:25left with Bing search results.
- 3:28I don't I don't need Bing search results
- 3:29in my life. But yeah. No. Cool. I'll
- 3:32have to try this one out, and we'll
- 3:35put a link to gityako.com.
- 3:39G,
- 3:40yeah, getyako.com
- 3:44by Merrill. Nice one. Again, probably more for
- 3:46work than personal because it doesn't have any
- 3:47of the well, I can't remember. Does it
- 3:49have personal m three sixty five stuff in
- 3:51there? I would have to go
- 3:53look. Oh, you can also switch it from
- 3:55classic icons. I know we've talked about these
- 3:57before if you want a new tab to
- 3:59be like msportals.io
- 4:01or cmd.ms.
- 4:03Yeah. I did see that. So so that's
- 4:05another project that Merrill has out there with
- 4:07the with the short links and things like
- 4:09that. So that that could be a helpful
- 4:11one as well. Oh, it does have some
- 4:13of the consumer stuff. So if you are
- 4:15just at home and you wanna do consumer
- 4:17stuff in it, you can do that as
- 4:19well.
- 4:21You're out of time. Copilot needs to be
- 4:23deployed ASAP, but is your tenant really ready
- 4:27for it? Years of data, permissions, and users
- 4:30lurk in its shadows, ready to be exposed
- 4:33by AI.
- 4:34Sharegate Protect sees it all, so you can
- 4:37find the exposure risks, fix them fast, and
- 4:39deploy AI with confidence.
- 4:42Microsoft three sixty five governance. We got this.
- 4:45Learn more at sharegate.com/governance.
- 4:53Now we can get into our topic if
- 4:54you want. That was just a nifty thing
- 4:56that popped up in my feed the other
- 4:58day and I was been playing with. And
- 5:00maybe a little bit of follow-up. So
- 5:02last time we recorded, we kinda talked about
- 5:05the co work situation and Claude co work
- 5:07and CoPilot co work.
- 5:09And
- 5:10that definitely sent me down the path of,
- 5:12like, hey. Let me play a little bit
- 5:14more with CoPilot CoWork and kinda see where
- 5:17I could see how far I could get
- 5:18with some of the stuff we had talked
- 5:20about, like, maybe, like, the limitations
- 5:22of not being able to interact with your
- 5:24local desktop or or local resources, all that
- 5:26kind of stuff. So
- 5:28custom skills in Copilot Cowork are kind of
- 5:31broken right now. They're they're a little frustrating
- 5:34to to work with along the way. Definitely
- 5:36ran into the I'm very used to kinda
- 5:40prompting
- 5:41LLMs at this point or a lot of
- 5:43these tools with questions to kinda help me
- 5:46refine a prompt and come up with a
- 5:47way to generate, like, the artifacts that you
- 5:49want. So rather than saying go in and
- 5:51build me this, it's ask me a couple
- 5:54questions that are gonna help. Like, here's the
- 5:55outcome I wanna achieve.
- 5:57So in,
- 5:58like, in the case of, say, like, Claude
- 6:01Code
- 6:02or
- 6:03GitHub Copilot CLI, things like that, or GitHub
- 6:05Copilot chat, it's very easy to go in
- 6:08and say, I would like to build a
- 6:09new skill that does
- 6:11blah blah blah. And then it will actually
- 6:13kinda ask you a couple questions,
- 6:15and it will frame out the markdown for
- 6:17you, and it will write it to the
- 6:19right directory for you, like, to the point
- 6:21where it where you can do
- 6:23install to just my local session or install
- 6:26this globally kinda thing. And Copilot Coburg kinda
- 6:29surprised me. It walked me in and it
- 6:30said, oh, you wanna create a new skill.
- 6:32This is great. I'll go create a new
- 6:34skill for you. What do you wanna call
- 6:35it? What do you want the description to
- 6:37be? And I already had all this markdown
- 6:39and stuff that I wanted to pump into
- 6:41it. So boom. Great. Click the go button,
- 6:44does its cheeky. I'm thinking about it and
- 6:46thinking and spinning the gears. And then it
- 6:48spits out an output for me, which is
- 6:50a skill quality report. So it gave me
- 6:53this very nice HTML file that said, I
- 6:56created your skill,
- 6:57and your skill has an 83, 84% score
- 7:01or whatever it is. Right? So it gave
- 7:02me this, like, nice dashboard that said, your
- 7:04skill is gonna be awesome and it passes.
- 7:06I don't know what it passes because it
- 7:08just generated me an HTML file that said
- 7:10my my my skill was really good. But
- 7:12it also hallucinated
- 7:13that it had ever created the skill. So
- 7:16it never actually went and created, like, the
- 7:18skill dot m d and put it in
- 7:19the right folder in my OneDrive and did
- 7:21all that stuff.
- 7:23So great that it told me my skill
- 7:24was awesome, and it generated a report that
- 7:26my skill was awesome. Not so great that
- 7:29it didn't actually generate my skill. It didn't
- 7:31actually create a skill? Maybe it did. Maybe
- 7:33it's in someone else's OneDrive. That was number
- 7:36one. Number two is actually finally did get
- 7:39that skill created. Had to go do it
- 7:40manually, provision it into my OneDrive. It's a
- 7:43little weird in the cowork frontier agent today
- 7:47because sometimes it sees your skills in your
- 7:49OneDrive, and sometimes it does not. So when
- 7:52you go and you do, like, slash commands
- 7:54in Copilot co work, you're presented with an
- 7:57interface of, like, people, skills,
- 7:59files, and these various things. So the very
- 8:02first time I created this skill, I went
- 8:03out there and I went and I just
- 8:05popped it into my OneDrive. I closed Copilot
- 8:07down, just the Copilot m three sixty five
- 8:10Copilot app, which I was just happened to
- 8:12be using, but it's that web wrapper. Loaded
- 8:14it back up, slash command. Oh, look. There's
- 8:17my skill. That's awesome. Like, didn't need to
- 8:18navigate around a bunch or do anything. Came
- 8:21back and
- 8:22so I did a quick chat with it
- 8:24just to see, like, okay. Does this work?
- 8:26Cool. It generated some output. Looks like it
- 8:28did the right thing that I wanted it
- 8:29to do. So then I spun up a
- 8:31new chat. Now mind you, I didn't close
- 8:33m three sixty five chat down. I didn't
- 8:35change anything in my OneDrive. Okay. Just a
- 8:38new session. Just a new chat session because
- 8:40now I'm like, oh, cool. This still works.
- 8:42Let me actually go, like, fire off and
- 8:43do what I wanted to do. New chat?
- 8:45I don't know about your skill. I've never
- 8:47seen this thing in the world, like, in
- 8:48my life. I I don't know what it
- 8:50is and what's going on. So you do
- 8:51the slash command, not there in the slash
- 8:53command. You actually knit browse straight over to
- 8:57the skills tab
- 8:58from the slash command, not there. But you
- 9:01I was able to say in my co
- 9:03work session, do you know about this skill?
- 9:05Can you please, like, use it when I
- 9:07put this what I wanna do in here?
- 9:09So it it eventually kinda wrangled itself. So
- 9:12I think that skills experience has a little
- 9:14bit of refinement to do, maybe something for
- 9:16folks to watch out for. The other thing
- 9:18that's
- 9:19been, I think, kind of getting on my
- 9:21nerves a little bit is as you're in
- 9:24Copilot Cowork and you're generating artifacts, so like
- 9:28in that very first run where it generated
- 9:30a skill report for me or or what
- 9:32I was trying to do with this custom
- 9:34skill that I spun out, it was ultimately
- 9:36spitting out some HTML files and some markdown
- 9:38for me as, like, an output. So those
- 9:40all go into your session, and you see
- 9:42them kind of in the Cowork,
- 9:45in in the co work frontier agent interface,
- 9:47like, it has a little bit of a
- 9:48different interface than the chat interface, and it
- 9:50says, here's your inputs, here's your outputs, blah
- 9:52blah blah. Good luck because well, at least
- 9:55in whatever build I'm on that's pushed out
- 9:57today or as of today, you cannot, like,
- 10:00right click those things and open in OneDrive.
- 10:03There is a little drop down like like
- 10:04an ellipsis there to click it and say
- 10:06open in OneDrive. Doesn't work for me at
- 10:08all. So then you gotta go manually browse
- 10:10your OneDrive. So you go into your OneDrive,
- 10:12you go into your documents folder, you go
- 10:14into your co work folder. And then in
- 10:16your co work folder, well, you've got skills,
- 10:18which is where you load your custom skill,
- 10:20and then you've got sessions. And then each
- 10:22session is a GUID. So if you do
- 10:24multiple chats per day or anything
- 10:26more than, like, one or two with co
- 10:28work for the day, now you have these
- 10:30folders that are just GUIDs. And, hopefully, you
- 10:32can figure out by timestamp which one is
- 10:35the right folder because you have to browse
- 10:37into that GUID folder, and then there's an
- 10:39outputs folder in there, and then that's where
- 10:41your artifacts end up. So it's a
- 10:45it's got some rough edges and some friction
- 10:47today. And it immediately drew drove me back
- 10:50to GitHub Copilot CLI, at least, because I
- 10:53I have access to that or GitHub Copilot,
- 10:56I guess.
- 10:57And the other thing is I was hoping
- 11:00that because
- 11:02Cowork
- 11:03is
- 11:04in the
- 11:05cloud ecosystem to start, that it would be
- 11:08able to get by some limitations
- 11:10that I potentially run into in my day
- 11:12to day being on the CLI or the
- 11:14desktop.
- 11:14And probably one of the biggest ones
- 11:17is I often have,
- 11:19like, multiple artifacts, could be presentations,
- 11:22Word documents, excels, things like that, that I
- 11:25kinda wanna, like, iterate over and riff on
- 11:27and come out with those ideas and go
- 11:30back and forth on my thinking around them.
- 11:32So on the desktop, I run into a
- 11:33lot of issues because I have my OneDrive
- 11:36and I have things synced and both my
- 11:38work OneDrive and then I use shortcuts a
- 11:41bunch too, so I have shortcuts back to
- 11:43SharePoint sites. A lot of the content that
- 11:46I iterate on day over day and throughout
- 11:48my day is
- 11:50IRM ed. So it has some kind of
- 11:53information rights management or, like, MIP information protection.
- 11:57Encryption on the files. Yep. Yeah. So when
- 11:59you're on your desktop and you're sitting there
- 12:01in, like, GitHub Copilot CLI, well, it's got
- 12:03a skill to read Word documents. Just
- 12:06uses the anthropic
- 12:07word
- 12:08skill, but that can only read nonencrypted content.
- 12:10It can't even though it has your user
- 12:13contacts and you're saying do this or go
- 12:15into my, like, physical folder on my OneDrive
- 12:17kinda thing, it can't do it. So I
- 12:19was kinda hoping that, like, Cowork would maybe
- 12:21help solve that for me, and I could
- 12:22just rethink some of the skills I use
- 12:24in the cloud world. Cowork can't read my
- 12:26protected documents either. It just blows up and
- 12:29says, sorry. I can't do this. Is it
- 12:31because it's sending it over
- 12:33to Anthropic into Claude versus
- 12:37when you use the GPT models that's staying
- 12:39in
- 12:40the Azure data centers and it's going to
- 12:42the models internally? That would be my assumption
- 12:45if that's the case because
- 12:47those MIP protected documents,
- 12:49I can use in things like Copilot notebooks
- 12:52when I'm in GPT mode. And then, oh,
- 12:54yeah. We should also talk about so, Anthropic
- 12:57had an outage earlier this week on their
- 12:59API surface,
- 13:00and it happened to be when I was
- 13:01in the middle of one of my Copilot
- 13:03co work sessions,
- 13:04completely bombed out. Like, the session crashed, and
- 13:07if I try and go back into that
- 13:08chat now, I just end up on a
- 13:09page that says, sorry, like, sorry, Dave. I
- 13:12can't do this right now. Can you sign
- 13:13back in? Like, I am signed in. But
- 13:16I I basically just lost
- 13:18the ability to go back in and see
- 13:19any of that chat history or anything
- 13:22for that session that's out there. So that
- 13:24that that was an interesting moment for me
- 13:26as well because I was trying to debug
- 13:28it. Like, what happened and what's going on?
- 13:29Is m three sixty five
- 13:31down right now? Like, why is just this
- 13:33one chat broken? And it turns out it
- 13:36coincided exactly
- 13:38with the anthropic
- 13:40API outage. So it was a good reminder
- 13:42for me of, like, that mental model of,
- 13:44like, when you're in Copilot Cowork,
- 13:46you are, I I guess, using just the
- 13:49anthropic APIs.
- 13:51So a lot of that stuff does start
- 13:52to click then about, like, oh, hey. I
- 13:54can't read and or open that IRM document
- 13:58and all those kinds of things. So that
- 14:01that's a, like, funny, like, I guess, limitation,
- 14:04but that I just I was not prepared
- 14:07for and I did not have in my
- 14:08head to even think about, here's one more
- 14:11modality or, like, mental model that I need
- 14:14to carry as a user
- 14:15into
- 14:16leveraging these tools.
- 14:19If you're managing file storage today, you've probably
- 14:22felt the pressure. Refresh cycles are harder to
- 14:25plan, costs and complexity are increasing, especially as
- 14:28file workloads scale across regions.
- 14:31That's why Microsoft customers trust Nasuni as an
- 14:34Azure certified software.
- 14:36Nasuni provides a global file system designed for
- 14:39enterprise scale environments,
- 14:41keeping file data secure, governed, and accessible across
- 14:44Azure environments without added infrastructure complexity.
- 14:48It's the foundation to keep your unstructured data
- 14:51stable even as your infrastructure evolves. To see
- 14:54how much you could save while keeping your
- 14:56initiatives on track, visit nasuni.com/tco.
- 15:02That's nasuni.com/tco.
- 15:08So do you want to talk about our
- 15:10topic, or do you want me to bring
- 15:11up something that popped into my head since
- 15:14we're on this topic and you brought that
- 15:15up? I mean, it's your show. Not really.
- 15:18Keep going with this. So this brings up
- 15:20an interesting thought then. Right? Because
- 15:23that would also
- 15:26seem to imply
- 15:28that your chat session,
- 15:30is it not being stored
- 15:33in Microsoft three sixty five? So then, like,
- 15:35did that get corrupted
- 15:38in Microsoft three sixty five data, or is
- 15:40it the fact that Microsoft three sixty five
- 15:42to earlier point can't reach back out to
- 15:46the API
- 15:47to grab that session from Claude?
- 15:51In which case, if all that data's in
- 15:53Claude,
- 15:54what does that
- 15:55start
- 15:56implying for things
- 15:58like auditing
- 15:59and
- 16:01retention
- 16:02and
- 16:04sensitivity
- 16:05labels when it comes to chat? Like, this
- 16:08is something, and I don't know if I
- 16:10should go pop open mine while we're talking,
- 16:12is
- 16:14do your clogged conversations
- 16:17in Cowork
- 16:18function the same way that a conversation
- 16:22would in a GPT model when it comes
- 16:24to sensitive information and sensitive content and, I
- 16:27guess, almost like that data
- 16:30sovereign sovereignty
- 16:32data sovereignty
- 16:33type scenario. I would imagine,
- 16:36and this is conjecture
- 16:37because I haven't seen it, like, formally documented.
- 16:39But today, when you're in an m three
- 16:41sixty five tenant, you can have the OpenAI
- 16:44and GPT models kinda, like, by default. That's
- 16:46your default mode. You have to go and
- 16:49explicitly enable anthropic and basically sign the legalese
- 16:52that you're good with your data You're using
- 16:54that. Leaving
- 16:55the boundary of Microsoft's cloud because you are
- 16:58chatting
- 16:59with a model that at least is hosted.
- 17:02So even if you're not sending the data
- 17:04out, you're still sending the chat out. So
- 17:06if you're chatting about something that's potentially sensitive
- 17:09to your business, that would just be passed
- 17:11in natural language, right, via your prompt over
- 17:14to
- 17:15over to that side of things. So I
- 17:17I know,
- 17:19you know, organizationally where I am, like, there
- 17:21there is a big difference in functionality between
- 17:24folks in The US and Europe because we
- 17:27haven't lit up anthropic due to GDPR and
- 17:30things like that for those for that set
- 17:32of users. So that that that does make
- 17:34it tough. Like, some things potentially aren't available
- 17:37to some folks based on, like you said,
- 17:39data sovereignty, data residency,
- 17:41GDPR,
- 17:43various legal requirements, things like that that that
- 17:46are out there. And
- 17:48you asked, like, where are the chats
- 17:51stored? I have no idea.
- 17:53I would hope that they're stored in the
- 17:55same place as, like, my, like, grounded memory
- 17:58for, like, my m three sixty five chats.
- 17:59But when is that? I I don't know.
- 18:01Like, that chat that crashed for me, and
- 18:03it just happened to be I I was
- 18:04in there prompt in a way and firing
- 18:06off requests, like, just when that anthropic API
- 18:09went down. That that thing, like I said,
- 18:11I can still get to the files because
- 18:13they're in my OneDrive. I can see the
- 18:15session ID and, like, I can map back
- 18:17to the GUID and the day and the
- 18:18time
- 18:19when that thing happened. So that's good. Like,
- 18:22the file storage is still there. I lost
- 18:24all the chat history. I've I have no
- 18:25idea where that is and what that looks
- 18:28like, along the way. So there is a
- 18:30little bit in the docs around, like, how
- 18:32does Cowork handle
- 18:34data. So authentication,
- 18:36super easy. Right? That's just your m three
- 18:38sixty five credentials and your org ID. Tenant
- 18:41isolation,
- 18:42so you can only
- 18:43work with data within your organization's tenant. Easy
- 18:46enough,
- 18:47because you can't access data
- 18:49cross tenant. And because you can only work
- 18:51with cloud data, like data in SharePoint or
- 18:54OneDrive, well, that that kinda takes care of
- 18:56it because you don't have to worry about
- 18:57the local access thing or anything like that.
- 18:59And if you did upload some data to
- 19:00the chat, it would get uploaded to your
- 19:02OneDrive and be part of the the session
- 19:04and all that. So file storage taken care
- 19:06of. You you're you're in OneDrive or SharePoint
- 19:08within your tenant. What's not clear is there's
- 19:10a little bullet when you go into the
- 19:12co work docs that says data subject rights.
- 19:15Access deletion,
- 19:16rectification, and portability requests are supported in accordance
- 19:20with Microsoft's privacy standards.
- 19:22Okay. So I would imagine that's, hey. I
- 19:25went into the m three sixty five admin
- 19:26portal and I clicked yes. Users within geo
- 19:29x y zed can get access to anthropic
- 19:32models, and then it's just off to the
- 19:34races from there. So, Scott, while you were
- 19:36talking, I just did a fascinating test on
- 19:39Copilot in my environment. Oh, you just asked
- 19:41it just to see if you could get
- 19:42it to leak again?
- 19:44No. We're not talking about what I got
- 19:45it to leak before. That's
- 19:48secret. If you run into me at a
- 19:50conference, come ask me. I am not recording
- 19:52when I got it to leak.
- 19:54I went into cowork. So I have a
- 19:55document in my environment. Let me preface this.
- 19:58I will more than happily give you these
- 20:00screenshots too if we wanna put them in
- 20:01the show notes. I have a document in
- 20:03my environment that I put a sensitivity label
- 20:05on. Mhmm. I did not encrypt it, so
- 20:07it's not using AIP or MIP or any
- 20:09of those, just a sensitivity label that's for
- 20:13labeling purposes.
- 20:14And then in my DLP policies,
- 20:16I
- 20:17put a policy
- 20:18or a Copilot and Copilot chat
- 20:21blocking
- 20:22Copilot
- 20:23from
- 20:24essentially accessing the content in this document
- 20:27or doing anything with the document. So it's
- 20:30just a simple test document. Like, in it,
- 20:32I wrote the color of the chair is
- 20:33blue,
- 20:34the color of the ocean is red, or
- 20:36something just something goofy like that. So if
- 20:39I go into Copilot chat, just normal Copilot
- 20:42chat session, make sure I'm on the work
- 20:44tab so I can get to my data,
- 20:46and I just do a slash command DLP
- 20:48policy test doc, what color is the chair
- 20:50based on this file, and Copilot returns to
- 20:53me, I attempted to open DLP policy test,
- 20:55but the content is blocked due to your
- 20:57organization's data loss prevention policies.
- 21:00Because of that, I don't have any visibility
- 21:01into the file's content, can't determine the color
- 21:04of the chair, blah blah blah blah blah
- 21:05blah blah. So works just like it intended.
- 21:08I did I wasn't paying attention. I had
- 21:10it on the web chat for a little
- 21:11bit too. I can still do a slash
- 21:13command and reference the document. And
- 21:15I asked it the same thing, and it
- 21:18just said it can't determine the color of
- 21:20the chair because there's no image content associated
- 21:23with it. It's text only, no description.
- 21:25I guess it kinda makes sense. It must
- 21:27be the difference that a web Copilot chat,
- 21:30how it interacts with the document versus on
- 21:32the work tab. Interesting that it didn't reference
- 21:35the DLP policy even though I added the
- 21:37document to the chat, but it still couldn't
- 21:39get to it. Then I went into Cowork
- 21:42and did the same thing. DLP policy, test
- 21:45doc, what is the color of the chair
- 21:46based on the file? Based on the document,
- 21:48the chair is blue. Cowork
- 21:50does not respect
- 21:52Copilot DLP policies. You turn this stuff on.
- 21:55You you use it.
- 21:57User discretion is advised. Yeah. And if you
- 22:00are doing DLP policies, you may want to
- 22:03and I get, like, Cowork's still frontier. Right?
- 22:06It still preview
- 22:07all the normal stuff, but
- 22:09CoWork at this point in time
- 22:12does bypass
- 22:14some of those
- 22:15security features that, I guess, I feel like
- 22:19by default,
- 22:20it would have been on that
- 22:23if we're gonna if I'm gonna go in
- 22:25and configure sensitivity labels and security and exclude
- 22:28certain things from Copilot,
- 22:30that it wouldn't be able to bypass it
- 22:32in that type of scenario. Maybe it gives
- 22:34a little credence to the do use things.
- 22:36Like, like, I can tell you, if you
- 22:37use MIP and it's encrypted, it's like,
- 22:40you're not get you're not getting that thing.
- 22:42You're safe there. I will say you're safe
- 22:44ish there. Like, you're
- 22:47as a user, there's still things that you
- 22:49can potentially do. So
- 22:51so for example, like, you can copy and
- 22:53paste data out of a a Word document.
- 22:55Right?
- 22:56And LLMs
- 22:58speak markdown.
- 22:59So while I was looking to see,
- 23:02okay, is there a way that I, like,
- 23:04I can make all this stuff work? I'm
- 23:05trying to, like, Google Bing, DuckDuckGo my way
- 23:08through life and see if I can figure
- 23:10this out. I did see some articles out
- 23:12there from folks who were talking about kinda
- 23:16markdown as the language of LLMs, which is
- 23:18true. And there's all these, like, just open
- 23:21websites that
- 23:23have fancy
- 23:24JavaScript engines, or there's a really nifty extension
- 23:27for Versus Code, which does paste as markdown.
- 23:31So you can copy your Word doc, just
- 23:33control c, give me all this content, and
- 23:35you can go and paste it into a
- 23:37markdown file. And then it's just out in
- 23:40the wild.
- 23:41Mark markdown's not getting a sensitivity label and
- 23:45IRM'd and all that stuff. So And all
- 23:47those. That's another
- 23:49thing I think that maybe, like, folks gotta
- 23:51think about. Like, it it's really just exciting,
- 23:54scary,
- 23:55interesting
- 23:55to
- 23:57kinda see the evolution of these things and
- 23:59see where the gaps
- 24:00and things come up all along the way.
- 24:03Like, I I don't envy, like, because I'm
- 24:06talking through these situations.
- 24:07Like, I don't envy, like,
- 24:09CSOs or things like that or chief information
- 24:12officers having to or legal. Right? Like, trying
- 24:14to figure out, hey, what do we do
- 24:16in our organization
- 24:17when it comes
- 24:19to the use of
- 24:20these models and these systems and contracting with
- 24:24these various vendors and things that are out
- 24:26there? Because in a world of just anything
- 24:29can be converted to raw text,
- 24:31then
- 24:32you you can just egress it and have
- 24:34it out there kinda thing. And so, like,
- 24:37I was playing around with that paste to
- 24:39markdown extension of Versus Code. Super cool, like
- 24:41I said, but you can do things like
- 24:44you can paste, say like an image
- 24:46from a website or from a document, and
- 24:49when you paste it in, it gets pasted
- 24:51as a base 64 encoded just native image
- 24:54in there. So it it's not even like,
- 24:56if you had, like, sensitive data in a
- 24:58flowchart or something like that coming through, you
- 25:00could potentially leak that into an LLM or
- 25:02something like that. So def definitely some stuff
- 25:05to think about. Yeah.
- 25:11This episode is brought to you by Trusted
- 25:13Tech. If you're managing Microsoft three sixty five,
- 25:17you already know licensing isn't simple.
- 25:19E three versus e five, the brand new
- 25:21e seven licenses, Copilot security bundles, and with
- 25:25price changes coming in July 2026,
- 25:28the stakes are getting higher. Trusted Tech helps
- 25:30IT leaders make sense of their Microsoft three
- 25:33sixty five environment with a free licensing consultation.
- 25:36Their engineers
- 25:37analyze what you're licensed for and what you're
- 25:40actually using and where you can optimize, whether
- 25:42that means consolidating
- 25:44security tools, preparing for Copilot, or eliminating wasted
- 25:48spend.
- 25:48Plus, they offer proactive and reactive support, which
- 25:52has been awarded yet another solution partner designation
- 25:55from
- 25:56Microsoft for support services.
- 25:58If you want a clear, data backed plan
- 26:01that has helped over 7,500
- 26:04subscribing customers save up to 20% on Microsoft
- 26:07three sixty five before your next renewal, visit
- 26:10trustedtech.team/mscloudprom365
- 26:17and schedule
- 26:18free consultation today.
- 26:24I was playing around with this a little
- 26:26bit more. Like, if I use the Claude
- 26:28model like Opus in chat, DLP works. I
- 26:32just tried it with another agent that I
- 26:35built that uses, like, WorkIQ
- 26:37and
- 26:38all the different m three sixty five ones.
- 26:40And that one,
- 26:42it does pick up that the file has
- 26:44a sensitivity label on it, and it says
- 26:46access to the files
- 26:47with
- 26:48the sensitivity label
- 26:50will be as per org policy.
- 26:52So it doesn't look like it's necessarily
- 26:56even tied to agents or
- 26:59the specific model because this agent I did
- 27:01set to use, I think it was Claude
- 27:034.6.
- 27:05It does look to be very
- 27:08at least a DLP
- 27:09policy
- 27:10workaround
- 27:11does appear to be something
- 27:14cowork specific
- 27:16and not
- 27:17necessarily
- 27:18agent or
- 27:19model based. Now we don't know how the
- 27:21data necessarily flows
- 27:23to
- 27:25Claude and the cowork agent versus an agent
- 27:27I built versus
- 27:29Opus in a Copilot chat. I don't know.
- 27:32I think it gets to some of what
- 27:33we've talked about before is
- 27:35Copilot feels overly complex, I guess, when it
- 27:38comes to some of this stuff. Like, this
- 27:39feels like something I shouldn't have to be
- 27:43I shouldn't have to have five different ways
- 27:46to five different places I have to validate
- 27:49that my sensitivity labels work. Like, if I
- 27:51say this is excluded from Copilot,
- 27:54it shouldn't matter
- 27:55what I'm doing in Copilot. It should be
- 27:57uniform across the entire platform. We could go
- 28:00down this rabbit hole for a long time.
- 28:01Right? So think about we've talked in the
- 28:03past about, like, declarative agents. So great. Super
- 28:06easy to spin up. I wanna give this
- 28:08thing a description. There's also going down the
- 28:11path of, like, full foundry agent that you
- 28:14can, like, publish as a native agent out
- 28:17to Copilot and to Teams and all those
- 28:20other kinds of things that are out there.
- 28:22So that's another interesting scenario because now I'm
- 28:24not, like, in a declarative agent. I'm in
- 28:26an agent that sits over in Foundry, which
- 28:29is in Azure land. Sure. Still still within
- 28:32the boundary of my tenant for identity and
- 28:35all that kind of stuff, but not necessarily
- 28:37within the boundary of my tenant as far
- 28:39as, like, m three sixty five is hosted
- 28:42and not, like like it's not Azure. It's
- 28:44m three sixty five and Azure
- 28:46kind of thing. So you can also kinda
- 28:48have, like, that just
- 28:51have to think through, like like, alright. What
- 28:53does that mean? And, like I said, it's
- 28:55not I and maybe it's me. And I
- 28:57totally they get this could be a me
- 28:59thing, but I also think it's a little
- 29:00bit of, like, a Microsoft thing and just
- 29:01how it's presented, documented, pushed out there. Like,
- 29:04I spent a decent amount of time trying
- 29:07to go out and find and tell me,
- 29:09like, how some of this stuff works, where
- 29:11does sensitivity of labels lie, where does DLP
- 29:14apply, all these things. And it's not, like,
- 29:17well done, I guess. Like, you can go
- 29:19with, like, into the purview docs, like, for
- 29:21sensitivity labels, and it'll tell you, like, hey.
- 29:24This works with Copilot chat and Copilot agents.
- 29:27But is that true? Is that just Copilot
- 29:30declarative agents, or is that Copilot Foundry agents
- 29:33that then that agent in Foundry could have
- 29:36access to other tools? It could have, like,
- 29:38logic that potentially ships your data between different
- 29:41tools and has different integrations. Like, I don't
- 29:43know. The whole thing weaves in weird ways.
- 29:46So
- 29:47much like I'm, like, just delighted by, like,
- 29:49being back in terminals and CLI experiences and
- 29:52things like that, you can see all this
- 29:55potential there,
- 29:57but the rough edges, the friction, just the
- 29:59mental overhead, I think, for users, and I'll
- 30:02I'll totally admit, like, you and I are
- 30:04probably more on the advanced side where we're
- 30:06thinking about these things where most other people
- 30:08aren't. They're just hopping through life going like,
- 30:10oh, researcher, help desk, a new chat, word
- 30:12and web. I don't know the difference. So
- 30:13I was just start or work in web.
- 30:15I was just starting work, or I was
- 30:16just starting web. Oh, I didn't know you
- 30:18could select a model, any anything like that.
- 30:20So you've got that full spectrum too of,
- 30:23I I think just kinda
- 30:25personas and
- 30:26folks that are gonna be out there using
- 30:28these things.
- 30:29Wild times.
- 30:30We'll see. This will be interesting to keep
- 30:32coming back to, and I promise we'll get
- 30:34to our topic that we were gonna talk
- 30:36about eventually.
- 30:37Someday, we'll get there. We'll see. That that
- 30:39was a backup anyway, but thank thanks for
- 30:41letting me rant a little bit or at
- 30:43least do some follow-up on co work. No.
- 30:45I think it's how we all learn. Right?
- 30:47Like, some say, hope if one person out
- 30:49there listens to this and their takeaway is,
- 30:52I was thinking about playing with it, but
- 30:53maybe I'm gonna wait a couple weeks until
- 30:55it refines a little bit more. Maybe we
- 30:57save somebody else a a little bit of
- 30:58toil and overhead. Even you and I talking
- 31:01about it and starting to think through, again,
- 31:03like, the DLP policies and sensitivity labels, and
- 31:05I hadn't even thought about that before until
- 31:09you brought up that thing about it crashing
- 31:11and losing your session of where is this,
- 31:13and how is this looking at those. So
- 31:15appreciate it. If you come back and listen
- 31:17to this, here's your thing. Right? We'll dump
- 31:19the transcript out, throw this through an LLM,
- 31:22and have this just write your next m
- 31:24three sixty five Copilot
- 31:26whatever security workshop for you. Exactly. That's it,
- 31:30Scott. Podcast, we're gonna
- 31:32multipurpose this content. That's the plan. Right? I
- 31:34will let you go get to your weekend.
- 31:36I'm gonna go try to get a few
- 31:37more things done before my weekend, and my
- 31:39wife is standing outside the door texting me
- 31:41for my order for dinner. Alright. I'll let
- 31:44you go. Thanks as always, Ben. Appreciate it.
- 31:46Thanks, Scott. We'll talk to you later. Bye.
- 31:47Bye bye.
- 31:50If you enjoyed the podcast, go leave us
- 31:52a five star rating in iTunes. It helps
- 31:54to get the word out so more IT
- 31:56pros can learn about Office three sixty sixty
- 31:58five and Azure.
- 31:59If you have any questions you want us
- 32:01to address on the show, or feedback about
- 32:03the show, feel free to reach out via
- 32:05our website, Twitter, or Facebook.
- 32:08Thanks again for listening, and have a great
- 32:10day.