Latest / Microsoft Cloud IT Pro Podcast / Episode 370 – Revisiting Microsoft 365 Copilot
Transcript
- 0:03- Welcome to episode 370
- 0:05of the Microsoft Cloud IT Pro podcast
- 0:09recorded live on February 9th, 2024.
- 0:12This is a show about Microsoft 365
- 0:14and Azure from the perspective of it pros
- 0:16and end users where we discuss a topic or recent news
- 0:20and how it relates to you.
- 0:22In this episode, Ben
- 0:23and Scott circle back to Microsoft 365 copilot
- 0:27where they discuss the recent changes
- 0:29to Microsoft 365 copilot licensing, which now allows tenants
- 0:33with less than 300 users to purchase licenses.
- 0:36They shared their experiences with Microsoft 365 copilot
- 0:40and their own tenants
- 0:42and explore its capabilities
- 0:43beyond just a summarization tool.
- 0:45They also delve into how it can assist
- 0:48with Outlook, word, PowerPoint.
- 0:50Microsoft teams tune into this episode
- 0:52to hear their thoughts and insights on this powerful tool.
- 0:57Here we are, we shouldn't ramble,
- 1:00but I've been so scatterbrained this week.
- 1:01It's been busy the last,
- 1:03it hasn't slowed down like ever since December.
- 1:06I started getting busy in December
- 1:07and I feel like I've just been slammed ever since December
- 1:10- .
- 1:12Yeah, it's weird out there, right?
- 1:14Like I don't know how you feel
- 1:16or how most folks feel in their job,
- 1:18but it's pretty easy some days to walk away
- 1:20and go like, I think I did too much today, .
- 1:24Like I was, I was talking
- 1:26to another person on our team the other day
- 1:28and they go, yeah, I feel like I'm like an FT plus one.
- 1:32Sometimes it's like, hmm, I don't know
- 1:35that I could justify like feeling like I'm really
- 1:37like two Xing it.
- 1:39But yeah, there's times like definitely like 1.5,
- 1:42especially when I realize that I'm to the point now
- 1:45where I'm like on one meeting
- 1:47but I'm maybe chatting in a window on another meeting
- 1:49or I'm like, oh hold on, I'll be right back
- 1:52and be right back is I gotta go join another call
- 1:55for five minutes and then go take care
- 1:57of whatever fire is over there
- 1:58and then come back over the other way.
- 1:59So, uh, I don't know where rear relief comes
- 2:03but take time off.
- 2:04That's, that's what time off is there for.
- 2:06- I should, but I am totally with you.
- 2:08I, I just looked I could, I am actually probably close
- 2:11to one point fiveing it
- 2:13'cause I looked, it's the 9th of February and
- 2:17because I do the whole consulting contracting thing,
- 2:20like I kinda guide how much I'm doing.
- 2:23There's certain points I wanna hit in terms of number
- 2:25of hours by certain points of the month, all of that.
- 2:28Considering that's the ninth, we're not quite a third of,
- 2:31well it's February, it's a short month
- 2:34so we are a third of the way through it.
- 2:36But in terms of hours I'm at about half
- 2:38of what I normally do.
- 2:39So current trend, I will work about one
- 2:42and a half more hours this month than is my goal
- 2:46or maybe 1.5 x
- 2:48- .
- 2:49Not, not just one and a half hours more.
- 2:50- Yes. 1.5 times.
- 2:521.5 times the amount , I mean it makes
- 2:54for a little nice February bonus when payday comes,
- 2:57but in terms of my sanity it's not good.
- 3:00- Not so much. Yeah, no. So I'm curious.
- 3:02We should do a kind of wraparound on
- 3:06co-pilot as well.
- 3:08Okay. Kind of before we get into today's topic.
- 3:10So I think you've had an opportunity to play
- 3:12with co-pilot a little bit maybe in sandbox environments,
- 3:15but certainly like availability out there,
- 3:17like it's available in more places.
- 3:19Yes, you have the opportunity to unlock it for personal use.
- 3:24There's like copilot pro for MSAs
- 3:28for like Microsoft accounts that you can go
- 3:30and get for like a personal Microsoft account
- 3:31for $20 a month and then there's the
- 3:35M 365 copilot variance,
- 3:38but those got unlocked for tenants with less than 300 users.
- 3:43I got access to copilot about a week ago,
- 3:47maybe a week or two ago.
- 3:48Okay. I had the flu one week so I was kind of out of it.
- 3:51But I know there's been a lot of folks that are kind
- 3:53of coming back and maybe don't have it in their own tenants
- 3:57yet or certainly not actionable on top of their own data.
- 4:01And I just kind of wanted to maybe give a little bit
- 4:04of a review as somebody who recently got access to it
- 4:09and has admittedly only scratched the surface.
- 4:11But I think I get a sense for,
- 4:14or I'm starting to get a sense for
- 4:16where it's helpful for me and my job.
- 4:18- We could talk about a whole bunch of things we could punt
- 4:21and go completely to copilot
- 4:22because there is some interesting things.
- 4:24So like you said, I had it in Sandbox for a little while
- 4:26and then shortly after we got it in Sandbox I,
- 4:31they lowered that limit under
- 4:33300 and I was like, you know what?
- 4:34Sandbox is cool, but to your point it's not my data.
- 4:38So I went
- 4:39and I bought two licenses
- 4:42for my tenant the day they dropped that.
- 4:45Well the day after they dropped that 300
- 4:49license limit
- 4:51because the only way
- 4:53to get it at least, oh it did show up.
- 4:56I went and looked. The only way to get it like
- 4:59that first week or so it came out was through a CSP
- 5:03and my CSP is me,
- 5:05but my company I used for my CSP
- 5:09- Weird limitation by the way.
- 5:10- Yes. The company I use for my CSP,
- 5:12'cause I'm like, I think it's technically an indirect CSP
- 5:15didn't have it available in their
- 5:16marketplace till the day after.
- 5:18So then I went and got it.
- 5:19It does look like now you can go get it through
- 5:23just the normal M 365 marketplace.
- 5:26It just logged in as an admin and another tenant
- 5:29and it is showing up there as available to just go in
- 5:34and purchase right through the
- 5:38like admin do microsoft.com.
- 5:40But I have had the chance to use it some too.
- 5:42So do you wanna talk about uses for it?
- 5:45How much do you wanna talk about copilot today Scott?
- 5:47- I was gonna kind of scratch the surface of it,
- 5:48but we keep going down this rabbit hole. Okay.
- 5:50- We can scratch the surface.
- 5:52- I will say as someone who also pays for chat GPT,
- 5:57like I wanted access to chat GPT plus
- 6:00and kind of the different models
- 6:02and things that come along with it.
- 6:03Like I was really down on chat GPT,
- 6:08like I, I was seeing a lot of the examples
- 6:10that were out there for what folks were doing with it
- 6:13and I was either physically constrained
- 6:18or artificially constrained due to
- 6:22like my employer and the nature
- 6:24of things that I work on, right?
- 6:25Like so like lots of stuff is NDA
- 6:27so I can't take say like an internal roadmap
- 6:31or like an internal strategy in a given area
- 6:33and like copy pasta that thing and put it over in chat GPT.
- 6:37Like that's just not gonna fly.
- 6:39It's not gonna work and I'm not gonna do it.
- 6:41So I think for like for me chat GPT
- 6:44and even co-Pilot Pro, like I'm missing out on a lot
- 6:48of the things that would make it valuable to me
- 6:50because back to that whole like were like 1.5 x-ing our
- 6:54jobs, like we're spending almost more time at work than we
- 6:56are on the personal stuff at this point.
- 6:58So that's where like all the data and all the gravity
- 7:01and all the things live, I've also found
- 7:05that chat GPT is like a singular tool is
- 7:09very much just that like it is siloed and, and it
- 7:12and it's very off on its own versus co-pilot which has kind
- 7:16of been a little bit muddy in the M 365 space for me.
- 7:19Like what's the distinction like say
- 7:22with like a team's premium feature like meeting recaps
- 7:25versus co-pilot,
- 7:26like the whole nuance is lost on me at this point
- 7:28because there's things like generative AI
- 7:30that runs across the transcript
- 7:32and gives you, you know, an overview of the meeting
- 7:35and what was said in it, what are next steps,
- 7:37action items, all those kinds of things.
- 7:40So what I like about it off the cuff is
- 7:44having access to a rich set of like features
- 7:48for generative AI across workloads is kind of awesome
- 7:52'cause it's, it's very consistent in that.
- 7:54So things like teams like hey
- 7:56I'm gonna record a teams meeting.
- 7:57That meeting is going to be transcribed and
- 8:00because it's transcribed, the large language model
- 8:03that copilot uses can run across it for summarization.
- 8:06So things for like meeting recap that stuff is awesome.
- 8:11I think the way I framed it like in in the Discord is like
- 8:14it's really clutch, it's hit or miss with names like
- 8:17and that's to be expected to a certain degree.
- 8:20I think like I work for a multicultural multinational
- 8:24organization like I don't expect it
- 8:26to nail every single name that it puts into things either
- 8:30for people or products
- 8:32but like gets close enough that I can figure it all out.
- 8:37I think the best things there
- 8:38for like the generative meeting recaps is auto capture
- 8:43of next steps surprisingly accurate
- 8:46and doesn't hallucinate a lot.
- 8:47Seems to hallucinate a little bit more in the notes maybe
- 8:50and I think it's just giving like extra alliteration
- 8:53sometimes than it does in things like next steps.
- 8:57And then I think like, and this is again muddy for me,
- 9:00there's some kind of cool features in like meeting recap in
- 9:03teams itself and the team's client
- 9:04and the new client that they kind of like go together
- 9:08with the generative AI and the summarization
- 9:11and they make it all really cool.
- 9:13So like on the meeting recap pane,
- 9:14now when you hit play on the recording you can actually jump
- 9:17to like where the person is talking.
- 9:19So I know a stream could always jump to
- 9:21where it was in the transcript,
- 9:22but this gives you a bunch of visual indicators.
- 9:24So like I can see that like, oh Ben
- 9:27and Scott are in this meeting and I'll actually see a row
- 9:29for Scott and a row for Ben
- 9:31and then I can click just where Ben talked like I know like,
- 9:33hey about 30 minutes into this meeting
- 9:35Ben talked about this thing here.
- 9:36You can just go ahead and click that
- 9:39and pull it up and it's all good.
- 9:40It also does an excellent job of extracting the meeting chat
- 9:45and any of the artifacts included in the meeting chat.
- 9:48So I don't know about, you hop on a lot of, I hop on a lot
- 9:51of meetings and things like links to docs
- 9:54or links to external sites.
- 9:55All those things are shared in the meeting chat
- 9:57and the recap just pulls all that stuff together.
- 10:01So that's super cool. Another team slash copilot crossover
- 10:06is co-pilot in a teams meeting
- 10:09that's already in progress and being recorded.
- 10:12So you can have access to copilot chat as like chat just
- 10:16for me between me and copilot while a meeting is going on.
- 10:20So that's great if you're in passive meetings,
- 10:24like you can actually ask copilot like hey
- 10:27what just happened in the last three minutes?
- 10:29And it'll go back in the transcript and pull it out for you.
- 10:31Like if you misheard something like you don't have
- 10:33to stop the whole meeting and interrupt if you're a couple
- 10:35minutes late to a meeting you can say in copilot,
- 10:38just catch me up and it just goes back
- 10:41and kind of ingests the transcript
- 10:43and gets it to where it needs to be.
- 10:45Such cool features
- 10:46that I'm basically recording every single
- 10:49teams meeting I'm in.
- 10:50Whether it's like a meeting that I set up personally,
- 10:52like I'm kind of like recording everything other than
- 10:55one-on-ones right now because I'm finding it so valuable
- 10:58to have access to the generative AI summaries,
- 11:03recaps and just the ongoing things in there
- 11:06and even the ability to go back later.
- 11:08Like you can go to copilot in teams
- 11:10like your actual copilot app in teams or your copilot chat
- 11:15and you can say like, Hey tell me what happened
- 11:18between Scott and Ben in that meeting last week on Friday.
- 11:22And as long as this thing's recorded
- 11:23and it's out there, it'll just go back
- 11:25and scrape the transcript.
- 11:26It'll scrape the chat from the meeting and all the things
- 11:29and kind of like give you like a net new like
- 11:31mini recap right there.
- 11:34So it's all very good for that.
- 11:36I also like the generative AI for presentations.
- 11:41So copilot in PowerPoint like hey go take this
- 11:46specification or this kind of like product requirement doc
- 11:50or this, you know, deck on a status update, whatever it was
- 11:54and turn it into this other thing.
- 11:57And that's good when it works.
- 12:00I don't think it works as often as it's supposed to.
- 12:02Mostly because of token limits in the language models.
- 12:06So I think I'm really running into the problem
- 12:08where like a 20 page doc is just too much versus like a two
- 12:12page doc for it to ingest
- 12:15and put all of those things together.
- 12:18So like when it hits it's awesome.
- 12:21It's like ooh that's great.
- 12:23It just isn't a hit maybe as much of some
- 12:26of these stuff in teams
- 12:28and it's very nebulous to me as an end user.
- 12:30Like what am I actually encountering?
- 12:32What's, what's the limitation? Is it token limits?
- 12:34Should I only be working with docs that are
- 12:38of a certain size, be it number of pages?
- 12:41I imagine it's gotta be like number of words, right?
- 12:43For the tokens that are driven into the LLM
- 12:46or something like that but it's kind of opaque
- 12:49and not great there.
- 12:51And then I think my last point about all of this stuff is,
- 12:55and I was kind of getting here with chat GBT as well
- 12:58is you do have to become a prompt engineer.
- 13:02So kind of taking a step back
- 13:03and saying like, hey, this thing that I'm using is a tool,
- 13:08what's the best way for me to use this tool?
- 13:10Which I imagine lots of us do in other places, right?
- 13:12Like most
- 13:13of the people I know don't just type random
- 13:16strings into a Google search.
- 13:17They know how to like constrain strings with quotes.
- 13:20They know how to put binary operators in there like show me
- 13:23this but not this thing.
- 13:24They know how to dial it into like a certain file type like
- 13:27hey search for you know, just PDFs in in my search results
- 13:31and and things like that.
- 13:33And just the way you learn to be a power user
- 13:36for things like maybe like Google search
- 13:39or you learned all the keyboard shortcuts
- 13:41and a bunch of like power functions and Excel
- 13:44or anything else like that.
- 13:45Like you do have to go back
- 13:47and spend time on prompt engineering
- 13:50what makes a good prompt
- 13:53and how you can get things to kind of where they need
- 13:57to be in prompt plans.
- 13:59So one of my suggestions there is
- 14:03Microsoft has a site that they stood up as part of copilot.
- 14:08So if you go to copilot.microsoft dot coms,
- 14:13copilot.cloud, do microsoft.copilot.cloud.microsoft man,
- 14:18these dude new like.cloud things are killing me.
- 14:21Copilot cloud microsoft slash prompts.
- 14:24It brings you into a like structured prompt experience
- 14:29and it helps you just kind of figure out like hey,
- 14:31what are some getting started prompts maybe
- 14:33what are some more advanced prompts that I can do
- 14:36with this tool to make it all kind of come together
- 14:40and really shine for me?
- 14:42- It's been interesting. So it's,
- 14:44you've primarily just been using Athe in teams
- 14:47and maybe a little bit in the office
- 14:49or like meetings focused on meetings.
- 14:51- I've been using it in teams,
- 14:54I've been using it in office.
- 14:57The other place I'm using it a bunch is Outlook.
- 15:00So I do a lot of email from my phone
- 15:02and having access to co-pilot on my phone is kind
- 15:06of cool at, at least inside of Outlook.
- 15:09So I get, I typically like get a lot of escalations
- 15:12so I'm added into an email thread
- 15:14after it's already been going for like a week
- 15:15and it could already have a chain of you know, 20, 30, 40,
- 15:21whatever, how many, however many like
- 15:23responses have already gone through it.
- 15:25And in the past I've kind of declared bankruptcy,
- 15:27somebody sends me an email and sometimes I'll look at it
- 15:30and I'll go like no I'm just not gonna read this.
- 15:32Like you really need to summarize it for me, right?
- 15:34Like gimme a recap of where things are at,
- 15:37don't just plus one me in
- 15:38and then expect me to solve it for you.
- 15:40And that little button right there in in Outlook mobile is
- 15:44awesome 'cause now I get that thing,
- 15:46I can just see like in the scroll bar how big
- 15:48of a thread it is and how much it's going
- 15:50and I can just hit that little button
- 15:51and it kind of summarizes it for me, which is great.
- 15:54So you know, the theme of it like is very much
- 15:58summarization like generative AI
- 16:00around summarizing other things that are out there,
- 16:03like written word kind of things.
- 16:05And I think that's okay 'cause it does provide value.
- 16:08- I've been doing some of that.
- 16:10The teams meeting one is really nice, I need
- 16:12to record more of my meetings.
- 16:14I wish there was a better way to just set like a global flag
- 16:18of record all my meetings unless I tell that to oh my gosh
- 16:20- So much.
- 16:21So I want that. Yes.
- 16:22- Like I don't want to have to go in and edit them.
- 16:25I mean you can do like templates and stuff,
- 16:27but I just want like a default setting record all my
- 16:29meetings, prompt the users,
- 16:31like whatever we need to do for the legal things.
- 16:34I just want that to be the default setting.
- 16:36One interesting thing, I didn't realize this, so
- 16:39before co-pilot you could use Teams Premium
- 16:42for doing the same thing, right?
- 16:44If you're not using any of the other teams premium features,
- 16:47you can just do co-pilot.
- 16:48Like there's a feature overlap there between teams Premium
- 16:51and co-pilot where the meeting recap is a licensed feature
- 16:55of teams premium and of co-pilot.
- 16:57So depending on your usage of other stuff outside
- 17:02of like meeting recap in teams, you can go one of two ways
- 17:06to license the whole AI meeting recap thing.
- 17:09- Very much so. And I think that's like, it's a weird,
- 17:11- It's odd - Nuance
- 17:12and that's where I was saying it gets
- 17:14very murky all of a sudden.
- 17:15'cause it feels like a lot of those things we're like,
- 17:20it's in my brain I think, you know, I could be conflating it
- 17:23but it's all just co-pilot at the end of the day for me.
- 17:25Like it is all generative AI summarization,
- 17:29blah blah blah on top of the thing, right?
- 17:31Yep. And getting it going.
- 17:32So like I really don't care
- 17:33what we call it if we call it Teams
- 17:34premium or blah blah blah.
- 17:36But it, it's the same fundamental experience.
- 17:39- It's the same functionality
- 17:41- As like an end user.
- 17:42Yeah. To figure that stuff out. So,
- 17:44- But I've been playing with
- 17:45copilot, I've done a few things.
- 17:47So one, just to test it out,
- 17:49I actually did go into PowerPoint
- 17:51and said generate a presentation
- 17:53for me based on a session title and a session abstract.
- 17:56It's not perfect like there's definitely repetition in it
- 17:59but it like went in and created like a 12
- 18:01or 13 slide PowerPoint presentation
- 18:04and it did a decent job of pulling in different bullets
- 18:07of putting graphics in my slides.
- 18:10I'm not gonna use this for going
- 18:11and maybe creating a session,
- 18:13but there's definitely some useful features there in terms
- 18:17of quickly getting, I would say drafts, right?
- 18:20I think it's a little bit of that emphasis
- 18:22that this is still there to help you not
- 18:24to do everything for you.
- 18:26So that was interesting.
- 18:27But I have been playing more
- 18:30with just the copilot app in teams.
- 18:33To your point about that switch where chat, GPT, copilot,
- 18:38pro Bing chat, whatever you want to call it,
- 18:40doesn't have the context of your Microsoft 365 environment.
- 18:46But having copilot that you can go in
- 18:49and have conversations with in teams.
- 18:51One thing it does do is it gives you the ability
- 18:53to start new chats.
- 18:55But also one of the things you mentioned Scott,
- 18:57where you couldn't always go back
- 18:58and see previous chats,
- 18:59you can go see all your previous chats that you've had
- 19:02with copilot chat.
- 19:04I don't know how far back it goes.
- 19:06- You can, which is nice. It is.
- 19:09It seems to cut off at some point.
- 19:10Like I don't know the exact number off the top of my head
- 19:14where it cuts off, but I do remember like it
- 19:15starts to drop off the list.
- 19:17- Yeah, the oldest one I see in mine is the 16th.
- 19:20So it's at probably at least 30 days.
- 19:22January 16, sorry it's at least 30 days.
- 19:25But having that conversation history.
- 19:27But you can start doing some fascinating stuff with
- 19:31co-pilot chat in teams.
- 19:33And this is, I'll send you this prompt.
- 19:35I saw this one the other day in a training.
- 19:38I was actually on co-pilot where it's,
- 19:40look at my calendar over this coming week, create five
- 19:42to seven categories that describe how I spend my time
- 19:45and give me a short description of each category,
- 19:47an estimated percentage on time I spend on each.
- 19:50And I was talking to one person
- 19:52that actually dropped this in Teams chat and it spit back
- 19:55and they were like, I spent 50% of my meetings
- 19:58with internal people at our company.
- 20:00I should probably be focusing a little bit more on
- 20:02some customer conversations
- 20:04- To the murkiness thing.
- 20:05How is that different than the Veeva Digest
- 20:09that I get at the beginning of every week that says,
- 20:11Hey here's how you spend your time,
- 20:12- Here's how you spend it.
- 20:13I mean there are definitely some overlaps there.
- 20:16I think here it's diving into it,
- 20:19although I would say it's not perfect
- 20:20'cause I've played with some other ones like
- 20:23how many emails did I send this week?
- 20:25Or which domains did I email the most?
- 20:29How many meetings do I have this week?
- 20:31I asked at how many meetings I'm multitasked in.
- 20:33It was the same number that I had meetings this week.
- 20:35Probably not a good thing. But , the fact
- 20:38that you can go in and start sifting through your data
- 20:42and to your point, you still have to get good.
- 20:44I need to improve at some of these prompt engineering
- 20:47and coming up with various prompts for
- 20:51how do I ask copilot things in certain ways
- 20:54to get the responses and the information out I want.
- 20:57I also was playing, I'm still trying
- 20:59to get this figured out, the concept of add-ins in copilot
- 21:04and Jira already came out with an add-in for copilot.
- 21:09So in theory you could go into teams
- 21:10and ask about overdue tasks and upcoming tasks
- 21:14and spit out my tasks that are the most overdue.
- 21:17I haven't gotten that working yet.
- 21:18There's some hoops to jump through
- 21:20with add-ins from what I've found.
- 21:23And I am apparently still missing something.
- 21:26But it'll also be really interesting to see
- 21:30if companies start building in add-ins.
- 21:33Companies like Jira where maybe you're tracking your tasks
- 21:35or I don't think that DevOps is necessarily integrated
- 21:39by default or any of those other third party applications
- 21:43that maybe already have add-ins for Microsoft 365
- 21:46that copilot will then be able to
- 21:49pull data from when it responds
- 21:52to those different conversations.
- 21:54So from my perspective, that's what I've been using.
- 21:56I've been playing with, I don't know
- 21:58that I've necessarily figured out all the business use cases
- 22:02for it and ones that I like,
- 22:04but that conversation in the co-pilot in teams,
- 22:08because it has access to all my data is kind of nice.
- 22:11Even I would say the other thing like presentations
- 22:14that I've given the ability it has
- 22:15to go look at all my files and I'm like,
- 22:17okay, where do I have this?
- 22:18It's search ish.
- 22:20Like some people could say, well you already had
- 22:24that in SharePoint search.
- 22:25And to a certain extent I think it's just the experience
- 22:28is a little bit different.
- 22:30- It very much is. So, uh, I'll give you a
- 22:33concrete example there of where
- 22:34that's been super helpful for me.
- 22:36So the other day
- 22:39I was working on some
- 22:41requirements documentation for an area.
- 22:43Okay. I needed some data about another part of our platform
- 22:47to like pull in for context on like, hey,
- 22:49why we'd wanna change this part of the service
- 22:51because this is where another part of the service is going.
- 22:53Yep. I had that conversation with somebody else about like,
- 22:57hey the, this other part
- 22:58of the service is going in a different direction
- 23:00like over a year ago.
- 23:01But I remember having the conversation
- 23:03and I remember who it was, who it was with.
- 23:06So I was able to go
- 23:08and ask copilot,
- 23:09what can you tell me about Project X, Y, Z?
- 23:14From a meeting with let's say Ben about a year ago
- 23:19and he presented a PowerPoint to me,
- 23:22it pulled back the stupid PowerPoint like
- 23:24it gave me a link to it.
- 23:25It said, Hey is this the right
- 23:26PowerPoint that you were looking for?
- 23:28I was like, oh my gosh, yes.
- 23:29And could I have gotten that another way?
- 23:31Well yeah, I could have gone into this maybe like my
- 23:34calendar and outlook
- 23:35and I could have searched for the meeting and
- 23:38but then I would've had to have like the right subject
- 23:40or you know, the, the right incantation of things to, to get
- 23:44to where, where it needs to be.
- 23:46So it was super helpful for that.
- 23:49It's been helpful in I think writing as well.
- 23:53So I tend to do a lot of things where, you know,
- 23:56you write kind of like a big document.
- 23:59Like I could take like show notes
- 24:01for this as an example, right?
- 24:03We kind of write a document, we put a bunch
- 24:05of bullet points in it, things like that.
- 24:06And then there's just links sprinkled throughout it.
- 24:10So lately I've been telling, like in some
- 24:12of the documents I read, I'm like,
- 24:13Hey can you like in the appendix,
- 24:15like I'll be in the appendix section.
- 24:16I'll say like Co-pilot, build me a table here
- 24:19that lists all the links in this document
- 24:23and make one of the columns the title of the uh page
- 24:28that it links to and it just automatically goes out
- 24:30and scrapes that stuff and pulls it down
- 24:32and just like boom, boom, boom.
- 24:34Like it builds you a table super slick when it works.
- 24:38. Yeah.
- 24:42- Do you feel overwhelmed by trying
- 24:44to manage your Office 365 environment?
- 24:46Are you facing unexpected issues
- 24:48that disrupt your company's productivity?
- 24:50Intelligent is here to help much like you take your car
- 24:53to the mechanic that has specialized knowledge on how
- 24:55to best keep your car running Intelligent helps you
- 24:58with your Microsoft Cloud environment
- 25:00because that's their expertise.
- 25:01Intelligent keeps up
- 25:03with the latest updates on the Microsoft Cloud
- 25:05to help keep your business running
- 25:07smoothly and ahead of the curve.
- 25:08Whether you are a small organization
- 25:10with just a few users up to an organization
- 25:12of several thousand employees, they want to partner with you
- 25:15to implement an administer your Microsoft Cloud technology,
- 25:20visit them at intelligent.com/podcast.
- 25:23That's I-N-T-E-L-L-I-G-I-N
- 25:28k.com/podcast for more information
- 25:31or to schedule a 30 minute call
- 25:33to get started with them today.
- 25:35Remember intelligent focuses on the Microsoft cloud
- 25:38so you can focus on your business
- 25:42Going back to the assistant.
- 25:44I think that's where copilot, even from my experience tends
- 25:47to excel is not not creating stuff.
- 25:49It doesn't always do a great
- 25:51job creating stuff from scratch.
- 25:53But if you can feed it that specific information
- 25:57or tell it, give it good specifics about what you're looking
- 26:00for from a PowerPoint presentation,
- 26:02help me go find this conversation or this presentation
- 26:04or take this document and pull all the links out of it.
- 26:08I feel like it does a better job.
- 26:10Some of that with some of that I've also used,
- 26:13have you played or tried the, the email coach
- 26:16yet in Outlook?
- 26:18This one's also been interesting to me.
- 26:20- , I have not been brave enough to .
- 26:23I was talking to a couple folks about this the other day
- 26:25'cause we, we were going back and forth, right?
- 26:26I, I kind of, you know, somebody asked in our discord like
- 26:30what are the use cases for this beyond summarization?
- 26:33So, you know, I kind of gave that list
- 26:34of things I talked about earlier.
- 26:36I also took that list of things back internally to uh,
- 26:39you know, other members of of the team that I'm on.
- 26:42I'm like, Hey, how are other folks using this?
- 26:43Like what am I missing? And I was going back
- 26:45and forth with somebody and he casually dropped.
- 26:48He is like, oh I've got this thing writing my
- 26:50emails for me right now.
- 26:51I'm like, you're truly a brave soul.
- 26:53Like I, I don't know that
- 26:54that might be a bridge too far for me.
- 26:56It's one thing to have Outlook collect,
- 26:57correct my grammar, which is horrible.
- 27:00I understand. I appreciate, you know, the,
- 27:02the red squiggly lines all over the place.
- 27:04Like hey you missed a the here or an
- 27:06and there you forgot to you, you spelled this thing wrong.
- 27:10But having it just wholesale write it, I don't know
- 27:14that I get there, especially when
- 27:15I see everybody in meetings.
- 27:16Like I see a lot more people like participating in meetings
- 27:19now and and like acting as like a quasi scribe
- 27:23and like they're throwing things out during the meeting
- 27:25and all they're doing is getting the recaps
- 27:28and things from copilot as it's going on.
- 27:30So you can like clearly tell
- 27:32and you just know what they're doing.
- 27:33So like, and now one of our jokes is like did you write that
- 27:36or did you have copilot write it did you?
- 27:39And you know right off the bat, like if you've been working
- 27:41with somebody for a couple years, like
- 27:42that's not your writing style.
- 27:44You had the robot write it for you
- 27:45- .
- 27:46I have not had co-pilot write my emails yet.
- 27:48But there's another option when you're drafting an email
- 27:52where it is coaching by co-pilot.
- 27:55So if you go write
- 27:57and this is what I've done, I go write my email
- 27:59and then if you go click on this coaching by co-pilot,
- 28:02it will go in and it analyzes your email
- 28:06and it will give you pointers about tone, clarity,
- 28:11those types of things where it doesn't
- 28:13even rewrite your email. But I just threw,
- 28:16- Isn't that just Microsoft editor?
- 28:17Like how is that different than what editor was doing?
- 28:20- it's different than editor.
- 28:21I feel like editor does more rearranging editor
- 28:24to me was a little bit more grammar focused.
- 28:27Or you could rearrange it this way to make it better.
- 28:31The coaching, it gives me something like the
- 28:35tone could be more friendly.
- 28:36The email sounds a bit dry
- 28:37and formal, which may not create a strong
- 28:39rapport with the reader.
- 28:41Suggestions. Consider adding some greetings
- 28:43and expressions of gratitude or appreciation.
- 28:46I mean kinda cheesy
- 28:48but it has Hal where I'm like, okay,
- 28:50so I could rephrase this and reader sentiment.
- 28:53It'll tell you things like this email assumes certain things
- 28:57which may not be the case for everybody.
- 28:59So how is this going
- 29:01to maybe come across from the reader based on things
- 29:04that maybe you've asked for or questions you've asked.
- 29:09And then clarity. If it's like super vague, you need
- 29:12to get more detailed, more specific about something.
- 29:15Point about the question. Discord business use case,
- 29:19maybe I'm still trying to dig through it.
- 29:22So far I have been unable to write any email
- 29:25that is friendly enough for copilot.
- 29:27So either I am an incredibly unfriendly person
- 29:31or a copilot is like over the top friendly.
- 29:34I, I don't really know yet. You
- 29:36- Gotta work on your your your Southern nice. Huh?
- 29:39- Apparently - It's your inner Northerner coming out.
- 29:42- It could be that. It could be the fact
- 29:43that I'm like I don't have time to be nice in an email.
- 29:45I just need to get this out and get it over to somebody
- 29:48so I can get this taken care of.
- 29:49- I gotta admit I haven't tried this one yet.
- 29:51I'll have to go check it out.
- 29:52Is this only in the new I,
- 29:54it looks like it's only in the new Monarch article.
- 29:56Monarch client from the screenshots.
- 29:59- I'm on a Mac so probably
- 30:01'cause I'm on the New Mac client, which I think is more
- 30:04on par with the new outlet client.
- 30:06Yeah, that one's an interesting one.
- 30:08I'm still waiting for copilot in OneNote.
- 30:11I'm curious to see what I can do with it there
- 30:13because I have so many notes in it.
- 30:15I have not had it.
- 30:17I've seen screenshots of other people using an Outlook.
- 30:20I would think it's maybe Outlook for Windows.
- 30:22I haven't seen it in Outlook on the web
- 30:24or Outlook for the Mac.
- 30:25Or maybe I have something broken in my tenant,
- 30:27which is also a very real possibility at times. Could
- 30:30- Be.
- 30:31I have not played around with it in OneNote yet.
- 30:33I don't know. Loop yes. OneNote?
- 30:37No, but I think I've been neglecting
- 30:39OneNote a little bit lately.
- 30:40- Oh for what? Scott? For Loop.
- 30:42Oh I thought you were gonna say notion. Okay.
- 30:44You're allowed to do it for
- 30:45- Loop.
- 30:46No, I'm still using Notion for personal stuff but Ooh,
- 30:49- I could get on a soapbox about Loop right now.
- 30:51I'm not gonna do it. . Yeah, I'm trying to think.
- 30:53Other business use cases for copilot that I've seen.
- 30:56The meeting recaps, I mean summarization.
- 30:59Yeah it's a, it's still falls in that category
- 31:02but it's been really good.
- 31:03I've liked meeting summarizations with it.
- 31:05I don't know that there's any others
- 31:07- As folks.
- 31:08Like if you're starting to light this up,
- 31:09you mentioned add-ins or, or plugins for copilot.
- 31:12Yeah, you do have to go into the copilot app
- 31:16and then in the text box there's like a little shadow icon
- 31:19that you click down there where you
- 31:20have to turn that stuff on.
- 31:22It's a little hidden away.
- 31:24Like I had to go in and like I, I was confused.
- 31:26I'm like hey why can't you crawl the web for me?
- 31:28And it's like, oh you have to go turn that on
- 31:30for yourself to get it going.
- 31:33And that was kind of weird and,
- 31:35and not well documented to me. Yeah
- 31:37- And it doesn't stay on, I have not found a way
- 31:39to turn it on and say always crawl the web.
- 31:41Like you can turn it on for a chat
- 31:43but then if you go start a new chat it's off by default.
- 31:46I haven't found a, oh no
- 31:47- On, I didn't notice that ,
- 31:49I was just assumed it was on after that
- 31:52- I would go look unless it's again my tenant.
- 31:54So I did notice that.
- 31:56The other thing I have seen
- 31:58the documentation on this is not very clear is add-ins are
- 32:02technically still in preview
- 32:04and I was talking with somebody the other day about add-ins
- 32:08and we aren't able to tell from the documentation.
- 32:11There is a section
- 32:12where it says if you wanna use add-ins in teams,
- 32:16like third party add-ins you in preview, you need
- 32:18to go open a support request
- 32:20and put this very specific phrase and I, I can go look it up
- 32:24and we can put it in the meeting notes in the service
- 32:26request so that it gets routed
- 32:28to the right person on the co-pilot service support side
- 32:31and they can enable add-ins for your tenant.
- 32:34And I did that and I went through the whole process
- 32:36and they send you a request there,
- 32:37what tenant id do you want it enabled on all of that.
- 32:40What I don't know is do you need this to just use them
- 32:43or is this only for developing them?
- 32:44I was talking to a developer about this
- 32:46that was looking at writing add-ins for teams.
- 32:49I don't know if that step is for only if you're developing
- 32:52and you need something turned on
- 32:53or if it's just for general use.
- 32:55Either way I have not gotten my Jira add in
- 32:58or plugin to show up in that dialogue box yet.
- 33:01Even though it says it's installed, I keep pouring
- 33:04through the documentation and it's
- 33:07go turn it on in the admin center
- 33:09but then you have to go over to teams
- 33:10but it doesn't really tell you what to do
- 33:12or where to do it in teams.
- 33:13And I haven't, I have not come up with good guidance
- 33:17nor have I been able to discover the exact steps to get
- 33:21that plugin to show up in lieu of the fact
- 33:22that I don't see it yet in teams.
- 33:25- Again it doesn't seem to be well documented in some areas
- 33:27to go figure that stuff out.
- 33:29- But it is in preview, - Like you almost say you have
- 33:31to have like, like that person you can get the incantation
- 33:34from like, and I'm sure there's more
- 33:36than one edge case for that.
- 33:38Like hey if you have this magic term,
- 33:40it'll effectively like ungate the next step for you.
- 33:42You almost want like your your dungeon master book.
- 33:44You know like, hey how do I , uh, I'm a DM
- 33:47and I'm, I'm trying to navigate a a crew
- 33:49through here. How do I get that going?
- 33:51- Yep. But again I will say it's in preview so
- 33:55I'm not necessarily expecting it to be super smooth
- 33:58and straightforward given the newness of copilot
- 34:02and that add-ins are still in preview.
- 34:04One other thing, I'm gonna mention this
- 34:06'cause I've seen questions about this.
- 34:07Did we talk about pricing of copilot
- 34:10and how you have to buy these licenses? Do you remember?
- 34:12- So we mentioned the pricing in the past like $30 per user
- 34:16per month and you briefly mentioned the initial restriction
- 34:20with CSPs but it'd be good to touch on it. Again this
- 34:23- Is for CSPs and for
- 34:26'cause I pulled it up in the admin portal
- 34:27and for the admin portal, this is still one of those Yes,
- 34:30$30 per user per month.
- 34:32But no matter how you buy it, whether you prepay
- 34:35or prepay seek hint, you're gonna prepay whether you do it
- 34:39through the CSP or through the admin center, it is prepaying
- 34:42for a subscription length of one year or three years.
- 34:44There's no month to month on this.
- 34:47So if you wanna turn it on, be prepared
- 34:50to pay $30 a month, which equates to $360 per year.
- 34:55So yes, $30 per month
- 34:57but your licensing is year to year for this one.
- 34:59Don't complain to me, I had no input insight
- 35:02nor can I change it and nor can your CSP change it.
- 35:05It is what it is. And we talked about this
- 35:08before, I'm sure it's due in part to certain
- 35:12capacity stuff needing people to,
- 35:15or Microsoft needs to have a lot of hardware to handle all
- 35:19of this and I'm assuming this prepay helps with some of that
- 35:23because I can imagine it would be really expensive
- 35:26for people paying for it for a month and then turning it off
- 35:30or paying for it for month, turning it off for a month,
- 35:32turning it back on for a month, whatever.
- 35:34I don't know. The fact that you do have to prepay though
- 35:36and not pay month to month is still a little intriguing.
- 35:38- I imagine licensing will continue
- 35:40to be a moving target for a little while.
- 35:42Yeah, it it seems like it's been like rapidly changing
- 35:46in some of the requirements.
- 35:48The restrictions. I don't know if you ever get to a,
- 35:51a pure like month to month PayGo model
- 35:54but you are kind of there
- 35:55with things like copilot Pro I believe like wasn't the
- 35:59personal one month to month.
- 36:00- Yes, that one's month to month
- 36:01and yeah, the only one I've seen it
- 36:03for even teams premium is month
- 36:05to month copilot for Microsoft.
- 36:07365 is year to year.
- 36:09But I'm curious if it'll start changing overall
- 36:11because now that everything is annual commits anyways,
- 36:15you still pay month to month
- 36:16but you have an annual commit, it can just be a lot of money
- 36:19to pay, especially
- 36:20for larger companies if you get into the boat
- 36:22where you're starting to have to prepay for an entire year.
- 36:25Messes with budgets, the whole CapEx opex thing,
- 36:29- Just a little bit. Right.
- 36:30- I think that covers copilot pretty well.
- 36:32Our experiences. I'm
- 36:33- Gonna continue to keep using it and playing with it
- 36:37and we should maybe come back in another couple months
- 36:40and revisit and see if there's any, any other tips
- 36:43and tricks or things there that kind
- 36:45of make the world potentially a better place.
- 36:49- I agree. 'cause it is gonna be, there's gonna be a lot
- 36:52of stuff and see if I can get my plugins working
- 36:54and I can have updates on plugins,
- 36:56- .
- 36:57Yeah, maybe I can go try some of those too.
- 36:59I don't know what's lit up in our tenant
- 37:01or what restrictions exist.
- 37:02- Yeah, so from what I've seen,
- 37:04the plugins are like a Microsoft 365 admin center thing
- 37:07where you have to turn 'em on everywhere.
- 37:10I'm curious Yeah. To see if you have any
- 37:12or if you can figure anything out.
- 37:14But with that I have Pinewood Derby cars to make
- 37:18a food truck outside my window the weekend ahead of me
- 37:21and an email migration .
- 37:25- So not, not a whole lot going on. Got it.
- 37:28- No, not really. It's just, yeah.
- 37:30And my wife's gone tonight
- 37:31and tomorrow will I do the Pinewood Derby car
- 37:34and the email migration.
- 37:35It'll be a busy weekend.
- 37:36Scott, you wanna come hang out ?
- 37:39- Sure, I'm, I'm,
- 37:40it's been a while since I've done a Pinewood car.
- 37:42My, my kids grew out of that stuff a couple years ago.
- 37:44- My daughter wanted me to make one
- 37:46that looked like my Lego Lamborghini do it.
- 37:49Well the race is tomorrow so it's, I'll have
- 37:52to take a picture , I'll try to take a picture
- 37:54and post it and Discord or put it out on Twitter.
- 37:56It, I mean it's a Pinewood Derby car
- 37:57and we had like two weeks so it looks pretty.
- 38:00I was impressed for the time we had to put into it
- 38:03and the fact that we're dealing with wood
- 38:05and I don't have, I don't have a ton of fancy tools.
- 38:10I thought it turned out fairly well. Well that's good.
- 38:12She was happy with it. The
- 38:13- Big frustration with Pinewood Derby cars is if you don't
- 38:16have a friend who doesn't have a band saw,
- 38:19I found having a band saw is
- 38:21100% a requirement for those things.
- 38:23So I have like everything else, you know like table saws,
- 38:26jigsaws, MITRE saws.
- 38:27But I don't have a band saw. That was always tough.
- 38:30So get a friend with a band saw and you'll be all set.
- 38:34- I'm looking for one. I used a jigsaw to cut these out.
- 38:37Jigsaws. It's rough. It is jigsaws lead to a lot of sanding.
- 38:41Yeah. I need a friend.
- 38:42If there's a friend in Jacksonville, Florida
- 38:44that has a band saw that listens to the podcast
- 38:46- That's gonna hear this before gets that's gonna,
- 38:48- It's listen to me.
- 38:49Well, but I'll have more Pinewood Derby cars coming up in
- 38:52the future that I can befriend
- 38:55and I don't know, I can pay you for your bandsaw.
- 38:58I can bring you food for your bandsaw or something.
- 39:00I would like a bandsaw in the next year
- 39:02sometime again. Alright.
- 39:03- Okay. - Now that we've completely gone off
- 39:05topic, we'll wrap it up.
- 39:07- . Sounds good. Alright. Keep
- 39:08an eye out for bandsaws.
- 39:09I would love to have feedback from others out there
- 39:12that are using copilot.
- 39:14Like come and find us on
- 39:17Mastodon Threads, all that kind of stuff.
- 39:19Or if you participate in the Discord,
- 39:21come hop into the chat over there.
- 39:24Like it feels like a very net new area to me.
- 39:26Like I said, I keep feeling like, oh my gosh, like I need
- 39:29to become like a prompt engineer.
- 39:32So I'm kind of like trying to soak all
- 39:34that stuff up right now.
- 39:35- I would love like other experiences but other prompts.
- 39:38I'm with you Scott. I'm not a great prompt engineer.
- 39:41That is an area where I need to learn.
- 39:43So I'm always intrigued with other prompts
- 39:45that people have developed and wanna share.
- 39:47We need to create like a prompt to library somewhere. That's
- 39:49- What Loop is for or OneNote.
- 39:51- . Okay, perfect. Sounds good. Thanks Scott. All
- 39:54- Right, sounds good.
- 39:55Enjoy the weekend. Enjoy the derby.
- 39:57- You too. We'll talk to you later.
- 39:58- All right, thanks Ben. - If you enjoyed the podcast,
- 40:02go leave us a five star rating in iTunes.
- 40:05It helps to get the word out
- 40:06so more it pros can learn about Office 365 and Azure.
- 40:10If you have any questions you want us to address on the show
- 40:13or feedback about the show, feel free
- 40:16to reach out via our website, Twitter, or Facebook.
- 40:19Thanks again for listening and have a great day.