Latest / Shiny New Object - a Marketing Podcast / Episode 300 / Emily Keller-Logan / Coursera / Director of Global Marketing Strategy and Experience
Transcript
- 0:00Emily Keller-Logan: business questions you're trying to
- 0:04answer.
- 0:11Speaker: Are you a fitness loving foodie? Then Defi Snacks
- 0:13is for you defy offers real high quality chocolate you love,
- 0:16combined with functional ingredients, giving you as much
- 0:19as 26 grammes of protein per bag. So you can be both a little
- 0:22bit bad and a little bit good at the same time as a female owned
- 0:26brand, defy dedicates a portion of its profits to other women
- 0:30owned businesses currently sold in the US. You can find us on
- 0:33defy with an i snacks.com and follow us on social at defy
- 0:37snacks.
- 0:44Tom Ollerton: Hello and welcome to the shiny new object podcast.
- 0:47My name is Tom Ollerton. I'm the founder of automated creative,
- 0:50the creative effectiveness ad tech platform, and this is
- 0:53podcast about the future of data driven marketing. And every week
- 0:56I have the pleasure and the privilege of interviewing one of
- 0:59our leaders. And this week is no different. I'm on a call with
- 1:03Emily Keller Logan, who is Director of Global Marketing
- 1:06Strategy and Experience at Coursera. Emily, I normally ask
- 1:10if I'm saying your name right. Have I got that right?
- 1:12Emily Keller-Logan: That is perfectly right.
- 1:14Tom Ollerton: I'm sorry. I should have asked. But anyway,
- 1:17Emily, thank you so much for coming on the show. Could you
- 1:20give the audience a bit of background on who you are and
- 1:23what you do?
- 1:24Emily Keller-Logan: Sure, yeah, I work at Coursera, and so if
- 1:24you haven't heard of us, we're the world's largest online
- 1:27learning platform, and we have 350 top companies and
- 1:31universities. And the whole idea is that wherever you are in the
- 1:33world, you should be able to learn whatever it is you need to
- 1:36do whatever it is you want to do. And so leading global
- 1:39marketing strategy and experience, my job is to figure
- 1:42out how we help reach the world effectively with kind of how
- 1:45they can discover Coursera, use Coursera and benefit from it.
- 1:49Been in startups for 11 plus years, so I've been learning a
- 1:53lot about how to do effective marketing and really thinking
- 1:56about bringing brands to life.
- 1:58Tom Ollerton: So in your career, what has been the best new
- 2:02belief or behaviour that has improved your work life?
- 2:05Emily Keller-Logan: Yeah, I kind of feel like I am learning every
- 2:07day. And so I guess probably the shift I've made over the last
- 2:11few years is, you know, when you're working in startups,
- 2:13typically the idea is, like, no jobs too big or too small. If
- 2:17something needs to be done, you roll up your sleeves, and you
- 2:20get it done. And I think kind of starting out that's like a
- 2:23really good move, right? Be the one who shows up, takes on the
- 2:26task, figures it out. I think the biggest shift that's helped
- 2:29me as I've grown is kind of what I call it, like, knowing when to
- 2:32let it break, like you can't go do everything at a certain
- 2:35point, especially as you get into more positions of
- 2:38leadership. Advice I've gotten over time is, you know, by doing
- 2:41too much, you diffuse your impact, and then you don't have
- 2:44kind of as great of results as you would like to have. And if
- 2:47you're always filling in and catching gaps, especially as the
- 2:50organisation grows too from like early stage startup to growth
- 2:54stage company to now I'm at a public company. If you're in
- 2:57there filling all the gaps, the company doesn't know what's
- 3:00broken. It's a fast path to burnout. It doesn't let you be
- 3:03as effective as you can. And so it's really kind of figuring
- 3:06out, what can I uniquely do that I need to make sure I'm
- 3:09preserving my focus, investing in and getting done for the
- 3:12company. And then, like, you know, when you let it break,
- 3:14it's not just you're silent on the sidelines. You're trying to
- 3:18figure out, Hey, wait. You know, as other teams are kind of
- 3:21defining their charters, does this sit with you? Does this sit
- 3:24with someone else? Or making the case that, like at this stage of
- 3:27this company, I think we need to invest in a resource to take on
- 3:31this thing that I used to help get done for us. And so I think
- 3:34that has improved the quality of my life and also the quality of
- 3:37my work.
- 3:37Tom Ollerton: That just sounds like a dream-like state that
- 3:41I've so far been unable to manage. I'm like, that, yeah,
- 3:45cool. That sounds great. Yeah, let's do that. Oh, what about
- 3:47this mad idea? Let's do that as well. I'm like, say yes to
- 3:51everything. I'm equally excited. Like, no job's too big or small.
- 3:55What's a, like, ridiculous challenge over there? Let's go
- 3:57and, like, Yeah, jump on that. But, at the same time you have
- 4:01to kind of manage and do all those other things. So I love
- 4:03the idea of putting your hand up and, you know, passing it on, or
- 4:06processing it, automate it, whatever it is. But how do you
- 4:08know when you you're broken, or your process is broken, or
- 4:12you've taken on too much without sort of winding up, you know,
- 4:16making bad life decisions?
- 4:17Emily Keller-Logan: Totally, I It's like a kind of learn as you
- 4:17go. And so that's when I say, like, I'm learning every day. I
- 4:21think you're kind of kind of figuring out what's mine to do
- 4:24and what's not mine to do. And so typically, the way I look at
- 4:27it is like, is there no one else in this organisation with this
- 4:30skill set? And I think too, as I've as I, you know, aged up it,
- 4:34there's often other team members who are earlier on in their
- 4:37career who might just totally love the opportunity to step in
- 4:41and take on a piece of sometimes it's me getting out of the way,
- 4:43creating opportunities for other people to shine and show the
- 4:46skills that they have. And then other times, it's really
- 4:49recognising that, like, there are 20 ideas we could have right
- 4:52now. I remember my old CMO, she would advise me. She would say,
- 4:57like, you know what? That's a great idea. Why don't you put
- 5:02that on the list? And like, there might be a right time for
- 5:03it, but it might not be right now. So it's also just having
- 5:03the discipline to be like, I kind of love that idea, but
- 5:03like, this probably isn't the right time for it, because right
- 5:05now I need to dedicate my focus here. And typically I use our
- 5:09business goals as the guide of like, right now we need to
- 5:12improve retention, or we want to improve conversion rates here.
- 5:15And so if I go take on that top of funnel idea, like, that's not
- 5:18the focus of the company right now. So that can kind of too.
- 5:21Tom Ollerton: I like that CMO play. That's a great idea. Yeah,
- 5:25put it on the list. It's a really that is a really clever
- 5:30soft No, isn't it like, yeah, brilliant.
- 5:33Let's get some specifics here. What's your best bit of advice
- 5:40for someone listening to this podcast to become a better data
- 5:45driven marketer?
- 5:45Emily Keller-Logan: Yeah, so I'm coming from the strategy and the
- 5:46like, to solve a problem, spend, you
- 5:46I feel like a massive fraud saying this, but I'm just about
- 5:48brand side, and often, maybe we have a little bit of a
- 5:50reputation of like, you know you're not metrics driven, which
- 5:53I think is unfair. So for anyone out there who maybe doesn't have
- 5:57formal training in analytics or using data. I guess my
- 5:59encouragement is, you don't need formal training to start using
- 6:02data to make better decisions. And kind of, my approach has
- 6:05just been being very curious. And I almost wonder sometimes
- 6:08if, like, not having formal training helps me, just like, go
- 6:11after it and not know, kind of, maybe what I don't know. And so
- 6:14we have tools like Looker and Amplitude. And so the nice thing
- 6:17about this is, like, data is really democratised in the
- 6:20company, but it's also my job to figure out, like, what what
- 6:22know, most of it figuring out the right question to ask, yeah.
- 6:23questions can I answer with this? And so we had a marketing
- 6:26ops director once who really encouraged all of us on the
- 6:29marketing side to be like, What business questions are you
- 6:32trying to answer with this data? So often I'm figuring out, like,
- 6:35what is it I need to know about how is the audience experiencing
- 6:38that campaign I just sent out? So then I'll go into Amplitude,
- 6:41I'll create a cohort and really look at, like, what, what did
- 6:44they start doing on the site after I sent that series? Did it
- 6:48work the way I expected? And so my advice is just to get in
- 6:50there and try it. Get curious with the data, pull reports, and
- 6:54really think about the question you're trying to answer, and
- 6:57then do if you're someone like me who maybe didn't have formal
- 7:00analytics training, like, find your performance colleagues or
- 7:03data science and analytics partners and go bring them your
- 7:06discovery and help them validate it. So sometimes I'll we have,
- 7:09you know, a lot of companies on Slack now, I'll go into our Data
- 7:12Science Channel and say, like, Hey, I pulled this this look,
- 7:15and I was trying to answer this question, here's what I found.
- 7:18Here's how I set it up. Does this look right to you? And more
- 7:21often than not, they're like, Yeah, that's right. Or sometimes
- 7:24it'll they'll reference a table that you want to pull and use
- 7:24to
- 7:27differently. And so my biggest advice is just to get in there
- 7:30and try it and see what you can learn, and make sure it's tied
- 7:33to kind of one of those key business questions you're trying
- 7:36to answer.
- 8:03Tom Ollerton: And I think another actually quote from the
- 8:08book. Now, you got me thinking, I think, I think it was Perla
- 8:14Bloom and she, she said that unless your data dashboards and
- 8:20decks inspire you. You're not asking the right question.
- 8:24That's not a direct quote, but it's along those lines, you
- 8:26know, like, and that's what we always say at automated
- 8:29creative. It's like, we can give you those things, give you the
- 8:31three Ds, data flows and decks, but all of them should and do
- 8:35inspire what you should do next. And I always think, if you're
- 8:38pulling data and you're like, cool, got some data, but you're
- 8:41not going, oh, right, I'll go and do this now. Then it's not
- 8:43doing the job.
- 8:44Emily Keller-Logan: Yeah. Can I add one more piece, I think, in
- 8:44Tom Ollerton: This episode of the shiny new object podcast is
- 8:47addition to your data on your dashboard, I think, and I would
- 8:51be remiss if I didn't say that, like, hear from your users,
- 8:51brought to you in partnership with MADfest, whether it's live
- 8:54right? So I think often I can pull reports and get the
- 8:57percentage trend or the graph see kind of, you know, how
- 9:01people are experiencing the platform in large numbers, but
- 9:04then I we, I really need to understand, like, what they're
- 9:07thinking and saying. And so we have a lot of qualitative
- 9:08surveys I will use Reddit. So there's this tool called Giga
- 9:11brain, where you can actually search Reddit at large for key
- 9:14questions about, like, what people are saying about their
- 9:16experience with your brand. And so I think kind of pairing data
- 9:19with the insight of like, what's motivating someone to do this,
- 9:22what's getting in their way as they do this, I think, often
- 9:24helps varying levels of the team make sense of the data and act
- 9:29on it, versus, like, sometimes you can kind of get caught up in
- 9:32testing madness and not really understand what the user really
- 9:36needs. And so I think really understanding what people are
- 9:41saying to you complements some of that data you're pulling on
- 9:47various dashboards too.
- 9:54in London or streamed online to the global marketing community,
- 9:58you can always expect a distinct. Of and daring blend of
- 10:01fast paced content, startup innovation pitches and
- 10:04unconventional entertainment from Madfest events. You'll find
- 10:07me causing trouble on stage, recording live versions of this
- 10:10podcast and sharing a beer with the nicest and most influential
- 10:13people in marketing. Check it out www.madfestlondon.com.
- 10:19So we're going to now move on to your shiny new object, which is
- 10:29AI agents and creative effectiveness. So for anyone who
- 10:32doesn't know what that is, can you explain?
- 10:36Emily Keller-Logan: Yeah, yeah. So I have been building AI
- 10:40agents internally with kind of the LLM large language model
- 10:44tools that are accessible inside my company. And the idea with an
- 10:47agent is like it is taking actions for you based on
- 10:50instructions you have given it. And so on the brand side, we
- 10:54have all kinds of documentation. You've got brand guidelines,
- 10:57writing guidelines, audience research, user research, and
- 11:01then for creative effectiveness too. Every platform has specs
- 11:05and requirements of how to show up well in that platform. And so
- 11:09what I've been trying to do is thinking about like, all of this
- 11:12information that like is hard for any one person in my company
- 11:16to know it all right, so we're building creative for YouTube,
- 11:19or now we're on meta, or now we're getting into Tiktok, or
- 11:23we're writing emails, but emails in kind of the US versus emails
- 11:28in India, we're going to try different approaches. And so
- 11:31it's hard for everyone to stay on top of everything. And so
- 11:36what I've been testing out and piloting internally is really
- 11:38trying to build out an AI agent that takes all of my
- 11:40information, and then I've set up instructions so based on what
- 11:44the user will query. So this could be a copywriter on our
- 11:47team. It could be a paid media manager. It could be me, and
- 11:50you're at a different stage in the creative development
- 11:52journey. It can kind of prompt the agent with different
- 11:55questions, and then the agent has guides on like how to score
- 12:00writing for clarity or visuals for visual effectiveness. It
- 12:03references at certain points, it will reference our writing
- 12:06guidelines, or it'll reference a platform guideline. And the idea
- 12:10here is to have our teams have better language to use as
- 12:14they're working with creative teams. What I found too, is it
- 12:18can be challenging to know how to give the right creative
- 12:20guidance. Like you don't want to solve for a creative you want to
- 12:26tell them the problem that you're experiencing. And so kind
- 12:30of these agents that I've been trying to create and build and
- 12:30test out internally are really trying to help teams get to
- 12:32better ultimate creative that really meets our audience where
- 12:36they are versus kind of where the company wants to be.
- 12:40Tom Ollerton: So I've got a bit of a problem with the word
- 12:42agents. I think this is marketing trying to make itself
- 12:45sound cleverer than it is. So we do, we do the same thing. I
- 12:48wouldn't call them an agent. I call them like a mini GPT or a
- 12:52tool or a thing or a bot. So maybe I'm missing something.
- 12:58Maybe my own agents can't work hard enough for me, but what's,
- 13:02what's the difference between a bot and an agent like, what? Why
- 13:04is this agentic approach different to just creating a
- 13:08resource? I understand it's conversational, but can you help
- 13:10me? Yeah, help anyone listening to this podcast understand that
- 13:13difference and the opportunity?
- 13:15Emily Keller-Logan: Yeah, I think it's like when it's
- 13:16chaining a set of steps together. So typically, as I've
- 13:19created, like, you know, in Chatgpt or Claude, you can kind
- 13:22of create a project, and then the project, they're referencing
- 13:24a set of documents. So that, to me, is more like chatbot LLM
- 13:28conversation. Agents to me, it's like, when you're chaining a set
- 13:31of steps together, where it's like, we're going to start here,
- 13:36then it's going to do this, and then we're going to go here and
- 13:37we're going to add that. I think that's where an agent becomes a
- 13:38little more useful. I think something I have not dabbled in,
- 13:42that I'm excited to try, is like, when you like, hand things
- 13:44over to the agent and have them do things for you. So I have
- 13:46someone actually on my team who is working on we have this kind
- 13:50of library of SEO articles. And so these are some of just really
- 13:54helpful, like, 1000s of writing pieces on the internet of
- 13:58basically, like, answering people's questions, so the first
- 14:01agent can go query the article library and find you the right
- 14:05topic for what you're doing, and then the second agent will pick
- 14:07it up and figure out, you know, if I wanted to take that long
- 14:10form article and turn it into like a feature in an email, how
- 14:14do we meet the specs of that email? So the subject line
- 14:17should only be this long, the you know, headline should only
- 14:21be this long. The CTA should always be that long. Then we
- 14:23compare it with and now adapt that for this audience. And so
- 14:27maybe we've built an agent that's all trained to be like
- 14:29data professionals and the kind of questions that they have. And
- 14:31so when you're chaining all these steps together, I think
- 14:33that's when you get agentic, versus kind of when you're just
- 14:37querying a chat bot with, like your brand guidelines, I think
- 14:40that's more chatbot LLM style. I don't know if that helps.
- 14:43Tom Ollerton: And so then this is fascinating. Thank you. So,
- 14:43so how help me understand? So, in a an environment like chatgpt
- 14:49you have projects, and then you whack in however many documents.
- 14:51Doesn't take many for it to fall over in my experience, but, and
- 14:55then you go look, well, you know I need to do, I need to make,
- 14:57write this article based on this thing. And. And I need advice on
- 15:01bla bla... how is that handoff working? What's, what's the
- 15:03difference there? Whereas I'm just, yeah, just trying to help
- 15:06people understand how a project is different to a sequence of of
- 15:10mini projects, or mini bots, if you like.
- 15:12Emily Keller-Logan: Totally. And I'm not sure how that that stuff
- 15:14works in chatgpt. So our company has kind of built, like an
- 15:17internal version of LLMs where, like, you can pull on like the
- 15:22LLM Foundation, from Anthropic, from Claude, from Gemini. But
- 15:26then our development team has basically built this like agent
- 15:29system, where then you can kind of create one agent, chain it to
- 15:32the next agent. And so there's basically just a set of steps in
- 15:35our kind of internal LLM. We call it playground, where you
- 15:35can kind of build one piece, connect it with the next piece,
- 15:35and there's documentation that our development team has written
- 15:35that then, you know, we're in marketing over here and trying
- 15:36to figure out how to connect these things together and trying
- 15:44it out. And so I will just be really transparent too, that,
- 15:49like we're in the learning phase. And I think everyone is
- 15:54of like, how do I use this as something that can work
- 15:57repeatedly? And kind of the way we've approached this is, you
- 16:00know, we look for volunteers in the team. We're like, Hey, this
- 16:03is the problem we see all of us having. We've come up with this
- 16:06solution, and we think this can really add to your life by,
- 16:10like, taking away the thing that's hard for you to do, or
- 16:12the thing that's really time intensive. Give it a try, let us
- 16:14know how it works. And then you kind of keep going back and you
- 16:17edit the way it connects to this piece, to the next piece, or the
- 16:21set of instructions you have for one agent. Maybe needs a little
- 16:23bit of refinement when someone comes at it with a question
- 16:26that, like we didn't think of on the strategy side, but maybe on
- 16:29the paid ads side, they have a need that we didn't predict. And
- 16:32so just a lot of like learning and doing it is a little bit of
- 16:38the like the answer to the data driven question, just like, try
- 16:44it and see what works.
- 16:44Tom Ollerton: What kind of wins have you had so far? I mean, the
- 16:47win is trying, obviously, hard, but in terms of, like, you know,
- 16:51running upstairs and going, Look, I've created an agent that
- 16:53does blablabla?
- 16:54Yeah, I always
- 16:54fact every last person on the planet.
- 16:54Emily Keller-Logan: Yeah, some of them went so I've had people
- 16:56tell me I didn't know how to show up in a conversation with
- 16:59creative to like, give that and I see this so often, of like,
- 17:02how do you help a designer or a copywriter see the like, give
- 17:06them feedback that isn't solving it for them? It gives you the
- 17:09language of how to like, describe what you're looking
- 17:12for. And so people have told me, like, because it's kind of got
- 17:15all this right language for me, I can have clearer conversations
- 17:19with creative to get better output. I've heard from our
- 17:22email marketing team who really would love to leverage that, you
- 17:25know, great article library, but it's really time intensive for
- 17:28them. They're like this took would used to take me hours to
- 17:32go, you know, sift through the content, adapt it for the
- 17:35channel, and now it can happen in a matter of minutes. And so I
- 17:38think there's just those are some of the smallest. And then I
- 17:41think somewhat like the non wins are like, wait, I tried this,
- 17:45and then it couldn't figure it out. So then you just go and you
- 17:48adapt, and you see how to change the instructions so that it can
- 17:51meet that use case. And and then maybe we realise that actually,
- 17:55you know, that's too much to happen in one of these, so let's
- 17:58build out a separate flow and experience to solve that use case?
- 18:50So how do I take all of that audience research? How do I take
- 18:53user research? How do I take what it is we can know about the
- 18:57challenges someone has in advancing their career, and help
- 18:59them, especially on the creative side, get into the heart of the
- 19:03problem. Someone has to then build a story or an email or an
- 19:07ad that when you see it, it meets you where you are and
- 19:09like, that's the journey you're on. Like, are we perfect in
- 19:11that? Absolutely not, but I think that is what can so if we
- 19:14can save time, great. So is everyone else. But if we can
- 19:17show up in a way that really gets you and knows you and
- 19:19matches you to the right, high quality experience that only we
- 19:22have, then that's, I think, where we win.
- 19:25Tom Ollerton: Emily, this too. It sounds too good to be true.
- 19:27It sounds magical, but we've got to leave it there.
- 19:30Unfortunately, we're out of time, so I would have to keep on
- 19:33talking to you. I'm sure other people would like to get in
- 19:35touch as well, but where's the best place to get in touch and
- 19:37what makes a message that you respond to?
- 19:39Emily Keller-Logan: Yeah, that's great. I'm at writing on
- 19:42substack now called it's at marketing in the messy middle.
- 19:45And so I love to have conversations about, what are
- 19:48you learning and what's effective in marketing, and
- 19:51what's not? How are you using AI, and where is it working, and
- 19:53where is it not? So those are the things I write about. And
- 19:56I've gotten people who've reached out to be like, You know
- 19:58what? This helped me? You know? Have the confidence to start
- 20:01talking and sharing my own learnings. Or I've had people
- 20:02who have talked about like, this is how I'm going into my next
- 20:03marketing meeting to talk about the use of AI, like, what do you
- 20:09think? And so I think it's just engaging on some of the harder
- 20:13topics that we have when you're at this level in marketing and
- 20:16and you're figuring out as you go, so that's kind of where to
- 20:19find me and how to reach out.
- 20:20Tom Ollerton: Right, I found it already. Let's share that as
- 20:23well in the in the notes. So Emily, thank you so much for
- 20:27your time.
- 20:28Emily Keller-Logan: Yeah, thank you for the opportunity. It's
- 20:30been great.
- 20:37Tom Ollerton: Hi. Just before you go, I'd really appreciate it
- 20:41if you could take the time to write a review of the shiny new
- 20:44object podcast on Apple podcasts or iTunes, or whatever it's
- 20:47called these days, or whichever podcast provider you use. We're
- 20:52at any podcast. So it would go a long way for us if you could
- 20:55just share the Word and give us a bit of a support on those
- 20:58channels. That'd just be fantastic if you haven't got
- 21:00time, that's also cool. And yeah, if you could tell your
- 21:03colleagues about the podcast, and also, if possible, don't
- 21:06forget to subscribe. And I'd love to hear your feedback. If
- 21:10you'd like to speak on the podcast or be a guest, or you
- 21:13think I'm asking the wrong questions, anything I'd be super
- 21:15interested to hear what you think. So please email me at
- 21:19Tom, at automated creative.net that's Tom at I'm not gonna
- 21:25bother spelling it anyway. You'll work it out. Thanks so
- 21:28much.