Latest / On Scope: The Marketing Podcast / Your How-To Guide for Mastering MMM
Transcript
- Speaker 1 (00:00): The views and opinions expressed on this podcast are those of the speakers and do not necessarily reflect those of the ANA or its members. On today's episode of On Scope, Game Theory's Karen Kaufman is your guide to modern marketing mix modeling mastery, magnificent. And this week on ANA Magazine, Matthew Schwartz is taking us to school on principle media buying. All that next, On Scope. One for the money, two for the show, three to get ready, and this is On Scope, the marketing podcast brought to you by the ANA. I am your host, Mike Berberich, and with me as always, the founder, the creator, the producer of On Scope, Ryan Dinger in the house. Buddy, how are you, my friend? Speaker 2 (00:57): I'm doing well, Mike. I like to imagine that you just have a running list of potential show intros that you're just always adding to because you're always keeping me on my toes. Speaker 1 (01:05): Yeah, they're north of 600 at this point, Speaker 2 (01:07): So Speaker 1 (01:08): I'm pretty comfortable. Speaker 2 (01:09): You're doing the homework. I appreciate it. I appreciate it. How are you, my friend? Speaker 1 (01:11): I'm doing fantastic. Gearing up to have a strong end of the year. I know we like to kind of get all cozy and sleepy and I love it. But this is an opportunity to make one more big hurrah before we all - Speaker 2 (01:27): Yeah, this is Q4. This is where you get into the black, baby. This is the time, the most valuable quarter. Speaker 1 (01:32): Exactly. I love it. I love it. I love it. And we are here to help you, as always, continue to optimize, continue to grow, continue to get to that next level. But before we do that, in an incredibly, incredibly important area - Speaker 2 (01:46): Or perhaps in an effort to do that. Speaker 1 (01:48): Actually, yeah, this is all coming together very nicely. Speaker 2 (01:52): All toward the same mission. Speaker 1 (01:53): That's right. Synchronicity in play right here, ladies and gentlemen. Can you believe it? We've got another update from our man Matthew Schwartz on this week in A&A Magazine. Here to discuss what is fresh out the oven from ANA Magazine is your guy in mind, Matthew Schwartz, the editor of Our Fine Publication. Matthew, what have you got for our listeners this week? Speaker 3 (02:25): Hi, Mike. Speaker 1 (02:26): How you doing, buddy? Speaker 3 (02:26): Okay. This week we got a piece that kicks off a new op-ed initiative for the publication. So for folks either on the agency or client sides have a burning issue that they'd like to discuss, please go to the lower right-hand side of ANA Magazine's homepage where you'll find my email address to reach out and see what's on your mind. Speaker 1 (02:45): That's exciting. Speaker 3 (02:46): First up, we got a piece on Principle Media written by Rick Cordoville, who's the chief media and marketing officer at tech giant Lenavo, who tackles Principle Media, which is stirring quite a good deal of debate, if not controversy throughout advertising precincts. Speaker 1 (03:03): Ooh, we've got a juicy one. Okay. Well, let me set the table with any of our listeners who are not familiar with the concept of Principle Media buying. So Principle Media is when an agency becomes the owner or the principal of a source, a group of media units. Agencies acquire the media through upfront purchases or real-time bidding, any of the standard methods and resell it to their clients. Thus, they cease to be the agent of the client and now they're acting as the principle. And while this is by no means a brand new trend, it is accelerating noticeably. Cordoval points to a recent A&A survey of 114 marketers showing that 58% of respondents said their companies had used Principle Media in the prior year. That number is up from 47% in 2025. So Matthew, the question that I have for you, how did we get here? Speaker 3 (04:06): Cordeval provides the context. Back in the 2010s is when Principle Media started to take shape. Now facing shrinking margins due to full-time equivalency compensation structures, ad holding companies started to embrace this practice and in the process started to generate some hefty chunks of revenue. Throughout his career, Cordova has seen Principle Media evolve. He says that the brand's primary KPI was being met but rarely exceeded, and that seemed a little odd to him. The client got what it wanted, but buying media enabled the agency to take a large cut of the campaign CPMs, sometimes up to 50%. And for some history, marketers may recall the landmark study ANA dropped about 10 years ago showing that Principle Media markups ranged anywhere from 30% to a whopping 90%. Speaker 1 (05:00): That is flabbergasting to be perfectly frank. And you can begin to understand why the issue is so fraught with complication, right? Speaker 3 (05:08): Yeah, you got it, Mike. Cortival is fairly blunt about the major concern about Principle Media. It's a false economy. When the agency shifts from being an impartial advisor to reselling inventory, transparency starts to get a little cloudy. He adds that the dearth of disclosed costs, margins, and incentives make it really difficult to measure the value of Principle Media. Speaker 1 (05:30): Yeah, clearly. But how can we assuage these concerns? Well, with 90% of marketers saying the top challenge with Principle Media is uncertainty, whether the recommended media is in the client's best interest. Isn't that the point? Speaker 3 (05:48): Yep. There are a few things that marketers can do to improve the situation, starting with disclosing the agency fee and making it negotiable. Without knowing the true agency cut, marketers can't measure how much of their advertising budget translated into legitimate working media to achieve their KPIs. Speaker 1 (06:08): Yeah, that makes perfect sense. And I've had a lot of really interesting conversations about media buying that it's like, okay, yes, we need to cut the fraud. Yes, we need to cut the fat, but we can't forget that this all costs money and this technology and these services are actually providing a service. So being more upfront and seeing exactly what this cost covers, I think that that's a great bridge to it. And the article also points out that transparency into the agent's acquisition rate markup tech data charges and comparable agent-based alternatives is also a must-have here. Speaker 3 (06:44): Very much so, Mike. To foster transparency, Cordova recommends that marketers run their own AB test in say programmatic media before they jump into Principle Media. This way they can make their own side-by-side comparison of cost, audience delivery, quality, and outcomes. Speaker 1 (07:02): I think that's brilliant. You're coming with data that you own, that you have run through the test, and it's now on Principle Media suppliers to explain why if that's not looking apples to apples. Really, really love that. And sitting at top this entire pyramid of complexity is governance, a major sticking point with just 57% of marketers having guidelines for the practice. That's down from 62% in 2024 per the ANA study. It's wild. Speaker 3 (07:37): That's the rub, Mike. Without guidelines and proper controls in place, things could go sideways really quickly with Principle Media. As the practice expands, marketers must include language in every contract specifying how Principle Media is being approved with written approval strongly recommended. Make sure you're protecting your brand so if you drive into Principle Media, you're mapping things out correctly and making sure there aren't going to be any surprises down the road. Speaker 1 (08:05): Yeah. When hundreds of millions of dollars are on the line, surprises are not the thing that you want to run into. And unsurprisingly, this op-ed provides key takeaways for building this process and maintaining it. Thank you, Matthew. It's a pleasure as always to have you here. Speaker 3 (08:26): You bet, Mike. Speaker 1 (08:27): For this article and more as well as the monthly ANA magazine quiz and your opportunity to participate in ANA Magazine op-eds, go to ana.net/publications. Speaker 3 (08:39): Thanks, brother. Speaker 1 (08:41): And there you have it this week in ANA Magazine. Big thanks to Matthew Schwartz. As always, Ryan, things are heating up more and more in the area of principle media buying. I'd love to get your thoughts on this. Speaker 2 (08:54): Yeah, I mean a fascinating article, thanks again to Matthew as you said, and Lenovo that we're getting these opeds now. Very cool. Yeah, super cool. It's interesting to me, you and I have been around in this industry for a long time. We remember the transparency report that Matthew mentioned during the segments. Indeed. It's interesting to me that versions of this issue have been around for so long and our wonderful media practice who is always on top of all this is still making the recommendation to brand side marketers that you really need to have an understanding of not only where your ad placements are going, but also what are the arrangements for your media buy agency and what are they doing that you need to look at these contracts and really make sure that you understand every single aspect of it. That feels to me, and perhaps it's just because we live a little bit too close to this stuff, that we've been hearing this forever. (09:49): So it's a little shocking to me that, or maybe not shocking, but it's a little curious to me that we're still finding that this is a recommendation that needs to be made that if you're a brand side marketer, you have to understand these arrangements with your agency. Speaker 1 (10:01): A hundred percent. I mean, it can get complicated, but when you really boil it down to once the agency is working with Principle Media, they're no longer your agency, they're the principle media seller. Obviously, incentives and motivations may not be the exact same. So yeah, this is another cry for marketers to take more ownership, to get under the hood. I feel like it's been 10 years since the phrase FOFO, the fear of finding out. Speaker 2 (10:32): Oh my goodness. You just took me back. Speaker 1 (10:34): Yeah, exactly. Friends, what are we always learning on scope? You run towards your fears. Speaker 2 (10:42): Run toward the dinosaur baby. Speaker 1 (10:43): Exactly. And challenge the dinosaurs. That's a deep cut for our longtime listeners. But yeah, I just think that it's never the easy move, but it's always the right move Speaker 2 (10:54): Man. Speaker 1 (10:55): Yeah, 100%. And one thing that I think is kind of getting in the way of knowing exactly where our media dollars are going is having the right measurement model to really clearly report that on a reliable basis. Speaker 2 (11:11): I think I know where you're going with this. Speaker 1 (11:12): You know what? You're a mind reader by trade, so I think you're right. I'm talking about today's guest and today's topic. It's media marketing mix modeling. I have to go ahead and slap myself on the wrist for that because I don't want to think too small about this. You know who's not going to think too small about this? Our guest today. Karen Kaufman, Global Chief Strategy Officer at Gain Theory, a global marketing effectiveness and foresight consultancy that helps brands maximize the return on their marketing investments by providing data-driven insights and strategic recommendations across marketing measurement, optimization, and strategy. Today, she joins the pod to help us crack the code on effective marketing measurement and modeling. No small task, but I feel she's just the person for the job. My conversation with Karen is up next. Listeners, often here at OnScope, The Marketing Podcast, we are shining a light on areas of the marketing function that we feel aren't getting their fair shake. (12:21): But today I'm actually very pleased that we're taking on an area that is finally, it feels like, getting its just due. Some might call this a measurement renaissance, including the author of that very work. The one and only Karen Kaufman, global chief strategy officer at Gain Theory is here today in ANA Studios. Karen, welcome to the pod. So happy to have you here. Speaker 4 (12:52): Thank you so much. So happy to be here. Speaker 1 (12:55): So what I'm saying, the measurement renaissance, I think there's been a lot of misunderstanding and the pendulum going back and forth and really hopping from one thing to another. And with the rise of AI, particularly agentic AI, I think everybody's almost being forced to take a step back and be like, "Can we get some foundation on this?" And so that's what I'm hoping that you and I can give to our listeners today. Sounds good? Speaker 4 (13:26): Yeah, that sounds great. Speaker 1 (13:27): Excellent, excellent. So right at the top before we even begin, MMM. When I came to you, I was like, "Oh, media mix modeling," but that is actually a little bit of an outdated way of thinking of it. So if it's cool, I'd love to kind of level set on what MMM means to you and what perspective we're going to be talking about it and many other things today. Speaker 4 (13:51): I think that is such a good first question. Speaker 1 (13:53): Well, thank you. Speaker 4 (13:54): Because it's one that I think carries a lot of misperception. So I have met with clients that talk about MMM and they jump right to it's media mix modeling, everything is about media. I've talked to other clients that believe that MMM is market mix modeling and it needs to be inclusive of all marketing channels. The reality is that MMM is a technique that really should start by looking at overall broad business drivers. Thank you. And if your MMM program isn't looking at things like distribution, pricing, trade, trends in the market, exogenous factors like economics, you're really sort of missing opportunities to think about what's going to drive the business moving forward. So even though we talk about it as being MMM, when we talk about it, what we're really talking about is business driver mix. I think some people call it commercial mix modeling, but it's really that holistic understanding of the drivers of business performance. Speaker 1 (14:51): Thank you so, so much. I have a very big belief that if your trajectory is off this way or that way, 10 feet out, it's not going to make a difference. 10 miles out, you're in a different city than you thought you were headed to. So I think a lot of marketers might get off on the wrong foot on their thousand mile journey. So yes, and this is really a recurring theme here at OnScope is that if the business needs are not central, you are probably already doing something that could use some improvement. So thank you. And I want to continue on that strand a little bit because when marketers say some blanket statement like they need better measurement, what problem are they actually trying to solve? Speaker 4 (15:42): I think that's a great question too, because oftentimes people think that it starts with the methodology and they want to jump right into what technique are you using? And that's certainly part of it. And we absolutely want to be transparent around what techniques are we using, how are we incorporating the data into the model? But I think the real question needs to be much more broad than that. So for me, when it comes down to are we using the right MMM approach, it needs to start with what are we trying to answer? And so from our perspective, getting people into a room and understanding what are the business questions that we're trying to answer, if you had that information, how would you use it is really foundational and critical to extracting value out of any MMM program. What you don't want to have happen is you collect all this data, you do rigorous analysis and you come back and people say, "Oh, that's interesting, but actually my question is totally over here." And so starting with what are the business questions that we're trying to answer, let's make sure we have the right data to do that. (16:44): Let's make sure we're using the right techniques. Now, I think technically from a modeling perspective, there is some consistency in the industry around the kinds of techniques that work best, certainly for different industries, but there's also a broader swath of analytic approaches that can be brought in. And when people talk about unified, being able to unify measurement across a variety of techniques to answer business questions is really where the value comes into play. And then I think the last piece to it is don't just stop with, "I had questions, I got my answers, check the boxes done," but making sure that your organization is set up for success and that you're using the information in a meaningful way. And I think a lot of times people think about, "Do I have the right foundations in place but miss the part around culture and culture building?" And I think that's a big part as well. Speaker 1 (17:37): Yeah. There are so many gems in that answer. Thank you so much. It's funny when you were talking about what models you use for measurement, the immediate comparison that jumped into my mind is AI. Oh, what AI are you going to use? We need to use more AI. Well, if you're just thinking about it like, well, what platform are you going to use? No, what problems are you looking to solve? You're never going to get anywhere with a platform versus a conversation. And yeah, without understanding exactly what you're trying to achieve, the different techniques and models and schools of thought, they can be anywhere. And another thing that I think people get into the idea that it's binary, it's either or, that you can't have different techniques to solve the things that they do best. So I love that unified practice of being the kind of city on the hill that brands have to be striving for. (18:38): I think a lot of this is that a lot of marketers, a lot of marketing leaders just don't know what they don't know. So for a company that has an established measurement system, but I don't know, is this good? Is this bad? Are we in the middle? What are some warning signs that a company is using the wrong measurement models for its needs? Speaker 4 (19:00): Yep. I mean, I think going back to what I said before, I think fundamentally the starting point should be, is my measurement program and are the measurement techniques we're using able to answer the questions we have? So I think that's certainly part of it. I also think that there's some themes that are helpful to think about when you're thinking about your measurement program. So the way that I talk about it is sort of a three-legged stool. So one piece is, do I have the breadth of understanding that I need to be able to holistically think about and plan my business? So going back to what I said about MMM, it can't just be about media. It is media, but it's marketing, it's broader business drivers, it's understanding the ecosystem and environment in which we're operating today, which might be very different from the past. So the first piece is, do I have the right breadth? (19:48): The second piece is, do I have enough depth of insight? So am I able to go deep into sort of the peeling of the onion, if you will, to make sure that I'm getting a real understanding of what's driving performance at the most granular level possible? And I talk about that for a lot of clients, people used to think advertising was synonymous with media and the media choices, but we know that advertising is media, it's creative idea, it's creative execution. So making sure that when you're peeling that onion, you're able to get into all of the components of advertising and not just media. So breadth, depth, the last piece is then speed. So making sure that we are operating at the speed we need. Now, I oftentimes am in meetings with clients where they'll say, "I need speed, faster, faster, faster." And I always say, "You can go fast, but let's understand when are you making decisions? (20:42): When are those critical moments that you need the insights to come in?" And that might be different for different channels, for different activities. So let's time the measurement program for the speed that you're operating at and not just speed for speed's sake. And then the last piece, I know I said it was a three-legged stool, but the last piece is then how do I apply it to the future? So one of the things that I think is a challenge in measurement is no matter what technique you're using, there is sort of a retrospective rear view mirror to it. Speaker 1 (21:13): Exactly necessarily. Speaker 4 (21:14): So whether you're looking at last three years, last three months, last three days, last three hours, you do need to be able to apply it to the future decision making. So in that three to four legged stool - Well, Speaker 1 (21:27): The fourth one is the thing on top. Speaker 4 (21:29): Right. Which is really around foresight and making sure that you're bringing an understanding of trends and how the world is changing so that you can adapt the intelligence that's coming out of your MMM program to make sure that it is future ready. And I think that's really important as well. Speaker 1 (21:43): Yeah, that last point is so, so important because, and you go back and back in history, it makes more and more sense, but measurement was always like, "Well, campaign's wrapping up. Let's see what the last four months are and we'll make some adjustments tweaking this, that, and the other thing that it was always this backwards looking validation of did we do good or did we do bad?" It was very rarely informing proactive decisions. And I think that's a massive, massive unlock for perhaps why measurement is starting to have its moment in the sun. I think more and more brands and marketers are waking up to this fact that this is supercharging your decision making towards the future, not just validating your decisions in the past. Speaker 4 (22:34): Absolutely. And I think one of the things that we've been talking to a lot of clients about is this idea around if you think about it as a validation, I did the right thing and you want to pat yourself on the back, fine. But to get real value, you need to connect it right to decision making. But it's not about running scenarios. Lots of clients have access to tools where I can run scenarios like what if I put another million dollars in? What if I move from this activity to that activity? But to get real value out of a program, you have to then not only decide based on the upside potential, but you actually need to make the decision and activate against it. And so one of the things that we've been doing is really emphasizing the importance of having value tracking program in place where on a quarterly basis you're saying, what decisions did I suggest doing over the last 12 weeks? (23:27): Which of those did we implement? Which ones did we not? How much money was I leaving on the table? And what potentially organizationally was getting in the way of making that active? And I think that's really important because there's a big chasm, if you will, between opportunity identified and real value delivered out of some of these programs, and we want to close that gap. Speaker 1 (23:49): I absolutely love that. A value tracker is a fire concept of what's really happening. Okay, these are the things we did, but what really occurred in the real world as a result of all those things? Brilliant, brilliant stuff. Listeners, stick around because when we come back, we're going to dive into something that Karen touched on and it's validating meaningful findings from interesting data. Stick around. This is a topic near and dear to my heart. You're not going to want to miss it. Ryan? Speaker 2 (24:22): Yeah, Mike? Speaker 1 (24:23): The following question has been brought to you by OnScope, The Marketing Podcast. How's it going, buddy? Speaker 2 (24:30): I'm doing great. Why are you talking like that? Speaker 1 (24:32): The following response has been brought to you by OnScope, The Marketing Podcast. Ryan, I had this idea that to generate some additional revenue for the pod, that I was going to sponsor this conversation. Speaker 2 (24:47): You're going to sponsor the conversation that we're having right now? Speaker 1 (24:53): Yes, yes. Generally, yes. Speaker 2 (24:55): I got to tell you, Mike, I think that might actually be illegal. I think that might be fraud. Speaker 1 (25:01): Huh. Well, then I don't really have anything to talk about right now, Ryan. Anything going on in your world? Speaker 2 (25:09): You know what I'd love to talk about? Speaker 1 (25:10): What would you like to talk about? Speaker 2 (25:12): Sponsorship and partnership opportunities via the A&A. Speaker 1 (25:15): Are they legal? Speaker 2 (25:16): They are very legal. Speaker 1 (25:17): Oh, then let's go crazy. Speaker 2 (25:19): Not only are they legal, they're valuable because you, dear listener, when you sponsor an A&A event, you're not just reaching marketers, you're reaching the decision makers, discussions that shape the industry start in A&A events, whether it be a networking opportunity, a coffee break, or in one-on-one meetings. Speaker 1 (25:35): Yeah, absolutely. And an A&A sponsorship is not just about hanging up a logo and calling it a day. Our national industry conferences are just electric spaces for convening marketing leaders, the people you want to get in front of and spurring meaningful conversations, making new relationships. Real things are happening. You can be in the middle of it all with an A&A sponsorship. Speaker 2 (26:03): You might actually be the one joining the conversations that move marketing forward, and I can't think of anything more valuable when you're looking for a sponsorship opportunity than being the ones who are pushing innovation, who are pushing our industry into the future. Speaker 1 (26:17): Truly, this is your opportunity to be the straw that stirs the drink. Speaker 2 (26:21): You want to learn how to do that? Then you got to visit us at ana.net/sponsorship. Speaker 1 (26:26): That's right. Go over to ana.net/sponsorship, and let's begin a beautiful friendship. Speaker 2 (26:35): And now, back to our show. Speaker 1 (26:39): Listeners, we are back. This is On Scope: The Marketing Podcast. With me today, Karen Kaufman, Global Chief Strategy Officer at Gain Theory. And Karen, you actually mentioned this earlier in our conversation, but I'd like to just dive into it a little deeper for a moment. How do you validate whether a model is actually producing useful insights versus simply generating interesting reports? I feel like all of our listeners might have a, "Yeah, I think I could tell the difference," but I don't know that that's quite the case. So what from your perspective are the telltale signs that I'm going in the right direction or this is fascinating, but I don't want to spend any more money generating this? Speaker 4 (27:26): Yeah. I mean, I think at its heart, there are some standard outputs that you should expect from any MMM, right? Things like understanding what's driving the business or return on investment. But I think where the real valuable output comes is answering the key business questions directly. So a marketer asks a business question like, "What's the right price point for this product?" Or, "How should I think about a package redesign?" And being able to answer that question specifically, I have found to be the most valuable, especially when at the beginning of the program you start with what I mentioned before, which is what is your business question? And if we can answer that question, what would you do differently? Because if you're not going to do anything differently, it can't generate value for the business. So I think answering the key business questions is a really important part of any MMM program. (28:19): And so from a gain theory perspective, we provide all the standard outputs, but then we go above and beyond that to answer the specific business questions that we identify. I think the other part of it is really doing what I call an assessment of the opportunity that it can generate for the business versus the ease by which you can make the change. And so making a recommendation like move money from this activity to that activity might be something that's really easy to do, especially if that budget is owned by a single person, right? It's harder to do if you've got a brand team and a conversion team and they have separate budgets and they don't want to work together. It's even harder if you're making a recommendation like how do you optimize investment across a portfolio of brands that has individual brand owners or across geographies where budgets are not set that way. (29:15): So a lot of the work that we do in setting up the program is, again, understanding the business question and the ease by which the outputs can actually take hold within the organization. And so you start off right from the start in terms of prioritizing the things that are of the highest value to the organization and are easy to implement. And then you work through an operational sort of organizational change program where you work through the barriers that are going to stand in the way of activating the insights. Speaker 1 (29:44): That makes perfect sense. And I think the path of least resistance has gotten a really bum wrap and people think, oh, you mean the lazy way? It's like no, the stuff that's going to produce the clearest return with the least... Amount of disruption is going to be the seed that grows into a mighty oak. You know what I mean? Speaker 4 (30:07): Absolutely. Yeah. Speaker 1 (30:08): You don't start with level 10 difficulty on something that you're just getting into or just wrapping your head around. So I love that. Yeah. Path of least resistance, my friends. Go for what is right there in front of you and work from there. This next one kind of comes along this area. I have, in my many years here at the ANA, being a host of podcasts and just getting to talk to a lot of brilliant marketers and marketing partners like yourself, every problem boils down to people. Everything is a people issue. And you've said it a couple of times now, but even the best model is useless if nobody trusts it. If you're just being like, "Oh, interesting. I'm going to stay doing what I'm doing. I'm going to follow my gut instead." How do you build confidence in measurement across an organization, especially in those areas? (31:07): I was just thinking when you were setting that up about people having to work together on budgets, so many parent brands have things that you all pool in together and then everybody wants to kind of have their thing be what the entire pool is about. There needs to be decisions made up top and follow through made throughout the organization. How do you build confidence in the model that you've landed on? Speaker 4 (31:34): Yeah. I think there's a couple of things that we do. I think number one is operating with complete transparency so nothing can be hidden. We do a lot of work with clients, opening the hood, showing the models, the algorithms, the what we've done to data, why we've done it. We do workshops with anyone who's interested. We offer technical and non-technical deep dives to the different audiences you're speaking to using the right sort of level of granularity around the models. But it's really about doing the work to build the trust early on. And we do those workshops very early in onboarding to make sure that by the time you get to model outputs, everyone says, "We know what we've done and we know why." So transparency I think is part of it. I think there's also a need to work within organizations to build a common language. (32:23): And I'll give an example of this, which is very pertinent to this conversation, which is one of the things that comes out of MMM is an understanding of incremental sales or incremental profit. With one client, we quickly identified that the term incremental meant something completely different for the marketing team and the finance team. Speaker 1 (32:43): Oh my Lord. Speaker 4 (32:43): So even though we were using the word incremental and assuming everybody knew what we meant by that, the marketing team was like, "Yes, we're driving incremental sales." And the finance team was like, "We don't believe it at all because this number couldn't be possible." And when we dove into it, what we realized is actually their definition of incrementality was different. And as soon as we clarified what we meant by that, then everyone was on board about the program overall. So I think just like being really clear about when you use a word that you might think everybody understands, still define it, make sure everyone's aligned to the meaning of it and make sure that you're doing that work early on. I think that's a big part of it as well. And then the last piece is don't underestimate the value of having senior leadership involved. (33:28): Of course. So the clients that we work with where a CEO or CMO or chief revenue officer come to the debriefing session and are involved in the conversation and want to understand the models are the ones where organizations, everyone gets on board. And I think having senior leadership involved in the program is critical as well. Speaker 1 (33:50): Yeah. Oh, absolutely. I mean, because I forget which one of our many esteemed guests from season one this was, but I was talking to somebody and he's like, "Listen, if you're going to make major change in an organization, that first feedback survey going to come back negative. People don't like change even if they desperately need it. So having a leader being like, this is the way we're going. You don't have to worry about your personal accountability for following this thing even if you are skeptical of it. We are moving as a unified front." I think that that does give people either confidence or it kind of snuffs out, "Well, I don't like this, so I'm going to make sure that this doesn't, that I stay in my lane and everybody else can do this." Yeah. Senior leadership buy-in is just, you can't underestimate it ever, especially for something like this. (34:46): Karen, this has been an awesome on the ground conversation. I love this. I feel like so much of this is immediately applicable for our listeners, but right now is the moment we're turning marketers into masters. This is where the rubber meets the road in a little segment we like to call the CTA. (35:20): Karen Kaufman, global chief strategy officer at Gain Theory. Are you ready? Speaker 4 (35:27): I am. Speaker 1 (35:28): What does a realistic roadmap look like for a company that wants to mature its measurement capabilities over the next two or three years? Really bought in, we want to make a sea change, get up to snuff. What does that roadmap look like? Speaker 4 (35:46): I think for every client, the roadmap is different and I think the starting point needs to be an assessment about where you are. One of the things that we do oftentimes with clients is really a broad assessment of the marketing measurement program that exists today. Where are you? What does best in class look like? What are the business use cases that you want to enable measurement against? What are the gaps? And then building a roadmap off of that. And so every client's roadmap is different. I think we would be remiss to say that things like AI and Agentic are going to be part of most clients' measurement programs, but I think it needs to be broader than that. Again, going back to the initial conversation we had, having the right techniques, having the right models, having the right business questions needs to be considered in any roadmap or any measurement program. (36:38): But I would encourage every listener to also think about what do we need to do as an organization to make this a core part of the way we think and the way we behave. Speaker 1 (36:47): Karen, this has been such a delightful conversation. I feel significantly smarter than when we first sat down. So I am in your gratitude. It's been a pleasure having you as a guest on Scope. Speaker 4 (37:01): Thanks for having me. Speaker 1 (37:03): And here we are at the end of another episode of On Scope: The Marketing Podcast. As always, I want to give a big thanks to our guest today, Gain Theory's global chief strategy officer, Karen Kaufman, for giving us a really on the ground conversation about measurement and going beyond the technology to the people. And one thing really kind of broke through to me at least from our conversation, best in class platforms absolutely matter, but what really matters most is that you know what your organization is and what drives its growth and getting clarity on measuring those things versus looking out into the world on who's got what and who's using what, really, really stick to what you know matters and make sure your platform is giving you the measurement that enables you to act on that. I think that's kind of pinnacle above it all. (38:06): As a reminder, if you've got a topic or guest for a future episode of On Scope, go ahead and shoot us a note. We'd love to hear from you. That email address, onscope@ana.net. And now, as always, here is your moment of marketing meditation. Take a deep breath, relax those shoulders, and consider the following from author Jennifer Egan. Mysteries that are destroyed by measurement were never truly mysterious, only our ignorance made them seem so. Think on that and we'll see you next week. Speaker 4 (38:56): This has been a presentation of ANA Studios.