Latest / Signal & Noise: Bringing Clarity to Media, Data, Tech and AI / The End of Marketing’s Age of Opinion: Greg Stuart on Measurement, Attribution, and Making Marketing More Predictable
Transcript
- 0:03This is signal and noise, bringing clarity to data, tech
- 0:07and AI. OK, Hey, welcome back everybody.
- 0:15It's Brett House at Signal Noise with my Co host Rio Longacre
- 0:20back after a long trip to the South to possible in Miami and.
- 0:25So much fun. And New Orleans Jazz Fest.
- 0:28And we've got Greg Stewart. We're thrilled to talk to.
- 0:30And for those that don't know who Greg Stewart is, he's the
- 0:33CEO of the Marketing and media Alliance MMA, formerly known as
- 0:37the Mobile Marketing Association.
- 0:39Not to be mixed up with mixed martial arts, right And.
- 0:41Not to be mixed up. Only if you're trying to.
- 0:43Only if you're a teenager, my son trying to day my daughters
- 0:45do I let you know that I'm I'm with the that I'm the CEO of the
- 0:48MMA. And they better watch out.
- 0:50And and as you probably got from that's that comment, Greg's got
- 0:53a really good sense of humor and I've always appreciated that
- 0:55about you. But you spent the seven, seven
- 0:58years basically rebuilding. And I remember when the MMA
- 1:01first launched, I was back in the rich media space of a
- 1:03company called Unicast by DG Fast Channel.
- 1:06And you guys were just getting started.
- 1:08And then there was like a bankruptcy moment.
- 1:11Close to you turn this around bankruptcy or close to it, but
- 1:14like it's turned around since. Yeah, yeah, we're all turned
- 1:17around. Yeah, we're all turned around.
- 1:20Before you guys start putting false information into the the
- 1:22the the, the, the digisphere here, I should step in.
- 1:26Yeah. No, listen, it was bankrupt and
- 1:28insolvent before I got here, just to be really clear.
- 1:31Yes, Yeah, Yeah. No, I was brought in.
- 1:33Yeah. In fact, they'd had three CEOs
- 1:35in four years. That sounds like a board.
- 1:37Yeah. Yeah, that's a.
- 1:38Board, you've been there. For quite a while now.
- 1:40Yeah, yeah. No, it's been over.
- 1:41It's been over well over a dozen years now.
- 1:43Yeah, yeah, yeah, yeah, yeah. No, but you're right.
- 1:45But it was a mess of a turn around, you know, I mean, but
- 1:47same with the IB. When I got to the IB where
- 1:49$1,000,000 revenue and 29 members and three of them hadn't
- 1:51paid their dues, I mean, that was ready to tank too.
- 1:54So I turned around the IB and then left there and then I came
- 1:56over here to turn around the MMA.
- 1:57Exactly. And you guys have, what, 800
- 1:59member companies? Something like 60 team members.
- 2:01Yeah, it's like 800 and 68160 corporate members worldwide in
- 2:0616 countries, and we're about 100 staff people at this point
- 2:10worldwide. Yeah, yeah, yeah, yeah.
- 2:12We've become sort of big and legit at some level, I guess.
- 2:15Headquarters in New York, Right? Great.
- 2:17Headquarters in New York, Yeah, I'm based on New York
- 2:19headquarters here, right? Yes.
- 2:20Yeah, and I've heard nothing, honestly, the last couple,
- 2:22there's nothing but really, really good things.
- 2:24I haven't been able to go to your your last events, but
- 2:26you're you're the events you've been holding have sort of risen
- 2:29up to a level where I'm like, wow, everybody across agency,
- 2:33brand, vendor are all going yeah, that was actually a really
- 2:37good substantive event. And I think you guys have prided
- 2:39yourself on sort of being kind of helping to architect the
- 2:43future, right? Talking about things like MTA
- 2:45and measurement and analytics and getting people like firing
- 2:48shark on the on your great debate series, like it's been
- 2:51thought leadership, but not at a surface level.
- 2:53You guys have gone really deep on a lot of these topics and.
- 2:56That's why we already have you on this pods, Greg.
- 2:58So, yeah, yeah, well that's good to hear.
- 3:00So I'll get for the listener in case there's maybe those who
- 3:02don't. We are in nonprofit industry
- 3:03body here to, you know, the, the fundamental thesis thing is that
- 3:09we think that we can advance marketers ability to create
- 3:11impact. So that's the mission statement.
- 3:13But what that really means is that we think there's too many
- 3:17big unanswered questions in marketing and nobody's really
- 3:21leading with the charge to I, I guess I put it like raise the
- 3:26stature and gravitas of CMOS and and we think the way to do this
- 3:30have a greater impact on business.
- 3:31Like I'll give you like one small example, you know, and I
- 3:34think Brett, this is the one you probably most know what most
- 3:37know us for because you guys worked on this back way back
- 3:39when. But it's like, what's the value
- 3:43of brand relative to performance marketing?
- 3:47And what struck us, we looked at that issue about 6-7 years ago
- 3:50now and said, well, that's a math problem.
- 3:52It's not a cold fusion problem. It didn't need new science.
- 3:54You just needed to do the math. But math requires collecting the
- 3:57right amount of data, and nobody had attempted to do that, so we
- 4:00created a one. On the brand side, no one had.
- 4:02Tried to do it, nobody had tried to do it right.
- 4:03And you know, we don't talk about brand.
- 4:05I mean, I'm an ex brand guy too. I worked on PNG business for
- 4:07years as an agency guy. But just like we'd never
- 4:10answered the big question. So the Mmas whole thing is like,
- 4:12like we if we're going to be taking legitimacy, if we're
- 4:15going to be given legitimacy, if we're going to have trust is the
- 4:18big question, then we need to answer these questions in a way
- 4:21that the CFO of the board are going to appreciate.
- 4:23And so that's what we set to do with our brands.
- 4:25Performance studies say well what is the value of brand long
- 4:27term financially? Yeah.
- 4:29No, we did a lot of that work as you know with Nustar, right.
- 4:32And we kept proving again and again with like 10-15 years
- 4:36worth of data for big, big banks, primarily financial
- 4:38services, which are often bifurcated between brand
- 4:41advertising. It's doing your television
- 4:42advertising and your direct response market is that of their
- 4:45own budget, their own channels, direct mail being probably 78%
- 4:48of that spend. And we kept saying you've got to
- 4:50split the spend, it's got to be 5050, You've got to put more
- 4:53money allocated to brand spend versus down funnel which which
- 4:57is where 80. Percent well, but when times get
- 4:58tough, people always cut brand and they just invest in it.
- 5:01Was harder for them to prove. Well, I tell you what we know
- 5:04now. So since this is this is the
- 5:06endless and you know, there's a guy, there's some guys out of
- 5:09the UK names will come back to me here who did do some work
- 5:12around the long, long and short of it.
- 5:13There was the work that they did for 20 years, but they used kind
- 5:16of a funny data set. It was awards and then they
- 5:20tried to supplement that, but it wasn't.
- 5:21It was an imperfect data set. We set out to collect the
- 5:25perfect data set. So over 12 months we tracked
- 5:29media at an individual basis, media exposure, brand attitude,
- 5:34brand attitude shift and actual purchase behavior.
- 5:38And nobody had tried to put those together.
- 5:39In fact, when we first came up with the methodology, I showed
- 5:41it at Google. They said we love this, we don't
- 5:44think what you're trying to do will work.
- 5:46That was very fun, they said that.
- 5:47Yeah, yeah, yeah, yeah. It's.
- 5:48Sort of like you're connecting top, mid and lower funnel
- 5:50behavior. You're doing that, you're,
- 5:52you're trying to look at the whole thing and, and really what
- 5:54you're really looking for. And I don't know, are we
- 5:56recording video the, the, the audience have some people might
- 5:58say, OK, I don't want to make it too hard for those who are still
- 6:00on audio. But basically what we did is
- 6:03it's kind of simple. If you think you get perfect and
- 6:05you have to collect the map. And we, we've collected data now
- 6:08from almost a million people in, in the four studies we've done.
- 6:11So massive amount of data. Exactly.
- 6:14Well, and the issue was, is that you have to identify the same
- 6:17people here as you do 9 to 12 months later.
- 6:19And that was just what we defined as long term.
- 6:21I mean, you could go longer term, but that was just further
- 6:24complicates the research. OK, but then you have to, they
- 6:26have a big enough group here to begin and that you can still
- 6:28track them later and still collect it on.
- 6:30But what we're doing say if they shifted their brand attitudes
- 6:32here, then how much more did they buy 9 to 12 months later or
- 6:35over the next 9 to 12 months than the rest of the audiences?
- 6:38It's a perfect methodology and we now know and by the way, the
- 6:42answer is 5X. So if you spend a if, if, if you
- 6:45in what are the campaign is now, if you generate a dollar
- 6:48revenue, you'll generate an additional $5.00 of revenue over
- 6:51the next, you know, 9 to 12 months and.
- 6:54Specifically tied to the Halo effective the brand advertising.
- 6:57It's all directed to it's, it's the direct effect because those
- 7:00are, those are in essence RC TS. I mean you're, you're really
- 7:03doing perfect randomized control testing than that.
- 7:06So you know exactly what their change of behavior resulted in
- 7:09sales behavior. Great based on that is you know
- 7:11remember that night Nike case study a couple years ago not
- 7:13surprising at all. Remember they they put
- 7:15everything into performance. They did it for several years
- 7:18had immediate like net positive effect right there.
- 7:20The revenues boosted because they were generating more
- 7:23immediate sales. But then over time, their sales
- 7:25started to tank. People forgot about the new
- 7:26products, right? People didn't even know the new
- 7:28products. All these like these new.
- 7:30PNG did that with Facebook, right.
- 7:32They shifted a whole bunch of their money like 70% of their
- 7:35spend to to Facebook early on and took it away.
- 7:37Meta they took it away from television and had a dramatic
- 7:40like long term impact and they. Had to switch back to their, the
- 7:43thesis I have and I and I've had other people articulate that,
- 7:46although it's not perfect information, is that all those
- 7:48direct to consumer companies that were out there, there was
- 7:50such a hot thing here 10 years ago.
- 7:53I mean, many of those have now died and gone away and I got to
- 7:56know those all companies in the course of or.
- 7:58Gutted AI like all birds, right? Well, or well, yeah, well,
- 8:02whatever. That's what.
- 8:03I don't know what the hell that means, but that was nothing.
- 8:05I don't think anyone does. Yeah, I don't know.
- 8:07Yeah, I don't think they did, but they got a nice bump in the
- 8:09stock price to give them, I guess, currency go do something.
- 8:11But the the issue is that they were so fixed.
- 8:15In fact, I would talk to them and say, well, why don't you
- 8:17join the MMA? It's only like $25,000 to go.
- 8:19I'd rather spend the money into getting new customers.
- 8:22And I was like, wow, that's really short sighted.
- 8:25Like if you think, well, I mean, I guess, you know, maybe you've
- 8:28become a perfect transaction machine.
- 8:29And then many of those companies die because I think they didn't
- 8:31have enough brand. I've heard other people
- 8:33articulate that point of view. So you almost got validation
- 8:35from that in addition to these other examples.
- 8:38Well, great guy. We're like this would be really
- 8:39fun discussion. We're really stoked to you on
- 8:41here. And you know the theme for this
- 8:42because you know, this is a like theme based or thesis based
- 8:45podcast. Here was that and we loved it.
- 8:47This is based on your the presentation you did a possible
- 8:50last week in Miami. I open.
- 8:52Possible every year? Yep.
- 8:53Yep, the key theme here is marketers have more data, more
- 8:56dashboards, more AI than ever, right?
- 8:58In fact, people are overloaded if anything.
- 9:00But the real issue is, is this actually resulting in like
- 9:02better judgement and better decisions?
- 9:05Your argument in the age of opinion is it the ending gets
- 9:10it. It gets us something deeper,
- 9:11right, that the attribution or analytics maturity, it's really
- 9:13question about whether marketing can build a body of knowledge
- 9:17strong enough to survive platform noise, vendor
- 9:20incentives. And it's like, is this over this
- 9:23confidence or maybe an overconfidence?
- 9:24You can argue that AI ends up giving all of us, especially
- 9:27marketers. And but underneath this, I guess
- 9:30a discipline strong, is it weak? What is this automation doing
- 9:33for us? So we want to dig into this and,
- 9:35and look at like, how is this impacting marketing?
- 9:38What does this mean about the age of opinion?
- 9:40And what does this mean about the discipline itself at large?
- 9:42So but that let's get this, let's go to some questions.
- 9:45Yeah, yeah. Well, here, let me let me sort
- 9:46of here. I'll tee up.
- 9:47To the age of the possible. Thesis.
- 9:49I'll tip, I'll tip. What's sort of base?
- 9:51I said I opened. I opened the I opened.
- 9:53That was basically saying if everybody in the C-Suite of any
- 9:58major company is paid based on growth, and they are, and the
- 10:02CMO and marketer is allegedly the person at the table most
- 10:06responsible for growth, then why isn't she or he the most
- 10:09important person in the room? Yeah, why doesn't the rest of
- 10:12the C-Suite if? They're in the room if they're
- 10:14in the room. Well, yeah, that's another
- 10:16issue, right? And so right, that's another
- 10:18issue. So that that's my knowledge this
- 10:20and and I think when I was trying to create there as a sort
- 10:22of a moment of self reflection is that, well, we're really not
- 10:25valued. And you know, it's like I've had
- 10:27all these people talking, you know, Dara, Dara Tracidor that
- 10:29opened up an event we did out in, in, in Napa one year.
- 10:32And she said, you know, everybody in the C-Suite can do
- 10:34a market and it's a side hustle. It's like, you know, we've heard
- 10:37this and we, we always kind of bemoan.
- 10:38Devaluing the like the the discipline itself like.
- 10:41Yeah, well, the profession. Which is multifaceted.
- 10:44It's increasingly. It's not easy, yeah.
- 10:46Well, it's not. It's not.
- 10:48But that's not my point. Rio though, the enbre, that's
- 10:50not the issue. The issue is that we don't know
- 10:52what the fuck we're doing. Wait who?
- 10:55The marketers or the. Marketers, marketers don't know
- 10:57what we're doing. We do not know what we're doing.
- 10:59And so you have to start with that moment of self reflection
- 11:02and say, well, is there a reason for that?
- 11:03It's because nobody in marketing was educated to be in marketing,
- 11:09and there's no other profession like that.
- 11:11Yeah, they're the liberal arts majors, English majors,
- 11:14journalism. 'S, majors, it's a whole bunch
- 11:16of stuff that comes on. I'm not sure.
- 11:18I always make fun of the comms majors, even though I've dabbled
- 11:21a little bit me in the territory, but as those people
- 11:23that didn't know what they wanted to do with the rest of
- 11:25their lives in college. But the issue is way too.
- 11:29Yeah. The issue is that we're just not
- 11:31trained to be in this business and to have and what what it
- 11:34means to be trained and then made to be a professional, which
- 11:36is really what you're going for. Just lawyers, doctors and every
- 11:39account everybody else has is that you're trained to be in the
- 11:42profession. You understand in in our case,
- 11:43it would be the underlying science of how marketing works.
- 11:46None of us have that. None of us are re educated
- 11:48numbers are recertified. I mean, sure, there's a series
- 11:51of anecdotal information that gets passed along.
- 11:53And I'm not saying that experience is worthless and
- 11:55smart judgement. I mean, you know, the people
- 11:57and, you know, the people I work with on the board are incredibly
- 11:59smart people, but we don't understand the online science.
- 12:02As a result of that, you know there's a lack of
- 12:03predictability, and as a result of that there's a lack of trust.
- 12:06Yeah, like adjusted and there's some numbers I think to back up
- 12:08exactly what you're saying, right.
- 12:09And I think it comes from your state of the marketing analytics
- 12:11report or started analytics report, their most recent
- 12:13report, right, only 30%. This actually jumped out.
- 12:16The only 30% of marketers trust KPI is enough to use them for
- 12:19strategy. That's a problem if you don't
- 12:22understand the data science, the methodologies underneath them,
- 12:25how this stuff is tracked, how you're going to trust it.
- 12:27So that to me I think is you can you can overcome.
- 12:30It's not, it's not a KPI then if you can't trust it, right?
- 12:33Seriously, like what are you? It's no wonder they're lack.
- 12:36There's a lack of trust from the other C-Suite members.
- 12:38Only 29% can trace decisions back to data supported
- 12:41rationale. 22% describe their analytics capabilities as
- 12:45robust. And Greg, you and I have spent a
- 12:47ton of time doing this stuff at the genius words at Ana,
- 12:51celebrating analytics in marketing oriented professions
- 12:54that are driven by data. It it's sort of disconcerting to
- 12:58to still hear those numbers. Yeah, right.
- 13:00You think it's? Disappointing.
- 13:02Yeah, and. So when you look, it's average
- 13:04CMO turnover, right? It's our CMO tenure.
- 13:07It's like incredibly out of all the C-Suite.
- 13:10It's it's low, right? It's low.
- 13:12So what is possible? What do they do?
- 13:14What are you counseling and coaching your CMO members?
- 13:18What was your, I mean, the big, the big thing for the MMA is
- 13:21that you know, and listen, by the way, I don't have a, you
- 13:24know, over 3 decades of Mark and I don't have a degree in
- 13:26marketing either. Mine was economic.
- 13:28So just to be fair to everybody and to be fair too, it's an
- 13:30incredibly complex profession is what I think we're not
- 13:33respecting. It's got both hard science of
- 13:35statistics and math and some of the other sort of neuroscience
- 13:40out there. And then you've got sort of a
- 13:41bunch of soft sciences like sociology and psychology, a
- 13:44bunch of so it's pretty complicated.
- 13:45Last year at possible, I actually opened with a list of
- 13:47all the things you need to know and it's it's almost impossible.
- 13:50It's some of them. OK, But that that said, some
- 13:53movement for us to be stronger than and to answer the big
- 13:56questions, which is what the MMA is all about.
- 13:58How do I and what's the value of personalization and how do you
- 14:01do it right? What's the value of brand long
- 14:04term? How do I have greater
- 14:05predictability in my analytics? You know, all the big questions.
- 14:09How do I build a marketing org that drives sales and raises
- 14:13team Net Promoter score, which is other things we worked on.
- 14:15So MMA is not doing all the topics, but everything we do,
- 14:18we've been working on for years, even as much as a decade in in
- 14:22one of those cases to try to really help give the facts and
- 14:25science to markers that they make better decisions with more
- 14:28reliability. When you said team Net Promoter
- 14:30score you mean team marketing team and how?
- 14:32They're so here, let's let's play a little game.
- 14:34You're ready for this. What do you think is the Net
- 14:36Promoter score for marketing department?
- 14:38So when you ask people, how would would you recommend your
- 14:41marketing department? I and that's a specific
- 14:43question. When you when you, what would
- 14:44you say the Net Promoter score? So now let's go.
- 14:46You know, Apple's like a 70, right?
- 14:48You know, most people are pretty happy at 3040% Net Promoter
- 14:51scores. Not bad utilities are like 10 to
- 14:5315%. So, So what do you think the Net
- 14:55Promoter score is for people and you ask about their marketing
- 14:58department? The the from other.
- 15:01Yeah, it's got to be a number 2025 negative 2. -2 they're not
- 15:08even on the scale. So, so, and that's on average,
- 15:10So the IT does go as high. It does go as high as plus 50
- 15:13and it and the of course it goes as low as -50 so yeah, no, it's
- 15:18a, it's a real problem. Now to be careful about that
- 15:20number is that it's not about market, it's about their market
- 15:22department. They could ate their CEO, they
- 15:23might not like their job. There's a bunch of factors that
- 15:25go in there. But it's a real dissatisfaction
- 15:28internally, the profession. And I think it's partly because
- 15:30of this lack of respect that we haven't guarded.
- 15:32And the whole point of my talk, the whole point of that talk,
- 15:35impossible to say. We need need to take
- 15:37responsibility for that. You cannot continue to blame the
- 15:40C-Suite for not understanding you.
- 15:42You can't sort of say, oh, my mother doesn't get me.
- 15:45I don't know where you're going with the damn thing.
- 15:46You got to stop that. And we have to own the
- 15:48responsibility to learn the size of this business and get better
- 15:50at it. And can't just be about can't
- 15:53just be about pedigree hiring degrees or it has to go much
- 15:55deeper than that. OK, sure.
- 15:56There's not, you know, like most marketers don't have a degree.
- 15:59But The thing is, it has to be the way they're communicating or
- 16:01not communicating to the other, to the rest of the C-Suite.
- 16:04Correct. Hey, real, to be fair, listen,
- 16:05you know my board of some of the the biggest C-Suite executives
- 16:08in the world, OK, Yep, less than 25% of them have a degree in
- 16:11marketing and, and some of them have really quality MBA.
- 16:15So let's be fair to that as good general manager, which is very
- 16:17valuable and helpful and why they do well and and you can't.
- 16:20Taste either. I think taste is a big part of
- 16:22it. They're.
- 16:22Incredible, but we're but we're and so part of what this
- 16:25business is we don't have a codified body of knowledge.
- 16:28We don't agree. Doctors don't run around and
- 16:30argue about on everything. I mean, sure, there's things
- 16:33that they debate, but for most health concerns we've risen a
- 16:35bare minimum. That is what they the
- 16:37hypocritical it was all about. We don't have it at marketing.
- 16:40We just don't agree and nobody every taught me when I was in
- 16:42the agency world. Yeah.
- 16:44Do you question do we need it though and so?
- 16:46You've got to have a codified body to be a profession you have
- 16:48to have. A codified body.
- 16:50Because you have to know what to learn.
- 16:52But you talk to professors, they don't know what to teach.
- 16:55If you ask them what to teach and market, they're not clear on
- 16:57that and they're still doing 4 PS that doesn't.
- 16:59Help anybody? I've taken those courses, right?
- 17:00My my son's going to a business for a business degree.
- 17:03I was an MBA with kind of a international management plus
- 17:06entrepreneurship with a little marketing.
- 17:07And I took a bunch of marketing courses and honestly they were
- 17:09the least helpful. It was the hardcore sort of HBS
- 17:12driven case study courses, the economics, macro and
- 17:16microeconomics courses, right? Those were the ones where it was
- 17:20hard skills and I was really learning like the science and
- 17:23strategy of business versus like, you know, brand versus,
- 17:27you know, you know, that could that kind of stuff just the
- 17:29marketing just wasn't as helpful.
- 17:31Yeah. I think, but take your
- 17:32experience from new store, I mean, you would have worked and
- 17:34I mean, I knew you weren't on the front lines of customers,
- 17:37customer support there, but you know, but you, you had heard
- 17:39some of your customers talk. Did did you, did you listen to
- 17:42what they said? And wow, that's a found
- 17:44foundational fundamental strategy that we all agree on.
- 17:47I mean, did they did you, did you say they really understood
- 17:50the dynamics of how to grow that business?
- 17:52Does it? I think growing a business
- 17:54always feels like for market like a little bit of a bit of a
- 17:56crapshoot sometimes and a little bit of a, a guess work.
- 18:00Yeah. And then I think that's that's
- 18:01the point of like the age of opinion.
- 18:03And I think the best marketers, you know, so that that I saw
- 18:07while there and I talked and interviewed, met with a whole
- 18:09bunch of them certainly had a rigor around data analytics.
- 18:15And they either had teams under underneath them or they knew the
- 18:17questions to ask. They knew they knew enough to be
- 18:20the conductor of that orchestra. They weren't necessarily data
- 18:23science driven people themselves.
- 18:24Some of them were, but those always seem to be at GM and
- 18:27other brands. Those seem to be JP Morgan the
- 18:29strongest. But don't you feel like we that
- 18:31they tricked themselves with some of that?
- 18:33Because how many people are still using click through as a
- 18:35measure? Let me be frank, people, There
- 18:38is no relationship between click through and performance of the
- 18:41business anywhere anyhow. Yeah, it does not exist.
- 18:45And by the way, I wrote the clicks, I wrote the technical
- 18:49click standard back in 2004. So like, you know, I mean, we
- 18:52did that To find it's the worst mistake I've made is like
- 18:54releasing that thing in the world.
- 18:56But but, but Greg, one thing I think makes marketers different
- 18:58though from other roles. And I maybe I, I imagine this
- 19:01probably impacts the perception of marketers and how they and
- 19:05how they interact with their peers to C-Suite is, I think
- 19:07unlike other, I mean, unlike other roles, a lot of what
- 19:10marketers do is actually done by vendors.
- 19:11Now every that happens, yes, I'm not suggesting that other like
- 19:15that. Obviously the CIO will CTO will
- 19:18hire Deloitte 6 centers to do a lot of their work.
- 19:19But I think for marketers, the fact that they're so dependent,
- 19:22want vendors, agencies and other to do everything from a strategy
- 19:27to creative to media to measurement.
- 19:30I mean, I, I've worked with some in some industries, you're like,
- 19:32what do these people even do? Are they just vendor managers?
- 19:35You kind of scratch your head. So I, I do think that he, he
- 19:39reels this perception. I'm.
- 19:40Going to put a little bit differently.
- 19:41So I've had this conversation with probably one of the world's
- 19:43biggest CMOS in his, his, his company.
- 19:46We don't find people. We find people within marketing.
- 19:49Too often in marketing parties, we see people who are good
- 19:52project managers, but they're not necessarily marketing
- 19:57people. They don't pride themselves on
- 19:59being marketing people. They're not there to study the
- 20:01art, the craft, the science of marketing.
- 20:03They're project managers. And we kind of, that's why I
- 20:06give the, the last year's talk was for actually two years ago
- 20:09was we're too busy to do better. What's the title of that talk?
- 20:12It's it's the kind of activity trap they would put out all the
- 20:15stuff. We got versions and versions and
- 20:16versions and versions and we're, you know, we're hitting the
- 20:19airwaves with all of our stuff. But I argue.
- 20:21People they, they end up spending their time into things
- 20:23they like doing. So it's your point, Greg, if
- 20:25somebody really is like at heart a good APM, right?
- 20:29And then they end up in a marketing role, they're going
- 20:30to, well, guess what, it's going to be a very process oriented
- 20:32marketing org. That's all they're going to give
- 20:34a crap about. So I don't know that, but I
- 20:36imagine if to the other people in the C-Suite, like that's got
- 20:39to fuel their perception. Okay, what, what, what is this
- 20:42CMO doing? If they've got all these
- 20:43agencies, those are their vendors doing all these things,
- 20:46what do they do? And I mean, if they're not in
- 20:48the weeds, actually, I'm not saying I guess it's not going to
- 20:52be building campaigns, but they should at least know.
- 20:53What's real, it's not that they're not in the weeds.
- 20:55That's not it. Everybody.
- 20:56I think people probably the issue is that they don't
- 20:59understand like like let's let's go after another one.
- 21:01OK, so I say click through is dumb.
- 21:02And yet it shows up in probably board presentations all the
- 21:05time. It doesn't have any metric to
- 21:06anything. It's not right.
- 21:07Yeah. Or the whole thing you got
- 21:09around in a couple years ago around duration weighted
- 21:10impressions. So what a horrible cross media
- 21:12measurement idea concept that was.
- 21:14And yet the industry believed in the bodies that were behind it
- 21:17believed that was the fact. While I'm reading an article,
- 21:19it's just right I'm not paying any more attention to it,
- 21:23despite the fact that it's been on the screen for a while.
- 21:26Right that. Oh yeah, that hotel, yeah.
- 21:28Well, there's no relationship with time and advertising effect
- 21:30is none whatsoever. We've looked at all that
- 21:32research, so it doesn't exist. So I don't think most people
- 21:34sort of understand that or or one of my favorite ones is how
- 21:37many people still believe in broad reach basis strategies.
- 21:41Broad reach is a terrible idea. It is so unbelievably value
- 21:45destructive. And then a simple understanding
- 21:48the economics of that, you just map it out.
- 21:49I'm happy to do it, not hard to do here, but it's like, it's
- 21:52unbelievable how bad that is. And yet this is what a lot of
- 21:55markers and CMO, some CMO believe.
- 21:58It's just not right. Well, and it's, and it's sort of
- 22:00gone from sort of the linear space right where you, you, you,
- 22:03it was a broad reach vehicle you could target, you know, at the
- 22:06television program level and it's sort of infiltrated the
- 22:09program. The media forced us into into
- 22:12broad base. Yeah, at one point.
- 22:13Yeah. And within what we talked about
- 22:15with Doctor Fu and a whole bunch of other folks on this pod is
- 22:18that, that push for reach, that same mentality has driven a lot
- 22:24of marketers to buy just that inventory fraudulent reach that
- 22:27doesn't really exist. And and it's not, you know,
- 22:30there's a targeting strategy that's broken.
- 22:32They're going, they're, they're paying less in CPM rates to
- 22:35reach as many people as possible.
- 22:36And then they they don't understand why they're .001.
- 22:40Are you getting into how, how, how, how flaky or faulty the
- 22:43digital ecosystem might be? Yeah.
- 22:44There's not well, but but but great before you answer that,
- 22:46that's a big topic. Great.
- 22:47I have a question the the piggybacks from what Brett just
- 22:49said. So like I find heads of media,
- 22:53some of them I don't seem to know.
- 22:55I'm not saying they don't know anything about media, but the
- 22:57everything, everything's outsourced.
- 22:58And you wonder like like how much how much have they ever
- 23:02done this? Like how much do they really
- 23:03know? And and the complaints amongst
- 23:05you people like doctor fools. It will point to all this fraud,
- 23:08right. And then the complaint everyone
- 23:10always has is nothing will change until brands care, until
- 23:14brands actually say we're not putting up with this.
- 23:15All this the bad stuff you just pointed out, which we all
- 23:17acknowledge is they're there. You know, whether it's 1% or
- 23:2150%, like I don't know, but it's there, right?
- 23:23So is maybe they don't care because like they don't have the
- 23:27right background because they haven't done the work because
- 23:29they they don't really understand me.
- 23:31What what do you think is? What do you think's behind the
- 23:33fact that because I'll be honest with you, like we like I don't.
- 23:37I think more brands should care, not many do.
- 23:39Yeah, OK. So I'd like to suggest real if I
- 23:41could, that that's what the MMA is all about.
- 23:43So I I get it that they don't really necessarily have the time
- 23:47to go figure out all these, you know, that some of this gets
- 23:49into real minutia detail, some of it gets very technical.
- 23:51Obviously they might not have the expertise in house, but
- 23:54that's really what the the MMA is trying to pick off as many of
- 23:57these things as possible that we can like what's the value of
- 24:00brand long term? What's the value of getting a
- 24:02marketing org right? That means even that promoter
- 24:04score of the of teams, you know, which is one of the factors we
- 24:07actually have figured out now how if you, if you design the
- 24:10organization the right way, you can actually improve sales.
- 24:12Like we can now tell you and measure like if you, if you, if,
- 24:16what, what, what change in New York will improve sales, what
- 24:18would detract from sales. So there's just I, I think that
- 24:21what it is, it's a lack of knowledge.
- 24:22And I think there's also a big issue of like trust.
- 24:24And so you, you, you kind of reference, there's a lot of
- 24:27vendors that come at you with a lot of solutions.
- 24:29Yeah, it's very hard to sort through what some of those are
- 24:32if they're. Really.
- 24:32Oh, totally great. And they and they all sound the
- 24:33same. And AI has made it worse because
- 24:35a lot of the AI50. 1000 more vendors are more tech tools,
- 24:38right? And like another like 5000 ad
- 24:40Tech Plus. It's crazy, Yeah.
- 24:42Yeah, not only the AI tools, but, but those using AI to
- 24:44promote their tools, you start to get this kind of smoke and
- 24:47mirrors effect. And, and, and we've talked about
- 24:49a lot of the, about a lot of about this in the pod is that
- 24:51CMOS or marketers need to have an inherent understanding
- 24:55exactly how this tech and the data underlying this data.
- 24:59They should. They would be well served.
- 25:00Like that's where AI, if you're building with AI and it's
- 25:04something that I'm doing and Rio's doing, it really gets you
- 25:06into it democratizes engineering.
- 25:09A 2° and five coding isn't technically engineering, but it
- 25:13does allow you to get within the weeds and it gives you just a
- 25:16much deeper inherent knowledge of what's happening beneath the
- 25:18surface. So you can call bullshit on that
- 25:21vendor that's promising A and delivering B.
- 25:25You know, that's part of the problem is they don't understand
- 25:27the vendor relationships and their involvements or the vendor
- 25:30tech in the capabilities, right? And it's all moving very fast.
- 25:34And so then they're relying on these vendors to drive reach.
- 25:36I'd ask you guys what, what you think, but you know, my, my
- 25:39sense sometimes is that we don't really have an orientation in
- 25:42it's funny, there's this funny duality that exists, which is,
- 25:45you know, do we really believe in marketing or do we really
- 25:49believe in marketing? And my, my point in summer level
- 25:52is that I think some people don't believe that they have the
- 25:56impact they should. And so they don't Orient to
- 25:58doing marketing improvement. Like what are you doing to boost
- 26:01marketing productivity? And by the way, our, our own
- 26:04data, our own numbers around this is just numbers.
- 26:06Anybody could do this kind of math is that if you can improve
- 26:09marketing productivity significantly, make every dollar
- 26:11work a little bit harder that you can change the stock price
- 26:14of a company. There's a 7, there's a .7
- 26:17coefficient of, of profit to market valuation.
- 26:21So improving market productivity, but I never hear
- 26:24any marketer talk in those kinds of terms I.
- 26:26Don't even what you say. Like even with AII.
- 26:29Try to, but I don't know that we really have a concerted effort
- 26:31to improve market productivity part of it because we're not, we
- 26:33don't have the right metrics for the whole another project we're
- 26:35working. On, yeah.
- 26:36And for me it's, it's less to your point to that point earlier
- 26:38about activity, you know, and just adding more activity to the
- 26:41mix, which is easy. To do.
- 26:42It's more about how do you actually get to better, better
- 26:44IP and better decisioning, right?
- 26:47And create, you know, and to me, the real use of AI is when an
- 26:50institution starts to build basically a brain.
- 26:53It's like a knowledge center, but it's not storage in your
- 26:56file system. It's not stored in your inboxes
- 26:58or your CRM, but it's but it's a system that's powered by, you
- 27:02know, agent to Gintigayi that stores all of that information
- 27:06and it compounds over time your competitive Intel, right, your
- 27:09media Intel and I think all that stuff.
- 27:11I think you use the keyword there, Brett, too, that we're
- 27:13building knowledge. So sometimes one of the things I
- 27:16advocated for last year is that you need to run a series of
- 27:19experiments that validate thesis.
- 27:21Now it's not just data. Data is misleading because data
- 27:26changes situationally. But once you run a scientific
- 27:29experiment, and that's where I think we're misses and we just
- 27:32don't have enough science background and you know how to
- 27:34develop a hypothesis. My favorite one is I talked,
- 27:37I'll name names on this one is I talked to Linda Lee who is the
- 27:40CMO of Campbell's and she was on my podcast, right?
- 27:44Can I give a plug building better CMO?
- 27:45Yeah, go for it. Yeah, so, so, but as long as you
- 27:48have us on your. Pod there we go OK, fair enough.
- 27:49So so so so yeah, otherwise that's going to get cut out.
- 27:53OK, I'll see it. I see I see how this game is
- 27:54played in order, Linda. So Linda is the CMO Campbell
- 27:59Linda's background was as a it was as a chemical engineer.
- 28:03And she said, she said the most interesting thing.
- 28:05She said she goes, I see a lot of markers go how big is my
- 28:08budget and how big is a team I get when you give them a
- 28:11campaign to where or something to do, She goes, what we really
- 28:14need to do is say what's the hypothesis that we have and how
- 28:18do we validate or invalidate that hypothesis?
- 28:21That's what a scientific engineering name.
- 28:23I like that. So, so I guess like relating to
- 28:26that, like there was AI, remember like 7 or 8 years ago,
- 28:28about 10 years ago, Gardner had that study about, you know, IT
- 28:31being outspent by the CMO like never really happened.
- 28:34But like, then there was another like study a couple years ago
- 28:37actually that was very interesting about the CMO
- 28:39needing to partner with the CFO specifically to be able to look,
- 28:44look at the actual cost of things tied to outcomes to be
- 28:47more for net, be more financially driven and be a
- 28:49better steward of the budget that are given.
- 28:51I think that's a very interesting point.
- 28:53And it, it ties to some of the metrics you mentioned,
- 28:55including, for example, attribution.
- 28:57So I love your thoughts on that, Greg, and like what you see
- 28:59going on there and why it's important.
- 29:01And you grew that thesis #1 and like, why it's, why is it
- 29:03important? OK, my favorite board meeting
- 29:06was about 3 years ago. It was a global board I'll even
- 29:09mention. So this is the biggest of the
- 29:10boards I have biggest CM OS and I'll never forget they in the
- 29:14middle of the board meeting at one point they said we need to
- 29:17know how to talk to the CFO. Now, I didn't say this out loud
- 29:20at the time, but my inside voice was what the hell do you mean
- 29:22you don't know how to talk to the CFO?
- 29:23You're the CMO. They were corporation like, what
- 29:25does that mean? Like I couldn't.
- 29:26Get it? They raised a very good point.
- 29:29They said, well, we don't talk in their terms and financial
- 29:31terms. We don't.
- 29:32We talked likes and clicks and all this other silly stuff.
- 29:34Right, OK. But the issue for us, right, the
- 29:37issue for us is that we need to be able to talk in terms of
- 29:40financials and so and they said they wanted we need to
- 29:43standardize the way we do that. So CF OS believe it.
- 29:47So by the way, the MMA has developed that is a financial
- 29:50formula, we have developed it. We are in the process of now
- 29:53running capturing data to do that.
- 29:56We're finding no marketer has their data ready to be able to
- 29:58do this kind of analysis. It's basically diminishing cash
- 30:01flow at a time. And what it will do is it will
- 30:03tell the CFO that if she or he cuts the budget, marking budget
- 30:06now, what will be the impact on the business later.
- 30:09We've never answered that question and we need.
- 30:11It's a great question, being able to say that OK, you're
- 30:13going to cut my budget by 15%. You might think it's great, but
- 30:16here here's why. Like.
- 30:18Here's a good example, and then and.
- 30:19Then calculate that over time with the net present value.
- 30:21Exactly, exactly. But yeah, And listen, we may
- 30:24have to perfect and change the formula time we've run it by
- 30:26academics and they said we're on the right path.
- 30:27So we think we're doing doing the right thing.
- 30:29But the fact that none of us have the data ready to do that
- 30:32is kind of funny or even that's just an orientation from the CFO
- 30:34that marketing should be an investment I think is a radical
- 30:37concept of some of them. But we've got to talk their
- 30:40terms. Yeah.
- 30:41And the SIMO needs to ask those questions to be able to dig into
- 30:43that. You know, and I and I and I sort
- 30:45of think econometrics, you know, having spent a lot of space in
- 30:48the MMM media makes model marketing, makes modeling space
- 30:50is such a critical. Why, why doesn't that type of
- 30:53knowledge? Speaking of you, Greg, you've
- 30:55got an economics major and you were a CMO at 1.0.
- 30:57You've been on the commercial side of things.
- 30:59Why doesn't that knowledge inculcate itself into the into
- 31:02the marketing organization? I think of what Mike Sortie
- 31:04does. I think it comes back to this
- 31:06concept of a codified body of knowledge that you need to know
- 31:10what is fact in science. In fact, I joke all the time.
- 31:12And here, if I can show that for those in video, they'll see.
- 31:16I mean, this is the only codified body of knowledge that
- 31:18exists. I've never once met a marker who
- 31:20read this book. It's called Empirical
- 31:21Generalization about Market Impact.
- 31:23It was compiled by Dominic Hansen's You're.
- 31:25Pushing over in front of your face so that because I think
- 31:27we're able to see that in video. Did they see Wait?
- 31:28Wait, wait a little bit. A little bit.
- 31:30Yeah. Empirical generalization about
- 31:32marketing impact. Yeah.
- 31:34Who's that written by? What was?
- 31:35It was compiled by Dominic Hansen's.
- 31:37In order to make it in that book, the study has to have it
- 31:40has to be a singular meta study that looks at 100 or 200 studies
- 31:44that is that came before on that topic and then crystallizes
- 31:47what's being said now. It in academics called settled
- 31:51knowledge and I talked about this nature of opinion if
- 31:53possible, but then it's about having settled on the stuff that
- 31:56we agreed to be factors point. It doesn't mean it won't change
- 31:58over time. We can get better and still
- 31:59continue to prove on that. But where we are now, what do we
- 32:01all agree on? And then you start from that
- 32:03basis. Like one of the things I pointed
- 32:04out, this is one of my favorite ones.
- 32:06What is the single greatest driver of financial performance
- 32:10for, for in broadly Mark, I'm being very broad here in
- 32:13marketing terms, what do you think like it is, is it
- 32:15advertising? Is it loyalty?
- 32:17Is it a promotions? Is it, I don't know, do anybody
- 32:20want to kind of make a guess? I'm by the way, I am setting you
- 32:23up here on this one. Yeah, because it's a trick
- 32:26question. It's a trick question you.
- 32:27Know what it is? It has 67 times the impact that
- 32:32advertising does. Is this?
- 32:35Distribution. Distribution, right?
- 32:38Which which ties the product shows up.
- 32:40Is that is that chopper marketing?
- 32:41So much more, yeah. So you should spend all your
- 32:44time on increasing your ACV, getting your advanced
- 32:47distribution before you even worry about sort of other
- 32:50elements of the thing or. The ties to B to B to Greg as
- 32:53well, because I figure out how you're actually going to get
- 32:55things to market, whether it's products or services, right?
- 32:58Like super important. People overlook that, like are
- 33:00you going to sell through channels?
- 33:01Are you going to sell through partners?
- 33:03Very important. Yeah, and it comes down to like.
- 33:05Whether you're a retailer or whatever it comes in, you know,
- 33:07it's your operations class in college, we get body of
- 33:09knowledge that your throughput, operational efficiency, can you
- 33:12deliver a good customer experience and deliver it at a
- 33:15speed to scale. Whether you're a dentist and
- 33:17it's about butts and seats and, and, or, or you're running a
- 33:20restaurant and it's about get, you know, flipping that table
- 33:22multiple times a night, that's that.
- 33:25Those are all distribution use cases, but.
- 33:26But these are kind of what the the point here is though, that
- 33:29there's series of science that we as marketers don't
- 33:31fundamentally have that we can incorporate into the thesis that
- 33:35we have that doesn't just devolve into opinion base
- 33:37storytelling, which is I think is why we kind of diminish
- 33:41ourselves back to my whole point.
- 33:42Like, listen, we can improve here.
- 33:44We just have to take the time to really put an expectation and
- 33:47learning the business and the science of this in ways that we
- 33:49just haven't. And in the context of it being
- 33:52really complicated, I don't want to take that off.
- 33:54Yeah. Not not to some trite, but what
- 33:56do you think in in I've I've heard Michael Kasan said this it
- 33:59an event, a brave new worlds event.
- 34:01I had a new star that I said a new star.
- 34:02I don't know. I don't think I got you to speak
- 34:04of that one. I had no, you spoke in the first
- 34:05one, but he basically said whatever happened, and this is
- 34:08the Mad Men argument. I'm watching that series
- 34:10belatedly now, but whatever happened to serendipity in
- 34:13advertising and and then the Detroit common of art science,
- 34:18the combination of the two, which we might say is kind of
- 34:20bullshit, but but whatever happened to serendipity in
- 34:23advertising? Meaning when you're showing some
- 34:26delightful experience, you know, for an advertiser to consumers
- 34:29that may not be in market, you might change their opinions.
- 34:32What role do you think that what's what's?
- 34:33Serendipity mean though. Serendipity means like, I wasn't
- 34:36looking for that. I wasn't in your target
- 34:38audience. You weren't reaching out to me
- 34:39specifically as a demographic or a profile.
- 34:42And yet you showed me some. Random.
- 34:44Habit that. Yeah, that.
- 34:46Yeah, random habit I saw I was in the market for you're.
- 34:49Arguing. You're arguing for what I'm
- 34:51arguing against, by the way. Yeah, yeah, I know.
- 34:53So you're. You're I'm not arguing.
- 34:55Good. OK, just checking.
- 34:56Just check your person to make sure.
- 34:59No, I mean, that's, that's kind of the that's kind of the issue.
- 35:01And listen, you know, Brett, because we did some of this work
- 35:02together around sort of movable minnows concept, right?
- 35:04So listen, all targeting originally was based on
- 35:06demographics. We kind of touched on that as
- 35:08sort of what reach based media did.
- 35:09So we tried to improve it. We knew demographics didn't
- 35:11really work very well. I never thought it worked very
- 35:13well. From why I could tell, it didn't
- 35:14seem that scientific. We moved to behavioral targeting
- 35:16the age of digital. We think the MMA now believes
- 35:18the answer around targeting segmentation should be based on
- 35:20neuroscience because it's what the brain will be responsive to.
- 35:23So here's the thing. The brain makes a decision in
- 35:263/10 of a second to pay attention to an ad or not.
- 35:29I don't give a shit how good the ad is.
- 35:30I don't give a shit if it makes you cry.
- 35:32I don't care of it. If if if what what you think?
- 35:34Are you going to just emotional? Watch this or tune out.
- 35:36The brain will say I'm not interested in that product, I'm
- 35:39out, I'm gone and it makes the unconscious decision to ignore
- 35:43it. It has no imprint on the brain
- 35:45whatsoever. So why are you trying to target
- 35:48people who are not interested in and have no propensity or
- 35:52consideration to buy Rolex ever? It doesn't make any sense.
- 35:55That's not good marking a concentration of those who have
- 35:59a potency to consider the brand. We think financially, which is
- 36:02this is a whole argument against re space planning it economic
- 36:05makes. If you look at those numbers, I
- 36:07don't think you can deny it whatsoever.
- 36:09And it's all predicated on the concept.
- 36:10But it's back. It's backed by neuroscience.
- 36:12That's the issue there that separates it.
- 36:15Now, listen, Yeah, to be fair is, you know, we're still
- 36:17validating the thesis. Under what condition is that
- 36:19true? Under what condition may not be
- 36:20true. I mean, there's still a lot more
- 36:21work to be done, but we think we're on the right path of that
- 36:23one. Yeah.
- 36:24And I think the predictive capacity of AI at the compute
- 36:27ability of AI to be able to bring in a huge amount of data
- 36:31to infer for predictive analytics.
- 36:33Analysis. Behavioral, contextual, all this
- 36:36stuff that it's absorbing, it's going to be able to more
- 36:38accurately. Predict, have you ever, have you
- 36:41ever mentioned LLM and typed like, hey, what's the best
- 36:43marketing? Because, by the way, I've done
- 36:46that and it gives you crap. Yeah, different kind of time
- 36:50too. It might.
- 36:52Sound it might sound good and it might reinforce, but all AI all
- 36:56in LLM and I want to separate AI processing, which is where you
- 36:59went to, you know, the actual sort of LLMS that were all that
- 37:02are so popular and helpful to us today.
- 37:04And listen, I'm a huge fan of AI have another podcast on AI by
- 37:07the way, but though that that's all really valuable.
- 37:10But the issue is that if you go into an LLM and ask you for
- 37:13what's good, it's just going to repeat the opinions.
- 37:16Yeah, you have to get back. To knowing the science.
- 37:18By me. But yeah, it says the best
- 37:20marketing is clarity plus proof in front of the right buyer at
- 37:24the right moment. Not the loudest campaign, not
- 37:26the clearest tag LED or cleverest tag LED, not the
- 37:29biggest. Well, there you go, Brett.
- 37:30There's our marketing strategy for the podcast right there.
- 37:32You go, you guys, you guys are winners today.
- 37:34Great. Well.
- 37:35Done so so so yeah. So conclusion.
- 37:37Well, the age of Mad Men and advertising as sort of the art
- 37:43is in an opinion that's kind of what that was based on is really
- 37:46over. But I want to pick on that too.
- 37:48So I keep interrupt. I want to pick on that too.
- 37:49So listen, you know, Rex and I Co founded, you know, Rexburg
- 37:52and I Co founded multi touch attribution attribution many
- 37:55years we were trying to figure out how to optimize media.
- 37:56That was a whole bunch of thing. But here's what it made us go in
- 37:59and look at individual ads and see how well they performed in
- 38:0247% of campaigns. We looked at, of the 24, two
- 38:06dozen intense measurement campaigns we did, 37 of them
- 38:10failed on motivation or message. In other words, the creative
- 38:13sucked. It didn't work.
- 38:15They didn't have motivation mattered.
- 38:16They didn't get. So I love to talk about the art
- 38:19and listen, I love the art, and I've seen it be incredibly
- 38:21powerful when done right. But we don't even understand the
- 38:23science of how to create messaging.
- 38:25Yeah. We have to be consistent about
- 38:27this. So we wonder why we're picked on
- 38:29and why we don't get it. And by the way, we think that
- 38:31answer also sits over in potentially neuroscience.
- 38:34We've not done as much work there on that.
- 38:35We'd like to explore that more. And that's a, that's another
- 38:38very complicated multidisciplinary area that we'd
- 38:41have to kind of figure out, but. I think isn't a good thing
- 38:43there, but you know that it's important to test and have have
- 38:45your tests be like well thought and planned down to continue to
- 38:48test, right. Marketing is, you know, it's an
- 38:49it's a science, right? And like, but it is certainly to
- 38:52yeah, I mean a lot It can be right.
- 38:54I mean a lot. I think a lot of people expect,
- 38:55oh, we'll do this and it work or doesn't work and and we prove it
- 38:58is no real. Well, I mean, you're learning
- 39:00and learning and you're proving and you're, you might be
- 39:05disproving certain tactics, but that doesn't mean that like this
- 39:08channel doesn't work, for example, just means maybe your
- 39:10creative sucks. So, but like, great, let's talk
- 39:12about turn to thinking fast and slow.
- 39:14Like one of the best lines in the report is the need to think
- 39:17fast and slow, closing the gap between data that is really
- 39:20immediately accessible and like provides robust ROI.
- 39:23Like what do you mean by this? And how can marketers like, like
- 39:27what does this split mean, mean to them?
- 39:29Can you break this down a little bit for our listeners?
- 39:31Yeah, You know, I'll tell you what that was actually compiled
- 39:33by Denise Champion on my team who's done phenomenal work
- 39:36around that. I don't have at my fingertips
- 39:38that information. So I I know what you're
- 39:40referring to. It was actually, I thought it
- 39:42was very good. I've been a long time since I've
- 39:44been exposed to it. So I don't, I don't think I'm
- 39:45your best answer around that one right now, but just that.
- 39:48But the fast and slow is it's based on a pretty famous book
- 39:53that's out there now. And I, again, funny, I reference
- 39:56it last year when I opened Possible and I'm just not
- 39:58remember the name right now. So it's system one thinking,
- 40:00right? And that's system one.
- 40:02Yeah, yeah. I don't know.
- 40:03I'll need somebody else to kind of walk me through that.
- 40:05I don't. I don't have it on my
- 40:05fingertips. You know, you get just they
- 40:07don't get put into show notes. Not a not a big deal.
- 40:10Yeah. And so, so back to that question
- 40:11around where do you think MMM and MTA is going at this point?
- 40:16But you know, we're a little biased.
- 40:17We're very MTA focused and we think MMA is complicated and
- 40:21subpar. MMA, yeah, I don't think MMA is
- 40:24good. I think it gives you a maybe an
- 40:26OK and a long term view. But unless you get down to an
- 40:29identity graph into an individual identity level, we
- 40:32don't think you're really improving marketing.
- 40:34And we see that come up again and again.
- 40:35In fact, this financial formula that I mentioned earlier, what's
- 40:38currently called Project Roamy will come up with a real name
- 40:41for this product or thinking here soon.
- 40:43But but that underlined you have to operate the individual level.
- 40:47So I'm just not a, I'm just not a big fan of MMM and what it's
- 40:50really trying to do. That said, MTA is really damn
- 40:53hard. It's difficult to do.
- 40:55And we actually just did an analysis here a little while
- 40:57ago. They said, well, an MTA, what
- 40:59happens if you lose a singular channel data single?
- 41:01What does that do to your analysis?
- 41:03It's not great. So, you know, we we have a lot
- 41:05of work to do there, but we think that's where the answer
- 41:07lies. Yeah.
- 41:08Well, and and as long as it, you know, and we worked in a lot of
- 41:10hybrid models, right. And you knew this.
- 41:12I know there's some of that. Yeah, where, where you're
- 41:13bringing in exogenous factors that are not channel and not
- 41:16media related that are driving consumer propensity.
- 41:20But are they improving marketing productivity at the end of the
- 41:23day, am I getting more for the dollar spent than otherwise?
- 41:26And I, I don't know that of every case.
- 41:27I, I, I am around MMM because it just doesn't go to the fine
- 41:31level that you need. And yet, you know MTA.
- 41:33Names of hypergranular MMM. But MMM was going through, I
- 41:36think the most change I've seen in a long time, right?
- 41:38I'm seeing people apply, I to admit for both for data
- 41:41ingestion as well as like the like Brett SharePoint earlier,
- 41:45the like analysis of that data and then turning it into more
- 41:49actual insights. Because MMM used to be this
- 41:50thing. You do it once a year.
- 41:51You give it to, you know, the CPG brand does it with their
- 41:53vendor, they give it to their agency a year later, revisited,
- 41:56very like. It was it was very people driven
- 41:59too, right, like, like like Mike Finnerty, we interviewed
- 42:02possible is now the the US president for Mutinex, which
- 42:05sounds like a cough syrup. And, and what they're doing is
- 42:09he's basically replacing what was a human driven model,
- 42:11managed services, relatively low margin of 200 people.
- 42:16He's an analytic partner, sort of does the same thing, right?
- 42:18They're very people driven. And he's replacing those people
- 42:21with agents that do all in each one of them have skills aligned
- 42:25to a lot of data, unification data, you know, identity
- 42:28resolution. And then and then pulling in
- 42:31every basically input you could possibly get from seasonality to
- 42:35kind of, you know, every econometrics input that you
- 42:37could get into your broad model to be more predictive of what
- 42:41really is driving media impact. I love, I love that as an
- 42:45orientation, absolutely. But again, you know, go back to
- 42:48kind of some of the core here. I said earlier is that, you
- 42:50know, it's nice to have a good media optimization model, but if
- 42:53the ads don't work, then I don't think you've really accomplished
- 42:55the goal. Yeah, yeah.
- 42:57And and you and what you said before is it's basically a flip
- 43:00of a coin with that 47%. Right, kind of 50.
- 43:03Percent like creative. That's just bad creative
- 43:05messaging. A 47%, that's all.
- 43:07That's that's what that's referring to, correct?
- 43:09Yes, yeah, yeah, yeah, yeah. I mean, listen, we would we said
- 43:12it was the book that Rex and I had done way back when called
- 43:14What Sticks, which is basically said there's three things you
- 43:16got to get right. You got to get a motivation that
- 43:18consumers care about. You got to get a message that
- 43:20they understand. And then you got to create, you
- 43:21know, media right place, right time.
- 43:23And so the problem was that they were failing in the 1st 2, which
- 43:25made the three invalid, third invalid.
- 43:28You spend a spend a dollar, a dollar meeting against that as a
- 43:30waste of time. So that's AI really got to stop.
- 43:33But does AI give us the ability to create?
- 43:35Because like variants of creative, the creative was
- 43:39always an it was always a big logjam, right?
- 43:41That was always a problem because we talked about
- 43:43personalization. I've, I've done, you know, I'd
- 43:46love to see some of your studies.
- 43:47I know you put out some good ones.
- 43:48We've done a lot of studies on personation, yes.
- 43:50And it really works right? When, when, when, when When
- 43:53employed correctly, it does make a big difference in terms of
- 43:56like return of marketing investment.
- 43:58But the problem creative was always a creative right?
- 44:01Like OK, you want 50 variable guess, but someone has to make
- 44:03those 50 creatives, get them approved by legal and
- 44:06compliance, especially in a regular industry, and then get
- 44:08them queued up in your different platforms or activation.
- 44:12Really not easy even given some marketing automation tools.
- 44:15Does AI maybe change that and finally make it possible?
- 44:18Yeah, it certainly makes the production and the iteration of
- 44:21ads possible. Is that, is that where you're
- 44:23going real that's what you're kind of fixes on?
- 44:24Yeah, I totally, I totally agree.
- 44:26And I think it's becoming more possible.
- 44:27But even sort of making the decisions and high speed as is
- 44:31necessary in ad serving to get that to the right people and
- 44:34build cohorts around that, which is basically what our work did.
- 44:36We use machine learning, a special, a couple of special
- 44:39techniques there in order to be able to find cohorts.
- 44:41Then we could serve the right ad for DCO basically.
- 44:44Yeah, it was, I'd call it DCO on steroids because we didn't
- 44:47actually do, we didn't actually do generative AI for the ads and
- 44:50the fly, although we could just, you know, no, no big brand was
- 44:53going to let us do that yet. And now, yeah, but I do think
- 44:55like at some point like AI is getting better, brains are
- 44:58getting more comfortable using and and and tools are getting
- 45:01better than leverage AI. So it's like.
- 45:02Google's got a solution and and Meta's got a solution.
- 45:05So, yeah, they're all, you know, They're all behind, behind that.
- 45:08Yeah. I mean, it's part of that.
- 45:08I mean, you know, but you don't have to be a rocket scientist to
- 45:10go figure out that probably personalization of ads makes a
- 45:12difference. Yeah, well, people will argue
- 45:14sometimes it doesn't doesn't work well, which I always
- 45:17thought was crazy, but there are fewer, fewer.
- 45:18DCO, I think DCO kind of damaged the space in some regards.
- 45:22It made it feel kind of stupid and dumb and not right.
- 45:25And yet, you know, we've had to work with a lot of, we've worked
- 45:28a lot of big CM OS on doing some of the lab experiments that we
- 45:31do around personalization. And it's hard to figure out,
- 45:33it's hard to sort of how do you hold state?
- 45:36Here's what it is. CMO put it really well on board
- 45:38me. She said, listen, she goes, we
- 45:40spent so much time convincing consumer or convincing markers
- 45:43that it's a singular insight with a singular message to now
- 45:46ask him to do different. And so how do you hold brand but
- 45:49then still personalize and get maybe a slightly different
- 45:51motivations or get a different message in that sort of appeals.
- 45:54It's it's, I think it's it's just an area we need to spend a
- 45:56lot more time. I do think the answer resides
- 45:58there though. Yeah, in fact, I understand.
- 46:00It's all. Yeah, go ahead.
- 46:01But it's all powered by, by good data governance and good data
- 46:04quality because what is personalization?
- 46:06If you've got underlying data that is completely missing the
- 46:08mark, right? Which is what a lot of brands
- 46:10are doing in terms of, you know, like we worked with GM, you
- 46:13know, that at, at at Nustar, they had 60 different data
- 46:16warehouses. So half the job of marketing was
- 46:18bringing this all together, unifying it, de duplicating it,
- 46:22resolving it down to the household and identity, you
- 46:24know, an identity level. And until you're really in
- 46:27device level and until you do that, you're really not able to
- 46:30power a personalization engine of, you know, worth it's weight
- 46:33and salt. Right.
- 46:34I don't know. I mean, the personalization that
- 46:35we did is we used just contextual.
- 46:37So we just looked at IP addresses, we looked at
- 46:39everything and then it would pick what would sort of kind of
- 46:42align people to a common interest.
- 46:44And we saw perform. I mean, here you mentioned, I'll
- 46:46give the numbers to the audience is that we saw on average gains
- 46:49of plus 160%. Now a couple of those were
- 46:52studies in the US They were all focused on digital metrics.
- 46:56So did they visit maybe these 5 pages that they go and fill out
- 46:58a lead form? Did they do something that was a
- 47:00digital for? Paid media, correct?
- 47:01Yeah. We've also done, yeah, all paid
- 47:03media. We've also done studies now
- 47:05against can we improve brand effect with that or can we
- 47:08improve store traffic driving at the retail level?
- 47:11And we've seen that and the gains aren't as big because
- 47:14you're, you know, if you're going to go from brand awareness
- 47:15of 46% to 60%, you know, it's only a 50% gain.
- 47:18It's not as big as 160%. But when you see digital
- 47:21metrics, the gains were unbelievable to me, nothing like
- 47:23nothing. I've never seen that those kind
- 47:25of gains ever and everything I've done.
- 47:26So I'm huge believer MMA is huge believers based on facts and
- 47:29evidence in our experiments of AI personal driven
- 47:32personalization. Yeah, so, so, but you were doing
- 47:34that with a GET with a discrete finite data set, right?
- 47:38No, no, no, no, no, no, no, no, no, no, no, no.
- 47:41We didn't use none of that. Use cookies.
- 47:44No, that was used. I'm just using some signal what
- 47:46was the underlying data set and if a brand has fragmented data
- 47:51and it's trying trying to train the AI on that.
- 47:54Yeah. No, that wasn't no, no, we were
- 47:56no, see, you're kind of back to the LLM kind of example.
- 47:58We were using machine learning. So it was 1 hot encoding with
- 48:01KMOS clustering with the two techniques that were used in
- 48:04this, in this particular approach.
- 48:05And that was able to build cohorts of people and it looked
- 48:08at probably 1000 different signals time of day.
- 48:11It would look at location, it would look at, you know, every,
- 48:13everything you could pick up just from the from the, from the
- 48:15data stream, whatever was available attached to that
- 48:18impression. And then it would build a cohort
- 48:20says, well, these people like this, this the ad they like and
- 48:22then continue to re evaluate and test that.
- 48:24And it would just incrementalize itself really fast to high
- 48:26performance. It'd take like a couple of weeks
- 48:27and you'd be at the best. Performance.
- 48:29Yeah, well, maybe it's Greg. I think one thing like brands
- 48:31have to marketers have to be aware of too, is like even with
- 48:33like let's say you have, you have the different types of
- 48:35creative, right? Like even understanding, OK,
- 48:36when you're targeting audiences, some audiences might be better
- 48:39defined than others, right? Some, you know, like you may
- 48:41think you're targeting like millennia.
- 48:44See, we didn't, but we weren't conceding all that.
- 48:47All that requires first either some variation of first party or
- 48:49third party data. We didn't do that.
- 48:51We just used Cigna that was available from from sort of what
- 48:53was out there that could be just done and it would find its own
- 48:56thing. And I will tell you though, it
- 48:57did figure out some things, like the one that was the funniest
- 48:59one was that we, we had a, we had audio as a male, female
- 49:03voice and the female voice performed 20% better.
- 49:06So if you were regular, you just run the female voice, but we ran
- 49:08the male voice too. The male voice, they'll always
- 49:11perform better in Southern States and Utah, funny patriarch
- 49:16patriarchal societies. And it always performed better
- 49:19everywhere in the everywhere in the country after 10:00 at
- 49:21night. It's funny the different way
- 49:23people act right, ever. Like what are my first jobs in
- 49:25marketing from We do market research and we stuff.
- 49:27This is back. We used to call people right.
- 49:29So I remember like the the difference in experience, like
- 49:32calling up random people to ask them questions when you're
- 49:34calling, let's say in Alabama where they talk to you all day,
- 49:36but maybe not answer the question, whereas New York they
- 49:38just tell you that off and hang up.
- 49:40I use wild right? Oh, you must have got me on the
- 49:42phone. Yeah.
- 49:44Yeah. So it's interesting and, and
- 49:45what what your point Greg says to me is that.
- 49:48It took a message, took him for this.
- 49:49It took a moment. They got to hear what they what
- 49:51I said there. Yeah.
- 49:52I was the one who told you to fuck.
- 49:54Up the one you want to hung up for you.
- 49:56Yeah, it what it what like what you're describing from that
- 49:58experiment, Greg, it sounds to me like it's, it's what I think
- 50:00personalization, I think person's level, I think 10.
- 50:04I totally, I totally agree with you.
- 50:06Yeah, exactly. And, and, and you were actually
- 50:07able to drive much better performance with more
- 50:10generalized cohort, which is aggregate for specific cohorts
- 50:14of specific type, which shows you just do that, right.
- 50:18And then you could potentially get to this promise of we're
- 50:21going to more effectively target you, but not just a retargeting
- 50:24play, but based on your propensity. 100 well put.
- 50:28Thank you. I better put the nice head.
- 50:29Yeah, exactly. Yeah, yeah, yeah.
- 50:30And by the way, I think we're, I think what you just did is you
- 50:32just advanced the science that we would love people start to
- 50:35test and really work against Like let's bring in data on the
- 50:37customer. Let's see how we let the AI sort
- 50:40of figure out what's best. And it really was, I mean, it
- 50:42was most interesting to this about the experiment and all
- 50:45that we've done is probably we've done 30 in total around
- 50:48the world at this point is that it really does feel like magic.
- 50:52The AI is making decisions. And this is kind of back to part
- 50:54of your guys original point, like it's making decisions.
- 50:56We don't even see what's going on.
- 50:57And we can tell we can, it's sort of like you can't see the
- 51:00wind happen, but you can measure what happened in its effect.
- 51:03So we can measure what happened, but we don't know why it made
- 51:05the decision originally. Very cool.
- 51:07And the closer we can get to the understanding of the why better
- 51:10off as marketers we would be maybe.
- 51:12Or just set up. Or just.
- 51:13Or just set up the right experiment and the right metric
- 51:15to measure against. See.
- 51:17If it works or if it works. Yeah.
- 51:20So, so it's it's it's a call for more science and marketing.
- 51:23It's a call for potentially, I mean, you're saying build an,
- 51:27you know, an academic body of researcher or understanding.
- 51:30There's the Byron Sharks and those out there.
- 51:32But, but to me it's, it's more of people coming from different
- 51:35disciplines, right? Not coming from the creative
- 51:38liberal arts necessarily. English major journalist
- 51:41background necessarily. Well, I'd like you to apply
- 51:43science. I'd like you to apply science to
- 51:45that creative side. Yeah, message development and
- 51:48message personalization to kind of the point where I can.
- 51:50And I'd like you to apply science over to the analytics
- 51:52side. And no, it's.
- 51:54Not what about the argument though that I'll be like large
- 51:57language models and AI can do a lot of like mathematics and
- 52:01science and things that it opens up a lot of capabilities that
- 52:04you know someone didn't have. Like you can ask it to do very
- 52:05sophisticated things right now. So I mean, I hear you like the.
- 52:08Need for the market is doing better, but when it.
- 52:10Comes to the science. It's only using the collective
- 52:13opinion that it knows about now. AI is not expertise, it is not
- 52:19judgement. It just comes up with the next
- 52:21evolution of what it believes to be true based on what it was
- 52:23trained on. Yeah, it's a predictive of what
- 52:25it trained. No, it's not of what might come
- 52:27in the future, right, Because it can't.
- 52:29It's kind of. What might come in the future if
- 52:32you kind of go back those who hold the opinions, who get
- 52:35ranked and rated in those in those systems or that you're
- 52:38trained off of. Yeah.
- 52:39Don't have the underlying science real.
- 52:41That's the problem. Yeah.
- 52:43And so and so that it would be nice if a nonprofit association
- 52:47might put together a good codified body of knowledge that
- 52:49might be helpful to everybody. Yeah.
- 52:52I mean soon. Well, yeah, but that.
- 52:54But that's why if you build that institutional knowledge within a
- 52:56brand, right, that is collecting and amassing all of the
- 53:00information, every media engagement, every consumer, your
- 53:03lifetime value, everything that you know about every person
- 53:05you've ever touched or interacted with, and not to
- 53:08mention your internal employee base and executives, that's
- 53:12your, that's your IP. That's what gives a brand
- 53:15advantage in terms of how do we better represent our branded
- 53:18products to the consumers we're trying to reach.
- 53:20Right. I think that'll require a whole
- 53:22another episode to dissect. Yeah, and and there's a whole
- 53:24argument about like, who's going to own agents?
- 53:26I mean, in this world, Brad, the brand certainly would, right.
- 53:29Maybe using that body of knowledge that hive mind order
- 53:31to. Create, I'm not so sure.
- 53:33Yeah, I'm not so sure. All that's been kind of
- 53:34completely resolved, like, no. It hasn't been resolved.
- 53:38The push was a lot of this was last board meetings discussion,
- 53:40by the way. Like your marketing team doing
- 53:43prompts is not AIAI has to be institutional IP that's codified
- 53:49that that spans time and it spans your your executive team
- 53:53and all of your teams and it collects and amasses and makes
- 53:57decisions based on all of this information.
- 53:58Yes, that that is the that is the utopian veil view and, and,
- 54:03and yes, I hope we will get their name and he's going to do
- 54:05what I can to support that. Absolutely.
- 54:07A lot of AI, my work that these consulting firms are doing now,
- 54:09it's fun. A lot of it bread is what you
- 54:11just described like the literally teaching people had to
- 54:13like open up the open up the prompt and the GPT that like a
- 54:17lot of these big like essential contracts to teach the
- 54:19government as unfortunately that's what I think we're
- 54:21getting. We're getting passed out.
- 54:23We're actually now getting solutions built on top of AI,
- 54:25even if they're just LM rappers. But but but I thought that is
- 54:29funny so. But we know you got a hard suck,
- 54:31Greg. I think we should do our quick
- 54:32hits OK. And hit.
- 54:35The quick hits another time. Right.
- 54:38So you start real. All right, so I think I know
- 54:40what you're going to say, but I'd love to hear this.
- 54:42Bullshit. No, I'm sorry.
- 54:44Sorry. I'm sorry I went too fast.
- 54:46Sorry. Yeah, well, you're probably
- 54:47going to say bullshit, but one marketing metric, the industry
- 54:50still values that they shouldn't.
- 54:53Yeah, click or they should, Yeah.
- 54:54Click through yeah, no brand know the value of brand, but
- 54:57stop with click through you're. Calling bullshit.
- 54:58Stupid, stupid, stupid. Yeah, yeah, Last click.
- 55:01I mean, all the research supports that.
- 55:02Even Google doesn't believe a last click attribution.
- 55:05They've come out. Technically, I can't believe
- 55:06we're still talking. About I can't believe we're
- 55:07still talking about it. It's ridiculous.
- 55:09It's lazy. It's lazy.
- 55:10That one related it's intellectually lazy.
- 55:12Yeah, one idea marketers still believe in that the data doesn't
- 55:16support, and I'm not. Click Wait, wait, wait.
- 55:19Say again. One idea, one.
- 55:20Idea marketer still believe in that.
- 55:22The data just doesn't support. That's a tough one.
- 55:27When one idea that Marcus still believe in that they I I mean,
- 55:31listen, though, I'm more concerned with trying to answer
- 55:34the big questions with a what's the value of brand?
- 55:36How does Oregon pack what they do what you know what what is
- 55:40here. Here's my favorite question is
- 55:42that I had ACMO call me. In fact, I'll name names Frank
- 55:44Cross and Best Buy. Call me one time.
- 55:45He says he goes. Great.
- 55:47He said he goes, is there he goes.
- 55:49Is there a A standard for quality marketing measurement.
- 55:52And the fact that that didn't exist until then, we wrote it
- 55:55six months later was insane to me.
- 55:57Yeah. Insane.
- 55:58Yeah. Well, great.
- 55:59By the way, the answer was incrementality on that.
- 56:01But go. Ahead.
- 56:01Yeah, yeah. And I think, I think I'm going
- 56:02to answer the question for you. I think reach, right?
- 56:05That's an idea people think brought raw, raw reach versus
- 56:08the kind of movable middle. Speech is so value destructive I
- 56:11think it's the reason CMOS get fired.
- 56:14Yeah, because they're spending so much money, they.
- 56:15Spend so much money in non productive, non profitable
- 56:18customers it's insane. Moveable middle is what
- 56:21validated all that right? You know that work.
- 56:22I mean, that's non profitable customers.
- 56:24That's an important point. Yeah, it's not just, yeah, lack
- 56:27of customers, it's non profitable.
- 56:28Customers non profitable. Customers that would have bought
- 56:30your product anyways. Yeah, or, or those who would
- 56:33have bought anyway. You shouldn't be advertising
- 56:34those. That tends to be really small,
- 56:36you know. But there's but you you could
- 56:38have as many as 75% of the population who will never buy
- 56:40your brand no matter what you tell them.
- 56:42They were just never going to stop spending money there.
- 56:44It's value destructive. It's waste of money and they
- 56:46don't come in new the franchise, as somebody likes to say, it's
- 56:49just not not in not in enough economic.
- 56:51That makes sense. It's funny you mentioned
- 56:52incrementality, so that was like the buzzword of marketing last
- 56:55year that mostly because of retail media, right?
- 56:58Like like that's why it was populist.
- 57:00All the platforms included these incrementality dashboards and
- 57:05their platforms is very interesting.
- 57:07OK, next one harder problem today, trust and data or trust
- 57:10in marketing? Well, see, I already, I mean,
- 57:15neither one of those are good. Trust in science.
- 57:18I want to change what? Trust in science.
- 57:19Yeah, you got to trust science because science is a thesis and
- 57:21a hypothesis testing evaluation that will last the Standard
- 57:24Time. So as the situation changes,
- 57:26that's the problem of data. Data is situational.
- 57:28And so you got to have science. Yes, yeah, yeah, it yeah, the
- 57:31end of the age of opinion is the is really the age of science.
- 57:34It's got to be and it's really a call for almost re skilling
- 57:37right in building knowledge around that as the CMO.
- 57:41Well, plus numbers, they can tell whatever you want.
- 57:42What is that Mark Twain quote? Their lies, their damn lies, and
- 57:45their statistics. Or something like that, right?
- 57:46Exactly. Exactly.
- 57:48Yeah. Well, hey, Greg, thank you so
- 57:49much for joining us. I think we just.
- 57:51Having fun. I knew this would be.
- 57:52I knew this would be good, yeah. And I knew you guys should be a
- 57:54little argumentative, which I really like.
- 57:57It's it's part of the show and I think people appreciate the
- 57:59depth. We like to go deep and and
- 58:01really. Uncover.
- 58:02It's like the Great Debates. It's like the great Debates that
- 58:04we did together. Exactly that stuff.
- 58:05It makes such a. Difference just so much mirrors
- 58:08out there, so much noise. And that's why we called it
- 58:11Signal and Noise. Although there's a few other
- 58:12brands called Signal and Noise that we need to to work around.
- 58:15But that's a brand marketing problem.
- 58:17Yeah, like in terms of people competing for the same name.
- 58:20And I'm like, well, we'll stand out eventually.
- 58:22But hey, thanks everybody for having you, Greg Stewart, tell
- 58:26people how they can reach you. Greg at mmaglobal.com if you
- 58:29want. I'm easy to find.
- 58:31Yep. And for everybody listening, go
- 58:34to our website www.signalandnoise.ai and you
- 58:37can find us on YouTube, on our podcast, on Spotify and we will
- 58:40see you next time. Thanks everybody.
- 58:42Thanks, Greg. Thank you.