Latest / Sales Pipeline Radio / The Accountability Reset: Rethinking Marketing Metrics as AI Search Grows
Transcript
- 0:16Matt Heinz: All right, we are back recording here live on the Forrester B2B
- 0:19Summit floor, right on the marketplace.
- 0:22It's booming — we got people everywhere here checking out the vendors,
- 0:25we got sound stages behind us, we got lounges, we got the big boot.
- 0:30Ross, right behind you is this enormous, like, 20-foot-tall boot.
- 0:35We've already established, we learned in an earlier session, that it actually is an
- 0:39ancient boot — it was here first, and they built the conference center around it.
- 0:43You know, when titans roamed the land, they needed solid footwear as well, and
- 0:48that's where boots were invented — by the titans that walked the earth, early days.
- 0:53Ross Graber: I had no idea.
- 0:54Matt Heinz: Most people don't know that.
- 0:55But if you look at the internet, if you go deep enough, you'll find
- 0:58evidence of it, I promise you.
- 0:59Ross Graber, we've got here today — he's the vice president and principal
- 1:02analyst at Forrester Research.
- 1:04And I was joking, like, you're an OG, man — you've been at Forrester
- 1:08and SiriusDecisions for 13, 14 years?
- 1:12Ross Graber: So it's just over 14 years — I was doing the math.
- 1:15This is my 15th North American summit.
- 1:18And I'm really proud of this — this is an awesome event, it's my
- 1:22favorite week of the year.
- 1:24Matt Heinz: Honestly, this has always been some combination of B2B reunion, B2B prom.
- 1:30You get some of the best and brightest minds in B2B getting together, everyone
- 1:34from analysts to practitioners, even, honestly, vendors — the people that
- 1:37are here showcasing what they're doing, it's a different round of
- 1:40stuff every year, and it represents sort of where the industry is going.
- 1:45I think this is my 12th or 13th version of this — it is always a highlight.
- 1:50And, as you think about that progression and where we've come as B2B marketers
- 1:54— and we're gonna get into your topic around the accountability reset here in
- 1:58a second — but I wanna take advantage of that legacy you have, that kind
- 2:02of consistency in this marketplace, in this industry, in this conference.
- 2:08What have you seen that's changed the most, and what's
- 2:11remained the most constant?
- 2:13Ross Graber: Oh, my goodness.
- 2:14These are
- 2:20tough questions.
- 2:20But I think
- 2:23what has been the most constant across all of these years is I love
- 2:30being surrounded by people who really love doing business-to-business
- 2:35marketing and are just trying to figure out, what does the future hold?
- 2:40How do we do better at this?
- 2:42What do we need to know to make sure that we're delivering for our businesses,
- 2:46for our customers, even for ourselves?
- 2:48So that sort of energy — I don't think that has changed from the first day
- 2:53I got here, like, in 2011, to now.
- 2:58Everybody's trying, everybody's trying to do a better job.
- 3:01I also think — but the question about what has changed, that's a walk down memory
- 3:06lane, because you think about this, and we always thought that… I don't know
- 3:14that we ever thought we had it fully figured out, but we always thought we'd
- 3:18figured out some pretty big pieces of it, and it's just amazing how much buying's
- 3:26changed, how much business expectations of marketing have changed over the years.
- 3:31And how that starts to affect the ways that we do our job.
- 3:38And it's so easy to just view it
- 3:46as something that's like a constant progression, like one step in front of
- 3:49the other, and you keep going up and up.
- 3:52But there have been a lot of detours.
- 3:54When you think about the amount of change there's been, especially in the last
- 3:59couple of years — and now I'm kind of hooking it back into what we're talking
- 4:03about today here at Summit — the theme this year is about singularity, because
- 4:08we're saying, "Well, wait a second, AI is changing the way buyers buy."
- 4:13Matt Heinz: Mm-hmm.
- 4:13Ross Graber: And so much of the discussion has been about, as marketers, how
- 4:18does AI change the way we do our jobs?
- 4:20But it also changes the way that our buyers are doing our jobs, and it
- 4:24starts to change some of the paradigms for how we think about what our jobs
- 4:28are, and what good starts to look like.
- 4:31And it's a little bit frightening.
- 4:33Matt Heinz: Yeah.
- 4:33Ross Graber: I mean, it's certainly exciting, because it means that we need
- 4:37to do new research, and we need to find new techniques, and we need to find new
- 4:41ways to make sure that we're delivering our buyers what they need and delivering
- 4:45what we need, what our businesses need.
- 4:48But it's a new world.
- 4:51Matt Heinz: I love the way you characterize the continuity
- 4:54of the audience, right?
- 4:55The fact that, as a group, there are people who are curious, who are
- 5:00proactive about trying to learn, who really care about the job that they're
- 5:04doing, and care about their colleagues, and care about being successful.
- 5:11Maybe not always 100% excited about changes to the status quo—
- 5:15Ross Graber: Sure.
- 5:15Matt Heinz: But the change is a constant, too, right?
- 5:17And so you sort of get used to that and say, the technology changes, what
- 5:20the buyers are looking for changes, the complexity of the buying group changes.
- 5:25You have to constantly be in evolution mode to be successful
- 5:29long term in an industry like this.
- 5:32Ross Graber: Absolutely.
- 5:33I mean, if we're not
- 5:38changing, we're gonna get run over, because everything's changing around us.
- 5:43And standing still, it's just gonna pass us by.
- 5:46I know that can sound kind of hackneyed, but some of the things that
- 5:51I know — or used to know, and that I was really good at — sometimes I've
- 5:57gotta put aside, because it doesn't work quite the way it perhaps used to.
- 6:03And I think a great example — we started off, before we got on the
- 6:10air, we were talking about things like the waterfall and the evolution
- 6:14of the waterfall, and how even we think about what interest looks like.
- 6:21The differences between individuals and groups — those things change.
- 6:25We weren't, I don't know that we were necessarily wrong, we were
- 6:29doing the best we could at the time.
- 6:31But we've just learned that things are evolving, and
- 6:34we've gotten smarter about it.
- 6:35Matt Heinz: Well, I think it's a really good point, because I think we kind of
- 6:38make fun of, like, "Oh, remember, we used to send emails and download white papers
- 6:41and send them to BDRs." Well, we did that because for a while that worked, right?
- 6:46Ross Graber: Right.
- 6:46Matt Heinz: And we could argue it's evolved since then, but I also think
- 6:49about, I remember asking my dad after a while in my career, like, "How did
- 6:53you ever work without a computer?" He was in sales and marketing — how
- 6:56the heck did he do any of that?
- 6:58He said, "Well, I would come home at night and I would have a pack of paper
- 7:01under my arm — that was my email, and I had to read it and write it back, and
- 7:06occasionally there'd be marketing copy that an agency had written, and I would
- 7:09use a red pencil — not rev marks — to work on that as well." He's like, "We
- 7:13didn't know better, we didn't know a computer existed." I think that's kind
- 7:15of like — I'm already thinking about pre-Claude cowork versus a post-Claude
- 7:19cowork in terms of being efficient — we didn't know better, we didn't have better.
- 7:24We didn't have Wi-Fi on airplanes, and now we do, and that changes
- 7:26the game a little bit, too.
- 7:28So it's not that the past was bad, it's just that we have
- 7:30an opportunity to constantly—
- 7:32Ross Graber: Absolutely.
- 7:33But I think it's fun sometimes to go and look backwards and start saying,
- 7:41"How did we get to where we are here?" And I'm gonna do a little bit of that tomorrow
- 7:44in my keynote, saying, "Well, why are some of these things that we've just accepted—"
- 7:49Matt Heinz: Yeah.
- 7:49Ross Graber: "—why are they normal? Why do we accept doing it this way?" And a
- 7:54lot of times it's because they did serve a purpose — they served a purpose at a
- 7:58certain point in time, but sometimes that purpose evolves and it doesn't hold true
- 8:03anymore, and we've gotta recognize that.
- 8:05And that's kind of fun, because you've gotta be super introspective
- 8:09and say, "Does it really need to be this way? Or could it be some
- 8:14other way, and we've just accepted it 'cause it's what the limitations
- 8:18at the time encouraged us to do?"
- 8:22Matt Heinz: We're talking on the show floor here at Forrester
- 8:25B2B Summit with Ross Graber.
- 8:27He's vice president, principal analyst at Forrester.
- 8:29And, you know, if we were doing this live, I'd feel like we were sort of
- 8:32giving away your summary tomorrow, but this will be published well after.
- 8:36So let's talk about the accountability reset, and I'm really excited for this
- 8:39session — I'm excited for the message you're gonna give, almost the challenge
- 8:43you're gonna give to marketers, not just in terms of accountability, but in
- 8:47terms of the culture change and change management required to get to where
- 8:52we need to be, to be more successful, more productive, sort of repeatable,
- 8:57sustainable producers of revenue impact.
- 9:00Give us a little preview, I guess, of what—
- 9:04Ross Graber: You're talking about tomorrow.
- 9:05So, here's the shape of the argument.
- 9:07We know that our buyers are changing — so
- 9:12I'm not breaking any news here that buyers are using AI search in really big numbers.
- 9:16That is a fact of life, that is happening, we have no choice.
- 9:21Most of the marketers I know and work with are aware of that shift, and they are
- 9:27doing things within their organization to make sure that they are feeding AI search,
- 9:32that they are showing up where their buyers are, and that's all important.
- 9:35It's good, super-duper.
- 9:38But the challenge that it presents — which is kind of a "seeing slightly around the
- 9:42corner" challenge — is so many of the ways that we evaluate marketing right
- 9:46now are based on being able to prove that engagement to our organizations.
- 9:54We research what marketing organizations are evaluated by, and when you look
- 9:58at the list, most of what they're evaluated by is built around being
- 10:03able to show that we had a buyer who did a thing on our web properties.
- 10:07Matt Heinz: Mm-hmm.
- 10:09Ross Graber: We are funded by the fact that our buyers have done
- 10:11that thing on our web properties.
- 10:14What happens when they're doing a whole lot less of that on our web properties?
- 10:19Does that mean marketing should be less funded, and marketing is going
- 10:23to be less influential over buying?
- 10:27I don't think—
- 10:27—that's the answer to that.
- 10:29Right.
- 10:29Which means we have to stop, or we have to break out of this
- 10:34idea that says everything is going to be engagement-based.
- 10:37Now we have to start being smarter and more specific and more explicit about
- 10:42what marketing is actually here to do.
- 10:46What do good outcomes start to look like?
- 10:49And we have to work all that much harder to make sure that we're calling these
- 10:53things out, letting our organizations know what we're trying to create for our buyers
- 10:59and our business, and how we're going to understand whether we're being successful
- 11:03in that, and whether it's helping us.
- 11:05I'm sorry, I've given you probably the three-minute Cliff Notes of the 20-minute
- 11:10talk, but there are all sorts of things we can go into on how to actually do that.
- 11:15Matt Heinz: Well, how to actually do that — how to help your teams
- 11:18navigate the culture change and change management related to doing that?
- 11:21'Cause any time you ask someone to take accountability for something they may not
- 11:25fully grasp, or fully understand, or fully know how to do, we get afraid, right?
- 11:30And that fear sometimes comes across as defensiveness, sometimes it comes across
- 11:35as almost belligerence — people saying, "I just don't know how to do that, I've
- 11:39never known how to do that. You just changed my job, and now I'm worried about
- 11:42paying my mortgage, 'cause what if I can't do this?" And so the accountability — we
- 11:47really can't and shouldn't escape it.
- 11:49And if we wanna think accountability is just traffic to the website or metrics
- 11:54that you already have access to, that's not the game your team is playing.
- 11:58So we have no choice but to make this shift.
- 12:00How do companies do that?
- 12:04Ross Graber: I wanna jump on something you just said before we talk about the how—
- 12:09Matt Heinz: Sure.
- 12:09Ross Graber: —because something's been fascinating to me.
- 12:11We started with some of the changes in the industry, and then we're talking
- 12:16about some of the metrics we have, and some of the data we have, and
- 12:19some of the information that we have.
- 12:21And it occurred to me that if you turn back the clock to times where
- 12:27organizations were just starting to get their arms around concepts of
- 12:30inquiries, and MQLs, and sales-qualified leads, and all those things — those
- 12:35were data elements that didn't exist.
- 12:37They weren't real until we made them real.
- 12:39And what that meant was we had to start saying, "We're gonna name this thing and
- 12:45call it something, and come up with new techniques to start measuring that we
- 12:49understand what demand is, and where it comes from, and what good looks like."
- 12:53And it's easy to look back at what we've been doing the last few years and say,
- 13:00"Okay, that always was there," but it was not — we had to bring that into being.
- 13:03And I think we're at a point in time where we're going to have to do something
- 13:08very similar, which is we're going to have to put new names on the sorts of
- 13:13things that we're doing, and develop new techniques to monitor whether
- 13:18those things are happening and whether they look good, and whether they're
- 13:23substantial enough to give us direction about what we should be doing next.
- 13:27So, I'm sorry, I went off on a tear in a different direction than you
- 13:32were intending, but the question you asked before I went on a jag was what?
- 13:37Matt Heinz: Oh, it was just around, when we face changes in how we do things,
- 13:43and there's ambiguity around how that's done, how do we help our teams manage
- 13:48that change comfortably and safely?
- 13:53Ross Graber: So there were two things that really stand out to me.
- 13:58I did a ton of interviews as part of the setup for this
- 14:02keynote I'm about to do tomorrow
- 14:07— there was a fair amount of survey research, but the interviews really
- 14:12stood out to me, because one of the things that kept coming across is
- 14:18leaders had to create space for new sorts of objectives by relieving some
- 14:25of the tension from the old objectives.
- 14:27So there's an example I'll talk to — SAS Institute was really good about this.
- 14:34They were seeing that their marketing-sourced pipeline numbers were
- 14:38something they were hitting all the time.
- 14:41But it really was not indicative of whether their business was having
- 14:44a good quarter or a bad quarter.
- 14:46They were great at tracking it, but it was not something that was leading to success.
- 14:51And the team over there started realizing that, and their CMO made a very bold
- 14:55call and said, "You know what? We're done with this — this is not how we're
- 14:59going to evaluate our team anymore." And it created new space to go and start
- 15:04to experiment with different types of objectives that they could put out there.
- 15:08But what also stood out to me is they were doing it in ways that were a little
- 15:15bit more exploratory than punitive.
- 15:17They were saying, "This is a direction we wanna run in — we're
- 15:19going to set objectives around running in this direction." But
- 15:23it never felt to me like they were
- 15:28putting it out there in such a way where — yes, they wanted to succeed—
- 15:33Matt Heinz: Yeah.
- 15:34Ross Graber: —but it was very much a new direction, as opposed to something
- 15:39that folks needed to be afraid of.
- 15:42Or that's how it came across to me.
- 15:44Matt Heinz: Yeah, no, it makes sense.
- 15:46I'm looking forward to this tomorrow.
- 15:47Now, by the time everyone hears this, it'll be on demand, and for
- 15:50those of you Forrester subscribers, you'll have full access to this.
- 15:53You're sort of uniquely positioned to talk about this — you've been talking
- 15:55about this measurement trust crisis for years, that's existed for a long
- 15:59time, and we talk about attribution and we wring our hands about it.
- 16:03But I really like the frame around accountability, because I think, as
- 16:09marketers, we're constantly trying to prove our value to the organization,
- 16:14we're trying to prove that we're true revenue partners, and I think the only
- 16:17way to do that is to get closer to metrics and closer to responsibility around
- 16:22things that you can buy a beer with.
- 16:24And, you know, it's hard to do, and it's hard to measure — but just because
- 16:30you can't measure it perfectly doesn't mean you can't seek to attain it.
- 16:33Ross Graber: Yeah, and one of the things that I'm a really big advocate for is
- 16:39being really specific about the business challenge that needs to be solved.
- 16:43Because sometimes, as marketers, in our ambition, we look a little too
- 16:47far down the road, to, "This is my tactic, and how much revenue did it
- 16:52produce?" And most people listening to your podcast understand that B2B buying
- 16:59is complex, and it's never one thing.
- 17:02And I think when we're chasing that one thing, sometimes we lose track
- 17:07of the intermediate indicators that say, "You know what, what we're really
- 17:11trying to solve for is the fact that most of our audience doesn't appreciate
- 17:16that this problem is more intense than they're giving it credit for.
- 17:21Or that our solution tackles it in this way." And if marketing can go and help
- 17:27change the perception of the problem, or change the intensity, or change the
- 17:31perception of the solution, or even help with different things that the business
- 17:37is recognizing as a competitive challenge — those are all things that start to be
- 17:44very tangible for business stakeholders who aren't sitting in marketing,
- 17:48because they recognize the problem, too.
- 17:50Now, that doesn't mean that we don't have to tie it downstream to the fact that,
- 17:53hey, when we do better at that perception challenge, or that sentiment challenge,
- 17:58we're seeing better revenue outcomes, or we're seeing pipelines moving faster.
- 18:02But we sometimes have to put it in terms that our stakeholders are more likely to
- 18:09embrace, because it matches their view of what's going on with their clients, with
- 18:13their prospects, with their products.
- 18:16Matt Heinz: Absolutely.
- 18:17Well, Ross, thank you very much for doing this.
- 18:21I'm excited for the rest of the conference to hear and see the accountability reset
- 18:25tomorrow, and just thank you for your servant leadership, honestly, in B2B.
- 18:30The longevity you've had at SiriusDecisions — it's not just
- 18:33coming up with great new approaches to accountability, but also all the
- 18:37legacy knowledge you bring to make that real, make it authentic, make it work.
- 18:41Just thank you for that.
- 18:42Ross Graber: Thank you for saying that — you've just made my day,
- 18:46and possibly my conference.
- 18:47So I appreciate that, and I appreciate you having me here
- 18:50and having this conversation.
- 18:51This has been a lot of fun.
- 18:52Matt Heinz: Awesome.
- 18:52Thank you so much, Ross.
- 18:54We'll be back for another episode here on the show floor here in a little bit.
- 18:56Stay tuned.