Latest / Sidecar Sync / 26: Unlocking Customer Lifetime Value and Embracing AI with Google's Neil Hoyne

Transcript

26: Unlocking Customer Lifetime Value and Embracing AI with Google's Neil Hoyne · Sidecar Sync

• 0:00
  Neil: So I always encourage organizations to say whatever metrics you choose, just make sure you go back and reevaluate that time and time again to say what happens if we use something different.
• 0:10
  Neil: Would our business look different from a different lens?
• 0:15
  Amith: Welcome to Sidecar Sync, your weekly dose of innovation.
• 0:18
  Amith: If you're looking for the latest news, insights and developments in the association world, especially those driven by artificial intelligence, you developments in the association world, especially those driven by artificial intelligence, you're in the right place.
• 0:27
  Amith: We cut through the noise to bring you the most relevant updates, with a keen focus on how AI and other emerging technologies are shaping the future.
• 0:35
  Amith: No fluff, just facts and informed discussions.
• 0:39
  Amith: I'm Amit Nagarajan, Chairman of Blue Cypress, and I'm your host.
• 0:44
  Mallory: Hello everyone and welcome back to another episode of the Sidecar Sync.
• 0:47
  Mallory: My name is Mallory Mejiaz and I'm one of your co-hosts, along with Amit Nagarajan, and today we've got a great interview lined up for you with Neil Hoyne.
• 0:55
  Mallory: Neil Hoyne is the chief strategist at a small company you might have heard of called Google.
• 1:00
  Mallory: As Google's chief measurement strategist, neal has had the privilege to lead more than 2,500 engagements with the world's biggest advertisers.
• 1:08
  Mallory: His efforts have helped these companies acquire millions of customers, improve conversion rates by more than 400% and generate billions in incremental revenue.
• 1:17
  Mallory: Immensely proud of the degrees he's earned from Purdue University and UCLA, neal returned to academia in 2018 as a senior fellow at the Wharton School of the University of Pennsylvania.
• 1:28
  Mallory: His first book, converted the Data-Driven Way to Win Customers' Hearts, was published in February 2022 by Penguin Random House.
• 1:36
  Mallory: I am so excited to share this interview with you all.
• 1:40
  Mallory: Today.
• 1:41
  Mallory: Neil Amit and I talk about key insights from his book.
• 1:45
  Mallory: We discuss the idea of customer lifetime value, or CLV, and contextualize it for you so you can apply the concept of member lifetime value or donor lifetime value to your organization.
• 1:56
  Mallory: Spoiler alert it's actually not as complicated as you think to calculate this value.
• 2:01
  Mallory: I bet you already have the data to do this.
• 2:03
  Mallory: Right now, of course, we talk about Neil's take on AI and look, if you want to hear some really fun analogies about how relationships travel and even your grandmother might apply to data, customers and marketing.
• 2:17
  Mallory: Stay tuned for the interview.
• 2:18
  Mallory: After a quick word from our sponsor.
• 2:20
  Mallory: Today's sponsor is Sidecar's AI Learning Hub.
• 2:24
  Mallory: The AI Learning Hub is your go-to place to sharpen your AI skills and ensure you're keeping up with the latest in the AI space.
• 2:31
  Mallory: When you purchase access to the AI Learning Hub, you get a library of on-demand AI lessons that are regularly updated to reflect what's new and the latest in the AI space.
• 2:41
  Mallory: You also get access to live weekly office hours with AI experts and, finally, you get to join a community of fellow AI enthusiasts who are just as excited about learning about this emerging technology as you are.
• 2:54
  Mallory: You can purchase 12-month access to the AI Learning Hub for $399.
• 2:59
  Mallory: And if you want to get more information on that, you can go to sidecarglobalcom slash hub.
• 3:04
  Mallory: Neil, thank you so much for joining us today.
• 3:08
  Mallory: I have been really excited for our conversation with you and for our listeners to learn all about what you do and the insights that you have to share.
• 3:15
  Mallory: But first and foremost I want to hear a little bit about your background and kind of what brings you to this moment.
• 3:22
  Neil: Of course, and first, the pleasure is all mine.
• 3:24
  Neil: It's great to be able to do this, to be able to share these nuggets and make them live and interactive, more than a white paper that nobody reads.
• 3:31
  Neil: But let me go beyond the bio, because the bio is pretty boring and for those that made it through the bio, be like, ah, let's see if he actually has anything interesting to say.
• 3:38
  Neil: I generally explain that I do two things.
• 3:41
  Neil: On one side, I spend a lot of time with models, with machine learning, with AI, all the nuts and bolts and the greasy technical mechanics of how to figure out what's going to happen next in the world.
• 3:54
  Neil: The other side of it is trying to figure out how companies actually use that to make a difference, and so there's a lot of technology that is underutilized, there's a lot of technology that's intimidating, and there's even just that one statistic that came out from Harvard Business School years ago that found that 95% of companies that implemented something as simple as a CRM solution to manage and understand their customers were unhappy with the results.
• 4:17
  Neil: And so, instead of simply saying we need a better design or a new product, is to say what are the friction points that companies run into where they try to use technology to transform their business, transform their industry, interact in a different way with their customers.
• 4:31
  Neil: And what can we learn from that?
• 4:33
  Neil: As practitioners, as leaders, to make better decisions.
• 4:36
  Mallory: That is really helpful.
• 4:37
  Mallory: I don't think anyone but you would say that your bio is boring, neil, so I'm just going to put that out there.
• 4:42
  Neil: I think it's boring.
• 4:43
  Neil: People always write these bios of like I'll write it in the third person.
• 4:46
  Neil: I'll acknowledge that, but I appreciate that as well.
• 4:50
  Neil: Usually I'll tell people.
• 4:50
  Neil: I say I like to come in with modest expectations.
• 4:53
  Neil: We needed to fill a slot.
• 4:54
  Neil: We found this guy at Starbucks.
• 4:56
  Neil: We brought him in and here he is.
• 4:57
  Neil: I know it happens on the BBC.
• 4:59
  Neil: Every now and then they bring in somebody that's not supposed to be on and they put them on.
• 5:03
  Neil: Kind of the same thing here.
• 5:04
  Neil: But I appreciate the credibility there.
• 5:07
  Mallory: For sure.
• 5:07
  Mallory: Well, first things first.
• 5:08
  Mallory: Neil, you talk a lot about putting the customer first.
• 5:12
  Mallory: You wrote a book called Converted that you released in early 2022, about a data-driven approach to winning customers' hearts, looking at the long-term game instead of the short-term, particularly sharing lessons from companies' failures and mistakes.
• 5:27
  Mallory: I'm wondering if you could, if it's possible, sum up your book into kind of one key insight, one key lesson.
• 5:34
  Mallory: If someone reads your book, this is the thing you want them to walk away with.
• 5:39
  Neil: To have permission to do what they already know intuitively is right.
• 5:42
  Neil: Metrics and this is why we have to train marketers so deliberately is we have to train them on the metrics, like return on ad spend, that they're supposed to measure their business on and get them away from this.
• 5:53
  Neil: Well, shouldn't we invest more money in our best customers and shouldn't we understand who's going to spend the most money with us?
• 6:00
  Neil: And instead, a lot of marketers are traditionally trained to be fixated on short-term metrics.
• 6:05
  Neil: No, no, no.
• 6:05
  Neil: Cast aside long-term relationships and instead, if I'm gonna give you a dollar, tell me how much money you made from that dollar today.
• 6:14
  Neil: And really, marketing itself it's a hot marketing is to blame for a lot of this.
• 6:19
  Neil: One of the historical problems with marketing is can we prove that it works?
• 6:22
  Neil: And when you go back to those days of radio and TV and print, it required a lot of time and a lot of math to figure out if that print ad did anything to drive your business outcomes.
• 6:34
  Neil: And then digital marketing came along and we said, aha, look, somebody clicked on this picture.
• 6:40
  Neil: And then they gave us money or they subscribed and we could see those immediate outcomes and we became addicted to it.
• 6:46
  Neil: We said look how great this is.
• 6:47
  Neil: We overcame the biggest challenges facing marketers.
• 6:52
  Neil: Except then we looked at it and we realized that customers are more complicated than that, that relationships are, in fact, not built on that single click, but they're built over time, where customers may or may not do something.
• 7:01
  Neil: We realize it's a lot easier to keep customers than it is to acquire them, and so, slowly marketers are learning what they've already intuitively understood.
• 7:11
  Neil: They're starting to learn how to put it into practice, and so, really this is a long-winded way of giving you the entire synopsis of the book is it's being able to go out to marketers and to say all this stuff that you know is right.
• 7:22
  Neil: I'm going to give you not only permission to do it, but a framework as to how you make it happen, and so it's not that I have to teach you about a brand new way to think.
• 7:30
  Neil: I'm simply giving you the steps to say here's how you start doing what you know is right in your organization that's been beholden to short-term metrics for far too long.
• 7:41
  Mallory: That was a really great summary of the book.
• 7:43
  Mallory: You mentioned kind of this framework that you want to teach to marketers about focusing on the long-term game, building and nurturing those relationships, and it seems like you recommend doing this through CLV or customer lifetime value.
• 7:56
  Mallory: Can you explain what that is briefly to listeners?
• 7:59
  Mallory: I'll ask that first and then I'll ask my follow-up.
• 8:02
  Neil: Sure, here's the way I put it.
• 8:04
  Neil: All right, I'll give a personal story because it's more fun.
• 8:06
  Neil: My wife and I dated for about seven or eight years before I proposed, which is the women will acknowledge, at least here.
• 8:14
  Neil: It's a very long period of time and she always puts she's like why did it take you so long?
• 8:19
  Neil: And I'm like because I'm a guy and that's what we do.
• 8:33
  Neil: But I always ask her.
• 8:33
  Neil: I say, well, how did you know that it was?
• 8:34
  Neil: And she had a secret.
• 8:34
  Neil: She had her grandmother and her grandmother in her 80s.
• 8:36
  Neil: She asked her she's like is this a good guy?
• 8:37
  Neil: And using that collective wisdom and intuition to look and be like yes, he's a good guy and that was enough for her.
• 8:40
  Neil: That was enough for her.
• 8:42
  Neil: And CLV is very much like whether it's a grandmother, an aunt, a brother, a father, whoever that trusted person is in your life looking at your customers and saying there's something there.
• 8:55
  Neil: They're going to be with you for a long time, they're worth your investment, they're worth listening to and getting to learn and they're always right.
• 9:03
  Neil: And that is CLV.
• 9:04
  Neil: Clv is just accept.
• 9:07
  Neil: Instead of bothering your grandmother about like a thousand people or a million people, you build these models that can effectively tell you with a great deal of confidence that these people are worth your time.
• 9:16
  Neil: And for a lot of businesses that's the first step, and the reason why you do this, even though it's a boring metric, is really twofold.
• 9:22
  Neil: One is to give yourself confidence that it's fairly easy to use these types of predictions, that you can actually generate them yourselves.
• 9:29
  Neil: People think that there's some strange magic.
• 9:31
  Neil: No, they're simplified to where almost any company organization can calculate this.
• 9:36
  Neil: And the second is, even before you act, simply to know you have them and just very much like in our own personal lives, how you can categorize.
• 9:44
  Neil: You know instinctively these are good friends.
• 9:46
  Neil: Or you meet somebody and you're like we know that we're going to connect, this is going to be fantastic.
• 9:51
  Neil: And other people you're like I don't think I'm ever going to see you again.
• 9:54
  Neil: You're a great Uber driver, I appreciate you, but never again.
• 9:57
  Neil: And this is what CLV is doing for your business is it's giving you the confidence that you can understand your customers and it's giving you that list to say these are the people you want to pay attention to, these are the people you probably don't.
• 10:09
  Neil: And then it's challenging you to say, now that you know this.
• 10:12
  Neil: What are you going to do differently with your organization because of it?
• 10:16
  Amith: that's um super interesting and I want to try to contextualize that a little bit for some of our listeners when they think about neil's commentary about customer lifetime value.
• 10:25
  Amith: Translate that to member lifetime value or donor lifetime value or constituent lifetime value, which may be measured through an economic lens in terms of dollars.
• 10:33
  Amith: It might be through volunteer hours and engagement.
• 10:36
  Amith: The mechanism through which that you are projecting the V, the value part, could vary depending on the organization and the way you're set up, and I think that the idea that you're projecting or predicting what that lifetime value might be is a really powerful construct that does help you to think both in the longer term, obviously, but also to potentially differentiate where you spend your energy between people who are very high on that lifetime value possibility and people who may not be.
• 11:03
  Neil: It's exactly that.
• 11:04
  Neil: It's exactly that the customer part is as you define it, the value part as you define it.
• 11:08
  Neil: It's built around your business and your needs.
• 11:11
  Neil: It's just having that conversation to say we can look more than what these people, these members, these subscribers, these donors do today, and let's look at what they're likely to do in the years to come.
• 11:23
  Mallory: I love this analogy you gave of the grandmother looking at the man.
• 11:26
  Mallory: In that case, you are looking at a list of people and saying I have this feeling that these are the customers that have the highest lifetime value, or members or donors, as Amit said.
• 11:35
  Mallory: However, when we're talking about feeling right, we're actually talking about data, and there is a way to calculate this.
• 11:40
  Mallory: Can you, without getting too far in the weeds, talk about what pieces of information you might need to find your customers with the highest lifetime value?
• 11:49
  Neil: Sure, it's really two groups of information To calculate the basic understanding of these relationships.
• 11:54
  Neil: We're going to look historically at what all of your donors, members, customers did in the past to help inform these models, and by that we mean an ID, so we know what their name is a first name, a last name, an ID in your CRM database.
• 12:10
  Neil: If that's what you use, you want to have the date that something happened, because we want to look at how frequently are people donating time or donating money, and then we want to look at the assigned value of that moment.
• 12:21
  Neil: Ideally we want to look at if we're looking at monetary, most companies would look at profit, but if you're just looking at straight revenue, donation, you can do that as well, and we're going to generally look at that information for several years back and so on a retail setting where transactions are happening every three or four times a year, that's going to be about two years worth of data.
• 12:40
  Neil: If you're seeing people once a year, you may need four or five years worth of data, but you are able to draw it out and that's the only information that you need.
• 12:48
  Neil: That's enough to inform the model the recency of transactions, the frequency of transactions, the value of those transactions.
• 12:56
  Neil: Rfm has been the cornerstone of marketing for more than 40 years.
• 12:59
  Neil: Those same metrics apply here Now.
• 13:02
  Neil: Once you have that, then always a question comes and you understand here's a list of my high and low value customers and how long they're going to stay with me.
• 13:09
  Neil: The inevitable question comes up to say well, why, what makes them special, what makes them different?
• 13:16
  Neil: We start as marketers.
• 13:17
  Neil: We build personas.
• 13:18
  Neil: We want to know how did these people come to me?
• 13:21
  Neil: Or what's most of interest, or what connects with them, or what activities do they partake in?
• 13:25
  Neil: What content do they look at on our website?
• 13:27
  Neil: For all that content, take it as it comes, which means you have your hypothesis.
• 13:32
  Neil: If you're curious about what emails they interact with, then the only data you would need is well, what emails did they open or click on?
• 13:39
  Neil: If you're looking at what sites do they come from?
• 13:42
  Neil: Then the only data you would need is how did you acquire these customers?
• 13:46
  Neil: And where I want to draw the distinction is.
• 13:48
  Neil: A lot of people think I need to have all my data in order.
• 13:51
  Neil: I need to understand everything about my customers before I begin, and really the takeaway here is one is to calculate the values.
• 13:57
  Neil: It's pretty straightforward it's the date of a transaction, the amount of a transaction, where was their value created?
• 14:03
  Neil: And then afterwards it's a choose your own adventure, based on what you think or what you're curious about as a driving value.
• 14:12
  Neil: And so, if you want to look at acquisition, do you know where they were acquired from?
• 14:13
  Neil: If you want to look at the products they use or the creatives or who they spoke to over the phone, it's just a question at that point do you have that data to understand how things are different based on those activities?
• 14:24
  Mallory: Okay, and once you have these values calculated, let's say I'm guessing it's twofold the strategy from there.
• 14:30
  Mallory: So, on the one hand, you're growing your business by continuing to engage with those high lifetime value customers, creating more opportunities for them to interact with your business, and then, on the other hand, you are trying to tap into a new audience.
• 14:44
  Mallory: Grow your audience by finding customers who are similar to those with high lifetime value.
• 14:49
  Mallory: Does that make sense?
• 14:51
  Neil: That's exactly it, and I'd give also one opportunity.
• 14:54
  Neil: We also look, look, there's some people that love your organizations.
• 14:58
  Neil: They don't need love, they don't need messaging.
• 15:01
  Neil: They're going to come back repeatedly, year after year.
• 15:04
  Neil: Love they don't need messaging, they're going to come back repeatedly, year after year.
• 15:08
  Neil: And so part of it is understanding where your marketing efforts, where your outreach efforts, are going to make the biggest impact.
• 15:13
  Neil: So, if you have customers in any setting that are going to come back, we all have these products and these brands that we just absolutely love.
• 15:21
  Neil: We're like.
• 15:21
  Neil: It doesn't matter.
• 15:22
  Neil: I'm a customer for life.
• 15:23
  Neil: They don't need to send you a coupon code for you to buy their products.
• 15:27
  Neil: You're going to keep buying.
• 15:27
  Neil: All they're doing is giving away margin.
• 15:29
  Neil: If you have to invite people to events, you don't want to have to invite people for events if they're going to give you the same amount of money they would have given you otherwise.
• 15:37
  Neil: And this is part of understanding where those limits are.
• 15:40
  Neil: And so what we do is we put a lot of emphasis on acquiring great people, because when you acquire these great people, one of the attributes is that they're a perfect fit for your organization and your mission.
• 15:51
  Neil: They will stay with you, they will come back and they will not be.
• 15:54
  Neil: So we may call it in relationships, high maintenance.
• 15:56
  Neil: And then you have people on the other end that no matter how much love you give them, they're not going to do anything different and so all right, so we can ignore both sides of those.
• 16:07
  Neil: And where we spend all of our time is right in the middle to say who are those people, that if we gave them a little bit more love, a little bit more attention, we'll see changes in their behavior result, and that's really where we want to focus those people.
• 16:18
  Neil: I always joke with it.
• 16:19
  Neil: Airlines are a great example.
• 16:20
  Neil: I spend a lot of time flying, but on airlines.
• 16:23
  Neil: I fly United Airlines often.
• 16:27
  Neil: It's not uncommon that I'll get upgrades on them, but I'd have their question for their analyst to say is this really creating any value for me?
• 16:35
  Neil: You're the only carrier that flies from San Jose, california, to my hometown of Chicago, illinois.
• 16:40
  Neil: If I want to fly direct, the easiest way is for me to go there, and I don't care what seat you give me.
• 16:46
  Neil: I don't care how much you charge.
• 16:48
  Neil: It's easier than flying into San Francisco and so why give me an upgrade?
• 16:52
  Neil: It's not changing my behavior.
• 16:54
  Neil: You're giving me a bulk discount.
• 16:56
  Neil: You're giving me oh well, neil, you flew us 10 times here's a free seat.
• 17:00
  Neil: No, who you want to look for are those people that may just fly you one time from Delta or American and to say if you have such a great experience, if you're not in the very last row, middle seat, then you'll fly with us a little bit more often than you would previously, and so you win that share of their money, and that's how you start building a relationship with them.
• 17:19
  Neil: And so the first thing is to get all the best relationships you can.
• 17:23
  Neil: And then to that second point you made is find those people where your outreach efforts, where your time and your investment are going to change their future behaviors, not simply recognize them for something they were going to do already.
• 17:34
  Amith: So, neil, I want to try to apply this to a common business problem that associations in particular have.
• 17:40
  Amith: So these are membership organizations within various professions and trades and so forth.
• 17:44
  Amith: And a common problem that people tell me about is you have people who do join these.
• 17:45
  Amith: So these are membership organizations within various professions and trades and so forth.
• 17:48
  Amith: And a common problem that people tell me about is you have people who do join these associations because it's kind of the expected behavior in a sector, whether that's law, you know, join the Bar Association, or if you're an accountant, join the CPA group, and if you're a doctor, et cetera, et cetera and at the same time, while it's fairly low churn, they continue to get renewals and membership renewals from these people.
• 18:07
  Amith: There's not really a lot of value being created in a way, because they don't have those people engaged.
• 18:11
  Amith: They're not buying other products, attending meetings, taking courses, doing anything else, since everyone's doing that within their existing ecosystem.
• 18:22
  Amith: Would it be, in the context of what you're describing, to calculate CLV or member lifetime value, to perhaps exclude the membership, since that data could be potentially dilutive in the analysis in the model, or would you still include membership data, even if it's not necessarily the factor that relates to what we're talking about in terms of getting them to do other things with you.
• 18:43
  Neil: I'd still include them.
• 18:44
  Neil: You're just going to see, unsurprisingly, a very large portion of your base that doesn't contribute a lot of value.
• 18:51
  Neil: They pay their fees and they'll take away theirs.
• 18:54
  Neil: You probably don't need to listen to them a lot.
• 18:56
  Neil: And so, again, going back to the airline example, a good one is just to say if you look at a typical airline, you're going to have I think American Airlines are outgoing CEO a couple of years acknowledged that 83% of the people on their plane are not going to fly with them again for the next 12 months.
• 19:12
  Neil: No-transcript.
• 19:40
  Neil: We're happy to take your fees, but when we look at building the future of the organization, we want to know those people that are going to contribute.
• 19:47
  Neil: Another example is that you often may want to find early on how to distinguish which category these people are going to fall into.
• 19:55
  Neil: Now, in those cases, we may certainly look to say well, are they renewing?
• 19:59
  Neil: Are they participating?
• 20:00
  Neil: One of the great case studies we had at Google was with our Google Workspace product.
• 20:04
  Neil: Now, if you're not familiar with that name, that's our corporate version of Gmail.
• 20:09
  Neil: So if in your organization you have your own version of Gmail, just for your organization, that's Google Workspace, and a lot of people sign up because a lot of people want to play with the product, they want to explore the product, but not a lot of them actually buy licenses.
• 20:23
  Neil: And so we have that question with our salespeople who do you send the salespeople after?
• 20:27
  Neil: Is it anybody?
• 20:28
  Neil: Is it the people at large organizations versus small?
• 20:33
  Neil: And so what we did was we were very deliberate to say, after somebody signs up for a product, after they just become that basic subscriber, let's look for activity in their account that says they may be slightly better than what we expect, and those are the people that we target, and so that might actually work.
• 20:50
  Neil: In this case, you have people that just subscribe and say, look, we're going to let anybody join that wants to join this professional membership, but then we're going to look very closely at what they do in the first 60 or 90 days.
• 21:00
  Neil: Do they come to a meeting?
• 21:01
  Neil: Do they interact with our website?
• 21:03
  Neil: Are they opening our emails?
• 21:04
  Neil: Give me something that says these are people we should lean in on, because they look more engaged with our organization than people that just come around to check a box.
• 21:14
  Neil: And that, again, is what we're looking at.
• 21:17
  Neil: That long term.
• 21:17
  Neil: These people are giving us signals that they want a better relationship with our organization and we're going to identify those and we're going to respond in kind by trying to bring them a little bit closer.
• 21:27
  Amith: Neil, you know what you're describing is first of all, I think, really insightful for our audience and also, in some ways, it's it relates in a way, to work that associations do a lot around this idea of the first year in the journey, where they analyze deeply what happens in the first 12 months of a member's journey with the association, what are the key things that happen, what goes well, what doesn't, and sometimes there's some interesting insights coming out of those types of studies when they're performed from time to time.
• 21:54
  Amith: But what ends up happening in my experience is they then apply their findings universally across everyone, so they don't like the idea of picking their favorite child, so to speak, and saying, hey, this is where we're going to focus their energy and as a result, they get mediocre results everywhere.
• 22:08
  Amith: Do you have any thoughts on that problem and perhaps how people might think about it differently, because they like to look at it from the viewpoint as a not-for-profit membership organization.
• 22:18
  Amith: They are there to serve all their members and they're seemingly disproportionately serving the ones that would grow the most, or things like that.
• 22:24
  Amith: What are your thoughts on that piece?
• 22:26
  Neil: It's a well-recognized problem and the way that I present things in the book has to be delineated because it makes a lot of sense Good customers versus bad customers.
• 22:34
  Neil: Let me give you the practical reality as to how companies do this.
• 22:37
  Neil: They may spend 5% more time with their better customers and 5% less with their worse.
• 22:46
  Neil: In some cases they will look and they will learn about their best customers, but they may not discreetly act on it.
• 22:50
  Neil: There was a gym I worked with one time where they said look, we know who our best customers are, we know who our worst customers are, but our goal, our mission, is to help everybody get in shape.
• 23:00
  Neil: And I said that's fine, I understand that, but let's at least understand the different needs of your customer segments more than just if they signed up for a membership.
• 23:10
  Neil: So if you can look at your customers and say value is not created based on the number of dollars they spend with us in your organization, values created maybe by the hours that they spend utilizing your gym Interesting thing I learned, at least for Americans, that if you sign up for a gym membership in January right January, new Year's resolution, people, we know them you will only use that membership six times in the next 12 months, four of those times being in January.
• 23:42
  Neil: Now you might look at this from a value lens to say, great, they're giving me money for 12 months and they're not using any of my stuff.
• 23:49
  Neil: Or you may identify to say, if value is created based on the number of times you're going to come back and we're going to say, every time you come back, we look at that as a dollar of value created.
• 23:58
  Neil: You're going to say these are people that I need to lean into because they're not going to create any value for me.
• 24:02
  Neil: They're not going to use the gym after the first month.
• 24:05
  Neil: What programs do we build for them?
• 24:06
  Neil: Because that's consistent with our mission and that's why we talk about the value.
• 24:11
  Neil: That's customer mission value, purpose-driven value, and that's how you define it.
• 24:30
  Neil: But again, what we're looking at here is simply saying how much value are people going to create more than what they're doing today?
• 24:33
  Neil: And we have that perspective and how you adapt that into your mandate, into your programs, is entirely up to you.
• 24:38
  Neil: There's no right or wrong way.
• 24:40
  Neil: I just want to bring awareness, to say we can get an understanding as to what we think will happen next.
• 24:45
  Amith: That's super helpful, thank you.
• 24:47
  Neil: And, by the way, I have to bring that up because whenever I bring up relationship things, you're going to get people bring up like so do you do a relationship value for all of your friends?
• 24:55
  Neil: No, but you still are nice to everybody, but you still intuitively know when these people call, you will pick up, you will move mountains for them and other people will be like I'm happy to help you.
• 25:04
  Neil: And that differentiation is fine.
• 25:06
  Neil: You're still a good person, you're still a great organization.
• 25:08
  Neil: It just helps you to become, I would argue, more effective with your mission, because you know the people you can and cannot influence, and this is an important message to bring up.
• 25:18
  Neil: Sorry, I'm going to jump ahead of this.
• 25:19
  Neil: You may ask this, but if not, I'm going to volunteer it.
• 25:22
  Neil: We often find that a lot of people whether we're talking nonprofits, b2b companies, retail companies or travel companies they have a certain behavior that's fixed on acquisition.
• 25:33
  Neil: You just can't change it.
• 25:35
  Neil: Somebody's going to be a great fit or not.
• 25:38
  Neil: And where a lot of organizations actually go astray is they look at these people whose behavior inherently cannot be changed and say we're going to invest a lot of time trying to change it.
• 25:48
  Neil: And again, personal relationships work best, and this is the example I love to give.
• 25:52
  Neil: But if anybody ever comes into you and says I found the perfect person for me, they're dating somebody.
• 25:57
  Neil: I found the perfect match on Tinder, whatever people use nowadays and then they follow it up by, but all I have to do is change them, you'd be like no, no, no, no.
• 26:08
  Neil: Find good people outright, don't try to change them.
• 26:10
  Neil: It's not to say you can't change them, it's just it's expensive, it's time consuming, it leads to a lot of heartbreak.
• 26:16
  Neil: It's easier to find people that you can connect with outright, that have what you need, that already have that affinity for your organization.
• 26:23
  Neil: That's all we're saying.
• 26:24
  Neil: And but no, it doesn't mean if you want to try, yes, but just we're giving you a prediction to say we think we know where things are going to end up, despite your best intentions.
• 26:38
  Mallory: That makes a ton of sense.
• 26:39
  Mallory: Certainly, my alarm bells went off in my head even hearing you say that analogy.
• 26:40
  Mallory: Right, we can't change people and we shouldn't go through life thinking that and we shouldn't go through business perhaps thinking that as well.
• 26:47
  Mallory: I kind of have one more question here, neil, for our listeners who don't have millions of customers, millions of members Is there such a thing as leaning on customer lifetime value too heavily?
• 27:00
  Mallory: And in that sense I mean, if you don't have that many customers or members to look at and some of those might have potential, even though they don't display those typical markers, maybe of someone who is high lifetime value in your organization, but they have the potential to be just like someone might have the potential to grow and be changed by an individual?
• 27:18
  Mallory: Do you ever see companies or marketers ignoring those with potential?
• 27:23
  Mallory: Or, if you calculate it correctly, should you not be losing those people with potential?
• 27:28
  Neil: Where customer lifetime value tends to go astray is, to your point, companies using it more aggressively than they should.
• 27:34
  Neil: They look at it to say almost to borrow that airline example, if we're going to get 70% of our revenue from 10% of our flyers, we only need that 10%, and then the rest of the seats on their plane are empty.
• 27:46
  Neil: Or if we only want to service our best customers, then you're going to have an empty ballroom the next time you have a conference.
• 27:53
  Neil: Really, what we're looking at is to say say, anybody that wants to be part of your organization, that wants to share in your membership, you want to support them.
• 28:01
  Neil: You just want to do it in a way that's appropriate to the value that they're going to bring back.
• 28:05
  Neil: And so really what we talk about is it's not only awareness but, exactly to your point, it's also offering that constraint to say we don't need to tear up all of our processes and our mission.
• 28:14
  Neil: We start with simply understanding that these behaviors exist.
• 28:17
  Neil: And then I really encourage organizations to say your goal is not to transform your business tomorrow.
• 28:23
  Neil: Your goal is simply to say, if we understand that these people may be better or these people may be worse, what's one small thing we can change in service of those groups or in recognition that these behaviors are happening.
• 28:36
  Neil: And then, slowly, that organization becomes more member centric, becomes more customer centric, and that's really the change that we're looking to happen.
• 28:44
  Neil: It's not where it's so precise that you spend time, say ah, you're not worth it, get out.
• 28:48
  Neil: It's just to say no, we guide with the principles of the organization first, and all these metrics and all this data and all these predictions are simply helping us better fulfill that mission.
• 28:59
  Neil: And that's as far as we take it.
• 29:01
  Amith: You know, neil, your thought about getting too aggressive with CLV or any particular objective metric, I think is a really good one, and it's interesting because I'd love to get your opinion on something that's slightly off track here but, I think, really relevant to the conversation for our audience, which is we think about, you know, optimization and pick any objective function for an AI algorithm and you can kind of, you know, get extreme with it, but you think about, like social media and the way you're optimizing in a social media feed, on any pick any of the social media platforms.
• 29:33
  Amith: Typically, they tend to be optimizing on eyeballs on site amount of time spent on site, the number of scrolls you have, therefore, how many ads can be displayed, which is understandable given the business model, the nature of what those organizations are focused on, versus necessarily providing the best information or the most entertaining information, or whatever the case may be, which may have different objective functions Some may be longer term in nature, some may be shorter term in nature, some may be shorter term in nature.
• 29:57
  Amith: We encountered this exact problem, actually, when we were building one of our AI startups called Rasaio, which is basically a personalization tool for email newsletters that delivers one-to-one emails, and when we launched this company seven years ago, there was a lot of debate amongst the engineering team saying, hey, what objective function should we essentially use?
• 30:16
  Amith: Should we look for?
• 30:17
  Amith: Maximizing open rates, maximizing click rates?
• 30:19
  Amith: What's the most important critical number to focus in on?
• 30:23
  Amith: In a similar sense to what we're talking about in the context of CLV.
• 30:26
  Amith: And ultimately, what they chose is to lean on their purpose statement, which is to better inform the world, which is a long-term view, and so they were looking at a 12-month open rate and a 12-month click rate, rather than a more immediate thing, which is kind of hard for a lot of folks to necessarily grasp their heads around because it's looking a little bit more long tail and so forth.
• 30:45
  Amith: But the theory was that if you can inform people quickly and get them out of the newsletter as fast as possible, that actually better serve them and then they'd keep coming back and they'd get more value from it.
• 30:53
  Amith: More value from it.
• 30:55
  Amith: Is there anything from that example, comparing like social media feeds versus like the Rasaio AI?
• 31:01
  Amith: You know that approach like that applies to CLV, like the kind of mindset of how you calculate things near term versus midterm versus longterm.
• 31:09
  Neil: You know, I think for any publicly traded company, as I mentioned to before, if you're driven by creating shareholder value, then your metrics will align to that Profitability.
• 31:18
  Neil: Profitability comes from ads.
• 31:20
  Neil: We need to show more ads, more interaction.
• 31:22
  Neil: If you're a nonprofit and you're focused more on a mission, then I would hope that the value that you define, whether it's customer, member or lifetime value is reflective of your goals in that mission.
• 31:33
  Neil: As it comes to specific metrics and people often wander in circles to say, do we use click rates, open rates, new signups, app downloads, do we look at lifetime value as the full lifetime value of someone or five years out the answer I often come back with is to say I want to know what the difference would be to the organization If you were to look at a three month open rate for email or a 12 month open rate rate or a 36-month open rate.
• 32:00
  Neil: Which customers would you serve?
• 32:03
  Neil: Which messages would you put out more or less?
• 32:06
  Neil: And if there's that difference that's where I want to have that debate More times.
• 32:09
  Neil: What we find out is the behaviors would be the same, and so we argue about things that are existential.
• 32:14
  Neil: We want to use this metric versus that.
• 32:16
  Neil: If the business outcome and the decisions are identical, then it's not as interesting to me to have that debate.
• 32:22
  Neil: If the lifetime value people I work with some people who are very strict it must be the full lifetime value of the person and you get a CFO, that's like I'll give you three years and they get frustrated about this and they have these organizational debates.
• 32:35
  Neil: We're not going to move forward until we resolve it.
• 32:37
  Neil: And then I look at it to say you're going to be reaching nearly the exact same people in that period versus the other period.
• 32:44
  Neil: If it's not changing your decisions, let's not do it.
• 32:48
  Neil: The thing that I want to be careful about is oftentimes in organizations, metrics fall by the wayside.
• 32:55
  Neil: You'll adopt a metric, you'll look at how it changes year over year, but people will forget why you ended up using those metrics.
• 33:02
  Neil: They just become historical.
• 33:04
  Neil: You're like well, that's how we've always looked at performance.
• 33:05
  Neil: So I always encourage organizations to say whatever metrics you choose, just make sure you go back and re-evaluate that time and time again to say what happens if we use something different?
• 33:17
  Neil: Would our business look different from a different lens?
• 33:20
  Neil: And this is a lesson that's very difficult for some organizations because it in fact creates controversy.
• 33:25
  Neil: Wait, if we looked at our business businesses in data everybody that you listen to you'll hear in our world, in data, it's a single source of truth, and that's very bizarre to me and I say well, why are you going to cut out all the other voices that could provide you with an opinion as to how your organization is doing, and saying we're only listening to this person, we're only listening to this metric, and so what I would do is I would look at other metrics as well.
• 33:49
  Neil: Use the metrics you have today, but then tomorrow, or six months or 24 months, go back and say if we looked at our business in a different context, would we still be happy with the decisions we're making?
• 33:59
  Neil: Would we be doing something different?
• 34:01
  Neil: And have that conversation amongst your stakeholders to say which one do we believe is consistent with the mission of our group.
• 34:08
  Mallory: Well, amit kind of touched briefly on AI and Rasaio.
• 34:12
  Mallory: I think that's actually a record, amit, for the longest we've gone on this podcast without talking about AI, which is pretty impressive, so now it feels like a good, opportune time to shift the conversation there.
• 34:23
  Mallory: Neil, we've got to ask how are you using AI currently with your own marketing and do you have a top few use cases that you could share with listeners?
• 34:36
  Neil: You know, I would say AI has this model like a little left brain and the right brain.
• 34:39
  Neil: Right, you have a very quantitative side of your brain.
• 34:41
  Neil: You have a very qualitative and creative side.
• 34:44
  Neil: A lot of what's been happening in AI lately has been on that more creative side.
• 34:48
  Neil: Large language models, chat, gpt, gemini things that allow us to create stories, to create prose, to rewrite emails, to engage with customers and chatbots.
• 34:58
  Neil: Those are interesting use cases because they lead to almost a furthering of humanity in how we communicate.
• 35:04
  Neil: How do we communicate with our members more efficiently, more effectively?
• 35:08
  Neil: There's a circular argument internally to say if an AI tool can build a better email that's more persuasive and communicates, shouldn't I use that?
• 35:19
  Neil: And then recipients saying if I can use AI to read those emails and summarize it for me, shouldn't I use that?
• 35:25
  Neil: And they're like do we create a cycle just where it's AI talking to each other?
• 35:28
  Neil: Be like can we do this?
• 35:30
  Neil: And the AI responds back yes, I think it's a very fascinating experiment that, as these tools see more and more adoption, we're going to see the implications of it.
• 35:39
  Neil: But everything is largely positive on that angle.
• 35:42
  Neil: Now, on the other side, the more quantitative side of AI, that's around predicting.
• 35:46
  Neil: It's around being able to look at MRIs or CAT scans and to say what's the likelihood that disease will form that a radiologist may not be able to discern on their own, to say, we could take a radiologist who has 10 years of experience, but what happens if we use every x-ray that we've seen over the past 20 years?
• 36:05
  Neil: Could we make a better determination, even everything we've been talking about lifetime value?
• 36:10
  Neil: Can we predict what customers, what members, need next, what their sensitivity is going to be to different prices and options for memberships, without having to roll those out?
• 36:18
  Neil: Those use cases are going to take a lot more time, but that's where I spend a lot of my time thinking about is for any, for any owner of a business, if you could predict something about the future, what would you ask about?
• 36:34
  Neil: What would change the way that you look at your business and that you look at your community?
• 36:39
  Neil: And that's where I think the really compelling part of AI is is that you have all those immediate use cases around better conversations and more language and better interactions.
• 36:48
  Neil: But then you have that harder, more quantitative side to say if we could reasonably predict what's going to happen, what would we do differently?
• 36:56
  Neil: And that's the part where it actually even becomes creative in and of itself to say what would you want to know if you had a magic crystal ball that could predict something more than just the lifetime value of your members?
• 37:05
  Neil: But what if you could predict market conditions or price sensitivity or different programs and options without having to build those?
• 37:13
  Neil: And what you get back to on both sides is that you see a very human component to AI.
• 37:19
  Neil: Ai won't know the questions your organization should ask.
• 37:23
  Neil: It can simply accelerate your business by helping you make faster decisions, or accelerate your business by being able to serve your members better, or being able to accelerate how long it takes you to write that perfect email copy.
• 37:34
  Neil: But it still comes back to now a lot of leaders saying that they actually felt intimidated by AI.
• 37:39
  Neil: Ai is so technically savvy.
• 37:41
  Neil: How do I possibly get my hands around it?
• 37:42
  Neil: A lot of my time is trying to figure out how you get them to step back and to say no, your value is not figuring out what is my AI strategy?
• 37:50
  Neil: Now, that's a ridiculous question.
• 37:52
  Neil: Your real thing is how do I take my existing strategy and use ai to get it to go faster or to be better?
• 38:00
  Neil: And so it's actually for a lot of areas in ai.
• 38:03
  Neil: It's bringing business owners back to focus and to say this is your role, this is how you focus on it and this is what ai is going to do to help accelerate it, and for them that's a lot of calm, but it's also a large area of focus, which is to say, no, stop being distracted by everything AI and let's go back to your business and let's just talk about the things you want to do, where AI can plug in to help you do it better or faster.
• 38:25
  Amith: Neil, I think a good area of exploration around what you're describing there for these listeners is around, perhaps, topics that people will be interested in in three months or six months or nine months, where we're going to have an annual conference and at that annual conference we have to make decisions on the keynote speakers we're going to invite and the program content overall.
• 38:46
  Amith: What should we focus on?
• 38:48
  Amith: And that is a very human decision.
• 38:50
  Amith: There's not a lot of predictive work being done in this field.
• 38:53
  Amith: Broadly speaking, some people are playing around with ideas, but I think that particular category potentially holds some promise in terms of being able to come up with programs and content that will be more appealing, more broadly marketable, etc.
• 39:08
  Amith: What are your thoughts on that and what are your thoughts on applying some of the thought processes you've already shared into other use cases, like the one I just described?
• 39:19
  Neil: hey, if you want, if you don't want, keynotes, reach out, I'll go do it for you.
• 39:22
  Neil: But no, uh, just as seriously, with with a lot of it, what I find organizations need is they need permission to decide a path forward.
• 39:33
  Neil: When things advance as quickly as ai, there's a lot of uncertainty, there's a lot of fear that they're going to be left behind, and what I worry about is it causes distraction, it causes overinvestment.
• 39:43
  Neil: And when I look at these large groups, oftentimes when I see these people in the audience, when I do speak to them, a lot of them are intimidated, they're confused, they're worried that here's a pivotal opportunity where they're going to miss the boat.
• 39:55
  Neil: And a lot of them bring up here in the US at least, they bring up the Blockbuster and Netflix example and they're like Blockbuster is like they had VHS and DVD rentals and then Netflix came around and the Blockbuster leadership team missed that opportunity.
• 40:10
  Neil: And then they say we're never going to be Blockbuster, our organization will see what's coming next.
• 42:06
  Neil: Here's the thing when you actually talk to the Blockbuster execs they all saw that streaming was coming.
• 42:11
  Neil: What they couldn't do was affect the organizational change in their business to take advantage of it.
• 42:18
  Neil: Blockbuster had $800 million annually in late fees and they, organizationally, could say how do I transform my organization to use what's coming next, when everyone's like to use what's coming next?
• 42:31
  Neil: Streaming means no late fees, shit.
• 42:33
  Neil: What do we do?
• 42:34
  Neil: And so that's what they need to learn.
• 42:37
  Neil: They need to know not just what AI does, but how, as leaders in an organization, do you start to pivot?
• 42:43
  Neil: And the same thing with your members.
• 42:44
  Neil: If you're asking your members for content, how do they know what's coming next and how do you navigate them through?
• 42:51
  Neil: And that's the value of those organizations is that it's not only that they're listening to people like us go back and forth about what's happening, but how do you get it down to every single one of your members who, arguably, in their own organizations are seeing the same type of change to say do we need to use AI?
• 43:06
  Neil: Are we not using enough AI?
• 43:07
  Neil: Should we hire people for AI?
• 43:10
  Neil: What do we do?
• 43:11
  Neil: And then again messaging to them to say relax a bit.
• 43:15
  Neil: You're great as you are, let's focus on the right things.
• 43:25
  Amith: In many ways, part of what you're describing with Blockbuster and, I would say, existing successful franchises of any kind is this classic innovator's dilemma where it's very difficult to get out of your own way when you have significant critical mass and a flywheel around it and all of the usual things that lead to people not wanting to undermine the revenue streams and the profitability from their current business, and I think associations and nonprofits do have flavors of that and nonprofits do have flavors of that.
• 43:47
  Amith: I'd love to hear to the extent you can share Google's perspective on generative AI and the impact with respect to the traditional search business and how that's going to adapt.
• 43:55
  Amith: Clearly, google's moving really rapidly right now from a tech perspective with Gemini and, if you use generative results in the search bar, really curious how the ad business fits into that longterm and how you balance that where you have a significant amount of revenue coming in to power an organization the size of Google and relative to the potential disruption that generative AI may have in that realm.
• 44:20
  Neil: We spoke a lot about missions, and one of the defining missions of Google has always been to organize the world's information, to make it accessible, to make it useful, and generative AI is simply an extension of that mission.
• 44:31
  Neil: The mission's never been to maximize profitability.
• 44:34
  Neil: No, the goal is to make sure that people have the information that they need.
• 44:37
  Neil: Now, interestingly enough, a lot of people look at search and, surprisingly, even in this day and age, 25 years out, that nearly 20-22% of the queries we see every day on Google are brand new People expressing themselves and asking questions in a way that's unique to all of humanity and everything that we've measured.
• 44:55
  Neil: And for the first time, and I think as we start integrating generative AI, we're starting to see how people react to it, how people use it, the queries that are helpful, how they interpret and process that information, opinion versus absolute truth and I say we're in the early days of that experiment.
• 45:11
  Neil: I say what's fantastic about it is that we have a long history of AI.
• 45:14
  Neil: As we're talking, even on the pre-call Google has a lot of.
• 45:18
  Neil: The foundational technology of these large language models was developed at Google, and so we have this rich history by which we can build and develop these models, and now I think we're on that part to say how do consumers, how do users, recognize them?
• 45:31
  Neil: How do they interpret trust?
• 45:33
  Neil: What's too much versus too little?
• 45:35
  Neil: What query are they going to ask next?
• 45:38
  Neil: And so I like to think of it all as a grand experiment, one that's super exciting, but one that, as we go and we look back every three or six months, what we learn and the surprises we see along the way are really going to be enriching in terms of what it looks like next and, I would argue, in five years.
• 45:54
  Neil: It's going to look fundamentally different in terms of how people access and get information, but not in a way that anyone can predict today.
• 46:01
  Neil: I think we learn that based on how people use and how people respond to these queries.
• 46:06
  Amith: Yeah, I appreciate you sharing that, and certainly, um, that makes a ton of sense and I think that you know, looking at the traditional ad business and how that revenue stream folds into generative results or whatever comes next, is an interesting uh thing.
• 46:21
  Amith: To constantly be balancing between how you're delivering the information that's mission-centric versus ensuring that the revenue stream is not only maintained but that there's growth opportunity around, which is, of course, important to any company, including a company like Google.
• 46:35
  Amith: You know, I think that the people generally who are outside of AI circles don't realize what you just said about Google's history in this field, and I mean Google, from the very beginning, is algorithmically in the AI camp and traces its roots all the way back to that, so it's a very interesting thing to watch.
• 46:52
  Amith: Ultimately, when you think about customers in the world today, whoever they are, in, whatever field, they want to get to the thing that they care about faster and faster, and their expectations are higher and higher and their tolerance for friction or any kind of you know inconvenience becomes lower, and so I think that that's a key message we try to share with this community that they may have a tremendously valuable product or offering, they might do amazing things in this world, but if they make it hard to deal with them, if they make it such a high friction experience, if you will, that's very challenging, and I think that's where a lot of people could look at things like the Google business and say, look, this is an incredibly complex product under the hood, but the surface of it is so incredibly simple that everybody in the world can use it.
• 47:37
  Amith: So there's a lot of lessons to be learned for that, for this audience as well.
• 47:42
  Neil: The simpler the better, right?
• 47:43
  Neil: You don't need to know how the sausage is made all the time, you just need to know that it works and that it's simple.
• 47:53
  Neil: And I think AI is just one where people start poking their head about to say, oh, what's going on there?
• 47:55
  Neil: And I'd also point out this is just something a little bit of a legacy thing when we talk about product simplicity.
• 47:58
  Neil: Some of OpenAI's GPT models in fact, gpt-3, if you go back to Wired Magazine in September of 2020, in fact, gpt-3, if you go back to Wired Magazine in September of 2020, wired had a glowing editorial about how this technology would transform everything from writing book reports to doing research, to composing music, and, collectively, the world didn't get on board.
• 48:24
  Neil: It's kind of like, oh well, that's kind of neat, it's coming, and part of the reason was that it was too technically complex for anybody to understand how it fits into their day or their work.
• 48:30
  Neil: You look at it and you'd go to their interface and I use it at that time and it was like and you have to specify tokens and then you're sitting there and be like what's a token?
• 48:36
  Neil: I need to learn this first, and then this brilliance that came in and I give I give the open AI team credit for this of putting it into a chat bot.
• 48:43
  Neil: So a chat bot so that way somebody could sit there and you say you type a query, like you would send a message to a friend or something on slack, and then you see it respond, and then suddenly people understood what AI was doing for them, and so I really look at it as almost the best example of product market fit.
• 48:59
  Neil: You could have had the best product in the world, but until people knew how to use it, how it integrates into their life, and to not be intimidated by everything happening under the hood and how many tokens are being used, you're never going to recognize its full potential.
• 49:12
  Amith: Makes a lot of sense and that quote that you, or the statistic that you shared a moment ago about 20%, if I heard you right, 20% of each day's Google queries are net new that have never been seen by Google, ever in the history of Google, that's a little bit more than 20%, If you could believe it almost.
• 49:30
  Neil: let's just say one in four queries have never been seen before.
• 49:33
  Amith: That's amazing.
• 49:35
  Neil: A lot more questions that people have to ask.
• 49:37
  Mallory: Yeah.
• 49:38
  Neil: People have different ways of expressing themselves and typing in queries.
• 49:41
  Neil: We think about ourselves in our own experience, but there's different audiences that will expect different things from search.
• 49:50
  Neil: My children actually grew up on voice search.
• 49:52
  Neil: That's their method of interacting.
• 49:55
  Neil: I know other people and researchers that grew up using syntax in specific Boolean fields.
• 50:00
  Neil: If not include this, exclude this.
• 50:02
  Neil: That's their language.
• 50:03
  Neil: Even when you look at Google Translate, google Translate was designed explicitly to work for.
• 50:08
  Neil: This is why we built it, for Klingon was to say, we don't just want to build it for known languages, but as new languages emerge, can we build an understanding of language that helps these models understand what people are saying, even if we haven't seen it before, based on what we learned, and so it's just as much as we try to simplify down humanity.
• 50:27
  Neil: It is the most complex thing we'll ever interact with, and I think what we see here with large language models is trying to give people a new medium by which they can express themselves, by which they can ask these questions.
• 50:39
  Mallory: I'm curious.
• 50:39
  Mallory: I'm sure we have some listeners that are curious as well.
• 50:42
  Mallory: Are you, neil, chief measurement strategist at Google, using large language models, generative AI, every day in your own workflows?
• 50:51
  Neil: I try not to.
• 50:52
  Neil: I try not to.
• 50:54
  Neil: In fact, I tell people this If you look at my cell phone, my cell phone has the fewest amount of apps possible.
• 51:00
  Neil: If you look at the desk, I have as little technology as possible.
• 51:02
  Neil: I'll actually personally rely on this quote to say when you have an abundance of information, it leads to a scarcity of attention, and so sometimes I've learned over my career that having as much information come at me at a day-to-day basis is not the best strategy, and if I assume my counterparts at other companies have the same situation, then there may be a competitive advantage for doing less and stepping away from the data from time to time.
• 51:30
  Neil: I don't ignore it forever, which means there's certainly times where I can't move myself and I'll have monitors and data all over the place, but at least when I'm at home it's just kind of a quiet thing to say let's think about where things are going as opposed to just being in the middle of it all the time.
• 51:43
  Mallory: Amit, what are your thoughts on that?
• 51:45
  Amith: I love it.
• 51:45
  Amith: I think that's a practice that I could improve upon, because I certainly have a flurry of information coming at me at almost all times.
• 51:51
  Amith: But I think you're right that attention is inversely correlated with the amount of information flowing at you, and you got to pick and choose your battles.
• 51:59
  Amith: What I try to do at the beginning of each day is to list very clearly what my priorities are for that day and to focus on those before I allow myself to get engulfed by email and all the other things and instant messaging and so forth.
• 52:11
  Amith: But creating focus is the key to achieving outcomes, and I think that's what you described as a really good way of describing that.
• 52:19
  Amith: And in the world we live in today, it's acceleration of both information and other things.
• 52:25
  Amith: So it's a challenge, for sure.
• 52:29
  Mallory: Well, neil, we've got to say thank you so much for joining us today, for everything you've shared.
• 52:34
  Mallory: I feel like we could write a book based on just this podcast episode, can you?
• 52:38
  Mallory: Let listeners know where to find you.
• 52:42
  Neil: Just, you can find me on LinkedIn.
• 52:43
  Neil: You can go to neilhoynecom N-E--l-h-o-y-n-e dot com.
• 52:48
  Neil: Uh, if you're interested more about the lifetime value, certainly, my book is a great place to start.
• 52:53
  Neil: In fact, uh, the profits from the book are donated to non-profits, so food pantries around the country, which is fantastic.
• 52:59
  Neil: But I always encourage people on social media to reach out, just because I love hearing from from them, from you, about what you took away, about the questions you had, because that again guides my thinking more than anything I can see in structured data sets.
• 53:12
  Neil: It's that human connection that's so important and often missing.
• 53:17
  Mallory: We will link those in the show notes.
• 53:18
  Mallory: Thanks everybody, Fantastic.
• 53:20
  Neil: Thank you so much.
• 53:21
  Amith: Awesome thanks.
• 53:21
  Amith: So much.
• 53:23
  Amith: Thanks for tuning in to Sidecar Sync this week.
• 53:25
  Amith: Looking to dive deeper?
• 53:27
  Amith: Download your free copy of our new book Ascend Unlocking the Power of AI for Associations at ascendbookorg.
• 53:35
  Amith: It's packed with insights to power your association's journey with AI.
• 53:39
  Amith: And remember, sidecar is here with more resources, from webinars to boot camps, to help you stay ahead in the association world.
• 53:46
  Amith: We'll catch you in the next episode.
• 53:48
  Amith: Until then, keep learning, keep growing and keep disrupting.