Latest / CXOTalk / Data Wins! Inside the NFL's Analytics Strategy
Transcript
- 0:00Today we're speaking with Paul ba Lu, the chief data and
- 0:03analytics officer of the NFL about the League's use of data,
- 0:08analytics, and AI to optimize gain performance.
- 0:13Ensure player, safety improve fan engagement and increase
- 0:18revenue streams. Our guest co-host is Q Harrison
- 0:23Terry, the head of growth marketing at the Mark Cuban
- 0:26companies at the center of the journey always is, can you?
- 0:30Up organizations, do two things connect with their customers and
- 0:33our case, our fans better and more intimately.
- 0:35And then, secondly, can you improve your operations?
- 0:38And in our case that involves improving the game?
- 0:40So as I look at the journey that I've been on, it's interesting
- 0:44that I've gotten to this point. I have a deep love for sports
- 0:46deep, love for the game. And now, we're at a point where
- 0:50Sports in particular is focused on using data and analytics, the
- 0:53science that comes from data and analytics to accomplish those
- 0:57two goals. So very similar to my journey
- 0:59and Automotive Of my journey and financial services and Retail
- 1:02over the last three-plus decades.
- 1:05Now I get to talk about football, they do something.
- 1:06So on top of worrying about the technical side of my job, I get
- 1:10to talk about football. So you think about two wonderful
- 1:13things going on my passion for data and analytics, my passion
- 1:16for sports, put the two of them together and my days are quite
- 1:19interesting and to be honest, a lot of fun, one of the things
- 1:22that is exciting about that. But also acknowledges where you
- 1:25bent is In both retail Banking and now even Sports on the
- 1:31football side. You still have to worry about
- 1:33the consumer and what ways has the consumer experience, part of
- 1:37your job changed in and what differs now compared to even the
- 1:41previous parts of your career. So if you go way back, when
- 1:44because as Michael knows, I've been at this a long time, we
- 1:48really struggle to understand who you were and therefore how
- 1:52to connect with you in ways that are meaningful.
- 1:54I always like to say, we want to engage with you meaningfully in
- 1:57Text that is the right conversation with you that you
- 2:01want to have with us. So decades ago we just struggle
- 2:04because we didn't have the capabilities to do that.
- 2:06So we resulted in very coarse things that we did, we surveyed
- 2:10you, we tested things. Coarsely, we'd send a lot of
- 2:13things into your mailbox, not, you know, mailbox by the way,
- 2:16your actual postal code mailbox. Well today our ability to see
- 2:21and know and engage with you is driven by the fact that we have
- 2:25the assets from a data standpoint from an analytic
- 2:27standpoint. Point in an engagement
- 2:29standpoint, think about marketing technology and all the
- 2:32changes in the last decade and what the league embraced is.
- 2:35The fact that we, despite the success of the NFL, with the
- 2:38world changing in terms of how content is being consumed and
- 2:43who owns that relationship, we have to get in front of that.
- 2:46We have to, with the respect in the privilege of our fans, know
- 2:50them and engage with them in the way they want to be engaged
- 2:53with. So our largest initiative at the
- 2:55league from a data and analytic standpoint.
- 2:57It is our one to one program. And so, very similar to what you
- 3:01see with retailers or an automotive or in financial
- 3:04services. We're now focused on doing the
- 3:06same thing in other sports leagues, are getting there as
- 3:08well, because if you're going to be successful, you have to
- 3:12connect and the way fans want to be connected.
- 3:14And by the way, under the age of 40, they want to be connected
- 3:17even more differently than just turning on the game every
- 3:21Sunday. So, that's a big part of the
- 3:23journey we're on. And what I like about it is it
- 3:25really shows the power and leverages the power Or what it
- 3:28data and analytics organization can do, what is the role then of
- 3:33data and analytics in getting closer to the fans and
- 3:39addressing. Those customer experience goals
- 3:42that you were just describing. Our role is a significant one
- 3:45because in partnership with marketing and partnership with
- 3:48our clubs or media organization, we're providing the ingredients
- 3:52to bake the right souffle as I would describe it.
- 3:55We're responsible for bringing Together of that complete view,
- 3:59we're actually the first sports League that has aligned with our
- 4:02clubs to bring all of our data to fan on fans together in a
- 4:06systematic way. And that's a big step for Forks
- 4:09because it unlocks our ability to understand tens of millions
- 4:12of fans systematically and increasingly pretty close to
- 4:16real time. And then in working with
- 4:18marketing and media and other channels, we are driving those
- 4:22insights into the relevant conversations to those
- 4:26individual pans. And then of course, Measuring
- 4:28and constantly learning through the feedback loops, that's
- 4:32extremely important. Because once again, connecting
- 4:35with fans in a way that makes a difference in their relationship
- 4:38with us is how you deepen that relationship with us.
- 4:41We don't take for granted that we are the biggest Sports league
- 4:44in the United States. And you could argue the biggest
- 4:47in the world. We understand that going
- 4:49forward. It's about deepening that
- 4:51relationship. That's what great companies and
- 4:53what great organizations do. And you can't do that.
- 4:56If you don't see a no No, you can talk about how much you love
- 5:00your customers, but if you can't see and know and then act upon
- 5:03that information is problematic, so we're focused on everything.
- 5:06On the data side, systematically all the way from acquisition to
- 5:09governance usage, everything on the technology side, and then,
- 5:12of course, the analytics and the insights that get driven through
- 5:16that ecosystem. So, we're engaging in a way that
- 5:18makes a difference and it's to the credit of the commissioner
- 5:22and the credit of our owners they've embraced this because
- 5:25they understand that the future has more of a direct Consumer
- 5:28focus and all the fragmentation and media that's out there and
- 5:31we have to be prepared for it. We have a really interesting
- 5:35question from Twitter, very important question on this topic
- 5:41and this is from our Salon Khan and he wants to know how do you
- 5:44manage the Privacy aspects as you're addressing these?
- 5:49These customer experience goals Fan Experience goals.
- 5:53One of the pillars is our data governance organization, and we
- 5:56have a group Within that, that's responsible for consent, working
- 6:00with our legal team and the general counsel's of all the
- 6:02clubs. And we start off with our
- 6:05philosophy on consent and privacy and that is, we are
- 6:07going to be transparent. We are going to give our fans
- 6:10controls to express their preferences if they choose to
- 6:14do. So and their relationship with
- 6:15us. And then we're going to make
- 6:17sure that the privilege of having that data is used in a
- 6:21way that provides them value that we're not just doing it
- 6:25till we can carpet bomb Communications to their We're
- 6:28focused very much on making sure that the communications are
- 6:31relevant. That's the journey.
- 6:33We're on 20 years ago. When we started going down the
- 6:35path of data. Governance issues around privacy
- 6:38were very limited because we were in the early days of
- 6:41gathering transactional data assets on individuals.
- 6:45We're now at the point where it has to be one of the pillars of
- 6:47the overall strategy. And we're very proud of the fact
- 6:51that we made it a pillar. One of the four pillars of the
- 6:54strategy around 121 And every day we spend, Time on it.
- 6:58And every day, we're making sure we're doing it the right way,
- 7:01not only in the US, but globally because it's a complex journey.
- 7:04And by the way, if you don't do this right there are brand
- 7:07issues as well as compliance issues.
- 7:08And, of course, the NFL spends a lot of time, focusing on the
- 7:12brand side of it, Paula, one of the questions I have around that
- 7:15is centered or in the form of excess ability.
- 7:18Now, externally, I mean, you, you have your partner's in the
- 7:24clubs and they know how to, you know, manage the data into I'm
- 7:27not Listen not so much worried about it from that made but more
- 7:30so internally you've got a lot of Partners.
- 7:33You've got a lot of fans and you've got a ton of teams that
- 7:37you've got to manage. How do you make the data
- 7:39accessible internally and go about it in a way where it
- 7:44ensures near real-time visibility.
- 7:46So people have the right and sites but are doing.
- 7:48So in a way where you can win with the data, our approach is
- 7:53not only data governance, which is all about what we're doing
- 7:56and standardization. And data quality and access
- 7:59controls and so on. But we're focused in partnership
- 8:01with marketing on marketing governance, how are we using the
- 8:04data? How are you orchestrating it?
- 8:06And then analytic governance, which goes through the
- 8:08validation processes. So it sounds like a lot of
- 8:10governance doesn't have to be a government type governance
- 8:15program, but you have to have those elements in place and
- 8:18you've got to run this with that degree of discipline that you're
- 8:22we all believe in this. Theoretically this concept of
- 8:25democratization of data created. Everybody make it, everybody
- 8:29make sure everybody has access to it, but at the end of the
- 8:32day, you have to govern it appropriately.
- 8:34And that's not why we built. This whole ecosystem involving
- 8:37our clubs, by the way in that ecosystem, because there's 33
- 8:40entities at the NFL and you have to be able to orchestrate
- 8:45coordinate, understand what you're doing, or guess what
- 8:48happens. You everybody wants to
- 8:49communicate to everybody all the time, and that uncoordinated
- 8:53side of it, not only causes compliance issues, but the
- 8:56bigger risk and All that is that fans, start tuning, you out.
- 8:59Customers start tuning you out. And that's not what this all
- 9:02about. This is about deepening the
- 9:04relationship which by the way, leads you to things such as
- 9:08sometimes more is not better. The last is better in terms of
- 9:11your communication and that's all been built into the system.
- 9:14We're launching in the system we have developed in the last year
- 9:17or so be sure to subscribe to our YouTube channel and hit the
- 9:22Subscribe button at the top of our website so we can send you
- 9:26our newsletter and notify Of upcoming live shows.
- 9:29So a lot of your effort then is focused on that Fan Experience.
- 9:37You, you mentioned there are four pillars.
- 9:39Can you describe what those are? We support the league on every
- 9:42initiative player, health, and safety.
- 9:44Football operations, officiating media operations, media
- 9:48optimization. So we go across the entire
- 9:51league and while fan is a big part of what we do, all these
- 9:55other activities are equally as important because Our commitment
- 9:58is to help the league achieve its strategic objectives, which
- 10:01is to make the game better to maintain the Integrity of the
- 10:04game to make sure that our content is being consumed,
- 10:08efficiently and effectively. So it is very, very important
- 10:11that we look at it that way when you think about our structure,
- 10:15in terms of the fan cited it from a journey standpoint, it
- 10:19starts with data and clearly all the data management aspects of
- 10:23that, we then have a pillar around analytics and insights
- 10:27It's because once you have the ingredients question is what
- 10:30insights are going to generate and how are you going to
- 10:33continuously measure and track the robustness?
- 10:36Then we have the pillar around marketing technology and
- 10:39marketing governance and orchestration.
- 10:42And then the last pillar is privacy and consent and the
- 10:44related enabling capabilities. Because within that bucket, you
- 10:48also have identity resolution and related capabilities, you
- 10:52have to have if you're going to do this at scale, because when
- 10:55you think about the data, Exit. He's that.
- 10:58We're bringing in. It's pretty hard to govern.
- 11:01Systematically your relationship with an individual.
- 11:03If you can't know them. And to know them, you have to
- 11:06see them and you have to validate that they are them.
- 11:10Which by the way, is poor grammar, but you get the point
- 11:12that you go down that path. So think of it is a full
- 11:15ecosystem, that thing gets wrapped around the needs of the
- 11:20organization and then you execute off that ecosystem
- 11:23through your channels and that's related to the data that you
- 11:26have. So, you It's about like, how the
- 11:29breath of the data. But one thing I want to
- 11:31apartment point out in particular with the NFL's, the
- 11:33depth, like not only do you have pretty well.
- 11:37Structured information pertaining to the game's main
- 11:40gauge means that even the fans and the stadiums but you are in
- 11:44charge of one of the largest media events in the world.
- 11:48That is the Super Bowl. And as a marketer that is like
- 11:53one of the most fascinating times because everyone's tunde,
- 11:56right? And with that.
- 11:59What data do, I mean, you have to manage the data of the Super
- 12:02Bowl, right? Like you're one of my rod
- 12:04correct? Not.
- 12:05Yeah. So just to be clear.
- 12:06It is the largest event that one.
- 12:08Okay, it's the largest I could resist that because you know it
- 12:16is it is the largest of that 200 million viewers by the way and
- 12:21the Super Bowl has just concluded.
- 12:22So just seeing it just wrap your head around that.
- 12:25No other event gets anywhere. About 20 billion viewers other
- 12:29than our playoff games and Monday nights and Sunday nights
- 12:32and so on, it's a it's a wonderful question.
- 12:35So the breadth and the depth of the data we have is pretty
- 12:39amazing to tell you the truth. It's one of the situations where
- 12:43we're Gathering data from what bands are doing in stadiums and
- 12:48what they're doing with the clubs.
- 12:49But we also have relationships with the fans permissions, where
- 12:52we're getting the data from our partners.
- 12:54In terms of transactional relationships that we have, Have
- 12:57with those Partners. We also have a data development
- 13:00organization, that's constantly focused on what new data assets
- 13:04can we acquire and how can we bring them in?
- 13:08So we are, we're blessed with actually, the opportunity to
- 13:11have lots and lots of data from a breadth and depth perspective,
- 13:16the real challenge we have is like most organizations been
- 13:19around for a long time. That data was created for a
- 13:21specific use case and now we're trying to leverage it for other
- 13:25things to get this holistic picture.
- 13:28So a big part of our journey has been too.
- 13:30Can we bring the data together? Can we cleanse it?
- 13:33Can we standardize it? And we deal with the ability of
- 13:37properly. Associating it with an
- 13:38individual. So it's pretty pretty amazing to
- 13:41think about where we're at. It's also pretty amazing to
- 13:44think about where we're heading because we're still in the early
- 13:48phases and with the right permissions in place in the
- 13:51support from fans, what we're going to be able to build in
- 13:55terms of our version of a Walled Garden is pretty amazing.
- 13:59When you think of the tens of millions of fans that we can see
- 14:02and know because the passion for the sport is so high and with
- 14:06the right respect for Them, we can build very deep
- 14:09relationship, so it's great question, but and yes, the Super
- 14:13Bowl is the largest event. So I just said, maybe the World
- 14:16Cup every four years you could argue but wherever year just to
- 14:19be crystal, clear about that point.
- 14:22The Super Bowl is the one that's a qaq and I are having a good
- 14:26time. Me as a marketer, you know,
- 14:39that's the dream, right? You've Won event, 200 million
- 14:41people, that 200 worldwide, you have pop culture Sports
- 14:46entertainment, some of the best products, and partners that also
- 14:50coincide with this. And, you know, the second
- 14:54dissecting that data and then leveraging it to do it again the
- 14:58following year and then even sharing that with your partner
- 15:01to your team's, it's just a that's what's an incredible role
- 15:05where you're defining really the future of Most organizations
- 15:08because it's a reality now that most orgs can, if they want to
- 15:15obtain and build pretty large data sets, but how you maneuver
- 15:19said data set is like probably the most important thing and
- 15:24we're learning from you. Yeah.
- 15:25How do you leverage it? How do you bring it to life?
- 15:28I like my favorite expression is, how do you bring it to life?
- 15:31And so I'll give you a good example of this.
- 15:33We've been developing an alternative way of assessing how
- 15:36our content. Is being consumed in a
- 15:39fragmented media world. Not just looking at traditional
- 15:42measurements of TV, or even digital or streaming, but
- 15:46comprehensively, how is it being consumed through social media?
- 15:49How's it being consumed through PR Communications?
- 15:52How's it being consumed through legalized sports, betting, all
- 15:55of those things around it, and we had to do that, because of
- 15:59the fact that if you can get that data and understand the
- 16:02comprehensiveness of how your content is being really consumed
- 16:06it, Only shapes where you want to put your emphasis where you
- 16:09want to place your backs. What am I doing right?
- 16:11What else can I adjust in terms of by mixed?
- 16:14And that's been a fascinating Journey for us to go down.
- 16:17We've now validated and we have those Diagnostics to have
- 16:21another data set to understand what we see, we call it NFL as a
- 16:25platform but it's it's really this ability to see how our
- 16:29content is being consumed and how much time and individuals
- 16:32spending with us by the way, in the month of January in the u.s.
- 16:363 billion hours and Over three billion dollars were spent
- 16:40consuming NFL content in the United States just in one month,
- 16:43three billion hours. It's just you don't have a team
- 16:47that's that large that can ingest 3 billion hours worth of
- 16:50data. So like talk to us about your
- 16:52partner's, right? Like I remember just I study
- 16:55computer science so some of the more fascinating case studies
- 16:59early on with AWS actually we're with the dfl next-gen was the
- 17:04platform. Yes.
- 17:06Okay. So that project in particular,
- 17:10you all were first movers in a space that you didn't have to
- 17:14be. Is it because you need help
- 17:18processing the data or what's the what's the idea there?
- 17:22You know that it's always this great question of the ability to
- 17:25buy a, do you rent it? And when you're going through
- 17:29and the way I describe it is that the right ecosystem.
- 17:33Now is Lego blocks. So years ago when you were
- 17:36building The whole data and analytics and insight.
- 17:40Each block is a whole you get up in the morning and people think
- 17:44about it is as it used to be a guy have to go to one vendor.
- 17:48I'd have to go to one partner and you had closed systems and
- 17:51so on now it's an ecosystem and I approach it from a try to
- 17:55approach it from a Proto humility, where I get up in the
- 17:59morning. And I think about this in the
- 18:00context of I don't have all the answers.
- 18:02We're not going to build everything in house.
- 18:04So how can we at the end of the day?
- 18:07Leverage, our relationships with these great partners and AWS is
- 18:11a really good example. Great partner, the NFL next-gen
- 18:14stats is a big enabler for us and football, officiating,
- 18:19player, health, and safety. So the partnership with AWS is
- 18:23just a good example of us. Saying if there's a partner that
- 18:26can fit into the ecosystem and help us do two things, get
- 18:30smarter faster or fill a technology Gap.
- 18:34That's how we look at it and it's really the journey we're at
- 18:37it. For me, going over the last few
- 18:39decades. I think it's probably one of the
- 18:41biggest pivot Points. We don't spend enough time on is
- 18:44that the ability to piece together different parts of the
- 18:47technology stack. And that ecosystem has been
- 18:51transformed just in the last decade if we just pause and take
- 18:56that step back because again, even 2010 ish, we were still wet
- 19:01it to saying, my stack had to be ax and I was dealing with this
- 19:04set of vendors. Well, now take a look at anybody
- 19:07Buddies. Modern stack, it's the
- 19:09environments in the cloud. The software tools are eclectic.
- 19:13They're all over the place. My analytic platform can
- 19:16basically be just about anything, which is what we do
- 19:19today and all the piece parts are really coming together.
- 19:21So pretty fascinating. It's a to me.
- 19:24What you just asked is one of the critically important
- 19:27questions we as a field have to continue to stretch our thinking
- 19:32on because you know the day the were being asked to do two
- 19:36things generate insights. That are more precise and to
- 19:39take latency out of the equation, that's my version of
- 19:42Moore's law. By the way, if anybody plays
- 19:44around with that, I have rights to it.
- 19:46Because that was a concept. I came up with what any partner
- 19:49that helps us do that. We're going to be very
- 19:52interested. We have a very much related
- 19:55question from again, Our Salon Khan comes back and he wants to
- 20:00know how do you manage decision-making Based on data as
- 20:06opposed to gut? Feel when in any industry,
- 20:09there's a human tendency among the people receiving that data
- 20:14to, you know, rely on their own experience and intuition as
- 20:18opposed to trusting that data. So as you're working with
- 20:21decision-makers inside the league and at teams, how do you,
- 20:27how do you manage that aspect of it?
- 20:29It's something you. And I've actually talked about
- 20:31in the past and that is you have to have an orientation that it's
- 20:34going to be Art and Science and establish organizations.
- 20:37And that as you move towards science to just support more and
- 20:41more decision-making going towards, what we describe as
- 20:44model-driven, decisioning you have to bring them along through
- 20:49the Journey, you have to deal with the change management.
- 20:51The human dimensions of this, the transformational side of
- 20:54this. It's one of the reasons why
- 20:56within the field, you see many of us now, having business
- 20:59transformation functions or we have translators, or we have
- 21:03engagement managers because if you don't invest the time to do
- 21:07that, That these organizations are established and people are
- 21:11established. And the way they make decisions
- 21:14that old adage that people don't object to change, the objective
- 21:17being changed, is true in this case and that's an any
- 21:21established organization. So that's that to me Remains The
- 21:24Secret Sauce. I'm engaging with the business
- 21:26partners powering forward in a way where it's beneficial to
- 21:30them. Bringing them along to the
- 21:32journey. I can remember when I joined the
- 21:35league initially the You're pulling me aside and saying
- 21:40please educate us all the time and he understood that and I
- 21:45understand it because all the years I've been doing this, if
- 21:48you look at the early Legacy companies that had very large
- 21:52investments in data analytics, I had one of the largest when I
- 21:55was at GM for a decade. We had one of the largest
- 21:58organizations that we would consider to be a data and
- 22:00analytics organization. Now, we never got to full
- 22:04adoption of all the work we were doing because we underestimated
- 22:07the The need to change and have the change management component
- 22:11in the equation. There's a couple questions from
- 22:13Twitter and I want to I want to preface this question with the
- 22:17just the precursor element. Then it fills and Just Sports in
- 22:22general, I've changed. I mean MBA is filling this as
- 22:24well with the unbundling of the Gable package.
- 22:28Right. You know the regional Sports
- 22:29networks. They're not making enough money.
- 22:31They so there's there's there's possible bankruptcies that can
- 22:35into on that front and that's going to have an impact.
- 22:38On all of sports but more specifically like in this world
- 22:43where you're experiencing disruption what are the some of
- 22:47the shining stars that you're seeing on the horizon.
- 22:51So first our strategy is to have optionality and optionality
- 22:56because for anybody to call the ball ten years from now it's
- 23:00it's an interesting challenge. We've publicly stated multiple
- 23:03times that we feel very good. We have long-term agreements
- 23:06with our play Layers. We have long-term agreements
- 23:09with our distribution channels. That's great.
- 23:11It gives us time to make investments and prepare for the
- 23:13Future Part of the Investments and preparing.
- 23:16For the future is to have optionality and where you go and
- 23:19how your content is going to be distributed you to do that.
- 23:22Well though, you still have to make the game better all the
- 23:24time. You got to connect with fans
- 23:27because if you own the relationship with the fans and
- 23:29you're making the game better, then your optionality for how
- 23:33you distribute is better because who knows what the future holds.
- 23:37Pause. So you got to get the
- 23:38fundamentals, right? You have to be prepared for that
- 23:41for us. We've been experimenting on a
- 23:43number of fronts. You saw Amazon with Thursday
- 23:45night football, for instance, had a great first season.
- 23:48We proved that we could disseminate content through that
- 23:52channel, which is a page Channel at scale, 10 million viewers
- 23:56roughly every single week and we had some weeks.
- 23:58Well, above that, that's where we're at.
- 24:00And we're continuing to experiment and trying to figure
- 24:04out where this is going at the same time, what we're making I'm
- 24:07sure is that we can control as much of our fate is possible in
- 24:10the way you do. That is make the game great,
- 24:12which it already is, but make it Greater make it better.
- 24:16And then make sure you can connect with your fans.
- 24:18Thus the investment and data and analytics is a critical enabler
- 24:21to us having that control of our future do as much as we can.
- 24:26So with that Chris Peterson from Twitter, is asking the following
- 24:29question as far as disruptions on the horizon for the NFL in
- 24:35terms of either It's or control of all the data.
- 24:41How has the explosive growth of sports, betting change things
- 24:44for you all? It's a factor.
- 24:46Obviously, it's something that when you look at sports, we had
- 24:50to get comfortable with because you have to get comfortable with
- 24:53it because you don't want it to have negative repercussions on
- 24:56the game. What we've done is we've
- 24:59continued to focus on striking the right balance, making sure
- 25:01that it's the Integrity of the game is still there and making
- 25:05sure that we're complying with how its role Going out.
- 25:09Obviously it has business impacts because gambling
- 25:13organizations. They always be organizations are
- 25:15big advertisers and they're promoting and they're doing all
- 25:18those things that are there from a data.
- 25:20Analytic standpoint. We get lots of homework
- 25:23assignments, around making sure that we're tracking and
- 25:25understanding that there are no negative implications to me.
- 25:30I look at it is part of the overall puzzle of how we
- 25:33maintain the Integrity of the game.
- 25:36How we helped Tan because it's broader than us maintain the
- 25:39Integrity of the game or the future, but not a surprise that
- 25:44the world's there and not surprised that it continues to
- 25:46grow. And, and it's important to fans.
- 25:49When we look at the amount of activity, going around legalized
- 25:52sports betting in football. It's very, very high.
- 25:55We take a very large share of that in the season,
- 25:59disproportionate share of the LSB activities between September
- 26:02and January about three-quarters of it.
- 26:05And sports are going to football Paul.
- 26:07We have not spoken at all about the use of data and analytics to
- 26:14help improve team performance to optimize the team.
- 26:19The football tell us about that. That seems pretty pretty
- 26:23foundational. Yeah, it is and again as I said,
- 26:26when you think about data and analytics in a modern science,
- 26:28always think about a how am I connecting with my customer?
- 26:31My fans and then how am I improving my operation?
- 26:34So in automotive it was about quality and efficiency.
- 26:37And productivity and throughput in football.
- 26:40It's about improving the game and proving officiating,
- 26:42improving performance. So the way I always think of it
- 26:45is in my side of it, my team is focused around supporting
- 26:50officiating and officiating analytics, and Rule changes and
- 26:53we provide a lot of support to player health and safety because
- 26:56of the work streams, we have there, the club level, they all
- 26:59now, every Club, all 32 clubs has analytics within their
- 27:02football part of their organization.
- 27:05So you think about clubs they have a revenue Ooh, part of
- 27:07their organization, which they have data and analytics teams,
- 27:10which work, very closely with us.
- 27:12And then they have football teams or team members supporting
- 27:15the football side of their equation.
- 27:17And you see it, you see it in terms of football strategy, you
- 27:20see it, in terms of probabilities being used, think
- 27:23about the, everybody's now amazed at how often teams, go
- 27:26for it on fourth down. Well, that's driven by
- 27:28probability analysis. It makes more sense to go for it
- 27:31on fourth down than it does to punt.
- 27:34And so when we look back on it years ago, Can always remember a
- 27:38game between the paths and I think paying was still in
- 27:41Indianapolis at the time where I'll check win for it on
- 27:46somewhere around is 35 yard line in the fourth quarter and it was
- 27:50fourth and not one, it was more like fourth and six or seven and
- 27:53everybody was just appalled. Why did he go for it?
- 27:57And of course the reason he went for his, he knew if he gave the
- 28:00ball back to paintin, the probability of Peyton walking
- 28:03down the field and scoring was very, very high.
- 28:06So you can See that in the early days now it's systemically
- 28:10embedded in all teams and we'll see, more and more analytics and
- 28:14Technology being leveraged to continue, to improve the quality
- 28:18of the game, the Integrity of the game, the effectiveness of
- 28:22officiating, my team doing that for the league.
- 28:25On a day-to-day basis is we've got lots of things to do every
- 28:29single day. We're asked to do a lot on that
- 28:31front and it's actually one of the high points of my week is
- 28:35just all the things we're working on.
- 28:37On that front because it's really exciting to see how
- 28:40technology and data and analytics will continue to drive
- 28:43this great game and the excitement of the game.
- 28:47Because to the earlier question, that's how you prepare for an
- 28:50uncertain future. You excellent.
- 28:53On the things you can control and you create optionality in
- 28:56your strategy. And that's what it's all about.
- 28:58I do want to get into a few things.
- 29:01The first thing is generative AI, you've got a ton of data
- 29:05that you're collecting at scale. We're now here where consumers
- 29:10can participate in the experience of generative.
- 29:13AI, how is the NFL thinking about it?
- 29:15Especially in regards to the data that you have it's early
- 29:19days for us? But whether it's generative AI
- 29:21or what we're doing with ML type applications, part of it always
- 29:25comes down to what you see generative, AI being used for in
- 29:29that is either natural, language processing, type Solutions,
- 29:32insert call centers or fan engagement or interactions or,
- 29:36or so on. Or some derivative there.
- 29:39And I would say a large part of our Focus large part of my team
- 29:42sits there because that's the Journey of driving hyper and
- 29:47accurate responsiveness to a consumer.
- 29:49Having said that, when you think about all the things we're
- 29:53doing, and let's call it the advanced analytics field, not
- 29:56just generative AI, but you start looking at things like
- 30:00computer visioning and related technologies that work, we've
- 30:04been doing goes all the way from player health and safety support
- 30:08which we provide support to them and our external Partners on
- 30:11that front to sponsorship Effectiveness.
- 30:13We've been doing sort of all sorts of fascinating things to
- 30:17determine the value of Impressions and exposures and
- 30:21other things that go along with it and we're all that takes us
- 30:24is an interesting question because again, it always anchors
- 30:27back into the things you're trying to resolve.
- 30:29Can I engage with you more meaningfully, and can I provide
- 30:33support to our partner and or ourselves?
- 30:36So what they're doing? Operationally is having the
- 30:39right outcome so high on our list like everybody else the
- 30:43opportunities for more advanced analytics the opportunities for
- 30:48applying the science now at scale and cost effectively is in
- 30:51front of us going to be an interesting couple of years.
- 30:54We've got a whole Rd skunkworks team in my shop that's kicking
- 30:58around applications right now. Elizabeth Shaw from Twitter is
- 31:02wondering, you know, what are the few ways that you organize
- 31:05that data? And Think about it at scale,
- 31:09when we get up in the morning are organizing.
- 31:12Construct comes down to think of it as Three Rivers.
- 31:15So there's data around the individual insert fans, but
- 31:19could be businesses as well. So we're treating businesses is
- 31:22an individual entity. There's data that specifically
- 31:25tied to player health and safety, which is a very
- 31:28important area. Very sensitive area, by the way,
- 31:30because you've got a governor, you know, not only HIPAA, but we
- 31:34have the relationship with the PA that we Very closely on and
- 31:38then you have all the football data which includes things like
- 31:40NGS. So our governing construct is we
- 31:43think of it as those three big rivers and then we've got
- 31:46support for the rest of the organization, whether it's HR or
- 31:49Finance or so on. But those are the three big
- 31:51rivers and we take a similar approach with all three of them
- 31:55in terms of we think of data management as an end and process
- 31:58it goes from, what's your Source?
- 32:01What's your ability to ingest? And curate it scale?
- 32:03What your ability to integrate make it available, Leverage It
- 32:07and then what's the continuous process of enhancements and then
- 32:11all the enabling things underneath it.
- 32:12What is data quality processes or data standardization or in
- 32:16the case of damn data individual data identity resolution and
- 32:21consent. That's why we think of it and I
- 32:23encourage anybody when you think about data and data management,
- 32:27always anchor back to the business, use cases and needs
- 32:31and The Logical construct that goes along with it because
- 32:34usually what you're faced with is you're trying to bring data.
- 32:37Transactional applications where the data was not designed to
- 32:42support your broader integrate, use cases.
- 32:45It was designed for a specific transaction.
- 32:47So if you think about a CRM application that data is
- 32:51specifically there to generate an outbound communication.
- 32:55And now we're saying we're going to use all that data to
- 32:58integrate into get to this complete view of an individual.
- 33:01That's the right way to do it when you were talking earlier
- 33:04about your ecosystem, it seemed that That was also very much
- 33:09implied. That everything you think about
- 33:12you, do? You plan is about that scale,
- 33:17ultimately, for a data and analytics organization.
- 33:20You ask yourself three questions in my mind, is it repeatable is
- 33:24it scalable and as a government and then you get into,
- 33:28obviously, the related things of?
- 33:30Does it add value to the organization and those sorts of
- 33:32things? But if you're going to do this,
- 33:34with Maximum Impact repeatability, Adders and then
- 33:38going right along with repeat abilities.
- 33:39Can I scale it? And then the third piece to this
- 33:42is because of the scale of the impact.
- 33:45We're now having you have to properly, govern it.
- 33:48Oh, by the way, you go back three-plus decades ago when I
- 33:51started, we didn't have any of those concerns because our data
- 33:55sources were all your day nor established and very structured
- 34:00situations. They were government statistics
- 34:02or they do US Census or they were marketing research,
- 34:05surveys. So the Questions around
- 34:08scalability or governance were not really questions for us
- 34:12because we didn't have those issues.
- 34:14We were dealing with things that were so structured to begin
- 34:18with. The US Census been around since
- 34:201790 and there's actually data from the US Census from 1790
- 34:25most economic statistics on the US, are out there from 1949 on
- 34:31and the construct of the data has been preordained for all of
- 34:35us and oh by the way, the governance of it Is what are you
- 34:37worried about? The data from You're a labor and
- 34:40statistics has no restrictions in terms of usage, now you can
- 34:45misinterpret it, which is a separate issue, but then we get
- 34:48into the 90s and then suddenly the world changes on its head
- 34:52because For the First time, we're able to capture
- 34:55transactional data at scale or observational data at scale, and
- 34:59then the whole world opens up to us around, can we manage that
- 35:03data? Can we govern it?
- 35:05And not surprisingly, it was only in that period of time that
- 35:07governance really started to take off.
- 35:09Off both in terms of standardization quality as well
- 35:12as access controls. So that's a little bit of a
- 35:15history lesson for everybody, but when you think about it, go
- 35:18down that path and then you go out the next five to ten years.
- 35:21And you say what's next? Well, what's next is the next
- 35:25generation of that is, is an even faster, leap, or bound,
- 35:29because the ability to make sense of it with limited latency
- 35:34is the next big Horizon for all of us.
- 35:36We have a couple of questions from Twitter and I'm going to
- 35:39Ask you to answer these quite quickly because we're simply
- 35:43going to run out of time. So the first one again from our
- 35:46Salon con is it's an interesting one.
- 35:49Do all teams have the same resources to collect manage and
- 35:54share their data. No.
- 35:57So we are see variability by all 32, but all 32 are making
- 36:03substantial investments in this area and then related to that.
- 36:07What is your actual Ation ship with the team.
- 36:11So you work for I was going to say Central HQ, but that's not
- 36:15right. The team is might have an issue
- 36:18with that. Rises it a Trade Organization.
- 36:20So that's probably the right way, but we were closer
- 36:23relationship with all 32 clubs. There are in essence, our board
- 36:26of directors, and from a data and analytic standpoint.
- 36:29It's an incredibly close working relationship.
- 36:31They leverage us for a set of capabilities and services.
- 36:36They leverage us to help Drive And then within the fan
- 36:41environment, we are the organization.
- 36:43That's brought all the data and analytic capabilities together
- 36:46that all of them, consume and then another one from Twitter
- 36:49from Chris Peterson who says how do the multi-use stadiums and
- 36:55their Data Systems including Wi-Fi and cellular access
- 37:01points, steer data to the NFL during game.
- 37:06So I think what he's asking is as the The data is Flowing
- 37:10around the stadium. How do you guys get it?
- 37:13Yeah. Actually it's the club's
- 37:14responsibility at that point in time and then there are specific
- 37:17data elements that the club share with us all visible and
- 37:22transparent to the fan and and all properly governed.
- 37:26So that again that governance is a is a crucial aspect governance
- 37:31governance governance. If anybody's trying to set up a
- 37:33data and organization from scratch, I encourage you to
- 37:35start with data governance. Love it Paul.
- 37:39Have to do this. You probably are going to expect
- 37:42it. Your you probably thought you
- 37:43were in the green and you you're going to get away on Skate.
- 37:47I'm going to ask you to tell a data story and that data story
- 37:50is going to be about one big moment that happened this year.
- 37:53And that was the fact that you had Rihanna as the halftime
- 37:57performer in the Super Bowl. Did the floor is yours?
- 38:00I just looking for data story on that.
- 38:02Well, it's interesting because halftime shows historically have
- 38:06given us pop in terms of viewership.
- 38:09We track that very closely, and we track.
- 38:12Wow, it's giving us pop. So, I've got all the data and
- 38:15yeah, but she did a great job and we got substantial lift, you
- 38:20saw the 200 million viewers and, and the tracking that we've
- 38:24released recently well soon. See, all of that.
- 38:26As we saw last year, we had about twenty six million
- 38:29additional viewers. We estimate that came in for the
- 38:31halftime show on top of 208 million viewers overall.
- 38:35So we look at all of them. We share it with the companies
- 38:38that are working with. Some talk about it and see what
- 38:41insights we have. We spent a lot of time.
- 38:43Looking at what else we can do to drive more viewership and
- 38:46more energy and more positivity. So it will all it's all getting
- 38:50examine reviewed top to bottom, but this year's Super Bowl was
- 38:57an A+. And the data is confirming that
- 38:59it was an A+ than just like last year with an A+, wait, an
- 39:02exciting game and tastic. See, you had weakened the fault
- 39:07of the following, you heard the previous year, and then you had
- 39:09Rihanna the following year. The question I have there is
- 39:12like there was also covid the covid elevate, your data
- 39:17collection abilities, because it seems like post covid.
- 39:19You've just nailed it. I would say, post covid and
- 39:23everything going on with the league, prompted us to make some
- 39:28additional Investments and data analytics is one of them.
- 39:32So, if you look at the last couple of years, coming out of
- 39:35covid, we did a lot of data collection and covid, because we
- 39:38had 22. Maintain Health, as well as keep
- 39:41the game going. And that was important for us.
- 39:44But covid, as well as other things are probably a forcing
- 39:48factor for us to put more emphasis and the area that I'm
- 39:51fortunate enough to be responsible for, but there's
- 39:54other things going on as well. The fragmentation of media and
- 39:57how content is being consumed. Those are really, really big
- 40:00forcing functions for us as well because to the credit of the
- 40:04commissioner and and the senior officers of the league, they are
- 40:08being forwarded. Word leaning.
- 40:10And there's a heightened state of let's be prepared for the
- 40:13future and not just rest in our current success.
- 40:16So as we finish up, can you talk to us a little bit about where
- 40:22this future is going? And I'm particularly interested
- 40:26in this to use an old term multimedia environment that we
- 40:32live in. So, maybe talk to us about any
- 40:36aspects of that, it's exciting as you and I have talked about
- 40:39For my day-to-day job is incredibly eclectic everyday is
- 40:43interesting because there's something new and exciting and
- 40:45player health or is a lot going on officiating.
- 40:48And course, all the fan work, but an area that really piques.
- 40:51Our interest is the current and future state of how content is
- 40:54being consumed and why that's important for us is, we want to
- 40:59understand this better. We want to understand this
- 41:01better, so we can share with our partners and help them activate
- 41:04their relationship with us better.
- 41:07All the partners and sponsors. We want to share it to Make sure
- 41:09that the things were investing in and putting emphasis on or
- 41:12driving, so, think about fantasy football, for instance, or all
- 41:16the things we're doing on social media and then it also gives us
- 41:19the opportunity to be out in front of where things may pivot
- 41:24and try to get as much of an early warning on that as
- 41:27possible. So early days, but very exciting
- 41:30for us. We feel very fortunate that
- 41:32we've been able to crack that code a bit.
- 41:35And and cracking that code, we're spending a lot of time
- 41:38with ourselves in the Figuring out what we can do with it.
- 41:41Because, again, big question is, can you bring it to life?
- 41:44It's great to have the science, the science.
- 41:47When you're in a business setting has to add value.
- 41:50Well, one thing before we go, I want to thank you for
- 41:54leveraging. All of the best technology from
- 41:59across the world really and bringing that to create a
- 42:02cohesive experience. I mean, one example that I've
- 42:05seen just in my few years as a fan is The NFL is one of the few
- 42:10places where you can get the best out of Amazon.
- 42:13Google Apple in many more to way too many for me to name and
- 42:17that's not true. Anywhere else in maybe I do like
- 42:21that about that info as a techie, it is quite a blessing,
- 42:25our partners like working with us.
- 42:28And as we like to say, we like working with them and it's been
- 42:32an enjoyable, part of my role coming in because of the
- 42:35technology side of my job and I external technology, Those are
- 42:39great to work with quick. Question under the wire before
- 42:43we go from Twitter. Do some people consider
- 42:47governance as just another form of red tape?
- 42:51One of the favorite stories I like to say about governance is
- 42:54my first leader and data governance, which is almost 30
- 42:57years ago, when I put her in the role.
- 42:59She spent. She's tell me these stories.
- 43:02You'll probably spend 100% of my time explaining to people that
- 43:05I'm not the police. We're really what she was about
- 43:08was to make We had standards and consistency, and we're using
- 43:12data appropriately, which actually opens doors for people
- 43:15to leverage data, the exact opposite.
- 43:17So, somewhere down the road, maybe we'll change the language
- 43:21from governance because it does sound like, it's some type of a
- 43:25police action versus. It's an enablement action.
- 43:28And if you do it right, it's all about enablement.
- 43:31And on that note, unfortunately, we're out of time.
- 43:35I want to say a huge. Thank you to Paul ba Lu from the
- 43:39National Football League. Thanks, thank you so much, Paul,
- 43:42for taking your time to be with us today.
- 43:44You're welcome. Michael is great to see you.
- 43:47And I also want to say a huge thank you to Q Harrison Terry
- 43:52for being the co-hosted. A queue is a really interesting
- 43:55discussion, it was and I'm always excited to be here.
- 43:59Thank you for having me and Paul has been a pleasure and
- 44:03everybody. Thank you for watching.
- 44:05Especially those folks who asks such excellent questions you
- 44:08guys are such great. Audience.
- 44:10You guys are very smart intelligent sophisticated.
- 44:12So always ask those questions. Now before you go, this is
- 44:17important. Be sure to subscribe to our
- 44:21YouTube channel and hit the Subscribe button at the top of
- 44:25our website so we can send you our newsletter and notify you of
- 44:28upcoming live shows. Thank you so much everybody.
- 44:32I hope you have a great day and we'll see you soon.