Latest / The Learning Corner by Precursor / Episode #45: Hire the experimenters, Lessons from "failed" enterprise AI pilots, Valuations soar past the 2021 bubble
Transcript
- 0:00Right now, we're in the let a thousand flowers bloom, spend a lot of money, throw a lot of
- 0:05spaghetti against the wall and see what sticks.
- 0:06And that's normal when you get a new technology, but eventually, people have to find
- 0:10value.
- 0:11It's the week of August 25.
- 0:13Welcome to the Learning Corner of Precursor Ventures podcast.
- 0:20Welcome to the Learning Corner by Precursor.
- 0:22I'm Mia Farnam, and I'm joined by our GP and managing partner, Charles Hudson, where we will
- 0:27be talking through the articles and Goodreads that caught our team's attention over the past
- 0:32week.
- 0:32Our first topic is a piece written by Rebecca Caden from USB, making the case for founders
- 0:37and team leaders to hire the experimenters.
- 0:41This strategy varies greatly from the tried and true model of startup hiring when taking a bet
- 0:46on someone with a proven track record of success in a similar environment would nearly
- 0:50always win out as an option.
- 0:51Rebecca says that locating these experts lately has become incredibly difficult with the
- 0:56reality that expertise in something in today's AI world might not have existed as a concept
- 1:01six months earlier.
- 1:03She said, quote, underlying this change is a deeper shift in where knowledge lives.
- 1:08Increasingly, it's moving from our heads into large models and the tools they power.
- 1:12Access is no longer the constraint.
- 1:14Execution, speed, and creativity are the new moats.
- 1:18I think Rebecca did a great job summarizing the hiring conundrum facing founders today.
- 1:23Last week, we discussed how difficult it is to hire the obviously good founding engineer.
- 1:29This week, it feels like Rebecca is encouraging founders to broaden their definition of what,
- 1:34quote, unquote, good looks like in today's market.
- 1:37Was there anything else in particular that stood out to you from this piece?
- 1:40I also thought it was good advice for VCs too, not just for founders.
- 1:45If I think about the evolution of what I've seen happen in AI investing, I think in the
- 1:50beginning, everyone's like, oh, I know the answer.
- 1:53Let's go find people who have expertise in a vertical and then have them apply like, those
- 1:58people are gonna win.
- 1:59The, you know, the insurance AI company started by the person with tons of insurance
- 2:03experience.
- 2:03And then I think what people realized was like, well, maybe in this AI world, the context and
- 2:09experience in a category is maybe less relevant than it was in the SaaS world.
- 2:14And I think pre AI, that expertise was helpful because building things took a long time.
- 2:19And someone with previous experience would know what to build and what not to build and would
- 2:23have those relationships.
- 2:24And, you know, getting in the door at a lot of those enterprise places took relationships.
- 2:28And now with AI, lots of companies have big budgets.
- 2:32And so getting in the door even as a relative newcomer is easier than ever.
- 2:37I wouldn't say easy, but easier than ever.
- 2:39And I think the fact that most of the incumbent products didn't have AI capabilities as quickly
- 2:44as their customers wanted them also created an opportunity for newcomers to show up and just
- 2:48say, hey.
- 2:48I'm I'm new to dental.
- 2:50I'm new to pet care.
- 2:51Yep.
- 2:52But
- 2:52I've got this AI powered thing that can meet your needs.
- 2:54And so I think there's something comforting in VCs believing that, like, oh, the answer is
- 2:58just fund the people who already have the relationships and context in this industry, and
- 3:01they'll be the winners.
- 3:02And I think that hasn't worked.
- 3:04And then we've gone through various iterations.
- 3:06I think we've we've landed in this place where I think the answer is, like, nobody knows.
- 3:10Nobody knows what actually matters in terms of founder pedigree and attributes.
- 3:15And I think we've ended up in this world where I think most people believe the only investable
- 3:20moat whether it's at an individual level for keeping your job and getting promoted or as an
- 3:24investor investing companies, it seems to be that it's, like, execution and speed.
- 3:28And I'm just like, but how do you measure those things upfront?
- 3:31Right.
- 3:32Obviously, we have a point of view about how you can try to get your arms on it, but it's
- 3:35really, really tough.
- 3:36And that's a very different moat than we're used to.
- 3:38I think if you abstracted away AI and asked most investors, would you wanna invest in a
- 3:43category where there's very little technical differentiation, there's a lot of competition,
- 3:48and the only potential moat is speed of execution and ability to figure things out?
- 3:53Think most people would say that sounds like a hard way to make money.
- 3:56Well, was, like, my next question.
- 3:57Being able to take those quick turns and move with speed is just obviously critical for
- 4:02founders.
- 4:03How defensible can your company actually be if your current success is truly driven just by
- 4:07speed, which I know we talked about this internally.
- 4:09I don't think money equals speed equals success.
- 4:13Obviously, that equation breaks all the time, but in more obvious areas, specifically within
- 4:17AI.
- 4:18It feels like large amounts of capital allow you to try a bunch of things at once, and maybe
- 4:23you can make more mistakes.
- 4:24But it's still unclear what works, what doesn't, because we don't even know who the
- 4:27winners are.
- 4:27For the first time, I checked one of our portfolio companies who told me that they were
- 4:31making a pivot because they're in a regulated industry, and some of their customers were
- 4:36like, hey.
- 4:36Your competitor has raised a lot of money.
- 4:38At a minimum, we know they're gonna be around for the next two to three years.
- 4:42So if we work with them on this product, we don't know if it's gonna be any good, but we
- 4:46know that they'll be around.
- 4:47And I was like, that's like an actual tangible benefit of having a bigger but the the truth is
- 4:51it doesn't mean that that company's necessarily gonna build a great product.
- 4:55The money gives them a longer lease on life.
- 4:58Yeah.
- 4:58It means they'll be and it's interesting.
- 5:00In SaaS, in 2021, we ended up with a bunch of companies that had raised too much money
- 5:04relative to their ability to scale.
- 5:07And I wonder if the same thing's gonna happen in AI.
- 5:10We're gonna have a bunch of really well funded companies that don't have any idea what to
- 5:14build, or the premise that they started building against turns out to not be that
- 5:18interesting.
- 5:19I mean, I think about some of these Aqua license companies that we've seen That, you
- 5:22know, the the founding team members and early employees walked out the door, and those
- 5:27companies, I think, are searching for a second act or some amount of relevance.
- 5:30And are we gonna have a repeat of this sort of unicorn hangover where there's a bunch of well
- 5:35funded companies that are casting about for something to do but with a lot of cash on the
- 5:40balance sheet?
- 5:40And I assume because they have capital, they'll continue to make changes, keep pivoting,
- 5:44etcetera, because they have the room to do so, and so we'll continue to burn.
- 5:49I don't know if these companies that have tons of money will just reach profitability one day
- 5:53and be like, this is good enough.
- 5:54I think that they don't fall into that bucket that might find that route attractive.
- 5:58It's funny, Mia.
- 5:58I talked to one of our portfolio company founders yesterday, and he said, hey.
- 6:02I've raised this money.
- 6:03I'm trying to figure out what the next milestone is.
- 6:06And we went over this thing.
- 6:06I said, look.
- 6:07Nobody really knows in this environment.
- 6:09You need to grow really quickly.
- 6:11And I said, we're in this world where there are two binary paths for startups.
- 6:14One is try to hit the high growth venture playbook milestones.
- 6:19Hope it's enough to catch the eye of somebody and keep going, or be a rule of 40 company
- 6:25that's profitable and grows at a good rate and hope that you have something that feels more
- 6:29like a PE exit.
- 6:30That in between zone feels like a horrible place to be right now.
- 6:33And I told the founders that based on the money that you've already raised, you've already
- 6:36chosen a path whether you realize it or not based on the way you've capitalized the
- 6:39company.
- 6:40And so I don't think most of the investors in these really well funded companies want the
- 6:43money back either.
- 6:44So I think we're gonna end up in situations where there'll be companies that have raised a
- 6:48lot of money, don't have a clear idea of what to do.
- 6:50And I think the the VCs are gonna say, well, find something to do.
- 6:53That's your job.
- 6:54Fine.
- 6:54You raised the money.
- 6:55You have it.
- 6:56I would take it back in a pinch, but I'd rather not.
- 6:59I'd rather you find something worthy of the capital that you raised.
- 7:02Right.
- 7:02Because those companies are typically the ones that have raised at this larger valuation
- 7:06bubble, probably had the big announcement about it.
- 7:08It's a loss for a loss in quotation marks.
- 7:11For everyone involved from just a media standpoint if they decide, oh, we're actually
- 7:15gonna cool down and not go after this massive extreme exit that we promised everyone.
- 7:20I think people are also anchoring themselves in those roadmaps or those outcomes so much
- 7:24earlier.
- 7:24Gonna talk about more in one of our topics.
- 7:26But if you come in and your seed valuation is $70,000,000, then you've already decided, and
- 7:32you probably haven't even built traction yet, which is crazy.
- 7:35And I don't know whose fault like, I could point fingers at, like, so many different
- 7:37players in that dynamic.
- 7:39One thing I liked about Rebecca's piece is that I think she is calling founders to just make
- 7:44sure, like, your head is on a swivel always.
- 7:45If you find yourself reaching a dead end, be able to change quickly.
- 7:48And, actually, I find that that's been something that we've seen in our best founders
- 7:52throughout times, being able to kiss a bunch of frogs and move on quickly.
- 7:55That's been what separates people from success versus reaching these massive plateaus.
- 8:00It's also been nice.
- 8:01I feel like, especially in the SaaS era, we had gotten into startup creation by playbook.
- 8:06These are the metrics.
- 8:07This is the spreadsheet.
- 8:08This is the only way to do it.
- 8:10This is the only technique.
- 8:12These are the only marketing channels.
- 8:13And it was just getting really boring.
- 8:15Yeah.
- 8:16And I think it's terrifying but interesting that now there aren't actually that many
- 8:20playbooks for this era.
- 8:22And Saturn's always asking me, what's the playbook?
- 8:24I'm like, I don't know.
- 8:25You gotta go create it.
- 8:26Yeah.
- 8:26It doesn't really exist.
- 8:27People are, like, figuring this stuff out as they go.
- 8:29Pricing models for these companies that have raised tons of money haven't been figured out,
- 8:33and they continue to change every ten months, which is crazy and would have never happened in
- 8:37the SaaS world because the entire basis of that successful industry was based on the one
- 8:42pricing model that had worked.
- 8:43Well, for our next topic, this past week, MIT's Nanda initiative published a report analyzing
- 8:48around 300 generative AI deployments across enterprise customers.
- 8:52The study found that ninety five percent of pilots were failing to deliver on promises of
- 8:58ROI and revenue growth.
- 9:00Interestingly, the high failure rate wasn't primarily due to the quality of the AI models
- 9:04themselves.
- 9:06Instead, interviews with company leaders pointed to flawed enterprise integration,
- 9:10especially in bridging the learning gap for both tools and organizations.
- 9:14The data also highlighted a resource allocation problem.
- 9:16Over half of generative AI budgets were being directed towards sales and marketing rather
- 9:21than toward lower hanging fruit like back office automation.
- 9:24One standout finding, companies that purchased AI tools from vendors had a success rate of
- 9:29around 67%, while those that tried to build internally succeeded only about a third as
- 9:35often.
- 9:36So while the report highlights some successful deployments that make up the remaining five
- 9:40percent, it also notes that many surveyed companies were hesitant to share their failure
- 9:44rates.
- 9:45My question for you is how long do you think it will take for companies to realize that their
- 9:50investments aren't yielding returns, especially when so many are focused on building in house
- 9:54solutions?
- 9:55I read this, and I think I had a different take on this article than a lot of people.
- 9:59A lot of people, at least on social media that I saw, were like, I knew this was all a scam.
- 10:03I'm like, I don't think that's what I take away from this.
- 10:06What I take away from this is those failures are the seeds of future success.
- 10:11I build a lot of things internally using Cloud Desktop.
- 10:14Most of them end up not being that useful, but every not useful thing I've built has informed
- 10:20the next thing I've built.
- 10:21And so I think this is the creation process.
- 10:24And if you think about other tech waves, you've seen similar things.
- 10:27The technology comes out and people say, well, we've gotta own this capability.
- 10:30We're gonna do it ourselves.
- 10:31And frankly, in the beginning, there also weren't a ton of great vendors for some of
- 10:36these products.
- 10:36So I think the combination of some companies wanting to build and own the tech themselves,
- 10:41kind of relative immaturity from vendors, and probably overblown promises for what the tech
- 10:46could do.
- 10:47And, look, I'm sure some of these general AI pilots were just like, hey.
- 10:49Let's just have Chet GPT write all of our marketing copy.
- 10:52Unsupervised, untrained.
- 10:54Yeah.
- 10:54It's gonna it's gonna stink.
- 10:55This isn't surprising to me that people who were not skilled in using these tools, who were
- 11:00discovering them and applying them for the first time were largely unsuccessful.
- 11:05That is, like, not very surprising.
- 11:07The thing that I think is interesting is I'm sure all of those people who have failed
- 11:10projects, whether they admit to them as failures or not, learn something in the
- 11:14process.
- 11:15Either, hey.
- 11:16We shouldn't build this internally.
- 11:17We should go find someone who can provide this tool.
- 11:20Or, hey.
- 11:20We to your point, Mia, we went after sales and marketing, but there's a ton of customer
- 11:24support and other low hanging fruit on the cost side that we could tackle, and maybe that's the
- 11:30right place to start before we go here.
- 11:33Or gee, maybe we didn't succeed because we don't have the internal capabilities, but we
- 11:37want to have them.
- 11:37And we need to go find people to work at our company who have more familiarity with these
- 11:42tools.
- 11:43And I think the average employee in these companies has more familiarity today with these
- 11:47tools than they did whenever the survey was taken.
- 11:49So to me, this is a good sign.
- 11:52I think it's gonna make people take these AI deployments more seriously.
- 11:56It means they're gonna be more, I would say, circumspect around expectations.
- 12:00I think it means they will throw out things that aren't working, and they will invest in
- 12:04things that will.
- 12:05And to the extent that AI delivers on its promise, it's only gonna it's only gonna work
- 12:09when companies are getting real value from deploying the technology.
- 12:12And right now, we're in the let a thousand flowers bloom, spend a lot of money, throw a
- 12:17lot of spaghetti against the wall and see what sticks.
- 12:19And that's normal when you get a new technology, but eventually, people have to find
- 12:23value.
- 12:23How many CEOs of large enterprise companies understand that?
- 12:29And so at the end of the year, they might see these quote unquote failures, but then have the
- 12:33same perspective that you will and be like, continue to keep trying, continue to keep
- 12:36spending.
- 12:37I think the pressure from boards is going to continue because, you know I mean, this is
- 12:43silly.
- 12:44That means 5% of projects were successful.
- 12:46So if a 100% of projects had failed, the pressure to invest and squeeze value out of AI
- 12:53would maybe get turned down.
- 12:55I don't think that's gonna happen.
- 12:56I think the pressure's gonna stay on for CEOs and management teams to figure out where in
- 13:01their org they can be successful.
- 13:03And it might be that, like, hey.
- 13:04We swung for the fences and tried the revenue side.
- 13:06Let's build back some credibility by maybe working on the cost side.
- 13:10That ought to be lower hanging fruit, lower probability of failure.
- 13:13Let's get some wins on the board with AI before we try the more esoteric experimental stuff.
- 13:18And it seems like on the vendor side, that's been more of a successful route so far.
- 13:22If you were a startup founder, now taking a look at this data and knowing where people's
- 13:25pain points are, what could possibly be the pockets of opportunity that you might try to
- 13:30pitch to an enterprise customer that might be attractive to them?
- 13:33If I were a software vendor, I would really take this survey to heart because it means
- 13:38you're gonna walk into a lot of buildings where either an internal or external team
- 13:43overpromised and under delivered an AI related solution.
- 13:47Yeah.
- 13:48And so whereas maybe twelve to eighteen months, you would have walked into a very optimistic
- 13:54wide eyed audience.
- 13:55Now you're walking into an audience that might have some scar tissue, either from a vendor who
- 14:00overpromised and under delivered or from an internal initiative that was a failure.
- 14:05And so I think understanding the context of the company that you're walking into as a vendor is
- 14:10gonna become extremely important.
- 14:12If buying AI tools from vendors leads to higher success rates, with the market flooded with
- 14:16wrappers and surface level integrations, what signals should the buyers, so the other side of
- 14:20this, look to truly separate valuable products from ones that don't move the needle at all.
- 14:24I actually think it's okay if you're a vendor to say, I'm buying this product because I think
- 14:29for the next year, it's the best solution in my problem.
- 14:32And a year from now, I'm open to the idea that this problem will be solved in different way by
- 14:37a different vendor.
- 14:38And that's how I even at Precursor, that's how I approach all of the AI tooling.
- 14:42I look at them, like, for the next six to twelve months, this feels like a reasonable
- 14:45solution.
- 14:46But I'm prepared to throw things away in twelve months if there's a better way to do it Yeah.
- 14:51Or a different to do it.
- 14:52And take bits and pieces of things that we like from one and take that to the next vendor and
- 14:55say, like, I didn't like this, but I love this.
- 14:57Can you incorporate that?
- 14:58I remember once upon a time, I paid $10 a month for a tool that helped me with text generation
- 15:04using ChatGPT, probably ChatGPT three five or something.
- 15:08Mhmm.
- 15:08And now I'm like, well, I don't need the wrapper in between me and ChatGPT or Claude.
- 15:12I actually can just
- 15:13Right.
- 15:13Prompt it myself and do it.
- 15:15But there was a period of time where that was a helpful thing, but that opportunity was kind of
- 15:19ephemeral.
- 15:19And I think we're gonna continue to see these ephemeral things, which doesn't mean you
- 15:23shouldn't take advantage of them during the moment of time when they're valuable.
- 15:27Just don't get you attached to them.
- 15:28Well, our last topic is another insightful set of data from Peter Walker at Carta titled
- 15:32Startup Valuations on Steroids, where valuations across stages are categorized in
- 15:37buckets from low end, so, like, the twenty fifth percentile, to wild, which is the ninety
- 15:43fifth percentile.
- 15:44Yep.
- 15:44And then wow, which is the ninety ninth percentile.
- 15:47The wild column, so the ninety fifth percentile, looks quite similar to 2021, where
- 15:53the median valuation for seed stage companies hung around $72,000,000.
- 15:57However, the new wow column increased a 123% with median prices landing around a 161,000,000
- 16:06for seed stage companies at this ninety ninth percentile.
- 16:10Looking at the chart, the question that remains here is where will the strongest company
- 16:13service?
- 16:14Any additional thoughts on this data?
- 16:15Maybe more specifically also on the seed specific numbers too.
- 16:18I think Peter might be if we had a leaderboard, Peter's definitely number one or number two.
- 16:22None.
- 16:22Because it got me the Peter or honor.
- 16:25And, you know, Peter knows I'm a big fan of all his work.
- 16:27I just published our quarterly LP letter two days ago, and the opening paragraph was, this
- 16:33is the busiest summer I've had since 2020 or 2021.
- 16:38Take from that what you will.
- 16:39And I was like, I could replace not going on vacation because you're locked inside for COVID
- 16:45with not leaving your phone at home because you're worried you'll miss out on some super
- 16:49hot, expensive AI deal that's closing in six hours or some triple layered SPV into Anthropic
- 16:57that just came through on a WhatsApp group.
- 16:59This is a frenzy.
- 17:01It's funny, Mia.
- 17:02I feel like everybody I know at the GP level is like, this is insane.
- 17:05I'm like, it's insane, but we're all participating in the insanity.
- 17:09And we just went through this three or four years ago.
- 17:12I think we kinda know how this tends to end, but it all feels like a great idea until it
- 17:17ends.
- 17:18And I think there's a lot of people who are like, I'm going to be able to get out before
- 17:22the music stops, and I really hope they are right.
- 17:24Yep.
- 17:24And those valuations to me, they just don't leave a lot of room for companies.
- 17:29You know, there was an old saying when I got into venture.
- 17:31Was like, oh, that round is priced for perfection.
- 17:33If everything goes perfectly right, that price probably makes sense.
- 17:37These new rounds are priced beyond perfection in my mind.
- 17:40Like, it's not like, if everything goes right, these are reasonable valuations.
- 17:46My last question to close out is, from your perspective, does this kind of aggressive
- 17:50pricing reflect genuine progress and innovation at the company level, or does it speak more to
- 17:54investors' obsession with winning across the most competitive deals through increasingly
- 17:58aggressive term sheets?
- 18:00I think the biggest change I've seen in my entire career in venture over twenty years is I
- 18:05think founders understand how to manipulate VCs and VC attention far better than they did
- 18:12twenty years ago.
- 18:12And I think VCs have the capacity to pay higher prices for rounds.
- 18:17Richard Reason's one.
- 18:18The scale of outcomes has grown over time.
- 18:20Second, the funds are bigger.
- 18:22So at the margin, if you want your ownership, paying up to get it works.
- 18:26But I think founders are just more skilled at extracting higher prices from VCs because
- 18:31they've had more reps, and they better understand the model.
- 18:34And I think if you can convince VCs that your company is really hot and it's a deal that they
- 18:38will deeply regret missing on, you can have a lot of influence on the entry price, which is
- 18:43very different than the exit price.
- 18:45And I it's funny.
- 18:45I talked to one of our LPs this week, and he said, you know, like, I don't know that I feel
- 18:49that differently about you losing a million dollars on a $10,000,000 valuation versus
- 18:54losing a million dollars on a $100,000,000 valuation.
- 18:56You still lost a million dollars.
- 18:58And I was like, well, yeah.
- 18:59Well, when it doesn't work out, the price you paid doesn't matter.
- 19:02But when it does work out, the price you paid, just go look at the Figma waterfall.
- 19:07Look at the difference between what index got by being in at the seed and what everybody else
- 19:11got by coming in later.
- 19:13It's it is not trivial.
- 19:14So I think entry prices matter, but I also think being in really important companies
- 19:20matters.
- 19:20And I think not every important company starts off with a high valuation, and not every
- 19:25company with a high valuation is ends up being an important company.
- 19:28But we only usually talk about the things that are at the intersection of turned out to be in
- 19:31it, like, when Square raised its seed round and OpenAI.
- 19:35The companies that turned out to be important and raised at a high valuation end up being the
- 19:39thing that it's like the buoy that everybody hangs onto in the ocean.
- 19:42Of course.
- 19:42Yeah.
- 19:43Very few articles are gonna be written about the ones that raised in high valuations that
- 19:46kind of like went off into nowhere that we don't hear about.
- 19:48We're pretty good at bearing those is that copy?
- 19:51I don't remember.
- 19:51No.
- 19:51Yeah.
- 19:52No.
- 19:52Everyone just has a wonderful memory issue then.
- 19:54Well, thank you so much for joining.
- 19:56We are all out of time today.
- 19:57Thank you to our listeners for hopping in.
- 19:59Please like and subscribe, and we will talk with you all next week.
- 20:01Thank you.
- 20:02Bye.
- 20:03Bye.