Latest / What's Your Problem? / Teaching Computers to See
Transcript
- 0:15Speaker 1: Pushkin.
- 0:21Speaker 2: Over the past year, we've heard a lot about artificial
- 0:24Speaker 2: intelligence models that are really good at manipulating language. We've
- 0:28Speaker 2: heard somewhat less about AI that deals with images. It's
- 0:33Speaker 2: called computer vision, and it's a huge deal, which you
- 0:36Speaker 2: know obviously. Like language, vision is this core part of
- 0:40Speaker 2: the experience of being human, And on a more practical level,
- 0:45Speaker 2: computer vision is key for self driving cars, and for
- 0:48Speaker 2: drones and for all kinds of industrial robots. As it
- 0:52Speaker 2: turns out, there was this one key moment in the
- 0:56Speaker 2: development of modern AI, for both vision and language, and
- 1:00Speaker 2: if you understand this moment, you understand a lot about
- 1:03Speaker 2: how AI works today. I'm Jacob Goldstein. This is What's
- 1:13Speaker 2: Your Problem, the show where I talk to people who
- 1:15Speaker 2: are trying to make technological progress. My guest today played
- 1:20Speaker 2: a central role in that key moment in AI history.
- 1:23Speaker 2: Her name is faith A.
- 1:25Speaker 1: Lee.
- 1:26Speaker 2: She's a Stanford computer scientist, the author of a memoir
- 1:29Speaker 2: called The Worlds I See, the former chief scientist of
- 1:33Speaker 2: AI and machine learning at Google, and just generally one
- 1:37Speaker 2: of the most important innovators in the history of computer vision.
- 1:41Speaker 2: I started our conversation with really a pretty general question.
- 1:45Speaker 2: I asked Fay fe just to explain what computer vision
- 1:48Speaker 2: is and why it's so important.
- 1:53Speaker 3: So computer vision is about enabling computers and machines to
- 1:59Speaker 3: have visual intelligence. What is visual intelligence? Well, the best
- 2:06Speaker 3: example comes from humans who are extremely visually intelligent animals,
- 2:13Speaker 3: So that we can make an omelet by knowing what
- 2:18Speaker 3: is in our fridge. How do we go and take
- 2:21Speaker 3: the egg out, how do we take the tomato out?
- 2:24Speaker 3: How do we plan the cooking of the omelet? How
- 2:29Speaker 3: do we interact with every ingredients, and how do we
- 2:33Speaker 3: understand all the changes of the objects and all this
- 2:39Speaker 3: is part of visual intelligence.
- 2:41Speaker 2: Yeah, I mean you write in your book that vision
- 2:43Speaker 2: isn't just an application of our intelligence, it is synonymous
- 2:47Speaker 2: with our intelligence, which is something I want to talk
- 2:50Speaker 2: more about. But before we get into human vision and
- 2:53Speaker 2: how that led you into computer vision, just give me
- 2:57Speaker 2: a sense of some of the applications, both the current
- 3:00Speaker 2: applications of computer vision and potential future applications of computer vision.
- 3:06Speaker 3: In fact, we're already using computer vision to do a
- 3:09Speaker 3: lot of things. The most obvious example is all kinds
- 3:14Speaker 3: of driver's assistant programs. Right, we're not having even about
- 3:18Speaker 3: self driving cars. We're talking about lane detection or talking
- 3:22Speaker 3: about avoiding curb sized pedestrian alert. You know, we are
- 3:28Speaker 3: using computer vision in our healthcare system, in radiology, in pathology,
- 3:34Speaker 3: or you know, in protecting of species. A lot of
- 3:40Speaker 3: the camera traps in the in the deep forests are
- 3:45Speaker 3: using computer vision to track to track different animals. So
- 3:50Speaker 3: we're using computer vision already on a daily basis.
- 3:54Speaker 2: And then when you dream of some applications that are
- 3:57Speaker 2: not here yet but that might be here in whatever
- 4:00Speaker 2: five or ten years, what do you think of what's
- 4:02Speaker 2: at the top of the list.
- 4:04Speaker 3: So when I dream of computer vision, I dream of
- 4:07Speaker 3: all kinds of robotic application, so from self driving car
- 4:10Speaker 3: to personal robots using computer vision. I dream of our
- 4:14Speaker 3: biodiversity being mapped using computer vision. I dream of exploration
- 4:20Speaker 3: using computer vision.
- 4:21Speaker 2: Wonderful. So I want to talk about your work in
- 4:25Speaker 2: computer vision, which goes back well decades now, and I
- 4:31Speaker 2: want to start with work not on computers actually, but
- 4:37Speaker 2: on human beings right, on understanding of how humans process
- 4:45Speaker 2: visual information, right, how we make sense of what we're seeing.
- 4:48Speaker 2: And in the book, you write in particular about this
- 4:52Speaker 2: nineteen ninety six paper with a boring name that was
- 4:57Speaker 2: a huge deal. It was called speed of processing in
- 5:00Speaker 2: the human visual system. Tell me about that paper and
- 5:04Speaker 2: what it meant.
- 5:05Speaker 3: It's a paper of using EG, which is recording electrical
- 5:11Speaker 3: brain waves to make a link between how fast can
- 5:17Speaker 3: humans make a very complex visual decision when they sees something,
- 5:22Speaker 3: And the particular decision humans were to make is to
- 5:28Speaker 3: separate images from images containing animals and images not containing animals.
- 5:34Speaker 3: And if you think about the pool of possibilities is
- 5:38Speaker 3: extremely complex. It's actually mathematically just an infinite possibility because
- 5:45Speaker 3: there are so many different types of animals, so many
- 5:48Speaker 3: different different types of non animals. That's infinite for practical purposes.
- 5:53Speaker 3: And then you put them in photos, you can get
- 5:56Speaker 3: infinite possibilities of photos. Yet you show them one by
- 6:02Speaker 3: one two humans they make decisions really quickly, and they
- 6:06Speaker 3: make correct decisions really quickly.
- 6:09Speaker 2: That really quickly, but like mind bogglingly quickly at the time, right,
- 6:14Speaker 2: it was shocking just how fast it was, right milliseconds.
- 6:18Speaker 3: Yeah. So the thing is we kind of sort of
- 6:22Speaker 3: know we're good at see, right as a species. We
- 6:26Speaker 3: know we open our eyes we see the world, but
- 6:29Speaker 3: we don't really know how good and how fast.
- 6:33Speaker 2: And this is we underestimate. It's it's a rare case
- 6:35Speaker 2: where human beings underestimate ourselves exactly.
- 6:38Speaker 3: This is a rigorous scientific study put a time, actual
- 6:44Speaker 3: time to that speed of visual intelligence, and it's using
- 6:48Speaker 3: modern technique. It's very smart and very very exciting.
- 6:54Speaker 2: What did it mean to you when you saw that result?
- 6:58Speaker 2: When you read that paper?
- 7:00Speaker 3: When I read that paper, it means north star. Let
- 7:03Speaker 3: me explain what does north star mean? As north star?
- 7:07Speaker 2: Okay?
- 7:07Speaker 3: Yeah, As a scientist, I'm driven by finding answers to
- 7:12Speaker 3: the most audacious question. But as high Einstein has said,
- 7:18Speaker 3: in science scientific inquiry, the hardest job is not finding
- 7:24Speaker 3: solutions asking the right question because you you know, when
- 7:30Speaker 3: you like we talk about visual intelligence, it's such a
- 7:33Speaker 3: vast topic. What is the topic to pursue? What is
- 7:37Speaker 3: the question to ask that is fundamental to visual intelligence?
- 7:42Speaker 3: And how do we unlock it? When when we read
- 7:45Speaker 3: that Simon Thorp paper, it convinced me that complex object categorization,
- 7:54Speaker 3: the ability to classify you know, animal versus no animal,
- 8:01Speaker 3: chair versus you know, table, hot dog, hot dog versus hamburger.
- 8:07Speaker 3: You know, this is fundamental told to humans. It's a
- 8:10Speaker 3: building block of visual intelligence. Is it has a neural
- 8:15Speaker 3: correlate in human brain that shows how evolutionally evolutionarily optimized
- 8:23Speaker 3: it is. So with all that evidence, it comments me
- 8:28Speaker 3: object categorization is a north star to pursue.
- 8:32Speaker 2: And you were a grad student at the time, right,
- 8:35Speaker 2: this is sort of the thing and any ambitious grad
- 8:38Speaker 2: student that's going to be doing it's like, I know,
- 8:40Speaker 2: I'm interested in this field, but I need my question,
- 8:42Speaker 2: I need my thing, right, And so now you've got
- 8:45Speaker 2: your thing, yes, and it's categorization in particular. And you
- 8:49Speaker 2: describe how earlier theories of how humans process visual input
- 8:56Speaker 2: was not so categorization focused, right. It was kind of
- 8:59Speaker 2: like if you just sort of thought from first principles,
- 9:02Speaker 2: you would think, well, we see color and we see
- 9:04Speaker 2: shapes and then we kind of make sense of it.
- 9:06Speaker 2: But with this paper and related work, it show is
- 9:09Speaker 2: like that's actually not it, right, and in fact our brains.
- 9:13Speaker 2: You write about how there are specific regions of the
- 9:15Speaker 2: brain like this region is just face, the face categorization region,
- 9:19Speaker 2: and this region is the like place as we go
- 9:21Speaker 2: all the time region And so it's a really different
- 9:24Speaker 2: and interesting way of thinking about seeing, and it's fundamentally
- 9:29Speaker 2: about just incredibly quickly putting things into categories. And so
- 9:35Speaker 2: you decide to take this idea of vision and categorization
- 9:39Speaker 2: and try and figure out how to how to get
- 9:43Speaker 2: computers to do this, right, how to get computers to
- 9:45Speaker 2: be able to categorize objects from the world. And you
- 9:53Speaker 2: start building these data sets essentially of labeled images, right,
- 9:58Speaker 2: And you build what seems in retrospect like a relatively
- 10:01Speaker 2: small one at Caltech, and then you decide to build
- 10:04Speaker 2: a really big one. Right. It comes to be called
- 10:07Speaker 2: the image net. It's a thing you're famous for, NERD
- 10:10Speaker 2: famous for, And I want to talk about building image net, right,
- 10:15Speaker 2: So tell me about deciding to build what becomes image net.
- 10:19Speaker 3: So the image net is the north Star. To me,
- 10:25Speaker 3: I was in the field long enough because I finished
- 10:28Speaker 3: my PhD, I started my own lab. I had this
- 10:32Speaker 3: unwavering faith and believe that, you know, unlocking object recognition
- 10:39Speaker 3: is part of the north is a north star, is
- 10:42Speaker 3: a critical north star. And I became impatient because I
- 10:45Speaker 3: realized we were not making enough progress. I realized that,
- 10:51Speaker 3: especially algorithmically, we were like running in circles a little
- 10:55Speaker 3: bit of optimizing very small algorithms that are not really
- 11:01Speaker 3: getting to the essence of the problem, and part of
- 11:05Speaker 3: the essence, which a lot of people overlooked, is actually
- 11:09Speaker 3: the scale of the problem. What was really bothering me
- 11:13Speaker 3: is that we were not seeing the problem. We're not
- 11:17Speaker 3: seeing the mathematical problem with the scale thinking, because it's
- 11:21Speaker 3: not just about being big. It's about the mathematical reason
- 11:27Speaker 3: of why we should go big, and it's it's a
- 11:31Speaker 3: very deep reason in general, it's a reason for what
- 11:35Speaker 3: we call generalization. You have to learn enough to be
- 11:39Speaker 3: able to see everything and that minds You've got.
- 11:43Speaker 2: To see a lot of pictures of things that are
- 11:45Speaker 2: cats and not cats to understand what.
- 11:47Speaker 3: Is right that that mindset was just not you know,
- 11:53Speaker 3: that's a big data mindset. It was not in the
- 11:57Speaker 3: world at all at that time.
- 11:59Speaker 2: So how did you get there? How did you Because
- 12:02Speaker 2: what you end up doing is building this just gargantuan
- 12:06Speaker 2: uh thing full of labeled images, bigger than anybody'd ever
- 12:10Speaker 2: built before. Like, how did you arrive at that?
- 12:12Speaker 3: That's a great question. I think that's actually the most
- 12:15Speaker 3: fun but difficult part of the book to write, is
- 12:18Speaker 3: you know, like dig in to my own brain. In hindsight,
- 12:24Speaker 3: it's just little by little the insight and the realization epiphany,
- 12:30Speaker 3: But honestly, I don't know how to analyze my own brain.
- 12:33Speaker 3: I had the mathematical intuition that scale makes a difference,
- 12:40Speaker 3: bigger difference than most people give credit to. I also
- 12:44Speaker 3: had the neurocognitive science inspiration that early human development was
- 12:51Speaker 3: exposure to the world in continuous ways. We don't like
- 12:55Speaker 3: lock the baby in a dark room and show them,
- 12:59Speaker 3: you know, one hundred cats. They just go out and experience.
- 13:04Speaker 3: You know that experience is actually driven by big data.
- 13:09Speaker 3: Maybe I was also inspired by this Internet age coming
- 13:13Speaker 3: our way right like that part, I do think it's
- 13:16Speaker 3: a little bit moment of just being alone, and somehow
- 13:22Speaker 3: all the stars aligned in my head. I decided I'm
- 13:27Speaker 3: going to try the craziest thing, and I did have
- 13:33Speaker 3: a faith and believe that it was the right thing
- 13:36Speaker 3: to do.
- 13:37Speaker 2: And specifically, like, what was this thing that you were
- 13:39Speaker 2: going to build?
- 13:41Speaker 3: I'm gonna get the entire Internet of images, consisted of
- 13:47Speaker 3: all the objects I can get my hands on that
- 13:50Speaker 3: humans have ever taken pictures of and catalog them in
- 13:55Speaker 3: a gigantic, big database. And I will use that to
- 14:00Speaker 3: do two things. To train machines to recognize the entire
- 14:05Speaker 3: world of objects, and also to benchmark everybody's progress. You
- 14:11Speaker 3: know everybody, I mean the international community of computer vision scientists.
- 14:15Speaker 2: So you will have this database and then everyone can
- 14:18Speaker 2: train their computer vision models on your database and see
- 14:21Speaker 2: how they do on new images.
- 14:23Speaker 3: Yes, so.
- 14:25Speaker 2: You have to decide. There's this interesting part of the
- 14:28Speaker 2: book where you're like, Okay, I want to build a
- 14:29Speaker 2: database with everything in it. How many categories of everything
- 14:34Speaker 2: are there? Right, somebody's actually done that research. If you
- 14:37Speaker 2: take all the things, how many kinds of things are there?
- 14:41Speaker 2: What's the number?
- 14:43Speaker 3: The number is the Beaderman number, and the Beierman number
- 14:48Speaker 3: is a I'm proud of really giving professor or Piederman
- 14:54Speaker 3: that credit. Yeah, nobody noticed that number. He wrote. He's
- 14:59Speaker 3: a cognitive scientist who wrote it very very good, But
- 15:03Speaker 3: I don't think it's a famous paper in the nineteen
- 15:06Speaker 3: eighties guestimating or estimating with the back of the envelope
- 15:12Speaker 3: computation of how many visual concepts humans see? And that
- 15:17Speaker 3: is a very hard number. How do you interrogate a
- 15:20Speaker 3: person and say, list me all the visual concepts. It's impossible.
- 15:25Speaker 3: But he had a way of using dictionary and using
- 15:30Speaker 3: visual structure to estimate, and he put a number of
- 15:33Speaker 3: thirty thousand visual concepts.
- 15:36Speaker 2: They're thirty thousand different sort of kinds of things, right,
- 15:40Speaker 2: people can identify differentiating. Yeah, it's a lot.
- 15:44Speaker 3: That's a lot.
- 15:46Speaker 2: Yeah, And every concept you're setting out, if you're setting out, sorry,
- 15:51Speaker 2: is that your number? Is your number?
- 15:53Speaker 3: That was my number. I was obsessed with that number,
- 15:57Speaker 3: and I was obsessed in a way that I feel
- 16:00Speaker 3: I was kind of crazy because nobody was obsessed with
- 16:03Speaker 3: that number. Nobody even knew. I think my book is
- 16:06Speaker 3: the book that gave the number A which is be
- 16:10Speaker 3: the most number, and I'm very proud of that.
- 16:13Speaker 2: Do you can you just rattle off some of the categories.
- 16:17Speaker 3: Star nosed mole, star No's mole category to itself, that's
- 16:23Speaker 3: my favorite, one of my favorite categories. And Guardenian windsor
- 16:31Speaker 3: flower has windsor chair. There were hundreds of dogs. I
- 16:37Speaker 3: remember there were uh different kind of cars like like
- 16:43Speaker 3: sports sedan and uh monocycles. It's it's a lot.
- 16:54Speaker 2: So Faithley has her number, she has her big idea.
- 16:58Speaker 2: She knows what she needs to build a gigantic image database.
- 17:03Speaker 2: But how do you actually do that?
- 17:05Speaker 1: Well? I have the answer in just a minute.
- 17:19Speaker 2: Okay, so you've got your giant north Star task ahead
- 17:24Speaker 2: of you. Not only do you have, you know, thirty
- 17:28Speaker 2: thousand ish categories to deal with, presumably for each category
- 17:33Speaker 2: you need many many thousands. So it's thousands of images
- 17:38Speaker 2: per category, tens of thousands of categories. What is the
- 17:43Speaker 2: order of magnitude?
- 17:44Speaker 3: We're talking about tons of millions?
- 17:47Speaker 2: A million this is and this is not a time
- 17:51Speaker 2: where you can do this in an automated or semi
- 17:53Speaker 2: automated way like you could now.
- 17:55Speaker 3: No, I mean the point is, the machines cannot do it.
- 17:58Speaker 3: We have to. This is a north start to push
- 18:01Speaker 3: machines towards that, So you have to do it by
- 18:04Speaker 3: human hen and the good.
- 18:06Speaker 2: News downloading and labeling. Yeah, millions or tens of millions
- 18:11Speaker 2: of images.
- 18:11Speaker 3: Downloading, cleaning, labeling, and yes, that's that was the task.
- 18:18Speaker 2: So now you're like Henry Ford or something right now
- 18:21Speaker 2: you need an assembly line, you need a factory for
- 18:25Speaker 2: creating this database.
- 18:26Speaker 3: Yeah, you can put it that way. And we needed
- 18:30Speaker 3: a global workforce, and eventually we found them on Amazon
- 18:35Speaker 3: Mechanical Turk. It's an online global market.
- 18:39Speaker 2: It's a market for project based work, right, people doing
- 18:42Speaker 2: project based work. And so, so how long does it
- 18:47Speaker 2: take you to build this thing? And how big is
- 18:49Speaker 2: it when it's done?
- 18:51Speaker 3: It took us three years. When it was done, it's
- 18:54Speaker 3: fifteen million hand cleaned, sorted, curated, labeled images across twenty
- 19:02Speaker 3: two thousand categories.
- 19:04Speaker 2: So now you have this thing. It's called image net
- 19:06Speaker 2: and basically the function of it is it itself is
- 19:10Speaker 2: not useful, right, It is there to train. Well, it's
- 19:12Speaker 2: useful as a means to an end. It's there for
- 19:15Speaker 2: people who have models that aim to teach computer's vision
- 19:20Speaker 2: to see and understand to train their models. Now there's
- 19:24Speaker 2: this giant database. I mean people talk about this as
- 19:28Speaker 2: kind of one of the beginnings of big data.
- 19:30Speaker 3: Yes, yeah, I think it should be properly recognized as
- 19:36Speaker 3: the beginning of big data in AI, because before this,
- 19:40Speaker 3: there isn't this concept of big data in AI. It
- 19:45Speaker 3: was just a paradigm shift from that point of view.
- 19:49Speaker 2: And so you create this contest where people can come
- 19:53Speaker 2: and train their models on image net, on this giant
- 19:57Speaker 2: database that you've built, and then and then in the
- 20:00Speaker 2: contest their models will be shown new images images not
- 20:04Speaker 2: in the database, and you'll see how how good they are.
- 20:07Speaker 2: And for a while it's like going okay, right, but
- 20:11Speaker 2: kind of slow, like you're in the book you write
- 20:14Speaker 2: about like you get a little worried. You've built this
- 20:16Speaker 2: giant thing with people all around the world and it's
- 20:18Speaker 2: not for a while leading to the breakthroughs that you
- 20:22Speaker 2: had imagined.
- 20:23Speaker 3: Yeah, it was first of all, we open source this.
- 20:28Speaker 3: We didn't even though we spend a lot of sweat
- 20:32Speaker 3: and tears, you know, building this, but we know the
- 20:35Speaker 3: real value is to open source. So we gave it
- 20:38Speaker 3: for free to the whole community. And then I wanted
- 20:45Speaker 3: everybody to use it. I wanted to see this driving
- 20:50Speaker 3: all of us towards the north Star. I want the
- 20:53Speaker 3: field to work out. But it wasn't like an overnight success.
- 20:59Speaker 3: It wasn't like everybody's running around and say, oh my god,
- 21:02Speaker 3: there's image Net to use. And of course we were not.
- 21:10Speaker 3: You know, we were disappointed, but we were not sitting
- 21:13Speaker 3: there crying. We were just disappointed.
- 21:16Speaker 2: And so there is this big moment right after a
- 21:19Speaker 2: few years at one of the contests, there's a new
- 21:22Speaker 2: model in three years, So tell me about that moment.
- 21:25Speaker 3: So the result of two thousand and twelve came in
- 21:31Speaker 3: and we saw this result coming out of Professor Jeff
- 21:34Speaker 3: Hinton's lab using your network, and the difference that the
- 21:39Speaker 3: error reduction compared to previous years was just much bigger,
- 21:46Speaker 3: you know, and we started to realize this is a
- 21:49Speaker 3: very very significant moment because there's a serious, serious breakthrough
- 21:59Speaker 3: in terms of the results of image that which is
- 22:05Speaker 3: the north Star problem. Right. So it was so important
- 22:08Speaker 3: for me that I, you know, bought last minute plane
- 22:13Speaker 3: ticket to fly to Italy to announce the Imagnet Challenge
- 22:20Speaker 3: winner that year, and.
- 22:22Speaker 2: You weren't going to go otherwise.
- 22:25Speaker 3: I wasn't planning to go because I was still a
- 22:27Speaker 3: nursing mom, so I was taking you know, I was
- 22:32Speaker 3: mostly working from home at that home in that month.
- 22:36Speaker 3: But I was like, this is so important that I
- 22:40Speaker 3: needed to go.
- 22:41Speaker 2: And so I mean, so this was someone working with
- 22:45Speaker 2: Jeff Hinton and using a neural network like today Jeff Hinton.
- 22:48Speaker 2: You know, if you know two names in AI, Jeff
- 22:51Speaker 2: Hinton is probably one of them. People call him the
- 22:53Speaker 2: godfather of kind of modern AI, right, and neural networks
- 22:56Speaker 2: are essentially the thing that has worked right both for
- 22:59Speaker 2: vision and for language. You know, jat GPTs neural network,
- 23:04Speaker 2: and so this was a moment was like, oh, this
- 23:06Speaker 2: technique that a lot of people thought wasn't going to
- 23:08Speaker 2: work had kind of given up on its back.
- 23:11Speaker 3: Yeah, yeah, exactly. I think it's actually a parallel story
- 23:15Speaker 3: of two groups of people that had that determination seeing
- 23:23Speaker 3: something that you know, maybe the mainstream wasn't seen, and
- 23:28Speaker 3: then had the resilience and just perseverance to keep marching on.
- 23:36Speaker 3: I was doing my north Star pursue. I was doing
- 23:39Speaker 3: the big data approach. They're doing the new network algorithm,
- 23:43Speaker 3: and then we converged.
- 23:45Speaker 2: Uh huh. That's really elegant, right, because it's like your
- 23:48Speaker 2: big data is just sitting there and you don't maybe
- 23:52Speaker 2: entirely know it, but you kind of need a neural
- 23:54Speaker 2: network to come in and train on it. Right, And
- 23:58Speaker 2: they're over there building their neural network and they may
- 24:00Speaker 2: or may not know it, but they need the big
- 24:02Speaker 2: data that you're over here building, and then when it
- 24:04Speaker 2: comes together, it's like, hey.
- 24:06Speaker 3: It works. Yeah. So I think that's how science progresses.
- 24:10Speaker 3: It's kind of spiraling up, and sometimes it takes a
- 24:15Speaker 3: couple of more threats. It's not a single spral I
- 24:18Speaker 3: remember very vividly that some of one of the critiques,
- 24:25Speaker 3: one of the main critiques of image net by my
- 24:28Speaker 3: colleagues is this is too big. We cannot even fit
- 24:32Speaker 3: this into memory. What are you doing? What are you
- 24:35Speaker 3: making this giant data set for when we cannot even
- 24:40Speaker 3: you know, put it on a chip. And as that
- 24:44Speaker 3: was happening, GPU was happening.
- 24:46Speaker 2: So GPUs are the Nvidia chips that are now made
- 24:50Speaker 2: in video, one of the biggest companies in the world.
- 24:52Speaker 2: But they were figuring out that GPUs are particularly good
- 24:55Speaker 2: for the neural.
- 24:56Speaker 3: Network exactly exactly.
- 24:58Speaker 2: So that moment, this moment when you guys come together
- 25:01Speaker 2: and kind of create this you know, new era of
- 25:04Speaker 2: computing really that we're still living in of AI is
- 25:07Speaker 2: about ten years ago now, right, yeah, so just bring
- 25:13Speaker 2: me to the present. Like that happened, then where are
- 25:16Speaker 2: we now? I mean, it's it's kind of the same universe, right,
- 25:19Speaker 2: It has advanced a lot, but the basic premise of
- 25:22Speaker 2: you have neural networks training on vast, vast databases of images, like,
- 25:27Speaker 2: it's basically the same.
- 25:29Speaker 3: Right, So from my conceptional point of view, you're right,
- 25:32Speaker 3: at that time, I was downloading the Internet of images
- 25:35Speaker 3: to be honest. Now, the Internet of Images is just
- 25:38Speaker 3: so vast, I don't know who can download it all.
- 25:42Speaker 3: And then the GPUs is mind bogglingly advanced. Right, but
- 25:48Speaker 3: you're right, the ingredients are still the same.
- 25:54Speaker 2: We'll be back in a minute with the lightning round.
- 26:05Speaker 2: Let's do a lightning round. Okay, what's one thing you
- 26:09Speaker 2: learned running a drag cleaning shop.
- 26:13Speaker 3: That's how very night to have to think. I think
- 26:17Speaker 3: I learned resilience because my goal is to be a scientist.
- 26:24Speaker 3: But if it takes running a dry cleaner shop to
- 26:27Speaker 3: get there in the most detoured way, I'll have to
- 26:31Speaker 3: do that.
- 26:32Speaker 2: So you're writing the book about a high school teacher
- 26:35Speaker 2: who was a very big and important influence on you,
- 26:38Speaker 2: and how your advisors in grad school were an important influence.
- 26:41Speaker 2: And now you have been a mentor to many people.
- 26:44Speaker 2: So I'm curious, what's one tip for finding a mentor?
- 26:48Speaker 3: For finding a mentor? That's a great question. I trusted
- 26:55Speaker 3: them different stage. This trust meant different things. I trust
- 27:01Speaker 3: their genuine intention, I trusted their wisdom, I trusted their
- 27:08Speaker 3: vas and I trusted there you know, believe in me.
- 27:17Speaker 3: So that was how I was lucky to find my mentors.
- 27:22Speaker 2: What's one tip for being a mentor?
- 27:25Speaker 3: Being a mentor is really about respecting the the person,
- 27:32Speaker 3: the soul and help them to find their north star,
- 27:36Speaker 3: to find their passion.
- 27:39Speaker 2: If everything goes well, what problem will you be trying
- 27:41Speaker 2: to solve in five years?
- 27:43Speaker 3: I'm trying to usher in machines being so helpful and
- 27:50Speaker 3: collaborative for humans, whether it's productivity or our wellbeing. If
- 27:56Speaker 3: this includes sensors, spar sensors, virtual agents, or real robots,
- 28:04Speaker 3: I think it all. You know, I'm very excited by that.
- 28:13Speaker 2: Feif A Lee is a professor of computer science at
- 28:15Speaker 2: Stanford and the author of the book The Worlds I See.
- 28:20Speaker 2: Today's show was produced by Edith Russolo and Gabriel Hunter Chang.
- 28:25Speaker 2: It was edited by Karen Chakerji and engineered by Sarah Bouger.
- 28:29Speaker 2: You can email us at problem at Pushkin dot FM.
- 28:33Speaker 2: I'm Jacob Goldstein, and we'll be back next week with
- 28:36Speaker 2: another
- 28:36Speaker 1: Episode of What You Have