Latest / Bad Decisions Podcast / #20 Ex-Google Product Manager on Generative AI, Apple Vision Pro & NeRFs | Bad Decisions Podcast
Transcript
- 0:00The future of work looks a lot more like people aren't playing
- 0:03and instruments in the symphony, they're becoming the
- 0:05orchestrators. If you're passionate about
- 0:07something, the tools may change, the Technologies may change, but
- 0:10then you're willing to adapt the way you find your passions, you
- 0:13just go and paste stuff. And then I really sunk my teeth
- 0:15into Maps, where spent almost four years, working on a
- 0:18next-generation, digital twin of the world.
- 0:20This idea of digitizing reality and then sort of Kit bashing, it
- 0:23started with photogrametry nerves added onto photogrammetry
- 0:27by allowing us to capture a lot more of the Alexa t a reality
- 0:31for Battlefront. They went to all these locations
- 0:33where the Star Wars movies were filmed and just scan the crap
- 0:36out of everything Kush. I think Apple just made VR.
- 0:39Cool, let's Dive Right In, Baby 32.
- 0:41Did you just drink without me, bro, do you anyone?
- 0:44Cheers that I something. Okay, all right, three two, one,
- 0:50cheers. Oh wow, got a new coffee in the
- 0:55house baby, bro. This is a Starbucks Kirkland,
- 1:00espresso coffee. And it's a good one.
- 1:03As you guys know, we're very, very much as do that all the
- 1:05time with the Starbucks coffee, and we can never get too much of
- 1:08it, but without anything else distracting and disturbing us.
- 1:13It is episode number, 20 of bad. Decisions goes right here.
- 1:19So, we just want to say, first of all, welcome.
- 1:22And second of all. Thank you.
- 1:24Thank you. Every single.
- 1:26One of you guys who has stayed with us since episode number one
- 1:28up until now, you guys aren't, oh, gee, you guys are amazing.
- 1:32You guys are the reason why we're doing this every damn
- 1:35week. Honestly, the data, we started,
- 1:37I couldn't believe that the ended up on episode 29.
- 1:40Oh, it's been a crazy. I've never missed a week so far
- 1:44so weeks we even did to podcast. We did lose friends and sleep
- 1:48and and our mental health and our physical and just joking.
- 1:52Some of them we did actually but it's been worth it because we
- 1:56made some great friends along the way.
- 1:58Every single week we talk and learn from all the inspiring
- 2:02guest, and before we bring our guests today, something that me
- 2:05and Farrah the discussion about last week and I just want to set
- 2:08the tone just very briefly. The reason we're doing this
- 2:11podcast and we never really talked about it.
- 2:13Is we want to bring on inspiring guests who've done great,
- 2:17groundbreaking work in any field, honestly, it doesn't have
- 2:21to be the fields that were Typically invested in our self
- 2:25and we want to just bring them on to talk about their Journey,
- 2:28their story, and hopefully we can learn something from them,
- 2:31and you guys can also learn something along the way, and get
- 2:33inspired and to be honest. Every single time, the podcast
- 2:37finishes, I have learned something and I cannot imagine,
- 2:40like people who are coming from different backgrounds.
- 2:42We had been, who was a filmmaker, we had Olaf who was a
- 2:46photographer, but their story and their Journey was so
- 2:49inspiring to us. And I'm pretty sure it's so
- 2:51inspiring for everybody who We're listening.
- 2:53Yeah, so it's it's all about giving you guys more reason to
- 2:57make that bad decision, you start, whatever you want to
- 3:00start and also learn from all these guests that we have them
- 3:03right so far. Hot, let's not waste any more
- 3:06time, man. We have a freaking special guest
- 3:09today and I will let you do the honors tell everybody who we got
- 3:15on. So I guess today is an ex Google
- 3:18product manager who has made significant contribution to The
- 3:22most groundbreaking project Paris, I'm pretty sure you know
- 3:25about Google immersive view. Oh yeah, I do you know about
- 3:28Google Maps. Hell yeah, he even worked on the
- 3:31geospatial API them, right? And yet even crazier beside
- 3:36doing all of this. He has made a huge community on
- 3:39social media, over 300,000 subscribers on YouTube, and
- 3:43around the million followers on Tick-Tock after a video, he has
- 3:47so many freaking videos. All of our social media and I'm
- 3:51like, how do you even managed to make all of these while working
- 3:55on all these cool projects at the same time fired.
- 3:57Let's let's let's bring him on our guest today is beloved
- 4:00siddhu. How's it going to be here?
- 4:02I got the I got the classic cup of coffee and given the sheer
- 4:08amount of overlap we have in terms of like, you know, the
- 4:11modalities of creation were interested in.
- 4:13I'm excited to dig in so thank you for having me.
- 4:15On nowhere is met. It's a pleasure to finally be
- 4:18able to speak with you here. First of all, can we do all of
- 4:21our cheers right now? Our culture, cheers, boom.
- 4:26We all be watching is also having some sort of drink coffee
- 4:29tea, whatever's your thing, just go for it.
- 4:32You know, this is gonna be a very enjoyable podcast and
- 4:36before we start with anything serious, I have to ask you,
- 4:39you've made loads of VFX and CGI videos especially on Tick-Tock.
- 4:44You're just scrolling through all of them and you started, I
- 4:47guess during covid. What is with you and your
- 4:50addiction with UFOs and siren head?
- 4:54200 of those videos which are amazing by the way, it's
- 4:59awesome. Yeah, it's so the UFO stuff.
- 5:01I mean, I've always been fascinated with this stuff.
- 5:03Lika, the first Hollywood movie that I saw that got me into
- 5:06visual effects was was Independence Day.
- 5:09And honestly it was the behind the scenes for Independence Day.
- 5:12Or if you remember the scene or it's like the mothership over
- 5:14New York and just like, yeah, the explosion in Sue's.
- 5:17So I've had a lifelong Fascination for that and then on
- 5:20Tick Tock specifically if you remember Read Area. 51 Trend.
- 5:24That started. Oh yes.
- 5:26Since I think you're making a bunch of random videos and I
- 5:28just like, put one of those videos out there and it just
- 5:31like toke off, right? And it was like one of those
- 5:34like hockey puck, like holy crap.
- 5:35What's happening here? So you know as a wise Creator,
- 5:38once told me if something worse, you double down on the damn
- 5:40thing. So it's been an amazing way for
- 5:43me to just like talk about these esoteric kind of scary
- 5:47phenomenon and it's the same thing with siren head, man.
- 5:49It's like there's this like that.
- 5:52Sound of the siren evokes this like visceral.
- 5:55The Eerie sound, right? Yeah, yeah.
- 5:58It's like you don't need to like even a kid is like, holy crap.
- 6:00What is that? And it's like the bomb raid
- 6:02siren, right? If you remember like, in the
- 6:04world wars, like that's the sound that like entire
- 6:06generation grew up with. So there's something deeply
- 6:08visceral in us about that and something about like, like scary
- 6:12spooky content is very interesting to me.
- 6:14And so visual effects are such a cool way of, like I do painting
- 6:17this sort of universe and every short is like a vignette into
- 6:21this like sort of Alternate spooky esoteric Dimension you
- 6:25know 100%. I think every person who is a 3D
- 6:30artist or 2D artists no matter where you are, there is that
- 6:33point that that that singular point, that you can go back to
- 6:37be like, this is the moment where I got inspired to get into
- 6:40this or I got motivated and for you it was Independence Day that
- 6:43and the best part, the best part is also been, you can recreate
- 6:46your childhood memories. And, you know, now you have the
- 6:49power to not like I watch that movie.
- 6:51I want to recreate that, that's it.
- 6:52Best field. That's so true.
- 6:53I feel like as 3D artist the first thing you realize, you're
- 6:56like, wait a second, I can now like remake all the movies that
- 6:59I love or like different scenes, that I love you did it.
- 7:02And I think the first video uploaded on take that was the
- 7:05Iron Man video or something. If I'm right.
- 7:06Yeah. All right.
- 7:07Yeah, totally super cool stuff you worked on.
- 7:10And how did the is that how you were sort of led into this
- 7:14journey of working at Google? Can you walk us through that?
- 7:17What was that Journey like because you started, you know,
- 7:203D animation with 3ds Max, if I'm not mistaken or was it?
- 7:25Yeah everything. So, how did that lead you into
- 7:27going it? Exactly like, that's, that's a
- 7:29really long time ago. How did that lead you into going
- 7:32into Google and and ending up here today essentially?
- 7:36Yeah, I mean it's it's like, you know it's a the theme you
- 7:38already hit on. Like I at the age of 11 I was
- 7:41really into flash five at the time and cartoon animation.
- 7:45You know just like this is the early days of the web.
- 7:47And I saw this cartoon right effectively like this TV show on
- 7:50Discovery Kids that was about Mega Movie Magic.
- 7:52Like how do you make these visual effects?
- 7:54And I kind of fell in love with a notion that my computer could
- 7:57like the same computer. I was using to make these like,
- 8:00Colorful full cartoony likes, you know, flash animations could
- 8:04be used to kind of seamlessly blend reality and Imagination.
- 8:07Exactly what you said about, you know, sort of taking stuff you
- 8:10see on the Silver Screen as it was called then.
- 8:12And sort of like recreating it. Like, like really crappy
- 8:15backyard, lightsaber Hood would like a crazy like, in a
- 8:19spaceship Landing. So, you know, when I was 14 like
- 8:22I Obviously got deep into 3ds Max then obviously is like, Maya
- 8:25was the tool to learn and start picking up after effects until I
- 8:28get 14 15, you know, right? I was entering High School, I
- 8:32was like, oh my goal in life is to be a visual effects
- 8:34supervisor and I want to go work at ilm and I want to have like
- 8:38you know your name credit, at the end of the movie like those
- 8:40sort of the dream. And then, as I got older, I went
- 8:44to boarding school and like got exposed more to the technical
- 8:47side of things. And I really enjoy this idea of
- 8:49like building actual things. And so that let me to like,
- 8:52despite getting into my film School.
- 8:54USC like dream Film School USC, I decided to study computer
- 8:57science and business, and this is right around when the mobile,
- 9:01boom was sort of happening. Like the App Store just come
- 9:03out, I graduated 2013 and everyone was like, Hey, like we
- 9:07gotta like a Web 2.0 is cool. But how do we let go mobile
- 9:11first. And so that Let me into product
- 9:13design right after graduation, I worked at a consulting company
- 9:16called Deloitte digital. It was there like Innovation arm
- 9:19and I did basically, like, product design stuff for two
- 9:22years. And that was interesting because
- 9:23all the stuff. Again, I learnt with After
- 9:25Effects, 3ds Max Maya just kind of got fueled into like, the
- 9:29earliest instantiations of a rvr.
- 9:32So this is like, Circa 2013 was like, you know, the Google Glass
- 9:36was the thing, right? This is that was nobody yeah,
- 9:40that time like nobody was talking about They are totally
- 9:44and if they were there like, oh it is.
- 9:45This dorky thing. Like we were barely coming to
- 9:48grips with what you could do on the phone, right?
- 9:50Like uber and like ride-sharing apps were just reaching ubiquity
- 9:53Instagram was just sort of starting to blow up, same thing
- 9:56with Snapchat and so forth. And so yeah, it's interesting
- 9:59like I kind of let the YouTube Creator thing.
- 10:01Go completely through college got into basically building a
- 10:05our VR experiences. As I graduated first Enterprise,
- 10:09really boring stuff like a field service, Hurt on an oil rig
- 10:13going through like a maintenance checklist because they need to
- 10:15be hands-free while they're assessing, and, you know, kind
- 10:18of like, you know, fixing the equipment, and then VR happened,
- 10:21you know, the DK2 came out meta, acquired, frickin Oculus like
- 10:27Oculus at the time, right? Like and so that kind of like
- 10:31360 video suddenly popped up. And again like that like really
- 10:35cheesy Steve Jobs, quote of like the dots connect looking back
- 10:38suddenly like all the skill that I learned around like 3D.
- 10:42Effects Etc. Just like manifested itself in a
- 10:45RV are so like I like to describe a our is basically the
- 10:49visual effects pipeline running in real time on the phone in
- 10:51your pocket or the headset on your face all the same stuff,
- 10:54right? Yeah.
- 10:55And so yeah, that got me into VR video and then I was like, all
- 10:57right, Enterprise is cool but like I really want to do this at
- 11:00scale and so at that time like circuit 2017, Google was like
- 11:05building out this like, you know, essentially the our
- 11:07initiative to create 360 and three DVR camera systems worked
- 11:12on. That then worked on a are like
- 11:14you know, this is like three hype Cycles ago, so VR with the
- 11:16first hype cycle than AR was the second hype cycle and then I
- 11:20really sunk my teeth into Maps, where spent almost four years
- 11:23working on, you know, a next-generation digital twin of
- 11:26the world and then creating consumer and developer
- 11:28experiences from that. So the immersive View and the
- 11:31geospatial API that you alluded to.
- 11:33But along the way the theme is just been blaming reality and
- 11:36Imagination and then I would say Google it was more of the
- 11:38utilitarian version of that blending the physical and
- 11:41digital world. So, It along the way, I
- 11:43discovered various roles and eventually ended up enjoying
- 11:45product management. Etc.
- 11:46And so yeah, like after doing my six years and after my YouTube
- 11:50Tech talk and all this stuff like sort of hit a threshold as
- 11:52this generative, AI wave is sort of picking up steam.
- 11:56I was like, hey, let's Dive Right In baby.
- 11:59Oh, yeah, in a conversation. That's, that's an amazing.
- 12:02But I want to go back a little bit and ask one question because
- 12:05you mentioned, you had two choices.
- 12:07One was going for computer science and film school.
- 12:09At that time, your decision to go for.
- 12:12Their science. Was it solely a personal
- 12:14decision? My God, or was it peer pressure
- 12:17coming from coming from Asian Heritage.
- 12:19I personally was forced into going to engineering school
- 12:24bitch, which I did it. So, listen to this, I meant to
- 12:27introduce go on the first day of orientation that I went to the
- 12:29class. They started talking.
- 12:30I was like, I'm out of here. I'm out of here.
- 12:33I think computer science. And I can say, not forced, but
- 12:36definitely wasn't a choice of probably would have gone with.
- 12:39If I was all alone on my own and when I win and I remember my
- 12:42parents, Turns the again didn't force me but they did sort of
- 12:46push the decision into my face. Hey, sign.
- 12:49And their excuse was you're good with computers out of, you know,
- 12:53how to be playing games ended up there.
- 12:56How did you end up with the question is like personal choice
- 13:00and it's okay. I mean, of course, it's okay to
- 13:02have been peer pressure, that time is normal.
- 13:04Yeah, exactly. No.
- 13:06It's a great question. I think, you know, again, you
- 13:08know, being from South Asian, Indian Heritage.
- 13:10Like, I think I like all immigrant like, Ali's kind of
- 13:12face this sort of, you know, I was talking to my Jewish friend
- 13:15the other day. It's the same thing.
- 13:16Like it's like, you know, are you Doctor lawyer engineer?
- 13:18This big one. Luckily, my parents were pretty
- 13:24good about this like I would say like my mom like got me into
- 13:27like got me a computer, very early.
- 13:29You know, I spent half of my life in India.
- 13:31Like so she got me like a friggin internet connection
- 13:33before. Not 56k modem throwback.
- 13:36You know, before anyone had that type of stuff there was a rarity
- 13:40and you know, like for a while. They really like spurred my
- 13:43passion would say around the 10th grade, it's like around
- 13:4610th grade came around. There was definitely a little
- 13:48bit of peer pressure is like I'll be taught you know if you
- 13:50want to be successful in life, you know you better you know,
- 13:53you better start your stem scores better be in a keep going
- 13:56up. And so, you know, they never
- 13:58actively forced me. But what I like to joke with
- 14:00them as like, hey, your propaganda worked and it's not
- 14:09all this. Yeah, I know, most of my
- 14:13freshman to Science school. It's not even even if you put
- 14:16the parents peer pressure side, it was rarely that someone could
- 14:20pick, like, I want to study art. Do it won't appear on where
- 14:23we're from art? School is looked down upon, like
- 14:26if your shit in school, you go to Art School.
- 14:29Like that's like that's how they look at it, which is horrible.
- 14:32Horrible, growing up up until High School thinking.
- 14:35Oh shit. Did you hear this guy went to
- 14:37Art School. Like, that was like, if you
- 14:39failed in life, you would end up in article and it's funny
- 14:41because all Life is not related to art and we're like totally.
- 14:45We're more successful in our minds and happy as we've ever
- 14:48been. And so it's just crazy how these
- 14:51things work. Totally.
- 14:53But I mean like I'm sure you empathize with this to like
- 14:55looking back like the way I sliced, the needles I'm going to
- 14:58study computer science and business because I wanted to do
- 15:00both, I didn't want to just do CS.
- 15:02I love the business side of like it's cool to have Cool Tech but
- 15:05how do you actually deploy this at scale to either?
- 15:08You know, like really make an impact on the world?
- 15:10Whatever metric of success? SS you have there, right?
- 15:13But at the same time, like dude, like college in the u.s. is so
- 15:17flexible, you know, my advisor was so awesome.
- 15:19I took all these like, Maya classes and new compositing
- 15:23classes, but then also took like, business intelligence
- 15:25classes that were like, this is like the earliest instantiation
- 15:29of machine learning being applied to a big data, was the
- 15:31big buzzword back then. So I was able to make this sort
- 15:34of, like really well-rounded curriculum that if I had just
- 15:38gosh, I think about like if I had gone to film school because
- 15:41I have a lot of friends who did that, It's like, well, here's
- 15:43like let's go shoot like on actual film.
- 15:46And let's go make your like, thesis film, like, in spend a
- 15:48year doing that. I don't think those skills would
- 15:51have as readily transition into the world.
- 15:53You know, we live in today, like, in the stuff you're doing
- 15:56with Unreal, Engine. I bet the fact that you spend
- 15:58some time in engineering probably makes it easier to pick
- 16:01up those type of things. So it has creative technology,
- 16:04man. I think like it's the
- 16:05intersection of like be able to wheel the world, a b, and the
- 16:09world of atoms kind of together is just like there's some see
- 16:12Secret Sauce there. So yeah, this little bit of the
- 16:13story and looking back. No regrets at all.
- 16:16Like, 100 I would say if you're happy where you are today, there
- 16:21shouldn't be any regret, even if you think you might have done
- 16:23something wrong, because if you did that, that led you to where
- 16:26you are today. Even if it was wrong or right
- 16:29now, one thing I do want to mention is you brought up doctor
- 16:34lawyer engineer. These are the three categories
- 16:37that most parents at least raise for tradition, praise and I want
- 16:42to give some credibility to you before.
- 16:44I even ask this question, you're playing and you're experimenting
- 16:48with all the latest Technologies every single day and we see it
- 16:51all over your Twitter feed. And so, for everyone watching,
- 16:55you are essentially someone who can truly answer this question,
- 16:59really well. Doctor lawyer, engineer, with
- 17:03all the things that are happening with AI and and we
- 17:06know where AI, we can all sort of predict where AI is going
- 17:09right? Where we talked about this with
- 17:11our previous. This gets with fat Hardware.
- 17:13General doctors, right? They essentially here in Canada.
- 17:18Healthcare is pretty shit. Like we've only been here for
- 17:21about a year and just what I'm realizing is I go to the doctor.
- 17:24First of all, getting into the queue is difficult, getting to a
- 17:28specialist is even more difficult, the wait times are
- 17:31crazy. And So eventually when there's
- 17:34going to be an AI that can solve every single one of your
- 17:37questions and problems, regarding your health, can read
- 17:40your health, essentially, an answer that or Let's talk about
- 17:42a lawyer all these contracts that can be written with AI in
- 17:46the quickest way possible in the best way possible.
- 17:49How do you think the new generation will gen Z into?
- 17:54Yeah, going to education system and career paths.
- 17:57Considering how AI is changing the world.
- 18:01It's a great question and a very profound one that obviously has
- 18:05people either super excited about the disruption that's
- 18:08ahead or sort of entrenched retreating into this defensive
- 18:12position of like, pushing back on any change that lies ahead.
- 18:15So I think like, what can we be sure if the world is absolutely
- 18:17going to change? The way the job functions look
- 18:19today, may not look the same way.
- 18:23In terms of what, how it'll actually manifest itself?
- 18:25Have a couple of like my here's my thesis write my thesis is
- 18:29that right now specialization is is deeply.
- 18:32Valued in the world we live in, right?
- 18:33Like so you all are from Iran, you know, there's this joke like
- 18:37we're like the the amount of phds in Iran is just way too.
- 18:39Damn hot. How did you know that you walk
- 18:45around like Stanford campus? Like it's just like everyone's
- 18:47Irani and there they have a PhD. It's like and it's like this.
- 18:52That's the Like the Apex of specialization, right?
- 18:55Your some sub specializing in this like this, like this is
- 18:58like the tip of the iceberg effectively, right?
- 19:00And you're losing the broader picture show, and that applies
- 19:03in all professions, right? If you think about the like the
- 19:06creative industry, you work and work in 3D animation, okay.
- 19:09So are you like a modeling artist texturing, orders, or
- 19:12your rigor you an animator, you know, are you good at lighting
- 19:15or you compositor? The general list has really been
- 19:18emerging as a profession. I would say in like social
- 19:21media. Roamright, like where you have
- 19:22more For trying to do with less. And so, effectively, most
- 19:25Industries, including computer science, right?
- 19:27Like you sub-specialize in some discipline.
- 19:30Hey, are you a front-end engineer specializing in these
- 19:32set of Technologies or back-end in these type of Technologies
- 19:35and same thing with machine learning only recently in
- 19:38machine learning with like, sort of the Transformer architecture,
- 19:41we're seeing sort of one, like, sort of, you know, kind of
- 19:44approach applied to a broad swath of problems.
- 19:46But historically, even within a subset of a, I like computer
- 19:50vision, there's been a lot of subspecialization So in other
- 19:53words, you had to sort of be this like t-shape person if
- 19:56you've heard of the T, shape or analogy, your Broad in certain
- 19:59areas and you're deep in other areas, what I think is happening
- 20:02with AI and like, AI agents, multiple sort of AI entities
- 20:06that you can work with that are specialized in different,
- 20:08domains as you go from being t-shaped, to being a tripod or a
- 20:12table, that's like sort of the image.
- 20:13I like to evoke when we talk about this stuff.
- 20:15So you know, if you're a lawyer that's like deep and for example
- 20:19corporate law right now, which is very boilerplate contractual
- 20:22stuff. Min-ho me that job is going
- 20:25away, like I don't think there's any way about it, right?
- 20:28And I think the same applies to, for example, like, if you break
- 20:33down, like all the newsletter content that exists, that's
- 20:35purely summarizing the news but that's obviously going to be
- 20:39automated of way. But we as humans I think are
- 20:42going to just start creating new roles that orchestrate.
- 20:45These AI agents along with our own, well of expertise, and
- 20:49other humans. Well of expertise at this higher
- 20:51level of abstraction. So to me the future of work
- 20:55looks a lot more like people aren't like playing an
- 20:58instruments in the symphony, they're becoming the
- 21:00orchestrators and how that manifests and permeates across
- 21:04all the roles you mentioned. I think could vary, but
- 21:06certainly it, apply to doctors to write.
- 21:08You're totally right. Like I think for the first
- 21:10seeable future humans will feel very confident if a human has a
- 21:15final call on especially if you're getting, you know,
- 21:18surgery or something thing like that done, but when it comes to,
- 21:22hey, looking at Functional unit, fmri, scan or looking at your CT
- 21:26scan or looking at, you know, like, certain symptoms and data
- 21:29points from your Apple watch, and doings this crunching, the
- 21:32sort of Big Data analysis. Of course, we want machines
- 21:35doing that. So like I think human
- 21:38intelligence will sort of coexist with machine
- 21:40intelligence and we'll just just like, you go on a slack and you
- 21:44might have a bunch of full remote employees.
- 21:46I've got a feeling it'll sort of be like, we're all just going to
- 21:49be working with these AI agents that help us get stuff done in
- 21:52the world. And I don't think that'll mean
- 21:54we'll all be sitting on our butts in VR headsets, like, the
- 21:57movie Wall-E. I think, I think that only
- 22:00happens if there's like a fixed amount of Labor that's needed in
- 22:03the world, right? Like, I don't think that will be
- 22:05the case will conjure up sort of new job lines.
- 22:08You know, new canvases for creation.
- 22:10Even like, I don't think we're going to fully automate away
- 22:12creation and and be like content with like sort of a dystopian
- 22:17point of like a tick tock style algorithm just procedurally
- 22:21giving you like infinite content.
- 22:22We're not Gonna. Excuse me, don't worry, maybe
- 22:26there's a place for that but that's not going to be the
- 22:28ubiquitous thing. What I'll end by saying is like
- 22:31the challenging part about this transformation than any other
- 22:34one. Which is why a lot of people are
- 22:36freaking out about this is I think the rate at which were
- 22:38creating jobs might be slower than the rate at, which were
- 22:42eliminating jobs and so, it's going to be a rocky transition,
- 22:46but best believe, I think on the other side of this, will still
- 22:49be doing cool stuff. It's just will be wielding these
- 22:52tools to create stuff at this much.
- 22:54Higher level of abstraction. I love the orchestra analogy.
- 22:57That was beautiful. So so if someone DMZ and say,
- 23:00hey Bulova, I'm 14 years old now, you know, 13 14 and I don't
- 23:05know what to do, and I'm scared of, all the changes that are
- 23:09happening. I'm afraid if I go to law
- 23:10school, whatever I learned is done by an AI tomorrow or if I
- 23:14go to business school or if I go to 3D.
- 23:17Yeah. So, how would you buy your
- 23:20science? Anything anything, how would you
- 23:22advise someone who is Thirteen or fourteen like you can even go
- 23:27higher than that. You can go someone in.
- 23:28Like like like he trying to finish college like before 20
- 23:31unit. Yeah, she's a, how would you
- 23:32advise them and say what they should do in order to be on top
- 23:36of their game and make the most out of what is happening right
- 23:40now? You know, I do get this question
- 23:43a lot especially from like people who are trying to be
- 23:45product managers and their just want to be a p.m. because that's
- 23:49like the cool thing to be all. I don't want to be an engineer
- 23:52which want to go be a p.m. and how to see it's like not.
- 23:54It's one of those like I don't pretend to have some special
- 23:57advice here, my advice is to go taste things.
- 23:59I think like it is easier in history today to taste things
- 24:02than ever before, like just two year like a year ago.
- 24:06We actually have to read books. Now you can go ask questions to
- 24:09a book, right? Like isn't that crazy?
- 24:11Yeah. This is distillation of all
- 24:13human knowledge or at least documented human knowledge on
- 24:16the internet, which does include Reddit.
- 24:18So we can talk about how much knowledge there's there, you,
- 24:20but you can query this well of expertise and try things, make
- 24:24things easily rather than, like, just like shake the digital art
- 24:28example. Like, rather than spending
- 24:31months learning how to use a pressure, sensitive Wacom
- 24:34tablet, getting a license for procreator Photoshop.
- 24:38Hey, why don't you just make some a journey art just try
- 24:40making it. Is it fun?
- 24:41Does it? Light up your soul, is that the
- 24:43thing? That is the thing you want to
- 24:45do. Even if you didn't get paid, I'm
- 24:47a big believer in just like, finding your passions because
- 24:51that's the only way you'll be resilient to change if you're
- 24:53doing things because that's the thing to do the moment, it's
- 24:57like hard and the going gets tough.
- 24:59Like the, you know, the tough gets going or whatever that
- 25:01saying is, I think like if you're passionate about
- 25:04something, the tools may change, the Technologies may change, but
- 25:08then you're willing to adapt and kind of harness the new set of
- 25:11capabilities. He's at your disposal.
- 25:12So I think like adaptability is going to be a skill.
- 25:15That is very important in sort of this like everyone talks
- 25:18about this like asymptotic curve.
- 25:20Like we're about to hit like, you know, an immense amount of
- 25:23change very quickly. So I would say find your
- 25:25passions and the way you find your passions, you just go and
- 25:27paste stuff. Like dare I quote Gary V coz he
- 25:30just like goes over water with the you gotta make like 32 no.
- 25:36Now you have the tools to just at least go taste stuff like
- 25:38even on like YouTube. If you want to learn about a
- 25:42certain profession like, rather than going in enrolling, in some
- 25:45sort of a class or whatever the likelihood is, you could just go
- 25:48find a video. That tells you what you need to
- 25:50do, or you could go find a person that's doing exactly that
- 25:53and you get to taste things and then once you find the stuff
- 25:56that you're passionate about, go pursue that and then the rest is
- 25:58just a means to an end. AI is like if we're truly
- 26:01building a general intelligence, it is a tool for all sorts of
- 26:05things. So you got to find the thing
- 26:07that you want to do day in and day out, right?
- 26:09And that may be visual crash. For user types of visual
- 26:11creation, that may be building software, if that's what you
- 26:14want to do. You know, you don't have to go
- 26:16to CS cool anymore. You already didn't that was
- 26:18already kind of getting outmoded, as you saw a bunch of
- 26:21companies, like, sort of that not making a, you know,
- 26:24bachelor's or master's degree mandatory.
- 26:27And now you pour gasoline on that, the joke about like, the
- 26:30best programming language to learn this year, is English.
- 26:32I mean, that's absolutely true. Like, don't learn English and
- 26:36like, use copilot, and Chachi PT and make a product.
- 26:40It and launch it. And you are seeing people do
- 26:42this right on Twitter Now sort of the solopreneur hype so that
- 26:45would be my advice, like find the passions and then use the
- 26:47technology and sort of these platforms at our disposal to
- 26:50discover them and taste them. You know, it's funny.
- 26:53You brought that up because I believe it was your own tweet,
- 26:56posted as a carousel on Instagram that you showed me
- 26:59yesterday that had a saying, I believe, whereas there's all
- 27:04these opportunities but the problem also is canceling out
- 27:09the noise like So much happening.
- 27:11I'm not sure if that was. You was it, you show me a
- 27:13tweeter thread post as a carousel.
- 27:17Anyways, just definitely sad stuff like that.
- 27:19Yeah, actually, so just about the concept of, yes.
- 27:23Now, there's all these possibilities, but the same time
- 27:26there's just so much. Like, where do you start?
- 27:29Like, how can you adapt so fast every single day?
- 27:32Now, the reason I brought that up as well, is mainly because I
- 27:37feel like a lot of people still L, don't know about all these AI
- 27:42Technologies. A lot of people we speak to here
- 27:45in Vancouver, still haven't used chat GPT which that makes me
- 27:49really shocked. I thought it because I mean, our
- 27:52Twitter feed, our Instagram feed is all about the eye because
- 27:55that's what I'd be looking at. So, my mentality is, when I go
- 27:58out, when I go to gym, which, you know, the age group is bit
- 28:02somewhere between like, 18 to 45 mostly.
- 28:05When I see someone in the streets, when I see someone in
- 28:07our lift, I assume they know about at least, GPT which is
- 28:11like the most famous and probably the one the easiest to
- 28:15use essentially. Yeah.
- 28:16That's the most like user-friendly.
- 28:18But we get so many know. I don't know or no I haven't
- 28:21tried it. Or should I try it?
- 28:23I haven't play with it so that's like the whole education thing
- 28:26is really crazy about this thing.
- 28:27And every Darkness the what do you think about the adaptability
- 28:30of all of these AI Technologies and agents?
- 28:33Because in our world clearly it's quite fast but apparently
- 28:37for the rest of the population which I'm assuming is around
- 28:40like 80% of the world these still probably haven't even used
- 28:43a I once do you think because it's definitely not matching
- 28:46like the actual use cases is not matching the actual usage of
- 28:49what? What I'm seeing?
- 28:50What do you think about that? I think you're absolutely right.
- 28:53Like we definitely live in a bubble, right?
- 28:55Like and it's this like sort of early adopter Tech bubble online
- 28:59where everything's about like large language models and neural
- 29:02lady neural, Radiance fields and all this other stuff and I think
- 29:06this even applies at the highest levels of these, these Is right.
- 29:10Like if you think about just photogrammetry, most of the
- 29:13photogrammetry companies, the players that have been around
- 29:16for 15, 20 years aren't thinking about nerves right now.
- 29:19This is like this early new thing for them and I think the
- 29:21same applies to large language models, right?
- 29:23It's like it's a good that the whole world is not using them
- 29:28because I don't think we have enough gpus to life, the power,
- 29:31all the queries right now certainly you know like opening
- 29:34eyes hitting scaling restrictions and like it's funny
- 29:37at the end of the day it's like Jensen that's just going
- 29:39laughing to the bank. Like I just keep joking.
- 29:41Like the dude could buy like 30 leather jackets for a second
- 29:44now. So I guess I'm just like, just
- 29:46like money's coming in and saying, no matter how early I
- 29:49pans out, like, you know, homey set and videos in a great
- 29:52position. Now, I think like, when will we
- 29:54see people are adopting this. I think there's an interesting
- 29:57case study here with generative, fill by Adobe like.
- 30:01Okay, so sensibly how I got really excited about like
- 30:05generative stuff was Dolly to in painting.
- 30:07Yeah, this is like I want to say, exact little over a year
- 30:11ago, maybe 13 14 months ago before the summer of AI really
- 30:14kicked off last year. I was deep into Nerfs at that
- 30:18point and I was like, oh, this generator stuff.
- 30:20I've seen some of the Gann instantiations.
- 30:22It always looks like this melty human, it's gonna suck and then
- 30:25I used in painting to make some like, you know, Mothership UFOs
- 30:29in. Oh my God, I'm you attend.
- 30:32Like, of course, you know, it's like a very predictable and so
- 30:34when I did that, I saw the holy crap, it got the lighting,
- 30:37right? The sun Direction, like holy
- 30:39shit. Reflections look, good.
- 30:40Like all the stuff that you would have done manually
- 30:42otherwise right with like hdri lighting and just approximating
- 30:46stuff manually in like my or whatever.
- 30:49It kind of the model was able to reason about it or at least like
- 30:53give the illusion that it's a reasoning about these things and
- 30:55produce a compelling and result. But man, like, nobody really.
- 30:59Like there was like a small number of craters that were
- 31:01making stuff with Dolly to in painting, and we were all
- 31:03calling it in painting and a I fast forward a year, the de
- 31:08facto image Earning software. Adobe Photoshop, right?
- 31:11Like is like, hey we got this new beta, it's called generative
- 31:14Phil. Yeah, people are using it.
- 31:16It's spawn and higher categories of memes.
- 31:18I made a random video where it took like Tim Tim Sweeney's like
- 31:22photo of a hike and just added like a dinosaur and like a bear
- 31:25drinking beer together and like I got a million views for some
- 31:28reason and so like you're seeing people use it and adopt a I now.
- 31:32But without talking about it like a i there's just like, hey,
- 31:35it's the cool new feature in Photoshop that thing I already
- 31:38love. I think the same is going to
- 31:40happen which hatch, epts capabilities, like obviously,
- 31:43like I'm a little biased, but I think like Google is going to
- 31:46crush it here. Like it's the biggest search
- 31:48engine. There's Gmail, there's docks.
- 31:50All these things that a bunch of early adopters, even like me are
- 31:53using Chrome extensions for when it's just in your tool and
- 31:58you're writing a dock and it gives you better autocomplete or
- 32:01an ocean like they've added the AI feature, I think people will
- 32:04start using an adopting a, I but I'll be in a way.
- 32:06It's kind of transparent to them, they don't care.
- 32:09About what the underlying model is it just like gets the job
- 32:12done for them and I think we're at the very early days of that
- 32:15adoption curve, right? Like, I think we got maybe even
- 32:19optimistically like three years before like everyone's kind of
- 32:22hard about this thing. Yeah, maybe longer who knows?
- 32:26It's I just I just one thing. Sorry.
- 32:28When you brought when you brought up the concept of memes
- 32:31regenerative, feel have you guys seen the PornHub memes, know,
- 32:34like, I'm not even joking, like, it's literally an image.
- 32:37I mean, it's nothing bad. It's just an image, probably
- 32:40like a thumbnail of what the porn thumbnail.
- 32:43But yeah, I guess and like they do it tonight problem.
- 32:45Guess you wanted? Yeah, and it's like, they're
- 32:48just like dancing together with clothes on.
- 32:50That's probably the funniest generative films.
- 32:52I've seen that's awesome. One thing I think your point of
- 32:56view was really interesting. I had the same point of view
- 32:59about NF tizen, web three, the nfc's and web tree will get Mass
- 33:03adoption. When people use a Nifty without
- 33:06knowing they're using an FTP such hundred percent.
- 33:08So So the same thing, I think what you brought up with AI is
- 33:11actually very, very true. Like what I do be did with the
- 33:13generative feel is exactly the same moment that o AI.
- 33:17What is a I know. I'm just typing something and
- 33:19clicking a button and it happens.
- 33:21Oh that's a i cool like this like magic, it should just
- 33:24happen without you even fucking know.
- 33:26So I believe that timid every technology that applies like
- 33:29people don't care about the terms, people don't care about
- 33:32the technology, people don't care.
- 33:33How hard is it to do that thing? People just want to do things
- 33:37faster and easier. So the moment Achieve that, you
- 33:40know, it will adopt it. Yeah, I generally agree with
- 33:43that as well and you brought up adobe.
- 33:45We were talking about this because like Adobe could have
- 33:48died out if they were just like not giving a fuck.
- 33:52It's so funny because like all these smaller companies were
- 33:55like, yeah, we have this cool technology Photoshop killer.
- 33:57They were like, what is? I was like yo we were doing this
- 34:01to by the way. We didn't know.
- 34:02And then they do it and now because like, you mentioned
- 34:04Photoshop has always been to go to software for editing and now
- 34:08like, Like I'm sorry, but all the other smaller companies.
- 34:12They now just going to have such a hard time because I people are
- 34:14already used to photoshop. That was the brilliant move.
- 34:17I hope every other companies trying to make we made a switch
- 34:20to DaVinci Resolve recently, and black magic has their own AI
- 34:23tools. Yeah.
- 34:25It's like they are amazing and there's reasons why so many
- 34:28craters switch to DaVinci Resolve, but now I'm like, did I
- 34:32make the right fucking move? Because like, Premier pie looks
- 34:34like that Meme. That is looking at what the hell
- 34:36man. Fucking at the end of this
- 34:40lady's, I just switch. I learned everything and now,
- 34:43but I hope black magic really brings a.
- 34:45I think it's one thing. Even if black magic does bring
- 34:48a, i it's like they will not have a never have access to the
- 34:52amount of I guess data that adobe has access to, because of
- 34:57the previous, you know, user base.
- 34:59Yeah, exactly. The user base and I'm looking
- 35:02forward to it. But the Adobe Firefly for video
- 35:04like making your own sound effects adding color grading
- 35:08transcripting All this stuff that is going to have a i
- 35:10integrated is going to make everything so much easier, but
- 35:13at the same time, you have people like Runway ml who are
- 35:17just trying to completely demolish.
- 35:19The way we do editing just like type it in bro.
- 35:22Like everything you want, just type it in.
- 35:23Will make it happen. It's gonna be really crazy
- 35:26seeing. All of this is like a taco far,
- 35:27you know, like who's pulling, who's Brent people.
- 35:30I don't know. That's actually the exact writer
- 35:34analogy. It's like, it's like a
- 35:35tug-of-war. It's like, it's like the one.
- 35:38One side of it is like, and then they're kind of converging
- 35:40towards each other and this theme, like kind of has happened
- 35:43it, like you probably noticed. This would like, you know,
- 35:46real-time and offline rendering sort of went through this sort
- 35:48of phase where it's like, initially there were so
- 35:51different, right? Like unity and unreal, but then
- 35:53they start getting more and more, photorealistic and better
- 35:55and better and better. And same thing happened with
- 35:57like, you know, redshift and octane.
- 35:59It's like okay, there was the days of renderman and Arnold,
- 36:02and Nondescript warehouses are just, like, CPUs crunching like
- 36:06four days on a frame of video or something and then slowly, like,
- 36:10oh yeah, you got to Nvidia GPU, you got some Cuda like, okay,
- 36:13cool? Red shift octane way faster, you
- 36:14can do motion graphic stuff and they start the offline stuff
- 36:17started getting more real time. And so I think like the, the way
- 36:21these companies like the incumbent and then the the
- 36:23upstarts that are challenging, their dominance are approaching.
- 36:26It is like the same thing as a tug-of-war is a beautiful
- 36:29analogy. If I may like build on that a
- 36:30little bit, it's like it's like AI I just want to bring out my
- 36:33popcorn, which is why it's so fun right now.
- 36:36It's like because like we're sure to have unbiased in this
- 36:38rate. We'll use the best tool for the
- 36:39job. There's nothing that locks Us in
- 36:42though. I do want to come back to
- 36:43DaVinci. It's like I'll come back to it
- 36:45later because like Oprah beers just so unstable.
- 36:47Sometimes it just like but it's like after effects.
- 36:50I can't leave it but Premier is like you know, people like Matt
- 36:54wolf or like hey man results pretty good.
- 36:56Like yes, never crashes on you. Same thing with the corridor
- 36:59folks. Oh, but tear tug-of-war.
- 37:01It's like Going to meet users where they are.
- 37:04They've got distribution. It's the same thing with Google,
- 37:06right? Like they've got these surfaces,
- 37:08these billion users surfaces and Adobe.
- 37:10I don't know what their exact Photoshop numbers are life, but
- 37:13I would assume they're at least tens of millions, if not
- 37:15hundreds of millions of users, right?
- 37:17And so, like, let's meet users where they are in a fuse AI in a
- 37:20way that's transparent to them. Take advantage of distribution,
- 37:22brand, awareness, all that. On the other hand, I think
- 37:25Runway can't do that, right? Like so Runway has to reinvent
- 37:29how creation is done because if they just made another slightly,
- 37:32Modified version of After Effects, which is what it seemed
- 37:35like to me. Like, I've been following Runway
- 37:37from the start when it was more about like, segmentation and
- 37:40green screen without a green screen and stuff like that.
- 37:42It felt like a like a replacement for After Effects.
- 37:45Hey, if you have lightweight compositing tasks or editing
- 37:48tasks, do it here but now where they're going with Jen hwan and
- 37:51Gentoo and sort of the generative models that started
- 37:54ostensibly with that Layton diffusion paper, right?
- 37:56Like, I think it's super exciting to see what sort of
- 37:59Paradigm emerges, but that's the, I would say, Be the billion
- 38:03are trillion dollar question is like, what is that new creation
- 38:06Paradigm? I'm not convinced it's text.
- 38:08I think like that's a deeply unsatisfying way for me to work
- 38:11with this stuff. So I think maybe it'll be
- 38:14interesting to see sort of like another example is perhaps
- 38:16descript and Premiere. And then you're talking about
- 38:19resolved to descript almost opens up editing to an entirely
- 38:23new audience, right? Like there's a class of people
- 38:26that will never learn Premier resolved.
- 38:29Maybe we're, you know, we're into this stuff but most people
- 38:33working at some company that want to make like, you know,
- 38:35like we're even a solopreneur that wants to make package up
- 38:38there webinar or whatever. They're like I can use docks and
- 38:42I know how to work in a deck. Okay, if I can do that now you
- 38:45can make a video with like, you know, with the amazing
- 38:47capabilities in descript. So I think like that's it opens
- 38:51up editing to a new class of users.
- 38:53At the same time Premiere, obviously is like sort of giving
- 38:56you that sort of training wheel mode inside of Premier itself,
- 39:00which is also interesting. But I again think Though, always
- 39:04meet like Target different audiences, right?
- 39:06Like somebody who's in an in description.
- 39:07So in other words, it's a tug-of-war and in another way
- 39:11it's also an expansion of the pie.
- 39:13Like you're opening up these new forms of creation to entirely
- 39:16new set of users. That might have never bothered
- 39:18with this stuff now. I do think the web-based tool
- 39:21that adobe's building for podcast editing and and all that
- 39:25type of stuff is more directly competing with something like
- 39:28descript. And so I'm excited, like, I'm
- 39:30excited to have ai tools today. Because they fit in your
- 39:33workflow but I'm also excited to see what are the net new
- 39:36workflows that emerge in like how that brings a bunch of
- 39:39people to create that weren't creating like?
- 39:42I mean one of my friends on Twitter is like Heather Heather
- 39:44is like you know like the mom of two in like Atlanta you know
- 39:49working on you know completely different stuff has her day job
- 39:53and then she somehow got into a IR has like 15K followers or 20K
- 39:56followers on Twitter now. It's like I don't think that
- 39:59would have happened that quickly if not for a ISO.
- 40:02Going to be interesting to see sort of what the landscape looks
- 40:06like just in a couple years from now.
- 40:07But yeah I love that love that visual of sort of the the tug of
- 40:11war if you will. Yeah.
- 40:13You see the thing is like you mentioned Heather.
- 40:16We don't know Heather. But that's a great example to
- 40:19bring up. There's other people like mr.
- 40:20Grateful who using Chad gbt as an agent was able to achieve a
- 40:25hundred thousand, you know, followers on Instagram.
- 40:27Whereas I would assume if it wasn't for Chad GPT probably.
- 40:32Be able to or wouldn't have the motivation to write it was
- 40:35because of Chachi Beauty was like, you know what, I'm gonna I
- 40:37want to make a challenge and he started a new challenge which is
- 40:41I'm going to get a hundred thousand dollars in revenue
- 40:43revenue again using charge. Yeah.
- 40:46Using tragedy, which to me, it sounds crazy.
- 40:49But dude, he didn't hundred K in terms of followers which is not
- 40:53an easy feat for a lot of people actually on Instagram.
- 40:56Yeah, there you go. And he did it and like if he
- 40:58makes a hundred K, it just goes to show.
- 41:01Damn, you can She do so much with all these AI agents that so
- 41:06many people are afraid of because they are afraid of
- 41:09losing. Oh, my goodness, y'all.
- 41:11I'm not gonna, I'm sorry, I just so we have our laptop open here
- 41:15and I just saw metahuman animator as an update.
- 41:18So we're deeply into metahumans and they just announced this new
- 41:21update that makes facial mocap like 10x better and I just saw
- 41:25holy shit. Anyway.
- 41:26Sorry about that. Are you go the virtual podcast?
- 41:28You got it. Ha ha ha.
- 41:30Like this needs to be done. It needs to be done, man.
- 41:34But essentially speaking, we believe that all these AI tools
- 41:37can help enhance everybody's life if we know how to use them.
- 41:41Now, I want us to come back to AI again and we're going to
- 41:44because I know a lot of people are interested in listening to
- 41:46your approaches and different things, but I want to take a
- 41:49step back and let's talk about something that was announced a
- 41:52few days ago and that is nothing but the Apple Vision Pro
- 41:55headset. So you were doing the review of
- 42:00the announcement if you will. There was being announced, you
- 42:03had a video sort of podcast with another friend of yours.
- 42:07And we were watching some of the things you guys were talking
- 42:09about. We also did our very own version
- 42:11as well. And I guess what I want to ask
- 42:14you as someone who's worked in Google as someone who's been,
- 42:16you know, extremely fascinated with the latest technology
- 42:20developments, you watch the division pronouncement.
- 42:24There's people who are optimistic about it.
- 42:26There's people who are pessimistic about it, we want to
- 42:29get your thoughts. First of all, what did you
- 42:31think? Apple.
- 42:32Did, right? That's the first question within
- 42:35that presentation. Gosh.
- 42:37I think Apple just like made VR cool to put a very ugly in my
- 42:43opinion. Like, okay, there's something,
- 42:45you know, I wouldn't give them like a 10 out of 10 and give
- 42:48them like eight and a half. Like there was definitely the
- 42:49scene with the dad, with the cooking.
- 42:52Everyone is called daughter. I was like only apples reality.
- 42:56Distortion field is such that they can be like you know what?
- 42:58We expect people in the house just have this on all day.
- 43:01It's your frickin is burned. It's in there with like a for
- 43:04you also. Don't talk to me blond.
- 43:07Those two, and it was the creepy smile to Dad was giving and
- 43:12caring at them like this. I'm like, oh my God, I can't
- 43:14believe they actually did that. I agree.
- 43:16So yeah. Do you know, like a little rough
- 43:18around the edges? I think they focus far more on
- 43:20like a soul experience but in terms of what they did, right?
- 43:22I think they finally made VR a good word, right?
- 43:25Like, I think for whatever reason, whether it was like the
- 43:29conflation with web, three weather was like, Meadows
- 43:31rebranding. Whether it was just like how
- 43:33people were feeling about social media and sort of technology
- 43:36that sort of pulls you away from the world, whatever the reason
- 43:39was it sort of like, petered out, like the investment in a RV
- 43:43are both, to be honest, kind of petered out.
- 43:45And so I think like apple entering this new product
- 43:48category that ostensibly Zach has been carrying, right?
- 43:51Like for a while with Quest, really selling subsidized,
- 43:55headset to just drive that sort of install base.
- 43:58I think makes this very interesting, right?
- 44:00Like so now Google and Samsung her and come out with a headset,
- 44:02obviously sucks got his like Quest 3 coming out and the pro
- 44:06already and then you've got Apple in the play.
- 44:08Like I think what Apple announced is like the Tesla
- 44:11Roadster is this like really expensive, you know, Cutting
- 44:15Edge, like the amount of technology that they managed to
- 44:17squeeze into that device. Craze on inspiring to me, like
- 44:20I've used almost every headset, there is other than the Vision
- 44:23Pro and like I cannot wait to get my hands on it and the fact
- 44:27that even jaded press that have tried all of that stuff like
- 44:30tried in there, having the sort of oh wow experience I think
- 44:34just is like just goes to show. It's going to be an amazing
- 44:36device for uppers to build on specifically because unlike
- 44:40every other device that uses these Qualcomm chips, they've
- 44:43got that split compute architecture.
- 44:45You've got this like am to chip just for the developer and then
- 44:49you've got these like 12 cameras and a bunch of other crazy
- 44:51sensors. And there's a dedicated, our
- 44:54chip, our one chip just to process that which is awesome
- 44:57for developer experience. Because like, I don't have to
- 45:00worry about, like, my whole experience, getting laggy,
- 45:03because I'm hogging too much compute.
- 45:05And suddenly, the slam tracking is flowing.
- 45:07Down or whatever. I think this is like, a really
- 45:10expensive sports car. It's great for a RV.
- 45:12Our developers that want to develop for the like model 3
- 45:16version that will eventually follow.
- 45:19And at the same time for early adopters, I think the picture is
- 45:21pretty interesting, which is if you want a massive media
- 45:24consumption device like this is, this is the way to do it and
- 45:28we've sort of seen APPL like laying breadcrumbs towards this,
- 45:32I like to call it like apples. Focus is connecting living
- 45:35rooms, you know, even to UW DC's ago, I've been writing about
- 45:38this apple stuff for a while. It's like to WWDC is ago.
- 45:41They announced this thing called like share play.
- 45:44So if you're in a FaceTime call you can suddenly share Tick-Tock
- 45:47this play or Apple TV and if you have you know like are pods.
- 45:51You get the spatial audio experience.
- 45:53Sort of like if we're sitting in a room we're talking about the
- 45:55virtual podcast like oh your sound is coming like spatialize
- 45:59from where you might be sitting and it was like yo that's the
- 46:02most Overkill feature to announce if you're just like, on
- 46:06a zoom watching some me. Together.
- 46:07Like why is Apple doing this? And obviously, there's so
- 46:10patient, they've just been layering these capabilities
- 46:13Brick by Brick. And so now finally we're seeing
- 46:16like they're sort of early adopter had kit, you know,
- 46:18headset, you know, kind of device hitting the market best
- 46:22believe. They're not entering this in a
- 46:24product category if they don't have like and other devices.
- 46:27Like the specs for this was finalized in 2016 because
- 46:30Harvard Hardware has just such crazy lead times.
- 46:33And so I'm like they knew then that this premium device was the
- 46:36way to go and the specs are beyond anything the vario.
- 46:39Nothing else freaking comes close.
- 46:41So I'm super excited. They did that right now.
- 46:43There's going to be metal versus going.
- 46:45To stop being a bad word, even though nobody, even though Apple
- 46:48doesn't even say metaverse, but it's going to revitalize
- 46:51investment in it. Because developers now have this
- 46:53new sort of ecosystem, that's typically pretty lucrative when
- 46:57it comes to Apples, like app stores and ecosystems to build
- 47:00on. So, I think it's going to be a
- 47:02Renaissance in a rvr, and I can't be more thrilled about it.
- 47:08Okay, first of all we we had sort of the same feelings
- 47:13towards everything. That Apple announced we were
- 47:15more on the excited side of things even though we did some
- 47:18negative comments and socials people still you know calling it
- 47:21too expensive. The thing is we understand the
- 47:23pricing like you cannot have what 45,000 patterns or 500
- 47:28patterns more than that but you cannot you cannot have all these
- 47:31unique Technologies built into this headset and have it be at
- 47:35500 bucks, which is like the The new headset that's coming out by
- 47:38meta. This is clearly different here
- 47:41and like you mentioned, this is gonna be the first version for
- 47:44developers to start building and then the other models which are
- 47:48going to come at a cheaper price, probably with less specs
- 47:50are going to come out eventually.
- 47:53Now one thing you brought up was social, a are so we come from a
- 47:56background where used to create a, our experiences, a lot for
- 48:00Brands and for our clients and I'm sure you working, you know,
- 48:04in the same field of augmented reality, you know, a lot of
- 48:06People who create social a, our experiences for themselves for
- 48:10socials, or for brands. Do you think that as someone who
- 48:15creates a our experiences or is into VR?
- 48:17They should be quickly. Making a switch into, you know,
- 48:22creating for vision produce. See that being the future and
- 48:26not social errors or do you think know they will each have
- 48:28their place or know? This is going to take over what
- 48:31we do right now, we essentially take out phone and, you know, we
- 48:36Of the, our experience. And the reason I ask that is
- 48:39because the software they're partnering with is unity.
- 48:41And so, a lot of a, our experience, they are using Unity
- 48:44to write, like Google is using Unity.
- 48:46So now, there is this mindset of, okay?
- 48:48If I go and learn Unity, I can build for Apple Vision Pro, I
- 48:53can work on the Google a our kit, as well at the same time.
- 48:57So what do you think about that? You know, it's like the way I
- 49:02break up a our experiences is into like front facing and World
- 49:05facing Right? And and the vast majority of
- 49:09filters that stole Drive Impressions.
- 49:11Like I think it's like 80 or 90% of snaps from your usage is
- 49:15always yeah. Like it's like you know it's a
- 49:18personal messaging app and I think they see the same thing on
- 49:21like you know if you're developing example for
- 49:23Instagram, right? Like you go to story mode.
- 49:25Usually you default opening up towards your face, right?
- 49:28It's self-expression. So I think that's not going to
- 49:30change and I don't see the Apple headset like dabbling in that
- 49:34world. Right?
- 49:34Like in fact I would actually Sighs Apple here and say, is
- 49:37like, I such higher hopes, for reality composure when it came
- 49:40out in 2017, like it kind of was cool.
- 49:43And like, you could like, you know, send each other, you sdz
- 49:46files over, like I message and you could open them up but they
- 49:50never really turned that into sort of like a lens experience.
- 49:52Like a Snapchat style lens that you could easily share or
- 49:56certainly never leaned into it. All that happen in these sort of
- 49:59Walled Gardens of Snapchat, you know, Facebook or Meadows.
- 50:01Swedes, you know, Google stuff, etc.
- 50:03Etc. And so I think like that front.
- 50:06Think stuff given how you know, we are self expressive and in
- 50:10care about ourselves and really like to take photos of
- 50:12ourselves, I don't see that changing now.
- 50:14The world spacing stuff has always been hard on mobile.
- 50:17Your, you know, you probably know this.
- 50:19It's like you talked about the waving the phone, I call it
- 50:21doing the sixth off Dances Like, okay, cool.
- 50:25Like and you've got this like sort of you know, if you really
- 50:29want to put the marketing hyperbole on it, we can say the
- 50:31Magic Window experience, but the freaking tiny window, right?
- 50:34Yeah, the fact that that window is now on your face.
- 50:36It and that it is this crazy pass through device.
- 50:40There was this headset company that Apple acquired called
- 50:42Nirvana vrv. Aana that had a similar demo
- 50:45like just really high quality pass through combined with sort
- 50:49of like the updates. They've got to their like
- 50:52mapping like, you know, like what is it called?
- 50:55I forgot room room capture API and their object capture apis.
- 50:58Just like it's going to be it's going to turn the world into
- 51:01much more Immaculate canvas indoors.
- 51:04So I think what's going to happen is like people are going
- 51:06to Love creating World facing room-scale experiences.
- 51:10And if you have those same shops and a are, I absolutely think
- 51:14you should be taking Apple. Seriously, like maybe not for
- 51:17Gen 1, because like, maybe the cell, like millions of units,
- 51:20maybe, tens of millions of units.
- 51:22I'd be surprised if it's more than that.
- 51:24And so that's not exactly a massive, you know, addressable
- 51:27Market to make a bunch of money. But again, we're talking about,
- 51:31that's the iPhone Pro will get the iPhone and the iPhone SE
- 51:35eventually, so you I'd get into this ecosystem for sure, but I
- 51:39kind of see like self-expressive a are especially given you have
- 51:42the headset. And yes, there's ways to use
- 51:44neural avatars to, like, use the eye tracking data to, like, kind
- 51:48of, you know, unmask you. I love that feature, by the way,
- 51:50like all the rumors were right. It's like I made this laundry
- 51:53list of rumors with actually another person who's
- 51:56vancouver-based Tobias Chen and like all the rumors were
- 52:00absolutely freaking on point. So I think there's going to be a
- 52:04place for social media distribution.
- 52:06With like, you know, in a front-facing like kind of a are
- 52:10and then the world facing stuff. I think we'll find a nice home
- 52:13at a place here, you know, in the, in the Apple ecosystem, we
- 52:18may even see a throwback to remember, when a r XR.
- 52:22Activations were super hot. Everybody was like, oh yeah,
- 52:25let's go do place-based, you know, this thing with the there
- 52:28was like the was a company, Disney had totally blanking on.
- 52:33They did a bunch of Star Wars IP where you could like, you know,
- 52:35basically experience this. In a theme park ride.
- 52:37Well, Matt, I think we may see a Resurgence of that sort of these
- 52:40activations built around these headsets.
- 52:43But yeah, that's how I think it's going to pan out.
- 52:45I'll be legit like a new canvas, it's not going to impact the
- 52:48perhaps the self-expressive. Like gosh what are the most
- 52:51popular filters on Tick-Tock? It's like the green screen
- 52:53filter. Yeah, everyone watching the
- 52:55screen is the one that turns you into an anime character, a our
- 53:04experiences we would spend so long to King to make Ward
- 53:08experiences, you know, spend days and the amount of
- 53:11impression and Views it got, it was in comparable to those that
- 53:14we made in a day. It was a phase filter.
- 53:16So. So it's like the effort and the
- 53:18impression. But what you said was dried,
- 53:20like, people really like the self-expression more video in
- 53:23our experience self-expression is almost invariably the bear,
- 53:26the better filter when it comes to Brand exposure.
- 53:29And that's mainly because, like you mentioned self-expression,
- 53:32what do you think about the whole Unity versus unreal think?
- 53:36So, Clearly we missed out on this for some reason we didn't
- 53:39fucking bring it up in our video but afterwards I was like holy
- 53:43shit. I remember apple and unreal had
- 53:46beef over, you know, Fortnight at one point what you'll do?
- 53:49Yeah. Yeah still do that work?
- 53:51A still on I think. Yeah, that's never gonna be
- 53:54resolved. The way they started the whole
- 53:56thing, but for anybody, that doesn't know, essentially, Apple
- 53:59does take a 30% cut, I believe on everything in the App Store
- 54:03and epic games had issues with that, specifically with the They
- 54:07were working with the, you know, apples and for night being the
- 54:10game that makes a shitload of money.
- 54:13I assume that's, that's where the problem started, but I don't
- 54:16know the full details of how the court case, when I do know that
- 54:19I actually did, there was nine out of ten cases, Apple was not
- 54:22guilty in one, they were. Apparently did just a little bit
- 54:25of research on that. But generally speaking, what do
- 54:27you think about their choice with going for Unity?
- 54:29And how do you think that's going to play out?
- 54:30Do you think Apple made the right move?
- 54:32Ready, are you team unity or team on real first of all
- 54:35because you both Kind of lean. I lean a little bit more unreal
- 54:39to be very okay if you just because I love the photo realism
- 54:43and like even with all the geospatial data like it's just
- 54:45so much for easy and fun to get that stuff.
- 54:48Looking good you know in Unreal Engine and this the whole
- 54:52virtual production angle that they leaned into.
- 54:54So I've always been a fan of unreal, I think it's not a
- 54:58surprise to anyone to know that like a vast majority of games
- 55:02that are mobile based on any app store are going to be Unity
- 55:05based, right? So it's a Very, very popular
- 55:08amongst the apps that are actually making direct revenue
- 55:11for themselves and obviously getting that choose heat, 30%
- 55:14cut an apple and so like, so yeah, I thought that was the
- 55:17elephant in the room. Like that's one of the things I
- 55:19definitely wrote about is like, look, it's kind of did data,
- 55:23unreal, shoot themselves in the foot like or epic shoot
- 55:26themselves in the foot with this apple debacle?
- 55:28I don't know. I think like, we'll see how that
- 55:29plays out. Maybe you'll still be able to
- 55:32develop a for the Vision Pro with unreal.
- 55:35I suspect there will I'll be a lot of AAA developers are like,
- 55:38yo, my games based on unreal, like, like I need to have access
- 55:42to the low level functionality that they seem to be giving
- 55:45Unity. So it does seem Unity got a
- 55:47pretty sweet deal like whatever the reality Os or whatever the
- 55:51new term for it xros. Whatever it is it does allow you
- 55:55like Unity files or treated at this like this lower level
- 55:58Primitives so you can get access to a lot of the system
- 56:01functionality and build a richer experiences essentially.
- 56:03Right? So I think that's really good
- 56:05for Unity. I think it probably Also State
- 56:07save their stock price, you know.
- 56:09Like so I invested in unity early and I was kind of
- 56:12disappointed with sort of how things were trending and yeah,
- 56:15like it was funny after the after the event was like, apple
- 56:18was down 2%, Unity was up close and it's like, so I think it's
- 56:24gonna be great for Unity developers.
- 56:26It's obviously far more accessible to the average
- 56:28Creator and developer in my opinion.
- 56:30That Unreal Engine. Maybe if you come from a 3D ish
- 56:33background. Yeah, it's a little bit easy
- 56:35like oh yeah, you use Or whatever, maybe you like the new
- 56:37node based workflow, but C Sharps easier than C++.
- 56:41It's harder to mess up and in unity than it is in in unreal.
- 56:46So I think like look, those are the two big game engines and
- 56:49it's funny how the industry always ends up with this
- 56:51oligopoly, sort of format, you end up like it's like, what else
- 56:54is there? It's like, okay, you got Unity,
- 56:56unreal, and there's Godot. Who the hell uses?
- 56:58Yeah. Like, I don't like maybe some,
- 57:01he's like in a niche games, use it, but like, yes, I think like
- 57:05they're going to have to support unreal.
- 57:06What level? I don't know.
- 57:08Maybe unreal will be on the hook to build their own stuff.
- 57:10That's what if I had to speculate, I would assume that
- 57:13there's some sort of like really nice deal between unity and
- 57:15unreal world. They're working together to
- 57:17build the stuff out. Whereas for unreal, Navy more
- 57:20harms length, but like unreal will stole get enough pressure
- 57:23from developers to build on it. So don't be worried is I guess
- 57:27what I'm saying that all gosh, like actually had a crater like
- 57:30Sam from soak, you know, works on so crispy media.
- 57:33He did the, the video the The squid game video for mr.
- 57:37Beast. Yeah.
- 57:39So that dude was like, yo, man. Like, I've got the all this
- 57:42stuff in unreal. I'm I screwed.
- 57:43It's like, no, I don't think so. It just might be a little bit
- 57:46harder to Port. So yeah, all these like, you
- 57:50know, Frenemy relationships as I like to call these companies are
- 57:53friends in one way enemies and other it's like, what a tangled
- 57:56web, we weave, you know? So you know, who knows how that
- 57:59will play out. But it does certainly seem like
- 58:01Unity got the better deal right now first, he nailed it though.
- 58:05He did you nailed it? Reason why a lot of people love
- 58:08unreal is just a beauty and a photo realism that you can
- 58:11achieve the real time. You got the nanite, the Lumen
- 58:14with unity is just like, it's easier to develop and it's more
- 58:17versatile. And so, we are not at all
- 58:21saying, Unity was the wrong choice.
- 58:23Definitely is a fascinating choice to go.
- 58:26It is just we as unreal people would have expected people.
- 58:30Not real people. We would have loved to see
- 58:32unreal. There's oh, but unfortunately,
- 58:33didn't I did see a screenshot of unreal.
- 58:36During the the plugin for Vision Pro so they did.
- 58:40You definitely going to be able to develop for a just like that.
- 58:43You're probably not going to get as much support as Unity will be
- 58:45getting along the way which is, I think Unity will have a better
- 58:48Pipeline and of workflow. So it's much easier to which is
- 58:51always a great thing to have to try to develop apps and things
- 58:54like that. But I was also funny related to
- 58:57this that you'll get a kick out of this is like, you know, it
- 58:59did you see the freaking the dinosaur content?
- 59:02That was showcased? Yeah, with the reality.
- 59:04Yeah, it was one of the main demos and this is See, like, you
- 59:07know, the who's who of like, you know, making these amazing
- 59:10amazing Jon Favreau at all, making the stuff, the Hans
- 59:13Zimmer soundtrack. I can't wait to watch that
- 59:14full-length oh yeah, with Prehistoric planet to but
- 59:17apparently the dinosaurs were rendered in unity and I was like
- 59:21wait that's weird. Like is in John like a big on
- 59:24real guy. Give it all the other movies
- 59:26that they've worked on and started digging into it.
- 59:28Apparently for Lion King they had Unity was like the virtual
- 59:32production thing onset. Yeah.
- 59:33Maybe that was just like they built some proprietary.
- 59:36Line, there's a company magnum, opus that Ben Grossman Academy
- 59:39Award winner. That was involved there.
- 59:41So, yeah, it's interesting that those diners are dinosaurs are
- 59:45like frickin and in unity and also like a, who's the gentleman
- 59:49that directed District 9? This room that I remember that?
- 59:54The, the movie ride out, like super old a couple of years ago.
- 59:57Right? Neil, blomkamp's, he did a bunch
- 1:00:00of stuff with unity to. That was more cinematic.
- 1:00:02So I guess you can like, what a couple of Lee might like you.
- 1:00:06Deep Harris were telling me not who you got some really photo
- 1:00:09realistic results from, you know, Unity as well.
- 1:00:11Have you checked X y&z out and so I guess you can do that.
- 1:00:14But like, let's be honest. It's easier and unreal, right?
- 1:00:17Yeah. Anyway, so yeah.
- 1:00:19Well, yeah, I agreed that since we are on this topic, I want to
- 1:00:22talk to you about the recent Obsession that we have found.
- 1:00:26So, we discovered nerves and we discovered that they could bring
- 1:00:30nerves into Unreal, Engine 5, and that has been a very costly
- 1:00:34hobby. So we had to buy a drone.
- 1:00:37I'm scanning environments and this has really changed like
- 1:00:41ever since whoever, we talked to specially filmmakers directors,
- 1:00:44people even people from Hollywood, we are telling them
- 1:00:47that this is going to change. The filmmaking industry, this is
- 1:00:51going to change the production industry.
- 1:00:53The reason is with a small drone and a DJ I brought three any Pro
- 1:00:583 which is like not not that exotic, you do not expensive,
- 1:01:01not that, you know, not the highest model we could scan
- 1:01:04environments that are photo. Mystic bring into Unreal, Engine
- 1:01:085, add some filters and you know, color grading.
- 1:01:11We could get an environment that it would take weeks maybe even
- 1:01:15months to build in just a matter of minutes.
- 1:01:19So it's been crazy how things can change with nerves and you
- 1:01:23know Unreal Engine and since you have worked a lot on nurse and
- 1:01:26I've seen Billy you've been doing videos.
- 1:01:28But what do you think? Like, if you are at this stage
- 1:01:31now? What do you what do you think is
- 1:01:32going to happen in the future? And I'm so excited about neural,
- 1:01:36Radiance fields and just generally how I think of it as
- 1:01:38like reality capture, right? Because this technology isn't
- 1:01:43new, right? Like photogrammetry has been a
- 1:01:44thing since the 1800s to be honest.
- 1:01:46Like it. This is like people were flying
- 1:01:48putting cameras, film cameras on kites and doing like, manual
- 1:01:52triangulation math to like, you know, create some real,
- 1:01:55especially in geospatial and all this other stuff.
- 1:01:58Obviously, I think like we saw this wave, the first wave of
- 1:02:01what you just described happen with like games like Battlefront
- 1:02:05and you know Star Wars Battlefront and Call of Duty
- 1:02:08we're tier points. Like would you want to create
- 1:02:10these like sort of complex Virtual Worlds, you know?
- 1:02:13It was easier for people to go like this you know for
- 1:02:16Battlefront they went to all these like locations where the
- 1:02:19Star Wars movies were filmed like and or like all the forest
- 1:02:22scenes and all that stuff and just scan the crap out of
- 1:02:25everything. So we had this sort of like
- 1:02:27perfect Confluence of like sensors getting better like
- 1:02:30mirrorless Sony, cameras like a a7r series, like 50 megapixels
- 1:02:35like, oh my God, like then that's been around for like six
- 1:02:37or seven years now. And it's the same thing.
- 1:02:39Then, like, you saw this crap like this crop of sorry, there's
- 1:02:43a problem, it's like a me and I'll put a room, she's in
- 1:02:48perfect Freudian slip up but not to jump ahead of myself like
- 1:02:52these cameras got better so people could go like capture
- 1:02:55even for Call of Duty. Hey let's just go scan stuff in
- 1:02:58the freaking like a nondescript parking lot in Los Angeles and
- 1:03:02use that to Kit bash and Populate the complexity in a
- 1:03:05scene. Right.
- 1:03:05So like this idea of digitizing reality and then sort of Kit
- 1:03:09bashing, it started with photogrammetry and obviously the
- 1:03:12output of photogrammetry was just like in many ways closer to
- 1:03:16what engines could deal with because it's just a triangulated
- 1:03:19mesh but at the same time it had all these problems that Nerfs
- 1:03:22have today that I think will get solved also which is like you
- 1:03:25end up with this like crappy looking texture, Atlas and you
- 1:03:28usually have to read apologize, it and blah blah, blah, and do
- 1:03:31all this stuff to it. You started seeing that in like
- 1:03:34AAA games and then suddenly you saw like a bunch of these
- 1:03:36blender artists doing the same thing with photo scanning and
- 1:03:40projection mapping. Like I'm blanking on the
- 1:03:42gentleman's name right now but he created this like sci-fi like
- 1:03:46futuristic dystopian Tokyo World Ian he begins a couple years ago
- 1:03:54just using like reality capture or agisoft metal shape combined
- 1:03:58with basic projection mapping of the plate to create these like
- 1:04:01set extensions and complete scenes that just like To me was
- 1:04:04like, yo, this took like whether digital and ilm an army of
- 1:04:08people and like a solo artist can do this.
- 1:04:11Now, I think Nerfs added onto photogrammetry by allowing us to
- 1:04:16capture a lot more of the complexity of reality that
- 1:04:19photogrammetry sucks with right? Like so photogrammetry uses
- 1:04:22multi-view stereo you compute these depth maps and like you
- 1:04:25know, and then you do like all sorts of stuff like some sort of
- 1:04:27poisson meshing to create continuous surfaces.
- 1:04:30But what do you do with Reflections and refractions?
- 1:04:33What do you do with transparency?
- 1:04:34Surfaces, what do you deal with like really thin ornate
- 1:04:37structures? All these things would be like
- 1:04:40sort of failure cases for photogrametry and like this this
- 1:04:43line of like essentially pseudo light-filled style research, you
- 1:04:47know, with the, you know, local light-filled Fusion, the Deep
- 1:04:49view paper and then the you know, really really seminal Nerf
- 1:04:53paper sort of brought that like volumetric light field quality
- 1:04:57to reality capture at some semblance of scale, right?
- 1:05:00And I think like really the moment of scale happened last
- 1:05:04Last year when it's like I remember in January I was
- 1:05:07playing with narcs and like you have to use Michener, find it
- 1:05:09like took like 12 hours to train on a TPU and then Nvidia came
- 1:05:12out with instant NGP and suddenly all my frickin home
- 1:05:16home machine, you could train a frickin Nerf, and like a minute.
- 1:05:19Like that. Just whoa, like, blew my mind,
- 1:05:21and then Luma you can do it on your phone, right?
- 1:05:23And hit a button, it's doing it in the cloud and hit another
- 1:05:26button. You got a video and I think like
- 1:05:29the ability for nerves right now to capture more of the
- 1:05:32complexity of a set. Like is really good for all the
- 1:05:35use cases you brought up right if you want.
- 1:05:37A virtual set digitized, nerves are the way to do it right now?
- 1:05:41Maybe you still capture the photogrammetry.
- 1:05:43So you have like, continuous surfaces or whatever you derive
- 1:05:46it from the Nerf, you know, kind of scan through various
- 1:05:49techniques, or just like exporting it out of Lumas, like,
- 1:05:52a obj, or POA, or whatever, but there's still some stuff where
- 1:05:56it falls short, right? So, your answer to, where do I
- 1:05:59see this going? I think it's all going to be
- 1:06:01about Dynamic Nerfs right. Like so right now we're really
- 1:06:04Be really good at static capture.
- 1:06:06Let's assume the world is static.
- 1:06:08That's kind of how photogrammetry works best.
- 1:06:10And now you're seeing that with Nerfs, you're seeing some really
- 1:06:12cool things happening with. What if you start imbuing
- 1:06:15semantic, understanding into each voxel so you can classify
- 1:06:19each W voxel. So if you wanted to just type, a
- 1:06:21text prompt to delete a bunch of crap from your scene, boom, you
- 1:06:24can do that. And then you use generative
- 1:06:26models to sort of fill in the holes, right?
- 1:06:28So I think this sort of where we're going.
- 1:06:30We're seeing this beautiful unification and you'll see a
- 1:06:33bunch of papers like Cvpr, which is coming up in, in Canada,
- 1:06:37actually all cooler. Yeah, I shouldn't be there, if
- 1:06:40you're not, no, I'm not. Unfortunately, I'm going to be
- 1:06:42stuck working on a maven course, but I'll be a cigarette off.
- 1:06:45So if you'll be at siggraph in la la, I'll see you there, but
- 1:06:48you'll see a bunch of these Nerf papers around sort of 4D nerves.
- 1:06:51But also about how do you take like incomplete captures of the
- 1:06:55world and sort of fill in the holes yourself, right?
- 1:06:58Like you mentioned it's an expensive hobby.
- 1:07:00What if you could just walk around at ground level with the
- 1:07:03capture that you You need because you've got the micro
- 1:07:05detail and will the macro detail already exists.
- 1:07:08You know in data sets like Google Maps has or Apple Maps
- 1:07:11has or Microsoft has or a myriad of other aerial imagery
- 1:07:15providers. And so then like could we
- 1:07:17autocomplete your scan with a model that sort of seen the
- 1:07:21diversity of everything that's in stable, diffusion for example
- 1:07:24but is also image the world from every possible angle.
- 1:07:27So those are the directions it's going and in like like really
- 1:07:31for all the stuff you and I care about to like it's like people
- 1:07:34Aces and things we need all three, right?
- 1:07:36So we're doing really good on places and objects.
- 1:07:38We need people. So I think this line of 4D Nerf
- 1:07:42research on like, how do you capture a full body volume of
- 1:07:45somebody? And then animate it, like not
- 1:07:48doing the metahuman thing which is like this explicitly modeled
- 1:07:51thing, that you're driving, but sort of as this neural
- 1:07:54representation is also very, very exciting to me.
- 1:07:56So I think we'll keep seeing people push on that on those
- 1:07:59fronts of like just like how do you start doing 4D?
- 1:08:02Captures of like So essentially and then how do you start making
- 1:08:06it easy to autocomplete stuff edit and transform these nerves
- 1:08:09and sort of a native format. And then finally, how the hell
- 1:08:12do we deal with humans? Right and maybe what Apple
- 1:08:14showed is a hint of that like they whatever Avatar they made
- 1:08:18looked very neural generated, didn't look like it explicit
- 1:08:22volume. It's similar to some of the
- 1:08:23research that meta has with something called codec avatars.
- 1:08:28So yeah, those are my pontification Zahn like sort of
- 1:08:31reality capture and the Nerf are on sort of where stuff is Going.
- 1:08:34It's going to be, it's gonna be pretty exciting for sure.
- 1:08:36I'm going to clip this and send it to Luma.
- 1:08:38And I was like, this is our feature requests for the
- 1:08:40upcoming six-month. I just described is my wet
- 1:08:45dream, like, I'm not even looking just, just imagining
- 1:08:49because right now, Luma II does have the capability of
- 1:08:52recreating your environment. Essentially, what it does is
- 1:08:55instead of cropping out exactly what you scan, it adds like a
- 1:08:59globe, sort of look to it as you bring it into our New London 5
- 1:09:03which makes it look less janky, right?
- 1:09:06The edges of your of your scan, which it's fair because you
- 1:09:09didn't even scan that part of the sky if you were outside.
- 1:09:13But it of course, doesn't really do a generic of Phil.
- 1:09:15It's not actually creating clouds or Sky based on your
- 1:09:18scan. So now just imagining, when that
- 1:09:22happens, it's going to be so fun.
- 1:09:24And this is the best part, like, we're always looking at people
- 1:09:28complaining about how AI is taking away stuff and like,
- 1:09:31should I learn sculpting because like sculpting my go away.
- 1:09:33Should I? Learn this, this might go away
- 1:09:35and we're like, the one thing I know that is not going away, is
- 1:09:39digitized digitizing the physical.
- 1:09:41Like you mentioned, like, we're always going to have this
- 1:09:43physical world at least in our lifetime.
- 1:09:45I assume on this is like a World War 3 or something, but we're
- 1:09:49always gonna have this physical world thoughts.
- 1:09:52Yeah, just saying, we're always going to have this physical
- 1:09:56world, and it's always going to be a human passion to go out
- 1:10:01hiking to go out running. And when you do Just grab your
- 1:10:04camera with you, your phone. That's going to be enough, and
- 1:10:07you can essentially capture anything, bring it back home and
- 1:10:10turn it into a magical world by using generative feel.
- 1:10:14And, and all of that, which is what excites me because like no
- 1:10:17matter how much technology improves and how good they get,
- 1:10:21you can still do this and people will still love it because it's
- 1:10:25based off the real world and the real world is extremely complex
- 1:10:29and a patterns that exist in nature is extremely complex to
- 1:10:32try to model again. So you have that plus Ai, and
- 1:10:36you can create fascinating things, which is why majority of
- 1:10:39our content right now is nerve related because we generally
- 1:10:42believe this is gonna be huge in music videos in Virtual
- 1:10:46production in film, you know, and in a lot of different use
- 1:10:50cases. And so were like heavily
- 1:10:52invested in like using these Technologies so far, we're only
- 1:10:56using blue my eye, but you use nvidia's.
- 1:10:58Instant, instant nervous. That is that, right?
- 1:11:01Most of the time I haven't tried them honestly.
- 1:11:03Okay, yeah. Yeah, I would say, like, it.
- 1:11:05The, you can like, so incident in GPS.
- 1:11:07Awesome nerve Studios, awesome, too.
- 1:11:09Although I don't know, what the future of nerve Studios
- 1:11:11development, looks like, I think there may be some it may
- 1:11:14continue as an open source tool and and perhaps get funded by a
- 1:11:18couple of players in the space. But you know I mean like it's
- 1:11:21the way I think about it is just like a tool for the job, right?
- 1:11:23Like the Luma excels that is just like I love their web UI.
- 1:11:26It's so clean like the keyframe editor.
- 1:11:29I still find it if I'm making a fly through animation.
- 1:11:32I still love the instant a GP And more so often how I like to
- 1:11:36use it as like instant NG p is the Willett Nerf question
- 1:11:39because I can create a Nerf in a minute and it tells me and then
- 1:11:42when I know I want this thing and I want to do a bunch of
- 1:11:44artifacts and Export it in different places.
- 1:11:47Then I love to use Luma if I'm out and about capturing
- 1:11:49something with my phone, Luma all the way at the same time.
- 1:11:53Like if you want to go get the highest quality Nerf output, you
- 1:11:56really want to get like MIT Nerf 316, get rid of all the
- 1:11:59floaters, and if you notice like Luma has this like mesh equality
- 1:12:03to it, it It looks a little bit more solid at times than
- 1:12:07instant, NGP, which has sort of this sort of hazy like kind of
- 1:12:10more volumetric quality to it. I've tried to ask them and I'm
- 1:12:14like, is it like some hybrid representations, like knots and
- 1:12:16Native Nerf like? All right, but like, yeah, so I
- 1:12:21think like, they're all freaking awesome and yes, I see like Luma
- 1:12:24is just such a great accessible way to play with this stuff
- 1:12:27because you don't have to like, you know, just deal with command
- 1:12:31line and stuff. You know, it's not a lot of
- 1:12:32people don't want to do. You just posted a video, I
- 1:12:35think, was it few weeks ago a few days ago?
- 1:12:38Was it an Indian? I think was it a temple that you
- 1:12:41change into a Minecraft? That was a couple of weeks.
- 1:12:44I think I was back in March. No.
- 1:12:45But there were two version, I think one was.
- 1:12:47Yeah, they go and you read it. So I want to know the redid the,
- 1:12:52the recent version. What was your pipeline to do all
- 1:12:56of this. So you capture the environment
- 1:12:58first, was it with your GoPro? Or like how, how did you do
- 1:13:01that? It's very walk us through that
- 1:13:03because it looked really yeah, it looked really sick for sure.
- 1:13:07Yeah that's it. Pretty simple workflow.
- 1:13:09It's like vacation footage GoPro, just sort of at like
- 1:13:11chest. Length, walking through on a
- 1:13:13path. Nothing too fancy to be honest.
- 1:13:16And then I created a Nerf that followed that exact sort of
- 1:13:18trajectory. And so then there's two ways,
- 1:13:20you can reskin it. Like the last video that you saw
- 1:13:24I was just doing basic stable, diffusion image to image and so
- 1:13:28you know this is before controlling that came out.
- 1:13:30I don't know how deep y'all have gone into control Nets have it I
- 1:13:33have a news control, net know you might actually love it
- 1:13:37especially If you're doing Nerfs like, I think you should make
- 1:13:39that a part of your workflow. It's like so image to image is
- 1:13:42chaotic. It's like it basically takes a
- 1:13:44takes your image as a basis, you know?
- 1:13:46So how diffusion models work? Is they denoise your image.
- 1:13:49So when you provide an image, it kind of blurs the image
- 1:13:51approximately and then sort of uses that as a basis to refine
- 1:13:55it and then adds all this detail.
- 1:13:56But the problem is, there's no temporal consistency.
- 1:13:59It'll just like every image is unique the way it blurs and D
- 1:14:03noises, every image can be different, even if you try to,
- 1:14:05like, solidify your seat, And change some of the variables.
- 1:14:09It will look like this jittery sort of fever dream mess which a
- 1:14:12lot of people love now. Controlling that based tools
- 1:14:15like high. Beret is a really good one.
- 1:14:17If you want to just experiment with this stuff in a web UI or
- 1:14:20if you just use the automatic 1111 tools, I use both.
- 1:14:24They're both great one. Give you one guess.
- 1:14:26Just like we're talking about Luma versus like instant NGP or
- 1:14:29nerve Studio. Once one gives you more control
- 1:14:32and takes a little bit longer, the other one is good for.
- 1:14:34Like, let me just throw something out this.
- 1:14:35Yeah, and get something back, so you Make the video you make the
- 1:14:38fly through with Luma you can export out the depth map to so
- 1:14:42you know this, right? Like yeah.
- 1:14:43Same video and that if you throw it into these tools and you
- 1:14:46don't always need the depth map to you, could just take the
- 1:14:49video control and that basically either if you give it a depth
- 1:14:53map, it'll use the depth map that you provided or it will
- 1:14:56hallucinate and approximate a depth map using Midas depth
- 1:14:59estimation which is this like really awesome intel-based F,
- 1:15:03estimator that creates pretty amazing results and then I'll
- 1:15:06use that depth. App and then Edge maps, that
- 1:15:08will extract Edge maps from the video to, to sort of guide the
- 1:15:12image diffusion process, the image generation process.
- 1:15:15And so that way you get far more temporal coherence and like that
- 1:15:19combination of like depth map to tell the model.
- 1:15:22Hey from this camera view point here's all the structure in the
- 1:15:26scene, right? Like that's awesome.
- 1:15:29But then you have flat surfaces right?
- 1:15:30There's no depth detail on where the windows are and the edges
- 1:15:33and the crevices that all gets encapsulated by the like candy
- 1:15:37Any or hcd hcd map, whatever you use their different control, net
- 1:15:41methods. And so when you put into
- 1:15:43something like Khyber, it does depth, it does canny.
- 1:15:46And basically, give lets you give a text prompt to reskin
- 1:15:49that video, and it's like so much fun.
- 1:15:52It's like almost feels like reskinning a reality and if you
- 1:15:55want to take that a step further, you know, kind of off
- 1:15:57the Nerf thing. We were just talking about, I
- 1:15:59pulled this up while you were talking about what you what your
- 1:16:02wet dream about Nerfs is, is, if you look at this tweet, you can
- 1:16:05check it out later. It's the same thing.
- 1:16:07A I to Nerfs in this iterative fashion so it's not just applied
- 1:16:10to the 2D output may be in a 3D aware away.
- 1:16:13It's like applied to the Nerf volume itself, sort of like, a
- 1:16:16way of brute-forcing gradually like, incrementally, restyling,
- 1:16:21all the input images and then making a Nerf from that.
- 1:16:24So if you want to say make it snowing, you can do that and it
- 1:16:26like, you get a native Nerf at the end of it.
- 1:16:29So a little bit of brute force and compute heavy, but works,
- 1:16:32but to go back to that. Yeah, it's a control.
- 1:16:33Yeah, go for sorry. Did you use a text prompt to
- 1:16:36basically change? The images or use an image
- 1:16:38reference, or you can do both, you could do both.
- 1:16:41So if you use gen 1 to do this stuff, and it follows a similar
- 1:16:44process, gen1 also creates a depth map and uses that for
- 1:16:47temporal coherence with some other things.
- 1:16:49You in gen 1. I'd like to provide image
- 1:16:53prompts a lot more. Yeah.
- 1:16:55But in Khyber control Nets, oh gosh, just text prompts like
- 1:16:59it's just iterating and getting the right Minecraft one and it
- 1:17:03just looks magical. It's like it's kind of wild to
- 1:17:05me and then I tried doing the reverse also.
- 1:17:08It took like Minecraft video and turn it into reality which is
- 1:17:12also like really that one's like, it worked really well.
- 1:17:15It's kind of surprising. Yeah, it's on my Twitter, check
- 1:17:18it out. It's like, it's like basically
- 1:17:19like and then I suddenly think of all the kids, right?
- 1:17:22Like that are growing up today that are working in Minecraft.
- 1:17:25Like they've no of 3D tool. Its like Minecraft.
- 1:17:27They literally build the world's in it and some of these kids are
- 1:17:30crazy that are pulling in like Google Earth data and like
- 1:17:32creating entire cities. But even if you know how to
- 1:17:35model with voxels, you cannot like Artificially upper as it,
- 1:17:39you know, to like yeah, before I saw the new you posted about the
- 1:17:42Minecraft builder, then the metaverse architect of the to.
- 1:17:46Yeah, that's the one hold of me. That's, that's what happened.
- 1:17:49Yeah, that's definitely, that's gonna happen.
- 1:17:51Like, I usually answer Minecraft metaverse Builders to, like,
- 1:17:55like I saw some of the videos, you all are making with the,
- 1:17:58like the Drone scan you did, and getting the characters going in.
- 1:18:00Like, that's the future like that.
- 1:18:02Is, that is the future. What is your first of all, thank
- 1:18:05you for sharing your work flow. Pipeline.
- 1:18:07What is your definition of the metaverse?
- 1:18:10Because clearly, Mark Zuckerberg and an apple, all these
- 1:18:13different companies and people they have different views.
- 1:18:17Even even Tim Sweeney has a different view of what the
- 1:18:19matter is. Looks like, what is your view
- 1:18:21of? What the matter of us looks
- 1:18:22like? Yeah, it's like oh my God this
- 1:18:26word is so loaded. It's like the way I think of it.
- 1:18:29Very simply, I think of it like the spiritual successor to the
- 1:18:342D mobile internet. We know today, right?
- 1:18:36It's it is, it is essentially like it mirrors the physical
- 1:18:41world that we embody in just a far more natural fashion.
- 1:18:45So I love the term that Apple has given to this, which I've
- 1:18:48been using since like 2016, at least which is spatial Computing
- 1:18:51and spatial media, right? Like Embodies the spaces and
- 1:18:55places. We care about in a more like
- 1:18:57three-dimensional way but also us write like metahumans and
- 1:19:00avatars. And so to me the metaverse is
- 1:19:02basically like you know everything since Xerox Parc
- 1:19:06onto. Now even on the iPhone and
- 1:19:09mobile era has just been rectangles stacked rectangles on
- 1:19:12a screen and like obviously the world we inhabit every single
- 1:19:15day like is dimensional. You see a doorknob, you know how
- 1:19:18to open it? You look at a person you want to
- 1:19:20shake their hand, you know, how to make eye contact, how to like
- 1:19:23navigate. Eight a grocery store Architects
- 1:19:26have been sort of the original metaverse architects in a way,
- 1:19:29right? Because they've been Conjuring
- 1:19:30up. These dimensional spaces that we
- 1:19:32know how to navigate and get around and hey some malls harder
- 1:19:36to navigate than others. Sure.
- 1:19:37But like they've been doing that.
- 1:19:38So I just view the matter versus like a spatial embodiment of
- 1:19:42computing, right? We're Computing just reflects us
- 1:19:44back in this. More dimensional spatial First
- 1:19:47fashion but it's not just spatial.
- 1:19:49It's also language and I think that's where like I don't think
- 1:19:52a rvr took off because the Dream.
- 1:19:54And the vision of creating more intuitive Computing was always
- 1:19:57there. But we always knew we wanted
- 1:19:59some sort of like Jarvis style interface to talk to write a
- 1:20:03person and embodied agent that helps us with stuff.
- 1:20:06And I think we're seeing that happening with this wave of like
- 1:20:09large language models and how these multimodal like large
- 1:20:12language models. I think it's going to be very,
- 1:20:13very exciting. So AR is going to replace
- 1:20:16mobile. I think VR as a form factor is
- 1:20:18going to replace desktop this sort of experience and, you
- 1:20:22know, it's all additive then as far as decentralization goes, I
- 1:20:25think whether it's centralized or decentralized that's
- 1:20:28orthogonal in my mind to the metaverse definition.
- 1:20:31I think the world we live in today, is largely centralized
- 1:20:34around a few players. I wouldn't be surprised if that
- 1:20:36continues to be the case. I also wouldn't be surprised.
- 1:20:39If we see a pretty large decentralized, social network
- 1:20:43computing platform distribution platform emerge as well.
- 1:20:46So, my take on the so-called metaverse.
- 1:20:51I love that we share, we share sort of the same mindset when it
- 1:20:54comes to the matter of us. Definitely, it has to get closer
- 1:20:57to the way we interact with the physical world today and and
- 1:21:00it's clearly not there yet. And and which is why I believe
- 1:21:03so many people were thrown off by it because in the web three
- 1:21:07space people were saying, oh it's already here, but I still
- 1:21:10think we're still far away from it if yeah.
- 1:21:13So that's even, even the physical have said is not even
- 1:21:17out yet. They're like next year will
- 1:21:19release this headset. So, Going to be far away but
- 1:21:22it's definitely going towards that direction.
- 1:21:25We see that as well. I have, oh I can go another 30
- 1:21:28minutes just to boil add perfect amazing.
- 1:21:31Thank you for letting us know. You have experiment, you have
- 1:21:35been experimenting with a lot of new tools.
- 1:21:37Just the names that, you know, came out of this podcast.
- 1:21:39I think I can list out 20 or 25 and then if I go on to your
- 1:21:43Twitter, I can get another probably 10 or 250.
- 1:21:47Oh yeah, it's I mean we are trying to catch up with all
- 1:21:52these new tools and honestly sometimes we just can't leave
- 1:21:55when we just can't try everything.
- 1:21:57Where do you get all this information?
- 1:22:00Like very dizzy, like It's like drinking from the fire hose.
- 1:22:04Man. Like a it is it is I think this
- 1:22:06is a full-time job just to keep up to date with all the stuff
- 1:22:09that's happening learning and building stuff with it.
- 1:22:12There is almost too much and I feel like I've only scratched
- 1:22:15the surface. I feel like there's 20% of like
- 1:22:18the landscape that I can reasonably, you know, Pope my
- 1:22:22eyes and attention on and then there's so much happening just
- 1:22:25in the text llm space, for example, that I rely on other
- 1:22:29folks like me. And so I would say like it's
- 1:22:30like it's like what we're doing. Now it's conversations like
- 1:22:33this. It's like Twitter spaces.
- 1:22:35Dare, I say it's people's newsletters that are just
- 1:22:38helping me sort of keep up to date on all the other stuff
- 1:22:41because I think the magic is always at the intersection of
- 1:22:44these things but like look the fomo is also crazy high, right?
- 1:22:48Like you talked about sort of like you alluded to this earlier
- 1:22:51with social media and like too much in a kind of this like sort
- 1:22:54of anxiety of like they're being almost too much and I think
- 1:22:58that's only going to get worse from here, right?
- 1:23:00Like it's it's that's maybe the Well, that you were alluding to,
- 1:23:03it's like there's going to be new things coming out every one
- 1:23:07to three months. For the, at least the next two
- 1:23:09or three years, if not longer, I truly believe that.
- 1:23:11And then like, when people even in, like even reputable
- 1:23:15researchers say stuff like, oh yeah, at some point, a is going
- 1:23:17to be making a I'm like, oh my God!
- 1:23:19We're so it's like, look, it's like it's done.
- 1:23:22Like we almost need our own AI agents scouring the web based on
- 1:23:27our interest sort of giving us our, you know, like newsletter
- 1:23:30summary and so like I think Maybe how will make sense of
- 1:23:33this all, but like we can't do it.
- 1:23:35Also like again, like the things I'm passionate about is like
- 1:23:38blending reality and Imagination.
- 1:23:39I'm more passionate about visual creation, not going as deep into
- 1:23:42all the Audio models that out there.
- 1:23:44There are other people who are doing a really good job of that,
- 1:23:46so they give me sort of the distillation.
- 1:23:48So, I gotta say, my addiction has been Twitter in all of this,
- 1:23:51like say what you will about the platform.
- 1:23:53Like I almost have like, stop posting Tick-Tock videos.
- 1:23:57Like I need to get back on that and just like push my account
- 1:24:00over a million. It's almost there.
- 1:24:02Yeah, like yeah, we see that. And so I got to do that.
- 1:24:05But again, like Tick-Tock has been my obsession for the last
- 1:24:07like, three months, and that shows him a growth like three
- 1:24:10months ago. I had like two or three thousand
- 1:24:12followers and now I think I'm at 35-ish k or something like that,
- 1:24:16so that's been fun. And I want to keep pushing their
- 1:24:18one conquest. That's always eluded me is
- 1:24:20Instagram, by the way, I just like a failed to do.
- 1:24:22I actually often asked him as a Kim, how do you do it?
- 1:24:25Like what do I do? If some trying like, you know,
- 1:24:28just like it's funny how different all these platforms
- 1:24:31are like, what you mentioned about Twitter and take that
- 1:24:33money and be Of the exact obviously opposite problem here
- 1:24:37because our Instagram is going. Well, there's our Twitter is
- 1:24:41suffering. Yeah.
- 1:24:43I mean suffering as in at we like it's just a different way
- 1:24:46to deliver the same value you're trying to deliver right.
- 1:24:48Like yeah. So so it's really crazy.
- 1:24:50You have to contextualize for every single social media
- 1:24:53platform when you are creating content for it or maybe an AI
- 1:24:56agent will do that for you down the line, right?
- 1:24:59You talk about what you want to talk about.
- 1:25:01The AI agents one for A gram 14, Twitter 14, you know Tick-Tock
- 1:25:06will package it up in the best way possible and send it out and
- 1:25:10that way you will work. I love that.
- 1:25:13I mean it's such a good point. I think those are the aspects of
- 1:25:15AI that we underestimate. We're like, oh my God it's like
- 1:25:18the South Park her gorger but you know everyone goes back to
- 1:25:21the our jobs are going to be taken but it's like these are
- 1:25:23the aspects of creation that are it's like mundane drudgery of
- 1:25:27like taking that video. Chopping it up turning it into a
- 1:25:30thread. All this stuff that's really
- 1:25:31just like transforming media and kind of pruning it down that I
- 1:25:35think, you know, hopefully craters mental health improve
- 1:25:39with that but I think there's even two that there could be.
- 1:25:42Essentially be a dark side, right?
- 1:25:43This is like where I got to go back to mr.
- 1:25:45Gary Vee. It's like, you know, something
- 1:25:47Gary Visa you got to do ten Tik toks a day, right?
- 1:25:50Like it's like I'm like homie. I do like one a week.
- 1:25:52You know like what do you mean like I can't even imagine.
- 1:25:57Like maybe you if you have a team of a bunch of people by
- 1:26:00though I'm looking for editor. So off the off the right I'd
- 1:26:02like if you know if anybody's watching and is looking for it,
- 1:26:05you know, to call. Yeah.
- 1:26:06Yeah, yeah exactly. And you want to like speed run
- 1:26:08the AI creation stack, I'll give you that.
- 1:26:10You help me with some spicy. It'll be magic, but to like the
- 1:26:14dark side of this, could be if our efficiency is craters, go
- 1:26:17up, right? Like the expectation might be
- 1:26:19for creators like us to blow up on a platform.
- 1:26:22We got to do 100 pieces of content a day because like sort
- 1:26:25of the floor Rises, right? It's not just the ceiling of
- 1:26:28like, you know, awesome content. You can do that.
- 1:26:30A studio can output the Rival like of a Marvel.
- 1:26:33And Marvel can set new standards.
- 1:26:34I think the floor might start rising to and I think I
- 1:26:38definitely worry about that and like sort of As creators need to
- 1:26:43make sure that we take advantage of automation to live a freaking
- 1:26:46better life. Then not just create another
- 1:26:49treadmill of our own design where we just do, they keep
- 1:26:52like, increasing the speed, increasing the speed.
- 1:26:54And it's like, you know, the frog that got boiled.
- 1:26:56If you want to boil a frog, just do very slowly just happens.
- 1:26:59And then next thing, you know, and before, you know it.
- 1:27:02So and I thought I'd sorry you want to say, yeah, because we
- 1:27:05are in this topic, I'm gonna reread one of billables tweet
- 1:27:09where you talked about the evolution of the Creation how
- 1:27:13YouTubers had to learn so many things, you know, light, audio
- 1:27:17editing, thumbnails/thumbnail.png know,
- 1:27:19so many things that, you know, different sound like when we
- 1:27:22create YouTube videos Pharisees, anything DaVinci Resolve.
- 1:27:25I'm making a thumbnail. Then I'm doing subtitles in Cape
- 1:27:28Cod. You know, like we are using
- 1:27:30multiple software to do that. And then, there is Tick-Tock
- 1:27:33where you mentioned in the, on your tweet, that you can make
- 1:27:36everything in a single app, music is there, you know,
- 1:27:39subtitle is there titled is there you can even, you know,
- 1:27:41split Screen, green screen, do whatever you want on.
- 1:27:43You make few of them in a single day and now, the next stage is
- 1:27:47generative AI. How do you see this evolution is
- 1:27:50going to impact the content creator.
- 1:27:52So we talked about consumption. Yes, there will be a lot of it,
- 1:27:55but it like you are a Content creative, you are content
- 1:27:58created, how is going to change for all of us with all this AI
- 1:28:01tools that are coming out. Yeah, I mean II think it's it's
- 1:28:05a really good prompt, right? I think take talk turned that
- 1:28:10sort of the Creator stack that you needed into this single
- 1:28:13application, right? And if you just combine it with
- 1:28:16cap cut like which is even more advanced stuff, they almost, I
- 1:28:19love what the by dance product teams are doing.
- 1:28:21They've got this awesome pipeline there, between the
- 1:28:23Advanced stuff from Cape Cod eventually graduates into Tick
- 1:28:26Tock, like, they almost test stuff there and then it pops in
- 1:28:29there. And it's amazing that you're
- 1:28:31using resolved, but it's still your you Oozing like cap cut to
- 1:28:34do titling because it's easier you Motion Graphics.
- 1:28:36Look, better looks more polish. It's faster.
- 1:28:38The transcription is amazing like so and it's also sorry to
- 1:28:41cut you off. It's also one more thing, it's
- 1:28:43about psychology as well. So people are now used to like
- 1:28:46the way cap cut videos. Look like, let's say there's a
- 1:28:49specific time way of doing subtitles like the psychology of
- 1:28:52me seeing those types of sub subtitles if they're meeting cap
- 1:28:56cut like I prefer to watch those videos.
- 1:28:58Sometimes, this is just one example but like people
- 1:29:01psychology also changes and the way they Consuming the things
- 1:29:04they pay attention to, but sorry to catch you up total tonight.
- 1:29:07It's beautiful point and the preference is changed to, right?
- 1:29:10Like now you see a bunch of, like, the classic chopped video
- 1:29:14vertical with the yellow text, right?
- 1:29:15Like, that's become the aesthetic du jour and that will
- 1:29:18evolve, but it, like, how will this change the mobile creation?
- 1:29:21I think the phone will turn into a studio in your pocket.
- 1:29:24It already is, in many ways, it'll become even more of that,
- 1:29:27right? Like so I think again, it speaks
- 1:29:29volumes that the most popular effect on Tick, Tock is The
- 1:29:33green screen filter like it is this flexible tool, right?
- 1:29:37It's a flexible tool for a Creator whether you're like a
- 1:29:40business savvy, like one of bunch of the AI creators, like
- 1:29:43Rachel Woods. You can like, take a screen shot
- 1:29:45of something. Pinch yourself down.
- 1:29:47Now, something you doing picture-in-picture in a
- 1:29:48presentation, you can use it like that.
- 1:29:51If you're a comedian, you could be like, going to Google image,
- 1:29:54search, and find a bunch of backgrounds, and you create a
- 1:29:56virtual sets, right? Like set of doing an, ER, if you
- 1:29:58just like, go into street view, or you're going and grabbing a
- 1:30:00photo from like image search, now, that's your virtual set.
- 1:30:03This one primitive Trends into these things that otherwise
- 1:30:06needed a studio, or like chroma key.
- 1:30:08And then you're doing all this other crap, right?
- 1:30:10Like so, I think that'll only get super charged with
- 1:30:13generative stuff, right? Like the ability to do this sort
- 1:30:15of video to video filter stuff that we're talking about
- 1:30:18granted, some of the things we talked about have Nerf as an
- 1:30:20input but video is an input just as well, works, right?
- 1:30:23Like so I think, like all that stuff is just going to get
- 1:30:26supercharged, the ability to create virtual sets to create,
- 1:30:29virtual humans to hold props. And to also be able to Like sort
- 1:30:34of create these more Dynamic virtual camera moves, all with a
- 1:30:374D nerve stuff that I mentioned is all on the horizon.
- 1:30:40And so like I kind of view it, like if you want to create like
- 1:30:44short form, like 60 Minute, 60 second or less, tight content
- 1:30:49more and more people will be able to do that in an app.
- 1:30:52Just like I mentioned descript sort of opened a video editing
- 1:30:54for a new audience, the Creator's.
- 1:30:56I think like these like these effects, these type of effects
- 1:31:00will get opened up to another audience of craters and like You
- 1:31:03know, Tick-Tock it's like these Trends sort of pop up and they
- 1:31:07take on a life of their own. I remember when the Clone filter
- 1:31:10effect came out, this is right when the raid Area 51 thing was
- 1:31:13happening. And everyone's talking about
- 1:31:15World War Three is going to start was like, raid Area 51 in
- 1:31:17the World War 3. It's like, oh my God, society,
- 1:31:20and it's like, everyone was like pretending to be like an army,
- 1:31:23right? Like with their Like Glue and
- 1:31:24effect, and using it as an effect, right?
- 1:31:26So you never know the ways. People will use the stuff, but
- 1:31:30the fact that platforms like tick-tock, Talk and now
- 1:31:33YouTube's going to end. YouTube's publicly said they're
- 1:31:36investing in generative. AI affects obviously Meadows
- 1:31:39going to do it too. We're just going to see this
- 1:31:41kind of crazy feedback loop that doesn't exist or is much slower
- 1:31:46of a feedback loop in the way you.
- 1:31:47And I create content where we're doing this thing would put her
- 1:31:50on, you know, it gets views and we figured out versus I just
- 1:31:53made the thing. I put it on there and somebody's
- 1:31:54like I like this, I want to use the same Primitives that you
- 1:31:57came up with and sort of remix, it kind of playing Photoshop,
- 1:32:00tennis if you will, if you remember that trend on red, Or
- 1:32:03you could post an image and people would additively add to
- 1:32:06it, right? So, it's gonna turn into
- 1:32:08full-blown Movie Studio. And I think short form stuff,
- 1:32:10more and more will be made natively inside these
- 1:32:13applications. But at the same time, given that
- 1:32:16they're such crazy, like, there's this arms race of
- 1:32:19generative AI happening. I think we'll also see people
- 1:32:22applying sort of the virtual production model that sort of
- 1:32:26lives in parallel to that. But I think in terms of product
- 1:32:29metrics of how most content will be created, it'll probably just
- 1:32:33be a nap because you'll have no reason to like, you know, like
- 1:32:37nobody's going to who uses like adobe's.
- 1:32:39What is there? Like mobile editing app called
- 1:32:42rush? Rush, hell are you doing?
- 1:32:51Yeah, that makes sense. And so cap Cuts interesting
- 1:32:54because they're on desktop now to, right?
- 1:32:56So like yeah, so it's again, that same tug-of-war, sort of
- 1:33:00Confluence, like, people coming from two angles coming together,
- 1:33:02but I'm excited. It would it, what?
- 1:33:04A time to be a kid today with bold ideas.
- 1:33:06Like, you know, I look back at my like crappy show, real with
- 1:33:10the like the crappy stuff looks like, literally clothes,
- 1:33:13clothes, drying on a freaking, like, string on the roof and
- 1:33:15like, we're playing with lightsabers.
- 1:33:17And this like shitty 3ds, Max render of a things going down.
- 1:33:20Now, a kid today, you got a 4k camera in your pocket, you've
- 1:33:24got AI agents working at your behest and you're basically able
- 1:33:28to like, chop up and do what required a mini YouTube team,
- 1:33:31and you can do that with a phone in your pocket.
- 1:33:33Pocket. So, what a time to be alive and
- 1:33:35that will only get more exciting in the future.
- 1:33:38I want to finish off by one last thing and I want this, it's not
- 1:33:42necessarily just a question towards you, but it's a question
- 1:33:45towards all three of us. And perhaps everybody watching
- 1:33:48in the comments, I'm going to stop by singing myself and
- 1:33:51answering it. I want to talk about, what are
- 1:33:53we most excited about with all of these Technologies?
- 1:33:56And we did talk a little bit about Vision Pro and nerve some
- 1:33:58talking, a bit, you know, maybe more than just that personally.
- 1:34:03What Sad about is something. I think I read in the comments
- 1:34:05where you can use AI to train it essentially based on all the
- 1:34:10content as a content creator that you've uploaded and your
- 1:34:13audience. And right before you upload a
- 1:34:15video, you can test to see how that video will perform
- 1:34:19essentially based on the audience that you have in your
- 1:34:21all your previous video. So I'm excited because sometimes
- 1:34:23we even think about thumbnails you're like we don't know which
- 1:34:25thumbnail works. Well, if you have the AI will do
- 1:34:28like a testing and the AI will tell you based on your previous
- 1:34:32results on based on Everybody else's thumbnails.
- 1:34:34This is gonna work better. Just going to have more
- 1:34:36click-through rate. So I'm excited personally about
- 1:34:39that technology. I think I want to see that
- 1:34:41coming soon. What about you guys?
- 1:34:43Maybe you want to go first? You know, I'm a, I'm less
- 1:34:47excited about a technology and more about how they come
- 1:34:50together. And the thing I'm excited about
- 1:34:52is is building on what you said to be honest.
- 1:34:55It's like I alluded to this notion of us.
- 1:34:57Being able to author content at this higher level of abstraction
- 1:35:00with these agents with these tools.
- 1:35:02With these models, these superpowers, or whatever you
- 1:35:03want to want to call it. I think your point about being
- 1:35:06able to like, create variations of content and A/B test stuff.
- 1:35:09Like I was talking to the premiere in After Effects, PM's
- 1:35:12about exactly this, where they were talking about Mo Gertz if
- 1:35:15you are. Millie with that feature in
- 1:35:17After Effects where you can create templates of text, like
- 1:35:20tax Motion Graphics, and then in Premiere, or with a CSV file,
- 1:35:24you can dynamically update the copyright.
- 1:35:26If you think about anyone creating these shorts for like,
- 1:35:30you know, 30 different languages, like how much of a
- 1:35:31pain in the ass, it is to do that stuff manually or you're
- 1:35:34creating an ad creative that needs to go and like, you know,
- 1:35:38sort of hit five different markets.
- 1:35:39For example, there's a lot of manual work there.
- 1:35:42And so, when I think about authoring content at this higher
- 1:35:44level of abstraction, I don't think text is it right?
- 1:35:47Like, everyone's like oh text is the be-all end-all.
- 1:35:52I think loss is visual craters. Know the value of having like a
- 1:35:54virtual track camera and being able to do stuff like that.
- 1:35:57But I think using all those modalities will be able to
- 1:36:01describe a video kind of like we described in HTML like a web
- 1:36:05page today. So unlike HTML there's this
- 1:36:07notion of like the document object model, right?
- 1:36:09Like here is the title, here's a bunch of the headings, the
- 1:36:12subheadings. Here's a bunch of iframes with
- 1:36:14content embedded in it. I'm envisioning a future where
- 1:36:17we're able to like author, a creative, like let's say an
- 1:36:20advertisement or short movie at that higher level of abstraction
- 1:36:25saying, hey, here are the like objects and spaces in a scene,
- 1:36:28the locations, here's like the the entities in a scene.
- 1:36:32The humans, the actors here's more information about them and
- 1:36:35then you can sort of like have this content be responsive to
- 1:36:39whatever, you know, sort of like, you know, objective you
- 1:36:42have if it's like, hey, I want to take the same ad creative.
- 1:36:45You're About nerves and all this stuff, right?
- 1:36:47Like let's say it's like a ad for a new fricking Hyundai car.
- 1:36:51You've got this type of talent. You got this backdrop, you got
- 1:36:54the car. You got this hero shot.
- 1:36:56Right now would be like an expensive red or re Alexia shoot
- 1:36:59in some Ela Warehouse, right now, imagine we authored this at
- 1:37:03this higher level of abstraction you did the mocap, you've got
- 1:37:06all the pieces down, you compose the scene graph, right?
- 1:37:09This document object model of the video and then I want to
- 1:37:12localize it to India. Boom.
- 1:37:14Swap out the background instead of soul.
- 1:37:16South Korea. It's freaking Mumbai Skyline
- 1:37:19swap out the talent with whoever you want this that and the other
- 1:37:22thing and I think like that ability for content to be
- 1:37:25responsive and adaptive I think is so exciting, right?
- 1:37:28And I think like when I think of things like that and explain
- 1:37:31this to a bunch of craters like there's a lot of people in the
- 1:37:33industry. I talked to that just like I'm
- 1:37:35skeptical this just don't look at good like doesn't have
- 1:37:38control or they're like, fuck this.
- 1:37:40Like this is like they're scraping Arch station, all the
- 1:37:43ethical concerns to but when I, when I start talking That things
- 1:37:46like this. They're like, holy crap.
- 1:37:48It's not Zero Sum, right? Like, it's not like these are
- 1:37:51the mediums at our disposal and I'll machines can automate that
- 1:37:54away. We're going to create these
- 1:37:56newer canvases for our imagination and we couldn't
- 1:37:59possibly author for this type of content.
- 1:38:02If we didn't have things like Unreal Engine, you're all
- 1:38:06Radiance, feels these generative models, these large language
- 1:38:09models, these like text-to-voice generators, all this stuff I
- 1:38:12think like in Confluence kind of like this, voltron's her to
- 1:38:15come. Together will let us create
- 1:38:18really really amazing thing. So I'm excited to see how like
- 1:38:21the consumption media. The way we author content
- 1:38:23changes and goes beyond just flat video into this like higher
- 1:38:27level of abstraction. I love the, I love that my
- 1:38:31personal excitement really translate to tools that speed up
- 1:38:35the process. So I can focus more on the
- 1:38:37things that I love rather than spending time on the things that
- 1:38:40are time consuming and or there are manual labor.
- 1:38:43So for my case would be like I would love to see it tool that
- 1:38:46can edit videos for me, you know, cut the seams and imagine
- 1:38:51you give you a script as a text because what we do for example
- 1:38:53to be shoots, the clip is like 50 Clips.
- 1:38:56He's talking, I'm talking, I'll give him the script.
- 1:38:58We cut everything, put them in order, you know?
- 1:39:03Do the sound, add some sound-effects and I'm ready.
- 1:39:06Oh, my God. I would kill for that tool right
- 1:39:08now. I promise you guys, we can have
- 1:39:10another episode later on probably the year and probably
- 1:39:13some of the stuff we just talked about today has already become a
- 1:39:16reality and we just look back and be like, do you guys
- 1:39:19remember we talked about this? It's going to be really fun.
- 1:39:22I definitely, you know, observe both of your sort of
- 1:39:25excitements, what you guys are excited about and I would love
- 1:39:28for that. To happen as well.
- 1:39:30Thank you so much again for your time.
- 1:39:32It was such an honor and such a blast speaking with you and
- 1:39:36learning about the way you do things.
- 1:39:38And I'm sure it's helped so many people watching as well.
- 1:39:41So thank you, is there anything that we need to know about what
- 1:39:44you're working on? Just before we go something that
- 1:39:47people can be looking forward to on your Twitter on Tick-Tock you
- 1:39:50know your website put I'll put every single Link in the
- 1:39:53description, your YouTube, your Twitter, like Tick-Tock
- 1:39:55everything so people can really follow you on because I
- 1:39:58personally Personally, followed you for quite some time now.
- 1:40:00And the good thing is I learned a lot every single time that,
- 1:40:03you know, you post something. It's a learning lesson for me.
- 1:40:07So I think it would be for everybody else as well.
- 1:40:09Are you doing a newsletter at the moment I do but I'm not very
- 1:40:12regular with it, unfortunately. Yeah.
- 1:40:14So like, if I do, I do have a Creative Tech digest when I have
- 1:40:17things to say I put them there but largely Twitter is where I'm
- 1:40:20basically openly sharing my work flow.
- 1:40:22So if you're interested in either like the cool new stuff
- 1:40:25that's happening and then like how I make some my content I put
- 1:40:28it right there. Or if I were to plug one thing,
- 1:40:31which I'm pretty bad at plugging.
- 1:40:32I'm still getting used to that part of the influencer life is.
- 1:40:37So I am a part of this like a group of AI influencers on Maven
- 1:40:41and we're creating our own AI courses.
- 1:40:44So I have one coming out on multimodal, AI creation, it
- 1:40:47starts right after 4th, of July enrollment is open right now.
- 1:40:50We've already got a great cohort.
- 1:40:52So if you're interested in like honesty, I've got most of the
- 1:40:55information available on my Discord on my side.
- 1:40:58Stack and on my Twitter but if you want a little bit more
- 1:41:02accountability, and if you want to a understand all the models
- 1:41:05at your disposal and then understand their pros and cons
- 1:41:08and sort of where they're going in, the research trajectory, and
- 1:41:11then, how do you like put them together with very simple tools?
- 1:41:14Like cap cut to create some of the types of content we talked
- 1:41:17about basically 3D scanning reskinning reality creating
- 1:41:21virtual avatars making all those Balenciaga type of videos that
- 1:41:24have been going viral there is going to be this generative AI
- 1:41:27master class on multimodal. And so if you're interested in
- 1:41:30that, just go look it up multimodal creation on Maven.com
- 1:41:33and yeah, be awesome to see you there.
- 1:41:36If not hit me up on Twitter, DM S, I try to check it at least
- 1:41:40once a week and always down to collaborate, always down to
- 1:41:43share thoughts, and thank you also, for reaching out and it
- 1:41:46was really awesome to be here. The Lord is always with, put the
- 1:41:49link to the course as well, in the description for anyone's
- 1:41:52interested, and thank you again to everybody watching.
- 1:41:55We'll see you guys again next week.
- 1:41:58With another guest. So thank you until then ciao.