Latest / Bad Decisions Podcast / #55 Cinematography & Virtual Production in Unreal Engine with Matt Workman
Transcript
- 0:00Hello and welcome. My name is Matt Workman.
- 0:01Let's check out how the virtual camera works.
- 0:03I'm doing this in my house. How do you do everything you do?
- 0:08So. This is Matt Workman.
- 0:11He's a cinematographer and virtual production pioneer.
- 0:14He's known for his viral videos showcasing Unreal Engine,
- 0:18Metahumans, motion capture, cutting edge virtual production
- 0:21tools. He's also the creator of
- 0:23innovative softwares that empower film makers to plan and
- 0:27visualize scenes with ease. What was the transition like
- 0:31going from cinematographer DP to going into becoming essentially
- 0:35a game desk? There's a lot of people who do
- 0:37that in the film edition where they work on set and they
- 0:38develop software for it and tools you've.
- 0:40Developed Cinetracer on your own.
- 0:42What was the biggest challenge making it?
- 0:44How does this work? I knew like nothing.
- 0:47Let me tell you, back then there were no Youtubers, T-shirts.
- 0:50No, there's nobody. I can talk about a failure.
- 0:54Yeah, let's go. Let's.
- 0:55Go. I tried to rebuild cinetracer
- 0:56too. I wanted to.
- 0:58I put it out there and that was received horribly, really bad.
- 1:03Oh man. The most valuable people in this
- 1:08space are the ones that can inspire us.
- 1:11They're the ones that can show us what we can do.
- 1:13You have inspired thousands, if not hundreds of thousands of
- 1:17artists around the world, but the real question is what
- 1:20inspired you in the first place? Matt, welcome to the Bad
- 1:25Decisions podcast. Hey, thanks for having me.
- 1:27It's a pleasure to meet in person.
- 1:28We've we went over this in person virtual.
- 1:30It's good to meet. Thank, you know, virtual in
- 1:33person. Yeah, this is how we're doing
- 1:34it. It's fine.
- 1:35It's perfectly fine. At least we're finally meeting
- 1:38because it's been such a long time.
- 1:40You wanted to speak with you and we've been a a long time fan of
- 1:43the continent you produce. So it's it's a pleasure to have
- 1:46you on the podcast. Yeah, looking forward to it.
- 1:49Matt, listen, one thing that me and Farah Hood have talked about
- 1:53prior to this episode, we were discussing the fact that the
- 1:57most valuable people in this space, in the creative space,
- 2:01are the ones that can inspire us, are the ones that can show
- 2:05us what is possible. They're the ones that can show
- 2:08us what we can do, things that we didn't know we were capable
- 2:11of. And The funny thing is that that
- 2:13is precisely how we found you. You have inspired thousands, if
- 2:18not hundreds of thousands of artists around the world just by
- 2:23the experiments that you've done on the YouTube channel, just by
- 2:26showing us precisely talking about our metahuman content that
- 2:31we were watching the motion capture videos that you created
- 2:34with meta humans, with the lightsabers, with the cloth
- 2:37simulations, with the chairs, with the pitch perfect motion
- 2:41capture, with your Vicon system. Things that we didn't know were
- 2:45possible with meta humans. You showed us that way and it
- 2:48inspired us to go and learn more about meta humans, to create
- 2:51content about meta humans. And I cannot even imagine how
- 2:54many more artists. And that is, I think, why you
- 2:58are one of the most valuable members of this community and
- 3:02you've inspired many people. But the real question is what
- 3:05inspired you in the first place? Well, specifically talking about
- 3:12like meta humans and, you know, motion capture.
- 3:14I like I think when I was younger I really wanted to make
- 3:17game cinematics. I still do played.
- 3:19I think I'm pretty sure I'm thinking like StarCraft one like
- 3:23intro cinematic. There's like a zergling and a
- 3:25truck hits it. They're like I think they're in
- 3:26the desert World of Warcraft cinematics with the marriage.
- 3:29Like I know, I know the shots and you know, it's it's kind of
- 3:32just been like a journey trying to get to there.
- 3:36It did start off in live action production because back then
- 3:39computers were like, back when I was in like, you know,
- 3:41elementary school, middle school computers were pretty slow.
- 3:44Doing 3D was pretty painful. It's not like UE5 real time now.
- 3:47Now it's like, you know, it's, it's, it's pretty fun.
- 3:50But it was like actually like game cinematics and movies in
- 3:53general. I just wanted to make you know
- 3:55that that type of image. Did you study for that?
- 3:59So when you had that passion, when when you were young, did
- 4:01you go to college or uni for cinema or for 3D?
- 4:06I ended up going to school for computer science 'cause that's
- 4:09what I thought. Made sense.
- 4:11High 5. I did that too.
- 4:14Did it work? Yeah.
- 4:15It's like, you know, I, I don't, I don't, there was no, or if
- 4:17there was game industry or movie industry or where I was growing
- 4:20up in Boston, I wasn't aware of it, that I don't think the
- 4:22Internet was as pervasive. You know, if your channel
- 4:24existed back then, I might have been able to get a, a better
- 4:28approach to it. But I went to school for
- 4:29computer science. I was like, that's how you make
- 4:30games. And but then I ended up
- 4:33transitioning into like film making kind of for similar
- 4:35reasons that I said, it's just like 3D back then.
- 4:38It's like really slow. I was like, this doesn't look
- 4:39like what I want to make. It's like there's the Blizzard
- 4:42cinematics and here's what I'm making.
- 4:43And I was like, these are not the same things.
- 4:46So filmmaking, just live action filmmaking.
- 4:47I was like just so much more immediate.
- 4:49And I ended up interning in New York City at Curious Pictures,
- 4:53which I think is possibly gone now.
- 4:55They're in animation studio. And I was lucky enough they had
- 4:58a mocap stage. They had like motion capture,
- 5:02stop motion cameras and just doing animation for like Barbie
- 5:05and stuff like that. So moved to New York, got into
- 5:08like in a live action VFX and then eventually moved to New
- 5:11York City and just worked in the film industry.
- 5:12What? What was your role when you were
- 5:15working in the movie industry? So it started off as like a
- 5:18gaffer and a camera assistant, so working like crew, and then
- 5:22eventually just started being a cinematographer, director of
- 5:25photography, and at the time was the DVX 100A.
- 5:29If anyone does that camera, I bought one of those was very
- 5:33expensive at the time. I just started freelancing.
- 5:35So I was like Craigslist, mandy.com.
- 5:38I was on that like all day and this came out like this is like
- 5:40right as the first iPhone came out.
- 5:43And so I was like, I felt like I was like the king of like
- 5:45Craigslist Mandy in New York City, which is like job
- 5:48listings, like little just like little web forms respond to all
- 5:51of them. And I would just shoot all the
- 5:53music videos and all the little short films.
- 5:55Like mostly, most were free, some paid a little bit.
- 5:59But then eventually I met, you know, people through that and
- 6:02some of those people went on to go work at like, really big
- 6:04companies and do, you know, bigger things?
- 6:07And I kind of came with them. Wait, so, so you would go on
- 6:10Craigslist and then you would be the one posting your services
- 6:14and the people would find you. You would find people that were
- 6:17had requests and then you would go and do OK job posts.
- 6:20And then you were, what were you doing specifically?
- 6:22Were you just shooting the videos?
- 6:24Were you editing them? Were you just what?
- 6:25What were you doing exactly in all of those jobs?
- 6:28Mostly filming and lighting so like what the cinematographer
- 6:31does. So I brought the camera I owned
- 6:32like a ton of lights over time and I would just shoot
- 6:36everything and everything. One to learn to the network and
- 6:40just build a reel and there were somewhere I would like edit them
- 6:43to, but New York City was like popping enough that it's like,
- 6:46no, it's like there are directors, there are DPS,
- 6:48there's like a there's like a difference.
- 6:50Now I, I'm not sure like how it, how that market would look now.
- 6:53I feel like there's a lot more like I as the video provider
- 6:56deliver the entire project perhaps.
- 6:59But back then it was like traditionally like just the
- 7:02camera lighting. And how How hard were you
- 7:05grinding at the time? As much as I could, you know, as
- 7:09much as it's freelance. So it's like you can't you don't
- 7:11really control like YouTube because like make a million
- 7:13videos if you wanted to like yeah, exactly.
- 7:15So I was definitely like responding to every post.
- 7:18It was like the I was just like all day on this iPhone version
- 7:21one on like Craigslist. I would respond to all of them
- 7:26and I just I would also go like like user forums back in the
- 7:29day, like DVX user and I was just on the Internet.
- 7:33So I suppose not that different than how I am now, but just like
- 7:36everything I could find and I would it's still to this day,
- 7:39it's like I just would share everything.
- 7:40I think that was a big one. I was like Facebook, literally,
- 7:43literally Myspace, Myspace DP ING away.
- 7:47But I would just just like I do now.
- 7:49It's like, hey, I just shot this video and we'd put it out there
- 7:51and people like that's cool. And it led to some pretty big
- 7:53opportunities. Got to shoot like a music video
- 7:56for like KRS-one. They flew me out to LA and
- 8:00people like, hey, I saw that music video you shot.
- 8:02It's like, you want to shoot one for us?
- 8:04And it just kept going. And this is like kind of early
- 8:06Internet stuff. Now it's like obvious, but like
- 8:09back then it was pretty pretty new.
- 8:12That's an interesting point right there because you know, I
- 8:15don't know if you know Gary Vee, right, Post Gary Vee era,
- 8:18everybody started making content because then there's this guy
- 8:21shouting every single day on Instagram.
- 8:23Whatever you do, make video about it.
- 8:24So I think I I. Would like to give some credits
- 8:26to him for making most of the businesses in the world small to
- 8:29medium sized businesses. Understand you need content for
- 8:32your business, but prior to him, it was more so a personality
- 8:36trait. Did you, were you the kind of
- 8:37person who would like to share your work online?
- 8:39And it's funny that even at the Myspace era, you were sharing
- 8:43your work, even though at the time there was really no
- 8:45incentive to do so. I mean, now, you know, if you're
- 8:48sharing it, you're going to get money from YouTube, you're going
- 8:50to get money from sponsorship deals.
- 8:52Back then, there was really no incentive.
- 8:53So what what was motivating you to take in all these jobs and
- 8:57then go back home, spend time to post about them?
- 9:00Even though I I don't know how many likes you got at the time,
- 9:03I honestly I'm curious to know how how posted.
- 9:05Well, I don't know why I never used Myspace.
- 9:08It wasn't until like Facebook, there were likes, I think.
- 9:11I'm not even sure you could track it.
- 9:13It used to be like top friends, but I don't know why we're
- 9:15talking about Myspace, but it would literally be like, it's
- 9:17like, oh, if like one of the directors or like, you know,
- 9:19someone like that put you as like their top friend.
- 9:21I was like, that's it. We made it like, so I, I don't
- 9:25think there was engagement like that back then, but it's like it
- 9:29was sort of like straightforward because it was like a portfolio,
- 9:32right? So it's like, I always have like
- 9:33a website, you know, like a traditional website and it's
- 9:35like, that's what I've shot. You know, if you would like them
- 9:38to look like that, That's, that's what it is.
- 9:40So it was, it was kind of just like a, a portfolio, but I've
- 9:42just always really liked filming behind the scenes, taking
- 9:46pictures and just sharing that. I just, and I still do and
- 9:50that's what I still do. It was, it was no different back
- 9:53then. It was just like like a, a real
- 9:55camera on, on set, you know? Now it's much more virtual, but
- 9:58it's pretty much the same. Like I like making images and I
- 10:01also like talking about them at the same time.
- 10:04But that's a great trait. A lot of people are hesitant to
- 10:07put their content, their work behind the scene online.
- 10:10Even nowadays, which is much easier from your era and much
- 10:13easier to get jobs, a lot of people are hesitant.
- 10:16Was it difficult for you to post your work or post your project
- 10:19even though you thought that they were not perfect or they
- 10:22were not good or you were OK to put everything online?
- 10:25I was pretty OK, probably just from like, from like ignorance.
- 10:28I think if I came from like, that's.
- 10:31A superpower, I think. Yeah, I, I think even now, like
- 10:34I, I look at what I've posted on like I think like LinkedIn is
- 10:38kind of Myspace now. I'm not sure that that's really
- 10:40the equivalent, but it's sort of like Myspace for music videos.
- 10:43And music at the time was like serious.
- 10:45I was like artist posted there and direct just posted there.
- 10:48I'd post there. I look at some of the stuff I
- 10:49post on LinkedIn. It's very like sketchy, like
- 10:51sketchy, like sketch phase. I was like, there's a concept
- 10:54I'm throwing it out there. Is this AAA quality?
- 10:57No, certainly not awful. Like with this go to portfolio.
- 11:00It's like you're disqualified immediately.
- 11:01But I I kind of just like have to these days.
- 11:04That's that's sort of my work. I was like, Oh, I like tried
- 11:06this thing. I'll post it even if it's like
- 11:08grey box and awful. It's like, that's just how I how
- 11:12I kind of do it. Whereas I can, I can certainly
- 11:14understand the approach of like, we're going to wait till it's
- 11:16finished and it's perfect. And here's the perfect art
- 11:18station post. I'm like, I don't think myself
- 11:21even makes it to that that phase at the time.
- 11:24So I'm happy to do it. And it's it's worked out well
- 11:27for me so far I think. I love that.
- 11:30That mentality is so good. Of course it's not for
- 11:33everybody. Yeah, but.
- 11:34But I think it will help everybody if they do it.
- 11:37Again, I don't wanna use the term everybody because, you
- 11:39know, so many people might not even care.
- 11:41They don't. It's not even their goal to have
- 11:43any sort of attention on social media or get any jobs.
- 11:46They're just happy creating art for themselves.
- 11:48So for those people, I'm happy that's not who I'm talking
- 11:52about. But there's a huge population
- 11:54that we get texts from on our Instagram on a daily where
- 11:56they're trying to get their renders in front of people,
- 11:59where they're trying to get their videos in front of other
- 12:01people. And the method that you've used,
- 12:03I think you works perfectly because then even if your work
- 12:07is not 100% done, you can still start sharing it online.
- 12:11Just a photo, just a comparison. And you never know whose eyes
- 12:15might be set on your post, because the algorithm works in
- 12:19Wondrous and sometimes the the weirdest moments can happen
- 12:22where somebody you actually respect will see your work.
- 12:25They might share it. And they might, they might hire
- 12:27you. How many times people have
- 12:28reached out to us and said that, oh, I, I loved work with that
- 12:32guy. I made a fan arc.
- 12:33They saw it. They hired me right after that.
- 12:36Yeah, definitely. And, and that's how I got
- 12:38connected with Epic Games. You know, I eventually from from
- 12:41working on set as ADPI started doing previs, technical previs.
- 12:45So I've been making 3D movie cranes and things like that for
- 12:48a long time and you know, for. How did you do that?
- 12:52No, I'm actually for people who might not know what is previs.
- 12:55Do you mind explaining what previs is?
- 12:57Yes. Yeah, So in from, from my
- 12:59context anyway, like as the cinematographer, we would need
- 13:04to like pitch and bid projects. It's like, hey, the director
- 13:07wants to like film this shot, there's two people, they're
- 13:10spinning in a circle, it turns blue, it turns orange.
- 13:13And it's like, what does that mean?
- 13:14Like literally that's what the treatment says.
- 13:17So for me, as ADPI used to pre visualize that or just visualize
- 13:23it. So I would get in like a 3D
- 13:24program like SketchUp, which is like a used to be a free 3D
- 13:27program. It's not anymore, but was like
- 13:28kind of a blender. You type free place a 3D program
- 13:31and I would just be like, here's a cylinder, here's another
- 13:33cylinder. Those are the two people and
- 13:35then put a little camera there and that's previous.
- 13:38And we would send those boards out with the pitch or once the
- 13:41job was, you know, one, it would be like, OK, what are we really
- 13:45doing here? And like before we're in person
- 13:47as like, here's some planning as like, did you want to look this
- 13:49way? Is it this, is it this wide
- 13:51shot? Is it a close up?
- 13:53So just kind of planning visually, you know, you could 2D
- 13:55storyboard it, but I would do it in 3D.
- 13:57So that is that's how I used previz as a as ADP, as a
- 14:02cinematographer. Wow, and where did you learn 3D?
- 14:07Just trying to be a 3D artist, but failing for many, many, many
- 14:11years and then going into live action filmmaking.
- 14:14I think I started with Milkshake and Bryce Milkshake.
- 14:18Milkshake. Milkshake is like a really old
- 14:203D modeling program. So you'd have to like, you've
- 14:23really heard of it. You haven't.
- 14:25But then there's yeah, I've never heard of it.
- 14:27Holy. Shit, it's not industry or
- 14:28anything like that, but it was like it was like free I think a
- 14:31long time ago. And Bryce was like a kind of
- 14:34like an environmental program poser.
- 14:36You just to move like 3D people around.
- 14:38So I've been doing that for a while and then I eventually got
- 14:42into in college during programming, I also took like a
- 14:46couple like Maya courses and, and learned Maya, which is a
- 14:49very like academic 3D program. Like they have free student
- 14:52licenses. I took a couple of courses and
- 14:55like the big turning point for me was and I, I discovered a
- 14:58company called the third floor, the third floor in Halon, like a
- 15:02really big previous companies for movie companies.
- 15:06So like what I would do for like a little music video they do for
- 15:09an entire movie and they'll make the they'll make the entire
- 15:12movie first in 3D and plan out a lot.
- 15:15And a lot of it's very technical.
- 15:16It's like, OK, so like the cranes this like how high?
- 15:18How how high does that mean we have to build the set?
- 15:20So it's technical previous. And once I discovered that
- 15:23through like behind the scenes reels or like VFX magazines and
- 15:27all that sort of thing, I was like, whoa, like a 3D camera for
- 15:30planning. I was like, that's like kind of
- 15:32my jam and that's still pretty much my channel.
- 15:35I was like, that is like, you know, absolutely incredible.
- 15:37So I, I started to build like 3D cameras, like the, the actual 3D
- 15:41camera and the Dolly and the crane.
- 15:42They would go on. I just slowly learned how to do
- 15:45it. I remember being on the train
- 15:47and like on my janky PC laptop, like trying to 3D model like a
- 15:50Dolly and like, Oh no, like that was that was like the that was
- 15:55the grind for a while. But making making those, it's
- 15:58like it got a lot of, I'm not sure a lot, but it actually got
- 16:02a lot of a surprising amount of industry attention.
- 16:05I was like, I'm just like building my little 3D cameras,
- 16:08like no big deal. But I made like a Maya plug in,
- 16:11which is like one of my first companies and like real people
- 16:14started using it and people still want it.
- 16:16I just don't make it anymore. And I started building Cinema 40
- 16:19products around this, like 3D cameras in cranes.
- 16:22That's still used by like a lot of people.
- 16:24It's not supported anymore. And then the way I got connected
- 16:27with Epic is Epic. Someone from Epic Games saw this
- 16:30and this is like right before, and they must have probably
- 16:33known that this was the direction.
- 16:34This is like right before, like the word virtual production was
- 16:36a thing. Like no one.
- 16:39I made videos about virtual production like 10 years ago
- 16:41using the word and it was like shit.
- 16:43And it was like, it was like, and it was like, what is this?
- 16:45Like it's like no one really knew, but it was like, so like
- 16:48Epic kind of contacted me like right before.
- 16:51They were like starting like the big virtual production journey
- 16:55and asked me to build this kind of stuff in Unreal Engine.
- 16:57And that's how I sort of as literally how I got into Unreal
- 17:00Engine. I was building it on my own and
- 17:02they were like, Hey, wouldn't it be cool if you did this in a, in
- 17:04a game engine? I was like, what's a game
- 17:06engine? Like, why?
- 17:08Why would you do that? Which seems silly now perhaps
- 17:11to, to ask that, but at the time it was pretty.
- 17:13It was like I'd done like a little UDK 3 at the time.
- 17:18But anyway, posting my my my little like 3D cranes and
- 17:21whatnot on the Internet got me directly connected with Epic
- 17:24Games. Wow.
- 17:27I love hearing that and I love how it all turned out.
- 17:29And we're going to break it down because I want to know when you
- 17:32were making the Maya plug in, the Cinema 4D plug in.
- 17:34This is when you were working at the third floor.
- 17:37So I was never working there. I just respected their work a
- 17:40lot. I saw their their behind the
- 17:42scene demos, right. They were that was the first
- 17:45time I saw like a 3D crane like a nice accurate model of a crane
- 17:48being used for what is technical previs.
- 17:52So I, I was never working there, but as ADPI did work with
- 17:56companies like the mill and frame store, I'd be the DP
- 18:00there'd be like AVFX supervisor there.
- 18:02And so there was a little bit at that time we would like exchange
- 18:05Maya files and what I wish they used Linux and like really crazy
- 18:08versions of Maya. I'm on like a Mac and trying to
- 18:12which is still technically, I guess Unix, but, but I never
- 18:15worked there. But I did work alongside some
- 18:18big VFX companies and we kind of like exchanged notes, especially
- 18:21for like motion control shoots was like the the cameras on like
- 18:24a robot. That's all planned.
- 18:26That's all planned. I was like, Hey, send me the
- 18:27Maya file. They're like you, you use Maya.
- 18:29I was like really badly but but yes.
- 18:32Still do it. Yeah.
- 18:33So as how many years did that go?
- 18:36I'm, I'm talking about before you joined forces with Epic
- 18:39Games to create what we're going to talk about Cinda, Tracer and,
- 18:42you know, everything else you've done.
- 18:44How long was that period of time where you were just creating
- 18:47plug insurance, working as a cinematographer?
- 18:50Yeah. So I think I graduated college
- 18:522007 I believe is the year and it was about 10 years of in New
- 18:57York City and travelling all around did a lot in LA And it
- 19:01was sort of towards like the last three years of that I
- 19:04started to get more serious about like building like a
- 19:07product perhaps around the 3D previous.
- 19:09I was like it was before it was just like an asset.
- 19:11I was like when they're bidding me as ADP my age, it would bid
- 19:14me. It's like, you know, Matt does
- 19:14like previous, he's going to previous like most of this
- 19:17shoot, not not everything, but like, but a significant amount.
- 19:20So it was just like at that time I was like, oh, just like a
- 19:22feature that I have as I get hired.
- 19:24But then I was like, other people are asking, they're
- 19:26seeing this like, like we'd like to do this too.
- 19:28So it's like that last three years, like whatever that those
- 19:31date ranges. I, I don't know.
- 19:33It was about 10 years as ADP and then I feel like it's been the
- 19:36last, I mean, this is just addition.
- 19:38I should be able to figure it out on my resume, but it's like
- 19:426 or seven years has been in Unreal Engine doing that.
- 19:45So it's those are roughly the numbers sofa that doesn't make
- 19:48me like 70 years old, but that's I think that's the I think
- 19:51that's the timeline, give or take a couple, no.
- 19:53One's calculating here. No one's calculating, Yeah, I
- 19:56promise. But.
- 19:57By the time that Epic contacted you, have you worked with Unreal
- 20:00Engine or you were using only Maya and other 3D software and
- 20:03when Epic reached out to you that was the first time you that
- 20:06was like started using Unreal? Before that I had done 1F XPHD
- 20:10course on previz using Unreal Engine, but it was Unreal Engine
- 20:15UDK 3. So it was real rough.
- 20:19It was real, real rough back then.
- 20:21And I was like, it was cool and it but I was like, I was like,
- 20:25hey, but like the Maya viewport's just as good.
- 20:26Why would I, Why would I do this?
- 20:28So I took like 1 UDK 3 course. But then yeah, it was I think
- 20:33unrelenting. It was about four dot 17 or 18
- 20:38when Epic reached out to me and the main thing I was interested
- 20:42in at the time was like RTX, like real time ray tracing was
- 20:46just about to come out. And so that was part of the
- 20:48pitch. So they gave to me.
- 20:50They're like, hey, we're, you know, we're, we're like working
- 20:52on this thing. It's like 'cause at the time I
- 20:54was looking at like Redshift and Octane and GPU rendering and I
- 20:58had I, I had a pretty big user base of people that were using
- 21:01that things. But like those are expensive
- 21:02computers. It was based in Cinema 4D, also
- 21:05really expensive. And it's like, yeah, if you want
- 21:06to do this in real time, just get like at the time, just get
- 21:084/10/80 TI's. And you're, I still have two of
- 21:11them. They're they're around here
- 21:12somewhere. I was like, it's like that's all
- 21:14you need, you know? It's just a lot.
- 21:17That's yeah, that's all. You need yeah, no, no big deal.
- 21:20Like easy for you Vis, you know, but Unreal Engine came to him
- 21:23and they're like, you know, one, it was like, you know, we we
- 21:25would like to, you know, it'd be great if he did this kind of
- 21:27work in Unreal Engine. And two, it's like, hey, we're
- 21:29coming out with this thing that's like real time ray
- 21:31tracing. So it's going to like look good
- 21:32and be really fast. And I was like, cool.
- 21:35And the, the demos that I made back then, the absolutely cursed
- 21:38demos, some of them went really viral because they're just
- 21:41absolutely ridiculous and unhinged.
- 21:43I just, I just started posting them.
- 21:45I could still find them out there.
- 21:47And it's like just weird day one learning on real engine.
- 21:51And so it's like it's 3D scanned me on like a, a Dolly, you know,
- 21:54I just put it in like the third person template and it's just
- 21:56like doing three 60s and like climbing of towers.
- 21:58And I was like scanning buildings back then.
- 22:00I was like just throwing it in there and just kept doing that
- 22:05pretty much every day for the last like seven years.
- 22:08I have to say we have failed in our podcast research.
- 22:10How do we not find those videos? That's the only thing we missed
- 22:14out. It's all we're gonna look for
- 22:15them. It's gonna look for them after
- 22:17this. It's all over the place.
- 22:18It makes sense to not find them. You know, I want to talk about
- 22:25the time where you were a cinematographer before we get
- 22:29into the unreal part and everything.
- 22:32Does everybody in your role do the previous themselves or
- 22:36usually is that done by somebody else?
- 22:38Because as you mentioned, your agent or you know, whoever was
- 22:41pitching for you said that that you that's your feature.
- 22:44You come in and you're going to do the previous as well.
- 22:46And you did it, I'm assuming better than a lot of people
- 22:49because you did the 3D work and make sure everything is done
- 22:51right based on our previous conversations with the
- 22:55cinematographer out the creator, for instance, or in such an
- 22:58important part. Yeah, such an important part of
- 23:01the process. And that's why that's why I'm
- 23:02assuming the the fact that your role was so crucial and why Epic
- 23:07Games also reach out. So I want to know, was that
- 23:09something that a lot of people in your role would do or was
- 23:11that your unique thing? It's pretty unique, there's only
- 23:14like 2 other DPS that I know that would do it like around the
- 23:18level I was doing it. And I would say that it's not a
- 23:20skill that every shoot needs, not every director even plans at
- 23:25all. So it would it would certainly
- 23:27bring me into very specific shoots and they would be very
- 23:30technical shoots. But I liked that.
- 23:33I liked being on like I liked, I was like secretly liked 3 DA
- 23:36lot. So the shoots I gravitated
- 23:39towards were like on a stage we're starting from nothing.
- 23:42We're going to build every single thing that will be on
- 23:44camera is going to be built except for the humans, I
- 23:47suppose. And so like that lends itself to
- 23:50planning because it's like, hey, like how big a stage are we
- 23:53getting? It's like, I don't know how big
- 23:55is the wall, right? It's like, so these are very
- 23:57nebulous conversations sometimes.
- 23:59So planning really lends previous lends itself to that.
- 24:02And that would get me into those shoots much earlier in my career
- 24:06than I probably would have been otherwise.
- 24:09But like if it's like, hey, it's a handheld shoot, we're gonna go
- 24:11into like 5 different countries over the next week.
- 24:13It's like, yeah, we're not probably pre visiting that.
- 24:16And if it's very narrative based, which like Jodie Leipes
- 24:20is his DPI like always respected their work.
- 24:22It's like it's more, it's more like traditional narrative.
- 24:25So it's like that doesn't usually get pre visualized as
- 24:28much. It's not really needed.
- 24:29It's kind of like you kind of feel it.
- 24:30It's like this room's feeling very warm over here and we're
- 24:33gonna go over there and we're filming and it's like more of a
- 24:36documentary kind of approach, which is really popular back
- 24:38then. So no, most DPS don't and most
- 24:42jobs don't require it either. But it was, it was what I
- 24:44specialized in and kind of with my like wanting to work in 3D
- 24:48background. It was like, this is like kind
- 24:49of the 3D of live action here. Like I'm planning in 3D.
- 24:51We're going to execute it with robots.
- 24:54The lights are on dimmer boards. And, you know, it's very, it's
- 24:55kind of kind of makes sense. Makes sense.
- 24:59And was this around this time the idea of Symmetracer?
- 25:03And for those who are listening who don't know, Symmetracer is a
- 25:06cinematography visualization app made by Matt.
- 25:09So did the idea came around that time to make an app that
- 25:13everybody now can use? So it started off with just
- 25:16making assets for like plug insurance and assets for Maya
- 25:22for I I never made of her blender, but you know, for
- 25:24cinema 4D and then make them for under lender because like making
- 25:28the whole app is kind of like it's a lot more than just making
- 25:31the cameras and just make the cameras not be done.
- 25:32It's like that's that's pretty chill.
- 25:34But when Epic reached out to me to bring this kind of stuff to
- 25:38Unreal Engine, I did not know Unreal Engine.
- 25:40I didn't know how to write AU plug in.
- 25:43I didn't know how to make anything there.
- 25:44So I couldn't really make assets for the engine.
- 25:47I was like, let me just try making a game, right?
- 25:50It's like I just need to learn this.
- 25:51So like, let me just put my cameras in here, a couple of 3D
- 25:54scan people and like pre built locations.
- 25:57You couldn't even build anything.
- 25:59And the thing that I released, which is absolutely unhinged.
- 26:02I'm about to do it again. Actually something similar.
- 26:04It was one level awful level It's like a warehouse and you
- 26:08could move around 3D scam people put up 1 camera and like one
- 26:11light and I released it I put it on steam.
- 26:14Oh my God, I put it on steam and it was and I put it up for
- 26:19$90.90 on Steam. So game developers are like what
- 26:23is this? But for context, like the the
- 26:27Cinema 4D plug and I was making before this was $500, which is
- 26:31it was like all the assets and a plug in and all this stuff.
- 26:33And it was targeted towards Cinema 40 users who were
- 26:35spending 3000. Like is it a year?
- 26:38Anyway, it's pretty expensive to get into that ecosystem in
- 26:40general. And premium plug insurance and
- 26:42assets at that point were about that price point.
- 26:45That's what I put it at. They were eventually hundreds of
- 26:48people that would go on to use that.
- 26:50So I was like, it's like, if I'm gonna put all this stuff
- 26:51together into like an app and like actually do this, it's
- 26:54like, I can't be like 20 like an indie game.
- 26:56I was like, that will never turn into a, a business for me
- 26:58because it's like a small market.
- 26:59I thought at the time it's like, so we, we would price higher.
- 27:02And it was, it was, I was like, I never thought like the
- 27:04general, the general public. I don't know what that means,
- 27:06but like kind of the general creative public would ever be
- 27:09into it. It was like, Hey, people who use
- 27:11my stuff in cinema, here's like this kind of like experimental
- 27:14Unreal Engine thing, which is like significantly less and it's
- 27:17kind of experimental and we'll, we'll see how it goes.
- 27:20And so that that's how it started.
- 27:25And one camera and one light. It was like, yeah, and there's I
- 27:28think those videos are private, but I I could find them from the
- 27:30early demos and I was streaming on Twitch at the time.
- 27:32It was like multiplayer at one point and have like users come
- 27:35in like be like multi people flying around.
- 27:37It was chaos. It was like anyone who makes
- 27:38like their first like indie game, except it was just the
- 27:41whole point was to take screenshots and and plan and it
- 27:45it must have been things. It was like such a different
- 27:47Epic Games back then like that that project early on one, this
- 27:53is pre mega grant and one's the wrong way.
- 27:55They don't like saying that was awarded.
- 27:57I think it was called an unreal grants back then.
- 28:00It was before the mega grants. So I, they told me to apply for
- 28:04it back then and it was awarded one back then and it was like a
- 28:08front page story on Epic games on the Epic Games website, which
- 28:13is like that I could find it. It's like literally my train
- 28:15level. It's like a Decagon train
- 28:17dragged into a level. You know, I was like, hey.
- 28:21And then a bit later on as like virtual production, like really
- 28:26hit, they were like really, really pushing it.
- 28:28This is like Mandalorian time, right?
- 28:30Yeah, a little bit right before that they, you know, I've, I've,
- 28:33I've printed presented at GDC for them.
- 28:36I was like mainstage on one of the mainstage presentations at
- 28:39like the SIGGRAPH user group. It was like a big one and they
- 28:43really like blasted it and supported it a lot in the
- 28:47beginning. So a lot of this is epic, has
- 28:50helped quite a bit. I've always just been doing the
- 28:52kind of cameras and stuff I've been doing, but they really like
- 28:55elevated it quite a bit. Yeah, I can see why you're
- 28:59wearing that Unreal cap now. It makes a lot of sense.
- 29:02Yeah. What was it transitioned like
- 29:04going from physical cinematographer DP before COVID
- 29:10and then as we talked about, this was during COVID time when
- 29:13you started with Cinetracer to going into becoming essentially
- 29:16a game dev. Yeah.
- 29:19So I'm trying to think of the transition point.
- 29:22I had moved to this house, so before Cinetracer, I don't like,
- 29:27I was like half working as ADP, half building like plug
- 29:31insurance, but it wasn't enough from the plug insurance to like
- 29:34make it my full time job at that point.
- 29:35And there's a lot of people who do that in the film industry.
- 29:37They work like on set pretty high up usually and they develop
- 29:41software for it and tools and they kind of feed each other,
- 29:44but it's like maybe not enough to like actually sustain it.
- 29:48But when I don't remember like the exact turning point, but
- 29:51eventually Syner Tracer started to pick up like a lot of Steam
- 29:55and on Steam and it it was selling it off those like I was
- 29:58like. I just got that.
- 29:59Yeah, I just got that. Forgive us.
- 30:03It's an Internet delay. Internet delay.
- 30:07But at A at a certain point, it was making enough that it became
- 30:10my full time. And I still to this day have a
- 30:14hard time distinguishing between like making a game.
- 30:17So it's certainly not and making an app.
- 30:20And it's always been this like weird hybrid back and forth and,
- 30:25and making another one of these like sort of like, is it a game?
- 30:28Is it an app? And it's, but that's unrelenting
- 30:30and on. And so I, I credit them that
- 30:32it's like possible to make that. But yeah, at a certain point it
- 30:36was selling well enough and hit mainstream, not mainstream.
- 30:39It's not like a mainstream game, but like a lot more people than
- 30:42like the couple 1000 cinematographers I was looking
- 30:44for. It's just much, much bigger than
- 30:47that. I want to know with Synatracer
- 30:50for anybody that is hearing about it for the first time,
- 30:53what is the biggest problem that you're trying to solve?
- 30:57So right now it's becoming slightly redundant because
- 31:02Unreal Engine is such a good place to do previs.
- 31:04There's just no question. Like real time rendering, like
- 31:07meta. Humans are free, you just
- 31:08download them. You know, lighting does.
- 31:11It doesn't require the 10 the four 1080TI's anymore like you
- 31:15do pretty good, almost like you know any reasonable computer,
- 31:19but I would say is that is time. It's still faster for most film
- 31:24makers to open something that is like pre made, like I take I use
- 31:31meta humans, but they're completely wrapped.
- 31:32You just drag them out. You just the close is right
- 31:35there. It's all in there.
- 31:36You don't have to do like any coding or anything like that.
- 31:38I use my my mocap system. It's like the mocap, the
- 31:40clothing Boom, they're ready to go change their hair out.
- 31:43Like I, I've downloaded the entire meta human creator app
- 31:45and you can you can configure it.
- 31:47It's all just like instantly there.
- 31:50So that's, that's primarily the, the main thing at this point is
- 31:52it's just going to be a lot faster.
- 31:54It's all pre. It's like it's cooked, if that
- 31:56makes any sense. It's like there's no waiting for
- 31:57shader signal pile. So film makers don't really
- 32:00have, I would say a lot of time to do previz and planning.
- 32:03Typically it's not paid. It's not a paid part of it.
- 32:05It is for me or it was, but it's it's hard to bid that.
- 32:09So I try to make it as fast as possible while keeping the
- 32:12quality. So it's like, it's just, it does
- 32:14one thing like I don't know if what, but it has like 1 focus,
- 32:18right? So it's like you're dragging out
- 32:19a camera, you're putting these people in the lights go there,
- 32:22we take a screenshot. And I'm thinking of these like
- 32:2415 seconds, 15 minutes sessions where it's really, really fast.
- 32:28So certainly this type of work can be done, should be done in
- 32:31Blender, Unreal Engine, Those are all really good.
- 32:34But it does usually take a little bit longer and there's a
- 32:37bit of a learning curve. So I, I sort of see it as like
- 32:40kind of like a good stepping stone to get into Unreal Engine
- 32:44previz and that sort of thing if you ever go there.
- 32:46But for a lot of people that use in a tracer, previz is not their
- 32:48goal. They don't want to be good 3D
- 32:50artists. They don't want to learn how to,
- 32:53you know, make clothes from many humans and, and stuff like that.
- 32:55They're like, literally like, how do I get a storyboard done
- 32:58like as fast as possible, you know, and it's also like the
- 33:01language around it is wrapped in a way that is like friendly for
- 33:06a film maker, a live action film maker, right?
- 33:09So like if you're like, hey, I want to know how to do previz in
- 33:11whatever DCC, you know, unrelention blend or whatever.
- 33:14It's like that's very 3D and they're like, what are these
- 33:16words? Like we don't talk like that on
- 33:17set in the game, in my context in in this world, Syna Tracer
- 33:21and the other things I make, it's all translated back to film
- 33:24making terms. So try to speak the language and
- 33:26make it fast really. Right, let's talk about making
- 33:31the syna tracer. So you develop syna tracer on
- 33:34your own. What was the biggest challenge
- 33:37making it? To plug if I can, I am speaking
- 33:41at Unreal Fest this year in Seattle on this exact topic.
- 33:45They they just announced it like today.
- 33:46So by the time this goes out, it should be legal to to say that.
- 33:49Yeah. But literally Andy Blondin, who
- 33:54is works on the broadcast and virtual production at Epic, he's
- 34:00the one that contacted me, brought me and I was like, cool,
- 34:03how does this work? I do like nothing.
- 34:06And there were, let me tell you, back then, there were no
- 34:09Youtubers teaching this. None.
- 34:10There was nobody. I was like, oh, I want to like,
- 34:13it's like, no, no, no, no, there's literally nothing.
- 34:16It was just like the live streams from Epic, which were,
- 34:18which were great, but not as approachable as like the stuff
- 34:21you make. And you know, there's, there's a
- 34:23lot more now. So he literally showed me how to
- 34:26take a variable in a class and have that drive something
- 34:30spinning. That's it.
- 34:32And that's what my talk's going to talk about a little bit too.
- 34:34And it was like. That's how I was born.
- 34:36Go build the. App.
- 34:37Now go build the app. I thought you everything that
- 34:39you. Need and it was that yeah, with
- 34:42the like the handful of like, you know Youtubers in the
- 34:44documentation back then and I did have a computer science
- 34:47background which helped a little bit, but it was very different
- 34:50to learn games because it's it's real time like it's always
- 34:52ticking. Whereas I was making apps before
- 34:55where like you would it was just static, like picture, like, you
- 34:57know, Blender, Maya timeline timeline never moved zero
- 34:59mostly. Whereas like games are just
- 35:02always moving. It's like always ticking.
- 35:04So it's just a different way of programming.
- 35:05But it literally started with like if there's a float and this
- 35:09is going programming, but like it's like there's a float on
- 35:11this actor called height. If I change that number to one,
- 35:15we move the cube up 10 and it's like, OK.
- 35:19And then it just went from there and there were no meta humans.
- 35:22And so getting 3D people to move now it's like it's so easy for
- 35:26people just download the metahuman like.
- 35:28But back then it was, it was a it was a struggle.
- 35:31And it's why it took me so long to make it like reasonable.
- 35:35I think it was a it's tough. But yeah, I started off with
- 35:38like one float drives like the position of an object.
- 35:41And once you get that, you can kind of go from there.
- 35:45How long did it take for the first version of Synod Tracer to
- 35:47be done? From the moment you began to the
- 35:50moment he was released from the from the flow to the moment you
- 35:52released it publicly. I could go look on Instagram or
- 35:56the actual launch date, but I want to say it was like maybe
- 36:00six months or something like that roughly.
- 36:03Damn, it's. Still very good.
- 36:05That's that's very good. Yeah, but it was.
- 36:06No YouTube video and nothing. But it was very bad.
- 36:09So extremely. Disclaimer.
- 36:13Extremely, extremely bad. But yeah, something like that.
- 36:16Because it was experimental again, if if you've like, if
- 36:20this was your business plan, what I've done and you pitched
- 36:23this to anyone, it would be like, this is nothing like what
- 36:26are you talking? It was just like, this is
- 36:27nonsense. This makes no sense to this
- 36:30doesn't make sense to anybody, you know, But that's what it
- 36:33did. And it and it went OK.
- 36:35And it went OK. But yeah, I would, you know, it
- 36:37was it was experimental at the time.
- 36:40I would say that, but I wasn't like, oh, this is going to be my
- 36:42life. You know, I was like, hey, what
- 36:44if we made a game out of this and see if people liked it?
- 36:47Does it even work? That's still like so much of my
- 36:50life was like, does this, is this going to work?
- 36:52And I'll just put it out there. And it did.
- 36:55But yeah, there was something around that time I was also
- 36:58streaming on Twitch back then. I've like streamed on Twitch,
- 37:00deleted the channel, streamed on Twitch again, deleted the
- 37:03channel again. But these are these are other
- 37:05idiosyncrasies I I have. OK, I, I got and I'm, I'm trying
- 37:10to figure something out. So I and I'm going to get to my
- 37:12final question. How much time did you spend on a
- 37:15daily basis or on a weekly basis developing Symmetracer?
- 37:18Well, at that time it was probably like, you know, like at
- 37:23least 8 hours a day or something like that.
- 37:25So every day. Yeah.
- 37:26Oh, yeah, yeah, yeah, yeah. Every day for sure.
- 37:28And I'm, I'm in one of those now, right.
- 37:30It's like back then it was it was still this basement and but
- 37:32it was just like, it was like, you know, it was this computer
- 37:35actually the one I'm using here for my like this is my Zoom call
- 37:37computer now. Old faithful.
- 37:40I think the early signature bills are probably still on this
- 37:42thing actually somewhere. But yeah, loaded up.
- 37:47I think all the beta branches are on on Steam, so you could we
- 37:49could go back in The Time Machine.
- 37:50But but yeah, I was down here literally pretty sure it was
- 37:53there. Yeah, like every day.
- 37:56But those are fun. Those are fun, fun grinds.
- 37:59And even back then I would be like, here's this cursed build I
- 38:01made today. It's going on Instagram, it's
- 38:04going on YouTube and it, you know, and, and I've heard like,
- 38:08I mean, it, it, it, it brought the user base in.
- 38:11There's that, you know, so it got people, they're like, this
- 38:13looks cool, like, let's, let's give it a shot.
- 38:15But surprisingly, like really serious.
- 38:17People also watched me goofing around and unrelenting.
- 38:19And they've, they've told me about that.
- 38:21And it's, it's had its influence on the, the serious side of the
- 38:24industry too, which I'm always like amazed at, But like people
- 38:26have told me that they're like, they're like, Hey, I saw what
- 38:28you were building like back then and like, it kind of like got me
- 38:31starting to build like what I'm doing now.
- 38:33I don't like not naming names at the moment, but like, so, you
- 38:36know, put it out there like I do still.
- 38:40But yeah, I was definitely like an everyday for like months kind
- 38:43of thing to get it out. So what I'm trying to get to is
- 38:47this, If you're spending 8 hours a day on a project where you
- 38:50know yourself is difficult to achieve, and you yourself are
- 38:55saying that even the first version was pretty bad compared
- 38:58to what you imagined it to be. How did you drive yourself to
- 39:02get up and work on something for 8 hours a day?
- 39:05Usually there's a lot of thought that goes in every single day.
- 39:09There's a voice in the back of our head when we're working on
- 39:11something that we're unsure of. It's telling you to give up.
- 39:15What made you not give up during those six months and and perhaps
- 39:19even later on? Yeah, I'm so I'm in one of those
- 39:21sprints now actually. OK, I usually have, I've tried
- 39:28like task managing, like apps and stuff like that, like Trello
- 39:33and like make like big mind maps and like future Rd. maps and
- 39:36stuff like that. Like, but like the back then and
- 39:40even like today now I pretty much like try to go to bed with
- 39:42something I want to try the next day and let that cook overnight
- 39:48while I'm sleeping or just like watching like, you know, YouTube
- 39:50videos or whatever, you know, going to bed And like, that's my
- 39:55thing. I need to get up that morning
- 39:57and like, it's like, can I do this?
- 39:59Is this possible? And I don't have like a big
- 40:02perfect plan with like perfect task breakdown.
- 40:04It's usually just like one thing.
- 40:07And like yesterday's for me was like, I'm building like a new
- 40:12thing called Cam op simulator, which is kind of similar to what
- 40:14I built. I have built but I was like can
- 40:17we get this metahuman as an AI walking around the level?
- 40:22I'm doing the collisions right and it works on Mac OS,
- 40:26specifically on a specific hardware add a frame rate that I
- 40:28want. And I posted that video like 10
- 40:31minutes ago and it, it worked and it worked.
- 40:33And so it's, it's, it's kind of like this series of like there's
- 40:36this one problem going to bed. Let's try it in the morning and
- 40:39get it, get it to work. And I guess I've just like been
- 40:41able to like also keep in mind like what the long term point of
- 40:45that one problem is. But I've been solving like one
- 40:48problem overnight for like years.
- 40:50And I, I still basically have that which I should plan what my
- 40:53one is for tomorrow. But I I've got a I've got a long
- 40:55list, so I'm just going to take. It Do you want us to throw?
- 40:59You, it's beautiful that you say that because breaking down a a
- 41:02complex task or a complex problem into small mini steps is
- 41:08always going to keep you motivated.
- 41:10Because if you're just looking at one big giant task, you're
- 41:13always going to get stressed about it and it's going to be so
- 41:15difficult for you to tackle that problem.
- 41:18Whereas if you break it down into tiny steps that you say you
- 41:21do every single night before you go to bed, let it cook, let you
- 41:24get excited about what you're going to do the next day.
- 41:27That's a very interesting way to keep yourself motivated.
- 41:31Yeah, and, and target the research to to do it like it's
- 41:34like there's like just like hyper specific problem one.
- 41:37I'll tweet it 2 if it's a huge problem, I'm going on Discord
- 41:40and messaging people I know and then also target search that on
- 41:45on YouTube. And I feel like that's how I
- 41:46found some of your videos is like, you know, I was not much
- 41:49of A sequencer user for a long time now.
- 41:51It's like all I do, but like I've always been afraid of key
- 41:53frames still am, but I do it a lot now, especially with the
- 41:57mocap. And it's like, yeah, like the,
- 42:01the, the thing I'm making now is very sequencer based.
- 42:03And I'm pretty sure some of your stuff has come up because it's
- 42:05like I'm so bad at sequencer or I won.
- 42:08I'm OK now. This is crazy that we watch each
- 42:11other. You're watching your videos and
- 42:13how you animate it. It's fucking crazy.
- 42:14I love. That I remember that, you know,
- 42:16we usually work at two different station, but just maybe 2 meters
- 42:19apart. And whenever Farah screams, it
- 42:22means that he found a new video, that the video does something
- 42:25that we cannot do and then he will show you.
- 42:27Most of the time it's your video with meta humans and it's and
- 42:30it's crazy. I wanted to ask because you said
- 42:32you are now developing another app or game, whichever you want
- 42:36to call it, or it's another Sprint.
- 42:38How is this development now different from the time that you
- 42:42were building Cynet Tracer 1? And I want to consider all the
- 42:45YouTube videos. We have AI at your disposal.
- 42:48What are the changes? So what I'm building now is sort
- 42:52of like a smaller version of Cynet Tracer, right?
- 42:55I think from a feature set, but it's more focused.
- 42:58So mostly what I'm building now I have done already.
- 43:02I'm just sort of like it's, it's being it's the end user uses it
- 43:09in a different way. So Synatracer is way more of
- 43:12like an open empty world. You just drag assets into like
- 43:15you wouldn't UE5. They move them around, they take
- 43:18screenshots and that that's it. You make a storyboard.
- 43:21What I'm making now is more like pre, like pre made level.
- 43:25So that it's very sequencer based.
- 43:26So the stuff that you'd you'd shown, you know, it's like, so
- 43:29it's like someone walks around, a scene happens, it's pre made,
- 43:33it's like a cinematic and the person's job is just to follow
- 43:36it with a camera. So it's just a camera operating
- 43:39simulator. But people have wanted this for
- 43:41a very long time because it's specifically being controlled by
- 43:44wheels, which I had, I wish I had them with me, they're
- 43:46upstairs. But it's something that's been
- 43:48requested for a very long time from my user base to make.
- 43:51So the difference is what I know how to make a game from like a
- 43:56class design point of view, getting the meta humans to move.
- 44:00I've been making meta human mocap for, you know, for the
- 44:02last like 2 years. Like most of this stuff I've
- 44:05I've figured out already. So it's, it's, it's this nice
- 44:08kind of like fresh start. It's like, I like know how to
- 44:10approach this from like a high level point of view.
- 44:14And now it's a lot more about like execution.
- 44:15Like are these levels like entertaining?
- 44:18Can they look good? And also like performance?
- 44:20It's, it's, it's very different. It's, it's great to be at this
- 44:23point now or it's like, Oh yeah, like that project is like, I
- 44:26could probably make that in like a good prototype in like 6
- 44:29months, I'm pretty sure. And it's like, I can sort of
- 44:31eyeball, it's like, OK, if we're gonna add like content every
- 44:33couple, like, you know, once a month or something like that,
- 44:36that seems pretty doable. So I, I, I don't know, I just
- 44:38have a lot more experience like basically stumbling over making
- 44:42symmetries over the last seven years.
- 44:43Like just have like a lot more like, I think understanding of
- 44:45what it takes to produce it. So it's, it's much nicer.
- 44:48It's much nicer now. But I, I don't think I knew that
- 44:51I didn't know back then to be afraid.
- 44:52I I don't, I still, I think that's maybe the one of the
- 44:56defining traits. I don't know, to be afraid of
- 44:57this stuff, you know, I just kind of do it.
- 45:00But it's much nicer now. Yeah.
- 45:01I have like a much better idea on how to get this produced.
- 45:05Is there any coding involved in what you're doing or are you
- 45:07doing majority of the stuff with blueprints?
- 45:11Coding meaning C++. I only do blueprints now.
- 45:15I do not touch C++. I know C and that's how I know I
- 45:19do not want to get into it. I know it that I don't want to
- 45:22touch it. Pretty much, yes, Synatracer 1
- 45:24has like a just like some C stuff in it because like it's
- 45:27like, oh, I know C and non religion C let's get into it and
- 45:29it's AC and make some classes and there's some performance
- 45:32games for sure. Certain projects have to have C
- 45:35based. There's no question, especially
- 45:36games, but the stuff that I make primarily is not going to get
- 45:40bogged down by running it completely in blueprints.
- 45:43So I like blueprints. It's much easier to migrate to
- 45:46the next engine version. I had some.
- 45:48This still haunts me. There was some build of Senate
- 45:52Tracer and they deprecated, they deprecated one of their pointers
- 45:55and and C and it became like a shared pointer and I just didn't
- 46:00know what that meant. And it was just, I was just.
- 46:03Seeing I have no idea what that means.
- 46:05If you don't know what it means, who does?
- 46:06Future science graduates, I really don't know.
- 46:08What did you guys study back in uni?
- 46:10Both of you are. I was.
- 46:11Playing. I was playing games, man, at the
- 46:13time. Oh.
- 46:13Man, like the programmers are like, this is no big deal, like
- 46:16the coders, the engineers, but like I, I know that I like to
- 46:18stay away from that when things go wrong and see, man, did they
- 46:22go wrong. It's like so, so wrong.
- 46:26And talk about not having like, you know, too much places to go
- 46:29on YouTube are, are resources. There's just less resources when
- 46:32something goes wrong and see, it's just like, 'cause you've
- 46:35made your own nightmare of a code base and it's like, oh,
- 46:38they're switching out this like core technology and it's, it's
- 46:40like, how do you fix that? And it's just like nobody knows.
- 46:44And that's why the engineers make so much money at these game
- 46:46companies 'cause it's, it's hard and it's not, it's really like
- 46:50no man's land to, to be in the code of it.
- 46:52So my projects are all blueprints.
- 46:55I will go into C++ if I need to expose a couple functions.
- 46:59Currently I'm graphing data and actually that's really slow in
- 47:02blueprint. So that's maybe something I
- 47:03would do in C++, but I try to stay very far from it these
- 47:07days. If I if I can, it's like if
- 47:09there's something that like need CI will build something else, I
- 47:13will find a different way, a different way instead.
- 47:15And because it's, it's just me programming and doing all the
- 47:18arts and all the mocap and all the UI and all the marketing.
- 47:21So it's like C will just slow me down too much unless there's
- 47:24like something super specific. But I try not to go to C++ if I
- 47:27can avoid it, Yeah. That's the crazy part.
- 47:30Me and Farrah were talking about this.
- 47:31How the hell do you do everything you do?
- 47:33I mean, you're literally doing everything.
- 47:36And what's interesting is the different skill sets that you
- 47:39have is quite varied. You are one day doing Vicon
- 47:43motion capture with meta humans and then the next day you're
- 47:46making clothes. And I think it was a couple of
- 47:48months ago you bought this book or you went to the library and
- 47:51you're learning like physical clothes, how to make.
- 47:53Physical clothes and you're taking that that happened, Yeah,
- 47:56yeah. So you, whatever is interesting
- 47:58to you, just decide to learn it yourself.
- 48:00Part of the overnight challenges, you know, I sort of
- 48:02tomorrow I have to, I have to make my own clothes.
- 48:05Yeah, so not everything is all this is like a very positive.
- 48:10I like it, you know, you know, you know, looking at, back at
- 48:14like the stuff I've done, but I will say that like there's been
- 48:18times where I've been LED in a direction that may not have been
- 48:22the most, like, I would say at least financially smart place to
- 48:25focus a year of time. I'm sort of recovering from some
- 48:28of that actually. Right.
- 48:30So it's not like, it's like, I just, you know, tunneled into
- 48:33this one subject and it made $1,000,000.
- 48:35It's like, there's definitely been some like misses in the, in
- 48:39the approaches I've done to some of these projects.
- 48:41But yes, it, it is, it is. I am a generalist, but then I go
- 48:46like I'm a journalist, but I go really deep in a certain
- 48:48direction, like I was really, yeah.
- 48:49I how you were like a generalist and a specialist because you
- 48:52were making freaking amazing meta human clothing.
- 48:55It's not like that's not a general.
- 48:57A generalist is probably me Marvelous is that I can open the
- 49:00software. I can probably make a rope.
- 49:02That's like I spent too long. I'm talking pure business wise.
- 49:06I think I spent too long focusing on that.
- 49:09But I am able to make clothing. I sold it on the marketplace.
- 49:13I can I want to skin for my game.
- 49:15I just make it, you know, so like that that is that is
- 49:17helpful. But there's there's been
- 49:19stretches where it's like I've gone too long in that direction.
- 49:22I can talk about a failure. Not not not too long ago.
- 49:27So when Meta humans first came out, I was like, we're making AV
- 49:30tuber app. This is the future Meta Facebook
- 49:34was still called Facebook. It wasn't called meta back then.
- 49:37And I was like, you know, I'm I'm into this.
- 49:39I didn't have a Vicon system. I was like, we're making AV
- 49:42tuber app with meta humans and the contents on LinkedIn.
- 49:46The cringey content of all that is, is all out there.
- 49:48The the you can look at my timeline.
- 49:50I'm not lying here. So I spent like a year building
- 49:53that this is UE5 early release couldn't package, wouldn't work.
- 49:58So couldn't get it to work. I was like, hey, we should make
- 50:01signetracer too. Basically I was like, I should
- 50:03upgrade signetracer to to UE5, but you couldn't back then UE5
- 50:07early so you you couldn't really do it.
- 50:09And even 5.1 it was like like 5.2 even was like like not
- 50:13quite. I didn't I didn't feel confident
- 50:16to ship on those on those ones yet.
- 50:18So I built AV tuber app with metahumans and I went real deep
- 50:22on it, really deep building like, you know, IK solvers and
- 50:26control rig. But this is how I learned
- 50:28control rig. This is how I learned these
- 50:29things. The things I learned during that
- 50:31period I use now, But that ended up I did that for a very long
- 50:35time or it felt like a very long time, like a year, maybe a year
- 50:38and a half. And that app I never launched.
- 50:42Oh my God, I built it. It was called Citizen.
- 50:44It was the YouTube, the V tuber around it was called Citizen
- 50:46Meta one which some people may know.
- 50:50Oh. Yes, citizen meta one.
- 50:51OK, Yeah, I do. I do know.
- 50:53Yes, I just realized. OK, that makes sense now.
- 50:55Because it but then it that morphed into the Vicon project
- 50:59which is then what is more known now.
- 51:02But it started off as me making AV tuber app in UE5 early
- 51:04release which was rough and it was VR based so like it.
- 51:09Oh. It was cool though.
- 51:11I I still think I could have sold a bunch of it, but I, I
- 51:13sort of like got to a point where I was like, this is not
- 51:16like I was like, what is the business like?
- 51:18Who is this for? But I was so into like, Oh my
- 51:20God, we have 3D meta humans. We got to make a move and I
- 51:22didn't have a Vicon suit, you know, so I spent a long time on.
- 51:26That Sorry, I got to interject. So the app that you were making,
- 51:31was it the one where you were basically creating controls that
- 51:34would help control meta humans in an easier manner?
- 51:36Yeah. It was I.
- 51:38Commented under that video. I commented under that video
- 51:41like a long time ago. I was asking for those.
- 51:44Yeah, yeah. I thought he was part of Unreal
- 51:46Engine. I heard this.
- 51:47I cannot find this shit. So that's what you were
- 51:49developing? Yeah, like picture VR Chat, if
- 51:52you've ever heard of VR Chat, it's like people in VR and they
- 51:55have a pretty good system of tracking hands and fingers.
- 51:57And and I was like, hey, Valve Index fingers.
- 51:59Like how do we Valve Index controllers, the knuckles, you
- 52:01know, how do you make those controllers move Many human
- 52:03hands. And at the time I had a good
- 52:06couple contacts, Epic, and they showed me the new control rig.
- 52:08Control rig was new back then. And I was like, this is great.
- 52:11And I had the fingers moving and I we wrote an IK rig for it.
- 52:14And I was like, is there a business I could make around
- 52:17this? Like, could this be something?
- 52:19And the hype for the metaverse was real back then.
- 52:21So people were like, this is the metaverse and you know, but it
- 52:25yeah, but then you kind of keep reality kind of I was like, this
- 52:27isn't really like a company I think I want to run.
- 52:29I was like, it's, it was another like it requires a lot of
- 52:31expensive equipment to run it. You know, it's like you need a,
- 52:34you need a fast computer, you need AVR system and whatnot.
- 52:38So I spent a long time building that to never release it.
- 52:42And so that was a very hard, that was a pretty rough dead end
- 52:44for me. But I will say I spent a year
- 52:48and a half learning meta humans and they were like, we were
- 52:50like, I had like alpha meta humans like before they were
- 52:52like out publicly and learn control rig.
- 52:56And you know my my knowledge of meta humans comes from spending
- 53:00a year and a half trying to make the move, writing my own mocap
- 53:03system essentially. But I will say the now.
- 53:06You're using it? Yeah, Sorry, sorry.
- 53:08Please go. Ahead, I was just gonna say the
- 53:09the positive of that project's dead end, which financially just
- 53:12never turned into a product, is that Vicon saw it.
- 53:15Vicon is like the is the is a big motion capture company.
- 53:19They make the the cameras and the little dots you see on
- 53:21people and like the big games and movies.
- 53:24They saw that silliness and they were like, why did you try a
- 53:28Vicon system instead of that? You know, because it's like, and
- 53:32so like literally that, that failure of a project did lead to
- 53:35Vicon, which now I use almost like, you know, every other day
- 53:38and, and drives a big part of the business.
- 53:40I, I have now. So well, it, well, it certainly
- 53:42closed one door at the end of that V tuber tried to make AV
- 53:45tuber app. It opened up the Vicon one,
- 53:46which was, which was amazing. And that was like another like
- 53:49year of I think successful R&D, but that that took a while to
- 53:52learn as well. So that's exactly what I wanted
- 53:56to point out the the failure that you were considering
- 53:59brought you so many lesson that now you're using in your current
- 54:02work, current app, the current project that you're working on.
- 54:05So it of course, one year the app wasn't released, but I think
- 54:09the lessons from that app is now throughout your day-to-day life.
- 54:13Yeah, that's, that's the silver lining, the other, but the I
- 54:16don't know what the other color lining is, but the the one
- 54:19that's bad is that didn't turn into a product which is not
- 54:22good. That's bad for me.
- 54:24I need to. So what do you, what do you know
- 54:26more now from the financial perspective of things and
- 54:31business perspective of things that you can perhaps teach other
- 54:34people? What advice would you give to
- 54:36people who might be about to go down on a path that could take
- 54:41them potentially a year or two, Take up their savings while
- 54:44they're developing a game or a movie, A feature film, A short
- 54:49film, Not a feature, a short film.
- 54:51What advice do you have for them?
- 54:54I'm not sure everyone can stomach it and every, every
- 54:56product should be released this way.
- 54:59But what has worked for me is to pose is to you could call it
- 55:02market testing and you know, building your user base early
- 55:06and getting their feedback early.
- 55:09For me, I don't do kickstarters or things like of that nature.
- 55:13I'll just like literally do paid betas.
- 55:16That's not gonna work for every company.
- 55:17If you paid beta a game that's, that's, that's tricky, like an
- 55:22actual game. That's, that's a rough one.
- 55:24But for the stuff that I build, I usually put out like a video
- 55:27on one of my platforms and like, if like a couple people are
- 55:30like, they're like, what was that?
- 55:31Like we, we would love to try that.
- 55:34You know, I think I forget it sounds like a very Gary thing,
- 55:37but it's like, it's like if one person would buy your product,
- 55:40there's probably more people that would buy it, right.
- 55:42So as I put out these like kind of like sketches and guesses
- 55:44into the world, someone's like, what was that?
- 55:47And like someone messaged me on LinkedIn or add me on LinkedIn.
- 55:49It's like they're like, we saw this.
- 55:50It's like we we're pretty interested in that.
- 55:52And so once I once I catch a couple of those, I start
- 55:56building like a user base around that, usually on social
- 55:59somewhere and I just put all the sketches in there and they're
- 56:02rough and they're horrible. But like the people that want
- 56:04it, they see like what's good about it.
- 56:07And I'm doing that now around Cam op simulator.
- 56:09Luckily that's like a sub sect of like kind of the business I
- 56:11already do run. So it's like just like it's not
- 56:15that was I'm not building it from scratch.
- 56:17Like I could convert over like, you know, like 50,000 people to
- 56:19that like immediately on social. But I'm I'm very much building
- 56:25the open and the business model, good or bad, is paid beta for me
- 56:30works pretty well. It's like, I try to be like as
- 56:32as transparent as possible. It's like you're buying this,
- 56:36it's a paid beta. It's going to be bad, it's going
- 56:38to be awful. But you're here because, you
- 56:39know, you want to support it. You'd like to see it do better,
- 56:43start up the Discord channel. Those early adopters probably
- 56:46have like, you know, the best feedback early on.
- 56:49And so I'm doing it better. Now if I could talk about
- 56:51another failure. Yeah, let's go.
- 56:53These are very recent on all failures the last couple years
- 56:58yeah there's been a few so I tried to rebuild syna Tracer 2.
- 57:02I tried to rebuild Syna Tracer as Syna Tracer 2.
- 57:06This did not this did not go well.
- 57:07This is the end of this. Sure it didn't go good.
- 57:11So I, I wanted to simplify Syna Tracer even more, make it even
- 57:16more of a game. So I made it first person.
- 57:19I tried to make it like a simulator game where you had
- 57:22like tools that would come out and simplify it and support
- 57:24controller because certain people were asking for that.
- 57:28And I, I put it out there and I started building in the open.
- 57:32The track record's still there. As much as I would love to scrub
- 57:34that off the Internet and just delete all of those, they're
- 57:36still there. And that was received horribly,
- 57:41really bad. Oh man.
- 57:42Really what what they didn't like so.
- 57:44People got used to and understandably got really used
- 57:46to how Centracer one works, which it's a weird formula of
- 57:49how it works when you're fresh coming into it.
- 57:52It's a weird ecosystem, but like it was built from this community
- 57:54from the ground up over like six years of like, this is what we
- 57:57like, this is what we don't like.
- 57:58This is what we like, we don't like, we built it up.
- 58:00So Nutrace two, I was like, I would like to like redo that.
- 58:02Like think of like a new way. The user base did not want a new
- 58:05way. They wanted the old.
- 58:07They wanted the way that works that we'd built up just in UV5
- 58:10with some of the new tech. I was like, let's just do a
- 58:12whole new thing. And I did it for too long, way
- 58:16too long. So Synergacer 2 is mostly
- 58:18negative reviews on Steam from the user base that's, you know,
- 58:21trying to transition from CT1 to CT2.
- 58:22And they're like, this isn't what we want.
- 58:25So it was sort of a mistake to call it Synergacer 2 because it
- 58:28was really like a reimagining is it should have been like a
- 58:31different project name probably. So that didn't go great.
- 58:36And that was a paid beta. You could buy it, you could try
- 58:39early, and I would get the feedback from it.
- 58:41And I was like, no, no, no, I swear.
- 58:42It's going to be good. We're going to make a new thing.
- 58:44It's going to be better. But so like another thing is
- 58:46certainly to listen to the user base early.
- 58:49And there was there was pushback for like months, months on this.
- 58:53And I was like, no, no, no, no, I swear it's gonna be good.
- 58:55Like we're gonna make it like this.
- 58:56It's gonna be great. And in the last couple, I think
- 58:59it was like a, it was like a couple months ago, I was like,
- 59:02finally, like, OK, everyone hates this.
- 59:04Let's rebuild it the way that they want it, which makes sense.
- 59:07And that's what I did. And so like that, that
- 59:09paperwork's out there. Like the trail is there.
- 59:11I've, I rebuilt it in a more agreeable way to the original
- 59:15user base and people like it now, they love it and it's, you
- 59:17know, it has all the new UE5 stuff and whatnot, but so sort
- 59:20of the pros and cons of like the paid beta approach as the
- 59:24feedback comes in real hot. So yeah, try to keep the early
- 59:28feedback in mind. Can I before, sorry, first of
- 59:31all, I just want to say I really appreciate your honesty to talk
- 59:34about this. I know it's not easy because
- 59:35it's something that you spend a lot of time on and to hear
- 59:39people's direct feedback. And I'm sure some of them were
- 59:42harsh because people don't hold back.
- 59:44You can read the Especially if they paid.
- 59:46Yeah, if they paid, they don't care and they don't understand
- 59:49there's another person behind it all.
- 59:51And having spoken with you having.
- 59:53Yeah, well, the thing I'm trying to say is having spoken with you
- 59:56and I haven't seen your haven't haven't seen your content, we
- 1:00:00know how much you actually care about what you're putting out
- 1:00:02there. You're not just trying to give
- 1:00:04me, give me money for this application.
- 1:00:06We know that because of the track record that you have.
- 1:00:08That's what I'm saying. I appreciate your honesty to
- 1:00:11come and talk about this and Farah, please, I know you had a.
- 1:00:14Question No, I, I want to talk about the close, the paid close
- 1:00:17beta concept. Yeah, Joey, the C Joey CEO of
- 1:00:20School of Motion, he also had this concept and he said it's so
- 1:00:23important. He was saying that the close
- 1:00:26beta is so important because if you go tell your friends I have
- 1:00:29this app, they will all say I will buy it the moment you ask
- 1:00:32for their credit card numbers. Nobody will give you their
- 1:00:34credit cards numbers. So you have to actually make
- 1:00:37sure people pay and then they will give you their construct
- 1:00:39the feedback that I think it's very, very important when you're
- 1:00:42developing something. Yeah, unless it's like, you
- 1:00:45know, you want to like market hard on relief, like how
- 1:00:48traditional game marketing the games should be pretty done
- 1:00:53probably before like even the betas happen and whatnot.
- 1:00:56But that's that's not the kind of company I run at this point.
- 1:01:00Kickstarters have done well for. I've never done them, but I've
- 1:01:02also seen Kickstarters do really well for people.
- 1:01:04I'm just always like, I would just rather like give you like a
- 1:01:07horrible build to try, then take money and then like be like it
- 1:01:12never came out. Like if I had kick started the
- 1:01:15project around citizen meta one, I could have gotten people
- 1:01:18involved like there's no question, but I'd never put it
- 1:01:21out. And so I've, I've, I've run this
- 1:01:24cycle a couple more Times Now and now I'm, I am personally as
- 1:01:27a single solo, like pretty happy and know I can sort of deliver
- 1:01:32paid beta and I'm doing another one with, it's like, so like
- 1:01:35we're starting that up pretty soon.
- 1:01:37And it's like, I know how to run these.
- 1:01:39We're going to listen to the early feedback from the people
- 1:01:41who would, who would, from people who would pay for
- 1:01:43something that's like broken, right?
- 1:01:45Like not working yet, but they see the concept.
- 1:01:47They're like, they need it. They'd want this to work.
- 1:01:50It's like that feedback is like crucial.
- 1:01:52So I, you know, I, I've listened a lot more in the development
- 1:01:56phase of that. It's like, I have my vision for
- 1:01:57it. That's what it's going to get
- 1:01:58us, you know, the first couple of things built, but then it
- 1:02:01sort of becomes like what everybody else wants, unless you
- 1:02:04want mostly negative reviews like I have on Centracer too at
- 1:02:07the moment, which I, you know, I I take as a lesson.
- 1:02:10I was like, we can't, we can't like do our own thing too hard
- 1:02:13without the like. You can't ignore the user base
- 1:02:15that that much. Even if it's like the thing I
- 1:02:17want to have come out. That's just like one.
- 1:02:20That's just my current example. So this is my like atonement for
- 1:02:23you. I was like, I'm sorry, people
- 1:02:24like it now, but they were like, there was like at least six
- 1:02:27months of people being like, what are you building?
- 1:02:29Like we do not, we don't like this.
- 1:02:31This isn't how we want it to work.
- 1:02:33And I was just like, no, no, let me try to get it out and it.
- 1:02:36Just didn't go. The balance is quite difficult
- 1:02:39to achieve. I don't know why, but there's
- 1:02:42this example rising up in my head as you're talking about all
- 1:02:45of this. I used to play a lot of League
- 1:02:47of Legends and a little bit of Dota, a lot of Mobile Legends.
- 1:02:50All of these games where there's hundred plus characters that you
- 1:02:54play and then usually you have this one character that you made
- 1:02:56that you absolutely love and you love that character because
- 1:02:59you're strong with it. And then boom League of Legends,
- 1:03:02Riot Games goes and changes, updates the character and boom
- 1:03:05suddenly your character is fucking powerless, can't do
- 1:03:08shit, just die in all the team fights and the entire
- 1:03:10population. That means that character will
- 1:03:13be mad on forums, on YouTube, on Twitch, live streams.
- 1:03:17And then that's Riot Games decision.
- 1:03:19Are they going to change it? Are they going to buff the
- 1:03:20character, nerf the character? Usually Riot Games needs to have
- 1:03:24the vision. They can't always listen to
- 1:03:26everybody because it's their game at the end of the day and
- 1:03:28they know what's right and what's wrong.
- 1:03:30But they also do listen to the public.
- 1:03:33They do take hints from the public.
- 1:03:34So I know from video games that it's a constant challenge every
- 1:03:39single month with every single update.
- 1:03:41So what you're trying to do right now makes perfect sense.
- 1:03:43You release things that thought were what people wanted and the
- 1:03:47public has showed you, OK, you know what, we might want it this
- 1:03:50way. And now you just have to sort of
- 1:03:52merge your vision with what you think the public would want.
- 1:03:55And that's when I think you'll have the perfect product.
- 1:03:59Yeah, if such a thing is, is possible, but yeah, I I think
- 1:04:02early the feedback is, is important, but I could also see
- 1:04:06like the the like the O toy, like author theory of some sort
- 1:04:09of, you know, project. It's like don't listen to
- 1:04:10anybody and just make the thing that you want, you know, but
- 1:04:13that's that's certainly at your own peril.
- 1:04:15And it's, it's more for like, again, from like the apps point
- 1:04:17of view, like there's not like, I don't think there's like
- 1:04:20there's not like a little art vision perhaps as much for like
- 1:04:25an app. I mean, there is like a certain,
- 1:04:27but like a game and a movie. It's like, oh, there's this has
- 1:04:29a strong singular kind of vision, like arcanes, like our
- 1:04:32style or something like that. It's like if someone early on
- 1:04:34was like, this looks cartoony. We don't like it.
- 1:04:36It's like, well, it doesn't matter.
- 1:04:37We're making it like this, you know, like there's there's
- 1:04:38certainly that. But for apps, when you're trying
- 1:04:40to make a useful hammer, if the hammer's not hammering, you
- 1:04:44know, like, and if people tell you the hammer's not hammering,
- 1:04:46you need to, you need to immediate, you should
- 1:04:49immediately not do what I did. You should, you should try to
- 1:04:53fix the hammer. But yeah, it, it is a balance
- 1:04:56for sure. Cuz like people ask for things
- 1:04:57and they don't understand like the technical requirements.
- 1:04:59And it's just like, no, that's not gonna happen.
- 1:05:02But yeah, anyway, I, I had way too many warnings about how that
- 1:05:05was going. But anyway, so I've had a
- 1:05:07couple, I've had a couple duds, a couple, but most of them I've
- 1:05:10turned around in in some way. I want to know your thoughts on
- 1:05:16UEFN and the future of Fortnite because we've seen on your X on
- 1:05:20your channel that you've been experimenting with UEFN as well.
- 1:05:25Yeah, so I was in the alpha for UEFN testing early and I was
- 1:05:31like, I was like, once there's metahumans in here, this is
- 1:05:33going to be awesome because like I'm, you know, I've invested so
- 1:05:35much time in the metahumans. I'm just like committed now.
- 1:05:37So that was like my main feedback.
- 1:05:38And I did some like mocap in the alpha beta and put that out
- 1:05:42there and I was like, that's what I want.
- 1:05:44And then kind of left for a little while because it was real
- 1:05:46raw in the beginning. It's still very new, but I
- 1:05:49couldn't, there's no, there was no persistence.
- 1:05:51You couldn't save. And like there was so much I
- 1:05:53wanted, like couldn't be there. Now, however, it's really good.
- 1:05:56So I have been looking at building, guess what cine tracer
- 1:06:00in, in fortnights building the building, the stuff that I build
- 1:06:04there. And it's, it's close to
- 1:06:07possible. So I for me it's like very
- 1:06:11interesting because it's natively multiplayer, which I
- 1:06:13decided early on to not do multiplayer.
- 1:06:15I got multiplayer working and then learned enough to not make
- 1:06:18a multiplayer game because it's solo.
- 1:06:20It's, it's just like everything is way harder in multiplayer.
- 1:06:24But then Fortnite comes around and you know, I see it as like
- 1:06:27it's a 3D World. We can have multiple users in
- 1:06:30it. I can bring my camera stuff in
- 1:06:31there and I could make, I could make a form of synatracer in
- 1:06:35there. And then also I'm, you know,
- 1:06:38really interested in building kind of like cinematic
- 1:06:40experiences in there too, which at any time I add anything like
- 1:06:42that to my apps, because they're apps, they're not games.
- 1:06:45People are like, we don't, we don't want this.
- 1:06:47It's literally the feedback. So I'm kind of interested in the
- 1:06:51kind of like flexing, sort of like a creative linear thing
- 1:06:54over there. And on top of that, there's a
- 1:06:58lot of interesting contract work specifically around UEFN right
- 1:07:01now, which is pretty interesting.
- 1:07:02So I've been contacted by a couple of companies to build
- 1:07:05islands there in a certain style.
- 1:07:08So it's it's a pretty interesting ecosystem.
- 1:07:09It's similar to like when Epic games was like, ever heard of
- 1:07:12Unreal Engine? I'm like, Nope, you know, it's
- 1:07:14it's, it's, it's kind of like that there as well.
- 1:07:17I don't think that I'm probably going to make like the next
- 1:07:19viral game mode that gets like, you know, concurrent 100,000
- 1:07:22players or something like that. But I just think that there's
- 1:07:25some fun opportunities for me to build kind of the stuff I've
- 1:07:28built in UV5 there. So I'm I'm very interested in
- 1:07:31it. And since GDC, I think is when
- 1:07:34many humans got released for it. So, you know, I'm very testing
- 1:07:38at the, you know, testing that stuff out as much as I can.
- 1:07:42I think UEFN is definitely a very cool opportunity for
- 1:07:46artists to go ahead and showcase some of the creative work inside
- 1:07:50Fortnite. It's something that wasn't
- 1:07:52possible before. Yes, of course we had the
- 1:07:53roadblocks, but there's nothing like the graphical fidelity of
- 1:07:58Fortnite if you're comparing that to Roblox, and the
- 1:08:01possibilities of now bringing in meta humans and things of that
- 1:08:04sort is crazy. We made our own UEFN map and the
- 1:08:07entire experience leading up to the publishing of the map was
- 1:08:11wonderful. We loved it working in teams.
- 1:08:15Online version control Version control.
- 1:08:17Is. So why don't you put that in
- 1:08:19Unreal Engine itself? Yeah, they should be native in
- 1:08:22Unreal Engine. It's fucking crazy.
- 1:08:24It's perfect when you're working with other people and you're
- 1:08:26just bringing in assets and then boom, you hit simulate and
- 1:08:29you're inside Fortnite and you have this giant photogrammetry
- 1:08:32asset that you have. It's it's a joy to create in
- 1:08:36there. But then the pain came when one
- 1:08:38week before publishing they release a new update and the
- 1:08:41fucking collisions broke. We had to change our entire game
- 1:08:44literally 2 days before we publish.
- 1:08:48So these things are are I think the only the the main
- 1:08:51disadvantage because you don't have control over what comes out
- 1:08:55and if the update comes in and it breaks your game, you just
- 1:08:58have to be careful about that. And it happened to us, it
- 1:09:00doesn't happen to everybody, it happened to us.
- 1:09:01So now we are more careful about taking in jobs or contracts when
- 1:09:06it comes to UEFN because you you can't.
- 1:09:09How can you say that to a client?
- 1:09:11Like, hey, one day before we publish, shit might go down.
- 1:09:15So that's the only thing. But aside from that, we had a
- 1:09:18wonderful experience creating it.
- 1:09:20And I definitely recommend people who are watching and
- 1:09:22listening to give it a try at least one time.
- 1:09:24I think it's a joy. I remember so like a while back
- 1:09:30I did this like LED project shoot with Epic games, like the
- 1:09:33the motorcycle, like LED wall shoot.
- 1:09:35Yeah, yeah, yeah, I was, I was on stage for that shooting that
- 1:09:38for like a month with them. And I remember getting dinner
- 1:09:40with with someone from Epic and I was just explaining like
- 1:09:43probably drunkenly a little bit like building cemeteries.
- 1:09:46And I was I was like, you know, I wish there was this like
- 1:09:48managed Unreal Engine ecosystem. I was like, I don't want to set
- 1:09:50up my own Perforce, you know, it's like, I don't want to have
- 1:09:53to set up like microtransactions and like, you know, DLC stuff.
- 1:09:57And it's like, I just want to build it, you know?
- 1:09:59And like that is UEFN in like 5 years from now pretty much.
- 1:10:05It's like UEFN is Fortnite. That's where the player base is.
- 1:10:08But you know, once you can spin off that, you know, cloud hosted
- 1:10:13assets and you know, native multiplayer and native payment
- 1:10:15systems like with FAB is coming in the future and stuff like
- 1:10:18that. It's like, you know, that that
- 1:10:20is what I want. I don't want to have to build
- 1:10:22like the infrastructure back end server stuff of like a live
- 1:10:25service game, but I would like to use those things.
- 1:10:28So it's like, you know, like Roblox, but it's, you know,
- 1:10:30Unreal Engine. So I, I'm very much looking, I,
- 1:10:32I look at using UEFN as kind of practice in a preview of what UE
- 1:10:386 will look like, basically, which I think is interesting.
- 1:10:40Like 10 years from two years ago from whenever Tim said that is
- 1:10:45like UV 6 is like is, is all those things, the cloud managed
- 1:10:48and like all the back ends like set up for you, But it's just
- 1:10:51straight UV6. It's not Fortnite based and it's
- 1:10:54not UV 5. People still build their own
- 1:10:56like stand alone UV5 stuff, but I would rather build it in like
- 1:10:59the epic games, you know, Fortnite, when Fortnite and UV6
- 1:11:04are the same exact thing. It's what I've wanted like for
- 1:11:07a, a very long time. So I'm, I'm pretty excited about
- 1:11:09that. But it is like you're just
- 1:11:11living at the razor's edge because it's like me, I locked
- 1:11:14Symmetracer 2, which is UE5. It was 5.2 for a long time, only
- 1:11:19just came to five, four. That's not how Fortnet works.
- 1:11:22As you know, they're in UE55 and it's like, hey, we're pushing
- 1:11:25this new thing. It broke.
- 1:11:26It's like tough wait. Wait for the next update.
- 1:11:31So I don't know if they're, if they're UE6 cloud version, you
- 1:11:34know, will have like let's just stay static.
- 1:11:37But yeah, it's, it's something I've wanted as a developer for a
- 1:11:40long time because like I'll just like, this is like a very dev
- 1:11:44side of it. But like, if you've ever
- 1:11:46programmed UIS to support mouse and controller is extremely
- 1:11:51difficult. It is extremely hard to support
- 1:11:53both. And I know that because I
- 1:11:55dropped controller support for centuries or two because I
- 1:11:57tried. It's very, very hard.
- 1:12:00Even with common UI in the frameworks.
- 1:12:01I think when enhanced out, when enhanced output, when enhanced
- 1:12:05input and common UI are out of beta and like they're fully
- 1:12:08working together for UE6, it's going to be perfect.
- 1:12:11But it's extremely difficult. So like having Fortnite handle
- 1:12:14that? Why is?
- 1:12:15Why is it difficult? So picture like, I don't know if
- 1:12:18you play Diablo Four or something like that, like with a
- 1:12:22mouse, you get to like get a position, right?
- 1:12:25It's like, oh, they're hovered and they clicked this thing.
- 1:12:26What do we do with a controller? There's no such thing.
- 1:12:31Well, you could do a virtual cursor.
- 1:12:32Most don't do that, though. It's like, here's an array of
- 1:12:35like, here's a list on the left of like options.
- 1:12:37So if you hit down right, it's going to go down right.
- 1:12:39OK, It's like, cool, well, what happens if when you hover this
- 1:12:42one, it opens up another UI over here?
- 1:12:44It's like, oh, I hit right to go over, but when you hit right and
- 1:12:48you're on the top one, it doesn't do that.
- 1:12:50So you start to have this like infinite tree of things that can
- 1:12:52happen. Logic, right?
- 1:12:54That's one way to do or you have common U, common UI which lives
- 1:12:57above that or behind it or lower level than that, and it's going
- 1:13:01to look at the screen. It's like they pushed right and
- 1:13:03it's going to look from a low level.
- 1:13:04It's like, well, what's the element to the right of it?
- 1:13:06Is it the inventory screen? Is it the?
- 1:13:09So it's all very dynamic, like picture, like a dynamic website,
- 1:13:11like shuffling all these menus around.
- 1:13:12It's like you have to program that state into the controller
- 1:13:16and then there's different types of controllers and what not.
- 1:13:19And then it's like, oh cool, when the mouse comes out, then
- 1:13:21what happens to the UI because you were just controlling what
- 1:13:23happens? So I programmed all that stuff
- 1:13:24for CT2 and it's, I was like, this is insane.
- 1:13:27That's why common UI, that's why they're writing common UI.
- 1:13:29So if you were to work in UEFN, you don't write that stuff.
- 1:13:34You don't know what the controller is doing.
- 1:13:35It just doesn't, you know, and it's like switching between
- 1:13:38third person to first person to editor mode with a, with a, with
- 1:13:42a mouse out, which is what a signature is there can do.
- 1:13:43It's like, that's annoying. There's a lot of stuff you need
- 1:13:46to manage. It's like, oh, we have to hide
- 1:13:48all the mouse UIS and like we give focus to the right windows
- 1:13:50and it's like it's complicated and that stuff doesn't make the
- 1:13:54game better. It's, it's a mechanic.
- 1:13:55You have to do it right or else it doesn't work.
- 1:13:57It's like my mouse doesn't work. What's going on?
- 1:13:59But isn't like, it's not like creative program and like I
- 1:14:02would like to be doing so like UEFN and like a managed
- 1:14:05Fortnite, you know, a managed UE 6 is like just write that
- 1:14:08framework for me. I just want to put the stuff in
- 1:14:10it and do the creative stuff. And it's it's morphine.
- 1:14:13And that's sort of what Blueprints is as well.
- 1:14:14It's like I don't want to do the C++ engineering of like memory
- 1:14:17and like you know, and ready input system, ready my own
- 1:14:19movement, ready a movement component.
- 1:14:23Is is is your life work on? You want to work on things that
- 1:14:26people do end up using. You want to work on things that
- 1:14:28people are going to notice rather than things are just
- 1:14:31supposed to be there. And Fortnite, UEFN more
- 1:14:33specifically, takes care of a whole lot of things like that,
- 1:14:38which allows you to just be more creative and work on what you
- 1:14:41actually want to create. And I genuinely believe it's a
- 1:14:44blessing that we have something like UEFN for anybody who's
- 1:14:47remotely interested in game dev. You fucking get to make a game
- 1:14:51without actually doing most of the hard work.
- 1:14:53You get to make a cinematic for your game with a sequencer.
- 1:14:56You get to do so many things. And then I saw and I got so
- 1:14:59jealous. I think today or yesterday
- 1:15:01Unreal Engine posted the spaceship that they showed at
- 1:15:04one of the the conferences and it's only going to be on fab for
- 1:15:07Fortnite. I don't.
- 1:15:08I don't think it's available for.
- 1:15:10Outside of Fortnite right? I saw in a comment under that
- 1:15:13that they were like just wait it'll fab will I think they will
- 1:15:15release it for UV5. You could also just probably
- 1:15:18could you migrate out of UEF and I forget, but I saw a comment
- 1:15:21from the first part of it said that it would.
- 1:15:23It's probably coming to UV5. OK.
- 1:15:26OK, interesting. One thing I want to segue to
- 1:15:29since we're talking about complex work and complex tasks
- 1:15:34like the UI, the UX, some of the things that you don't want to
- 1:15:37spend time on, but you just have to, if you're not in UEFN, some
- 1:15:40of the blueprints that you have to work on.
- 1:15:42One tweet that we saw or post, you may say now because it's on
- 1:15:46XI, don't know if it was from you or if it was from somebody
- 1:15:49else in the community. I showed you this the.
- 1:15:51Blueprints. Yes, so now you can take
- 1:15:53blueprints, post it on ChatGPT and GPT will understand all of
- 1:15:58the logic. And then you can start asking it
- 1:16:00questions about the blueprints and then tell GPT what kind of
- 1:16:03blueprints you want to not blueprints, what kind of logic
- 1:16:06you want to add. And then he will tell you so
- 1:16:08that you can go ahead. And without having an extremely
- 1:16:12good amount of knowledge of blueprints, you can go in and
- 1:16:14create a really nice structure that wasn't possible before.
- 1:16:18You know that, right? You have to go through thousands
- 1:16:21of pages of documentation, live streams that are three hours
- 1:16:24long, YouTube videos if they exist.
- 1:16:26But now with AI, you can fucking do that.
- 1:16:29So what are your thoughts on AI and have you used it yourself to
- 1:16:32help you with what you're building?
- 1:16:34I saw something that like with that for verse, which I'm
- 1:16:38learning like everyone else is and the language changes every
- 1:16:40day or like every release I feel like and it's like.
- 1:16:43And sorry verse, for anybody that doesn't know, that's what
- 1:16:45the programming language of UEFN is at the moment, correct?
- 1:16:48Yeah, exactly. OK, So I don't know that as well
- 1:16:50as blueprints. So I'm like anything that can
- 1:16:52help like, you know, like I'll take it AI for code, like
- 1:16:57there's a lot of different AI out there.
- 1:16:59So like AI for coding, though, what I think would be useful is
- 1:17:04kind of how Versify is doing it, which is like the first AI
- 1:17:07system I've seen kind of being developed is like, I would like
- 1:17:09to make this type of game with these features And it's like,
- 1:17:12it's like, cool, here's the template code for that.
- 1:17:15It's sort of like how Unreal Engine has like templates and
- 1:17:17and demo projects for the like third person blueprint or
- 1:17:22template, first person template, car racing template and whatnot.
- 1:17:25It's like that for coding. I can see that being useful.
- 1:17:28But like coding is like, from what I've heard mostly from
- 1:17:32people who are like, you know, high level engineers is it's
- 1:17:34like, it's like, yeah, it can give you something quickly, but
- 1:17:37then you have to comprehend what it did and figure out what it's
- 1:17:41doing wrong. So I think there's probably,
- 1:17:44it's sort of like, would you rather 3D model something from
- 1:17:46scratch or start from photogrammetry that you have to
- 1:17:49clean up, you know, like a 3D scan, It's like, which is worse?
- 1:17:53And what will get you because it's going to, you know, it's
- 1:17:55like, so which way do you want to go about it?
- 1:17:57I personally cannot sculpt a photorealistic human from
- 1:17:59scratch. I would rather start from a scan
- 1:18:02retop of it. And it's like, OK, I got the
- 1:18:03framework of it, let's keep going.
- 1:18:06So I think there's certainly like code frameworks like that
- 1:18:08that could be smart. And if you wanted to just be
- 1:18:11like text input based, I'd rather just like a check box or
- 1:18:13something. I was like, I want this feature,
- 1:18:14I want this feature. It could be a ChatGPT input, but
- 1:18:18like an intelligent contextual, like code framework generator.
- 1:18:22That's great. That would get me.
- 1:18:23I need that. I'm looking at it for UEFN.
- 1:18:25I'm like, I, I need to build like a a tycoon and I'm like, am
- 1:18:29I writing out like like it could be like 5010 thousand lines of
- 1:18:33verse. It's like, am I writing this or,
- 1:18:34or is there like some sort of template?
- 1:18:36So I think that that that could be helpful as far as like
- 1:18:40templates and getting started having it like actually rate the
- 1:18:43game, I'm not so sure about that.
- 1:18:46But a smart template maker when it's code would be helpful.
- 1:18:50And it's like it's, you know, vetted by like it's like we know
- 1:18:52this framework like works. So I think for that case it's it
- 1:18:55would be useful. I'm excited for that because I
- 1:19:00personally, even though I did computer science, I don't
- 1:19:02remember a single thing about coding Fair.
- 1:19:05And I know how useful it can be and there's so many new models
- 1:19:08now there's the cloud 3.5 sonnet which apparently does code
- 1:19:12really well compared to ChatGPT. The.
- 1:19:14Copilots agents as well that you can yeah, you can use.
- 1:19:17So I heard this. It's a lot of benefit when you
- 1:19:21actually have a code and you want to debug your code.
- 1:19:23So you can give it to ChatGPT or Cloud and they can.
- 1:19:27They will go through it and they'll say you can fix it here.
- 1:19:29Or when you get error messages you can drop the error message
- 1:19:32and it will tell you what save you.
- 1:19:33Hours of debugging, which is I'm sure something you've
- 1:19:36encountered, but I think what you use as an analogy works
- 1:19:40perfectly. The photogrammity versus
- 1:19:42something that was 3D model from scratch.
- 1:19:44For so many people, the photogrammity model is perfect.
- 1:19:46You're just using it in the background of your scene and you
- 1:19:49don't want to fucking model a human.
- 1:19:51But for so many people, if that's the main subject, you're
- 1:19:53going to need to 3D model. So it really depends on your use
- 1:19:56case, and that's a perfect way to put it.
- 1:19:58But I'm just glad it exists because for so many people, it's
- 1:20:01going to open up so many doors and I'm just excited about it.
- 1:20:07I think the best way to end this podcast is to end it with
- 1:20:11something me and Farhart have been super curious about
- 1:20:13because. When we watch your videos from
- 1:20:16before, you had this tiny green screen and you were just using
- 1:20:19one of your cameras to send everything to unreal and it
- 1:20:23wasn't even genlocked like you were just testing things out.
- 1:20:26And then we go to today. I'm we're not very updated as to
- 1:20:30what you've got. You probably have some new
- 1:20:32things, but you have the whole freaking Vicon system.
- 1:20:34You got a bunch of shit right now behind you Yeah, you got you
- 1:20:38got so many cool gadgets. So we want to know, first of
- 1:20:42all, what is your most favorite gadget that you own?
- 1:20:46In the basement. Oh, the Vicon system, there's no
- 1:20:49question. Like, yeah, like it's like, just
- 1:20:53like, it's like, it's like, I always think I say it's like,
- 1:20:56it's like what you think mocap works?
- 1:20:57Like it's like, oh, I stand in front of the whatever and I move
- 1:21:01and the 3D character moves just like that.
- 1:21:04That is this system and there is some work involved, but it's
- 1:21:07like, yes, that's like, and you know, so when you start with
- 1:21:09like other systems, you're like, cool, I'm going to move into
- 1:21:11whatnot. Then you look at the character,
- 1:21:12like what are you doing? Like what's that like?
- 1:21:13That's not what I did optical mocap like this, like it is
- 1:21:17that, you know, with some parameters, but like that's
- 1:21:21helpful. I'm that I'm that much closer to
- 1:21:23making the thing I want now. We are so jealous.
- 1:21:27What is the next gadget that you're eyeing on?
- 1:21:31What is the next thing you want to buy?
- 1:21:36Talk about side projects that may not go anywhere.
- 1:21:37I I I wanted. A1 year project?
- 1:21:41A sewing machine or a clock? That's a good one.
- 1:21:47I I want an Apple Vision Pro, I'm not going to lie.
- 1:21:50So wait. Wait wait, are we going back to
- 1:21:52the V tuber thing as soon as the metal 1 coming back?
- 1:21:56I could. I see so many things.
- 1:21:57Are any of them good? You know, so, so part of the
- 1:22:01reason Cinta submitted 1 the V tuber project like wasn't as
- 1:22:05viable as it was like as like PC only and VR.
- 1:22:09That's not a big user base for me.
- 1:22:11I, I know this is for a fact. I know my numbers.
- 1:22:12It's not not very good. My user base is probably, and I
- 1:22:17tweeted this the other day when I say 50% Mac OS, it's probably
- 1:22:20more like 75% or something like that.
- 1:22:23So I'm like, that's crazy for UE5 dev unheard of, like
- 1:22:26absolutely unheard of. I, I doubt most people even
- 1:22:28understand the beginning of what it takes to ship an IO an A Mac
- 1:22:30OS game or iOS. Really weird.
- 1:22:32There's a lot of steps that no PC developer will ever have
- 1:22:35heard of. So selling VR things to the film
- 1:22:40industry is tough there. I, I have VR, I have made VR
- 1:22:43things. There are VR users I've made
- 1:22:44stuff for It's not a huge market.
- 1:22:47Apple making AVR headset. The film industry is very Apple
- 1:22:52and if they were ever to buy, if they're ever going to buy AVR
- 1:22:54headset, it certainly would be that one because they're on
- 1:22:57iPhone. The number one request I get is
- 1:22:59to build for iOS, which I'm starting to kind of look at.
- 1:23:02It's still like it's like slower.
- 1:23:04Just get a, you know, get a MacBook Pro.
- 1:23:07So if I was to build like an XRAR app in the way that I do,
- 1:23:11if it's a tool, if it's an experience, it's probably going
- 1:23:13to end up being a tool. That's what I end up building
- 1:23:16film makers will. And I think by the time like
- 1:23:18the, you know, the Apple Vision, the Apple Vision Air 4 is out,
- 1:23:23that's what film makers will be using in in my market analysis.
- 1:23:27So, you know, this year's Unreal Fest has a talk specifically on,
- 1:23:33you know, Unreal Engine 5 for Apple Vision Pro and iOS and the
- 1:23:36whole ecosystem. You know, it's it's not there
- 1:23:39yet. It's very early.
- 1:23:40But yeah, like, you know, Apple Vision, Air 3 pop pop popping
- 1:23:46off of the film industry. And, you know, I'd like, I'd
- 1:23:47like to build stuff for it. Now, if I spent a year building
- 1:23:50it now we're not shipping it. It's not making any money and no
- 1:23:54one's going to have it. But it's it's kind of like to
- 1:23:57get, you know, because they're sort of redefining some of the
- 1:24:00open XR stuff. Like what they do is unique.
- 1:24:02And it's like that's going to be the standard and that that's
- 1:24:06just how the people I'm going for is like.
- 1:24:08That is probably what they're going to use.
- 1:24:09So yeah, it's a little hopium, hopium now, but like Apple
- 1:24:13Vision Pro in like 5 years or something like that is a pretty
- 1:24:15interesting space for me because I've, I haven't even used it
- 1:24:18yet, but I just know it's like, from what I've heard people,
- 1:24:20people like, it's like they, they made that, you know, it's
- 1:24:23like one of the hard parts about VR is like the, the UI, the UX,
- 1:24:27it's clunky. So if they, if they smooth it
- 1:24:29out, it's like they just made the iPhone and the iPad of VR
- 1:24:32and it's like, OK, then with amazing XR and camera tracking
- 1:24:36and you know, like any of their systems right now can track your
- 1:24:40face and your full body. And yeah, it's maybe I'm making
- 1:24:42a feature for app again or something.
- 1:24:44But like they have a lot of fun tech.
- 1:24:46So yeah, that's what I would want.
- 1:24:48But I'm not gonna, I'm not gonna spend a year on it just yet.
- 1:24:50But there will be a time where I'm gonna be deep in VR world
- 1:24:54again but deny it. I heard the new they're
- 1:24:58releasing a new version next year, the vision Pro.
- 1:25:01Oh really? I think so.
- 1:25:02Like the hardware? Yeah, the cheaper air, which is
- 1:25:05not. Yeah.
- 1:25:06Do they call it air? No, someone people are just like
- 1:25:08speculating and like making markups of it.
- 1:25:11Because they're speculating for an Air iPhone as well, like a
- 1:25:14thinner, thinner iPhone. That's iPhone 17, not 6, not the
- 1:25:17one that will be released in September next year.
- 1:25:19They're going to be an Air version, OK.
- 1:25:22Have you tested the Vision Pro with Unreal at all?
- 1:25:25I know you don't have one yet, but have you?
- 1:25:27Have you ever seen anybody? Test it, yes, yeah, I followed a
- 1:25:29couple people who are like actively doing it.
- 1:25:32It's still very new and buggy kind of, but it's it's going to
- 1:25:37be I I I have faith that it's going to be good.
- 1:25:40Is it a mainstream thing? Like perhaps not, but like I you
- 1:25:46know, I built for like a very specific segment.
- 1:25:48These are like the US and, you know, worldwide film makers, but
- 1:25:51very much US. That's just where I live.
- 1:25:52It's the most like what I know It's like it's cool tech.
- 1:25:56I mean, it's, it's gonna be, it's gonna be pretty cool.
- 1:25:59And I, I think there's hopefully there's like some utility we can
- 1:26:01build around it like the iPhone. Like if we take like the iPhone
- 1:26:04apps that every film maker uses on set, one of them is Artemis.
- 1:26:07And it's an XR overlay of like where's the sun gonna be at
- 1:26:10noon? It's an helpful thing to know
- 1:26:12for a shoot. And it's like, boom, it's right
- 1:26:14there. I take a photo.
- 1:26:15Every film maker in the world uses that right.
- 1:26:18It's all like there's gonna I think there's similar
- 1:26:22opportunities there that the tech stack that they put
- 1:26:24together. It's like yeah, you're native
- 1:26:25like you put it on. It's like you're tracking
- 1:26:27everyone who's in the room. Everyone you see, you have a 3D
- 1:26:30skeleton of what they're doing. Just native.
- 1:26:33It's just built in. Do you want to use?
- 1:26:34It's up to you like full, you know, just like I I think that
- 1:26:37there's like some cool tools and utility that can come from that
- 1:26:41specifically for filmmaking and also I have a Vicon systems like
- 1:26:44I want to put walking and talking meta humans in VR.
- 1:26:47So ad and I feel like that's, you know, that's a place I have
- 1:26:51a user base that I'm pretty sure like if I released like the
- 1:26:53Apple vision pro, whatever, it's like I I know people will be
- 1:26:56like, I don't know what this dude made, but we were going for
- 1:26:57it, you know, So I just wanted to be there though, because no
- 1:27:00offense to Quest or anything like that, but putting it on
- 1:27:02like the quest store or something like that.
- 1:27:04It's been like or, or even Steam for VR.
- 1:27:07I'm just, I'm like not that into it.
- 1:27:08I just make regular steam games, but like like an App Store, like
- 1:27:12an Apple vision App Store version of it is like I could
- 1:27:14see that being compelling. So yeah.
- 1:27:17Yeah, especially if it's like iPhone App Store.
- 1:27:19At the beginning, the apps were making millions of dollars when
- 1:27:22they. Doodle Jump Yeah, no, no the.
- 1:27:24Beer. They were the beer, the lighter.
- 1:27:26Yeah. So when Apple Vision Pro Store
- 1:27:29start, you know, people start building apps for it.
- 1:27:32There will be huge market for it as well.
- 1:27:34That's now too, I follow because I got really into it at the
- 1:27:37launch. I got real hyped really close to
- 1:27:39like go buying it and well, and, and going down a hole is the
- 1:27:43really the big problem buying it.
- 1:27:44It's like, oh, you know, but like, but like if I spent a year
- 1:27:46building for it, that's you know, that's, you know, it's
- 1:27:49just maybe not that I have to be very careful with that.
- 1:27:50But like, yeah, I follow with all the developers that make the
- 1:27:53like you pick up a thing and you look at it and it's like, or
- 1:27:56like the the I think the big ones like a rocket app that you
- 1:27:58can like put it on. You can like see different
- 1:28:00rockets at the scale and stuff like that.
- 1:28:01It's like, and like the echochet, like the body parts
- 1:28:05that come up, it's like in the early days of those, that's all
- 1:28:07you can get. And they could be like $60.00
- 1:28:09apps. You know, it's, it's like, yeah,
- 1:28:11hey, you, you spend $4000 on this thing and it's like, Oh
- 1:28:14yeah, buy the $60.00 app. We'll just try it.
- 1:28:16It's like, OK, cool, you used it once.
- 1:28:17And like that's the user base in the beginning.
- 1:28:19They're like, they use like an app for 60 bucks like once.
- 1:28:21And it's like, cool, they're happy.
- 1:28:23That's, that's all they want. So that that ecosystem exists
- 1:28:26now, but it's not. I'm not building into it yet.
- 1:28:29I'm just curious what's the the demographic at the moment
- 1:28:32because when the vision Pro was released.
- 1:28:35Yeah. When when it was first released,
- 1:28:38the hype was extremely high. Of course with VR that's usually
- 1:28:43the case. You got the Quest coming out and
- 1:28:44then the hype is there. But Vision Pro, because it was
- 1:28:46an Apple product, the hype was really high.
- 1:28:48I wonder how many people actually use it today.
- 1:28:51In terms of numbers, I do not have the statistics.
- 1:28:53I'm very curious to see how it's growing.
- 1:28:55It's U, it's US only, right? They only just opened it up to
- 1:28:57other countries like recently. So it's it launched US only.
- 1:29:02So that's certainly smaller. I don't know, I've I don't know,
- 1:29:06I don't know. But I, I think for the people
- 1:29:07that are like XR people, you know, had like holo lenses, they
- 1:29:12had like magic leaps. It's like, you know, it's, it's,
- 1:29:15you know, it's a good step for it's like mainstream adoption,
- 1:29:18you know, and having that like the fact you can go to Apple
- 1:29:20store and try on like an XR headset, like pretty much, well,
- 1:29:24eventually it'll be worldwide, but like almost like anywhere in
- 1:29:26the US is like that's, that's a big deal for people who've like
- 1:29:29spent their lives working in XR. It's like validating that like
- 1:29:32Apple's like, yes, we're gonna build, we're gonna build an
- 1:29:34ecosystem for this. There's utility.
- 1:29:36There is utility in it. Like for film, like if it's just
- 1:29:38Artemis and like the XR layout overlay for like, you know, the
- 1:29:42sun where the sun's gonna be, It's like there is utility
- 1:29:45that'll come from it. And the rooms getting stuff is
- 1:29:47really good. I used to be so into scanning
- 1:29:48before I was doing light Vicon stuff, I was working with Lyca
- 1:29:52and like scanning grooms and, and doing photogrammetry and
- 1:29:54stuff like that. And like the iPhone just does an
- 1:29:56incredible room scanner now. Yeah, like people take it for
- 1:29:59granted. It's like you want to scan your
- 1:30:00room, have a perfect model. It's like, yeah, of course,
- 1:30:01like, what's the big deal? But that's only because they
- 1:30:03built this tech stack for it, you know, it's like, so I, I
- 1:30:06hope that there's also like things that we can't even
- 1:30:08conceive yet of. Like once you have all this tech
- 1:30:10in here and it's like smooth, it's like it's new.
- 1:30:14There's cool stuff. I I hope it's cool.
- 1:30:16Hope, hope, hopefully UE5 works on it really well.
- 1:30:19Well, whatever happens, we hope that from the lessons you've
- 1:30:21already learned, you don't go down a path for one year and
- 1:30:25then realizes but you still release but again, but you but.
- 1:30:28Even time, but even if you didn't.
- 1:30:29Release it. This stuff you learned.
- 1:30:31So yeah, you never know what to do.
- 1:30:35Actually do it. Yeah, we're just going to be
- 1:30:38watching, supporting, and we are rooting for you because you're
- 1:30:43always sharing the knowledge. And I think that's the most
- 1:30:46important part. Going back to the very beginning
- 1:30:48of this podcast, we really consider you as one of the most
- 1:30:51valuable members of the community because of the fact
- 1:30:54that you inspire others. And it's not easy to do that.
- 1:30:57I just want people to know that when we create whatever we
- 1:31:01create in Unreal, when you create whatever you create in
- 1:31:04Unreal, it's much easier to just go and sleep afterwards.
- 1:31:07But we all decide to go ahead and make videos about it.
- 1:31:10And these videos are not one take videos.
- 1:31:12They take multiple takes. They probably take a little bit
- 1:31:14of scripting, editing's involved, but we do it because
- 1:31:17we love sharing the knowledge and you have done that.
- 1:31:20You've inspired us and we really appreciate that.
- 1:31:23So thank you so much, one, for sharing the knowledge and
- 1:31:26inspiring us, and two, for giving us your time and helping
- 1:31:29us learn a little bit more about your past and about why you do
- 1:31:32what you do. And also the two failures there
- 1:31:35were, there were so many lessons that came from that.
- 1:31:37So thank you for sharing those as well.
- 1:31:39Yeah, it was a pleasure. I love the stuff you're
- 1:31:41producing and hopefully we do this again.
- 1:31:45Absolutely. Well, Matt, thank you so much.
- 1:31:47And for everybody watching and listening, thank you as well.
- 1:31:50We will see you guys on the next episode.
- 1:31:52Until then, Ciao.