Latest / Bad Decisions Podcast / #24 Virtual Production, Cinema, and Unreal Engine with Jim Geduldick | Bad Decisions Podcast
Transcript
- 0:00It is no secret that Unreal Engine is the engine of toys for
- 0:03real time virtual production. So virtual production is not
- 0:06solely just LED, you know, virtual production cover is a
- 0:11lot of different things. Apart from Unreal Engine, what
- 0:14other software is used to make a virtual production setup?
- 0:17You can start off with a webcam, Unreal Engine, a laptop.
- 0:21You don't necessarily have to go to school for.
- 0:24A lot of what we're doing in visual effects specialists are
- 0:27still very much in demand. All the big studios.
- 0:30Experimenting into stuff too. Is gatekeeping a thing for all
- 0:33this knowledge? Nerves are in this evolutionary
- 0:36stage, so then we start getting into fun talks of like LOD
- 0:40structure and optimization and you know, baked versus dynamic
- 0:44lighting is always a topic. It's never a bad thing to learn
- 0:49more about cinematography and photography.
- 0:51The best ways you can do that is. 321 Are you ready for us of?
- 0:55Course I am, everybody. Welcome back to the Bad
- 0:58Decisions podcast where we give. You guys, a backstage pass into
- 1:01the minds and brains of creatives, entrepreneurs and
- 1:04visionaries from all domains. And today we're turning into.
- 1:08Virtual production because we have the cinematographer, VFX
- 1:11and virtual production supervisor who has worked with
- 1:14the world's leading visual effects studios such as
- 1:17Dimension Studio D Neck. He also previously worked at
- 1:20Apple, GoPro, Autodesk. So everybody, here's a toast to
- 1:23Jim. Get old egg.
- 1:25How are you, Jim? Good.
- 1:26I'll toast back. Thank.
- 1:28You. There you go.
- 1:29That's what I'm talking about. How many cups of coffee do you
- 1:33drink a day? You know what?
- 1:36Nah, I usually try to have like the morning espresso and then
- 1:41I'm good. Just because I know if I have
- 1:44too much from previous history that unless I level it off
- 1:49without eating something by like one or two, you get the espresso
- 1:53jitters. But yeah, I'm not like a 12 cup
- 1:57coffee type of person. It's just that's too much
- 2:00caffeine. But you stay so long in the
- 2:02sets, like these, long hours, you don't need coffee like once
- 2:06in the morning, and you're good to go.
- 2:08Yeah, I mean sometimes in the afternoon you you get one if
- 2:11you're if you're lucky, Crafty has like the good snacks on set
- 2:14and and you know they might have like a, you know, sometimes you
- 2:18might get a good dit that has like a little espresso maker at
- 2:22their at their cart. But I don't know there's so much
- 2:25excitement that goes on on sets that sometimes that's the
- 2:29adrenaline besides caffeine. So you don't need to be.
- 2:32You know, pumping Red Bulls and other energy, there's enough to
- 2:37keep you busy on set. I love that.
- 2:40The thing is, we here were big coffee lovers.
- 2:43Actually, this podcast used to be called Bad Decisions Coffee
- 2:45Break, and then we just took out the coffee break because it was
- 2:48just too long. But essentially speaking, we're
- 2:50the kind of people who drink multiple cups a day as long as.
- 2:54We need to work with like, OK, Chuck another one, Chuck another
- 2:56one. But we know eventually one day
- 2:58we'll be like, OK, go ahead, that's enough because we do get
- 3:01the espresso jitters as well. But sometimes I feel like it's
- 3:04it's like a drug, you know, it is like a drug it.
- 3:07Is it is? A legal drug there?
- 3:10You go it, I mean we could do it.
- 3:13We could do a whole podcast on on coffee and good espresso and
- 3:17and then talking about like. Good beans and not not burning
- 3:23not burning your beans and you if you do it at home versus you
- 3:26know going to like a local roaster or something.
- 3:28So yeah, I can, I can definitely taste the difference of like
- 3:31good espresso versus bad of, you know, I guess I've got the
- 3:37palate now of of being spoiled by good, good espresso.
- 3:42Oh. Yeah, 100%.
- 3:43You get that after you try so many different cups of coffee.
- 3:45That's like natural. It comes naturally.
- 3:48But you know, like you said, we can leave the coffee talk for
- 3:51another day. Let's let's start talking about
- 3:53Threads, because it's been a crazy journey over the past 24
- 3:58hours since Threads was launched as a new social media platform.
- 4:015,000,000 or 5,000,000 sign up in the first four hours.
- 4:05Oh yeah, in the first four hours they got 5,000,000 sign ups.
- 4:08And the best part was the onboarding process.
- 4:10So you go in, it's connected to your Instagram, you follow
- 4:13everybody if you want to, but still, you know, have you got
- 4:16the hang of it or or like. It's it's it's a little weird in
- 4:20the navigation. I would say the the setup was
- 4:23was really easy. You know just click on the
- 4:25ticket you know in the search bar and and it ports over your
- 4:29friends and followers. Like I, I, I I think I met my
- 4:34follower Max and I had to unfollow a bunch of people
- 4:36because I was like wow I follow way too many people and I can't
- 4:40keep track of everybody that's doing all the cool stuff on on
- 4:43Instagram. So I had to.
- 4:45Unfollow some accounts that I just didn't pay attention to as
- 4:48much anymore. And the thread side was cool cuz
- 4:52tons of people from visual effects, animation, filmmaking,
- 4:56art, music all jumped over threads as soon as it launched.
- 5:01So it's cool. So it's like, I think
- 5:03everybody's like, OK we're here now what do we do?
- 5:05You know, you know what's funny? I didn't do sorry to cut you
- 5:09off. I didn't do what you did.
- 5:10I think Farrah did the same thing.
- 5:12But as you, I didn't actually follow all the people I follow
- 5:14on Instagram. I wanted to start all fresh and
- 5:17just, you know, good. Luck you have Good luck going
- 5:20through all your friend list and following.
- 5:22I don't want to go and follow the friend list anymore.
- 5:24I actually want to see is there any new creative people that I
- 5:27might have missed out on Instagram because it's so
- 5:29saturated where I can actually follow new people now so I'll
- 5:32I'll pick and cherry pick like all the new people that.
- 5:35You might have not known. I think this is a good chance to
- 5:37do that as well. That's why I went that route.
- 5:40Yeah, yeah. I mean it's it's it's a lot,
- 5:43there's a lot of lot of noise I would say on all the different
- 5:47platforms, especially for you know people in the different
- 5:51industries that we're you know, following or interested in And
- 5:55you know in tech and AI and machine learning and you know
- 5:58visual facts and filmmaking and you know and art in general.
- 6:02And there's so much of. Content that's being put out,
- 6:06you know, whether it be, you know, content makers like
- 6:08yourselves or just people in the industry.
- 6:11It's funny because there's a there's a lot of people that are
- 6:14in the industry at a very high level that are kind of just very
- 6:18just just going in like dark mode, you know, there's not a
- 6:22lot of fanfare like you, you know, there's there's very,
- 6:25very, very amazing like DPS and visual effects artists and soups
- 6:28and animators and and. And sound designers that are on
- 6:32these platforms, but they either don't use their name or if they
- 6:37do, they don't post very often, either because they're busy or
- 6:40because they're off living life than just posting on social
- 6:44media all the time. So there's a lot of people to
- 6:47follow. There's a lot of cool things
- 6:50that everybody's following because everybody's jumping on.
- 6:53Nerves and AI and generative AI and like using all these
- 6:59different things in new ways. So there's a lot of content to
- 7:03get through to be like where did this source even come from?
- 7:08Because a lot of the influencers post but they don't always
- 7:12credit back and you have to go into their comments and be like
- 7:16this is so and so's work like. You know, that kind of, it's
- 7:20kind of a pain, but it's like, oh, I want to get to the person
- 7:23or the artist that did this or experimented like let me get
- 7:27back to that original person. So if I reshare, I want to
- 7:30reshare from, you know, that person that actually did this,
- 7:33you know, crazy, you know, volumetric thing with like a
- 7:36bunch of Gopros or, you know, or messed around with like wonder
- 7:39dynamics and did this really cool, like animation with the,
- 7:43you know, with the. You know, dancing and you know
- 7:46whatever IK rig they got from like Wonder Dynamics or
- 7:49something. 100%. I just had one question because
- 7:53Jim brought up a really good point that there is a lot of
- 7:55people on top that are actually either not posting or not
- 7:58posting enough. What I what I think would be
- 8:02really powerful if we can see all these people who are really
- 8:04on top and who are really have the knowledge especially about
- 8:07things that people really don't know about nerves.
- 8:10Volumetric scan, photogrammetry and if they share their
- 8:13knowledge, I believe like there would be more people gets
- 8:16interested into all these stuff and they want to do more.
- 8:18That's I agree with Jim. The one issue is time right
- 8:22there. They're working so much on the
- 8:24the stuff they're producing and so they just don't have the
- 8:27time. We for example, have to create
- 8:29the content because creating content around the work is
- 8:31literally the other half it's. If you're spending 50% of your
- 8:35time creating, you need to spend the other 50% doing the content
- 8:38and marketing the content and posting it.
- 8:40Put the captions and now there's threads, so there's an extra
- 8:43platform for you to post on. And so a lot of these top
- 8:46performers who Jim has mentioned, for example, in
- 8:50different industries, they just don't have the time or maybe
- 8:52they're just not fond of putting, you know, content out
- 8:55there. I've seen those type of people
- 8:56and it's a shame because if they.
- 8:59It's if they put out their work first of all we're going to be
- 9:01out of business. Like there's it's just they're
- 9:03they're so good at what they do. Good competition is great.
- 9:05Yeah. Good.
- 9:06Like I would love to see people creating cool stuff yeah and and
- 9:11it would motivate us to create. That 100% to level up to their
- 9:14level of 100. Percent it's it's hard even for
- 9:17myself who like you know, I like to share when I can.
- 9:19It's just when you get in. When you get in the thick of it,
- 9:22other than Ndas which can span years for you to talk about
- 9:27certain projects that you are on or sometimes you can't even talk
- 9:30about projects for until they're officially announced it, It is
- 9:35hard because it's you know, it's not just a matter of like you
- 9:39know time management to find it. It's just like sometimes when
- 9:42you get offset or you're you know on a project for months or
- 9:45over a year or sometimes multi years.
- 9:49You know, it's like how do you find the energy and you know
- 9:52more power to like the early days, early days of people you
- 9:58know with with Mike is like his. I remember going to his site
- 10:02very, very early and when he would post all his cinema 4D
- 10:07projects and I would use his post to break down projects
- 10:11because he was doing. He was doing different type of
- 10:14visuals back then than what he is known for today.
- 10:17But like the everyday is started and he would post them all and
- 10:21he's been doing it you know for really, really long time.
- 10:25Not just like sharing his information, not so much the
- 10:28tutorials but like his old website was just like put up the
- 10:31cinema 4D projects and you know basically use use that as a base
- 10:35and go like oh how did he get that And that's how.
- 10:39I got into a lot of this stuff is like, you know, connecting
- 10:42with people, you know contemporaries of that day that
- 10:46in like motion graphics and filmmaking and you know
- 10:49illustration and design and you had, you know, the peoples, the
- 10:54Gap and strangers. You had, you know, tons of like
- 10:58Danny Young. You had like all these people
- 11:00that were amazing that I looked up to in like motion graphic
- 11:04design and visual effects and and you.
- 11:08Always wanted to know like well how did they do this amazing
- 11:10thing? And BTS was nowhere near
- 11:14accessible as what it is today because of social media.
- 11:18So it's like usually you had to wait if like some kind of like
- 11:20EPK video came out for that project or that that studio did
- 11:27a breakdown or. You got like you know the DVD
- 11:31extra or you bought the book, you know, not like with every
- 11:35major feature that comes out, there's usually an art of that
- 11:38feature that comes out, which is amazing.
- 11:41Those books are are probably some of my favorite.
- 11:45But yeah, information for education is much easier.
- 11:48Kind of like what you guys are doing with your experimenting is
- 11:51like it's it's way easier today, which makes it to be harder
- 11:56because. I kind of say there's no excuses
- 11:59left to just go out and experiment.
- 12:03So if somebody's like, well, I don't have access to a red
- 12:05camera, I don't have access to this crazy thread.
- 12:08Ripper Pro, like crazy Unreal system.
- 12:12It's kind of no excuse. You can get a baseline computer
- 12:17laptop from like a Best Buy or Amazon.
- 12:21You don't need the craziest, you know, digital cinema camera or
- 12:25even the craziest like you know, digital SLR these days.
- 12:28Like you can do a lot with an iPhone and a GoPro and a OK
- 12:32baseline like laptop. And we see it like we see the
- 12:36and I'm gonna forget his name, but he's awesome.
- 12:39Is that like 14 or 15 year old kid from Canada who animated?
- 12:46The Lego piece that he did in Blender and then he got.
- 12:50I don't know his. Name.
- 12:51He got hired for spider verse. Yeah, he's like 14 or 15 years
- 12:54old. Really, really cool kid who has
- 12:57a YouTube will have to find it and link it.
- 13:00But he got hired, you know, by the directors, you know, the
- 13:04spider verse that just just came out and he got invited to
- 13:07animate a section in his style and that kind of Lego, you know?
- 13:12Animation style that fit really well.
- 13:14So you've got, you've got kids, they're all younger than us that
- 13:19have these things and they're just experimenting.
- 13:21I mean, that's the thing. It's like back to the they have
- 13:24the time, you know? And when you're in school,
- 13:27you've got nothing but time to experiment.
- 13:29When you're kind of in the field, you have to balance it.
- 13:32And like I struggle with that too.
- 13:33It's like, oh, here's this new thing.
- 13:35Can I use this for work for what I do, you know, or.
- 13:40Do I just set time aside and jump into like, you know,
- 13:43everything from, hey, any of these new AI platforms or any of
- 13:48these new tools or you know, beta plugins or anything?
- 13:51Unity drops or Unreal drops or so it's like you got to find the
- 13:57right things in there or you might see an inspirational video
- 14:01and go, OK, this person did this in Blender and they did it in
- 14:05Blender and Unreal. They used a Rococo suit.
- 14:07They did this that. OK, that's a cool thing.
- 14:10Like I have that stuff, Let me go try it.
- 14:12Or, you know, big bar of steel, you know, you got a friend, you
- 14:16know somebody you can rent it, you can do whatever to try to
- 14:21get the equipment you need to do it and just just experiment.
- 14:25So it's it's beautiful what you brought up about the concept of
- 14:29the kid being hired and the opportunities that are available
- 14:32today. Even though, you know, we see a
- 14:34lot in the comments where a lot of people are asking for jobs,
- 14:37they don't know where to look. If they are in Unreal Engine in
- 14:40Blender Cinema 40 yet there are other opportunities like you
- 14:44mentioned, like the kid who just uploaded a bunch of videos about
- 14:47himself doing the Lego and for that very reason he was hired to
- 14:52be part of the Spider Man universe.
- 14:54The question I want to ask is. Let's go back to your journey.
- 14:58How different was film and cinema and this industry in
- 15:02general from the moment you started?
- 15:04What was it like back then? And then we can slowly, you
- 15:07know, come back to where we are today.
- 15:09We want to hear about what how you started and how different it
- 15:11was. Well, I started mainly because
- 15:15my thing was not even chasing to be.
- 15:19You know a visual effects artist or or a cinematographer?
- 15:22When I first started it was mainly because of skateboarding.
- 15:26That's what got me into filmmaking cuz I wanted to be a
- 15:29pro skater, pro snowboarder. And you know the the early intro
- 15:36into filmmaking came because of skateboard videos and people
- 15:40that I looked up to. In that realm, you know the, you
- 15:43know Mike Ternasky is Jacob Rosenberg.
- 15:45Stacy Peralta's, you know, Macdog, like these are Spike
- 15:50Jones. You know Ty Evans.
- 15:52You know you you have all these seminal film makers over my, you
- 15:58know, growing up in in skateboarding and action sports
- 16:02and you these were different films that were introduced to.
- 16:08You know, young kids and they weren't your traditional, you
- 16:12know, like Goonies and Indiana and all that would like, you
- 16:15know, feature studio things then those were everybody aspired to
- 16:19be, but there was something really raw and connected for me
- 16:24with, you know, skateboard films because they were not shot well
- 16:30early on, You know, it was a group of friends getting
- 16:34together. So like a lot of, I think a lot
- 16:36of. Us in skateboarding really
- 16:39connect with a lot of the early films is because it captured in
- 16:45essence of like the culture, the art, the the community, which is
- 16:50a big thing about, you know, counterculture.
- 16:53I don't even want to call them sports, but the kind of cultured
- 16:56movements like skateboarding, and I could be biased to say
- 17:00that skateboarding pushes the world forward in music, art and
- 17:05design and just the rawness of it.
- 17:08So I always related to that. I was like wanting to follow the
- 17:14film makers that came before me and I didn't know.
- 17:17At that time, you know, at like, you know when I started skating
- 17:21and I was like 10 years old. So the first skateboard films
- 17:24that I got were either, you know, a friend got one for their
- 17:28birthday or we watched them at the local skate shop.
- 17:31And it was like it's always things like the early PAL
- 17:33Parotha videos. Then you move into like the
- 17:35early 90s with the Plan B videos and they're they they were done
- 17:42and stuffed away at that time that they were groundbreaking
- 17:44just the way that. You know we would see these big
- 17:47temple feature films made but you're doing it with like next
- 17:50to no budget with your friends and that's something I was
- 17:54related to. What helped me in my career is
- 17:57kind of coming up that that do it yourself.
- 18:00The DIY route which is very skate style definitely helped me
- 18:05out in when I got into more professional things and
- 18:09commercials and music videos and and and then feature films is.
- 18:14It it taught me how to do more with less.
- 18:19Wow. And and that DIY route is kind
- 18:22of what we're seeing a lot of people work with today is like
- 18:27you may not have the studio, but you've got the technology and
- 18:31there's there's this thing called YouTube and social media
- 18:34that you don't. When I started, it was like you
- 18:37had to read books. You know, or or you had to go to
- 18:42like or you had to go to like NYU or USC or something like
- 18:45that. And I didn't.
- 18:45I didn't go to school for, you know, for what I'm doing now.
- 18:49It's, you know, it's a self tough thing.
- 18:51No, no, no formal education on on what you're doing right now.
- 18:54Not for filmmaking, no, no. I wanted to go.
- 18:59Funny enough. I wanted to go either to NYU or
- 19:02Pratt. And I just did not.
- 19:05I didn't, I didn't have the grades or like the the track at
- 19:09that time to just jump into into that.
- 19:11And I didn't have a body of work from like say high school.
- 19:16And most high school kids don't unless they focus on it that you
- 19:19go, hey, here's my, you know, because it would be like you get
- 19:22your art portfolio ready to go like and submit it to Pratt and
- 19:25then you'd have to go to the interview or you know, a body of
- 19:27work that would have to go to some school to get you in
- 19:30because you know just how competitive, you know.
- 19:33You know, colleges were and are and I'm in the proponent of like
- 19:41education is really, really important.
- 19:44But it's like how you get that education is so much change from
- 19:50when I started coming up through through the industry versus what
- 19:53it is now. There's a lot more things that.
- 19:55Are accessible and I'm not saying you know skip going to
- 19:58school like those are a lot of formative years and it's it's a
- 20:02lot about connection and experimenting.
- 20:03But you don't necessarily have to go to school for a lot of
- 20:09what we're doing in in visual effects.
- 20:11It's good because it gets you a base you know.
- 20:13So you've got a lot of people doing training out there from
- 20:16visual effects you got you know no man and escape and all these
- 20:20like really top tier. You know schools that you can go
- 20:25to to learn very key things from like industry, you know industry
- 20:28experts that have been in the industry.
- 20:30But there's there's something you said about just like getting
- 20:32your hands dirty and jumping into the stuff and experimenting
- 20:35yourself like you're gonna that's the good thing about like
- 20:39the educational side is like being left to fail at something
- 20:44and then figure out why that didn't work and then when you
- 20:47find the answer. It goes back to those
- 20:50connections of neural pathways. You go like, I did it this way.
- 20:53It took this long. Now I know that either a I did
- 20:57it wrong or now I know the right way to do it.
- 21:00And next time I'll do it this way and I'll be more efficient.
- 21:03Or I can try this new thing. So it's really cool.
- 21:07Yeah, Education. In any realm, not even ours.
- 21:11You know, like, hey, I'd love to learn more about how to, like,
- 21:14cultivate my own coffee beans and roast them at home.
- 21:17You know, it's like, so that's more education.
- 21:20How much of the the people that work in these leading studios
- 21:25that you had the opportunity to work at have traditional
- 21:29education in the form of going to a college and university and
- 21:32studying filmmaking versus how many of them were like you?
- 21:34They went on. Libraries got books or learned
- 21:38from peoples behind the scenes stuff or.
- 21:41Experiencing like just trying out things at home.
- 21:43Nowadays you can try so many things and you can go and hey, I
- 21:46know how to work with Unreal Engine, right?
- 21:48It's a good. I would say it's a good myth.
- 21:50I mean some of the people that have been in Englishly longer
- 21:53definitely have come up in some traditional ways.
- 21:57I mean you've got. You've got people, I know some
- 22:02other VFX supervisor friends that you know came up similar,
- 22:06same way of me of just like wanting to learn and and being
- 22:11really excited about, you know, the potential of maybe not even
- 22:16just to get a job and visual facts with filmmaking, but just
- 22:20got really excited about being a storyteller.
- 22:22You know, and and kind of, I don't want to say, fumbling
- 22:26their way into the industry, but you know, kind of finding.
- 22:29Their own path. And it's like you, I think in
- 22:32the industry you you have to kind of keep reinventing
- 22:35yourself. For me anyway too, it's like I
- 22:39feel it's like I don't jump on a different type of job now and
- 22:44then again or do my own thing, but then I feel like I get
- 22:48stale, like either I have to learn something new or try a new
- 22:50approach or. You know, tackle a new problem.
- 22:56And that's what's fun about working on a lot of diverse
- 22:59projects is I probably would have gotten bored with with a
- 23:05lot of this stuff if there weren't new challenges.
- 23:08And I think that's what's cool about working with new
- 23:11technology in animation and visual effects and filmmaking.
- 23:15And it doesn't matter if it's cameras or it's a new piece of
- 23:17software where it's like, you know, some a new iPhone, you
- 23:22know, it's just like. It's always like trying to do
- 23:28better than I've done before and then also just try to be more
- 23:32more efficient because the the end goal is you know, for for
- 23:36those of us with with family and lives outside of our work is
- 23:40like you know, you want to wrap up, work quicker and get back to
- 23:44you know get back to the other stuff.
- 23:46That's a really key thing I think is like you got to have
- 23:50the good split and it's really hard to do.
- 23:54The balancing between the work life thing.
- 23:56Sometimes it goes way more work than it does life, but that's
- 23:59like you gotta one's gonna influence the other for sure.
- 24:05Yeah, it's a complicated conversation to have and I guess
- 24:09we're gonna get to that, but let's I wanna talk about the
- 24:12journey at Dneg as well and before that, if you don't mind.
- 24:16I just want to ask how, how did you get into the position of
- 24:19being at Dneg and Dimension Studios?
- 24:21Of course these are, you know, leading studios and a lot of
- 24:23people have the the inspiration, motivation to go and work in
- 24:28positions that you did. How did you end up over?
- 24:30There and how is it like working there?
- 24:32A lot of people are, you know, like in different industry
- 24:34people are always curious like how is it working like in
- 24:37Google, Apple, like they really want to know.
- 24:39And since you have this position to work in this big studios, all
- 24:43people are really curious. Yeah.
- 24:45And I'm sure with your conversation with our buddy Bill
- 24:47Wall previously with his Google venture, it's like you know he
- 24:50could tell you probably have to do like 14 different interviews
- 24:54to get you know it's it's it's a bit different at.
- 24:58So if I, if I rewind it really back and being at companies like
- 25:02GoPro and Apple and and Autodesk, they're different in
- 25:09working at companies that are you know releasing products.
- 25:14And that's one good thing that I think was a benefit of working
- 25:19at different companies. Like I said, you know, getting
- 25:22getting too comfortable in things of like leaving.
- 25:26I wouldn't say I left the creative field to go to some of
- 25:28those companies, but it was, you know, I wanted to learn more
- 25:32about things. So like when when I left being
- 25:35like a freelance cinematographer and and visual effects artist
- 25:39for a while and went to GoPro for like almost three years, it
- 25:42was. A matter of wanting to learn
- 25:45more about how to build cameras and software and understanding
- 25:49something. But that was like where where my
- 25:51core came from too is the connection of where a company
- 25:55like GoPro started resounded very well with me.
- 25:58I knew a lot of the early, you know, the early people at GoPro
- 26:03and had been working with them just as a filmmaker.
- 26:07You know, early on they would like see the cameras and give
- 26:09feedback and, you know, this was like.
- 26:13Earlier on before kind of GoPro kind of blew up and I had a
- 26:16friend there that was, I was like, you should come work with
- 26:18us. And I was always like, yeah,
- 26:20yeah, yeah. They're like when you guys are
- 26:21like serious and you make a really good product.
- 26:25Like I don't think about it, but it's just conversations and
- 26:28staying in touch with people. And one time I was just looking
- 26:33for. Something new.
- 26:35And then he hit me up again and he's just like, hey, I think
- 26:39we're ready and we're looking to do this.
- 26:41And this is like GoPro was like getting to be really on the rise
- 26:47and I was like, okay. This seems like something to
- 26:49jump from the frustrations of freelance life, which talk to
- 26:55any freelancer in any industry and they can tell you sometimes
- 26:58it gets. It gets to be a pain in the ass,
- 27:02you know, like you, you have to when you're a freelancer, you're
- 27:06your own, you know, your own CEO, you're your own, you know,
- 27:10bookkeeping department, you're your own marketing department.
- 27:12Like it is, it is you. Unless you are in like a little
- 27:15boutique thing and you start like a little LLC or Escort.
- 27:19And yeah, it's just, it's a it's a different world when you jump
- 27:23to these, to these bigger companies, whether it be studios
- 27:25or. You know, commercial companies
- 27:28like, you know, Fortune 500 companies, it's very eye opening
- 27:32for somebody that comes up from that kind of DIY route.
- 27:38And then skateboarding, like sometimes you clash with, you
- 27:41know, corporate, corporate America in that it's just like
- 27:44oh you know, it's like it's got to be about the core, it's got
- 27:46to be about the core and you know, you get to understand
- 27:51politics really well. Meaning politics within the
- 27:55business, not government politics.
- 27:57But you get an appreciation for understanding what it takes to
- 28:03get products to market if you're working for a company that sells
- 28:08products or creates things. And it helps you in a lot of
- 28:13different ways when it comes to. What we do cuz you're learning
- 28:17different things about budgeting and data cycles and marketing
- 28:20cycles and what it takes to get hardware and software products,
- 28:25which is something I didn't know previously, like in new being at
- 28:292 hardware and software companies.
- 28:30When you're at Apple or Autodesk or Adobe or any of these big
- 28:35companies like it takes a lot of people.
- 28:40To get what we're using day-to-day, whether it be Epic's
- 28:44tools or Adobe's tools or Apple's tools or Autodesk or who
- 28:48it is. So I have a much bigger
- 28:50appreciation for the development and engineering teams to go what
- 28:54they go through and even independent if you're a person
- 29:00that writes a bunch of Blueprint plugins and putting them up in
- 29:04the epic marketplace. That's a job unto itself, is to
- 29:07package that all up and do the marketing for it and then wait
- 29:10and see if it gets approved by Apple or Epic or uni or whoever.
- 29:16But then when I shifted back into kind of like doing these
- 29:21stints at these companies in different studios, you get a
- 29:28good look at how different workflows work.
- 29:32Both on the corporate side and then even at like independent
- 29:35studios. You know because I came up
- 29:38through the industry on the East Coast in New York City and and I
- 29:43work for a lot of different boutiques like a lot of small
- 29:46VFX shops and and you know post facilities and and production
- 29:51companies and when you. Get to see how they work on
- 29:58different levels from like the small shops to the really big
- 30:01shops of you know, like the DN A's dimensions and you know
- 30:04Disney's and other things like that.
- 30:07It gives you a really good insight into how you either as
- 30:12an individual artist or supervisor or whatever your
- 30:15position may be or that you're going for, You either need to
- 30:21augment. You know certain things about
- 30:24your workflow style you, you. It's one big thing about working
- 30:28with big teams or running big teams is being able to
- 30:32communicate well. It's like #1 thing is like it's
- 30:36syncing on set. It's like you have to be.
- 30:39You have to be a good communicator.
- 30:41You have to be you have to be good at reading people and and.
- 30:48Understanding the dynamics, cuz it's different on set, dealing
- 30:52with clients and studios and production teams than it is if
- 30:57you're just sitting in the back end of post.
- 31:01And sometimes you don't get one to one with clients unless you
- 31:06work at smaller shops. It depends on what your role is
- 31:09in that and at bigger shops. You know, it's a different
- 31:16approach because there's usually lots and lots of people.
- 31:18If anybody stays for the credits after you know, a TV show or a
- 31:22film, you know when you get to be effects and posts like it is,
- 31:26hopefully everybody gets their credits.
- 31:29But it is the long things, because there's usually not a
- 31:32project these days that doesn't get touched by visual effects,
- 31:35even if it's a ROM com, even if it's a, you know, a drama series
- 31:40like something's getting touched, colors getting touched
- 31:42things. They get composited, they get
- 31:46treated, pixels get manipulated in some way.
- 31:50It's not always the big sci-fi films or like fantasy stuff.
- 31:54So visual effects and animation is just, it's everywhere it has
- 31:59been. It's just more and more because
- 32:01of the accessibility of what you can do.
- 32:06The way that, like the Dimension Dean Hague thing came into fold
- 32:10is a really good friend of mine who is my one of my former
- 32:13partners at Dimension, Callum McMillan.
- 32:16He rang me up because we actually knew each other.
- 32:20His brother and I worked together at GoPro and we had
- 32:25worked on a bunch of projects together during the GoPro days
- 32:29and we just stayed in touch and we both.
- 32:32Had been working in high speed and multi camera array and
- 32:39volumetric together for a while, either separately or kind of
- 32:44like I'd be working on these projects and he'd be working on
- 32:46these with his former company Time Slice and he just rang me
- 32:51and he was like, what are you up to?
- 32:53This is what we're up to. At that time, time, Slice Films
- 32:59and Hammer and Interactive came together and that's what formed
- 33:03Dimension. And he just said, hey, this is
- 33:07what we're doing. I paid attention to what they
- 33:10were up to with the volumetric stages in London and a lot of
- 33:15the kind of VR and AR and interactive things that.
- 33:20They've been pushing and I've always known Cal and the team to
- 33:24really pushing the next step of like image capture and they were
- 33:30the first Microsoft volumetric capture partner in the world.
- 33:35So they were like the first volumetric stage approved by
- 33:40Microsoft when Microsoft had this division.
- 33:43They shut the division down last year.
- 33:47And why did I join? Yeah, well, I mean, there's been
- 33:53a lot of divisions that have been shut down in some bigger
- 33:57companies. And sadly, we don't always know
- 34:01the reasons. But it sometimes comes down to
- 34:04the big bosses looking at what's generating enough revenue, you
- 34:08know, or marketing cycles. We've seen everything from GoPro
- 34:14to Microsoft to, you know. Apple and and and others you
- 34:19know kind of kill good projects or projects that just may not be
- 34:25in line with what their trajectory is as a as a company.
- 34:28So yeah, it's the same thing. You know, it's like they may be
- 34:33done with that, but you know sometimes you hope they either
- 34:36open source it or that that technology will evolve on the
- 34:40path. You had things like Lightro
- 34:41which were in my opinion Lightro was was released.
- 34:47At the at the wrong time, you know so it's like you know where
- 34:50Light Row was going is like they were probably a tad too early
- 34:53and it didn't hit the market and didn't have an end user.
- 34:58They kind of really understood like what you know technically
- 35:03volumetric capture and display technology would be.
- 35:06But now we're we see more of it today where it's like.
- 35:09Maybe Lighter came out today would have had a better chance,
- 35:13you know, because people would have understood a little bit
- 35:15better. And now that we're talking, you
- 35:17know, volumetric capture and nerves and and and novel view
- 35:21technology, it might have been better.
- 35:23But yeah, the couple of years ago, you know, I joined
- 35:28Dimension Dimension did a partnership on the virtual
- 35:33production side, which became D neg virtual production or D neg
- 35:37VP. In which was a division between
- 35:42Dneg and Dimension that came up to offer virtual production
- 35:46services. You know virtual art department
- 35:49on set services like this whole kind of end to end solution and
- 35:56I got to work on a lot of really cool you know Rd. projects and
- 36:01you know big features you know got to do.
- 36:04Pinocchio and a lot of other projects up until recently and I
- 36:09think in April I decided to leave because I was looking at
- 36:15where technology was going and where the types of projects I
- 36:19wanted to work on and the types of technology that I wanted to
- 36:22focus on, you know was kind of changing and it and also was
- 36:29just I think a time for me to look at.
- 36:34Where I was going to focus you know my time and and my effort
- 36:39for things and you know they they have they have a great team
- 36:44there and you know still talk to talk to a lot of people there
- 36:48and they they're doing some really cool stuff like you know
- 36:51there's some other projects that I finished up on that'll be
- 36:54coming out you know in in the not too distant future and and
- 36:59next year too that I'm really. You know proud of working on and
- 37:03and definitely the teams that we you know got all together
- 37:08because it is a team effort. You can't you know and me as a
- 37:11supervisor I can't I can't do it without the team and and you
- 37:16know you get to really rely upon the different technicians and
- 37:19engineers and and R&D and support staff and production you
- 37:23know managers and producers that you work with like you know at.
- 37:28If it's service based versus like your own creative or own
- 37:31internal project, like you know with the stuff that you guys do,
- 37:36it's it's a lot for two people to do.
- 37:38So it's like the the benefit of being at bigger studios too at
- 37:43the time is the is the type of support staff that you can put
- 37:48together to go and do these projects.
- 37:50You know, that's a really big, big benefit to working at.
- 37:56Large studios or large vendors is you have availability of
- 38:01technology and people that you may not have as like a smaller
- 38:05boutique. But we're even seeing, we're
- 38:08even seeing a lot of that technology be available.
- 38:10You know, just like you guys and your experiments with, you know
- 38:13with Nerf Studio and Instant NGP and Luma and like all this stuff
- 38:17is all the big studios are experimenting with the stuff
- 38:20too. But it's back to time.
- 38:21It's like you know. How much time do you get to
- 38:24experiment versus like okay? Is this going to work for this
- 38:28feature or is this custom tool that is being developed for a
- 38:32special use case, You know for a big temple feature film like
- 38:35being specially built for that show to solve a particular
- 38:39problem versus like you know just grabbing something off the
- 38:43shelf and and seeing if it'll work, that happens too.
- 38:46You know at that's the you know it's not.
- 38:49I guess I should say it's not a big secret.
- 38:51It is like. The big studios use the same
- 38:53tools we all of us come and folk use too.
- 38:56It's just there's different things about the pipelines and
- 39:00there are custom tools and there are benefits to create
- 39:03efficiencies. And when you're either a single
- 39:08person or at a boutique or you know, it's like five guys and
- 39:11gals together to make, you know, like a little production
- 39:14company, sometimes that's the thing that you.
- 39:18See is you're learning the efficiencies as you go and when
- 39:22you're at the bigger studios, sometimes there's a lot of
- 39:27efficiencies in place that streamline the workflow.
- 39:31And you may see like why certain studios go back to certain
- 39:35vendors for repeat business is not only because the teams are
- 39:39really good, but also it's it's how they work with the clients,
- 39:44it's how they turn over. Projects.
- 39:47Are they doing it on time or are they doing it on budget?
- 39:50Like there's a lot of things and it also comes down to people
- 39:54being friendly with. It's like when a DP works with
- 39:59the same camera team, like there is a shorthand that you create
- 40:03like YouTube working together. You kind of know what annoys the
- 40:07both of you. You kind of know like who, who,
- 40:10who has the stronger. How did you?
- 40:12Know. Yeah, yeah, Like who has the
- 40:16stronger skill set? So somebody might be a better
- 40:18modeler, somebody might be better at grooming a groom or
- 40:21compositing or lighting. And then you you balance each
- 40:24other. That's how teams should work if
- 40:26you balance each other out. And that's how you know as a as
- 40:29a supervisor you work with, you know your production managers
- 40:32and and and. Like HR teams to kind of staff
- 40:36and build the teams and you say look you know I've I've gone
- 40:39into battle many times with this crew.
- 40:41Like I really want you know like this TD and I want this lighter
- 40:45and I want this compositor and I want this modeler.
- 40:48And you know usually if they're available it's like it's like
- 40:51building a freelance team. So like when you get like a
- 40:54bunch of friends together to go we see a lot of Youtubers do
- 40:57this like the guys at corridor great example you know like a
- 41:02lot of the. The the Youtubers and I miss the
- 41:05beast. You know like these are really
- 41:07good examples of of of people that are not like yeah
- 41:10traditional studios in the way but like they're figuring the
- 41:14guys at so crispy media. Like they these people do really
- 41:18cool things and they've got like they've stepped their level up.
- 41:22Like I remember when Corridor was just Sam and Nico you know
- 41:25and it was just like and and those were tied to you know it's
- 41:28tied to like Sam and Nico and Freddy W and and Brandon like.
- 41:33These, they were younger like teenage, you know, Youtubers.
- 41:37I feel like I've watched them grow up to be this like really
- 41:39great artists and build these, you know, kind of
- 41:43self-sufficient studios and they've been able to hire out
- 41:46their friends and do really cool projects.
- 41:50So yeah, it's it's like it's fun to be at the studios and my
- 41:54journey of working for. A lot of different studios like
- 41:58very, you know, high end studios and then boutiques and then even
- 42:01like just like independent ones. It's eye opening to see how how
- 42:09projects are approached. You know, like I've done them
- 42:13where I've, you know, directed them and put the teams together
- 42:16and put the budgets together and then you know when you're at
- 42:20larger studios you know there is a different structure.
- 42:24To how teams get set up and how projects get bid and what the
- 42:28breakdowns are and what your role is.
- 42:31A very large feature of films, it's usually multi vendor.
- 42:35It may not be just one person, you may have a single vendor
- 42:39that is the overall vendor for visual facts or animation or
- 42:43whatever it is and then you might have multi vendors where.
- 42:47Different places like halon and mold or doing previs and bad.
- 42:54So it really depends. It's project dependent about how
- 42:56things are set up. So you touched on one point that
- 43:00I think a lot of people asked us on social media and I wanna
- 43:04point that out because a lot of people actually are really
- 43:06interested in your role, like the VFX and VP supervisor.
- 43:11But I think not a lot of people know what is this role.
- 43:15Does like every day on a daytoday basis, like what is
- 43:18your job every day they just. Think it's the LED volume and
- 43:20that's it. But it's there's.
- 43:21So much. More to it.
- 43:23If it's specific, so I want. It's funny because the role of a
- 43:28virtual production supervisor has been around with different
- 43:33names, you know and and to me from my role is because I have a
- 43:38background in cinematography and visual facts.
- 43:40Like I see my role as a virtual production supervisor being a
- 43:42hybrid of both. Because as as a virtual
- 43:48production supervisor or a visual tech supervisor, you have
- 43:52to be the hub or the translator, if you will, of a lot of complex
- 43:58technology to creatives. And sometimes the creatives that
- 44:02you work with or the storytellers you work with they
- 44:06either. Have not done this before,
- 44:09especially when you're working with like real time game engines
- 44:12and LED volume and a lot of complex sometimes custom, you
- 44:15know technology and workflows. You know virtual production in
- 44:21some form or another is not new. Like LEDs, LED walls, LED tiles,
- 44:27processors, yeah, real time engines have been around.
- 44:30It's just that. The evolution of the use case of
- 44:34these tools has shifted and it especially shifted a lot during
- 44:38the pandemic. So like virtual production has
- 44:41been around for a while in live visuals, you know both.
- 44:45For like anybody that's been to like you know an EDM festival or
- 44:49you know Tomorrowland or something crazy like that, It's
- 44:51like you guys have seen you real time visuals for for a long
- 44:56time, whether the real time through a custom engine, you
- 44:59know, through touch designer through Notch through.
- 45:02You know a projection mapping with like Mad Mapper and some of
- 45:05these other tools you're you had a lot of creatives and
- 45:08technologists that like were hodgepodging different workflows
- 45:12to get like it's almost like hey we're going to turn this on and
- 45:15see if it works. And sometimes you know what
- 45:16especially from the from the live visual side there's a lot
- 45:19of lot of experimenting too like visual effects.
- 45:22But yeah this the virtual production supervisor thing came
- 45:28came about to more prevalence as like you know role.
- 45:32You know with the with the bigger push like using you know
- 45:38real time game engines like Unreal and Unity and
- 45:42Touchdesigner for solving problems that the Pandemic kind
- 45:48of hit everybody. Hey you can't go on location
- 45:50right now and you can't have a lot of people and you can So
- 45:53what what tools can we use to solve these problems to still
- 45:57tell stories and create content and do all this and.
- 46:00We saw this big boom of virtual production.
- 46:03You also just happen to see the growth of real time engines like
- 46:09what Epic was doing, like what you and me was doing like all
- 46:11that Epic just kind of like took the lane and like a rocket shot
- 46:18off and. You know we we've seen that like
- 46:23you know it is it is no secret that you know Unreal Engine is
- 46:27the is the engine of choice for for real time virtual
- 46:29production. There are other tools out there.
- 46:32It's just they have done a really good job of not only
- 46:36doing the education with like the fellowship and the community
- 46:40and doing things like Unreal fast and you know trying to
- 46:43support creatives and and creators with things like mega
- 46:48grants. So they've put a lot back in the
- 46:51community and they've been rewarded for that because of the
- 46:55the use cases and and also paying attention to you know the
- 47:00the feature set that does it. But everybody's remember like
- 47:03these are game engines built for making games.
- 47:06All of us that are film makers and creators, we're not, we have
- 47:10been shoehorning a real time game engine into media
- 47:14workflows. And it's been frustrating over
- 47:18some time because we still have to understand like there's
- 47:21development cycles like you can't just go hey epic unity,
- 47:25you know, you know meta all you guys like we need this feature
- 47:29tomorrow. It's like it doesn't happen like
- 47:31that you know Deb cycles take take some take some cycles to to
- 47:35get some things over but. You know the virtual production
- 47:39supervisor thing and a lot of these new roles that people
- 47:42still don't know where they sit. You know for me as a as a soup
- 47:47and I kind of go back and forth is like sometimes I might be the
- 47:50effect souping project and sometimes I might be virtual
- 47:54production soup, which is this like hybrid thing virtual
- 47:58production teams usually are thought of and sit under visual
- 48:03facts. And and times everybody knows
- 48:07that, you know visual effects does not have a union.
- 48:10It's not part of the local 600 with camera and DIT and you know
- 48:14728 and and 800 with our directors and and it confuses a
- 48:19lot of people as to like where these roles did like people go
- 48:23what's a TD, you know and they're like oh you know is that
- 48:26just the, you know, the Unreal Engine operator is this you
- 48:30know, so there are. Really good things that break
- 48:35this down. There's actually something
- 48:36called the virtual production glossary that a lot of people
- 48:40that in the industry, they give feedback and things that Netflix
- 48:43has been working on as well that kind of helps break down.
- 48:50You know, this information that's out there is like, hey,
- 48:53there's this ever changing thing of like when The Mandalorian
- 48:55came out, everybody called, you know, the Unreal team or the,
- 48:59you know, the virtual production team, the brain bar.
- 49:02And it's like I can't stand that name.
- 49:04It's like it's an older name that's been around and it's also
- 49:09equated to a specific set of team that was working on Mando
- 49:15that was tied to the Stagecraft team, which is you know,
- 49:19Stagecraft is Ilm's internal team in process that they use,
- 49:24they use their own renderer and they have the real time engine.
- 49:30They've used Unreal. They go back and forth and I'm
- 49:33sure there's different technology approaches to the
- 49:39different teams, but it's been confusing for people to kind of
- 49:45understand and break down. Where do I fit or what role can
- 49:48I get on a team? And the best thing I can say is.
- 49:55If you're looking to break into like real time and virtual
- 49:58production and you're looking to work with things like LED walls
- 50:01and and other things like that, your best thing to do is is to
- 50:06focus on what type of role you're looking for.
- 50:09You know the easiest roles are coming in usually as like a a
- 50:13bad artist, virtual, the virtual art department.
- 50:16So if you have an understanding of, you know, Unreal, you have
- 50:20an understanding of. Cinematography and photography,
- 50:24because that's a big thing is I've run across a lot of people
- 50:29that no one real but have never stepped foot on set, have never
- 50:34talked to a client and don't have like a full understanding
- 50:39of like filmmaking workflows versus game engine workflows.
- 50:43And those are two different things.
- 50:45Each one can help you. There are people that go from
- 50:47filmmaking into the real time side and and vice versa.
- 50:51But usually there's a gap that happens of understanding and
- 50:56workflows. How can you get that experience?
- 50:58Because I feel like for people watching, the majority of this
- 51:02audience knows how to probably get Unreal Engine tutorials and
- 51:05content. It's pretty easy to look for
- 51:07that on YouTube. How do you get the filmmaking
- 51:10experience, the studio experience that you just talked
- 51:13about, that a lot of people miss out on?
- 51:15Yeah. There's there's always the thing
- 51:18of like you know the chicken and the egg like how do I get
- 51:22experience to go work on an LED volume or you know you know run
- 51:25a silent Cam session or vcam or anything like that.
- 51:28If I don't, you know get on a set or I don't get in that the
- 51:32one, the one kind of route to do it in YouTube fashion.
- 51:36DIY fashion is like you can start off with a webcam, Unreal
- 51:41Engine, a laptop where like you know go pros are small.
- 51:46Cameras that are at least like 1080.
- 51:49Most cameras are 4K off the bat or your iPhone and you know you
- 51:55can start playing with you know live link tools and unreal.
- 51:59You can use your iPhone as like a DCAM or you know instead of
- 52:03take recorder sessions. These are like base workflows
- 52:07that. When you see a job position or
- 52:10when you see like a project, because there's always people
- 52:14that are looking for people like hey it might be, it might be no
- 52:17pay for for education, you know, you know it might be you know,
- 52:21hey we'll we'll we'll pay for your food and we'll pay for your
- 52:24travel. You know come work on this like
- 52:27in you know you got to choose pick and choose what's what's
- 52:30right for you of like hey, the whole work for free thing is I
- 52:33think everybody should get paid even if it's like a you know, PA
- 52:36route but sometimes. I've done it in my career where
- 52:39you go and do things for free to learn, just to learn, just to
- 52:43learn, just to learn beyond a fly on a wall.
- 52:45It's like somebody had said, even today, if somebody said,
- 52:50hey, Roger Deakins is shooting this thing with Spielberg and
- 52:54it's like you're not gonna get paid and it'd be like.
- 52:57I don't care. Hands down, I would.
- 53:00Go. I would go yeah.
- 53:01Yeah. Like, yeah, I.
- 53:03Totally agree, experience is priceless like you cannot put
- 53:06price especially. If you're starting out, if
- 53:07you're hungry, you should. Like you said, yes, you should
- 53:10get paid. But if you're really hungry, you
- 53:12shouldn't give a damn. Like, just go and learn if you
- 53:14get the chance to do so. And and The thing is is like you
- 53:20learn a lesson and whether it it it winds up no good and the the
- 53:25project. Is disorganized wherever it is.
- 53:28Like, you're still going to learn, You're going to learn.
- 53:30Like, hey, maybe I should have checked in with the producer and
- 53:34asked this. Or if it's an independent thing
- 53:36and it's just a couple people, maybe you'd be like, oh, I saw
- 53:40that we didn't approach this or we did this right, and every
- 53:44time you go into these projects, it'll be a learning lesson.
- 53:48But. Within within these roles that
- 53:51people are trying to figure out where they would stay because
- 53:54it's a really exciting time with all this technology.
- 53:56It's like you have you have a lot of experimenting that's
- 54:00coming into working with you know led walls and and and real
- 54:05time game engines is like that's not the only thing virtual
- 54:08production is. Virtual production is a blanket.
- 54:11Term for a lot of different technology and creative
- 54:15approaches to do that. So virtual production is not
- 54:17solely just LED walls, you know, virtual production.
- 54:20For saying. That cover is a lot of different
- 54:23things. Yeah, this is something I think
- 54:25I need to put it on social media.
- 54:26I think a lot of people make that mistake.
- 54:29Yeah, virtual production is not only that big LED wall screen.
- 54:32Yeah, you can still do it. Look, the whole thing of like oh
- 54:36you know LED walls killed greens can you And blue screen and it's
- 54:38like, no, they're. The thing that's going to kill
- 54:41green screen and blue screen is going to be AI and machine
- 54:44learning and it's not going to happen overnight.
- 54:47Yeah, this is still evolutionary stuff.
- 54:49Like to say like anyone piece of technology is going to kill a
- 54:52job or kill a technique or a workflow process.
- 54:57It's a lot of hype. I do hope some of these things
- 55:00get, you know, displaced because they are, they're inefficient,
- 55:05so in workflows. Nobody wants to sit there and
- 55:09Roto, and nobody wants to sit there and and just sit there and
- 55:13Key and Comp and Spill, Suppress and Edge, Blend and Feather.
- 55:16And like. These are menial, tedious tasks
- 55:21that with technology can speed you up.
- 55:24Because if you're a compositor or an editor or you're making
- 55:28creative decisions, that's going to enhance a look of A-frame.
- 55:32Because if we if we just lock it down to A-frame.
- 55:36And you're going to pause your favorite film on like any hero
- 55:39segment. It's like the hidden thing that
- 55:43happens from like editorial VFX animation sound, you know,
- 55:48production team is like it's always the thing of like if you
- 55:51pause it on A-frame, that frame should stand alone, you know,
- 55:54and. You know, good, good or bad,
- 55:57hopefully you don't pause it out like you know a not I frame and
- 56:00you've got all this motion blur. But you know there's a book out
- 56:05there that that is is kind of old that buddy Stu Ashwitz used
- 56:08to share when he had his his gorilla film milking book.
- 56:13But it was like every frame is a Rembrandt and you know relates
- 56:18to release to filmmaking and then the creative process and
- 56:22now it stands true. It's like.
- 56:24There are people that will methodically, you know, you
- 56:28know, kind of like nitpick and and you know, you'd want to get
- 56:33some CG soups and VFX soups that'll just, you know, or
- 56:36clients that'll pixel peep, you know, they'll be over the
- 56:39shoulder and be like and move that Pixel 3 up to the right and
- 56:42it's like it happens. But but yeah, these these
- 56:46evolutionary roles, you know, and how people get into this is
- 56:49like you honestly can experiment at home.
- 56:53At school, at home, whatever it is, there's going to be a little
- 56:58bit of this. You need a couple things in
- 57:01place to do it, but Unreal Engine is free.
- 57:05If you already have a camera you know and and a laptop, you're
- 57:08like 3/4 of the way there, you know and it's going to be about
- 57:13educating yourself to to do this because there there's not every
- 57:19workflow documented on. The unreal side of things like
- 57:23you know all of us that are you know on the bleeding edge are
- 57:26always breaking things and going back to the to the companies as
- 57:29early adopters and just saying like hey, this works, this
- 57:32doesn't work And and a lot of people in the community too,
- 57:36like on Reddit, on YouTube, on all the social media platforms
- 57:41like it. It's just a matter of
- 57:43experimenting. So yes, you do need time on set
- 57:48especially. On the high end stuff, because
- 57:52it is virtual production as a whole, with LED walls, is a
- 57:56mixture of production. First, it is still your
- 57:59production teams, your production designer, your DP,
- 58:03your DIT, your ads, you know, your your sound teams, like your
- 58:07crane OPS, like your your key grips, your gaffers.
- 58:10Like it's still production. That's why it's called virtual
- 58:13production. That is, it's still a
- 58:14traditional production. You add the layer of these
- 58:18technologies and engineering because with LED walls you have
- 58:24the the physical build of the walls which also need to be
- 58:27safely done so the wall doesn't fall over.
- 58:30You know, RIP. Scaffolding.
- 58:31Down. So you need really good, you
- 58:34know, really good grips and gaffer to make sure the lighting
- 58:36and the threats are safe. These walls are designed, you
- 58:41know, so there's, you know, structural engineering that goes
- 58:44into it. There is CAD design.
- 58:47There is a method to the madness of why the shapes are different
- 58:52of the LED volumes. A lot of times you see we've
- 58:55seen a lot of demos that were people that have like, you know,
- 58:58cheaper LED walls be like flat, you know, it's because this
- 59:03stuff is really expensive still you're you're talking about.
- 59:06A per tile cost. You're talking about the power
- 59:10consumption you need. You need a lot of power to power
- 59:13all of these large volumes. You need the processing power to
- 59:16break down and you guys know this well.
- 59:19Even running a beefy computer to, you know render to an LED
- 59:23display like a big 65 inch OLED that you have.
- 59:26You know sometimes you got to set up a a pretty beefy system
- 59:30to run an end display set up. That exponentially grows when
- 59:35you're doing it to like big Christie projectors or you know
- 59:3816K by 6K LED volumes on a pixel count.
- 59:44So that barrier that you guys talk about and then I think a
- 59:48lot of the the questions that come in of like how do I break
- 59:51into this or like what role would I fit into it's it's a
- 59:54matter of the roles are are kind of defined in that.
- 1:00:01You know if you have a strong background in modeling and a
- 1:00:05game engine and building assets and kit bashing things together,
- 1:00:09it's like well maybe your entry into a virtual production team
- 1:00:14or real Time Team might be through like as as an asset
- 1:00:17builder on a virtual art department team.
- 1:00:21Or you could be doing previs and techvis where you know you're
- 1:00:24using the engines. Instead of building all this and
- 1:00:27Maya math cinema 4D. But if you have a strong
- 1:00:32background in any of those traditional Dccs, you can take a
- 1:00:36lot of that and bring it over into that just like you could if
- 1:00:40you were coming from traditional filmmaking.
- 1:00:42If you're coming from a cinematography and photography
- 1:00:44background, you're gonna be at an advantage coming into Unreal
- 1:00:49Engine because you're gonna know composition, you're gonna know
- 1:00:52lensing, you're gonna know different sensoring film backs.
- 1:00:56Hopefully you have that understanding that you can take
- 1:00:58that production learning and bring it in and then the
- 1:01:03understanding of the game engine will just come as you spend more
- 1:01:06time in it. But you you you have to spend
- 1:01:10quite a bit of time in the game engines because things change
- 1:01:14quickly. And you know, I'm not just
- 1:01:17talking about buttons moving, I'm talking about workflows and
- 1:01:20that's a really big thing is like.
- 1:01:23People getting into or wanting to get into virtual production
- 1:01:25in real time is you have to stay on top of kind of evolutionary
- 1:01:32steps in that the technology is changing fast.
- 1:01:34We've seen this a lot really quick with generative AI and
- 1:01:38other tools that are coming into this world.
- 1:01:42And you know that's kind of one of the best tips is just like
- 1:01:45even if you may not be in the engine or in that tool or in
- 1:01:48Luma or in Wonder Dynamics or whatever it is, at least if you.
- 1:01:53Play around and understand the workflows.
- 1:01:55You would understand if that platform or that particular tool
- 1:01:58is right for you and where you want to go.
- 1:02:01Otherwise, like you might be wasting your time and go, hey,
- 1:02:04I'm not doing character IK stuff or you know, automatic
- 1:02:08rotoscoping. Like maybe I don't need to use
- 1:02:11wonder dynamics now or maybe you know, I need to focus here,
- 1:02:16especially if you want like a career trajectory.
- 1:02:21You know, you brought up so many important points and I I want to
- 1:02:24touch on most of them with Farhad.
- 1:02:26One of the things that I want to talk about is just hiring,
- 1:02:30especially because you mentioned so many different roles and I
- 1:02:33believe a lot of people like ourselves who've never been on
- 1:02:35these giant sets, I don't know which role I fit in.
- 1:02:38And you said that's a common, you know, common issue a lot of
- 1:02:41people have. So if I don't know.
- 1:02:43And if I don't know cinematography, I might know a
- 1:02:45little bit of Unreal Engine. Would you say the right thing
- 1:02:48for me to do is go ahead and hone my skills in modeling and
- 1:02:52sculpting and texturing in camera work just to know, just
- 1:02:55to know the basics and then also at the same time hone my skills
- 1:02:59in cinematography and film? Do maybe read a couple of books,
- 1:03:02learn more about color theory and stuff like that.
- 1:03:05And then do you recommend me going deep into one thing?
- 1:03:10For example, let's say in camera visual effects we know that you
- 1:03:13took the, I believe, the fellowship or the course from
- 1:03:16Unreal Engine to do that. Do you recommend like going deep
- 1:03:18into one thing? Would that get you hired easily?
- 1:03:22Is that what you guys look for when you're looking for somebody
- 1:03:24new? Let's say there's ten people,
- 1:03:26How do you guys pick from all these people to to?
- 1:03:29Add to your team. That's yeah, when you're
- 1:03:32building a team for. A project as a supervisor if
- 1:03:38your production side, meaning working for the studio versus
- 1:03:42working for the vendor. Sometimes teams get built for a
- 1:03:46production and they work with the vendors, or sometimes the
- 1:03:50vendor will be handling a lion here of the type of work and
- 1:03:54they may already have internal teams and they'll backfill with
- 1:03:57freelancers so. You know when you're when you're
- 1:04:02say like a CG soup or a build supervisor, you're looking for
- 1:04:07people on your team that are strong at the particular needs
- 1:04:10of that show. So if you know that you're going
- 1:04:13to be doing a lot of photo real modeling, you're going to be
- 1:04:16looking at people that are really good at you know like
- 1:04:19things like Substance Painter and Z brush and and you know
- 1:04:23things that way if you're. If you're doing things that are
- 1:04:26very character driven and it's a mix of like a hybrid live action
- 1:04:30or animation or just animation, you're going to be looking for
- 1:04:33people that are, you know, really good at modeling
- 1:04:35texturing animation because you need to round out a team if
- 1:04:40you're a. Specific.
- 1:04:41Individual that's more of like a generalist and you're like, OK,
- 1:04:44I know Blender, I know Maya, I know you know a little bit of
- 1:04:48this because it's a hard part tool.
- 1:04:50There's so many different tools to learn and you go, well, do I
- 1:04:53just focus on? You know, being like the best Z
- 1:04:57brush artist, you'll find your job if like you do pick a
- 1:05:02specific thing. Specialists are still very much
- 1:05:07in demand. You know, in terms of like if
- 1:05:10you were to go down a route and go, you know what, I'm just
- 1:05:13going to focus on animation and I'm really good at rigging a
- 1:05:17model and being able to animate it.
- 1:05:20And then it goes into the different departments.
- 1:05:23When you're at in a much larger studio versus like an individual
- 1:05:26who's like, you know what, this is my project.
- 1:05:28I've got a model, I've got to texture it, I've got, you know,
- 1:05:31I've got to do everything for it.
- 1:05:33And you become like this self-inflicted generalist that
- 1:05:39has to do it because nobody else is on your team versus a studio
- 1:05:43where you may, you may model and rig a character and then you may
- 1:05:48hand it off. And it may go to the paint team
- 1:05:51and then it goes to the lighting team and it steps through that.
- 1:05:53There's different, there's different categories and
- 1:05:55efficiencies. I would say if you were having a
- 1:05:59base level generalist skill set right now is by all means I
- 1:06:06would say to take the time to learn about the other
- 1:06:10departments you may work with or other other roles.
- 1:06:14I did the same thing. It's like.
- 1:06:17When I was on set, I'd always wanna know, like went early on
- 1:06:22what? So it'll go around.
- 1:06:24Even if you have the time, you'll go around like introduce
- 1:06:26yourself and go like, what is it that you're doing?
- 1:06:28You try to get an understanding and appreciation.
- 1:06:33Because making a movie or making a project, usually if it's not
- 1:06:37your individual thing, it's like it's a total team effort and you
- 1:06:40are you're either waiting for other departments to do their
- 1:06:43bit and then you do yours, or it's like all in at one time.
- 1:06:50So it's never a bad thing to learn more about cinematography
- 1:06:55and photography. The best ways you can do that is
- 1:06:58go out and shoot your own stuff hands down and it's like.
- 1:07:02One of the best advice you could you could give somebody is like
- 1:07:05you know if if if you're a modeler, you know go out there
- 1:07:09and learn about stop motion. You know if you're learning
- 1:07:11about modeling and animation, learn, learn about go take a
- 1:07:15life drawing class. You know if you want to learn
- 1:07:18about color theory, don't read, don't just read the books.
- 1:07:21Go to museums, you know paint, mix colors, you know do all the
- 1:07:26stuff to get to understanding if you're if you're wanting to know
- 1:07:30more about. Cinematography and photography
- 1:07:34in that way is there's so many resources, but other than
- 1:07:38shooting your own stuff is watch the greats.
- 1:07:41Pick one. DP, you know pick you know, pick
- 1:07:45a Roger Deakins, you know, pick a, you know pick a Greg Frazier,
- 1:07:49you know, especially for the VP are those.
- 1:07:52Your Are those the ones that you looked up to and you you checked
- 1:07:56out? There's so many.
- 1:07:57I mean like there's so many. There's probably like a lot of
- 1:08:00unknowns that if I said their names people wouldn't know too.
- 1:08:02But like you know there's early there's early Dp's and and and
- 1:08:09cinematographers that you would you would look up to.
- 1:08:12But I I bring up Roger because he's ever since he launched his
- 1:08:17website and he had his forums like you know him and a couple
- 1:08:20ASC and BSc Dp's like at the highest end that have shot all
- 1:08:25of our our. Favorite films.
- 1:08:29There's been a bunch of them through like the ASC and through
- 1:08:32other global unions and committees that they give back.
- 1:08:37And during the pandemic, Roger and his wife started the podcast
- 1:08:44and the podcast is like the who's who of DPS and production
- 1:08:48designers and visual tech supervisor and.
- 1:08:50If you go to Roger's website like he answers tons of
- 1:08:53questions on this forum, He's you know, it's been around for
- 1:08:56years. There's there's a lot of other
- 1:09:00you know, our directors and DPS and VFX soups that that give
- 1:09:04back in terms of like trying to educate.
- 1:09:05I try to do the same thing as much as I can when I go to like
- 1:09:08you know do talks at on real fast or you know do things like
- 1:09:12this is to share like where resources are and there's a lot
- 1:09:16of resources out today, you know there's.
- 1:09:18So many good YouTube channels that even even I follow The
- 1:09:22things that you guys are doing for trying to get education out
- 1:09:25there is, is is really cool because people are looking to
- 1:09:30get into whatever it is and you may go hey maybe I come in
- 1:09:35through virtual art department but then somebody at the team
- 1:09:39said hey does anybody know anything about nurse and it just
- 1:09:42so happens that that person was experimenting with Luma AI and.
- 1:09:46You know Nerf Studio and Incident, NGP and all this and
- 1:09:49then who knows where that could take you in your career.
- 1:09:51So that's why I say experimenting is really
- 1:09:53important to get to these roles and how to build these teams.
- 1:09:58It's like you, you have to be a chameleon.
- 1:10:00It's like you I don't want to see, you have to learn
- 1:10:04everything because even for me it's impossible.
- 1:10:06Anybody that tells you they're expert in Unreal Engine, I kind
- 1:10:09of call BS on because the engine or engines are still there's.
- 1:10:15There's so many facets of what you can do, especially with with
- 1:10:20Unreal is that and you talk to the guys and gals at Epic and
- 1:10:24they'll even tell you the same thing.
- 1:10:25It's like you know you even they.
- 1:10:27Themselves. Probably don't know the whole
- 1:10:29software and like one department person know everything.
- 1:10:33It's use cases, It's use cases. It's like you can look on, you
- 1:10:39know, and I work with Epic a lot and they've and they've been
- 1:10:42really great. And you know, there's stuff that
- 1:10:46they come across that it's just like, oh, somebody did this
- 1:10:49approach or somebody did this with meta humans or somebody did
- 1:10:52this with, you know, you know, volumetric data and nerves and
- 1:10:57it sparks something. So that's what's cool.
- 1:10:58And why say experimenting Because you never know, the
- 1:11:01little project that that you do and you put, that's the thing,
- 1:11:04if you do it, put it out there, share it and just, you know,
- 1:11:07once it's out there, it's out there, it becomes it's not, it's
- 1:11:09no longer yours, it becomes the world.
- 1:11:12So you never know who's going to come across.
- 1:11:14It's like back to the kid who got to do the animation stuff
- 1:11:18for Spider Verse is like, he put that out there.
- 1:11:21Like, did he ever think that the directors from Spider Verse were
- 1:11:24going to call him to do that? Like.
- 1:11:26I don't think the kids passion was like I'm going to do this
- 1:11:30just to get a gig and you know and and be animated spider
- 1:11:35verse. Like there's an interview with
- 1:11:36him out there online that it's just like he he didn't expect it
- 1:11:40like he was just a kid having fun doing what he did.
- 1:11:43But now his I got to think because I don't know him
- 1:11:46personally but I got to think like he has a fire lit under him
- 1:11:49now then now he has this like passion.
- 1:11:53And hopefully it doesn't go stale of working in the industry
- 1:11:55because the industry sometimes can beat down on you.
- 1:11:58But that's what's cool about this stuff of like all this new
- 1:12:03tech and all of the working with cool people is what keeps me
- 1:12:11going, is like, there's always a new challenge.
- 1:12:13There's always like new creatives to work with.
- 1:12:16You know, there's, there's new titles.
- 1:12:19I mean, like, I'm really. I'm I'm like all the stuff
- 1:12:23coming out. There's a lot of cool films and
- 1:12:25stuff coming out. But I'm like really excited to
- 1:12:27to see and to hear about. Get with Edward's new project,
- 1:12:32The Creator. And I know a lot of people that
- 1:12:34worked on it and I can't wait until it's out because I want to
- 1:12:37pick their brains apart about the creative approach, the
- 1:12:40technical approach like so I get really psyched and you know geek
- 1:12:44out on. Friends projects are like, you
- 1:12:47know, people I look up to and contemporaries, you know, that
- 1:12:51are just like, oh, you know, you dissect.
- 1:12:53I dissect every BTS that comes out from like it doesn't matter
- 1:12:57if it's a traditional shot project or it's like a TV show
- 1:13:01or a commercial. Like I just look at it and I
- 1:13:04wonder like, oh, how do they do that?
- 1:13:06And then, you know, it's cool that social media lets everybody
- 1:13:09share BTS and and approaches and they go.
- 1:13:13That's how you can understand and go like, oh, OK, I see this
- 1:13:15person was like the VP soup on on this project.
- 1:13:18And you know, when I do the Bts's or the Epks and it's like
- 1:13:22I get to break down, you know, some of the approaches and and
- 1:13:26how we did stuff and what the team did on things.
- 1:13:28So that's really cool because you never know who's going to
- 1:13:31watch these and get inspired, be like, oh, OK like I see what
- 1:13:34they did and that person has this title.
- 1:13:36Like maybe that's what I'm going to, you know, either aspire to
- 1:13:40to go for it in a career or to go.
- 1:13:43Oh, that was really cool. Why don't I just get five
- 1:13:45friends together and we can do this ourselves, which you can.
- 1:13:49Yeah. And I think the BTS thing is
- 1:13:51very important. You learn a lot from BTS and
- 1:13:54that can be an educational pathway for itself.
- 1:13:57Like you just watch BTS, you see how people are doing it.
- 1:13:59You get to know what you know, what you need to do yourself.
- 1:14:02But there was something that Jim mentioned in the beginning that
- 1:14:05as his role as a supervisor, he's the hub that translate the
- 1:14:08latest technology for the creative.
- 1:14:11One question that I always. Had was how hard is it to
- 1:14:14convince the creatives with the ideas that you have Because when
- 1:14:19I look at your Twitter, it's like 5 years ahead of time.
- 1:14:22You know you you you are experimenting with things that
- 1:14:25are really experimental. I would call them high risk for
- 1:14:29a big production. I don't know how much of those
- 1:14:31you take to the studios or even you bring up the idea and
- 1:14:35explain it that how much of. The actors, the producer, the
- 1:14:39directors are accepting. This idea and I want to add
- 1:14:41weight to that question just to make it harder for you.
- 1:14:45Just trying to understand Vp's role, the virtual producers role
- 1:14:49a little bit more and supervises.
- 1:14:51Is that essentially what you do mostly on a day-to-day basis?
- 1:14:55Look for new technologies and find ways to implement them to
- 1:14:58improve the workflow? And then when those workflows
- 1:15:00have problems, you're the guy who has to fix it.
- 1:15:03You have to be the one who goes in.
- 1:15:05Jim said you're like the firefighter.
- 1:15:06Yeah, yeah. So I just wanna add.
- 1:15:08That at the end as well. Yeah, yeah, no, yeah, yeah.
- 1:15:12It's sometimes it does get put on my shoulders, you know, as
- 1:15:18working with the production teams.
- 1:15:20But it's kind of like a multifaceted answer is yes.
- 1:15:24I'm always looking at what's next and it's usually based off
- 1:15:28of either. A current problem that still
- 1:15:30hasn't been solved in in the industry or industries, looking
- 1:15:35at where those gaps are and where those inefficiencies are
- 1:15:39to be like, I knew we did this on on this film and it took us
- 1:15:43like a year ahead of time to develop a tool just for that.
- 1:15:47Does that gap, you know, need to be filled either just for the
- 1:15:53project or is this something like the industry?
- 1:15:56Needs or you know, like as you know, visual facts and
- 1:15:59filmmaking and animation. And sometimes the projects have
- 1:16:08specific needs that say this technology doesn't exist.
- 1:16:12Do we have R&D time to develop something or does this need to
- 1:16:18be created on the fly? And it is a risk, It's a risk
- 1:16:21for the studios, it's a risk for the directors, it's a risk for.
- 1:16:26You know, all the supervisors and it really depends on, like,
- 1:16:30you know, if you're talking about a big, you know, hundreds
- 1:16:35of millions of dollars like feature film, there are
- 1:16:38calculated risks. And it it depends on the studios
- 1:16:44and the directors and the team you're working with and the
- 1:16:49faith that they would put in you either as a team if you're at a
- 1:16:54vendor. Or if you're hired as a you know
- 1:16:58a virtual production super visual fix supervisor is you
- 1:17:03know you do you do get interviewed.
- 1:17:06You know if you're if you're trying to go with the team they
- 1:17:09you know they go through and say is this team or is this person a
- 1:17:12right fit for this production. You know it may be because of
- 1:17:16you've worked with those teams before or they you know word of
- 1:17:20mouth you know you have a reputation in the industry for.
- 1:17:24Being able to solve problems and you're you know you're good with
- 1:17:27working with people. I've had it happen a couple
- 1:17:31times with a with a good friend who is you know a contemporary
- 1:17:37and and or mentor who is you know a top tier visual effects
- 1:17:40supervisor and my friend Kevin Bailey.
- 1:17:43I'd say a perfect example is like I've worked on you know two
- 1:17:47projects with with Kevin kind of back-to-back and and and Bob
- 1:17:51Zemeckis. And and Don Burgess of the DP
- 1:17:55and there's been a couple times where Kevin's taken the risk to
- 1:18:00look at new technology and kind of put the onus on, you know,
- 1:18:04myself and wider teams to say hey, here's an opportunity, what
- 1:18:11solutions are out there or he may have a solution and an
- 1:18:16approach and kind of go, well, let's figure this out and see if
- 1:18:19this will work for. This particular show, we did
- 1:18:24that heavily for Pinocchio and we used new camera tracking
- 1:18:30systems that had never been used before in a different type of
- 1:18:33technology. And sometimes, sometimes things
- 1:18:36worked and sometimes they failed and they were really good
- 1:18:40learning lessons to see not only for us as a team or not only for
- 1:18:44me as a super in production is sometimes you get to work with.
- 1:18:53Really adventurous and risk taking directors and and
- 1:18:59cinematographers and and other, you know, production designers
- 1:19:02that you know really want to push the boundary because it's
- 1:19:07all this tech is supposed to be in service of the story.
- 1:19:11It's supposed to enhance it, You know, like they always say, like
- 1:19:14editorial and visual facts and all this is supposed to be
- 1:19:16invisible. The invisible art, You know, you
- 1:19:19you guys. The way we do things, and this
- 1:19:23could be from studio feature films down to like, even for
- 1:19:26YouTube, it's like the invisible art is people not being able to
- 1:19:31see your work because you don't want your work to distract and
- 1:19:34pull somebody out of the story. And the best way, when we were
- 1:19:39just talking about people and experimenting with different
- 1:19:41roles, is like do little shorts yourself.
- 1:19:44And like you know these little short experiments in the R&D
- 1:19:47stuff that you heavily watch it on, you know things like Avatar
- 1:19:51with Cameron. If you look at the amount of of
- 1:19:53of R&D and experimenting that go into things like like Avatar and
- 1:19:59things like both Pinocchios, I would say Bob Zemeckis's
- 1:20:02Pinocchio and and Guillermo del Toro's Pinocchio, both our
- 1:20:08Pinocchios came out at the same time.
- 1:20:09And Guillermo is being stop motion and you know done here in
- 1:20:13in Portland with an amazing stop motion and technology teams.
- 1:20:16And then the totally live action CG mix that we did on Pinocchio
- 1:20:21is A2 faithful stories, two different approaches 2 visual
- 1:20:27approaches that that came out differently and and both both
- 1:20:31great films whether they're critics like one or the other,
- 1:20:34it it doesn't matter, like you know.
- 1:20:38Pinocchio for me was like another way to push push the
- 1:20:43level. And I'm like, you know, I know
- 1:20:46myself and Kevin and John and and and Bob and everybody on the
- 1:20:49teams are like really proud of what the teams were able to do
- 1:20:53on Pinocchio because we pushed new ground.
- 1:20:56And then the the feature that I just finished with them that's
- 1:21:00still being worked on is another.
- 1:21:05Film that needed quite a bit of new approaches to achieve the
- 1:21:11visual that that you know, the the, you know Bob and the team
- 1:21:16had envisioned. And you know you need people
- 1:21:20like that that are going to push you.
- 1:21:21You need like the Kevins and the Bobs and the Dons and all those
- 1:21:26teams back there to go. Is this possible?
- 1:21:30And the cool thing about people like that is.
- 1:21:33You know, they're they're putting a risk into into you,
- 1:21:37but they're putting risks into the teams.
- 1:21:39And like I say, you know, when you're dealing with very large
- 1:21:42feature films, there's there's calculated risks.
- 1:21:46So there's there's there's sometimes only so much you can
- 1:21:49go to. But then you need people and
- 1:21:53teams to push into like what Avatar had done, you know, had
- 1:21:58been never been done and what. With the guys and gals early
- 1:22:02with James Cameron and Glendary and a lot and a lot of the early
- 1:22:11techno props, team of building Hmcs and different ways of doing
- 1:22:18mocap and vcam and simulcam, it's like.
- 1:22:21We're all benefiting from that because it's all trickled down
- 1:22:23now into into the different tools or approaches.
- 1:22:26It's like, you know, you could do V Cam at home with your with
- 1:22:28your iPhone, you know, it's like it's it's really cool to see
- 1:22:31that, but you do need those people to push you in those
- 1:22:35directions to be like this has never been done before.
- 1:22:40We're going to trust you with this or we're going to approach
- 1:22:42this as a team and none of us have ever done it before.
- 1:22:45But here's the risk and it's. And it's usually worth it
- 1:22:51because if it if it fails, you're learning and if it goes
- 1:22:54off really well, you're learning and and you sometimes reap the
- 1:22:58benefits that your project is, is is like well loved.
- 1:23:02You know it's not about like, Oh yeah, back end.
- 1:23:06It would be like, oh, does the film or does the project make
- 1:23:08money? Yes, that's a good thing too
- 1:23:09because you need to recoup and you know.
- 1:23:12Get proven to be like, hey, this was successful, so on the next
- 1:23:15one we get to take an even greater risk with a bigger
- 1:23:17budget. Sometimes not.
- 1:23:19It's like sometimes your budgets are not.
- 1:23:22They may be really big on one and then they may not be as big
- 1:23:25as the next one. So it really depends.
- 1:23:28I'm curious, sorry if I was like how much of this knowledge is
- 1:23:32being shared in the industry? Like now what you mentioned
- 1:23:34about Avatar, of course we watched the BTS, but like.
- 1:23:38Gatekeeping. Is that I mean, is gatekeeping a
- 1:23:41thing for all this knowledge? You know what?
- 1:23:45I hate gatekeeping because I I think it's complete BS because
- 1:23:48look and one thing I I went through it myself like people
- 1:23:52when I was coming up. It's job security.
- 1:23:55You know, like and it's and it's and it might be, you know it
- 1:23:58might be some IP that somebody's protecting, which is great.
- 1:24:02But I do say, you know, unless you're writing custom tools,
- 1:24:06there's there's usually an approach to figure out how to do
- 1:24:10it off the shelf. You know, there are definitely
- 1:24:15studios and vendors and technology companies that exist
- 1:24:20because they are doing something that nobody does, you know they
- 1:24:23have spent. 1,000,000 or hundreds of 1,000,000, you know,
- 1:24:27at times to do like in ILM is a perfect example.
- 1:24:31You know they have proprietary tools, they have the teams and
- 1:24:36the the, the work coming in as well to kind of build a cycle of
- 1:24:43like constantly evolving, you know, technology, hell yeah,
- 1:24:49there's gatekeeping and you know it it.
- 1:24:54And sometimes it's justified. I get it.
- 1:24:56It's like, you know, we had a dimension, we had a D nag other
- 1:25:00studios we were at, we had it. I mean we had a GoPro.
- 1:25:02Like there's there's custom things that give you the edge
- 1:25:05above others that either get you hired or get you to work on that
- 1:25:10next project or get you to you know create that next
- 1:25:14evolutionary product. So yeah, there there is that.
- 1:25:18But for my stance is. You know, a lot of these tools
- 1:25:22are available to everybody. They're accessible by, you know,
- 1:25:25by renting it, by borrowing it, by buying it.
- 1:25:30So it's it's pretty hard to say that like you know, Pandora's
- 1:25:34box was opened a while ago. We saw it with, you know, all
- 1:25:38these evolutionary steps in there.
- 1:25:39And like we've we've definitely been seeing it in the past
- 1:25:42couple years with with AI and machine learning too is like a
- 1:25:46lot of these things are leveling the field, you know, in terms of
- 1:25:49accessibility. The whole kind of legality
- 1:25:54behind a lot of the new tools that are coming out, that's
- 1:25:57still something that needs to be worked out.
- 1:26:00I do feel like, you know, artists should be paid their
- 1:26:04worth if a lot of these platforms are scraping data and
- 1:26:09getting that like they should credit and pay.
- 1:26:13The artists and and where that data is coming from and it gets
- 1:26:16into a much bigger conversation. That could be its own podcast
- 1:26:20that I won't dive into. But you know, yes, I mean I've
- 1:26:24been using AI machine learning for for a while you know and
- 1:26:28especially with generative AI there are approaches to go about
- 1:26:32it in a legal and ethical way. I will leave it open-ended that
- 1:26:39a lot of the platforms in question that.
- 1:26:42We see on the conversations on Twitter and everywhere else is
- 1:26:48how those different platforms may be doing unethical things.
- 1:26:51That's still remain to be seen like that will flesh itself out.
- 1:26:58Hopefully it doesn't get over regulated that it stifles
- 1:27:01innovation but. We'll see.
- 1:27:04Because you know that does worry me a little bit.
- 1:27:06When people that don't understand technology make laws
- 1:27:09about things they don't understand.
- 1:27:12It doesn't always benefit everybody.
- 1:27:14But we'll see. It's it's there.
- 1:27:16I'm I'm kind of in my stance with like all these new tools
- 1:27:21and the approaches and how we use them at different studios is
- 1:27:24like I'm 100% for them, they. They help speed up and the way
- 1:27:31that I use like AI and generative and machine learning
- 1:27:34today is really looking at it from how can you get from what's
- 1:27:38up in here out visually quicker and usually better.
- 1:27:44Yeah, I mean it does like sometimes the benefit of you
- 1:27:48know sitting there and messing with something good or bad like
- 1:27:52mid journey or stable diffusion or control net or EB synth or.
- 1:27:56You know, I can rifle off 30 more different platforms of
- 1:27:58tools that have been around for for for a while now for me
- 1:28:03individually. Like it helps me get iterative
- 1:28:07ideas out there quicker, you know?
- 1:28:10And right now I mainly use different tools for you know,
- 1:28:15prevising things or techvising things and and going in there
- 1:28:18and kit bashing things and going like hey is there is this the
- 1:28:20right path or is this. The right approach, is this a
- 1:28:24good creative look? Like does this technology, you
- 1:28:27know, make things more efficient for me?
- 1:28:29And that's like how I look at, hey, can I use this for this
- 1:28:33next project or I may see down the road like, hey, this is the
- 1:28:37infancy of this in like 18 months.
- 1:28:40It's going to be here in two years and then in five years I
- 1:28:42know it's going to be here, but maybe I go in the long haul on,
- 1:28:47on, you know, some type of technology or some type of
- 1:28:50approach and be like. I see the bread crumbs like what
- 1:28:53you were saying before of like seeing some of my work on like
- 1:28:56Twitter and social media platforms.
- 1:29:00It's like looking looking for those bread crumbs.
- 1:29:02And that's one thing that I think I've been pretty good at
- 1:29:05in my career is looking at like what's the next thing coming or
- 1:29:08like having a little bit of an intuition into pay if this thing
- 1:29:14married with this thing and we used it for this like nobody's
- 1:29:19ever done this before or. It's going to, you know,
- 1:29:22accelerate our workflow. So we're going to save, you
- 1:29:25know, money in post production, you know, something like that.
- 1:29:28And that when you can show that to a studio or a filmmaker or a
- 1:29:33showrunner or a producer, that's where you know, a proof of
- 1:29:38concept becomes something that goes like, OK, that gets the
- 1:29:41stamp of approval. We're going to take the risk on
- 1:29:43this now to use it for this project and then we're going to
- 1:29:46put it on. Your shoulders and the team
- 1:29:48shoulders to like prove this out so.
- 1:29:51You know, Jim, Speaking of exactly what you just mentioned,
- 1:29:55the next breadcrumb nerve, when are we going to see the stamp of
- 1:30:00approval on nerves? What are your thoughts on nerves
- 1:30:02and who do you think is doing it the best way?
- 1:30:04Of course we have Luma AI, we have the that in videos only
- 1:30:08have instant NGP, we have Neuron Neuroangelo, which is like also
- 1:30:12another model. That is.
- 1:30:13Which looks. So give us give us everything
- 1:30:17you know about what's happening with Nurse, because we
- 1:30:19experimented with it. But of course it's.
- 1:30:21Just, yeah. We just don't know when it can
- 1:30:24be used. And I was thinking that, you
- 1:30:25know, it can start from music videos or short film.
- 1:30:28Like you know it can. People are using it right now.
- 1:30:31It's it's showing up in commercials.
- 1:30:33Yeah, we're seeing, I mean, look, the way that what I really
- 1:30:38liked about doing like music videos and commercials early on
- 1:30:41was like a lot like you had a shorter round.
- 1:30:45And quicker experimentation time with shorter form projects
- 1:30:48versus if you work on features. Sometimes you can work on
- 1:30:52features for a year and sometimes a couple of years if
- 1:30:54it's an avatar. But what's cool about that is
- 1:30:59we've started to see the way that content creators.
- 1:31:05Meaning, it doesn't matter if you're an individual influencer
- 1:31:08or you're like these boutique influence content creation
- 1:31:11companies or like a corridor or so Crispy or any of those is all
- 1:31:20of the different brands are paying attention to the social
- 1:31:23media trends. And you're seeing the technology
- 1:31:27become easier and more accessible to individual
- 1:31:31artists. Like people like yourselves, was
- 1:31:34it like Karen Chang and like all these people experimenting it.
- 1:31:37And they may partner up with a friend who's like somebody who
- 1:31:44is their feeder and editor. And they go, I'm listening and I
- 1:31:47came across. You know, this Bad Decisions
- 1:31:50YouTube video that was like showing nerves and and it looked
- 1:31:53really easy. And they did one with this, you
- 1:31:55know, with this tool called Luma AI.
- 1:31:58And they go in and they start experimenting and then, you
- 1:32:03know, they put out the experiment and then the brand
- 1:32:06sees their video and they go like, hey, I want you to do that
- 1:32:09for us, in this, in this style for us.
- 1:32:13So you're starting to see. Things like nerves and I'll get
- 1:32:18I'll get to where they're at in a second but you're starting to
- 1:32:21see these novel view approaches to technology with like with
- 1:32:26nerves and different machine learning and computer vision
- 1:32:29tools hit this good enough quality level right now where my
- 1:32:37feeling today on on nerves and generative AI for.
- 1:32:43Things that I do every day for like to hold up on a feature
- 1:32:47film, you know for the big screen and for a large format
- 1:32:50LED and all that is it. It's still work in progress.
- 1:32:56You know the fidelity and the control that you would want
- 1:33:01individual over certain parameters whether it be from
- 1:33:05the camera or from the renderer or from the materials and the
- 1:33:08texture and the quality level is is.
- 1:33:12Getting better day by day and there are certain use cases
- 1:33:15where I could say, hey, you know, nerves rendered out of
- 1:33:19this platform can't hold up on an LED volume.
- 1:33:23It's just not there from a from a collective level if you're
- 1:33:26talking about like a little 30 by 30 LED volume, hey, the nerf
- 1:33:30out of luma or you know it's an NGP or nerf studio might hold up
- 1:33:35on a much smaller. Scale and and you could you
- 1:33:39could use a nerf as a background as like you know for image based
- 1:33:43lighting if you're using an LED volume as like more of a
- 1:33:46translate than you are for in camera visual effects.
- 1:33:50But it's accelerating so fast. So I think there's use cases of
- 1:33:55nerfs today that could totally fit like the way you guys are
- 1:33:59using them for both the educational and the
- 1:34:01experimenting for YouTube and and and other platforms is.
- 1:34:06It's good experimentation because it's like, you know, we
- 1:34:08could be having the same conversation right after
- 1:34:11SIGGRAPH and all the papers come out and SIGGRAPH and all the new
- 1:34:15like update, you know, some new updates drop right after
- 1:34:17SIGGRAPH. A lot of, a lot of computer
- 1:34:20vision and technology things get dropped at SIGGRAPH and you
- 1:34:25know, for a lot of people, a lot of people that don't pay
- 1:34:27attention to to, you know, computer animation and computer
- 1:34:33generated content. Trade shows, SIGGRAPH, it would
- 1:34:37be like your your like anime show for people that you know
- 1:34:41are super into anime, like for for for for CG and visual
- 1:34:47effects and animation like and and future technology.
- 1:34:49SIGGRAPH is like something to pay attention to and cool thing
- 1:34:52is it's back in LA this year, you know?
- 1:34:56So that's cool man, that's cool. Man, it was in Vancouver
- 1:35:00lifetime. What do you mean it's?
- 1:35:01Cool. That ain't cool at all.
- 1:35:04Well Vancouver's fun. Vancouver's fun.
- 1:35:06I I mean I was I was up there for for Vancouver and I I
- 1:35:11definitely love taking trips up to Vancouver.
- 1:35:14But yeah the I I think the state of of nerves and like we're
- 1:35:19saying with the tools from Luma and I've talked to the Luma team
- 1:35:24and they're they're creating a really great tool especially.
- 1:35:31Like I say the most advanced camera that's out there is still
- 1:35:33on iPhone you know and and and this is no knock that any re
- 1:35:38mini laugh or any you know any red Raptor or Komodo or you know
- 1:35:42Sony Venice or you know a 7S or any of that stuff.
- 1:35:46But you know having seen where pre iPhone to like what an
- 1:35:52iPhone can do today especially for a content creator who does
- 1:35:55happens to do visual effects is like it's the perfect scouting
- 1:35:59phone. If you have something like Luma
- 1:36:02and Polycam and Scanniverse and like all these other tools out
- 1:36:07there, it's like you can show up to a place and get a base level
- 1:36:13scan, come back, bring it in, bring it into my Unreal engines
- 1:36:17from a 4D blender, whatever it is and.
- 1:36:21Get it to a level that it takes an evolutionary step in terms of
- 1:36:25that, but it's super quick to iterate, best based off an
- 1:36:29iPhone, an iPad or mobile devices as a whole.
- 1:36:33And nerves are just this new newer approach to doing novel
- 1:36:40view synthesis of pixels like to to be able to create from a 2D
- 1:36:46flat image. You know depth and data because
- 1:36:49we do have you know depth cameras on our on our a lot of
- 1:36:53our devices. Normally we would have to do
- 1:36:56that as we would have to you know rent or have a very
- 1:36:59expensive light art scanner That and and shooting, you know
- 1:37:03shooting Hdris and and using a lot of photogrammetry approaches
- 1:37:09which are still relevant and will be for quite a while
- 1:37:11because there is a detail level that you get from traditional
- 1:37:14photogrammetry and light art scanning.
- 1:37:17That you can't get from the phone today.
- 1:37:20So you're you're using these mixtures of technologies for you
- 1:37:25know whatever that approaches and nerfs and novel view
- 1:37:29approaches to you know filling in missing information like
- 1:37:34depth data, pixel data, texture data materials like all of that
- 1:37:38is really interesting to see how fast it's moving because if you
- 1:37:45look at. Video projects, you look at
- 1:37:47Google, you look at the stuff that Apple's doing.
- 1:37:51You know, it's it's really interesting.
- 1:37:52If you look at the break crumbs 2IN Apple, especially with
- 1:37:55things like Vision Pro coming next year.
- 1:37:57And if you just look at that like camera kit and AR kit
- 1:38:01within Apple, there's some really cool things in there that
- 1:38:05like if you just get a developer account, you start messing with
- 1:38:07things like you've got some pretty robust virtual production
- 1:38:10tools right in there. And you can create like you can
- 1:38:15probably do some really cool virtual production tool, create
- 1:38:18it and pop it up on the marketplace.
- 1:38:22So nerf wise, I think we're in a state where they're at a level
- 1:38:28of good enough for certain types of workflows, especially if it's
- 1:38:32for things like commercials or brand videos or YouTube and
- 1:38:36educational. I think the best way to equate
- 1:38:40them is like I've said, they're kind of at their Instagram
- 1:38:42filter stage right now where they they have a ceiling to
- 1:38:49them, but the ceiling keeps going up because the technology
- 1:38:52is changing fast from like all these different platforms that
- 1:38:55are out there and projects and then new research papers keep
- 1:38:59coming out. So if you're like, you know,
- 1:39:01hey, well, if I shoot Nerf as a background and I have that, can
- 1:39:05I use that for an LED stage? If I shoot a nerf and render it
- 1:39:09out as a background, but then I shoot markerless mocap with like
- 1:39:13Move AI or another set of tools, can I then bring a ribbed
- 1:39:17character into that nerf background?
- 1:39:19Yes, you can do that today, like people do it all the time, and
- 1:39:23it will just keep getting better and better and better.
- 1:39:26So I think nerfs are in this evolutionary stage and I think
- 1:39:30like we have the same conversation.
- 1:39:33Post the graph and like, say January of next year, we're
- 1:39:37gonna be in a totally different place.
- 1:39:39We should have that. Conversation.
- 1:39:41And I'm looking forward to that. We're gonna clip.
- 1:39:43This. Moment in the next podcast,
- 1:39:45Okay. A couple of questions come to
- 1:39:47mind. First question, have you seen
- 1:39:50anybody use an iPhone in in in for feature films or shows to
- 1:39:55not even for the final product but to let's say scan something
- 1:39:58for a scouting location or or anything.
- 1:40:01Have you seen people already start using or maybe even
- 1:40:03yourself start using all these you know, tools that are
- 1:40:07available to the entire world like an iPhone to help their
- 1:40:10production? I do it all the time.
- 1:40:13I've been using an iPhone and iPads and you know, there was
- 1:40:18this nice tool and and system called Project Tangle at Google
- 1:40:23back in the day, which was what's killed.
- 1:40:26It was great. It was a great potential tool
- 1:40:28that I wish they hadn't killed. But yeah, hands down like in if
- 1:40:33you were to say like, hey, what's in your supervisor kit,
- 1:40:35that's always there and it's usually like an iPhone and an
- 1:40:38iPad. To capture because you can you
- 1:40:43can use tools like Luma AI, you can use tools like Polycam, you
- 1:40:47can use reality capture now that there is an iPhone based capture
- 1:40:52to that and be really quick to like get it down in dirty scan
- 1:40:58and bring it to into Unreal Engine.
- 1:41:01And it doesn't have to be 100% perfect.
- 1:41:04Usually what we do is we go back and light with like an RTC 360
- 1:41:10or some other type of like higher end lighter scanner for
- 1:41:13like sets and locations. But you'd be surprised like the
- 1:41:19quality level that you can reach today and that just.
- 1:41:23Gets you faster. So like I've worked with other
- 1:41:26soups and other production designers who have gone and like
- 1:41:29either I've shown them this tool or they use it themselves and it
- 1:41:33becomes this collaborative thing which is like, hey, let me just
- 1:41:36export out this, you know, this this OBJ or this FBX and I'll
- 1:41:40send it over to you and say, oh cool, let me bring this into,
- 1:41:43you know, into Unreal or into, you know, some of into Blender
- 1:41:46or DCC package and. Just you just start iterating
- 1:41:50really quick back and forth. So it's really good for
- 1:41:52collaboration and speed. And I think that the distance
- 1:41:57between using very high tech devices in high production value
- 1:42:01and using Bluetooth and iPhone is really getting smaller.
- 1:42:05And I wanna talk about democratization of tools and
- 1:42:08technologies that we have now. The softwares that you
- 1:42:11mentioned, most of them have free accounts.
- 1:42:13You can just get started. On them for free.
- 1:42:15Polycam, Luma, Unreal Engine is free.
- 1:42:18Blender is free. And now we have met a human
- 1:42:21animator which just recently got announced and this.
- 1:42:24Is crazy like previously to get a good facial motion capture.
- 1:42:30Of course there was live link, but you had to have, you know,
- 1:42:32an HMC. Live link is like it's using
- 1:42:35just the basic blend shapes right of AR kit and so the the
- 1:42:38movements and range of motion is very limited.
- 1:42:41And the other alternatives where just expensive gear that as a
- 1:42:46solo artist or a creator who's just starting out and you're
- 1:42:49excited about creating a short film and boom, you have the
- 1:42:52uncanny value of having a shitty facial animation because you
- 1:42:55just can't get it. Get around that and now you have
- 1:42:57Meta Human Animator, which is like, dude, it's freaking crazy,
- 1:43:01OK, it's crazy for us, but have you also had the same reaction
- 1:43:06towards meta human animator when you saw because.
- 1:43:07You were like I've seen this before.
- 1:43:10Oh, no, no, no. It was it the first time I saw
- 1:43:14and and sometimes seeing things a little bit earlier, you know,
- 1:43:19working with Epic for a while, it's like it it.
- 1:43:21Oh, so you you saw it and then they announced it.
- 1:43:24OK. Maybe.
- 1:43:26Maybe I'm not breaking. I'm not.
- 1:43:28Breaking any? We need to create a private
- 1:43:31WhatsApp group with Jim just for the sake of getting news early
- 1:43:34on getting alpha. Yeah no I mean well that's the
- 1:43:38thing sometimes is is you know I've I've over my career too
- 1:43:42I've been lucky enough to to kind of beta test and give
- 1:43:44feedback to a lot of different software and hardware companies.
- 1:43:48And you know that you know seeing some of those either
- 1:43:52sneak peek or getting to test things to give feedback is is
- 1:43:57really cool because you can you can help shape like what the
- 1:44:00next evolution of some of these tools are from.
- 1:44:04I remember sitting in the crowd the first time I saw the public
- 1:44:08Fortnight trailer at at an Epic special event and I'm just like,
- 1:44:15whoa, this is, this is awesome, like the the game engine company
- 1:44:18because this is, you know, there.
- 1:44:20Obviously we had known that, like you know Epic was making
- 1:44:23games. You know their own games too.
- 1:44:25You know, from from Unreal side Unreal Tournament.
- 1:44:29But. And it's like, Oh well, here's
- 1:44:32this new game and it was created all with this tool.
- 1:44:35And over the time, the one I would say the one great thing
- 1:44:41about working or seeing those bread crumbs like I was saying
- 1:44:45earlier was like I did a got invited onto a project with Epic
- 1:44:50years back and I got introduced to a lot of the team and got to
- 1:44:56work with Kim Labury at Epic. And you know looking at how we
- 1:45:04were using the tool for this, for this one project that was in
- 1:45:07collaboration with the mill and Epic for some new tools that
- 1:45:12were going to you know be announced in Unreal Engine.
- 1:45:15You know this is back in like 20 end of 20/15/2016 and.
- 1:45:21Like for me working on that project I'm like OK, this this
- 1:45:25is connecting the dots for me. Like I can be this much faster
- 1:45:28for this. And you know it was it was
- 1:45:31bringing in. You know this one happened to be
- 1:45:34for using at that time what was known as the the Mills Blackbird
- 1:45:38which was supposed to be this this tool this hybrid physical
- 1:45:42car that was going to change like you know car commercials
- 1:45:46for a while and it was a really awesome project and and you know
- 1:45:49it's still it's still up on. On epic site and there's this
- 1:45:53whole BTS of the project that that kind of talks about what we
- 1:45:56did. But it was it was that early
- 1:45:59thing that connected the dots for me for like what Unreal
- 1:46:04Engine was going to be for me as like a as a you know as like a
- 1:46:07visual effects artist and a DP and a storyteller.
- 1:46:09It's just like oh, I can get my ideas myself out faster and if
- 1:46:14I'm working on projects with other people I can and then as I
- 1:46:18go deeper into. The kind of epic land, if you
- 1:46:23will, in looking at their acquisitions over time with
- 1:46:29Cupid Motion and Three Lateral and so many of these other tools
- 1:46:35in gaming. So you think of some things in
- 1:46:37gaming well that would apply to filmmaking.
- 1:46:39It's like, well, you're getting the benefit of these tools to be
- 1:46:42able to. Iterate your ideas faster and
- 1:46:47when it came to 1st, seeing the first tease of something like
- 1:46:52metahuman with metahuman character creator and then
- 1:46:58you've got metahuman animator and you're looking at these are
- 1:47:02all the tools that are part of keeping motion and three lateral
- 1:47:05and other kind of science experiments and internally an
- 1:47:10epic. And just go, whoa, this is, this
- 1:47:13is like going to be available to all of us.
- 1:47:15You know it's like this isn't locked up at like weta and ILM
- 1:47:19and all. It's like I'm sure there's
- 1:47:21influence that have come from you know, the all of them, you
- 1:47:25know and and just seeing where the trajectory and then so if
- 1:47:28you look at it too, you can't not look at, you know Kim and
- 1:47:34the team that he and others at Epic have brought in.
- 1:47:38But it's like you know. Kim was a visual effects
- 1:47:40supervisor for the Matrix and other a lot of other amazing
- 1:47:43projects and I didn't he and the teams and yeah yeah yeah the
- 1:47:49well it's funny enough Kim Kim is in the last matrix too.
- 1:47:53Like he actually makes a cameo with some other some other the
- 1:47:56other yeah. Yeah.
- 1:47:58I won't spoil it for anybody that hasn't seen it but but Kim
- 1:48:01and some some of the other you know visual effects team make a
- 1:48:05little cameo and and. Most recent matrix, it's like by
- 1:48:08the elevator scene kind of like earlier on.
- 1:48:12But yeah, so you know if you look at the way that that
- 1:48:19specifically epic with meta human animator and a lot of the
- 1:48:22other tools around VP and animation, like you've got a
- 1:48:26game engine that has evolved and it doesn't solve every problem
- 1:48:31for filmmaking and all this cuz it's still a game engine that is
- 1:48:36now. Augmenting to serve the needs of
- 1:48:39all of us coming from content creation and filmmaking, coming
- 1:48:42into a game engine and going like hey, we need these tools
- 1:48:45and I want it to act like this and it would be great to do
- 1:48:48this. So it's having that appreciation
- 1:48:51for development to to understand there is a finite amount of team
- 1:48:56even though Epic is doing really well to be able to build
- 1:49:01everything that everybody wants. But when you look at.
- 1:49:05You know, the changes from Unreal Engine four to five, it
- 1:49:09was like night and day, you know, especially as as a whole,
- 1:49:13not just for virtual production, but just as a whole.
- 1:49:16And then we look at, you know, we're about to come up on, you
- 1:49:19know, Unreal Engine 53 road map publicly released and there's,
- 1:49:24you know, there's always. The roadmap and keeping, you
- 1:49:28know an eye on the roadmap board and the Trello boards and like
- 1:49:32what the what the GitHub releases are because you can
- 1:49:35find little gems in there and be like oh here's this thing, so
- 1:49:38you you know you've got to compile the build but still you
- 1:49:40get to poke around in the in the engine early.
- 1:49:45But yeah, Metahuman as a whole has been a really awesome tool
- 1:49:51that has been able to democratize.
- 1:49:57What people can do to make, you know, a digital twin or digital
- 1:50:03human And normally how we would do it like how we were doing in
- 1:50:07the dimension and Ding and previous to that was you
- 1:50:11normally had to go in, you had to have a Cyberscan rig, you
- 1:50:15know you had or you had to build one, you know off of like
- 1:50:18hundreds of cameras that are all synced and it's a lot of data.
- 1:50:21And then you've got to go through and you've got to.
- 1:50:25You've got to rebuild it, re topple it, skin it, IK rig it
- 1:50:28like it was a lot of work and tools like that because I do
- 1:50:33have to give credit to to Unity with you know, with the Ziva
- 1:50:38tools that they acquired and some of the the Weta tools that
- 1:50:41they have there. There's some some really cool
- 1:50:43things on that side that Unity has been doing with the Ziva
- 1:50:47Dynamics theme. But I would say like Epic hands
- 1:50:52down has just. Made it much easier to do
- 1:50:55digital humans and rig them and bring them into a scene and and
- 1:51:00you know, use things like, you know, all the all the Kick Bash
- 1:51:03and Quixel tools and reality capture tools.
- 1:51:07And my thing is like people are like, you know, I don't even
- 1:51:10think it's a whole thing of like Epic versus Unity.
- 1:51:13They're just different tools, you know, It's a different,
- 1:51:15different paintbrush in which way?
- 1:51:18I would approach certain things. If I was doing mobile AR gaming,
- 1:51:23I'd go okay. Maybe that's a Unity project if
- 1:51:26I was building certain things or trying to solve certain
- 1:51:30problems, even vision. Pro Right now Unity seems to be
- 1:51:34the better option for Vision Pro people who want to develop for
- 1:51:37that, mainly because Apple. Is partnering with them, but I
- 1:51:41believe even with Unreal we can eventually create projects.
- 1:51:44Yeah, there's been Vision Pro. There's been a Vision Pro
- 1:51:47workflow. Like their documentation from
- 1:51:50the Unreal side of things is there too.
- 1:51:53I don't think that it's gonna be a one.
- 1:51:57Horse race in terms of a game engine availability, I also
- 1:52:01think Apple's just gonna release tools for Vision Pro like if you
- 1:52:05yeah, my my, my feeling on Vision Pro was that it is just a
- 1:52:11step in what is going to be more of the ecosystem play.
- 1:52:17And for me, I'm more interested in where the the OS is going for
- 1:52:22Vision Pro than I am specifically about the hardware.
- 1:52:26I am a proponent that, like I've had every HMD there is under the
- 1:52:30sun and used it in every different way.
- 1:52:34I think people are still not wanting to put expensive heavy
- 1:52:38goggles on their face, and it's still an evolutionary step until
- 1:52:44it gets to the. I don't even want to say
- 1:52:48sunglasses, because some people didn't even want to put stereo,
- 1:52:51whether they'd be passive or anaglyph glasses on their faces
- 1:52:54for for stereo films, you know, we're talking about real time,
- 1:52:59foveated, rendered, you know, projection back onto your pupil.
- 1:53:04And until you have that in smart cities that there are
- 1:53:08unfortunately cameras or you know, projection devices
- 1:53:11everywhere, we're still quite a ways away from having something
- 1:53:15like that. But.
- 1:53:16Like I said, you can see the bread crumbs to say that you
- 1:53:19know if theaters or something like a crazy like MSG sphere can
- 1:53:25use technology to basically track your eyes in real time and
- 1:53:30project back pixels to it at a scalable level.
- 1:53:34You know, be affiliated rendering or some other new type
- 1:53:37of rendering. Then you then you start to go
- 1:53:41like whole like that that could be some interesting tech to get
- 1:53:44into. We're we're still away from
- 1:53:47something like that. But no, there's little pieces of
- 1:53:50tech that are out there like that and you go, OK, in 10
- 1:53:53years, this is going to be like, the shit.
- 1:53:57It's it's honestly, there's so much more coming out, and I
- 1:54:00didn't expect this. But Jim, there's so much we want
- 1:54:02to talk to you about. We have like at least ten other
- 1:54:05topics that we haven't even touched on.
- 1:54:06And I definitely would want to plan another episode.
- 1:54:10But one thing I want to say is. Can we have a rapid fire
- 1:54:14section? Because we have some questions
- 1:54:16that people ask and on on our stories and in threads.
- 1:54:19So we'll do like a rapid fire and just make sure we can
- 1:54:23approach as many as possible with you answering them.
- 1:54:25Because I think there's a couple of really good questions that
- 1:54:28can help and benefit a lot of people.
- 1:54:29And with your experience, this is like the best time to do it.
- 1:54:32Should we, should we do that right now?
- 1:54:33Let's. Do it.
- 1:54:35OK, Fire. You want to go first or?
- 1:54:37OK, All right. So.
- 1:54:38Sebastian Joseph asks apart from annual engine, what other
- 1:54:42software is used to make a virtual production set up that
- 1:54:45they might need to look into if they're getting started?
- 1:54:49Pretty much everything under the sun, like in a traditional
- 1:54:51workflow for virtual production, you're going to touch other DCC
- 1:54:55tools that you may already be using.
- 1:54:57Blender, my Cinema 4D Zebra like it's going to touch a lot of the
- 1:55:02tools that are existing and have existing workflows so you can
- 1:55:06still get into. A virtual production role, be it
- 1:55:09on that or or pre viz or or post viz with some of those skills
- 1:55:15that you may already have. Perfect.
- 1:55:18OK. I got a very interesting one.
- 1:55:19Someone asked Can you imagine films and video games blend
- 1:55:23together as a new medium. Now that we have, you know, game
- 1:55:26engine coming to production. I I assume what they think of is
- 1:55:30now you have created the field, you have the set, you have the
- 1:55:32environment, why not I can go inside and you know play.
- 1:55:35Add a third person blueprint and make it.
- 1:55:39I I think we've seen steps of that happen.
- 1:55:42Like we've seen things like Netflix experimenting with like
- 1:55:45the Choose Your Own adventure. You know, I go back to like the
- 1:55:49Tom Hanks movie in big where like the comic book that he
- 1:55:52wanted to create when he when he got big was this like
- 1:55:55interactive choose Your Own adventure.
- 1:55:57And I know we faced it in like VR and AR for a while, but yes,
- 1:56:01I think we're seeing hybrids of. The streaming, the streaming
- 1:56:05platforms and other film things of like how do you tie the story
- 1:56:10in because you want to you as as a you know person that's
- 1:56:15invested in like the series. Like you know whether it be Star
- 1:56:19Wars or new IP, maybe it's the Gareth Edwards like creator that
- 1:56:23expands into a bigger universe. Marvel Marvel's the perfect
- 1:56:27example of this of like you have all this original IP how do you.
- 1:56:33Keep your community involved past just like the film, you
- 1:56:37know. And it's like where do you take
- 1:56:38the story? Do you take the story from you
- 1:56:41know, the movie theater back home to like a device like a
- 1:56:43Vision Pro or you know your iPhone?
- 1:56:46And how do you keep the person engaged throughout a story arc
- 1:56:50in a storyline to keep them invested, to keep coming back to
- 1:56:54the, you know, it's like the Indiana Jones thing even though
- 1:56:56we just got the last one you've you've spanned of like 40 years
- 1:57:00of. A career and a storyline to
- 1:57:03like, how do you keep coming back to it?
- 1:57:04So yeah, hands down we'll see more gaming and filmmaking get
- 1:57:10tighter. I love that we have another one
- 1:57:14from Piktorri Studio that says is it possible to shoot without
- 1:57:18Vive or any other tracker for a virtual camera?
- 1:57:22Sure, yeah. I mean, you can use your iPhone
- 1:57:26as a tracker. There's some other iOS tools out
- 1:57:29there. That you can use to you know
- 1:57:32record tracking data to the camera and then get the tracking
- 1:57:34data into something like on real engine.
- 1:57:37You know the the Vive Mars is a great like barrier to entry
- 1:57:40because it's you know it's like a it's 5K for like a kit.
- 1:57:44And you know even if you didn't have the full Gen. locked Mars
- 1:57:48system you can still use something like a Vive tracker
- 1:57:52and base stations to get data to do a track.
- 1:57:55Camera. Do you know roughly how much it
- 1:57:58is to get a Vive tracker on a base station that should be?
- 1:58:01Yeah, 5000. Right.
- 1:58:04Yeah it's for the Vive Mars. The whole kit that HTC sells
- 1:58:08that's A5 RAM like all-encompassing comes in a
- 1:58:11Pelican case with you know with the hub that allows you to to
- 1:58:16run the vibe system with the base station with the tracker
- 1:58:19and you know you need a couple extra pieces for Gen. locking
- 1:58:23and and and SDI connections. But if you just wanted to get
- 1:58:27started and you had you know a minimum 2 Vive base station, 2
- 1:58:34point OS and like a tracker 3 point O you can do a track
- 1:58:38camera. You know like you can even use
- 1:58:40the you know, the Poc you know as your camera.
- 1:58:43You just need to bind it to like your semi camera act and then
- 1:58:47set up you know, you know your vibe set up but like.
- 1:58:52There's ways to do it on the cheap.
- 1:58:53I just out of curiosity for ourselves because we're we
- 1:58:57haven't really played around a lot with the virtual camera
- 1:58:59setup. Would you recommend if someone
- 1:59:02has a budget of let's say 1005, two thousand and they want to
- 1:59:04get into, would you recommend them getting an iPad which has
- 1:59:06like that you know big display and there's a device, there's an
- 1:59:10application for you to connect or would you recommend them
- 1:59:12going to the basic Vive tracker setup that he just mentioned?
- 1:59:16You can just you can just use an iPad or your iPhone and and use
- 1:59:20the V Cam plugin directly. With an Unreal Engine and if you
- 1:59:25just wanna use it as a visualizer and get track data
- 1:59:30and set up Take recorder to do the takes for your scenes, you
- 1:59:34can just use an iOS device in that way.
- 1:59:37Super easy. And if you wanna take the next
- 1:59:39step then you go towards things like to vibe and then to.
- 1:59:44Then you start stepping up into the bigger realms of camera
- 1:59:47tracking capability when you start moving towards like
- 1:59:49optical based or marker based tracking systems.
- 1:59:52Honestly, I think there is no excuse for people to do not
- 1:59:56start on the things that they wanna do.
- 1:59:58All these company providing all these tools and many of the
- 2:00:00things that we mentioned today, right phone, laptop, camera.
- 2:00:03I think potentially everyone has one at their home.
- 2:00:06They just need to download some application and software and
- 2:00:08start using it. It's just a quick YouTube search
- 2:00:12away. Yeah, exactly, exactly, yeah.
- 2:00:15Someone asked about the dynamic lighting because when there is a
- 2:00:18set of virtual production, I think what they assume is how do
- 2:00:21they change lighting based on the scene when the action is
- 2:00:25happening. So then we start getting into
- 2:00:27fun talks of like LOD structure and optimization and baked
- 2:00:32versus dynamic lighting is always a hot topic cuz that's
- 2:00:37usually what breaks the scene is the lighting.
- 2:00:40You know it's it's not only you know materials and textures of
- 2:00:43things that are like photo real versus stylistic.
- 2:00:46But for me, you know coming from a background cinematography is
- 2:00:50is lighting, is what is is a dead giveaway to something that
- 2:00:53looks like a bad broadcast key from like the 90s.
- 2:00:56You know shot on you know not properly lit green screen.
- 2:01:01But you're trying to create the separation you know is is you're
- 2:01:04pairing, you're pairing camera with within lighting and we've
- 2:01:08all seen it. We've seen a lot of the good
- 2:01:10demos and bad demos and we've seen really good stuff you know
- 2:01:13done well on on an you know an LED wall for ICBFX.
- 2:01:19The choice about dynamic lighting versus bake lighting is
- 2:01:21always, you know the hot topic of that it it's based off of of
- 2:01:25of the scene and how the scene needs to be performant on the
- 2:01:28day especially for for ICBFX so. If the way that you approach and
- 2:01:33This is why it always comes down to like a team thing and
- 2:01:36experimenting. Whether you're indie level or
- 2:01:38you're like you know full ICB effects on set.
- 2:01:42You know VP team is you know you're approaching optimization
- 2:01:47to know like what is in the field of view like what what is
- 2:01:50in your frustum. You know if everything outside
- 2:01:54of your your, your, you know inner frustum is not you know
- 2:01:58being captured final pixel. Then your LOD structure for that
- 2:02:01can be much, much lower where your detail level doesn't need
- 2:02:06to be because you're not capturing there.
- 2:02:08So that comes into like a good understanding of like how how
- 2:02:13your lighting team within bad and how you are approaching your
- 2:02:17lighting and your your scene approach to building.
- 2:02:21Because if you just that's one thing is like a lot of people
- 2:02:23think virtual production is hey just go out to the marketplace
- 2:02:26get unreal assets and just throw it up on the wall.
- 2:02:29Half, I would say more than half of the assets that are out on
- 2:02:32the marketplace and available, you know, turbo Squad and all
- 2:02:35that. They're not built for virtual
- 2:02:36corruption. They're built for either gaming.
- 2:02:39They're built for, you know, they have a different LOD
- 2:02:41structure. They have, you know maybe the
- 2:02:43textures are much lower quality than they need to be.
- 2:02:46Like these are the things that people don't fully understand is
- 2:02:50like, it's just not a kit bash. 2 LED wall turn it on camera
- 2:02:54duck type of thing you do you can kit bash.
- 2:02:58It's done all the time. You can use Quixel, you can use
- 2:03:01Kit patch 3D, you can use all these tools, but they do need to
- 2:03:05be finessed and optimized in a way.
- 2:03:07And especially in lighting is there's an approach to choosing
- 2:03:10why you wanna choose dynamic lighting.
- 2:03:13And the key thing to why you wanna have dynamic lighting for
- 2:03:16Icbfx is you're working with other creative production teams.
- 2:03:20A DP and a director may wanna change the time of day.
- 2:03:23You know they may want to change something.
- 2:03:25Once you bake lighting, you're now committed to that.
- 2:03:28It's rendered out and that's Okay.
- 2:03:30You can do a mix of bake lighting with dynamic lighting
- 2:03:33in a certain type of LOD structure, but you take away.
- 2:03:38The creative manipulation that you can, you know, hand in iPad
- 2:03:44over with the Webkit API to a gaffer and to a DP and be like,
- 2:03:47you know what you want the sun to be here, you want the time of
- 2:03:50day here. We're going to raise the horizon
- 2:03:52level here. That's a benefit of using, you
- 2:03:55know, dynamic assets and especially dynamic lighting
- 2:03:58versus bake lighting. And the tools are getting better
- 2:04:03and we're getting beefier CPUs and beefier, you know, graphics
- 2:04:06cards, thanks to NVIDIA. To be able to do more of the
- 2:04:11heavy lifting and that is also the benefit of going into tools
- 2:04:15like diving into Lumen and Nani is to be able to you know.
- 2:04:21Increase the Poly count or increase our triangles but not
- 2:04:24increase the load on the systems which is why virtual production
- 2:04:29we usually need a lot of render nodes to handle not only the end
- 2:04:33display but the, you know, just the the scenes in general.
- 2:04:36So yes, if you can go dynamic lighting, just understand that
- 2:04:39dynamic lighting has what I what I call and others referred to as
- 2:04:43like a scene tax. So every light you throw in,
- 2:04:46whether it be a rec light, a spotlight, whatever it is like
- 2:04:49that lighting is going to have a tax.
- 2:04:51So understand how to approach lighting the right way is
- 2:04:54probably one of the key things I can say spend more time in
- 2:04:57Unreal Engine or CG lighting as in general and understand what
- 2:05:02the tax is of every asset and every light and every scene
- 2:05:05camera that you add to a scene. So.
- 2:05:08Well, for this question it wasn't amazing.
- 2:05:11So well said because. I kind of came back to it, yeah,
- 2:05:14No. No, no, please.
- 2:05:16It's exactly what you started out with when you were talking
- 2:05:19about how you get your experience.
- 2:05:21It's either you got to go work at big studios or smaller
- 2:05:24studios, boutique studios, to learn all of these things from
- 2:05:27somebody who's doing it every day.
- 2:05:28So when you go, you can actually learn all of this, like smaller
- 2:05:32things about, oh, the light tax and everything within a week,
- 2:05:35within the first week, But because you'll see the problems.
- 2:05:38And you learn them that quickly if you really curious enough or
- 2:05:41alternatively if you are somewhere else in the world who
- 2:05:44do not have access to these studios, the best way is to just
- 2:05:47do it yourself. Again going back to what you
- 2:05:49mentioned, if you try to do this at home and try to have your own
- 2:05:53setups you'll quickly understand that the more lights you add the
- 2:05:56more taxing you'll have and also the on real engine
- 2:05:59documentation. I don't know if you guys know
- 2:06:01this but like especially for the 5.2 and everything they added
- 2:06:04more stuff I believe. About rendering and all these
- 2:06:07sort of light taxes and just take a read on that cuz all of
- 2:06:10that is extremely helpful but what What a great answer.
- 2:06:12Jim read yeah read read it but but experiment like you know you
- 2:06:17can set up an end display workflow environment at home
- 2:06:21like you can you can do it to I've done it here multiple you
- 2:06:25know OLED TVs and or just even multiple monitors you know I've
- 2:06:29got you know Asus monitor here and and other stuff over here
- 2:06:34and it's just like. You can build the baseline of
- 2:06:36it, and if you can't understand it because you know, right, you
- 2:06:38know. And it's like.
- 2:06:39Configs people have the love, hate relationship with with
- 2:06:42setting up and display at times, but there's a lot of good
- 2:06:46resources, you know, You know, if you don't have that benefit.
- 2:06:50I know a lot of people get tied up and they're like well, how do
- 2:06:53I get experience if I can't get on set and I can't you know,
- 2:06:55it's a whole the like chicken and the egg thing.
- 2:06:58Just set this stuff up at home, mess around with projectors,
- 2:07:01hook up multiple monitors. You know, play around with the
- 2:07:04stuff like dissect and read the documentation.
- 2:07:09Sometimes the documentation doesn't have everything in there
- 2:07:11and you're gonna get caught up. And usually you do like one
- 2:07:14quick YouTube search and be like somebody posted this.
- 2:07:16One thing that I'm going through just get good at researching.
- 2:07:20That's because the answers are usually out there.
- 2:07:24That's extremely true. There is one more question.
- 2:07:27I think it's the final question and I think I'm not sure it's
- 2:07:30related to one of your tweets that you made yesterday.
- 2:07:34So the question goes, how fast can you move the cameras before
- 2:07:37busting the trackers? And then you were tweeting
- 2:07:40yesterday about a video that Marcus Brownlee posted about you
- 2:07:44know the 120 frames, that the whole LED is 120 frames, you can
- 2:07:47have 60 frames shooting with a different background and other
- 2:07:5060 frame is shooting with a blue background.
- 2:07:53You mentioned something about ghosting that might have not
- 2:07:55been, you know. Described.
- 2:07:56Properly. Maybe you can like clarify that
- 2:07:58for us. Yeah.
- 2:08:00So the the way there's a couple things and pieces of technology
- 2:08:04more than likely when. Marquez and Cleo where at at
- 2:08:09that XR stage is there's there's certain processors that have
- 2:08:15features and then there's some other tools out there like Go
- 2:08:19screen just happens to be one type of technology which is in
- 2:08:23another way pulling from like the stereoscopic days that we
- 2:08:28used to like interleave frames of like doing over, under.
- 2:08:32What what the benefit and what that video that that Marquez and
- 2:08:36and and Cleo had showed at at 0 Space was this technology that
- 2:08:43you know instead of having like 3 having to do 3 takes and then
- 2:08:47do one to two safety takes and then put up a green screen or a
- 2:08:49blue screen just as you know we do quite a lot on LED walls.
- 2:08:53It's a it's a way to like you know just do safety takes or you
- 2:08:57know give give production options you know to get to get
- 2:09:01stuff. Is you know it is a piece of you
- 2:09:05know broadcast technology and and and a little bit of
- 2:09:09production tech in the in the background is that you know what
- 2:09:13they're what they're doing is, is it's a higher refresh rate of
- 2:09:17being able to to kind of interleave frames.
- 2:09:20So like the the frames are you know kind of flashing you know
- 2:09:23and there's a there's a limitation to that.
- 2:09:25There's also. Disadvantages to it is currently
- 2:09:29for feature films and for episodic.
- 2:09:31That technology doesn't work because there's certain
- 2:09:33limitations to the shooting style, the frame rates, the
- 2:09:37shutter angles you can shoot at and it and it works well for
- 2:09:42like studio environments. Broadcast and like agency.
- 2:09:45Commercial type shoots can can use this technology.
- 2:09:48Right now they do. They do a bit of, I want to say
- 2:09:54like dark magic. In in the way that they approach
- 2:09:56how they can interleave the the framing.
- 2:09:59At the same time as you know the multicamera example that they
- 2:10:03that they're doing is being that they can OverDrive the
- 2:10:07processors at a higher refresh rate.
- 2:10:10There's limitations of what the camera can do of what the
- 2:10:12processor can do and and what the what the LED tiles can do.
- 2:10:17So when I say that it's got certain restrictions is like
- 2:10:20that technology will. Catch up.
- 2:10:23You'll be able to hit different shutter angles, you'll be able
- 2:10:26to hit higher frame rates, you'll be able to pack more data
- 2:10:31through the pipe to be able to use it.
- 2:10:36And that technology is being used like ESPN and other
- 2:10:42broadcasters are using it for their stuff because it would be
- 2:10:47great. That for every frame that you're
- 2:10:50shooting, you could potentially have a green frame with tracking
- 2:10:54markers or a blue frame or another plate.
- 2:10:58You know, we see it tend to happen in live broadcast first,
- 2:11:02then you know things. Or sometimes it might be done on
- 2:11:05a feature film and that broadcast will take it or vice
- 2:11:07versa. But it plays really well for
- 2:11:10that because in a studio environment you can control a
- 2:11:12lot, a lot of things for, you know, for broadcast or for some
- 2:11:15type of. A TV show and you know you can
- 2:11:21lock down the technology because if it's like episodic or it's a
- 2:11:24show that shoots all the time you can lock down the workflow
- 2:11:27pretty well. And the the approach that
- 2:11:31they're using is in a multi camera scenario is IF8 camera is
- 2:11:37on the wide shooting like on on a 24 and B camera is shooting
- 2:11:41the tights are like in 85. But you want a different
- 2:11:45background on the 85 than you do for the 24.
- 2:11:48You know, that technology can kind of play well to say like,
- 2:11:51hey, there's this correspondent that's over here.
- 2:11:53We want to make them look like they're, you know, at, you know,
- 2:11:56at this location, you know, they're they're supposed to be
- 2:11:59at the Eiffel Tower, but then this person is supposed to be,
- 2:12:01you know, back in New York City shooting that.
- 2:12:04There's advantages to to that too.
- 2:12:06It it hasn't gotten to the level.
- 2:12:11Into the ease of use, I'd say of like how fast sometimes things
- 2:12:16like commercials and feature phones need to work, jumping
- 2:12:21from set to set to set, but it'll get there.
- 2:12:25But it is a cool piece of technology if people look it up
- 2:12:30like one form of it's called ghost frame the other.
- 2:12:34Side of it is probably what they were showing might have been
- 2:12:38coming from the Brompton processors and what they're
- 2:12:41capable of doing. It's a different it's a
- 2:12:43different name that Brompton has than Ghost Frame has and they're
- 2:12:48it still uses expensive equipment to pull off stuff like
- 2:12:52that but it is a very cool approach and.
- 2:12:56You know, if you could tell, you know somebody they could, you
- 2:12:58know, a producer, showrunner, a director like, hey, you know,
- 2:13:01you can get your green screenshots and the same time
- 2:13:04you're doing that, you know, they'd be like, Oh yeah, that's
- 2:13:06going to save a ton of money. It'll get there.
- 2:13:08They'll get there. We're seeing, we're seeing these
- 2:13:11evolutionary steps of it yet. But the cool, I, I, I, you know,
- 2:13:15I did tweet it out there that you know people like Marquez
- 2:13:19and. You know, Casing istat and some
- 2:13:22of these other Youtubers and storytellers that you know,
- 2:13:25introduce new tech to different different communities and and
- 2:13:31different people. Because it's like the people
- 2:13:33that see the video of Marquez today versus like, you know,
- 2:13:38following what Marquez was doing early on in his career.
- 2:13:41Like when he started getting into like, you know, red cameras
- 2:13:44and then motion control robots and.
- 2:13:46And then in virtual production, the same thing for Linus tech
- 2:13:50tips. It's like, hey, everybody's
- 2:13:52paying attention to virtual production.
- 2:13:54And then the Youtubers are using it and they're like, well, what
- 2:13:58if we set it up there? And it's like Linus's was like
- 2:14:02with the Mars system for green screen?
- 2:14:05That's one workflow. Marquez is at the LED space, at
- 2:14:090 space. Different like XR, that setup is
- 2:14:13more of a setup for like agency commercial brand work versus
- 2:14:17like a LED volume that more we would use for like feature films
- 2:14:22or car process stuff. It's like an erector set,
- 2:14:25different configurations for different use cases.
- 2:14:29Wow, thank you so much for that explanation.
- 2:14:32And what was funny is at the end of the video Marcus was saying
- 2:14:35and he said this multiple times that I want to have this in my
- 2:14:39studio. Of course it does.
- 2:14:41Yeah, but like you mentioned the costs are 100 like just
- 2:14:45stupendous figures. I but he probably can afford
- 2:14:48them. I I I don't know I I mean he
- 2:14:50probably makes a shit load of money so I.
- 2:14:52I There's a benefit. He has some really you know, I
- 2:14:55mean like he's got a motion control robot sitting at at his
- 2:14:59place and and it's like not every you know YouTuber but but
- 2:15:04he you know he is a different type of YouTuber slash
- 2:15:06production company now. But yeah I I wouldn't imagine
- 2:15:12that he wouldn't have you know something like that.
- 2:15:14I think you know these. Content creators these days that
- 2:15:20have now evolved from just himself doing you know tech tips
- 2:15:25and like hey here's the new iPhone thing to like having a
- 2:15:31full blown production company that works with these brand
- 2:15:34partnership deals. And and you know his videos are
- 2:15:36really flick and they're polished and you know him and a
- 2:15:40lot of other Youtubers and and social media production
- 2:15:45companies that have kind of come up out of.
- 2:15:48Out of this, like they make a good living and they do really
- 2:15:51great content. His videos are enjoyable.
- 2:15:54I got to work with him a little bit at GoPro.
- 2:15:59A lot of them like the guys at Corridor and Casey Neistat and
- 2:16:05Marquez and a bunch of them of like seeing them cameras and
- 2:16:08kind of like being able to show them how to do things with
- 2:16:12Gopros, but you. Look at that and you look at
- 2:16:16like Marquez going like, hey, I may use this.
- 2:16:18The line is going like, hey, we would use this.
- 2:16:20It's like they don't have to build physical sets or maybe
- 2:16:23they have to build partial. It's like right now I could
- 2:16:28easily have, you know. Usually on Zoom I do it and I
- 2:16:32bring in a different background and you can run, you know,
- 2:16:34through through these platforms and we can all have virtual
- 2:16:37virtual backgrounds and make it look like, hey, we're, you know,
- 2:16:40some posh place where we're just like sitting in our own office.
- 2:16:44So yeah, it's it's technology, you know, it's really cool to
- 2:16:47get excited about this stuff. But yeah, if if Marquez does
- 2:16:51have one, you know, he can, he can always give me a ring and I
- 2:16:53can give him some tips on how to be, how to be efficient with his
- 2:16:57LOD structures. You would probably be the best
- 2:17:01person to talk to about that. But you know All in all, Jim,
- 2:17:04it's been a pleasure speaking with you.
- 2:17:06We honestly covered so many different topics and I I hope
- 2:17:10the people who are watching can really take down some of the
- 2:17:14stuff that you talked about about virtual production, about,
- 2:17:17you know, being a VFX supervisor and.
- 2:17:19About how they can get into this, and that was the main
- 2:17:21point of the conversation today, to give people an inspiration
- 2:17:25and motivation. And if they're already inspired
- 2:17:27and motivated, give them a pass to begin with so that they can
- 2:17:31follow in your footsteps and get to the positions that you've got
- 2:17:34into in your career and so. I just want to say a big thank
- 2:17:37you to you. We'll take the links of your
- 2:17:41profile, you know, on threads. Now on Twitter and all that.
- 2:17:45Now we're all on threads. Yeah, we have to be right.
- 2:17:48We'll put it down in the links in the comments below and also
- 2:17:50some of the other stuff that you mentioned about John's podcast
- 2:17:53and all that, all the cool links and the cool videos that you
- 2:17:56just talked. About, Yeah, we can.
- 2:17:57We can definitely share those out.
- 2:17:59Yeah. And I think for people, it's
- 2:18:00very important, I think, to follow Jim on Twitter.
- 2:18:03At film Bot. Right at Film bot.
- 2:18:05Film bot He's sharing. Film bot is me on Instagram and
- 2:18:08Twitter and you know the film bot name is a funny thing
- 2:18:11because it's it's always gets confused of like I think I have
- 2:18:15a shadow band that they think I'm some kind of like Jackbot
- 2:18:19because I don't have my life. I've been I've been Film Bot
- 2:18:22since like. I don't know.
- 2:18:25It came off of like an e-mail, which is funny because back to
- 2:18:29the skateboard thing is a friend had something back in the day
- 2:18:34called Film Bot Files which is this like you know, this whole
- 2:18:37thing, it was like a skateboard brand and and and would be
- 2:18:40skateboard videos. So people always equate that
- 2:18:42like, oh are you the same film bot.
- 2:18:44And it's like my friend and I always get confused with each
- 2:18:47other of like the film bot files for escape stuff versus just
- 2:18:50like the regular film bot stuff. But.
- 2:18:52It's supposed to be a play on like filming robot because all I
- 2:18:55did was just like go around with the camera and and film things
- 2:18:59and you know, always had cameras.
- 2:19:01So that's where the whole kind of film button name is.
- 2:19:03So yeah, Instagram and threads now since it just goes over in
- 2:19:06Twitter and you know, same thing.
- 2:19:08It's like you can. Find them out there.
- 2:19:10We'll let we'll let people know and and guys go ahead and give
- 2:19:14Film Bot a follow because it does post a lot of crazy stuff
- 2:19:17and for you guys that want to get updated one of the best
- 2:19:20places is his profile. But thank you again Jim.
- 2:19:22We'll definitely talk to you and have another episode, you know,
- 2:19:26potentially maybe even after SIGGRAPH maybe before we'll see
- 2:19:29how it goes. But would love to continue the
- 2:19:31conversation and and maybe talk about some of the things that we
- 2:19:34missed out on today and for everybody watching.
- 2:19:36Thank you so much for staying through.
- 2:19:38We'll see you guys next week until then.
- 2:19:40Ciao.