Latest / Automated with Brian Heater / Designing the Machines of Disney’s Avatar with Ben Procter

Transcript

Designing the Machines of Disney’s Avatar with Ben Procter · Automated with Brian Heater

• 0:00
  SPEAKER_00: Part of what we had to think about is the fact that Mr.
• 0:02
  SPEAKER_00: Krabby Pants has uh you know more legs than a person does, right?
• 0:06
  SPEAKER_00: In the AM suit, the presumption is that there's something that might be analogous to two legs controlling two legs, which of course doesn't work when you've got four legs on the vehicle.
• 0:14
  SPEAKER_00: So we came up with the idea that it's kind of like you're riding a creature, right?
• 0:17
  SPEAKER_00: So imagine that you're riding a horse and then you have big robot arms kind of strapped in the front of that horse.
• 0:23
  SPEAKER_00: So your legs are going to be telling the creature where to go, along with some control sticks and stuff that are built into the end defectors.
• 0:29
  SPEAKER_00: But uh your arms are directly controlled as opposed to the indirect control.
• 0:32
  SPEAKER_00: So we built different paddles and levers and stuff into the leg area of the seat so that you actually use like the same way that you might use your knee as to put pressure inside a horse to make it move away from pressure.
• 0:43
  SPEAKER_00: That's exactly how you do a crab suit.
• 0:51
  SPEAKER_01: Hey everyone, my name is Brian Heater.
• 0:53
  SPEAKER_01: I am the managing editor at A3.
• 0:56
  SPEAKER_01: I hope you're having a happy whatever it is that you do or don't celebrate.
• 1:01
  SPEAKER_01: This episode of Automated is very special for a couple of reasons.
• 1:06
  SPEAKER_01: Uh, first and less interestingly, it was recorded at the Ramada in Sunnyvale, California during late checkout.
• 1:14
  SPEAKER_01: The guest was actually booked uh the night before uh while I was moderating a panel about AI over in Mountain View.
• 1:22
  SPEAKER_01: Uh, the second reason is, of course, the guest himself.
• 1:26
  SPEAKER_01: This week we are speaking with Ben Proctor, an art director, production designer, and visual effects artist who has worked on some of Hollywood's biggest blockbusters from the Transformer films to Prometheus.
• 1:41
  SPEAKER_01: Uh we're here to talk about another absolutely gigantic franchise.
• 1:47
  SPEAKER_01: Uh, this one actually has a new entry due out later this week.
• 1:51
  SPEAKER_01: Avatar Fire Nash.
• 1:54
  SPEAKER_01: Uh, I note during the interview that this is a conversation that I have actually been thinking about since I saw the uh the last avatar, the second avatar uh in theaters.
• 2:06
  SPEAKER_01: It's a great conversation.
• 2:07
  SPEAKER_01: I hope you enjoy it as much as I did.
• 2:09
  SPEAKER_01: Don't forget to like and subscribe, and we will see you on the other side.
• 2:14
  SPEAKER_01: So I mentioned to you on my initial pitch, I saw the last movie in theaters.
• 2:22
  SPEAKER_01: I was sitting there with my 3D glasses on.
• 2:26
  SPEAKER_01: Um, I should mention this was a Manhattan theater, so you know, probably a$50 ticket enjoying the movie.
• 2:33
  SPEAKER_01: Um, I I think they had just landed on Pandora, and I see these little robots come out, little like spider or crab-like robots come out and they're doing building.
• 2:44
  SPEAKER_01: And it occurs to me at that moment that the next time an Avatar movie comes out, we absolutely have to get some of the behind-the-scenes folks on to talk about them.
• 2:53
  SPEAKER_01: Because the first thing that jumped out at me is oh, these are like very much based in robots that we have right now, like robots that are out in the world and research that's being done right now.
• 3:05
  SPEAKER_01: So those are the hex bots.
• 3:07
  SPEAKER_01: When you start production or start the creation on a robot like that, how much are you actually looking to the real world and current robots for inspiration?
• 3:17
  SPEAKER_00: Yeah, I mean, the the idea that Jim wanted some kind of swarm assemblers that were moving around, I believe existed previous to us doing design on them.
• 3:26
  SPEAKER_00: I don't think like there are times then we we just come up with an idea and we pitch it to him and he's like, great, and then it goes in the movie, and that's awesome.
• 3:32
  SPEAKER_00: I think this was an idea he had already.
• 3:34
  SPEAKER_00: The idea that they were insectoid or insectile, whichever is the correct word, and some form was already there.
• 3:40
  SPEAKER_00: Um Jim is very familiar with with technology, and we're, you know, those of us who work on hard surface designs for movies are also big nerds and geeks for these kinds of things.
• 3:48
  SPEAKER_00: So, you know, the idea that didn't have to be humanoid in any way, right?
• 3:51
  SPEAKER_00: That you can have a swarm that operates together in a kind of, you know, algorithmically driven, intelligent way that's grander than any the intellect that's on board of each of them is an idea that we're all familiar with.
• 4:02
  SPEAKER_00: And so we kind of went with that.
• 4:04
  SPEAKER_00: We came up with a family of different designs, figuring there would be need for different weight classes, essentially, like things that could handle and carry larger pieces of material up to the job site, which could be 30 stories in the air, so that the little friends could come in with their welding torches and their fastener drills and whatnot and attach things into position.
• 4:22
  SPEAKER_00: At the end of the day in the movie, Jim wasn't interested in showing that there was like a group of different types, he just didn't care.
• 4:28
  SPEAKER_00: So, so you know, the idea, he's like, I think it's more of like a von Neumann machine kind of thing, like you know, as if deliberately every part of the process is, you know, they're identical little units, right?
• 4:38
  SPEAKER_00: Um, but uh, but you know, I enjoyed all the the exploration we did.
• 4:42
  SPEAKER_00: You know, we tried to break, you know, the kind of typical expectation, you know, you watch WALL-E, right?
• 4:46
  SPEAKER_00: I mean, they're kind of cousins of WALE in a way.
• 4:48
  SPEAKER_00: Of course, they have six legs and they operate very differently.
• 4:51
  SPEAKER_00: But as far as a yellow construction-related robot of a certain size, um, you know, that they're they have things to relate to in media and pop culture.
• 4:59
  SPEAKER_00: But of course, we wanted to move way away from the WALLE thing of trying to personify these things.
• 5:03
  SPEAKER_00: We wanted to anti-anthropomorphize these guys so they don't have a face of any kind.
• 5:08
  SPEAKER_00: We wanted to keep it a lot of like little cameras and sensors, a lot of little tools.
• 5:12
  SPEAKER_00: They don't even have a front or a rear end that is dominant.
• 5:15
  SPEAKER_00: It's probably, I think whichever three-quarter angle you see it at first, you could easily perceive that as being the front, but the other end is just as equally studded with sensors and different types of tools.
• 5:25
  SPEAKER_00: So I think it's in the movie that you could see it, you know, one of these guys doing doing a job and then spinning around in position so that it's what was formerly its butt end becomes the now operating end.
• 5:35
  SPEAKER_00: Um, and so anyway, we just leaned into all the potential of these kind of free form little dudes.
• 5:40
  SPEAKER_00: And there was a great sort of texture to have on our buildings in the aerial shots.
• 5:45
  SPEAKER_00: It takes a lot of them because they're so small, it takes a lot of them to be visually noticeable in these wide aerials.
• 5:50
  SPEAKER_00: But uh, you know, we got them in there, so they're crawling everywhere.
• 5:53
  SPEAKER_01: That's a really interesting balance that you have to strike because obviously, by and large, the robots in this movie are like many of the robots now, are biologically influenced, right?
• 6:03
  SPEAKER_01: So they do they are insectoid, as you said.
• 6:06
  SPEAKER_01: So you have to at once both make them biologically influenced, but also make them like as mechanically presenting as possible.
• 6:14
  SPEAKER_00: Totally.
• 6:15
  SPEAKER_00: Yeah.
• 6:15
  SPEAKER_00: I mean, everything we do on on uh on the tech side or the hard surface side on Avatar, you know, as anybody can tell, it's always like detuned from the most sci-fi, most futuristic version that could be, right?
• 6:27
  SPEAKER_00: Um, you know, obviously we all have have uh computers in our pockets that look like slabs of abstract glass, right?
• 6:34
  SPEAKER_00: This is this is where technology is really headed.
• 6:36
  SPEAKER_00: Um, but as a you know, as a kid who grew up watching 1980s movies, some of them being Jim Cameron's, I became familiar with his aesthetic from the power loader and other things like that.
• 6:45
  SPEAKER_00: That leaning into kind of hardcore industrial stuff, um, A makes things feel much more real.
• 6:51
  SPEAKER_00: B is sort of timeless because there's there's a certain look to very, very functional things, whether it's stuff in a space program or stuff on an oil rig or stuff that's used for manufacturing.
• 7:00
  SPEAKER_00: Anything that's not consumer-facing has a kind of a vibe to it that's that for people like me is really cool.
• 7:06
  SPEAKER_00: And if you can lean into that, um, then you won't fall into kind of sci-fi tropes of trying to be trying to be futuristic too hard, right?
• 7:14
  SPEAKER_00: Um, I mean, we did things that, you know, that that are geeky, you know, like adding carbon fiber patterning on certain elements of our designs.
• 7:22
  SPEAKER_00: The scale suit is meant to be completely carbon fiber in terms of its cowlings, and you can see that very subtly in certain places where the military paint job doesn't cover it up.
• 7:31
  SPEAKER_00: You know, we just we're we're nerds and we we we lean into the sort of like, you know, whatever, poor man's ignorant version of being really aware of how engineering works.
• 7:39
  SPEAKER_00: You know, we we do our best as kind of fanboys or fangirls of this kind of thing.
• 7:44
  SPEAKER_00: Um, I'm sure we get a lot of it wrong, but at the same time, I'm sure we're inspiring people who really work in the field as well uh with the things that we do.
• 7:51
  SPEAKER_00: So it's a good balance.
• 7:53
  SPEAKER_01: So you're not calling up MIT to have them consult on like the specifics and the physics of a robot.
• 8:01
  SPEAKER_00: We don't.
• 8:01
  SPEAKER_00: I mean, I would say we we we typically call up experts um in some in certain categories.
• 8:06
  SPEAKER_00: It tends to be medical graphics, to be honest, where we call up experts.
• 8:09
  SPEAKER_00: So when we needed to show how the link system would work with coordinating two different brains to come into synchronicity, right, in the first avatar, we consulted with neurologists then like what would the activity patterns look like?
• 8:21
  SPEAKER_00: What is the correlation and what's the jargon we could put into our motion graphics of what these parameters are that are coming closer together and finally into a full congruency link?
• 8:31
  SPEAKER_00: Um, and uh so we did it again with you know in Avatar 2, you saw a giant brain imaging system when spider's getting, you know, he's on the rack, you know, they're probing his memories.
• 8:40
  SPEAKER_00: We needed to know if someone's trying to probe your visual cortex, what would be the networks that would be active as you fight that?
• 8:47
  SPEAKER_00: And I'm getting totally off topic for your podcast, but you know, we we do go the extra mile in terms of research on things that I think we are at least familiar with.
• 8:56
  SPEAKER_00: I try to be a scientifically aware, but I'm I'm no neurologist.
• 8:59
  SPEAKER_00: So that stuff is very helpful.
• 9:00
  SPEAKER_00: Um, but uh for the mechanical stuff, I think it's a lot of research.
• 9:04
  SPEAKER_00: You know, it's either it's there's so many incredible YouTube videos out there, you know, all these companies that make robotics are are are doing a great job of promoting themselves, whether it's I I don't even know if I should name names, but anyway, the big the big companies that do great videos and and and experiments.
• 9:18
  SPEAKER_00: And so yeah, we watch these things.
• 9:19
  SPEAKER_00: And yeah, I think we, I mean, we most of us will have done that for fun anyway.
• 9:23
  SPEAKER_00: So so we didn't even have to lift a finger to to be relatively prepared.
• 9:28
  SPEAKER_00: And I think it's also just just like my co-designer Dylan, who handles all the organic stuff, the beautiful flora and fauna and all that, you know, he's a person who spent his whole life, like when he's in a natural environment, studying like the shape of a hillside and the bark of a tree and all these kinds of things that a geek like me, you know, or a geek for different things, um, you know, maybe just doesn't process the same way.
• 9:48
  SPEAKER_00: But I've spent my whole life like stopping at construction sites and staring at the equipment, looking at how the treads are linked together, like getting off on the patina of how mud gets spattered onto it.
• 9:59
  SPEAKER_00: I mean, this is weird shit, but this is literally what qualifies you to do the job.
• 10:03
  SPEAKER_00: Um, and so you're leaning into a lot of your kind of background knowledge and passion.
• 10:08
  SPEAKER_00: So these little bots needed to be insectile or insectoid, but they needed to look like construction equipment.
• 10:13
  SPEAKER_00: And I know what that looks like.
• 10:14
  SPEAKER_00: So we had to keep some of the forms a bit boxier in addition to the more insectoid kind of curvy shapes.
• 10:19
  SPEAKER_00: You're always trying to find some kind of form language balance so that the eye, the eye sees both things at the same time, right?
• 10:26
  SPEAKER_00: You don't want the eye to fall down a black hole of like, oh, I entirely understand that's a is is that even a bug?
• 10:31
  SPEAKER_00: Like, is that a big bug?
• 10:32
  SPEAKER_00: What am I looking at?
• 10:33
  SPEAKER_00: Or, oh, that's boring and that looks like something I saw on my street yesterday.
• 10:37
  SPEAKER_00: You've got to find that really cool balance.
• 10:39
  SPEAKER_01: Something that bears mentioning is that the vast majority, if not every single like piece of technology that we've seen in the films so far, is a military piece of technology.
• 10:51
  SPEAKER_01: And obviously, like one of if again, if not the key through line through all of these films, is this conflict between military, um, you know, but also this like urbanization, this the desire to build and the natural world.
• 11:04
  SPEAKER_01: So it it is that's a big part of the reason why it is really important to not personify these robots.
• 11:11
  SPEAKER_00: Totally.
• 11:12
  SPEAKER_00: Extraction is a word that comes to mind also.
• 11:14
  SPEAKER_00: It's like a lot of the stuff we do, whether it's a horrifying drill that we design that goes up into the poor Tolkoon's brain to take out the Amrita and Avatar too.
• 11:22
  SPEAKER_00: And um, we look at everything on Avatar, whether it's a fish or whether it's the way that we build a Navi hut, which we, of course, we call a Marui, we have a Navi word for it.
• 11:32
  SPEAKER_00: Everything has to be designed as if it's real.
• 11:34
  SPEAKER_00: The thing that rings in our minds as we get into discussions with with Jim is like, okay, what would this really be?
• 11:39
  SPEAKER_00: You know, it's not kind of like what's the coolest thing we can think of.
• 11:42
  SPEAKER_00: It's like, what would this really be?
• 11:43
  SPEAKER_00: So the Marui has to have a whole bunch of fabric lashed up over the roof that we're never going to see unfurled, but it's for hurricane season.
• 11:51
  SPEAKER_00: We put those kinds of designs into it because Jim insists that you think through the life cycle, whether it's a creature that has to feed a certain way, whether it's a machine that needs to be refueled, maintained, rearmed, right?
• 12:02
  SPEAKER_00: Like we put the details in that allow you to see that that the thing has a life beyond the film, beyond the screen.
• 12:08
  SPEAKER_00: If each of us in our different creative departments, including costumes, including everything, if we all do that job really well, it just gives these movies like a verisimilitude that I think is maybe maybe not consciously available to the audience, but certainly subconsciously underpins the story as being like real.
• 12:24
  SPEAKER_00: Like you feel like you've gone on an actual journey to an actual place.
• 12:27
  SPEAKER_00: Pandora's real.
• 12:28
  SPEAKER_00: Therefore, I care about it more.
• 12:29
  SPEAKER_00: Therefore, it's the threat to it is that much more you know sinister.
• 12:33
  SPEAKER_00: Um, and for me, doing the human designs, um, which by the way isn't all just about death machines, I do a lot of scientific related stuff with motion graphics and things where I actually try to like like use high tech to sell the beauty of the planet, to be the beauty of the biology and all that, which is a fun other kind of you know, sort of lens on the tech side of things.
• 12:52
  SPEAKER_00: But um, you know, in my in my world, I'm trying to make it all feel real so that in some sense it's relatable.
• 12:58
  SPEAKER_00: Like it's very easy for a person to watch a Star Wars, right?
• 13:00
  SPEAKER_00: And I'm not I'm not shitting on Star Wars by any means, it's the most brilliant design, you know, world ever.
• 13:06
  SPEAKER_01: Star Wars doesn't need your support, they're doing fine.
• 13:09
  SPEAKER_00: They're doing okay, exactly.
• 13:10
  SPEAKER_00: Yeah, yeah.
• 13:11
  SPEAKER_00: Um, but if you can't think like, oh, that could be me.
• 13:13
  SPEAKER_00: Like looking at a stormtrooper that flies in a giant triangular ship and whatever, it's not it's not immediately relatable.
• 13:20
  SPEAKER_00: My hope, as the guy that does the human stuff, um, is to make it almost like oof, like you can almost see us, you can see yourself, you know, in in what the humans are and what they're doing.
• 13:30
  SPEAKER_00: Um, you know, if if if if anyway, it's it's very much a reflection of what we're doing every day on Earth, right?
• 13:36
  SPEAKER_00: I mean, that's just a fact.
• 13:37
  SPEAKER_00: So the more I keep it looking kind of like that, it reminds you that wait a minute, like you don't be don't be so proud of yourself that you side with Jake Sully and the Rebels, because the minute you leave that theater, you're contributing, you actually work for the RDA, most likely, in some metaphorical form or another.
• 13:52
  SPEAKER_00: You know, you're contributing to a society that is doing all these exploitative things right now.
• 13:56
  SPEAKER_00: I mean, and we don't try to jam it down the viewer's throat, but that's that's the the backstory.
• 14:01
  SPEAKER_01: I suspect sort of another line that you have to walk again is somebody who's like, as you said, like a you know, a deep nerd or a deep geek about a lot of the stuff is like like how much time you want to spend on a specific project.
• 14:15
  SPEAKER_01: Um, again, you know, between the first infamously, there was quite a bit of time between the first and the second, but between the the the second and third, you know, it was just it was just three years.
• 14:24
  SPEAKER_01: You know, there's all this lore built up around some of the systems that you sent to me.
• 14:28
  SPEAKER_01: Obviously, there's like the video game, there's the theme park, so you do have to accommodate for other aspects of this world.
• 14:34
  SPEAKER_01: But there is a possibility that you could like potentially spend too much time developing and thinking about any given system.
• 14:41
  SPEAKER_00: For sure.
• 14:42
  SPEAKER_00: I mean, look, it all has to serve the story.
• 14:44
  SPEAKER_00: And I've, you know, it's with disappointment that I found that the you know, the story function that the human tech serves in these films, you know, has become uh maybe a little a little more constrained over time.
• 14:55
  SPEAKER_00: You know, it doesn't take a lot of screen time, let's just say, to convey that the RDA is back and kicking ass and doing terrible stuff.
• 15:00
  SPEAKER_00: And so, yeah, there's points at which maybe we've gone a little far given the screen time, but you don't, A, you don't know that in advance, right?
• 15:06
  SPEAKER_00: You don't know what the final cut's gonna be.
• 15:08
  SPEAKER_00: I mean, there's giant things that get cut out of these movies that they're like heartbreakingly deeply imagined, and even things that got photographed and whatever that get cut out.
• 15:17
  SPEAKER_00: So, you know, you're still trying to design for the world, but of course, keeping the story in mind.
• 15:22
  SPEAKER_00: I mean, you know, I'm focusing on the you know, the story aspect of things, like the scale is an important design, you know, not just because, oh, wouldn't it be cool if the troopers had like these exoskeletons as a way to upgrade them?
• 15:33
  SPEAKER_00: That's cool, right?
• 15:34
  SPEAKER_00: But the real reason they're there is because you need someone who can relate to Navi.
• 15:38
  SPEAKER_00: You need basically Navi-sized entities that will fight Jake Sully on the tilting deck of the sea dragon in Avatar 2.
• 15:44
  SPEAKER_00: You need these characters that can wrangle and capture Navi, right?
• 15:49
  SPEAKER_00: Um, so it's a very, very pragmatic decision for the story, you know, just to give one example.
• 15:53
  SPEAKER_01: That was something that I was thinking about as well, because obviously, to a certain extent, up to this point, we've been talking about these autonomous systems, but you also alluded to obviously aliens very famously.
• 16:04
  SPEAKER_01: You know, we all have this image of Ripley in the mech suit, and that's carried on over here.
• 16:09
  SPEAKER_01: Mechs, you know, these human pilot suits play like a really big part in here.
• 16:14
  SPEAKER_01: And from a storytelling perspective, it makes a lot of sense to have uh a mechanical suit where where a human being is present.
• 16:22
  SPEAKER_00: Totally.
• 16:22
  SPEAKER_00: Humans are puny compared to Navi, right?
• 16:24
  SPEAKER_00: So certainly the amp suit needed to be something that I mean, uh not Jake Sully's like nine feet tall or something or something around there.
• 16:31
  SPEAKER_00: We ended up doing a slight rescale of the characters for the sequel.
• 16:34
  SPEAKER_00: So he's a little shorter than he used to be, but he's around there.
• 16:37
  SPEAKER_00: Um, and uh, you know, yeah, obviously the amp suit with Korichin, it was meant to be an overwhelming opponent, right?
• 16:42
  SPEAKER_00: Something that that it takes basically Natiri and Jake and that poor Thanator that ends up dying.
• 16:48
  SPEAKER_00: Um, you know, it takes all of them to take on this thing.
• 16:50
  SPEAKER_00: Um, but but uh we needed a more kind of apples to apples, you know, even fight element for the sequels.
• 16:56
  SPEAKER_00: And that's where you know Jim came up with the idea of this of the scalp.
• 16:59
  SPEAKER_00: Um but but obviously there's there's a lot of like to get geeky, there's a lot of specifics to the way that a human drives these different vehicles, right?
• 17:07
  SPEAKER_00: That the actual interface for the driver, um, which and it and that's ends up important for the story because you're gonna see it, like literally, like when Korich is fighting Jake and holding a knife and whatever, you cut to the inside of the cockpit, and there he is, pantomiming essentially, but in the haptic interface that's in that glove and theoretical way it works in the movie, he can feel the grip of the knife in that hand.
• 17:27
  SPEAKER_00: And so giving the actor an opportunity to act and emote and perform the actions of this robot and to have those things correlate in some way that reads well for the audience, um, and yet still work within the constraints.
• 17:39
  SPEAKER_00: Like, I don't think there's enough room in that cockpit for him to throw a really long punch as an example.
• 17:44
  SPEAKER_00: I just don't think you could.
• 17:45
  SPEAKER_00: You'd hit the glass, right?
• 17:46
  SPEAKER_00: So there is there is a non-one-to-one um kind of ratio gearing, so to speak, of how he's controlling the robot.
• 17:54
  SPEAKER_00: And we ran into the same things on the uh designing the scale suit.
• 17:57
  SPEAKER_00: The kinematics of the scale suit were a big pain to figure out.
• 18:00
  SPEAKER_00: And we started off with different versions of it and kind of evolved to where we are, because unlike with, well, I guess maybe with both, you know, in a wide shot, even as exposed as the operator is in a scale suit, the eye doesn't pick up on the human and then and then move on to the scale.
• 18:15
  SPEAKER_00: The eye picks up, and it's this is just evolutionary biology, whatever the hell, picks up on the biggest silhouette and sees that as the body, right?
• 18:22
  SPEAKER_00: So essentially, you know, in terms of how we rig it and the way that it's rendered in the in the final uh setup, you know, we of course capture, we capture people and then map that motion onto the scale, right?
• 18:33
  SPEAKER_00: So that the scale's behavior is closest to the performance of the actor.
• 18:37
  SPEAKER_00: And then the little human body that we see visually is actually, in some sense, going along for the ride.
• 18:41
  SPEAKER_00: It's being puppeteered from the outside in.
• 18:43
  SPEAKER_00: But figuring out the ratios and angles and stuff and the connection points of the operator to the scale to make that look good, to where if I hold up my arm at, you know, like this, the scale throws up.
• 18:54
  SPEAKER_00: It's totally differently proportioned arm with a much longer forearm and all this kind of stuff.
• 18:58
  SPEAKER_00: It's it's you need those angular relationships to look the same, like in an instant read, and then it looks great.
• 19:04
  SPEAKER_00: But when those angles were different, it looked, it looked terrible, right?
• 19:07
  SPEAKER_00: So we ended up, you know, Jim wanted to do something a bit more like the power loader where the hands uh would grip something that was attached to the forearm of the scale.
• 19:14
  SPEAKER_00: And it's what ended up happening is when the scale did any, it was like putting suspenders on the scale's arms, right?
• 19:20
  SPEAKER_00: When it put its arms up to do anything at all, the person ended up like as if they were on an exercise machine in this crazy Y pose.
• 19:27
  SPEAKER_00: It looked terrible, right?
• 19:28
  SPEAKER_00: So we had to go back to what worked for the AMP suit and put a Waldo system onto the scale driver.
• 19:33
  SPEAKER_00: So they actually are wearing a very lightweight, articulated Waldo system with you know haptic gloves that are a little slimmer and more sophisticated than what's in the amp suit, but uh not dissimilar in terms of how they function.
• 19:44
  SPEAKER_00: And the actors weren't wearing very much.
• 19:46
  SPEAKER_00: So what they were wearing for photography is basically that apparatus because it's so closely tied to their body.
• 19:52
  SPEAKER_00: It doesn't constrain them, but I think it's good for them to be aware of the collisions and all that all that kind of thing, and maybe some shadow casting elements that we kind of have to attach to them off of a back rig so that like there's a if it's a sunlit scene, like when Ardmore's walking in her scale in Avatar 2, it's a morning construction site kind of a vibe, right?
• 20:09
  SPEAKER_00: So it's diagonal sun coming.
• 20:11
  SPEAKER_00: We needed to have something that was moving with her that would block that sun.
• 20:14
  SPEAKER_00: But most of the time it's bare bones, it's stripped down to just the uh this apparatus, you know, with kind of a harness and a wall loom.
• 20:20
  SPEAKER_01: It sounds like you're saying that there are examples where you know it actually gets to the point where you're in production, you're doing shooting, you're looking at these actors doing the scenes, the actor looks silly, so you actually have to go back to the drawing board and redesign the You try to predict that stuff in advance.
• 20:35
  SPEAKER_00: You're basically doing tests, you're doing mock-ups with foam core, and and you know, you're doing you're doing stuff in with the cheapest possible methodology to discover these problems up front.
• 20:44
  SPEAKER_00: The crab suit, right, has its own Waldo system, which is a weird one that's kind of inside out in the sense that it's in front of the operator instead of behind.
• 20:51
  SPEAKER_00: I'm giving you some cool photos of how neat that thing looks and how the hand system articulates with kind of joystick, but then a three-finger articulator is because it's a three-fingered crab, right?
• 21:01
  SPEAKER_00: So you don't need all five fingers represented in a glove system.
• 21:04
  SPEAKER_00: We mocked that up in plywood to begin with.
• 21:06
  SPEAKER_00: Um, and there's all kinds of things you discovered, like the degrees of freedom that you thought would work.
• 21:10
  SPEAKER_00: As it turns out, like it binds, you know, and it still kind of does a little bit in the final one, but we were able to re-engineer the pivots and the lengths of elements using the human body, sitting on a piece of plywood that that, you know, it's held together with with uh you know, like really simple hardware, um, so that we could make sure the person could do.
• 21:27
  SPEAKER_00: Let's just say we have a scene where there's a knobby on top of the back of a crab suit.
• 21:32
  SPEAKER_00: There is one in Avatar 3 coming, and the and the guy is trying to get this character off the back of it, right?
• 21:37
  SPEAKER_00: Well, you know, you the scene is about not being able to do it.
• 21:40
  SPEAKER_00: So the fact that the waller constrains the motion actually suits the story, but but at least the actor is able to do something that feels appropriate to kind of this this crab thing trying to swat at its back carapace area, you know.
• 21:53
  SPEAKER_01: As much as possible, you're trying to develop these systems and finalize them before the actual Acting happens and Yeah, we have to.
• 22:02
  SPEAKER_00: It's too late to fix stuff on the day.
• 22:03
  SPEAKER_00: If you if you fix fix stuff on the day, you're burning daylight and you're yeah, you're you're in big trouble.
• 22:08
  SPEAKER_00: Daylight such thing.
• 22:09
  SPEAKER_01: There's the issue of burning daylight, but I'm also curious, like from an actor's perspective, like how do you work with them and how closely do they actually have to study your designs to know how to act within a mech suit?
• 22:22
  SPEAKER_00: Well, that's a great question.
• 22:23
  SPEAKER_00: And it leads into the fact that we have a pilot's manual for the crab suit, because that was a less intuitive setup, I think, than the AMP and the scale, which are much more humanoid in the way that you're relating to the to the mech.
• 22:34
  SPEAKER_00: Um, you know, but I'll go back to that in a second.
• 22:36
  SPEAKER_00: I mean, I think in terms of the the scale uh is very lightweight and very free and doesn't bind you.
• 22:43
  SPEAKER_00: And I don't think you need to give the actors a whole lot of of uh you know kind of uh input on how to use that system.
• 22:51
  SPEAKER_00: The only thing we do have to do is the leg comes up fairly high.
• 22:54
  SPEAKER_00: It's like got a high hip position, the robotic leg.
• 22:57
  SPEAKER_00: And so we do have to put basically like holster-like things on the actors just so they don't put their arm through that, right?
• 23:03
  SPEAKER_00: Because otherwise you just you wouldn't stop your arm, you wouldn't be aware.
• 23:06
  SPEAKER_00: Um, and also it's cool because when you know that it's there, there's a sort of putting a hand on the hip thing that that Ardmore does where she's like casually putting her hand on her hip, but she's putting her hand on the robot's hip, right?
• 23:16
  SPEAKER_00: Which, so in other words, her hand is floating in space, but we put an object there so she would know uh where to grab it.
• 23:22
  SPEAKER_00: The amp suit.
• 23:24
  SPEAKER_00: I wasn't around for photography on the amp suit and on the first movie because I wasn't a production designer.
• 23:28
  SPEAKER_00: I didn't go down to New Zealand and see any of that stuff.
• 23:30
  SPEAKER_00: You know, I'm sure that Jim did a great job coaching slang on how to be cool about it.
• 23:35
  SPEAKER_00: They probably had to rehearse it and play around with it a little bit, you know, to like, you know, the idea that he pushes a little button, but like in this emphatic way and a little light turns on, you know, to kind of activate the arms.
• 23:44
  SPEAKER_00: I'm sure that was probably figured out to some extent on the fly, you know, and some maybe some poor guy had to figure out how to turn that light on and off on command because it was just rigged to be on, like, oh crap, you know.
• 23:54
  SPEAKER_00: So some electrician or you know, lighting technician maybe, maybe had some stress.
• 23:58
  SPEAKER_00: I'm not sure.
• 23:59
  SPEAKER_00: As far as the crabsuit, we made the manual knowing that we wouldn't always be there.
• 24:02
  SPEAKER_00: The people that use crabsuits are not the lead actors, right?
• 24:06
  SPEAKER_00: We don't have like dialogue scenes around the apparatus the way we did with slang on the first movie.
• 24:10
  SPEAKER_00: And so we did that knowing that we wouldn't be there to kind of encapsulate the knowledge.
• 24:14
  SPEAKER_00: So we give that to the assistant director and her department.
• 24:17
  SPEAKER_00: We give it to our art directors who might be on set, just hoping that the cultural knowledge kind of flows through, you know.
• 24:23
  SPEAKER_00: Um, you know, the way that the movie's cut, it's some of the subtleties, it would be easy to miss them anyway, but we wanted to have a good system.
• 24:31
  SPEAKER_00: Part of what we had to think about is the fact that Mr.
• 24:33
  SPEAKER_00: Krabby Pants has uh you know more legs than a person does, right?
• 24:38
  SPEAKER_00: So in the amp suit, even though we've never really addressed what the hell's going on with the legs in the amp suit in terms of control, the presumption is that there's something that might be analogous to two legs controlling two legs, right?
• 24:48
  SPEAKER_00: So there's some pedals or there's something down there that you're using to walk around with, which of course doesn't work when you've got four legs on the vehicle.
• 24:54
  SPEAKER_00: So we came up with the idea that it's kind of like you're riding a creature, right?
• 24:57
  SPEAKER_00: So uh imagine that you're riding a horse and you have big robot arms kind of strapped in the front of that horse.
• 25:02
  SPEAKER_00: So your legs are going to be telling the creature where to go, along with some control sticks and stuff that are built into the end effectors.
• 25:09
  SPEAKER_00: But uh your arms are directly controlled as opposed to the indirect control.
• 25:12
  SPEAKER_00: So we built different paddles and levers and stuff into the leg area of the seat so that you actually use like the same way that you might use your knee as to put pressure inside of a horse to make it move away from pressure.
• 25:23
  SPEAKER_00: Uh that's exactly how you do it, Grabsuit.
• 25:25
  SPEAKER_01: Unfortunately, we're coming up on time right now.
• 25:28
  SPEAKER_01: Um, but but but looking at your CV, you know, you've worked on all these amazing films with these very iconic directors.
• 25:34
  SPEAKER_01: Um, you know, three of the big ones that come to mind are the Transformer series, Prometheus, and Avatar.
• 25:41
  SPEAKER_01: So, you know, we're talking about Michael Bay there, uh Ridley Scott, and James Cameron.
• 25:45
  SPEAKER_01: Compared to uh the other two, um, like how and and this is coming from having like just watched these two documentaries and again a through line through all of them is like James is really involved to a fall with like every part of production.
• 26:01
  SPEAKER_01: How involved is he with um the actual sort of designing and the execution of the like mechanical and robotic part of the design?
• 26:11
  SPEAKER_00: I think his level of involvement is always there in super laser detail in the sense of you know looking at the designs carefully and perceiving whether they feel legitimate and feel real or not, right?
• 26:24
  SPEAKER_00: Um then when that doesn't go right, he has to get more involved.
• 26:28
  SPEAKER_00: You know, I mean we've certainly put designs in front of him where, you know, there was certainly moments on Avatar One where like people would get the full the full boar scrutiny into, okay, tell me what this detail on this helicopter does.
• 26:40
  SPEAKER_00: Like, what is that?
• 26:40
  SPEAKER_00: What is that?
• 26:41
  SPEAKER_00: What is that?
• 26:41
  SPEAKER_00: And I think he did that to kind of shock in all the art department into, oh God, all right, look, we got to take this seriously.
• 26:46
  SPEAKER_00: We're working for a frustrated engineer who knows how to fly a helicopter, you know, so you better know what cyclic means and like all this kind of stuff, you know.
• 26:54
  SPEAKER_00: So so he established a standard.
• 26:56
  SPEAKER_00: I would say that, you know, does he go into the nitty-gritty of like every little detail anymore?
• 27:01
  SPEAKER_00: No, but if we're doing our job, he shouldn't have to do that.
• 27:04
  SPEAKER_00: I mean, and and he he often doesn't.
• 27:06
  SPEAKER_00: When something is problematic or you know, just because we haven't quite solved it, or uh there's something that's that's a high concept element of the script that really needs to get conveyed.
• 27:16
  SPEAKER_00: Like in other words, this design needs to convey story.
• 27:19
  SPEAKER_00: And this is true of even the holograms that I mentioned, right?
• 27:21
  SPEAKER_00: Like he will beat up those holograms just like he would any piece of mechanical design, because in some senses, often they're more important to convey to the audience what's happening right now.
• 27:30
  SPEAKER_00: Like we're telling the story of how this crazy link system works to the audience and Avatar One.
• 27:35
  SPEAKER_00: It has to be simple enough, that's to look cool, but it has to be simple enough and clear enough in how it's visually presenting that stuff to communicate clearly to the audience.
• 27:42
  SPEAKER_00: And so I think I think he probably comes at it more like that.
• 27:44
  SPEAKER_00: I mean, I think he's got enough trust in uh, you know, me and other nerds that that uh you know work so with such passion in the uh live action art department.
• 27:53
  SPEAKER_00: Fausto De Martini is some a name I can mention that Jim is he loves Fausto.
• 27:57
  SPEAKER_00: Anyway, Fausto has his hands into many, many, many of these designs go as we've gone into the sequels.
• 28:02
  SPEAKER_00: So we have it easy sometimes.
• 28:04
  SPEAKER_00: You know, if it looks really damn cool and we've clearly done our homework, then it it's gonna be okay.
• 28:10
  SPEAKER_01: Yeah, well, Dan, it's been an absolute pleasure, and uh we'll I guess we'll see in a few years when Avatar 4 comes out.
• 28:16
  SPEAKER_00: Sounds good.
• 28:17
  SPEAKER_00: Alrighty, cool.
• 28:21
  SPEAKER_01: Thank you so much to Ben.
• 28:23
  SPEAKER_01: Thanks to Disney, thanks to the Avatar team for setting that up.
• 28:26
  SPEAKER_01: Thanks to Jim.
• 28:28
  SPEAKER_01: I feel like I can call him Jim now after that conversation, right?
• 28:32
  SPEAKER_01: Ben.
• 28:33
  SPEAKER_01: Don't forget to like and subscribe for more robotics content.
• 28:37
  SPEAKER_01: And please subscribe to the automated newsletter over at automated.fm.
• 28:42
  SPEAKER_01: And we will see you next week for another episode of Automated.