Latest / Bad Decisions Podcast / #2 The Ultimate Guide to Motion Capture | Bad Decisions Coffee Break
Transcript
- 0:00So, excited for this episode, where I hold on, hold on, hold
- 0:02on, hold on, hold on, hold on. Let's do this.
- 0:06Let's go. You get up.
- 0:09Hmm. White drinking like ticular.
- 0:10You know, like I've learned shot, this shot, man, we're
- 0:14drinking the East Africa, dark, roasted a baby thought I was his
- 0:18favorite. It is because we pull so well
- 0:20from it power. Doesn't like it that much not
- 0:22mine, definitely because it doesn't give you enough energy.
- 0:24Yeah, so I don't feel that much with it but it's good.
- 0:28Welcome everybody to this. The second episode of bad
- 0:31decisions coffee break. That's today, we are gonna talk
- 0:34about motion capture. Yes, the ultimate guide for
- 0:39motion capture for everybody watching, specifically artists.
- 0:44So today we are going to focus on body motion capture although
- 0:47on the table we have some props which don't call the props Man
- 0:511. What do you call all my sexy
- 0:54equipment props? These are your highest Motion
- 1:00capture, of course, they're not necessarily for the ones we're
- 1:03talking about today, but right here, in front of us, we have
- 1:06the face, good facial helmet. This captures motion capture for
- 1:11the face, not sponsored the podcast.
- 1:12Oh no, and on the right and left side, you're looking at the
- 1:18Rococo, smart gloves, which capture your hand motion.
- 1:22The reason we don't have the suit behind us right now,
- 1:24because we have no space to put it on, I mean, we should but we
- 1:28could have hang it somewhere actually.
- 1:29And This is the yeah this is the face notices.
- 1:32The full, what is it called? Actually the yes Marshall Pro.
- 1:36In this episode, we will be breaking down.
- 1:38Exactly what is motion capture and why you should care.
- 1:42We are going to cover a bit. A bit of history of motion
- 1:45capture, and different types of motion capture.
- 1:47Also, we are going to evaluate every single one of them and
- 1:50hopefully, by the end of this video, you will know which type
- 1:54will suit you best. They are, you are a newbie who
- 1:56wants to jump into motion capture or you are a small
- 1:58Studio like us. And Reason why this episode is
- 2:01super important and I'm going to stress this a lot because we've
- 2:06done so much research in the past few months, my finals.
- 2:09Well, the I have literally killed myself and me and and far
- 2:13had while doing all this research with the bad decisions
- 2:17Team every freaking day every night for weeks.
- 2:20On end, trying to find out what is the best solution for facial
- 2:24capture. What is the best solution for
- 2:26body capture? Which one is more affordable,
- 2:29which one is is more feasible and which one is more efficient,
- 2:33which one is more, which one is going to come out with a higher
- 2:36Fidelity of Animation. All of these data that we
- 2:39consumed over the past few weeks.
- 2:41We've now tried to put it all into one 30 to 45 minutes and
- 2:46podcasts. And hopefully it's 45 minutes
- 2:48and we're going to just feed you all of that information and
- 2:52hopefully, like fire set by the end of the, the episode, you'll
- 2:55find out exactly what's the right solution for you.
- 2:58You can imagine that he was Researching for 3-4 hours every
- 3:02night. And I had to listen for out
- 3:04this, our understanding, I had to listen for the summary every
- 3:07morning, if I don't care who's this, feel how accurate this
- 3:10look at it, we can. And the best part is all these
- 3:13more caps, different types, they are very different in terms of
- 3:16different categories. The pricing ranges from a few
- 3:19thousand to like, no, no, we're talking about free and enjoy a
- 3:23hundred thousand. Yeah.
- 3:25So it's the red and it's very confusing for someone like me
- 3:28who not Not really a treaty artist.
- 3:31I mean, I worked with a lot of 3D stuff, but understand the
- 3:34whole thing and to know how to make decision for our studio.
- 3:37Yeah, so I think this episode will help everybody.
- 3:40Yes. So let's start with the basic.
- 3:42Okay. What is motion capture or
- 3:44probably you heard the word mocap mortgages like for motion
- 3:47capture. So this is a technology to
- 3:50transfer all the movement information from a real person
- 3:54to a computer-generated character.
- 3:56Yeah, so an example that I think everyone would be familiar with
- 4:00Stannis in the Avengers and game.
- 4:02Yeah, Josh Brolin was doing the movements, they captured it and
- 4:06movement, moved it to the character that he plays.
- 4:09Yeah. Or if you are a gamer and you
- 4:11can see it, you can see sort of his face.
- 4:14In fact, everything is. Yeah, that's that's when you see
- 4:16a good motion capture. As you can see, Josh Brolin in
- 4:19the character even though it's not him.
- 4:21It's a city actions, the movements, everything.
- 4:23It's like an exact replica, what he was acting.
- 4:26And honestly, that's an amazing example, because I feel like a
- 4:29lot of Of people might have been a marble lands.
- 4:32Yeah. Might have known a lot of people
- 4:33might have been exposed to mocap, but they are not aware
- 4:37yet. They've watched mocap like let's
- 4:40just not even consider video games, like so many.
- 4:43Yeah, if you are, if you are not a guy who watches movies like
- 4:46video games, like God of War. Yeah.
- 4:49Last a lot. Yes, of us.
- 4:50The last was all those zombie fighting scenes like, most of
- 4:54these are mocap. And I mean, I'm not going to
- 4:56even talk about the games today. These are games that belong to
- 4:59like, Couple of years ago. So motion capture has been
- 5:01around for a long time. But what are the other examples?
- 5:04I mean, the biggest example, I think the top movies all time
- 5:07Avatar. Oh yeah, that's a second way.
- 5:09Certainly, the whole movies done with and that's okay.
- 5:13I would say, James Cameron the director of Avatar.
- 5:15Who was born in 16 August, same days as me, Donald Until I keep
- 5:22having that in my mind that he was.
- 5:24But yeah, I thought I screen on, both of them have the same
- 5:27birthday have 17 August just a day after I doesn't mean I'm not
- 5:30as good as you mucking you guys. Okay.
- 5:33No, but he I think really made a revolution in the whole motion
- 5:38capture industry. I afford the first avatar, he
- 5:40was waiting for 10 years for the technology to evolve because we
- 5:43always had a body motion capture but to get the motion capture
- 5:46for face. Yeah.
- 5:47It was very difficult to get the emotion and all these small
- 5:50muscles How they Flex. So for the second avatar, he did
- 5:54under the water, I'm like, wow, even for the second avatar, he
- 5:56had to wait three years and that's a lot of the
- 5:59Technologies. So we were looking at some
- 6:01footage as last night together of documentary interviews with
- 6:06James Johnson, ye behind the scenes for Avatar one and how
- 6:10they went through these essentially like motion-capture
- 6:13developments. And what was so crazy is looking
- 6:15at the software's. They look old like, yeah, they
- 6:18looked so much like 12 years ago.
- 6:21I cannot believe like the things we're going to be talking about
- 6:24today. These he has had it 12 years ago
- 6:26and let's just say half of these things that we have today is
- 6:29thanks to people like him developing because they
- 6:32developed the technology as they were figuring out, okay?
- 6:36How do we capture the face emoji, when emotions with such
- 6:40high fidelity or the body? And so, for all these movies,
- 6:44they started working on creating these Technologies and improving
- 6:47them every single time. And the best part is it used to
- 6:51be only available to the movie studios.
- 6:53Oh yeah. How small Studios like us can
- 6:55have access to motion can do our.
- 6:57That is exactly why we're having this conversation today.
- 7:01Because five years ago, this fucking conversation wouldn't
- 7:04happen. Like none of you guys watching
- 7:06and US, probably, I'm assuming that you guys are like if
- 7:09someone from Marvel is watching who can afford it.
- 7:12Yeah, you can. But just generally speaking for
- 7:15the majority of us, we wouldn't be able to even afford or get
- 7:19close to a motion capture system.
- 7:21But nowadays, they're so accessible so affordable.
- 7:25So easy to use that. Everybody can use them and and I
- 7:29just believe it's going to help the animation and film industry.
- 7:32And just any artist doesn't even have to be in film and
- 7:35animation. It's going to help you guys
- 7:36music videos games. All these things everything.
- 7:39Yeah, Sports health care, but again, that's not our main area
- 7:43of expertise. So we're going to be talking a
- 7:45lot about that, mostly, it's going to be related to 3D artist
- 7:48but generally speaking, it's so accessible.
- 7:50So you might just find your use case while watching this
- 7:53episode. So, what's next?
- 7:55So let's let's go up because last night, I Was preparing for
- 7:57this podcast is that you were doing.
- 7:59Yeah. I said you wanted to make sure
- 8:01you can keep up with me. Shut up, I'll say, but what I'm
- 8:04saying is, when I was looking at the history of mocha.
- 8:07Yeah, it was very interesting. I couldn't find a solid route of
- 8:10how it started, but there were a few examples which the first one
- 8:14started with healthcare industry.
- 8:16So the Physicians and doctors were measuring the movements of
- 8:19the body, the joint If you can imagine exactly, if you are
- 8:22doing a research of a guy walking and you want to measure
- 8:25like how they walk did the difference ratio between their
- 8:27knees muscles and the joints like the movement.
- 8:30Exactly. Line ization of.
- 8:31Yeah. So so it started with the
- 8:33healthcare industry and then only been to the other
- 8:35Industries, okay? Another very interesting story
- 8:38that I read was in the early days of Disney.
- 8:41So if you watch Snow White yeah so they watch that shit
- 8:44together. She's dancing with the seven
- 8:52dwarfs. Okay?
- 8:53That's in his hand animated, but the dance actually happened by
- 8:57a, by a, by a lady. And few guys were dancing.
- 9:00So, a person will dance. They will record it, and the
- 9:03other person will start doing animation.
- 9:05Let's see, that's how we even do animation nowadays.
- 9:07If you're manually animating anything, you usually, like, if
- 9:11you, if you want to do it right, you would record yourself doing
- 9:14that animation or you will find references and then just copy
- 9:17and great eye cream. So yes, I guess the idea.
- 9:20So they made us start it that way and then they were like
- 9:23looking for Technologies. And how can we make this faster?
- 9:25Like how can I do it myself and get that same animation without
- 9:28having to manually, keyframe it every?
- 9:30And honestly, sorry, I'm just gonna say this, this is one of
- 9:34the biggest reasons why we're having this conversation.
- 9:36Like, you just need to understand.
- 9:38The reason motion-capture exist for artists is because prior to
- 9:42motion capture, all of the animation needs to be manually
- 9:45done, which means you have to go keyframe by keyframe and If
- 9:51you're running, let's say a 60 frames per second animation,
- 9:54which is usually for video games, it's going to be really
- 9:56high 60 frames per second. That means 60 frames in a second
- 10:01and let's say you have 20 seconds of Animation, right?
- 10:04That's crazy. That's crazy.
- 10:05He frame every single almost every single frame, or you can
- 10:08go on twos, or threes. So, every two or three frames,
- 10:11that's a lot of Animation that needs to be manually done, which
- 10:14is why if you go to video game companies like riots, and I was
- 10:17watching a video about them animating these like, you know,
- 10:20Movements of the characters, like, yeah, standing and all
- 10:23that, they spent hours manually animating just like, literally
- 10:27just like the fast song in the just a state.
- 10:29Like, Wisconsin, I don't think the patient's, I don't have the
- 10:32patience II didn't when I first was learning manually animating
- 10:37Hannah animating, I hated it. But the moment you get how it
- 10:40works. It's such a peaceful process.
- 10:43It is a very peaceful process because you tried to move the
- 10:46joints around with the rig. And if the rig is done, right,
- 10:49it feels great. Now, Now I don't want to get too
- 10:51deep into that but just saying the reason, why motion capture
- 10:54for artists exist is to essentially save a lot of time
- 10:59and and increase realism because you can only get so close to the
- 11:04actual human motion when you compare it to the actual human
- 11:08motion that you can get some. Okay?
- 11:09Basically why we use motion capture is to reduce the time
- 11:13and effort. Yes.
- 11:13And also to have more realistic animation.
- 11:16Fun character. Almost.
- 11:17No, not even you can't you can't even say identical?
- 11:19Yeah right. Like All movement identical
- 11:21movie because if you because if you're not an artist, you
- 11:24probably never thought about this.
- 11:25But even the way you move your head your neck, right your
- 11:29fingers. Like there's so much random
- 11:31movement in all your joints heinie muscles.
- 11:34I need joints, especially face. Yeah.
- 11:35So manually doing all of that is going to take a lot of time and
- 11:38if you're not a good animator, if you're not listening to use
- 11:41the word good, if you're not experienced, its nautical,
- 11:44another look at you want. But when motion capture you can
- 11:47essentially have really great-looking.
- 11:50And even if you're not a great animator, let's put it that way.
- 11:54Yeah, so let's go back to our Disney story.
- 11:57So in the early days, they were, they were hand animating and it
- 11:59looking at an actual video. So, when it's been the
- 12:02technology started to come in the first movies, I think it was
- 12:04Terminator 2, and okay. So now I've started using some
- 12:08basic motion capture and then in the year 2000 this for like the
- 12:12robots. And so, yeah, and then they
- 12:14started using it for. So the very first Peter Jackson
- 12:17use it for the Lord of the Rings.
- 12:18Gollum you remember back actor? Yes.
- 12:21So so that was also one of the one of the most common is a
- 12:24early motion capture but one of the 100 Revolution because if
- 12:27you know the actor and the circus yeah he plays he's Villas
- 12:31all he's a bad guy. Yeah he like he's the go-to
- 12:34Mochi. I've got if he wants.
- 12:35Yes. Anyone wants to create yes.
- 12:37Caesar in the Rise of the Planet of Apes Gollum in The Lord of
- 12:40the Rings all played by him. Yeah.
- 12:43And one other good example not the same guy but Benedict
- 12:47Cumberbatch. Well, they drank my smoke.
- 12:49Yes. Yeah.
- 12:50Rings and if we look at Ya Hobbits, loaded Rings, sorry
- 12:54nerd. When you look at different
- 12:58different movies, tree, Lord of the Rings not the same.
- 13:04So when you look at these actors like that the the best part
- 13:08about these motion capture Technologies is you don't
- 13:10actually need to be an actual Dragon to act out a dragon.
- 13:14You can be human and act out a dragon and you can still get the
- 13:17animation and map it onto a dragon and he will work out.
- 13:20So Again, motion-capture uses those cases are a lot but back
- 13:23to the history. So yeah, no, I just wanted to
- 13:25cover it. Like how in the cinema, like we
- 13:28started this very basic like in the movies like Terminator
- 13:30RoboCop, then we went to Lourdes earrings, then we have Avatar
- 13:33and like now it's everywhere. Now you can see on YouTube
- 13:36people using it. You were to say the movie with
- 13:38the best. Mocap Avatar Avatar, right after
- 13:40one Avatar but I thought the second one was crazy.
- 13:43Second one has water. Yeah.
- 13:46Like underwater motion. You a very shitty way more than
- 13:49you. Look at the Find the scene.
- 13:51Because I would say, for a, for a normal movie.
- 13:53When you watch like the Agra, put another link but his
- 13:56description for behind us. Yeah, we'll put a few links and
- 13:59people had to imagine where they are and they have to imagine.
- 14:02How do you look for example, for Avengers to understand how tall
- 14:06Thanos is? They put a banner up, Josh
- 14:08Brolin's head and that was Tyler says with everybody does look.
- 14:12Yeah, I level is right. So, so a lot of tricks has been
- 14:15done, I think acting would be a bit more difficult.
- 14:18I mean, I'm not an actor, I wouldn't know, but it's It's a
- 14:21great achievement. I mean we're gonna find out.
- 14:23Yeah. Just received our Rococo smart
- 14:25suit Pro to. So we're going to be acting a
- 14:28lot with it so I guess we'll find out but we didn't watch the
- 14:31document and they were like it's quite liberating to act with
- 14:33most. Yeah, it's all about imagining
- 14:36things. Fact, I'm Gonna Act.
- 14:37I'm going to create a few characters and play.
- 14:39Follow us on our YouTube and Tick-Tock and Instagram like
- 14:42this. Winter is coming.
- 14:43Yeah. All of the social media
- 14:44platforms, we create a lot of content around the cool stuff.
- 14:47We create and motion capture just one of them.
- 14:49So if If you are interested in the things we're talking about
- 14:52today, you're going to see a lot of use cases.
- 14:54Yeah, buy ourselves. Some of them are actually
- 14:56already out. So just make sure you watch
- 14:58that. So, let's jump into the types of
- 15:01mocap. So the biggest question a person
- 15:03when they, okay, I understand what motion capture is but which
- 15:06one, there are thousands of different.
- 15:09Yeah, different kind are, we can categorize them into four
- 15:13categories? There's well, there's four main
- 15:15ones that were going to be talking about today, but of
- 15:17course, there are more that I am aware of and I will share one of
- 15:22them with you, but there's probably more that I'm not aware
- 15:25of, and you might know them just watching this video.
- 15:27But before that, we're going to be covering today are the ones
- 15:29that you probably need to focus on because the more, the great
- 15:32majority of people sort of fall into these four categories when
- 15:36they're trying to use mocap and all of them are different.
- 15:39All none of them is better than the other essentially.
- 15:42It just depends on which one is right for you and what you're
- 15:44going to do? What's your project like?
- 15:45Yeah. Yeah, exactly.
- 15:47So I'm going to talk about all the different four types.
- 15:50That we think motion-capture existing and these four start
- 15:55with your inertia suits, then the AI marker list, motion
- 16:00capture. Then we have the optical motion
- 16:03capture and we have the AI, markerless plus Optical on
- 16:08steroid that at that is a game changer.
- 16:10That is a the last category that we're going to talk about and
- 16:14found those, I've been rambling on and on about and I think he's
- 16:19planning to Bad decisions to do to get the equipment to prepare
- 16:23for that. Mark a yes I want to get us all
- 16:26of these for each actually be happier.
- 16:28We are going to show you guys what we have and what we've
- 16:29worked with and based on our own experiments as well.
- 16:32And we are going to tell you what we are planning to get in
- 16:34the next step because we would love to try different things.
- 16:38And to see which one fits because we want to do music
- 16:40videos. You want to do like short films,
- 16:42VFX a are augmented reality characters and all of them are
- 16:45very yeah. Use cases and see which one will
- 16:47fits best. Exactly.
- 16:48So let's start, let's start with the first.
- 16:50One inertia suits. Yes.
- 16:52So what is it with the name? You can already say that.
- 16:55Inertia means movement energy. So inertia suits essentially are
- 16:59wearable suits or sensors that you put on as the actor and that
- 17:05suit will capture your body movement transfer it to a
- 17:08software where it's processed. And then you can use that in
- 17:11your animation software of your choice.
- 17:14Now, how these actually work is using centers?
- 17:17And one of the most common, let's talk about the Rococo.
- 17:19So that we just showed you earlier.
- 17:20On is using, I mu sensors of these are your inertia
- 17:23measurement unit devices. And what's really cool about the
- 17:26IMU sensors is these things have three different things and I
- 17:30wrote it down here accelerometers, gyroscopes and
- 17:33magnatum magnetometers magnet, a little bit of.
- 17:36Yeah, it's hard to say but essentially using all these
- 17:40things and they might have more some of them, some of them might
- 17:42have less depending on how expensive they are.
- 17:45I actually checked on Google right before this.
- 17:47There are I am sensors that go as cheap as like 50 bucks.
- 17:50Bucks or so one piece. Yeah. 11 showing.
- 17:52Yeah one. Yeah.
- 17:53But one of them won't do you any good, right.
- 17:55That's like oh yeah, and just the hardware alone is not going
- 17:57to give you your motion capture, you need the software behind it.
- 18:00We're going to talk about all of that.
- 18:01But essentially speaking these I am you sensors that are put on
- 18:06different limbs on your body so you can attach them to your
- 18:09forearm, your shoulders, and if you're an artist, you would
- 18:12note. These are the joints that
- 18:13usually work with. When you're wrecking your
- 18:14character your legs using these sensors.
- 18:18Coupled up together on top of a You can then tell the rotation
- 18:23and orientation of the joints and using that information, you
- 18:27can capture the movement and the best examples for these inertia
- 18:32suits are Rococo. That is, I would say the most
- 18:35famous I knew about Rococo since their branding is amazing.
- 18:38I have their website, it's not know.
- 18:40The honestly they're really smart word branding the way it
- 18:42looks like. It just means it's packaged in
- 18:44the package arrived. I think it was last week that I
- 18:46opened the package. I was like, oh my God, I feel
- 18:48like opening the box of, you know, like Came from a
- 18:50spaceship. It was so good.
- 18:52Yeah, it's from Apple, people love it, it's the same.
- 18:55I would say same sort of concept.
- 18:56Now we were sent this suit to test out and work with you know,
- 19:00the Rococo suit but we're being super honest about everything.
- 19:04We say. We're going to talk about all
- 19:05the things that are good and not necessarily bad.
- 19:08There's nothing bad about anything.
- 19:09We're going to talk about today. It's more about again which one
- 19:12is right for you. Just have to look at the pros
- 19:13and cons. So going back to it.
- 19:16Rokuko' is the most famous. Because as a gamer, I wasn't
- 19:20there. What's industry?
- 19:21And I already knew about Rocco because we had V tubers and
- 19:24YouTubers using raw cocoa and it's honestly, the marketing is
- 19:27great and also because they're affordable so a lot of people
- 19:30know about them, but there are two other ones perception,
- 19:32neuron and accents. And these are known.
- 19:34Also, for the quality we've seen YouTubers, like expertise is the
- 19:38one of the the luggage They Carried everywhere.
- 19:40Lenora video. I have been watching the thing
- 19:42is because they have like, real cool.
- 19:44Comes with the suit and the senses are already on with, I
- 19:47believe, accents or perception. Neuron, you can buy the sensor.
- 19:50Has separately. You can buy more sensors and
- 19:53attach them to your body, so you can more accurate.
- 19:55Yes essentially. Yeah.
- 19:56So and then you might have different actors so you just
- 19:58have sensors. So they are slightly more
- 20:01difficult to use for that reason.
- 20:02Would Roku is just okay, put on a suit and it's ready to go.
- 20:04So for these sensors on the suit you technically don't need a
- 20:08camera to actually record, you know.
- 20:10So the information transfer from this sensor wire router to the
- 20:14transfer. So no camera is needed.
- 20:16No, do your movement like he was doing last night?
- 20:19Yeah, he we we actually Tested the Roku.
- 20:21So last night there was a movement.
- 20:22He was you were giving a flower ride like it.
- 20:24Yes. Yeah dude, we should talk about
- 20:26this. Okay, this this shit is real we
- 20:28got the Rococo suit, okay. And we were stuck at 98%
- 20:32accuracy and there was some lag in the software and I was so
- 20:36disappointed. And I was like, okay, deep down,
- 20:38I was so excited for their work who suit.
- 20:40And I was like, this is not right?
- 20:42This cannot be like the I can see some like and when I was
- 20:45watching Sam on on YouTube, which is their creative
- 20:48director, I believe he was getting like really smooth
- 20:50performance and I was like, this is fucked up.
- 20:52I can't believe I thought that he made us by two routers,
- 20:58because he thought the brand of the router is it hasn't paid,
- 21:02but we couldn't solve it with two routers.
- 21:04Luckily, we reached out to the support team right now.
- 21:07We're eating at the support team.
- 21:08Shout out to you honest, he the technical director like there's
- 21:12a way you can book at them. This is one thing I like about
- 21:14Rococo is their accessibility on the web site.
- 21:17We booked the demo with the technical lead and He threw an
- 21:21hour session 7 a.m. at 7, a.m. he showed us exactly what we
- 21:26need to do and he took control of the computer, he fixed a
- 21:29bunch of things and boom, like in a my percent we got 100%
- 21:33accuracy, guys, you have no fucking idea how smooth the suit
- 21:36is like, you're gonna I was disappointed at first.
- 21:39I was like, obvi didn't like this cannot be the performance.
- 21:41I can't believe that accuracy is not as high as I want it to be.
- 21:45And then today we were like completely shocked because they
- 21:47fix it online. And What's amazing about, okay,
- 21:52this is not just about real code is about accents and perception,
- 21:55neuron as well. All these Brands, because it's
- 21:58not just a sensor, this Hardware plus software, these software's
- 22:02can improve. And what we know working with
- 22:05Rococo now is that they constantly talk about updates to
- 22:08the software. So if there's offers are getting
- 22:11better essentially going to get higher accuracy.
- 22:13And so if any of you bite a student, now you might end up
- 22:17with a much higher accurate result.
- 22:19Most down the road Line. Yeah, exactly.
- 22:21So you just have to understand a couple of things with using
- 22:24their sisters, and I wrote them down here, first things first,
- 22:27they're going to be portable. So the best part about these
- 22:29suits is that you can wear them outside Outdoors.
- 22:32You can carry them to a different country.
- 22:34If you have to to shoot your milk in motion, you can go to a
- 22:36side like a movie side or something that you can do
- 22:39exactly. And, and because it's usually
- 22:41like, wait, it's either just sensors or suit and sensors, you
- 22:44can move pretty freely in them. I can do any sort of movement
- 22:47and that's a problem. Sometimes you might not be able
- 22:49to move that much. But with this, you can.
- 22:51And so that's also I would say A Plus and also that are Wireless.
- 22:56They don't have any like, you're not attached to something.
- 22:59You want to talk about. I can imagine the first motion
- 23:01capture suits, probably years ago, worth Cable cable.
- 23:04Yeah, imagine. So that would be really
- 23:06difficult. But there's only one downside to
- 23:09usually the inertial sensors, or inertia sort of motion capture
- 23:12systems, which is drifting because they're not, they don't
- 23:15have the exact position of you in the space and there's no
- 23:18cameras to track you It's just you and the sensors on your
- 23:22body. You have to calibrate yourself
- 23:24constantly and you usually would get drifting if you constantly
- 23:28move around the room. Can you explain drifting what
- 23:30you want? Essentially means, let's say I
- 23:31start here and I'm moving all the way over there and that
- 23:35distance is 5 meters to be exact in the software you might get
- 23:38four meters, okay? So you might have to just
- 23:40manually move your rig by a meter if that's going to be
- 23:43super annoying. My still saves a lot of time if
- 23:45you want to have. Yeah, it's they need cleaning.
- 23:49Anyways. I like almost every motion
- 23:52capture we're talking about today, needs cleaning.
- 23:53And even if it doesn't need cleaning, people still do.
- 23:56Because you always even when you record a video like this
- 23:58podcast, we're still going to do minimal color grading, even if
- 24:02you don't want to know a lot. So you still need color clean
- 24:06up. But it's when we talk about,
- 24:07clean up clean up, we're talking about going into the graph
- 24:09editor of the software. And like let's say, if your hand
- 24:12is like broken in the motion capture in any sort of thing or
- 24:15your hands are clipping, if you're clapping, your hands are
- 24:17going through each other, if that's the case you're going to
- 24:20To do some cleanup which means you're going to need to use the
- 24:22graph Editor to fix your hands all of those.
- 24:25Once you try it out a little bit, they're pretty fast.
- 24:28And because most of the solutions were talking about
- 24:30today especially actually let's talk about this case inertia
- 24:33suits. Their highly accurate.
- 24:35Usually, so you're going to need minimal.
- 24:37Clean up. Okay, that sort of wraps up the
- 24:40gator shows. So so let's go to the second
- 24:41category of mocap you mentioned. The second category or ai
- 24:45markerless ai markerless motion capture and a marvelous motion
- 24:49capture. You've Seen us use it am Oculus
- 24:52motion, capture is basically capturing your motion from a
- 24:55single video. You send a 2d video.
- 24:59So one video of myself recorded in your phone, like you just put
- 25:02your phone record, the video webcam yourself, or even a for a
- 25:06video of Snoop Dogg dancing, although, it doesn't have to be
- 25:08life. It doesn't have to be live.
- 25:10It can be any video as long as the quality is there.
- 25:12There's some contrast between the body and the background and
- 25:16the software will sort of use AI to Where the landmarks of your
- 25:21body, are your shoulders, your feet and everything.
- 25:23And then give you the animation data this by far is the simplest
- 25:29method for anyone to use and the most accessible and how it
- 25:34works. Again, is by artificial
- 25:36intelligence because they use thousands of videos of people,
- 25:40dancing and all that and then tell them.
- 25:42Okay, these are what hand look like.
- 25:43These are what faces look like. These are what feet look like.
- 25:46And the AI will find these landmarks based on any new video
- 25:49that you feed. It and then use that to
- 25:51calculate the body motion. Now, this technology works
- 25:56really well for simple use cases, and they do not work
- 26:00really well. When it comes to occlusion,
- 26:02that's one of the things that people need to understand
- 26:04solution. You may like you put your hands
- 26:06behind you or like that was right.
- 26:08Lucky, that's when something is blocked essentially.
- 26:10So if let's say it because it's a 2d video, If lets him dancing
- 26:13like this how would the artificial intelligence be able
- 26:16to tell what I'm doing with my because you can only fucking
- 26:19guess like About makes sense. No, right?
- 26:23It's included. It's a 2d video so this will
- 26:26never be solved. This problem.
- 26:28Will never also say, this is the easiest entry for anyone who
- 26:32wants to try motion capture. I, because that's right.
- 26:34Then you want to start, you want, you don't want to make a
- 26:35movie right on. No Hardware.
- 26:37Like, you can just wave your hands do.
- 26:39This, simple movements and is pretty accurate.
- 26:41I would say. Yeah, I saw you were doing it
- 26:43even a dancing. Like it was quite good actually.
- 26:46So I was, it depends. They are them down and you use
- 26:48them are careless. We did.
- 26:50Did so actually just going back to that.
- 26:52Like if you want to know what are the examples of this, that
- 26:55would be real. Cool video, deep motion.
- 26:57And there's a whole other, you know, range of software's that
- 27:01do the same thing. But again, I know it sounds like
- 27:06it. We're talking about real Cola
- 27:07but you can you can fucking sue me in the comments if you want.
- 27:10But this is just the truth. Rokuko' video is the only
- 27:13company. I believe you can correct me if
- 27:15I'm wrong in the comments because I'm not aware of the
- 27:18other ones, but he's the only one that is In this solution for
- 27:22free, for absolutely free unlimited.
- 27:25Now again I'm not saying oh it's highly accurate because it's not
- 27:27none of these AI. Markerless 2D will be highly
- 27:30accurate compared to the other Solutions because again the
- 27:33problem of occlusion a I will never be able to guess what
- 27:36they're doing because I just really like you have your phone.
- 27:39You are in your in the basement. You just want to try something
- 27:42like you have a character. You wanted to wave.
- 27:44Yeah. For your short clip.
- 27:45That's nothing. Like you don't have to spend
- 27:48nothing zero because of her Cook of video.
- 27:51It's absolutely free. You, you made another video like
- 27:53the X-Men video is also using Rococo video or that one is
- 27:56using broker video. Yes, yes.
- 27:58I mean that was actually people people put few videos that we
- 28:01made with this AI Market list. So the motor is in the comments
- 28:04so you can see how accurately can get.
- 28:06Of course, we did some cleanups. Yeah, but not me this always
- 28:10needs clean up. Yeah like okay let's put it this
- 28:11way. This thing just very quickly
- 28:14going through it with AI, Mark Ellis motion capture, it's free.
- 28:19And that's like, Deep emotional or not.
- 28:22But we're talking about real quick video.
- 28:23For example, here, it's free, it's very easy to use, it's
- 28:27literally as simple as uploading your video and exporting out the
- 28:29animation data fast. You have to understand that it
- 28:34has no calibration. You don't need to tell it where
- 28:37your body is like an impressive calibration.
- 28:39If you want to set up any other systems, we're going to be
- 28:41talking about next. You're going to need some
- 28:43calibration. And one last thing I will say,
- 28:44though, it's naked. I literally wrote.
- 28:47I'm Jake. Imagining one, doesn't - Look
- 28:50like it's naked because you don't wear anything.
- 28:53Think about it. Oh yeah.
- 28:56Sensors on. You still have attachments on
- 28:58you and it's going to limit your movement at least by a
- 29:01percentage. Let's say yeah.
- 29:02But when you're doing this sort of solutions, you you're not
- 29:06wearing anything. You can literally do this naked.
- 29:09I mean, don't do it because the video goes to the cloud.
- 29:11You don't want to do that, but you can be naked and record
- 29:14yourself and I think that's a big plus.
- 29:16The only downside to this, I would say, is the low accuracy
- 29:19compared to every other Solution.
- 29:20We're going to be talking about today, so he said, oh, it's I
- 29:22want to say is it? It's never a solution is always
- 29:25a trade-off. Yeah, so you are not, you're
- 29:27paying zero. You are getting something if
- 29:29your movements are basic, so you can go with this.
- 29:33If your movements are complex, then you need a budget.
- 29:35Yeah, you need to get a set up and then we go to the other
- 29:38methods. Yeah, sometimes you need a
- 29:39studio so it's always a trade-off of yes your project,
- 29:43your budget and the solution that has you're saying.
- 29:45Yeah and man I just it's unbelievable because as A 3D
- 29:50artist. I knew when I started, if I had
- 29:54Rococo video because I get deep motion on, might be higher in
- 29:58terms of accuracy. I don't know, we haven't tested
- 30:00them. Like honestly, you can tell us
- 30:02in the comments if you have but just from all the tests we did
- 30:05with Roku video. Again, we always needed to do
- 30:08clean up because we were going for more of a complex animation
- 30:10that was longer. So if it's just a way, you
- 30:12probably don't need a cleanup but we want to hand something,
- 30:15grab something and all that. But the thing is, dude, it's
- 30:19free and it's Limited and and I believe that's going to be like
- 30:23that forever. I don't know, essentially, from
- 30:25their website, that's what it says, at least what that's going
- 30:27to change is, it's going to encourage a lot of artists to
- 30:31start using motion. Oh, yeah, a lot of entries.
- 30:34Yeah, that is the fucking key and they go by the suits, or
- 30:37they go to the optical ones and it's gonna Elevate the level of
- 30:40art. That's why it's so important
- 30:42because it's free, because a lot, let's be honest, 80% of
- 30:45artists before, like as we speak the like, they probably We are
- 30:50not making high enough income to be able to afford, you know, a
- 30:54huge limb motion capture solution.
- 30:56But because this is free now they can make our quicker.
- 30:59They can make their art better because the motion can be more
- 31:02realistic. And all that means more
- 31:04production of Art and for someone like us was artists,
- 31:06that's just great fucking news. So yeah, baby, this is a big
- 31:09fucking deal. So honestly, thank you Roku for
- 31:12making this free because I know that's part of their pipeline is
- 31:15making democracy. Sorry, democratizing motion cam.
- 31:18That's something they talked about all the time.
- 31:20I'm which means making it available for everybody but
- 31:22there are other brands that are trying to do the same thing.
- 31:25We're going to be talking about them.
- 31:27This is one of those guys will cover this in another episode.
- 31:30Yeah, I mean we wanted to actually today we wanted to
- 31:32cover the whole motion capture. By the time we did that our
- 31:35diversity, have to stick to body motion, capture, face, capture
- 31:39gloves, and other session. Because you have only, we want
- 31:42to have two thousand times. So let's go to the third
- 31:44category. The third category is our
- 31:46Optical motion capture. That's right.
- 31:48Have you seen any examples of those?
- 31:50All the movies. Yeah, yeah, I will stop.
- 31:52There are, you know, I wouldn't know if I'm representing major
- 31:55actually downloaded some videos. As we got an overlay on this
- 31:57podcast for shows the optical one Avatar that.
- 32:00Yeah, using optical. I think the other movies also
- 32:04they were using optical. Let's just put it this way.
- 32:07Majority of the big, Triple A title games and big filmmaking
- 32:12Studios use Optical. This is gonna be the solution
- 32:15when you need like 100% or 99% accuracy.
- 32:20When we talk about Optical marker based motion capture and
- 32:24I'm stressing the word marker based non marker, less because
- 32:27here were actually using markers and you probably seen this in
- 32:31some BTS shots or movies or games how it works is you set up
- 32:37specialized cameras around the actor?
- 32:39Any of them. But I look man you be like
- 32:41Winnie yeah. 50 of them and then you have markers and reflectors
- 32:46these are usually balls but white by any tiny balls placed
- 32:49on the Actors and objects. Remember I said they were
- 32:53putting on a gun as well like the sword.
- 32:55Yes. And when you then act, these
- 32:58cameras, then look for these balls, these reflectors, and
- 33:03they know their rotation orientation and position.
- 33:06And based on that, it didn't takes you to the software and
- 33:09calculates the motion. Now, why is this important?
- 33:12How does this work? Well, this is very complicated
- 33:15technology, but essentially these specialized cameras
- 33:17sometimes I believe there are also infrared cameras.
- 33:20Which means they can see in the dark, and they can see it if,
- 33:22you know, in a harsher conditions.
- 33:24But essentially, all of these camera, specialized cameras have
- 33:28to be calibrated before hand. So, that means the position and
- 33:33orientation and rotation of the cameras are known and placed in
- 33:36the software prior, to recording the motion capture, which means
- 33:39you're going to need an actual studio and actualize, a huge
- 33:43budget. You need a huge like only movies
- 33:45probably can do it. Although is a high-end music
- 33:48videos games. Yeah.
- 33:49But It wouldn't be like a boutique studio and I thought.
- 33:52Yeah, probably and then what happens is this camera?
- 33:55Start tracking all of these balls and all of these actors
- 33:58and I say the word actors, it's plural because usually have
- 34:02multiple people not only at the same time.
- 34:05And that's one thing we sort of forgot to mention in the
- 34:07previous two methods of motion capture, because we will cover
- 34:12it later on in the full breakdown.
- 34:13But essentially you have multiple actors, all of these
- 34:15with different balls often acting at the same time.
- 34:17And these cameras record these sort of balls, the Mince the
- 34:20track, track them and record the orientation rotational that and
- 34:25calculate and give you the motion impressive.
- 34:27And then, but again, I budget high-quality.
- 34:30This is a category that would say is for for people who want
- 34:33to, you know, spend a lot of money on mocap.
- 34:35Yeah, the last category which I think I was so excited.
- 34:42The example, I don't know if you mention this, the example for
- 34:45this would've icon. Oh yeah, vikon system is one of
- 34:48the most well-known. And one of the oldest when I was
- 34:51doing research, why can't I think one of the first one who
- 34:53did motion-capture? Yeah.
- 34:54I think like super light, the 80s.
- 34:56I think I have some time and and rightfully so because their
- 35:00technology is really good. And one thing about vikon
- 35:02systems is if you want to go and see one of the examples, go and
- 35:06look for Snoop Dogg's music video made in Unreal, Engine
- 35:10fire. Now, shout out to these guys
- 35:11actually the guys behind this is I forgot the name but Jesse one
- 35:16of the old YouTubers where he would prank people.
- 35:20His girlfriend prank his girlfriend, a girlfriend would
- 35:22prank him him and another creative director and a team use
- 35:26Unreal Engine 5 to create a music video for Snoop Dogg using
- 35:31the vikon system sick and there's a couple things you need
- 35:34to know about these Optical motion capture systems, and I
- 35:37wrote them down here is, first of all, you are not naked.
- 35:40That's one of the downsides. You cannot, you have markers all
- 35:43around. You have a suit you'd like your
- 35:45body is all filled up with motion capture equipment.
- 35:49The setup is Is not for ordinary people.
- 35:51So me and you or someone watching probably is not going
- 35:54to be able to set it up on this. You do a lot of research and
- 35:57know exactly how to use all these cameras and setups.
- 35:59It's going to take a couple of weeks for it to just be able to
- 36:02calibrate them properly. It is going to be expensive and
- 36:06the time that it's going to take for you to be able to record it
- 36:09as a solo artist. I don't take ages of Ages, but
- 36:13the only thing you have to understand is that it is going
- 36:15to be highly accurate and you're going to be able to track
- 36:17objects to. So you have weapons chairs.
- 36:20As whatever, you can, attach these sort of reflectors on any
- 36:23object and be able to track. Can we go to the most exciting
- 36:27part? I didn't drink something.
- 36:29Yeah. So this is, this is the, the
- 36:32fourth category and I think one of the category that we tested
- 36:35with a bit, but we still haven't looked into in your full
- 36:38potential, okay, you ready for this?
- 36:41You, let's go. You ready for this?
- 36:42Let's go this final category is a category that is very, very
- 36:48new and it's again you've seen a lot of different.
- 36:52I would say Technologies in a past few years, you know, Arise.
- 36:56But this one is I would say, artificial intelligence.
- 37:00I just going to say the fucking word everything in the past few
- 37:03months has been about AI. If you look at it takes to image
- 37:063D Creator video editing. Yeah.
- 37:08Everything chat upt. Yeah, Luma Nai, ya fucking.
- 37:12So everything is not DOT AI. Yeah.
- 37:14It's you should do one bad decisions on AI.
- 37:17Yeah but I don't know why but the reason why I'm saying this
- 37:21is because I mean the Rococo video or or deep motion all that
- 37:24are also use He I believe but this one is really crucial
- 37:28because of what it does. So let's let's talk about this.
- 37:30We don't have a name for it because even the website didn't
- 37:33have a proper name for this. So we're calling the AI marker
- 37:36list, plus Optical 3d motion capture on steroids.
- 37:41And what we're talking about is essentially, when you're able to
- 37:44set off the shelf cameras. We're talking about iPhone
- 37:47cameras. We're talking about GoPro
- 37:49cameras, set them up, like how you would in an optical
- 37:51scenario, but without the specialized cameras, you would
- 37:54set 3 x 3. Three of them in the room, three
- 37:56iPhones or two iPhones in this room, the more the better of
- 37:59course and then you would just do your thing.
- 38:02You would just do your emotion. And what happens is, these
- 38:06cameras will then send the footage up to the cloud and this
- 38:10website called move a. I will merge these three Clips
- 38:14together and then calculate your data, your animation data using
- 38:18artificial intelligence using thousands of animated models
- 38:22that they've done themselves. I believe over the years and
- 38:25then Instead it into 3D animation was readable
- 38:28animation, so you're telling me few iPhones, no suits, no
- 38:33tracker, nothing and multiple people in this scene not even
- 38:37one multiple people you can. So on, so the example of this
- 38:41movie, I if you go to our website, it starts with one
- 38:44person. But of course, the union more
- 38:46iPhones are more cameras for more people.
- 38:48But the beta I believe goes up to 25. 25 is like, like, you can
- 38:53literally do a football game. That's 11. 11:22.
- 38:56Oh yeah. Wow, that's great.
- 38:59Yeah, of course. Yeah.
- 39:00But you can imagine why this technology is so important
- 39:04because it literally it, okay, may I Is essentially saying, you
- 39:12know what Hardware matters. But then with software, you can
- 39:16solve all your issues that you had all your limitation that you
- 39:19had with your hardware. And what's crazy about moving
- 39:21idea is that it's taking everything that the AI more Mark
- 39:24Ellis technology is doing in 2D form with one video.
- 39:28But what it does is merges multiple videos into one and
- 39:32that allows you to create that sort of 360 Vision to be able to
- 39:37have highly accurate. High Fidelity animation data and
- 39:41what's crazy. It starts with two cameras, they
- 39:44do recommend iPhone. So, one thing I have to say, far
- 39:46out is a lot of people asked us to this day.
- 39:48I'm on the Discord moving, I discovered, you can go and enjoy
- 39:51that this people asking how can I use this?
- 39:54Can I use Android? It's only Iphone, right?
- 39:56You have to understand, they're they're actually, the plan is to
- 39:58go iPhone. Only, because I found, let's be
- 40:01honest. They have the best cameras when
- 40:02it comes to phones. I mean, not sponsored by.
- 40:04I know there's people going to be shitting on me because they
- 40:06have like Google phones or whatever, but it's just I've
- 40:09Phone cameras are more stable and I guess these guys have been
- 40:12training. Everything when iPhone said they
- 40:14liked that mistake to I found it makes sense right now but I just
- 40:17go with iPhones and iPhones cheaper.
- 40:19I you can buy a refurbish. I mean you don't have to buy
- 40:21new. I don't have to you can decide
- 40:23on a website, you can buy iPhone, 8 and above.
- 40:25Yes. So you can buy or few hundred
- 40:27dollars that's right 49 there is no 99 can skip nine-day event to
- 40:33iPhone x which is why would a fuck.
- 40:36What? Wine will skip night.
- 40:38I don't know man. Okay anyways Yes you can use
- 40:41anything above iPhone 8, all the way up to iPhone 13 Pro or 14
- 40:47but the better the iPhone, the better, the quality of your
- 40:49capture because okay you know, the better camera will be.
- 40:52Now I'm just going to quickly tell you how it works.
- 40:56Would move AI. You can stop with two cameras
- 40:59but that, of course, means you will have low accuracy because
- 41:03you're still going to be missing out on front, on characters are
- 41:06gonna be sort of setup. They have we're gonna put up the
- 41:08photo probably right now. Where it showing you the capture
- 41:11volume with two cameras, have to set them up like this, you can't
- 41:13send them up like behind and in front of you because it needs to
- 41:16merge information, you cannot be completely isolated.
- 41:19So you're going to miss out on some data.
- 41:21We recommend based on our test PC tested with three iPhones and
- 41:24we got really good animation data.
- 41:26We will link that video down here as well, but you can
- 41:28imagine if you go up to six iPhones, wow?
- 41:31Like so okay. Farrah's is killing me to like
- 41:34we should buy. How many iPhones like for
- 41:36iPhones for because you need one iPhone or IPad to host a
- 41:41session. So we have tested Rococo video,
- 41:43which is the AI Market list. We have the inertial suits.
- 41:46If we buy this refurbished iPhones, I think we can test
- 41:49this as well. So we have tested all three and
- 41:51then we would if you if you FR are sorry.
- 41:54No, no, go ahead. If you want to, if you want to
- 41:56check out all these tests, we will be testing all of these
- 41:58images on our YouTube channel, on our Tick-Tock, Instagram on
- 42:01all that. So make sure you guys stay
- 42:02tuned. One thing I have to mention is
- 42:05how the system works. So essentially you download the
- 42:09AI app. It is currently in beta.
- 42:13It's coming out of beta very soon.
- 42:15They did announce their pricing as well which were going to
- 42:17discuss in a second. It's very affordable.
- 42:20Actually and how it works is, you hold you download the
- 42:24application on the phone. All all your iPhone's.
- 42:27And then you essentially have one iPhone hosting a session
- 42:30which is showing you all the cameras, like how you would look
- 42:33at security cameras. If you were the owner of a
- 42:35restaurant CCTV cameras, you have all the angles, you will
- 42:38host a session. You will see all Jangles and
- 42:40then all the other iPhones will be recording.
- 42:43Once you're done, once you're done it automatically uploads
- 42:46all the footage, has to the cloud where it gets processed
- 42:50and it's as simple as that, you know?
- 42:51It's crazy. How, like, I always say, in a
- 42:53few years down the road like this AI solutions would be crazy
- 42:56and then you're gonna really change the game.
- 42:58It's kind of fucking change a game.
- 43:00There's one downside though, do you know what it is?
- 43:02No, no. What is it?
- 43:04The only downside to this is that it's not real time.
- 43:07Oh yeah, it makes sense. So you cannot live stream it?
- 43:09Oddly, you cannot live stream it now and a lot.
- 43:12I think future will be like probably yeah and it's crazy
- 43:15because a lot of people watching probably they want to be V
- 43:18tubers if you want to be tuber, then a lot of you are using
- 43:21Rococo suits. Ya inertia inertia suits.
- 43:23Yeah, so it's not real time. So you're going to miss out on
- 43:25that part but again, it could be solving the figured trade-off
- 43:28straight out. So now we have covered all four
- 43:31and you have covered quite extensively.
- 43:33We had ever since I think you are already marking around one
- 43:36hour. Now let's less than that a bit.
- 43:39So if you're going U.s. fire rounds if the evaluation of
- 43:43based on different categories of these four types of mocap.
- 43:46So we are going to talk about ease of use.
- 43:49Yeah, which is basically, how hard is it to set up, how it is
- 43:52to work with the software and how long does it take to set it
- 43:55up? Exactly.
- 43:56Then we're gonna talk about accuracy.
- 43:57So, accuracy is relative, depending on your project and
- 44:00depending on your motion but we are going to talk about the
- 44:02simple motion, which is like a bathing a hand or a very complex
- 44:05motions. Your hands is like behind your
- 44:07back. Then we are going to talk about
- 44:08portability. Whether you need a physical
- 44:11Studio, you can move anything or you can travel with it.
- 44:14Yeah, we are going to talk about capacity.
- 44:16Some people, they are so lovely to Bear, some people, they want
- 44:19to do it like maybe a team of two or three.
- 44:21So I'm going to be able to do it a team of 10.
- 44:23Yeah. So that, what parent means, but
- 44:24as recording 10 people at the same time things, right?
- 44:27The same thing. So it's like a fight scene or a
- 44:29battle. Yeah.
- 44:30Last, which is the most important factor is the pricing.
- 44:34So we're gonna give you all the pricing for different types,
- 44:36basically arranged. And by end of this, you can say,
- 44:39oh, Based on my project and my budget and the feature that I
- 44:43need, this would be the best choice for me.
- 44:45Yes. That's right.
- 44:45You ready? I'm fucking ready.
- 44:47Let's go. Let's go for the ease of use.
- 44:49How do you rank them? Okay, so we're going to take an
- 44:51arbitrary number and because we're artist, we're going to
- 44:53take blender Donuts of blender Guru as our ranking you because
- 44:58we, I mean you have to give an arbitrary sort of rating to this
- 45:01out of one donut, which is going to be the lowest score.
- 45:04I'm so hungry now. Yeah, Kevin none.
- 45:12The easiest to use and setup and one being the hardest.
- 45:16So for the marker list motion capture, which is going to be
- 45:21AI, motion capture, your local video.
- 45:23I'm going to give it a 10 blender Donuts out of 10 because
- 45:26I'm hungry. You said it a video and you
- 45:29download that emission data, perform the next one inertia.
- 45:32Yeah. What do you think and they're
- 45:33shot would give it a 7 out of 10 because it still is fairly easy
- 45:37to use but you do need to Some setup to wear the suit you need
- 45:41to. Notice you wear the suit, you
- 45:43need to set it up into suffering to connect your internet and
- 45:45make sure their internet connection is good.
- 45:47So I would give it a 7 out of 10.
- 45:49It's not hard but it's not the easiest.
- 45:50How about Optical Optical would be like a five, or maybe I would
- 45:55even sometimes go a bit lower, maybe three to five because you
- 45:58need to calibrate. All the cameras, you deserve
- 46:01unions team. You didn't have an expert, okay?
- 46:03That's the most efficient videos, right?
- 46:04Yeah. How about AI markerless plus
- 46:07Optical movie? I basically movie, I would It'd
- 46:09be an 8 out of 10. It still took me some time to
- 46:12figure out how to do the first time.
- 46:13For example, when you're setting up your scene, you need to
- 46:16always do a tipos and an a pose and then a clap and even for me
- 46:22who's done this a couple times, it was confusing.
- 46:24And how many seconds do I need to hold my pose?
- 46:26Because the AI will recognize this post as a starting pose,
- 46:29you need to do if you don't do it right, your motion captures
- 46:32fought, right? And because it's not real time,
- 46:35you won't know it until you're done with the motion capture and
- 46:38imagine if you're doing this with an Peter, you're not going
- 46:40to get the actor again. So your follows your you doing
- 46:43one time? Yeah.
- 46:44Okay. Makes sense.
- 46:45Why Again movie? I It's fucking amazing, but
- 46:49maybe it's not the best solution for you.
- 46:50That's why we said no cons here. It's just, which one is right
- 46:54for you. So that one of the big downturns
- 46:56of movie, I, if you ask me, is not be able to judge your motion
- 47:00at that very moment. Okay?
- 47:02So, the current is of huestis talk about accuracy, accuracy is
- 47:06hard, to give a number, you're going to give you a range
- 47:08percentage from the Easiest motion which are explained like,
- 47:11waving your hand to the heart, just like, what a very complex
- 47:15like human movement, right? So let's started.
- 47:17Markerless, what will be the range that you give it to?
- 47:19I will give it a 60 to 100 percent range for AI hundred
- 47:23percent for a simple waving. Yeah.
- 47:25And then 60% for something that, you know like see if you're
- 47:28fucking jumping around. Yeah, okay make sense, inertia
- 47:31inertia would be around 80 to 100%.
- 47:34This depends on your network conditions.
- 47:36You know. This depends on your Hardware,
- 47:37your laptop that is running. The same time and where you are
- 47:41located, I guess, if you're in a magnetic building or if you're
- 47:45in a building, there's concrete all of this is going to depend.
- 47:48So I would say, 80 to 100%, but most of the time, it's going to
- 47:50be above that 90% range Optical Optical would be 99 to 100%.
- 47:56Okay. That's like that's that's the
- 47:57most likely where do I went to siggraph which was here in
- 48:00Vancouver, which is a convention for all the new technologies
- 48:04they had. I don't know if it was vikon, it
- 48:06probably wasn't. It was another Optical system.
- 48:08They had, literally Set up trampolines, where these actors
- 48:13had the optical, you know, sort of reflectors.
- 48:15And they had the camera set up and they had a real time TV
- 48:19showing their action. It was so fucking accurate.
- 48:23It's crazy. If they were juggling and they
- 48:25were like juggling to had these objects attached to the objects,
- 48:29they were juggling the emitters and it was fucking like so
- 48:31accurate. At the same time, the guy was on
- 48:33the trampoline, jumping the height, everything was accurate.
- 48:36So accuracy is all the way up there.
- 48:40Movie a movie, a is, I would say 90% to 100%.
- 48:43We haven't tested it that much, but based on our one-time test
- 48:47and all the footages we see online is pretty high.
- 48:49Def footage is like, if you go to the website moved all day, I
- 48:52you will see. The footage is crazy.
- 48:54They put a comparison between Optical and moving.
- 48:56The, I honestly, it's really close.
- 48:58Yeah, really, really close. And if you follow J's film
- 49:01suggestions and one of the YouTube channel, yeah, Jess
- 49:03films. Does a lot of tests with movie.
- 49:05I see if you guys want to find out exactly how to use it, I
- 49:07would say go to his YouTube channel and check it.
- 49:09Out next category's. Portability.
- 49:12How do we take these suits or this?
- 49:15I don't know. If you take your laptop with
- 49:17you, imagine we're gonna go to a site.
- 49:19How would you rate, all of this Market less fucking 1010
- 49:22blender, doughnuts out of 10 million jobs in your phone.
- 49:25You don't even need a phony matter.
- 49:26If it's Snoop Dogg's video, you are just downloaded.
- 49:28Yeah, it's sit down and do it. Yeah, perfect inertia suits, 7
- 49:33out of 10. You still probably need to carry
- 49:34a briefcase or luggage, or not heavy not heavy.
- 49:37You can just hand carry to the airport, right?
- 49:39Yeah. Optical through or one, maybe
- 49:43y'all can get home. Yeah, move the whole studio and
- 49:47movie. I move AI is going to be around
- 49:49like 7:00 or 8:00 because depending on how many cameras
- 49:52are going to set up. Let's see if you have five
- 49:54iPhones files and iPods five iPhones makes sense.
- 49:57But still I would say not that hard to care and portable.
- 50:00Yeah. Fucking go to a jungle and
- 50:02start. Yeah.
- 50:02Sure. As long as you have your laptop
- 50:04and your phone's next category, we're gonna talk about capacity
- 50:08how many people in the scene? Can be present when we are
- 50:11recording. That's right Market.
- 50:12Let's go. So, to my knowledge, I believe
- 50:16you want to stick to one. Oh yeah, because anything more
- 50:19than one it's probably going to start messing up specially if
- 50:22you got if you are like Contracting.
- 50:24Yeah. Yeah.
- 50:24They're how can it fucking capture the data?
- 50:26So I would say M1 is optimal but probably you can do more.
- 50:29I mean keep marking this for your mini projects, your based
- 50:32on your projects. Yeah.
- 50:34Inertia. Inertia is going to be so I only
- 50:37am aware of this for Rococo. I believe they said Can record
- 50:40up to three performances at the same time, a unique, she suits,
- 50:43and then, of course. Yeah.
- 50:44So you need to be able to afford the three suits first, but you
- 50:47can record like a scene with two or three people, and anything
- 50:52more than that, might affect your performance.
- 50:53I'm not sure how it works for extends, our perception neuron
- 50:56that one. We have to check later Optical.
- 50:59Oh, fucking hell. That's just I Army.
- 51:01Bring the whole Army in battle. I watch.
- 51:04I watch The Rise of the Planet. Apes, the behind.
- 51:07The what? He plans?
- 51:08Yes. Ten of them were playing.
- 51:10The Apes ever run into a mountain and they were recording
- 51:13all talk. Together guy all at the same
- 51:15time. Oh, is it the one where they
- 51:16were like? Yeah.
- 51:18Oh yeah. That's the one.
- 51:19It's yeah. So with Optical you can do many
- 51:20people at the same time. Okay?
- 51:22Make sense. Move a.
- 51:23I move my eyes. I would say it's about the same
- 51:25as Optical. You can do many people at the
- 51:27same time. Of course, the accuracy will
- 51:29drop when you have more people but you can do, I believe 1225,
- 51:34I believe 126 is what they have officially available above.
- 51:39That is like Peter, I'm not tested it but it is going to be
- 51:42available soon. Okay.
- 51:43I mean, if you are a small Studio, probably you're not
- 51:46going to need a bigger fucking good.
- 51:49Yeah, yeah, exactly. So most one of the most
- 51:52important factors for everybody. And for me, like, when photos
- 51:55came to me, he started explaining all this feature.
- 51:57My question was, how much is it each other and, you know,
- 52:00Finance know the the problem with far as is he always gives
- 52:04the price at the after object. First of all, not tax included,
- 52:08he's smart. Second, he always neglect the
- 52:12price of the software. So, so you have.
- 52:14So let's start with marketers. How much is it?
- 52:19How much is the price of the market list software now?
- 52:22So, I'm again, talk about recovery is fucking free, okay?
- 52:25It's free, it's free. You don't need shit next
- 52:27category. Let's go to inertia.
- 52:29Okay. So inertia the price.
- 52:32I know for Rococo starts with about three thousand dollars for
- 52:36the suit accents and perception perception.
- 52:39You Is around the same price perception.
- 52:42Eurostar expense is going to be more expensive when you came.
- 52:45I don't know, not even any case thing around like 78k, it
- 52:49started, but they have different version.
- 52:53Like never like pricing guitars always like you start, they said
- 52:56to stop it and I end up with 25 like to 99.
- 52:59But again for all of this inertia suits you need a
- 53:02software license which is an annual fee payments, you need to
- 53:05pay you, okay? So with Rococo you don't need
- 53:08the software. Since necessarily, but the body
- 53:11is not, unless you want to live stream it.
- 53:13So you can record the data and then just transferred, but if
- 53:16you want to live stream, it directly to Unreal Engine or
- 53:18Unity or blender, or do face capture, and all that, then you
- 53:22can get the pro license. This, let's put a range of 3K to
- 53:2415K to start with like, based on the brand that you choose, but
- 53:27it makes this very nice seat, consider the annual subscription
- 53:32also in your budgeting when you're doing and the power bank
- 53:35and and then your power of n because you need to charge it.
- 53:37But I think that those are negligible Okay, I'm cheap.
- 53:40But yeah, Optical Optical would be around.
- 53:48Honestly, I would say 20K above, I think Avatar has been the
- 53:51million on the under under shit. Yeah, I mean, it's no privately
- 53:55and fucking know the software's for that but just Hardware
- 53:59Hardware wise, you're talking about all these specialized
- 54:01cameras. You're talking about all the the
- 54:03sort of the reflectors and all that.
- 54:04So well above 15, 20 K, when you talk about Optical and last but
- 54:08not least, Move a, I do this. This came at a surprise to us.
- 54:12So move a, I just announced the pricing, I would say month ago
- 54:17and it is honestly, one of the best pricing models.
- 54:21I've seen they announced that it is going to be one dollar a day,
- 54:26which means a total of three hundred and sixty five dollars
- 54:29for an annual license, to be able to use cheap, their
- 54:33artificial intelligence, that is fucking Dirt Cheap on a see
- 54:36dirty but for the quality that you but not included.
- 54:40So yes, it comes a hobby knife owns.
- 54:42It can't, unless you have for iPhones laying over in your
- 54:44house, which I don't know why you would have for.
- 54:46Yeah, if you do, you're lucky. Yeah.
- 54:48But then you have to pay for the iPhones on the tripod.
- 54:51This isn't this, like the opposite of the inertia suits
- 54:53inertia suits. You have that upfront payment of
- 54:56the suit, and then the license of the software is annual here.
- 55:00You have the license of the server, which is annual.
- 55:02But you need The Upfront actions saying this is how much the same
- 55:05Hardware. But the hardware here is not the
- 55:07suit. The hardware here is your phone,
- 55:09the camera. Phones and all that cameraphone,
- 55:11the cameras. So you need to pay The Upfront.
- 55:13So how much would that be? Lets say if it's an iPhone or
- 55:16see if you buy second-hand probably you're paying $500 for
- 55:19each so around me. Yeah, yeah.
- 55:21So 2323 k for the phones and in tripods and they are 23 case and
- 55:26then your one-year 2.5 to 3 K per year.
- 55:30Yeah first year. So for a good mocap set of with
- 55:34you want to put around a budget of around 3,000 dollars for
- 55:39upfront. And three hundred sixty five
- 55:40dollars per year for the annual license.
- 55:43But again you're going to get really good motion capture data
- 55:45out of that. So I know this was a lot to take
- 55:49that and you believe me, you need to go back.
- 55:51Sometimes and look at certain sections, we've got a time stamp
- 55:54it so you can easily go back when you want to buy your mocap
- 55:57solution. You know, where you refer to
- 55:59again? Look at your project.
- 56:01Look at your budget budget. See what is coming in for your
- 56:04studio or if you're a freelancer and then make a decision and
- 56:07it's always good to start with the free software.
- 56:09Software to try it out to see whether you like it or not, and
- 56:13then moving to another solution. Yes, it's don't look at us with
- 56:17like the gloves, the move. A, I'd the helmet and also
- 56:20rakugo, we are actually motion-capture enthusiastic
- 56:23like, that means we are researching about mocap every
- 56:25day and we want to try out all the other hardware and software.
- 56:28So you are mocap company looking at us right now.
- 56:31We will try out your product if you send it to us saying,
- 56:34Shameless plug, Shameless plug, but just saying, I mean, we love
- 56:38to test out and see Works. And what doesn't work?
- 56:41That is not the case for you. Probably the majority of you
- 56:44watching. So just find out which one is
- 56:45right for you. I promise you for the majority
- 56:48of you watching right now just an AI, markerless motion capture
- 56:52is going to be enough. Because do you think the lips to
- 56:54start? Yeah you can get you can just
- 56:56use the, your own video and I say fast as one as and the
- 56:59easiest one to use. Send it your video, get your
- 57:02motion capture data do minimal clean up.
- 57:04Minimal well, depending on your motion capture, but do some
- 57:07cleanup. Let's say, 10 An hour worth of
- 57:10cleanup and boom, you have your motion capture and your
- 57:13animation looks a lot better and it's a lot faster than it was
- 57:16ever before. So I hope by now you guys
- 57:20already understood, what is motion-capture, you found out
- 57:23about some case studies of motion, capturing the field and
- 57:26gaming industry, you know, all the different types of motion
- 57:28capture and you know, how to compare them to find the best
- 57:31need for yourself. That's right.
- 57:34And I really apologize if I I talked a lot, it's just nothing.
- 57:39I think the rvl market one hour which is got this have coffee,
- 57:42breaks are getting a bit long yet, it's not a copy me.
- 57:45Actually, when we started this podcast we said you're going to
- 57:47do 20 minutes because that's our break time and we're going to
- 57:50record this. Love this is one hour but we
- 57:54love to talk about these things and I hope you guys liked it.
- 57:57Make sure I'm stops. I have one day I have one thing.
- 57:58I just want to say sorry just in after what you said because I
- 58:01don't if you're going to say bye or not guys, we watch the first
- 58:04episode. We did barely any marketing for
- 58:06the precipice of barely any high.
- 58:08And we got about Did something views 1440.
- 58:11And that was honestly, it meant so much to us.
- 58:14So if you are one of the first few people who watch this
- 58:17podcast, thank you. This means a shit ton to us.
- 58:20This is our passion project where we want to just talk about
- 58:22the things we love and we would appreciate, we're not going to
- 58:25ask you to do anything. Just the fact that you're here
- 58:27and you're watching is a blessing for us.
- 58:29Of course, if you find it useful, if you find any of the
- 58:32information useful, and you think your friends or your
- 58:34colleagues might appreciate it, please go on and share if not,
- 58:38don't fucking shared, okay? Watch it and enjoy it.
- 58:40That's all we ask. But yeah, just want to say thank
- 58:43you. That's all.
- 58:44Yeah. Thank you so much everybody.
- 58:45All right, we're done. Let's go.
- 58:48Let's go. Okay.
- 58:49Okay. Wait wait.
- 58:50It's Wednesday but you did talk to the point.
- 58:52We might cut it. You might not cut it.
- 58:54I don't know, it's Wednesday, 3:00 p.m. so Wednesday, 2:00
- 58:57p.m. PST.
- 58:58Snap lens, I thought is going to announce the winner.
- 59:01We submitted our most complex. We put a lot of effort into that
- 59:06filter. We didn't sleep for a few nights
- 59:08to make that complete. It came from I'm a story of an
- 59:10actual exhibition. That we went to be modeled and
- 59:13exact, right? Okay.
- 59:14Long story, short, we did an AR Challenge and we want to see
- 59:17people. Don't let me hold on.
- 59:19Tanya, Johnson media. I'll show you our message.
- 59:55Let's go, baby. Thank you, myself.
- 1:00:06And you and everybody, I don't know what to say.