Latest / Bad Decisions Podcast / #4 How to choose the right Facial Motion Capture for Your Project | Bad Decisions Coffee Break
Transcript
- 0:00Welcome to another episode of bad decisions, coffee break.
- 0:04All right, clink. Chin.
- 0:08Chin Chin. Oh man.
- 0:12Oh man, baby, I'm caffeinated. This is like the this is a field
- 0:15showed up today. Well technically I've had four
- 0:18shots until now or five six. I don't even know.
- 0:21Yeah, I'm just super fucking caffeinated right now and we are
- 0:23going for a peak again. Well, we should be trying out
- 0:29new copies every single time. That was the promise.
- 0:31Why? Why have you known about your
- 0:33coffee? No, because the packages are so
- 0:35big they are and it's only two of us.
- 0:36We can't really finish them, but we are Gonna have anyone for the
- 0:39next episode. I like about this, I like that.
- 0:41I like that. We found this really cute coffee
- 0:43place near the house, which has really small packets of coffee.
- 0:47But they have all these nice little flavors in them that I
- 0:49would love to try but it's like double the pride.
- 0:52It's like like half is like half of this know.
- 0:55The problem with this small pocket size is by the time we
- 0:58figure out what is the grind size is going?
- 1:00Yeah. Half of it is where it's wrong.
- 1:03We may say so much coffee. Yeah, you guys so much coffee.
- 1:05Just figuring out the perfect drip.
- 1:08Yeah. I mean, it's all right.
- 1:09You know, coffees Like My Favorite Drug, just thought I'd
- 1:13be just started making coffee, whatever.
- 1:14It's like being swimming problem that yeah, yeah, yeah.
- 1:17Coming months. But again, we've been coffee
- 1:19drinkers since birth, like, literally came out of my mom's
- 1:22womb, and I was like, give me that caffeine, but we've only
- 1:26gotten a proper machine, which is the Barista Breville
- 1:31Breville, Breville Barista Pro burst Express something.
- 1:34Yeah, which is like their basic one is expensive but it's like
- 1:36the basic one. To all the ranges that they
- 1:39have, but it's like it's changed our life so much because we used
- 1:43to put the coffee on the pot and spend like a boiling and boiling
- 1:47and then mix it. And it was, yeah, good old days.
- 1:50But no, I wasn't, that was four months ago.
- 1:52Yeah. We've only.
- 1:55Yeah, we've only upgraded recently but, you know, this is
- 1:58not a podcast about coffee, even though the name coffee break is
- 2:03involved, but this is a podcast about us, talking about the
- 2:06things that we love, which tends.
- 2:08To be a lot of 3D animation, VR, and AR.
- 2:11And now you guys are back for our fourth fucking episode.
- 2:14I fucking don't believe it beyond our fourth episode.
- 2:17Let's go. It's been one month since we
- 2:19started this. Yeah.
- 2:20And it has been crazy. I've met people in real life.
- 2:23I mean, our friends of course nobody.
- 2:25Nobody came to us and said they saw the podcast, but people who
- 2:28we know and watch the podcast, they said they said they loved
- 2:30it. And this is so much.
- 2:32It gives me so much inspiration to continue and make it making
- 2:35more of this and, and just to touch on that.
- 2:37Thank you. Thank you.
- 2:38Q. Thank you.
- 2:39If you are tuning in right now and watching almost every
- 2:43episode or every episode, or even if this is your first
- 2:45episode, I just want to say thank you from both of us
- 2:48because you watching gives us the motivation to continue.
- 2:51And so we love you. And I think what is really
- 2:55important that we need to, we need to say that.
- 2:58Every episode, we're going to have a different theme.
- 3:00Yes. Like we are going to cover.
- 3:01We are going to go over different things so.
- 3:03So One Episode IV started with a are, then we went to body motion
- 3:07capture, I'm gonna put all that. The previous episode, by the way
- 3:09below? Yeah.
- 3:10You don't have to necessarily watch it, watch all of them you
- 3:13can you can just see which topic would be the best fit for you as
- 3:17right. And then you can just you know
- 3:19watch it and get all the information that we spent hours
- 3:21of research on it. Yes.
- 3:23Get it in like an hour or maybe less.
- 3:25Yes. I think and also to add onto
- 3:28that you can even go with in the episode itself and episodes are
- 3:31usually 40 minutes to an hour long but we try to timecode
- 3:35everything. So usually what happens is we
- 3:37start with the Beginner talk in the start of the podcast and
- 3:41then we go to more advanced and the same thing applies to this
- 3:44episode. So, let's say today, we're
- 3:45talking about face motion capture, which will cover for
- 3:48the first few minutes. We're going to be covering the
- 3:50basic terms in motion capture, so everybody can understand.
- 3:53But if you're more advanced, you can literally just look at the
- 3:56time code and Skip to where we start talking about.
- 3:59The very details of facial motion capture for studios.
- 4:02And so, pick, and choose. You don't have to watch the
- 4:04whole thing. It's more about what you like,
- 4:06or if you Vibe and you want to just watch a whole I want to
- 4:08relax go ahead and do that to it.
- 4:10That's fine. Can I show you something?
- 4:11Yes. Go.
- 4:12What do you want to show their packet?
- 4:14Okay so yesterday after I think we were it was ten days of you
- 4:17are waiting for SNAP spectacles. I think if you watch the
- 4:20previous episode, we told you guys that we requested it, you
- 4:23didn't know that you're going to get it or not.
- 4:24Yeah I'm this. Maybe you can tell them what the
- 4:27fuck it's all about. Anyways they don't know.
- 4:29Okay, what are snaps neck? Spectacles, okay.
- 4:31Well let me say I won't out what our snap spectacles and why do
- 4:34we have them here? So these are AR glasses.
- 4:37So basically these are Like your normal glasses, which has an LCD
- 4:40right in front of it and you can see all the digital overlay that
- 4:43you create on lens studio in your real physical environment.
- 4:47How cool is that? So if you lose it for the
- 4:49future. Yeah, exactly.
- 4:50And in the previous episode, we covered that xiaomi came up with
- 4:53their own, a our glasses, I think between the previous
- 4:55episode. And this episode, there was
- 4:56another company. I forgot opal.
- 4:58Yes. They announce their own, a our
- 4:59glasses, Apple of course, is coming up with their eyeglasses.
- 5:03These are glasses of VR apples coming with VR headset.
- 5:06The roadmap. So metal also now.
- 5:08Your dresses are in the road. As we imagine all these big
- 5:11companies are creating all these are glasses and we managed to
- 5:15get our hands on. Not 12 of these so far has has
- 5:18also is own V, where's mine? No.
- 5:19We have a mine bitch. We haven't opened it.
- 5:21So I'm going to put it on at first before before I get this
- 5:25spectacles. I thought oh my God, these are
- 5:26going to be heavy. They're not going to look good
- 5:28there, but it looks so good that good.
- 5:30It looks fucking amazing. Great.
- 5:32I look like a fucking DJ, dude. How you look?
- 5:35It's very comfortable. I haven't, you know, took out
- 5:37the plastic and And yeah, you still have like that package
- 5:41plastic on. Let me just tell you one thing
- 5:43about it. So if you can notice it's matte
- 5:45black you can I'm thinking, Can it can I put hint for myself?
- 5:49For this pocket, don't carry this paper on like a
- 5:51teleprompter as yes. It's a create a lens as a
- 5:54teleprompter and then yes. Oh my God!
- 5:56That's good. We should do that.
- 5:57She liked Rock these glasses for the next semester and have like
- 6:00all the, like, fuck paper man. Why do you have paper?
- 6:03Would like so efficient. So we have two of these snaps.
- 6:06Thank you so much for sending us these spectacles.
- 6:09What we need to do now me a father to sit down and plan.
- 6:12What are we going to create? So, there are so whatever you
- 6:15create online Studio. Technically, you can, you know,
- 6:17use spectacles with it as well and there's more capabilities.
- 6:22So stir, some capabilities shared, but there are some
- 6:25capabilities, which you cannot have it on spectacles, for sure,
- 6:28because different, from the phone.
- 6:29But it's basically the same framework with the same base and
- 6:33I'm, we are going to have a meeting with stuff I think on
- 6:35Thursday or Friday with their team to find out.
- 6:38More about, you know, this is an onboarding session.
- 6:40Are you trying to show off that? We have meetings with Snapchat?
- 6:43Yes, we do know. And then what's going to happen
- 6:46is, we are going to focus on creating lenses for these
- 6:49spectacles and gotta create content out of it.
- 6:52So, two or three ideas that we had.
- 6:54I think one of them was definitely bringing our King to
- 6:56the experience into spectacles. Yes.
- 6:58Imagine you try it, you know, you go into the tomb without the
- 7:01phones. Using your look around and see
- 7:03the tomb. And also the supermarket idea, I
- 7:05think that one is a fucking dope ideas.
- 7:08So Just a little bit of a backstory, to what file was
- 7:10saying? The King Tut idea.
- 7:11If you don't know, we created an AR experience for SNAP lens,
- 7:15Athan which we, for which we created the exact replica of a
- 7:20tomb in Egypt. In augmented reality, we managed
- 7:24a comment third place, which was a great honor and Pharaohs idea
- 7:27is to Port that same experience for spectacles which will allow
- 7:31us to create essentially more effects because spectacles, have
- 7:33some extra capabilities that you don't have with your phones and
- 7:37the supermarket idea. There is also really cool.
- 7:40The idea for the supermarket was imagine if you walk into a
- 7:42grocery store and all the time that you're looking at, all
- 7:45these nutrition labels. If you are a health freak like
- 7:48me and found our chicken for like canola oil and sunflower
- 7:51oil. Imagine if you just have to look
- 7:53at the products and all these informations are popping up.
- 7:56The moment, you get close to them so you don't have the
- 7:58necessary pick up the packaging. Look around.
- 8:00It's a lot of like I feel like cyberpunk or anime, sort of
- 8:04cartoons would have definitely shot source.
- 8:08Is like this. So our vision, our ideas and
- 8:10Inspirations came from them and we want to recreate that for
- 8:13spectacle so stay tuned that lens is coming.
- 8:16Hopefully by the end of March, let's see how we do it.
- 8:18Let's see, I'm looking at you and keeping you accountable for
- 8:21and as March, let's do it. Let's do it on pumpkin is wide
- 8:24like 89 but I think yeah, I don't know.
- 8:26I mean, yeah, I know, but I think we've talked enough about
- 8:29this. This is like the most exciting
- 8:30thing that has happened is we haven't tried it yet, but that
- 8:33is going to be the goal. Aside from that.
- 8:36I feel like we can go ahead and talk.
- 8:38About what is happening today because today we have this
- 8:43headset right here. The head Mount gear AKA HMC Was
- 8:49it? A gypsy gets HMC and my head
- 8:52Mount year. Hm not only no but it's HMC.
- 8:55Head Mount control. No cap cap, cast cap.
- 9:03Do you wanna check? Head mounted camera.
- 9:17Thank God anyways, head Mount camera and gear Head, Mount cap,
- 9:25whatever you want to call it. Essentially we brought this for
- 9:29our second episode which was all about body motion capture.
- 9:32But we did mention that this was not going to be a part of it.
- 9:35Had it as decoration. But it's been so long since I
- 9:38wanted to talk about facial motion capture with farad and is
- 9:42a specific reason why maybe you want to tell them.
- 9:44So, to give up to give you guys a background on episode 2.
- 9:47We dive deep into motion capture and we covered everything about
- 9:51body motion capture. But when we look at our time, we
- 9:54were at like past one hour, so we couldn't really talk about
- 9:57face most motion capture because I think face itself deserve that
- 10:00episode because there is a lot of things to talk about their
- 10:02different devices when you want to, you know, capture your or
- 10:05facial movement. So we thought that this episode
- 10:08would be fully focused on facial motion capture.
- 10:10I'm going to put the link for the episode 2 here.
- 10:13So if you guys want to know more about body motion capture what
- 10:16Solutions are available, you can go to that link.
- 10:18Basically. Yeah and okay so the reason why
- 10:20we're bringing facial motion capture, why we think it's
- 10:22important to dedicate one episode to it is because up
- 10:26until well I would say a few years ago or up until even today
- 10:29facial animation has been one of the more complex parts of any
- 10:33animation. And the reason for that is
- 10:34because we have Thousands of small muscle movements in our
- 10:38face and to be able to translate that in a realistic manner to a
- 10:423D character was impossible. If you go 30 years ago, 40 years
- 10:47ago, but it's still only got more possible when people start
- 10:51figuring out different ways to do that and now 2022 2023.
- 10:56It's become so accessible so affordable that we believe we
- 11:01need one episode. You just talk about how easy is
- 11:04it is to get realistic animation on to your 3D characters for the
- 11:08face and do it in a very quick manner.
- 11:12So, so in other words, I can say that small Studios with low
- 11:16budget with low. Budget, can create animation.
- 11:19I'm just as good as them. I'm going to correct you not
- 11:22small Studios. I'm talking about one fucking
- 11:24division of Freelancers eventual, a YouTuber or a take
- 11:28talker can then if they have basic 3D knowledge and they are
- 11:32willing to learn. There is the tools.
- 11:35Available right now to create super realistic animation for
- 11:38case. That's amazing.
- 11:39So I think why don't we start by talking about just the basics.
- 11:43If you don't know facial motion capture is taking our own facial
- 11:47movements and putting it onto a 3D character and the 3D
- 11:51character doesn't have to be a human.
- 11:53It can be a dog, it can be a bird, a monster a monster.
- 11:57Like like what? Give me give me an example of
- 11:59what, what what what movie used facial motion capture, Benedict
- 12:03Cumberbatch The Dragon. In The Hobbit.
- 12:06Okay, you got that, right? I was waiting for you to say
- 12:08Lord of the Rings. I got no, that was not gonna
- 12:09fall for it again. Gollum in The Lord of the Rings,
- 12:12these are like Gollum in Lord of the Rings was one of the earlier
- 12:14examples, but Benedict Cumberbatch with the dragon.
- 12:18Like, when you compare a human's facial features to a dragon,
- 12:22it's definitely not the same. But you can essentially take the
- 12:26facial animation of a human and still map that onto a dragon.
- 12:31That is possible. And so that's why facial motion
- 12:34capture. Really important because if you
- 12:36were to manually do all these animations, it will take a long
- 12:38time and it might not even look that real.
- 12:41But when you have facial reference to connect and map
- 12:44that to then, you know, you can get really good animation,
- 12:46really fast. So the reason facial motion
- 12:49capture is so important. There is this concept called
- 12:51uncanny valley. Yeah.
- 12:53What is it about? So uncanny valley, I heard about
- 12:56this term first at siggraph, in Vancouver and essentially
- 13:00uncanny valley is the unsettling feeling that we have.
- 13:04When we Look at something that is human-like, but there's
- 13:08something off about it. And we've all experienced that
- 13:11where maybe an older cartoons are older movies, they were
- 13:15trying to get a character to look like a human but it just
- 13:19did not. And the reason it did not is
- 13:21because fortunately or unfortunately we are
- 13:24particularly good at telling if something is human or not.
- 13:30So we are good in this that you know defining what is bullshit
- 13:33and is not and you his idea Like, if something is off, our
- 13:36brain will tell us immediately. Hey, this is not real like and
- 13:40then the feeling of watching that feel more, that animation
- 13:44wouldn't be as good. Exactly.
- 13:46Right. Okay.
- 13:47You and the reason they call it the uncanny valley because it's
- 13:50exactly like a value. Like it's so steep the moment.
- 13:53If the eye movement is slightly jittery or not as smooth or if
- 13:58the head movement or if the muscles, when it's smiling, if
- 14:01the character is smiling but it doesn't just look quite right.
- 14:05The emotional connection, you have to that character to that
- 14:08movie to, that story is immediately gone.
- 14:12So our brain is very good at deciding whether.
- 14:15So I'm imagining now in the future, when the Hologram
- 14:20avatars are a thing, we have to make them.
- 14:22So high-quality illus, our brain will immediately tell us that a,
- 14:25this is a replica. This is a real human.
- 14:27This is exactly. Okay, so he doesn't really
- 14:30interest that's why right now. Like, if you just go on Tick,
- 14:33Tock and look at some movies, you can.
- 14:35L. Look at this is CGI.
- 14:36Does not CGI. This is CGI.
- 14:38Does not CGI and some for some reason to this day, still if
- 14:42you've been in the 3D industry or even if you haven't when you
- 14:45look at Deep fake videos, for example you can still tell their
- 14:49deep fake like the Tom Cruise deep fake.
- 14:51There's a lot of people who cannot tell that as a deep baked
- 14:54or that's fake because he's trying to get it so close.
- 14:57So, The Uncanny Valley doesn't exist there right, but there's a
- 15:00lot of deep fake videos where you can instantly, almost
- 15:03Ellicott, that's not real. That doesn't look real.
- 15:06It's supposed to be like that but still the movements are not,
- 15:10you know, off you know. Yeah, they're not detailed
- 15:12enough and it's just the human consciousness.
- 15:15Like are on sorry, the our unconscious mind and brain can
- 15:20actually tell that apart. We're very good at that.
- 15:22That's why you don't need to be taught to know.
- 15:25If someone's feeling happy since you were born, you you feel that
- 15:28if you're smiling, I can feel your happy.
- 15:31And if you're sad, I can feel that you're sad now.
- 15:35Now, you've definitely watch cartoons where like the
- 15:37character, right? Maybe a 20 year old cartoon was
- 15:40sad, but you don't feel shit. Because that's the transform,
- 15:43the yeah. And Polar Express is a good
- 15:45example of that, so he didn't really reflect.
- 15:48Yeah, I really I think it would be good to talk to a
- 15:50neuroscientist about that. What happens in the brain, dr.
- 15:54Andrew burman's, please. All and uberman is one of the
- 15:58biggest and best podcasters and he's a neuroscientist.
- 16:02Farhad is a big fan. If you're watching this ever, he
- 16:05would love to have a conversation with you about AR
- 16:07and VR and how our brain actually reacts with all these
- 16:10different and how we can differentiate them actually.
- 16:13So this is very interesting, but yeah.
- 16:15So I think now we talked about this.
- 16:17Let's talk about some of the basics.
- 16:19So now, how does this movement are transformed and defined so
- 16:24we can talk about blend. Shapes or even face Rick.
- 16:27Because those are the things that, if you are doing facial
- 16:29motion capture, we need to know how those things work to be able
- 16:32to, you know, say, oh, this is a good software.
- 16:34This is not, this is a good output or not.
- 16:36Basic. Exactly.
- 16:37Know. You're absolutely right.
- 16:38I think the fact that you brought that up, I think we
- 16:41should go over towards those terms.
- 16:42Before we get into the details of what facial motion capture is
- 16:47and how you can use it. But the very basics of it is
- 16:51when you have a 3D character, the 3D software doesn't know
- 16:55exactly. Where the eyes are, where the
- 16:57mouth is, how does your character Smile?
- 16:59So, you need to find a way to define those things.
- 17:02And the way you do that is through bones and face rakes.
- 17:06So you essentially start, setting up bones, how your own
- 17:10face has those bones around your character, around the eyebrows,
- 17:13around the eyes, right around the mouth and these bones
- 17:17essentially will control the different parts of the face.
- 17:20The more bones you have usually the more advanced your
- 17:23animation, the more realistic animation is going.
- 17:25Ooh look, which is why metahumans, for example, have
- 17:28very realistic animations because there's hundreds of
- 17:30bones, but that's not where it ends.
- 17:33We have something called blend shapes and blend shapes is
- 17:36essentially a tool to set up expressions and predefined
- 17:39expressions for your 3D character.
- 17:42For example, eyebrow up, eyebrow left up eyebrow, right up mouth
- 17:48open. So you define these I look
- 17:51stupid but allow sitting right in front of me.
- 17:55You said eyebrow. Left.
- 17:56I was like, okay, this is the right one.
- 17:58Yeah, I know it started. But essentially speaking, you
- 18:00get my point, right? Yep.
- 18:01So using these face tricks, which connect to the bones of
- 18:06the 3D character, you can move these, you know, characters,
- 18:08facial and facial movements, facial bones.
- 18:12And then with these blend shapes, you can then set up
- 18:14expressions of what for this cat, if it was smiling, how
- 18:19would it look? And with the blend shape, you
- 18:21will Define that. And so, you can do this in any
- 18:233D software and It's a very commonly used term and known
- 18:28knowledge. Is there an asset of number for
- 18:31all these blend shapes that, you know, that we have like how many
- 18:34blend shapes in. You can have as many blend
- 18:37shapes of you want, so you can go as detailed as you want to
- 18:41like a smirk, a smile. A frowning.
- 18:45Yeah. And then you can have blend
- 18:46shapes which are mixed up. Other blend shapes.
- 18:48Right? So, you can go super detailed
- 18:51into this or you can go very basic like for some of the V
- 18:56tubers right? You have like maybe ten blend
- 18:59shape. So it's very basically just have
- 19:00the eyebrows moving and the smile and a sad face and that's
- 19:04because maybe they want to keep it light.
- 19:05They don't want to have super realistic animations like an
- 19:08animated character. So it really depends on what's
- 19:10your needs, right? Okay.
- 19:12Now that perfectly makes sense actually.
- 19:14But so now we know some of the basics and we know how, you
- 19:18know, facial motion capture works, why do we need it?
- 19:21But when you were explaining it to me, I think it was two months
- 19:24ago that we started going through.
- 19:25Through this long journey of research about all of this.
- 19:29There were many, many tools out there to do facial motion
- 19:33capture, and I would say, you cannot put them in different
- 19:37categories or types. There are just different
- 19:39solutions by different teams or companies.
- 19:42Yeah. And they, all have certain
- 19:44things and if you are, for example, want to work in Unreal
- 19:47Engine, then there is one tool to use.
- 19:50If you are one of work on animation in there is another
- 19:52one. If you have a lot of budget,
- 19:54then there is 12 You're so how we can break it down for someone
- 19:58who's coming in and say hey I don't know anything about the
- 20:01tools out there. How can I pick one or where
- 20:03should I start? Yeah before breaking my bank or
- 20:06before you know, doing something very complicated.
- 20:08That's a very good question and I just want to stress one thing
- 20:12to everybody. Right now, we are going to be
- 20:14covering this guy right here in full details of stay tuned.
- 20:17Because this is actually a main focus of today's episode.
- 20:19But before we move on to this, and I like to call this a
- 20:22studio-grade animation, facial, And because you can truly
- 20:27produce quality animation for the face as, yeah, go ahead and
- 20:32put it on as good as let's say, Thanos in Avengers right, as
- 20:36good as any Hollywood studio, or any AAA title game studio, and
- 20:40that's going to be the main focus.
- 20:41But before we jump into that, do you like that?
- 20:43Yeah, I like it. And I just realized, I mean,
- 20:45there's a camera right in front of me, right?
- 20:46Yes, exactly. We're going to be covering that.
- 20:50But before we go into that, because not everybody has access
- 20:53to this, I feel like the one thing everybody needs to know
- 20:55About, and if you've ever tried facial animation, what you just
- 21:00saw what Cyrus did. He's very sensitive about all of
- 21:03this. I put the cable a little bit of
- 21:05timing wasn't don't touch the cable to be careful.
- 21:08With my head said, man. So Apple a Arc, it is the term
- 21:12that everybody needs to be aware of, because if you want to talk
- 21:16about facial animation, right now, the biggest category for
- 21:20any freelancer, any small, Indie studio right now, to consider,
- 21:25ER, is using Apple a arcade. Now Apple, a our kid is what
- 21:29Apple did to Define how we can use 50.
- 21:33Plus blend shapes to control realistic.
- 21:37Facial animation for any 3D character and they came up with
- 21:40a predefined Expressions. Again, 50 plus button shapes.
- 21:44Apple Define these two have documentation on it and what
- 21:47happened is after they did this for their own meme.
- 21:50Oh, Jesus and their own emojis, you know, those emojis.
- 21:52And apple did this small avatars that you can send through text
- 21:55Yes, exactly. That's the poop emoji.
- 21:58The pig emotion. Just a very basic use of facial
- 22:01capture using your iPhone. Yes, that's like free.
- 22:04Everybody probably experienced that.
- 22:06Yes. Like using different, there's a
- 22:07unicorn. I think there is a yeah.
- 22:09Okay, they okay. So what Apple did was really
- 22:12smart before that facial detection markers existed.
- 22:16Like you can use your own webcam and it starts putting in these
- 22:19landmarks, on your face. Look at these are your eyebrows.
- 22:21These are your eyes, your mouth, but they were not very accurate.
- 22:25Accurate, what iPhone did was okay.
- 22:27We want to have people control our emojis, so they released a
- 22:30our kit, and with a our kit, the release the documentation.
- 22:33And with the documentation, they also read is the really good
- 22:35camera from selfie camera which has true depth.
- 22:38And that means it can scan your face in 3D and set those
- 22:43landmarks on anybody's face with any skin color right in
- 22:46different lighting conditions and that's why it's so good.
- 22:50And so came a plethora of applications, right?
- 22:55That allow you to record, your facial motion capture and put it
- 22:59on any 3D character. We're talking about live link
- 23:02for Unreal Engine, which is the most affordable and it's free.
- 23:05And you can use it to control your metahumans or any character
- 23:08that has the Apple, a arcade blend shapes.
- 23:11There's face cap, which is a free software for like two
- 23:14seconds of recording. But you have to pay a couple of
- 23:16bucks after that, you can record it for unlimited amount of
- 23:20usage. And that also uses apples are
- 23:22hit. It's the same technology
- 23:24different application, you can. And then export that into
- 23:27blender, Maya any 3D software, then you have live face for
- 23:31iclone right. Again, apples, they are kit and
- 23:35it's being sent to iclone real illusion, which is a software
- 23:38purely made for animation. So I can say that there is a
- 23:42suit of products. Yes.
- 23:43Builds on top of Apple a our kit and you can use them differently
- 23:48based on the platform that you use.
- 23:49So if you are a person who is working with blender probably,
- 23:52you should use face cap. If you are working Unreal
- 23:55Engine, Five or four or whatever version that you're working, you
- 23:58better use live link and if you want to use iclone, what was the
- 24:02software? I forgot.
- 24:03I clone. Yeah.
- 24:04Oh yeah. Oh yeah, I don't know.
- 24:05What was life face life face? Then that's an application.
- 24:08Okay. Yeah, perfectly makes sense and
- 24:10it's easy to pick and these are very low barrier to entry,
- 24:14right? Like the price, how does the
- 24:16price? That's not even say there's no
- 24:17fucking barrier is. Yeah, it's open because all you
- 24:19need is to have an iPhone, okay? Right.
- 24:22And then you use this applications and it's also real.
- 24:25Time. So all of these send data over
- 24:27Wi-Fi to your computer so you can connect them to your
- 24:30computer and have your animation in real time.
- 24:32So it's not just good for preview but also for recording.
- 24:35Now I would say the one thing that differentiates all of these
- 24:38applications. And there's also Rococo remote
- 24:41which is again, built on top of Apple, your kit.
- 24:44What differentiates them is the price and also what are the
- 24:47features that are offered alongside them face?
- 24:49Gap is just a couple bucks but the export is like a text file
- 24:54or .fb File. So you can take it to any 3D
- 24:57software, the difference now between that and lightning is
- 25:00live. Link is absolutely free but only
- 25:03for Unreal Engine, right? But if you're building an Unreal
- 25:06Engine, so I can say that you don't have to pay anything and
- 25:08you can record face capture, right?
- 25:09Absolutely free as amazing, right?
- 25:11And it controls metahumans pretty damn realistically or any
- 25:15again. Any character that is set up 50
- 25:17plus blend shapes which usually take what a day to do or two
- 25:21days for someone who's you know, who knows what to do with blend
- 25:24shapes very Very quick in my opinion, for a long animation
- 25:27that you're going to be doing and there is real cocoa remote
- 25:30which is paid. But again it does most of the
- 25:34back end stuff for you so you just have to click and it
- 25:37automatically takes everything to you know, blend it for
- 25:39example. So it's much easier to use but
- 25:42you have to pay and it is iclone real illusion life face.
- 25:45The issue with that. Is you got to still pay for the
- 25:47software and the software is quite pricey was around 800 last
- 25:50time, we thought. Yeah, it would there's a lot of
- 25:52different things you can buy in a software but it is pricey.
- 25:55So much that we didn't buy it yet, right?
- 25:58But the thing is, I cloned the illusion has so many tools where
- 26:02you can then right after recording your facial animation,
- 26:05use those tools to perfect your animation and make it even
- 26:09better. Whereas, if you were to do it in
- 26:11a 3D software, you have to deal with all these graph editors and
- 26:13all that, which can be confusing and time-consuming.
- 26:16So again, when you talk about Apple a dark, it there's so many
- 26:20applications that you can use. And the reason we wanted to
- 26:22mention that is because it starts with being free.
- 26:25Free and all you need to know is just have the knowledge to run
- 26:29them and you can get realistic animation to your characters in
- 26:32no time. That's amazing.
- 26:34I think so it's a very so if you haven't touched facial motion
- 26:38capture, that's the best way to get in before even going to the
- 26:42studio grade devices. So so just try it out.
- 26:45Maybe create a short music with your create a short clip.
- 26:48Yeah. Plate with different characters
- 26:50doesn't have to be, doesn't have to transfer it to.
- 26:51I like an animal or a monster. It can be to another human and
- 26:55there are ready. With basis, a lot can take.
- 26:57Yeah. So it's obviously that you can
- 26:59try it out very fast and you find out there.
- 27:02You're good at it or know. So, yeah, I think it's good but
- 27:04and and one more thing I think you really enjoyed it too.
- 27:07Like the moment we tried connecting our iPhone the first
- 27:10sentiment it's very enjoyable. Like if you're a 3D, you know,
- 27:13artist or an Enthusiast just give it a fucking tried.
- 27:17Like yeah, it's awesome to see your face connected at the same
- 27:20time. You seeing the, the preview in
- 27:22real time you enjoyed it? Yeah, I know 100%.
- 27:25I love And then after that, you want to do more and you want to
- 27:27make it more accurate and you want to make short films.
- 27:30So it's really, it's really fascinating to see that.
- 27:33Now, you can transfer all the detail of your facial.
- 27:36Emotions to another character. So I definitely loved it but we
- 27:41went over all the not all of course, some of the Apple, a our
- 27:44kit Solutions out there, but now let's talk about it for someone
- 27:48that, okay? They are doing a little bit more
- 27:50detailed work or they're doing client work, or they want to
- 27:53create something more sophisticated.
- 27:55And you know they wanted they want to really take it to
- 27:57another level. Yeah, I remember you talking to
- 28:00me that there are Studios that are spending a lot of money on
- 28:05facial motion capture because you know, it's very important
- 28:08movies like Avatar or even Thanos in Avengers.
- 28:12But last year end of last year, you told me that.
- 28:15Oh my God. There is this device that is out
- 28:17by the way. This device is not sponsoring
- 28:19our podcast unfortunately not yet.
- 28:21Yeah but so you told me that the oh this came out this is a
- 28:25Affordable almost as good. And no, no, not almost as good
- 28:30as good as good, very affordable.
- 28:33And now we can create a movie like facial motion capture.
- 28:37So let's go over the new category of things.
- 28:39What are the studio-grade? Motion capture device, man?
- 28:43You put me right on the spot. I'm ready, we're talking about a
- 28:47fucking game changer here. Okay, so when we talk about a
- 28:50studio, great motion capture for the face, we're talking about
- 28:54using actual All head mounted cameras, hidden cameras, to
- 29:00record, your facial motion capture and using software to
- 29:03manually, solve or automatically solve your motion capture, which
- 29:07then again, goes to the 3D characters.
- 29:10Now, we're not talking about a, our kid here because we are not
- 29:14just talking about 50 blend shapes, we're not talking about
- 29:17using Apple's documentation or, you know, way of recording your
- 29:21facial motion capture. We're talking about other pieces
- 29:23of software which movies. Games AAA Studios have been
- 29:27using for years. They actually developed like,
- 29:30for avatar for Lord of the Rings.
- 29:31A lot of these movies. They develop their own software
- 29:34yesterday, we were researching about digital domain which is
- 29:37the company who's worked on all the movies.
- 29:39All the X-Men Days of Future Past Adventures, Percy Jackson,
- 29:44what else everything like that was like, but I don't many
- 29:46movies, right? Had.
- 29:48So, like they were saying, 47. What was it?
- 29:51Seven shots of Avengers. They had seven sequences have
- 29:54been 300 somehow. And people worked on it for ya.
- 29:57It was a seven sequences over 300 shot, I fix shot.
- 30:01Yes, more than 300, people worked on it.
- 30:03So it is in Vancouver and la and Shanghai, anti do this.
- 30:07All you did to my fault, okay? And they were like digital
- 30:11domain, where the guys based on their website, that worked
- 30:14heavily on Thanos has facial motion capture, and again many
- 30:18other characters. But their main focus has been
- 30:20Tano's in the Avengers and the even develop their own software,
- 30:24which is called Massacre. Arrayed, and there's a
- 30:26masquerade 2.0. So, from like one of the
- 30:29Avengers for Tano's, they worked on the tennis facial animations,
- 30:33so they were using masquerade. So they develop the software to
- 30:36do realistic, facial motion capture for him.
- 30:38But for the next movie, they have to develop that software
- 30:41even more like an update masquerade 2.0.
- 30:44And I believe that's not a software that's available to the
- 30:47public. I don't think so.
- 30:48Which is why we're talking about a fucking game changer right
- 30:51here on this table face good-bye.
- 30:55Hardy. This is a Chinese based company
- 30:58and the moment I found out about them from Jay's films.
- 31:01Again, shout out to another YouTuber who's done so many
- 31:04videos and also KK Studio. His name is Brian.
- 31:08These guys have been doing loads of content about face good and
- 31:11the reason why we're talking about Facebook specifically is
- 31:14because of how affordable it is and it is completely mind
- 31:21blowing so base good and there's another company called face.
- 31:26We're both create not just the hardware for head mounted
- 31:30cameras but also software. So they have these software's
- 31:34which essentially take the animated, take your facial
- 31:36movements and translate that into animation data for 3D
- 31:40character. Now, both in this scenario, both
- 31:43the hardware and the software need to be really good for you
- 31:46to have realistic animations. Now, both of these companies
- 31:50pretty much do the same. Same thing.
- 31:51When it comes to face motion-capture, they have these
- 31:53different steps, and I'll explain these steps for you.
- 31:56They start out by a part of the software that records, your
- 31:59facial animation. So that's the camera in the
- 32:01front. That's the camera in the front
- 32:03as an infrared camera in the front.
- 32:05And you are telling me that you cannot the reason you cannot use
- 32:08your phone. It has to be head-mounted is
- 32:09because it is, it will be always in front of your face when you
- 32:13move. So it covers everything right?
- 32:15That's right. And the thing is, though, you
- 32:17don't necessarily have to use these cameras both Of these
- 32:21companies in their software allow you to use your own
- 32:24camera. Your own DSLR, your own eyes.
- 32:26Why would you if there is a no? But not, everybody can afford to
- 32:29have this right, you still? Okay.
- 32:31So this is the difference with apple AR kit.
- 32:33You have the 50-plus blend. Shapes is limited with these
- 32:36software's. You can go super realistic.
- 32:39So, essentially you do not need these pieces of Hardware to
- 32:43record your facial animation. You can just depend on a DSLR as
- 32:47long as you keep your head stable and do your animation.
- 32:51You can get pretty realistic animation if you know how to use
- 32:53their software. There are software here is
- 32:55actually the most important part.
- 32:57However, you don't want to go ahead and do that because if
- 32:59you're doing a scene and you're acting would like the mocap suit
- 33:02of Rococo, you want to record your facial motion, at the same
- 33:06time, not separately sitting still like this.
- 33:08You cannot have a fight scene and be like, Oh, I'm gonna kill
- 33:11you right now. You know what I mean?
- 33:12Like, it's gonna be really hard to do.
- 33:14You can but various so difficult.
- 33:16Yeah, exactly. So you can't both of these face
- 33:19where and Face could have the capability to allow you to
- 33:23record your own animation from iPhone or DSLR but not
- 33:28recommended, but you can. But essentially both software's
- 33:32allow you to record yourself with these Hardware's or your
- 33:35own. Secondly, you have something
- 33:37called the tracker in the tracker.
- 33:40You use the software to put landmarks on your eyebrows, on
- 33:43your eyes, and your mouth and lips.
- 33:46And what the tracker does is, it has an auto track button and
- 33:49using the auto track. It will sort of go through all
- 33:52the frames in the video and see where these movements go and
- 33:55essentially Trace these lines. Usually you end up with
- 33:59something that is 50% done and so you need to go ahead and
- 34:02manually keyframe the modify, the modifications that you want
- 34:07and that can take a couple of hours if you're gud or something
- 34:10to be a day or two, if you're not good, if you're a beginner,
- 34:13and what happens after the tracker, is now, the software
- 34:16knows, okay? These are where the lips are and
- 34:19all that. Then you need to go to the
- 34:20retargeting And it works exactly the same for both faces grinning
- 34:23face where you go to the retargeting where you'll
- 34:26download your 3D character. So this is your target Ride,
- 34:30Like it, Like a Monster or whatever.
- 34:32Exactly. Okay.
- 34:32So your 3D character because sometimes your 3D character, not
- 34:35sometimes most of the time it's not going to have the exact same
- 34:38faces you unless it's your own face which is one percent of the
- 34:42time. So you need to then map,
- 34:44whatever these this tracker has done into the 3D characters face
- 34:50rig. Facerig into the facerig by
- 34:52mapping. You mean like to Define that
- 34:54this is the right, I brought. This is the left eyebrow, or you
- 34:57have to say this is where the eyebrows starts with the
- 34:59eyebrow. And you've already done that,
- 35:00right? That's what we talked about,
- 35:01like, the facerig and talk about the blend shapes.
- 35:03Like, before you go into the retarget, other, you've already
- 35:06defined a facerig for your character, your character needs
- 35:09to have a phone so you know, already by that stage when you
- 35:11get there. Yes.
- 35:12So it knows where the eyebrows are but it doesn't know relative
- 35:16to your smile. How should the characters smile?
- 35:19Okay, relative to your. Out raised, how should the
- 35:22character do the eyebrow raised. So that's what you're going to
- 35:25do in the tracker. The software knows for like,
- 35:27let's say this 500 frames, right?
- 35:30And the audio track does a decent job for like 400 frames.
- 35:33But like for other 100 frames you to manually, go in between
- 35:36and fix them. That's why it's going to take a
- 35:38while couple of hours. And the more time you spend
- 35:41here, the better the animation is going to be when you go to
- 35:43retarget, ER when you go to Every targeter you click a
- 35:45button and boom, the animation is now onto the face of your 3D
- 35:49character. However, When you're smiling,
- 35:52maybe the smile. Doesn't look so good on the 3D
- 35:55character. That's where you need to
- 35:56essentially. Do the same thing that you did
- 35:58in the tracker. Go through all the frames and
- 36:00manually, fix the big Expressions that you think
- 36:04should look different using the face.
- 36:06Rick, that is available to the 3D character.
- 36:09So basically, for example, if you were smiling a lot or
- 36:12laughing in the scene and now you saw the character is not
- 36:15laughing as much. You can go and just stretch the
- 36:18lips a bit more, add more expression.
- 36:21So, I mean, it goes back to the same thing that we discussed
- 36:23with body motion capture, no matter how good or accurate you
- 36:26get it, there is still some manual work involved to improve
- 36:30and enhance to make sure every frame is reflecting our goal at
- 36:33a target for the character, right?
- 36:35That's partially true because of a technology called artificial
- 36:40intelligent. Like we just got five thousand
- 36:42dollar thing that you want to bring.
- 36:43Yeah. Yes, we are going to cover that.
- 36:45So, yes, manually solving that's called manually solving what
- 36:49we're doing on till this step, which is Is true.
- 36:51For every motion capture that is existed to this day because they
- 36:55you need to manually solve. If we want the perfect
- 36:57animation, you need to still make some modifications and they
- 36:59do the same thing for movies. I'll explain and I'll finish
- 37:03what the software do and I'll go to the AI part.
- 37:05So what happens is in the retargeting want to do fix all
- 37:08those frames. Then you keep recalibrating and
- 37:11when you recalibrate, it starts using the tracker' information.
- 37:16And your retargeting information that you just modify, mix them
- 37:19up to recreate the Chin. And then once you're happy with
- 37:22what you got, you export out an fbx file of the rig and put it
- 37:26into your 3D software and boom, you've got realistic facial
- 37:30animation, very quickly, you record your face, you track the
- 37:35landmarks on your face. And then you re Target those
- 37:38tracks onto the 3D character and that's essentially how you use a
- 37:43face code or face where software to create realistic facial
- 37:46animation. Now this step can take somewhere
- 37:49between A day to a week makes a whole week for like a 30-second
- 37:55animation, but you will get Thanos level animation.
- 37:59That is why we're here today now.
- 38:03You know, something about face good.
- 38:05Why is face good? So interesting.
- 38:07So there is so there are different tiers are so, there
- 38:10are so many. You want to get a studio level
- 38:13HMC, you have to pay the price for the device itself, which is
- 38:17how much, how much we paid for this 400.
- 38:19Let's just say, if you want to, just set up a GoPro and a and a
- 38:23cap yourself, you will cost you around the thousand bucks.
- 38:27There is literally people who made that and are selling it for
- 38:301,500, ready for you. GoPro and the head Mount gear
- 38:35for face where I believe their head on camera cause around five
- 38:40thousand dollars. Just this said I swear not this
- 38:44not this one phase phase they swear yeah okay base good
- 38:48release this headset a couple months ago we were one of the
- 38:51first guys who bought it on the same day.
- 38:53Actually were one of the top ten.
- 38:55I think we bought it, right? If I like when they opened it
- 38:58and we bought it, right? We were there.
- 39:00It costs 400 and $69 doesn't make sense.
- 39:05It doesn't fucking make sense. This head.
- 39:08Mount camera is the cheapest, hit Mount camera we've ever
- 39:12seen. It's the most affordable and it
- 39:14works better than half or maybe most of the head man cameras.
- 39:17Why he has infrared camera, which means it doesn't blast
- 39:22lights in your face. If you go and look at movies,
- 39:24when the recording to character does like two lights interface
- 39:26that fucks with your eyes, there's no lights here infrared
- 39:29camera. Any lighting scenario doesn't
- 39:32fucking matter. It records your face.
- 39:34The same way in the dark in the light position.
- 39:38It has a microphone really it has a microphone so you can
- 39:42record your voice at the same time and it costs 400 something
- 39:47dollars. So this is for the hardware.
- 39:49Now, imagine you recorded your footage and now you want to go
- 39:51through the steps that we talked about what is the cost of the
- 39:54software. Very nice.
- 39:56It's fucking free, can it, okay? It's unbelievable.
- 40:00You know why? It's unbelievable because, and
- 40:02we're not trying to shit on face.
- 40:04We're here. Okay, face, where has been used
- 40:07for? Literally, a lot of the AAA
- 40:09Title Games movies VFX in, in any sort of, you know, domain
- 40:14and they are one of the industry-leading standards and
- 40:18one of the or D I think they are.
- 40:20There are other ones too, but baster is super big, super
- 40:23famous and that's because they do an amazing job at creating
- 40:27realistic animation. How much how much it cost a face
- 40:29where. So this is the thing I was
- 40:31looking at the website And we can put the numbers for you, but
- 40:34essentially, there's like different numbers because they
- 40:36have like, the year lead the monthly, but all of these
- 40:39processes like the tracker know the device L talking about the
- 40:42device itself. 5000, and minimum.
- 40:44Well, just this just this okay with a GoPro.
- 40:48Wow. So if you are a studio who has a
- 40:50lot of money to burn, then you can afford that.
- 40:53But yeah, I mean 400 25, thousands, huge like 10x.
- 40:57You know what's crazy? Please could has another head
- 41:00Mount camera P 1. This is the D2.
- 41:03There's a P1 Hedges that previous version, right?
- 41:06Previous world like no, no, a higher level version.
- 41:08It's cause like, 10,000. I think $10.
- 41:11This is why it was crazy because I saw the announcement, they
- 41:13kept saying we're going to be announcing something crazy.
- 41:15No one's going to believe it. I was like okay what is going to
- 41:17be the price like two thousand dollars like denounced and it's
- 41:21like 400 something dollars and it just doesn't make any sense.
- 41:24Like people who know anything about motion-capture know, this
- 41:27is the biggest deal in the movie industry and so what I'm going
- 41:32to put down Paper today is you're going to see a lot of
- 41:36freelance, a lot of small Indie Studios, get in on this guy
- 41:40right here. It's the same concept as Rococo
- 41:41like, Rococo is Affordable. When it comes to motion capture.
- 41:45These could is doing the same exact thing, but keeping the
- 41:48quality make it affordable. Small Studios can come in and
- 41:51can create content and not. Everybody is making it to our
- 41:55movie, right? You can making so sorry, I can
- 41:56tell you that music videos advertisement like you can you
- 42:00you should be like you could be creating a clip.
- 42:02Which is like 20 seconds. 10 seconds.
- 42:04Yeah. Like it won't take you that much
- 42:06time and you don't have that much big-budget dry.
- 42:08Very good are making like short films you are making like a lot
- 42:11of I would say applications out of these AAA movies that takes
- 42:16you know hours or years to build our with all this like you know
- 42:20devices. Yeah.
- 42:21I think that but I remember so so you explain all of this to
- 42:25me, then there was a catch that you said oh remember the manual
- 42:29process that I told you will take you one day to one week.
- 42:32There is a way to automate it. There is a way to get rid of
- 42:36that one week and do it in a matter of what hours almost live
- 42:41almost live. Yeah.
- 42:42But it comes with a price as you just come with a price and
- 42:45that's something that people need to be aware of.
- 42:47So, you're absolutely right face.
- 42:50Good is absolutely free to software is completely free for
- 42:53you to use to create the manual salt and this only cost under
- 42:57500 bucks so anybody can get in on this literally anybody even a
- 43:01college student But recently they're using loads of
- 43:06artificial intelligence who doesn't nowadays everybody like
- 43:09whatever you want to do create caption without artificial.
- 43:12Artificial intelligence presentations make images like
- 43:16yeah, it's bound to come in. Right.
- 43:18So what essentially you can do is you can use artificial
- 43:21intelligence to greatly enhance your tracking by different
- 43:26methods. One is the real-time method.
- 43:28So real-time the quality of this is a our kit.
- 43:30So do you say our kid for real time as well?
- 43:32You can do a live preview but with the artificial intelligence
- 43:36part of the software, you can essentially have really good
- 43:40animation in real time. And on top of that, you can use
- 43:44your own face to train the data. So the next time you're using
- 43:48auto track, it knows exactly your face.
- 43:51So it tracks better, a tracks faster and then you can retarget
- 43:54faster. So this comes at a hefty price
- 43:57of five thousand dollars. When I say Hefty, I'm talking
- 44:01about Hefty compared to the fact that it's absolutely free when
- 44:04you talk about the, you know, the metal salt.
- 44:06But if you are somebody like a small Studio, honestly, if you
- 44:10have a big client, if you have a brand who are working with
- 44:12probably 5,000. Is it a year?
- 44:14It's for one year. Yeah, it's like talking about
- 44:16this for years, not Staffing. If you are getting really
- 44:18clients like big not even, I wouldn't call it Big clients.
- 44:21If you are getting 1 million project yeah it will cover
- 44:25everything and how much time do you save?
- 44:27Ellen order doing that. So now you're using AI to what
- 44:32do I call? Enhance your facial motion
- 44:34capture or to enhance it, and increase the speed.
- 44:37And so using AI to enhance and increase speed of your motion
- 44:40capture. That's right.
- 44:41That's right. There's a lot of other features
- 44:43are adding. But again, a lot of it is in
- 44:45beta. If you guys want to find out
- 44:47more, go to Avatar, effaced good, they have a Twitter
- 44:49account and their website and a Discord Channel.
- 44:53They essentially are working every day to create better
- 44:57software. So they're training their AI
- 44:59models. All of this is improving and And
- 45:02even there, even the free version, if you think about the
- 45:04audio track is going to get better over time, because the
- 45:07more faces they train themselves, the auto track get
- 45:10stronger. So this is a very promising
- 45:12piece of tech and a promising company.
- 45:15And the reason why we were talking about base good in
- 45:18specifics is we forgot to mention his face, where is still
- 45:22amazing? Sometimes you might get better
- 45:24performance out of face where sometimes maybe better
- 45:26performance out of face. Could it really depends on the
- 45:28Artist as well? But essentially the reason why
- 45:31we're talking about this is because I swear for each part of
- 45:34the software for the tracker, there's a monthly price for the
- 45:37retarget. ER, there's another monthly
- 45:39price. It is another thing called face
- 45:41for Studio which is for live preview, there's another price
- 45:44for that, right? And the head Mount camera also
- 45:47comes at a price as more expensive.
- 45:48So, unless you're a AAA title Studio, I'd say it's harder for
- 45:52anybody to get into investing into something called face,
- 45:56where where you definitely have to have a lot of a budget.
- 46:00Yeah. So you know what I love.
- 46:02To do like enough every episode to create a flow chart, you
- 46:05know, have you seen those flowchart that they will say, do
- 46:07you have a budget? Yes.
- 46:09No. If yes, then your head go by
- 46:11this know, then. Do you have client?
- 46:13Who's paying you? Yes.
- 46:14No. So, if you create that and I
- 46:16think by this episode we covered so many things.
- 46:18Are you a beginner? So I will do a wrap-up a quick
- 46:21wrap-up of what be said. So if you are beginner, if you
- 46:24haven't used facial motion capture, there are free tools
- 46:28out there to try and is as simple as using your phone and
- 46:31just download again. Location.
- 46:33Very, if you are a little bit, you want to do something more
- 46:36complicated, you want to spend some money, there are Studio
- 46:38level gears that you can, you know, afford and you can buy to
- 46:42create to create your facial motion capture.
- 46:44One of them is face school, which is under $500.
- 46:47The software is free. If you want to spend more money,
- 46:49if you want to save time, you can subscribe to their AI
- 46:52enhancer or whatever. Whatever.
- 46:53Yeah, it's essentially Enterprise Edition.
- 46:55Okay? Even call Enterprise because
- 46:57it's meant for Enterprises, right?
- 46:58To make sense. They are a lot of people wanted
- 47:01to try to are Also they are they're considering actually a
- 47:05monthly subscription doesn't which is I guess is going to be
- 47:09around a hundred two hundred dollars a month to still pricey
- 47:11but at least you get to pay monthly.
- 47:13So for example, I just want to use it this month, then I can
- 47:16just subscribe for one month, pay 100, 200 bucks and use all
- 47:19of my animations within record. All my animations within that
- 47:22month and then I have to untie, can unsubscribe after that.
- 47:25So they're thinking of that model.
- 47:26So it's still very, very new ride like this, this just came
- 47:29out like, two, three months ago and then this came up to three
- 47:31months ago, but Avatar. It has been there for a while.
- 47:33Okay, makes sense. No, I think.
- 47:35Now the people who are watching, this will have a great idea of,
- 47:39you know, how to start, where do they go?
- 47:40And if you have any question, just leave it in the comments,
- 47:43right? We can answer.
- 47:44And if you know any other solution in the other device
- 47:47that we didn't cover today, put it in the comments, we would
- 47:49love to do research, probably not going to buy it because we
- 47:52generate money on this but I mean we are going to do research
- 47:56and we're going to talk about it in the next upcoming episode.
- 47:58Yeah, so this is episode 4 and it's going really Sorry before
- 48:03you have been finishes, I just want to say one thing for face,
- 48:05where if anybody from Facebook as watching this I just want to
- 48:09point out the fact that we've never tried face for ourself.
- 48:12I've tried to software but you know for you to fully understand
- 48:16the capabilities, you have to have the head Mount camera and
- 48:19the software coupled up together, try it out with like
- 48:21metahumans and all these characters, we would love to try
- 48:23out face where and compare it to something like Facebook.
- 48:26That way will truly know which one is better and even at that
- 48:30point, it might be a little bit difficult because it depends on
- 48:32your Emmanuel solved. But still respect to anybody in
- 48:35the industry who's helping bring affordable or even convenient or
- 48:40highly performant motion capture.
- 48:43But again we have to talk about this because as an indie Studio,
- 48:46ourself as a small Studio we have to go for something that we
- 48:49can afford and we have to go for something that is allowing more
- 48:52people, more artists to use facial motion capture.
- 48:55So and really this speech patterns just opened the gate
- 48:58for face fair to sponsor us if they want to do it.
- 49:02I'm no comments and no. No.
- 49:05But again, I think what we covered here is again is up to
- 49:09you to decide what what device you want to pick up but then
- 49:12it's really depends on what you want to do.
- 49:14Was sort of clients. You have a sort of budgets you
- 49:16want to spend and this is episode 4.
- 49:19Yeah, I think we covered everything.
- 49:21It's been one month that we've been doing this.
- 49:23We are thinking to bring in guests, from Jose episode, 5 6
- 49:287. And if you guys have any
- 49:30recommendation leave them. In the comments, we are going to
- 49:33cover. I would say people who are
- 49:35really in our industry, but we want to cover people who are not
- 49:38also in our industry and get their ideas and get there, you
- 49:41know, feedback about augmented reality, animation, motion
- 49:45capture and all those things. So I think those episodes are
- 49:47going to be interesting. If you really liked this
- 49:50episode, please subscribe. Share it with your friends if
- 49:53you think is useful for them. And I think it's a wrap.
- 49:57I think it's a wrap again, I just want to say thank you for
- 49:59anybody watching this. Get ready for the Yes, I guess
- 50:02they are. We were preparing.
- 50:04So we upgrade our equipment. If you notice, the cables are
- 50:06different, we bought like an audio interface so we can bring
- 50:09in guests and all that just like ferrets said.
- 50:11So we're very excited about upgrading the podcast.
- 50:13And thank you so much for supporting us to this day and
- 50:16what we are going to do is switch.
- 50:17This is a long form of content that you're going to produce.
- 50:19We produce a lot of YouTube shorts which is basically
- 50:22whatever we do with this device has a our or different projects
- 50:25that we have also on our other social is, if you go to
- 50:29Instagram, Tick-Tock Snapchat, Twitter LinkedIn, We also post
- 50:33different materials, based on our R&D projects and Creations.
- 50:37So you guys on the next episode, Peace.