Latest / Bad Decisions Podcast / #15 The Evolution & Application of Immersive Sound Design with Mirko Vogel | Bad Decisions Podcast
Transcript
- 0:00Tomorrow's. Are you ready?
- 0:01Let's go bro. Are you chugging it again?
- 0:03Now you're not talking it anymore.
- 0:05Let me do that. This is not safe and we do not
- 0:09recommend. Anybody do this, do not talk an
- 0:13entire cup of coffee, right? Before you do a podcast or any
- 0:16sort of activity, this is not good.
- 0:18We talked about this with Farhad, we're always spending
- 0:20our time in the visual world, right?
- 0:22Everything we talked about on YouTube on Instagram and
- 0:25Tick-Tock is, is this about creating words?
- 0:27Creating visuals a rxr, Unreal Engine.
- 0:30It's all about visuals. That's right.
- 0:33But we sometimes under appreciate the importance of
- 0:37sound. But as people who create content
- 0:39as people who play games to the last of us to Dead Space Alien
- 0:42Isolation, we watch films, we know the importance of sound,
- 0:46it's their subconsciously, and it's enhancing that experience,
- 0:50and, you know it, when you play a good game, you know, it.
- 0:52When you watch a good movie would like, you know, the
- 0:55rattling of the cage, you hear the rat in the corner, you hear
- 0:58the zombies growling at the back, all these things that add
- 1:01to the immersive experience, but when it's missing, it just
- 1:04destroys the whole experience, right?
- 1:07And the importance of sound is so high that we have to have
- 1:12that conversation here because up until now every gets that we
- 1:15brought on was more so related to the visual World 100% And I
- 1:19think what was actually missing an old.
- 1:21Those conversation to take your experience to the next level is
- 1:25the sound design, but father's voice.
- 1:27Don't you tell us? Who is our guest today?
- 1:29Okay, I'm super excited about this one.
- 1:30Our Guest today is the virtual so of immersive sound.
- 1:35He's the man who's going to make you yourself and your ears
- 1:39pre-existing. Now, he's not just a sound
- 1:41designer or a composer and a sound engineer.
- 1:44He's a Sonic Wizard. Who's projects have taken him to
- 1:46more countries than most people can locate on the map.
- 1:50From indie rock bands, to grammy-winning artist from
- 1:52Netflix to Nintendo. His left is melodic mark across
- 1:56multiple collaborations with our guest.
- 1:59Today, we're going to be discussing the power of
- 2:01immersive, sound the technology behind it, and how he uses it to
- 2:05transport us into other. Dimensions.
- 2:08Our Guest today is a very special one.
- 2:10Everybody who got Mirko Vogel. What's up Marco?
- 2:13Because it going hey guys, great to see you.
- 2:16Well, that was it, that was a great by.
- 2:19Oh, I think I'm going to steal that for myself LinkedIn.
- 2:24You can change your LinkedIn bio to this but I think it's not
- 2:27much better. Thanks, awesome.
- 2:30No, no, no, worries at all. We first of all, it's an honor
- 2:33to have you on the podcast. We are so delighted to speak
- 2:37with you. You but before we even get into
- 2:39anything else, I think if I'm not mistaken, you're the first
- 2:42guest. That is actually here with us in
- 2:44Vancouver. Yeah.
- 2:45Is that rightly like we are in the same city of course, in the
- 2:47same physical place. I think we can Vape through the
- 2:49window. Hey, what's up guys?
- 2:55But a little backstory of, actually how we met.
- 2:58We went beyond far has been to an event.
- 2:59It was a Double Uni night in Vancouver, which we always talk
- 3:03about XR and emerging Tech. And there were three
- 3:06presentations. That day and usually the
- 3:09presentations are about a rxr you know again mostly Visual and
- 3:13then one of the presentations on that day that I think blue
- 3:18everybody. Everybody's mind in the audience
- 3:20was Miracles presentation. When he talked about immersive
- 3:23sound. Those topic that he covered
- 3:26where the topics that people should have known.
- 3:29And honestly, it like me talk to someone after the conference and
- 3:32they were like, oh my God. What was your favorite speech
- 3:34was like, definitely the sound design and they make some sounds
- 3:36and it's the one we did in. Expect honesty, it was the one
- 3:39because you know, there's different presentations when you
- 3:41go to different sort of events and does ones where you expect a
- 3:45lot from, and I like again we come from the visual realm, we
- 3:48are spending most of our time there.
- 3:50I am interested in audio, but I didn't know I'm going to be,
- 3:52like, fascinated for the next 20 minutes.
- 3:55Just hearing this guy talk. So Mirko is that person and and
- 3:58we're, we had to, we had to have a conversation with him.
- 4:01So, right after the presentation, we managed to have
- 4:04a chat with him and ask him to come on deposit.
- 4:06So, first of all, Thank you so much for taking the time to be
- 4:09with us. Yeah, absolutely.
- 4:11And well and I'm glad. I'm glad you enjoyed it.
- 4:14I was a bit. I might my slides my slide
- 4:17presentation definitely had some like Envy of the other speakers
- 4:20that were speaking that night. But I'm glad I'm glad that you
- 4:24found it useful and I'm glad that it sparked some imagination
- 4:27and conversation for you guys. Hundred percent.
- 4:30You started your presentation by telling everybody.
- 4:34What do we mean by immersive sound and what does immersive
- 4:37sound me? Means like can we start our
- 4:39conversation with that here as well?
- 4:41Because I think sound and audio on how we talk about immersive
- 4:45sound is super important. Absolutely.
- 4:48I'm well I think that the best way that we started, I think we
- 4:51might have spoken about it after that presentation of the aw
- 4:54night is that there's sort of there's two for us as a company.
- 4:59And for me as a designer, I think there's sort of two
- 5:02distinct approaches to it. I think it depends on where your
- 5:06content or your audience. It's going to be and I think our
- 5:10approach to immersive sound for 2D displays is it is sort of one
- 5:17approach and you know we as a company we do a lot of work in
- 5:19film and TV and especially here in Vancouver.
- 5:22A lot of Animation work in our normal sort of linear
- 5:26storytelling work and then you know we work in these immersive
- 5:30formats when you're immersed in a screen and I think that the
- 5:33approach to immersive sound or two Rather it must sound to
- 5:39immerse someone in a story. It has these two distinct
- 5:43approaches and you know, with a 2d display, you're really trying
- 5:46to keep somebody's attention at the right place.
- 5:50Sometimes subconsciously, and sometimes very consciously,
- 5:55whereas in a more immersive, displays like a VR display or
- 6:00xra are displays. You're really trying to craft a
- 6:05more human experience. And these two things are very.
- 6:10I think there's like there's two very different approaches to
- 6:12that. So, for film and TV, you're
- 6:15often sort of, you're creating an imagined, an imagined, sort
- 6:21of space for characters to live in and you're trying to create
- 6:25these sort of imagined narratives and in 3D displays
- 6:31while that a lot of those factors.
- 6:34Still hold true. You're really trying to create a
- 6:37more Or human-centric experience we're having something that's
- 6:41whizzing, you know zooming around you the whole time.
- 6:44Actually becomes really distracting because that's not
- 6:46how real life is. And so that's where we, as a
- 6:50company, we're really pushing a lot of our efforts into building
- 6:54these sort of more subjective sound design experiences and the
- 6:59creative approach to that versus in 2D displays where you have, a
- 7:04much more objective approach to how you work.
- 7:07And So yeah, when we talk about immersive sound or immersive
- 7:11storytelling or immersing somebody in a story, we're
- 7:14really talking about these two very different approaches and I
- 7:17think up until now we've got you know, 2D displays is going to be
- 7:21a long and super rich creative history in storytelling.
- 7:25You know, all the way from when Cinema, first started having
- 7:30sound in in with the picture all the way to 2 stereo sound too.
- 7:37To you know, quad quadraphonic sound to 5.1 sound and then two
- 7:42huge theatrical sound systems to Dolby Atmos.
- 7:46And you know, so from a technology perspective we've had
- 7:48this really long kind of Rich history and we've seen a lot of
- 7:52sound artists and filmmakers and storytellers really lean into
- 7:58these new technologies and these new systems really effectively
- 8:03and and we're really just at the starting point with VR and how
- 8:07Street Sounds in these sort of more immersive, these more
- 8:12immersive Technologies and and I think it's a new experience as a
- 8:17creative Community. How do we build, you know, nice
- 8:21places for people to spend time that are that feel creatively.
- 8:25Interesting. But that are also feel a little
- 8:30bit more subconscious and a little bit more human, you know?
- 8:35So that like because when we look at so right now, Right?
- 8:37We're looking at each other through a screen and yeah, what
- 8:40is most important so immersive? Well, but but it kind of is
- 8:45Right. Pardon me.
- 8:48So right now, we're looking at each other through the screen.
- 8:52And what's really important is that we hear each other in this
- 8:55conversation. You know what I'm hearing from,
- 8:58you is a slightly different to what you hearing for me.
- 9:00We're in different spaces, but it's the conversation that's
- 9:03important. What's not important right now
- 9:06is the background So for instance, in this room, we have
- 9:09a little bit of air conditioning hum and, you know, we have like
- 9:12maybe there's some cars idling outside, you guys probably can
- 9:15hear a little bit of traffic and, you know, every now and
- 9:18then so like so police siren or something like that.
- 9:20So what we, what we try to do when we're building these
- 9:24immersive stories in VR or xra, our spaces is that we're trying
- 9:29to build this experience. We're trying to figure out what
- 9:33is important to that person at that very specific moment and
- 9:37we're Trying to, we're trying to not, not just emulate reality /
- 9:42to sort of build like a hyper realistic version of that
- 9:44reality. But most importantly focusing in
- 9:47on what is important to the person experiencing, this thing
- 9:52that's happening and that's going to be different for
- 9:54different content, different for different stories.
- 9:57But it's an important thing to think about, in terms of, like,
- 10:00the focal points of what you're really building these worlds
- 10:03from. And what's interesting about
- 10:06these worlds, like Even in this experience, which, you know, if
- 10:10you look at it face value, it's a fairly two-dimensional kind of
- 10:15communication experience, right? Like, we're on the screen, we're
- 10:18talking to each other. We're sort of looking at each
- 10:20other in the screen. You know, there's yeah, like
- 10:23it's a it's quite a sort of it's a little bit disconnected
- 10:26because we're not here in real life.
- 10:28But but what's in what's important to kind of think about
- 10:32is that we're bringing the right sounds into the experience, the
- 10:36right point and We're not bringing them in as a mono Sound
- 10:41Source, we're bringing them in. Like even though our experience
- 10:45is at this point stereo, I think through this, you know,
- 10:49communication medium. My experience is actually very
- 10:53three-dimensional as is yours. Like you're probably hearing me
- 10:56through your headphones or through speakers and you're
- 10:59hearing the reverberation in the room.
- 11:01You're here, like your experience is different to mine
- 11:04and it's different to the people that are going to be watching
- 11:06this at home. In the offices.
- 11:09So what we try and do is like we're trying to look at that
- 11:12point of view, perspective of that experience and we try and
- 11:16make that as lifelike and three-dimensional as possible.
- 11:19So, if I'm trying, like, if we were to transplant, this looks
- 11:22like my experience into game or into a, you know, some sort of
- 11:28experience in VR or instead of, you know, head-mounted display
- 11:32system if I was to try and emulate my own experience in
- 11:37this. This, I would have to think
- 11:39about the air conditioning hum, the reverberation of the room,
- 11:44the sound of the, the headphones, the sound of my own
- 11:47voice in this space and also what I'm hearing back through
- 11:50the microphone. So there's sort of, you know,
- 11:53every sound that we have, there's these three dimensional
- 11:55layers to the sound and our job has its Founders plan for this.
- 12:00How do you, how do you guys plan for this?
- 12:02Like is it someone like storyboarding visually that it
- 12:05will say that? Oh, I need to walk to this room.
- 12:06Open the door. Do you guys also put that when
- 12:09you're walking is the food step? Then doorknob than aircon in the
- 12:12new room? Is it some kind of story
- 12:14boarding for the sound design as well?
- 12:16Kind of. So we sort of approach it in
- 12:19four categories. So if we're approaching a new,
- 12:23you know, a new thing that we're working on with a new client.
- 12:26We look at we first, look at the scenery.
- 12:30And if I'd take, if I was to take this room, for instance, I
- 12:33would take, okay, what's the size of the room?
- 12:35What's in the room? What's Making sound what you
- 12:38know, what's important to the room.
- 12:40So, you know, if I have to build the character, the personality
- 12:43of this space, I go like well yeah, there's a pipe that kind
- 12:46of runs along here that has like a little bit of a rattle when
- 12:49the air-conditioning's like kicking in.
- 12:51We have a little bit of maybe office noise outside, we have
- 12:55maybe a little bit of traffic but it all very sub perceptions
- 12:59very, very low perception. So but those are all the
- 13:03characteristics of room. And then we have this, the
- 13:05reverberation is some sound You're threatened.
- 13:08So that's the first thing. We have the space that something
- 13:10is happening in, then we have static objects within that space
- 13:14is like I just mentioned, like the little rattle of the air
- 13:16conditioning, you know, that kind of stuff that would be a
- 13:18static object, but it's making noise.
- 13:21And it's always in the same sort of spot but it affects the site
- 13:24like the sound of the room and effects.
- 13:26Actually, the kind of concentration that you have in
- 13:29this room again, like very sub perceptual but important, you
- 13:32know, it's not as silent space then.
- 13:35So we have the space then we have Attic objects.
- 13:38Then we have moving objects. Now, right now there's not a lot
- 13:41of moving objects other than the chair that I'm sitting in which
- 13:45has a little bit of a creek to it when I lean to the side.
- 13:48But that is a moving object, right?
- 13:50Like if I'm to emulate myself in this experience, we have to
- 13:53think about things that are moving and I can't just have a
- 13:56static Creak of a chair. It changed the creek changes
- 13:59depending on where I'm leaning. And so, that movable part is
- 14:04part of what lens the personality to the space.
- 14:07Um, and that goes in for in-game experience, where we might have
- 14:11like something flying through the air, or we might have grass,
- 14:14that's moving, you know, or like Foreigner or like things that
- 14:18are part of the environment that we're trying to capture trees
- 14:23moving, you know, anything like that.
- 14:26And then again like a hyper-realistic versions of that
- 14:28because we want to if we're trying to draw someone's
- 14:31attention to feel cold. You know, we're trying to build
- 14:34this wind that's moving through the space and that.
- 14:37Is part of that's you know, moving movable object design
- 14:42experience and then we have this sort of point of view experience
- 14:46that we're trying to model and that is for instance.
- 14:48Yeah, this is sort of me talking to you guys through this
- 14:51microphone that's up here and the, you know, the sound of my
- 14:55headphones and the sound of my voice in the room.
- 14:59Like, something that's very personal to the person viewing
- 15:02that. And so, when we look in VR,
- 15:06especially where we're serving Lately encapsulated in in an
- 15:10environment and in a story we have to take into account all of
- 15:14those layers and and how they affect one another and how we
- 15:19sort of spec them out. So yeah.
- 15:20So in answer to your question, basically, we look at what the
- 15:24requirements are for each scene, each object, and we analyze it
- 15:28in those sort of, for sort of character traits.
- 15:33And then we look at the types of technologies that we apply to
- 15:37each of those scenes. So, rather than going, like, I
- 15:40will build everything in a Sonic or will only use BB outmuscle.
- 15:43You know, you sort of you have to take like each technology
- 15:47layer has its benefits and its negatives in these sort of
- 15:51stomach, Sonic storytelling. And if I look at, you know what,
- 15:55I've just sort of described we might look at like an ambisonics
- 15:58fear for the static room sound. Then we might look at a mono
- 16:03object for the air conditioning hum, but we might A little bit
- 16:08of like a impulse response Reverb like a 3D Reverb.
- 16:13That is like very again very, very slight.
- 16:16But if I turn my head here, the air-conditioning crackle
- 16:21whatever is happening over here, but I'm still kind of getting
- 16:24the experience of, like, it's actually physically in the room,
- 16:27you know, and then for movable objects, we might go like, well,
- 16:32actually, that's so we might use for the whole project.
- 16:34We might use a Sonic's as a way to represent, three dimensional.
- 16:37Sound, like, what sort of what technology layer do?
- 16:42We need to put in place to build effective movable objects?
- 16:46And are they predetermined paths?
- 16:49Or are they a, they sort of, you know, precisely like, are they
- 16:54procedural in nature? And so again, like every, every
- 16:59object, every layer to this story might have a very
- 17:03different approach to how we create those assets and then how
- 17:06they're implemented Within You know, platform is story a system
- 17:11a game that kind of thing that is super estimating.
- 17:15I'm just listening to all behind the amount of work that goes
- 17:19behind the scenes because when you see, for example, a movie or
- 17:21a game again, the the only concern that people might have
- 17:25is divisions there, looking at it.
- 17:26Like, oh my God, that was really hard to animate but yeah, no
- 17:29one, no one. Well, I would say selling people
- 17:32think about how much work goes behind the scenes in the audio
- 17:36work to make something, Ingrate, and the fact that you, I mean,
- 17:39okay, as someone who's editing, we do try to add in the
- 17:43ambience, sounds right? We have access to like epidemic
- 17:46sounds and, you know, artless are you, I guess a lot of
- 17:48editors would relate and there's all these sounds that we can go
- 17:51and add to, you know, increase the realism in what we create,
- 17:55but you're talking about static objects, or objects, that I
- 17:59never even thought of adding into videos that we put out, how
- 18:02important is it to add all these little detail considering that
- 18:06the Technologies Is available for consumers is not up to
- 18:10standard to what you guys are creating with, because I feel
- 18:12like that's a conversation you had in the presentation.
- 18:15Whereas, for example, you guys spend a ungodly amount of money
- 18:19on devices, you know, in the studio that can create all these
- 18:23amazing audios and sounds and effects, whereas people will be
- 18:28most people will be listening to them on their iPhones or Android
- 18:32devices. Maybe not even with headphones,
- 18:34they're looking at this content through the speakers of their
- 18:37phone. How much of these sounds are
- 18:38actually later on propagated into these speakers and actually
- 18:42listen to how much of that is lost through this transition
- 18:46from your studio to people's, you know, devices.
- 18:49Well, I think so, I sort of two parts to this question for me.
- 18:53I think in terms of, you know, our approach and the work that
- 18:58we do like our job is sound, designers is to create,
- 19:02especially in, you know, immersive environments is to
- 19:06create Is to model nature, and that's not to like emulate
- 19:10nature, but it's to model how we interact with the natural world.
- 19:14And the reason why we do these many, many steps as because
- 19:18nature is complicated and, and an infinite in its in, its, you
- 19:25know, in our relationship as humans to the world around us us
- 19:29being part of that natural, ecosystem of the world.
- 19:33It's a complex relationship and, and there's four of Us.
- 19:37There's a lot of ego in our like, you know, naughty go in
- 19:41the negative sense, but there's ego as in like, we're egocentric
- 19:45beings. And so we expect things to be
- 19:47modeled after our own personal preference, when we talk about
- 19:50technology and content. So our job as designers is to
- 19:55please the ego of the person and to do the best job possible to
- 20:01sort of encapsulate what makes nature and the world around us
- 20:06interesting to be in. And to sort of distill that down
- 20:09into something that's, you know, palatable for a specific
- 20:12experience. The way that we sort of look at
- 20:16consumer technology and the sound reproduction is we look at
- 20:21modeling the highest possible standard of creative of work.
- 20:26Not just creative work. But in terms of sound, how
- 20:30people listen to these things will continue to change over the
- 20:34next, like four little to continue to change forever.
- 20:37You know it'll go I mean if I have to make some predictions
- 20:41into in terms of AR and and how these Technologies might improve
- 20:45over time. Yeah.
- 20:47Right now we've got a lot of you know, mono speakers on the
- 20:50bottom of our telephones, you know where we listen to to stuff
- 20:56but and and we always have to cater to the lowest common
- 20:59denominator to make sure that our work functions properly on
- 21:03these devices. Now, technology companies do
- 21:06actually a pretty good Job of just doing some of that
- 21:09distilling for us so that we can deliver a really high Rich kind
- 21:16of experience high-quality and Rich experience and it will
- 21:19translate as best as it can through these.
- 21:22Through the little speakers at the bottom of a telephone now is
- 21:27wearing, you know, a better pair of headphones, a better
- 21:29experience. Like yes, of course, is it
- 21:32playing through? You know, a five hundred
- 21:34thousand dollar speaker system. Going to be a better experience,
- 21:36like yeah. Absolutely.
- 21:38But the good thing is that a lot of these technology companies
- 21:43that you know, also fighting for a better user experience, if we
- 21:48give them more to work. With, the end result will be
- 21:51better regardless of the platform of the all the system
- 21:55that you're listening to it on but we want our work to
- 21:58translate as best as it can in all formats.
- 22:02And so we could generally concentrate not on the lowest
- 22:06common denominator. We always check our work there,
- 22:09but we concentrate on what is the most high-end Rich
- 22:13experience and then we let the technology layer that technology
- 22:17companies do the distiller distilling for us and to
- 22:21represent the best possible quality for that device for that
- 22:25user. All right there.
- 22:27Sorry. Now just let us, who do you
- 22:29think is doing the best work in things like doing that?
- 22:32Like I'm not talking about like the most expensive.
- 22:35I don't know if the most expensive is that The best in
- 22:37this category but you know, we have apple are pods.
- 22:40We have Sony, we have both like, which one do you think is doing
- 22:43the best job in translating? All these audio work?
- 22:46Well, I think there's there's a couple of companies doing really
- 22:50great work. I mean, if I have to sort of
- 22:51look at headphone companies, you know, Apple being one of them I
- 22:57think apple is probably a few steps ahead in terms of having a
- 23:01robust ecosystem, for the specialization of sound.
- 23:06And they're one of the Few companies that sort of do
- 23:09everything, you know, like they build the phone, they build the
- 23:12headphones, they build the editing platforms.
- 23:16They build the content creation systems.
- 23:18They have the content streaming system.
- 23:21So they are sort of one of the only end-to-end systems of all
- 23:25the way from creating content to listening and experiencing it so
- 23:29they can control the production Pipeline and they can sort of
- 23:32set some standards of how things work.
- 23:35So Apple do a Great job of that. What they don't do a great job
- 23:39of is making it cost-effective, you know.
- 23:42So really just to experience you know like whatever they're like
- 23:48a huge company and they do amazing work and there's a lot
- 23:51of really smart people that work there and there's a reason why
- 23:55they make those decisions I completely understand why they
- 23:58make those decisions. I think the only negative is
- 24:01like yeah it doesn't you know like an 800 dollar pair of
- 24:06headphones. It's not accessible to most
- 24:09people, like there's a few people that will be willing to
- 24:12spend that kind of money on that system.
- 24:15But ultimately, what we need is we need an accessible standard
- 24:18for all companies that that they can work too.
- 24:22And so, yeah. So back to your question, if we
- 24:24look at like, okay Apple great system, I mean, we, you know, we
- 24:28use it here, we have a bunch of those are pod, max headphones,
- 24:32they sound phenomenal. This isn't a sales pitch for
- 24:35those headphones that I would change about them but they're
- 24:40you know it's a fantastic product.
- 24:43They are pod Max's. Yeah.
- 24:45Like you know they sound okay I think they don't they're not the
- 24:48best sounding airpot Air Bud you know like the buds things.
- 24:52But the but they're pretty good. I think Sony is doing a
- 24:57fantastic job with their, you know, headphones their noise
- 25:01cancelling stuff is amazing. The user experience is great.
- 25:04It's, you know, it's a better kind of price point.
- 25:07Bo's obviously do an amazing job and, you know, have pushed the
- 25:11envelope like really really pushed how people consume audio
- 25:18especially when traveling. And I mean there's countless
- 25:22others. Like if we're talking about the
- 25:24headphone realm is lots of great sound reproduction, technology
- 25:28companies as well. I mean, mark one spatial is an
- 25:30amazing system that that, you know, really does a lot for Ders
- 25:37and encapsulate, it's a lot of robust Technologies, including
- 25:41ambisonics and Dolby Atmos streams and stereo and 51.
- 25:46Obviously Dolby do it. You know, are doing a great job,
- 25:50you know, all these companies. They're all genuinely trying to
- 25:54do to have a better user experience.
- 25:56If the only really critical point that I think we have, and
- 26:00I think we're sort of, at this Junction point of of consumer
- 26:04Tech creative content make like Creatives and content makers.
- 26:11We're at this Nexus point where we have companies that are
- 26:13essentially trying to Silo people into a specific workflow
- 26:17and into a specific type of technology and you know Dolby
- 26:22with Atmos is doing a great job of convincing people that that's
- 26:26what they should be doing and it's a great system and
- 26:29definitely has a huge role to play in how immersive audio
- 26:33works. The one thing that we don't have
- 26:35and I hope that this, you know, Might spark some conversation
- 26:39with your viewers and maybe amongst yourselves to that.
- 26:42What we don't have is we don't have a good open standard for
- 26:45the translation of gyroscopic data from headphones.
- 26:51So, if I look at like apples system and we talked a little
- 26:54bit about this at that awwe night, Apple had because of its
- 26:58closed ecosystem, it can go like, okay, we interpret the
- 27:02gyroscopic data from the headphones like this and our DS
- 27:06p-- on the computer. Reads it in this certain way.
- 27:09So, but there's really only three streams that come from the
- 27:11headphones which is pitch, yaw and roll.
- 27:15And so there's really only three things that the computer needs
- 27:18to read from the headphones, or the device needs to read from
- 27:21the headphones, in early in order to interpret, the
- 27:24specialization of the specific data stream that's coming in.
- 27:30But because it's up all it's closed.
- 27:32And it's closed to only their products, which means you can't
- 27:36plug in a Bose headphones that might be more in your price
- 27:40point or more to your preference as a Creator and take advantage
- 27:45of specialization. Within those systems with head
- 27:49tracking, you can get binaural specialization on every device
- 27:53but with head tracking. So you can really as a Creator,
- 27:57hear how that your work sounds, there is nothing like that.
- 28:01And so my hope is through these, you know, conversations that
- 28:05we're having an For us the meetings that we have with a lot
- 28:08of these companies is that we can start to build a bit of
- 28:12momentum behind this idea that we need an open, an open
- 28:19standard for the forehead phone tracking.
- 28:22And if you can do that, then all of a sudden, I think we'll see
- 28:26that world of immersive audio open up, not only in terms of
- 28:31what creators can do. But in terms of the consumer
- 28:35experience that people might have So that if you have an
- 28:38Android phone and you choose to buy some Sony headphones, you'll
- 28:43get full 360 degrees. Spatialization.
- 28:47On those headphones, you don't have to buy the Google
- 28:52headphones, all the Apple things, like whatever it is, you
- 28:55know, it's like currently we're like, we're very like all these
- 28:58companies are very protective I guess rightly.
- 29:00So there's a lot of R&D lot of money that goes into building
- 29:03these things, but I think it's now time.
- 29:07Time to start talking about the like having some sort of open
- 29:10standard for, for the, for being able to read headphone tracking
- 29:14data. So that creators can start to
- 29:17experiment with this more can start educating themselves more?
- 29:21How important this work might be in terms of their, in terms of
- 29:24their own work and their own output.
- 29:27And to give consumers a greater degree of choice and freedom in
- 29:32how they experiencing that work. And I think if we really want to
- 29:35build an immersive future for ourselves, Selves in terms of
- 29:38like whether that's augmented reality or mixed reality or
- 29:43virtual reality or 2D displays more objective ways of consuming
- 29:49and interacting with the world, we have to have these.
- 29:53We have to have that conversation and we have to
- 29:55build you know as a system that is that is open to all and open
- 30:00to all device manufacturers. So that whether you have, you
- 30:04know, an apple VR display or a TC display or like whatever
- 30:10magic leap display, whatever display you using and whatever.
- 30:15That's going to look like in the future.
- 30:17There's a democratization to the process of accessing this
- 30:23immersive content. And I think that is, that's sort
- 30:27of the biggest. I think the biggest hurdle that,
- 30:30you know, you were sort of talking like, what's the jumping
- 30:32Point into the like, from from a consumers perspective, like how
- 30:36do you work with that? That's the biggest hurdle, the
- 30:39device isn't the problem. There's amazing devices that
- 30:42have more than enough, DSP power to do this.
- 30:45There's the the steps the stuff is already built in to the
- 30:48system. And and I think that like, that
- 30:53is the biggest. That's the biggest hurdle.
- 30:55The biggest hurdle isn't the device.
- 30:57It's how it's, How We, it's how we, as a community of creators,
- 31:01can maybe rally to build some of these Open Standards, so that
- 31:05the interpretation layer for that work Work is more robust.
- 31:11I have a question in regard, we talked about device so headphone
- 31:14and an iPhone, assuming or iPhone does the platform also
- 31:18matters. So if I listen to music on
- 31:20Spotify or apple music, is there any differences where they
- 31:25control the way that the sound is translated or no solely by
- 31:28the device on which is iPhone or Android?
- 31:31Yes. So, I mean, there's a between,
- 31:34in terms of music, there's a big difference, currently between
- 31:38apple music and Spotify. Fi and that, is that Apple
- 31:41music, Apple music hosts Dolby, Atmos content as their special
- 31:47spatial audio format, which is amazing.
- 31:50And we, you know, we have as a company, we've done a lot of
- 31:53work, both in terms of music mixing for Dolby Atmos as well
- 31:58as you know, audio books like immersive audio stories that are
- 32:03Audio Only and they sound super awesome on Apple music Spotify.
- 32:10Stereo only. And so you'll only ever really
- 32:13get a two channel content and I think this is, but this is
- 32:17partly to do with the fact that there is no open standard for
- 32:21the specialization of music, right?
- 32:25Not everybody that has a Spotify account has Spotify headphones.
- 32:30There's no such thing as Spotify headphones, right?
- 32:32So if you, if you, if you're accompanying, you look at you go
- 32:36like Spotify. Okay, we're on every platform
- 32:39where On Android devices, we're on Linux devices.
- 32:44We're on iOS everywhere, like Windows, we're on every single
- 32:49device. Including Chrome OS, right, when
- 32:52everything. So if, if we are to build a
- 32:56specialized space, if we're to adopt as a company, if I'm
- 32:59speaking on spotify's behalf of, we are to adopt a specialization
- 33:03format, it makes sense for that to be Dolby Atmos.
- 33:06Okay. Cool.
- 33:07You know, great, however, Currently there's only one
- 33:11platform where you can listen to that content and it's apple and
- 33:15so you're directly compare directly competing with their
- 33:19own platform with their own specialization system and their
- 33:24own headphone ecosystem. And so I don't think we're going
- 33:28to see. We're going we're not going to
- 33:31see Spotify, be be an immersive audio platform until there's a
- 33:36universal way for people to access that At Specialized
- 33:41content and so, so who has to who has to be new to this opens
- 33:46that are out there. First of all, we're on Spotify,
- 33:48we need to think a switch quick way to get that open standard
- 33:52out there. You know?
- 33:53And look and I mean something like in spotify's defense, the
- 33:55other things I have a huge music library and to host at most
- 33:59content is data-intensive, you know, like an album of Music In
- 34:04Stereo is around. Maybe like three hundred fifty
- 34:07megabytes or something. Maybe 500 Meg if it's a Record,
- 34:10you know, at full audio down with slits, like 24, 48 or 40
- 34:1541, 16 bit like CD, and above kind of quality at Moss.
- 34:23The an atmosphere in front like for an album you're probably
- 34:26looking at like 13 gig of glass for people who have data just
- 34:34that amount that exact amount for a month on the.
- 34:36Yeah. So that's not gonna be possible
- 34:38to listen to outside, right? So, People.
- 34:40Yeah, so that's I think that's a big hurdle now Apple, I think as
- 34:44a company, you know, they're very wealthy well-run
- 34:47organization that produce a lot of price that people love.
- 34:50So I have a lot of money and I think they can take the data.
- 34:55They can take the data hit as a lost leader to build out an
- 34:58immersive platform which is the right move.
- 35:01And I'm really, really glad that somebody is doing it because
- 35:05it's amazing. But when you look at someone
- 35:08like Spotify that Is that they're only there.
- 35:12Only product is the streaming of content is music and podcasts.
- 35:17And, you know, audio content that like the hit to their
- 35:23bottom line to host to, for the data, hosting of that work.
- 35:28And then the Ingress and egress costs that they would have for
- 35:32their data centers. To do that work is substantial.
- 35:36So there's a huge financial footprint for companies to do
- 35:39this work. Work and I think that's
- 35:41something else that we need to kind of you know that that needs
- 35:44to be taken into consideration. I think that's one is the data
- 35:47bandwidth and the hosting of that work.
- 35:49That's very comes at a very high cost that only a few companies
- 35:53can really afford right now and and then yeah there's obviously
- 35:57you know the end-user limitation of like how many people are
- 36:00actually going to adopt this format as a way to listen to
- 36:04music. So one thing you mention is how
- 36:08companies like the company that you you Work in, you know, you
- 36:11guys are always on the lookout to, to improve the technology to
- 36:15go beyond. And at the same time, there's
- 36:17platforms now that are supporting that, like you
- 36:19mentioned to it like apple, who are caring enough about
- 36:23immersive audio. And of course, I think, as
- 36:25consumers if we have the option, would love to listen to
- 36:28immersive audio. Like there's no doubt about
- 36:30that. Yeah.
- 36:31But what about artists? And I'm talking not just about
- 36:33music artists. I'm talking about artists within
- 36:35the film realm, talking about producers, all these decision
- 36:38makers who are creating the The art, how conservative have they
- 36:43been in using the latest Technologies when it comes to
- 36:46immersive audio? I'm sure you guys have things
- 36:48that you experiment with and probably something that you
- 36:50talked to him about are they always willing to experiment
- 36:53and, you know, have these newer Technologies added into their
- 36:56workflow, or sometimes you shouldn't be like, no, I want to
- 36:59just stick to the old ways of doing things, it normally it
- 37:02normally. So yes, absolutely.
- 37:05So one, there's two answers to that question.
- 37:08What is yes when we show People? What is possible?
- 37:12The general, the general response.
- 37:15Response is a well response. Like wow, like I never knew that
- 37:19you could do this thing and it's particularly impressive when you
- 37:23come into like one of our Studios and you know, you're
- 37:25sitting in a beautiful environment that's of custom
- 37:28builds to experience this work, right?
- 37:31So that's that is there's definitely, you know, it's the
- 37:35most idealistic place to do this but that's why we do our work.
- 37:39So that's where We want people to experience this, the
- 37:41possibilities of this work. Now, the second part to this is
- 37:46like it. Generally comes down to budget
- 37:48and different kinds of content or different work that we do
- 37:52will have different requirements in terms of budget.
- 37:56And we've noticed this a lot, like we were one of the first
- 37:58studios in the UK to have like a full Dolby, Atmos set up many
- 38:03many years ago, and initially when we started working for with
- 38:08content companies like Netflix, Amazon, that there are the
- 38:11initial spec was that everything needed to be an utmost because
- 38:14it's one of the systems that allows you to kind of fold it
- 38:17down into into everything like right down to Mono.
- 38:22So you can go all the way from Super immersive 714 down to 51
- 38:27down to stereo down to Mono. So it was a good format
- 38:32actually, it is a good format for streaming platforms because
- 38:36no matter what you're listening to it on, you'll always get the
- 38:38version that kind of works, you know.
- 38:40It folds down really well. It's like origami you can kind
- 38:43of think of it as origami. Yeah.
- 38:46Takes any show that the initial problem was like, when Dolby
- 38:49Atmos first came out? It's very time-consuming.
- 38:52It's a time-consuming process because you're not just moving
- 38:55things left to right? You're moving things left,
- 38:58right? Up down back, and it's backwards
- 39:00and forwards. So you're finding these
- 39:02positions in the room, where the audio where the world lives and
- 39:06that just by Nature's, is more designed time.
- 39:10More implementation times, you have all these new places where
- 39:13sound can be and the where a lot of especially in film and TV,
- 39:19where a lot of those discussions, kind of, you know,
- 39:24have a jumper, like a jumping off point for a lot of people is
- 39:27when they're like, it's like, oh, that's actually far more
- 39:29time than we had allocated for this work.
- 39:33Now, we don't have that experience in video games
- 39:35because I think in video games and in immersive VR in the
- 39:39Mimosa. Of VR world.
- 39:41The emphasis on what we're doing is different and, and we talk a
- 39:45lot like part of keeping people engaged in a gaming experience
- 39:49or in VR experience is you need this sort of, you know, tactile
- 39:56environmental feeling to it because it's the general
- 40:00experience is much longer than a TV show.
- 40:02It's much longer than a film here, much longer than an
- 40:05animated series. You know, it's not abnormal for
- 40:07someone to play a game for two or three.
- 40:10Five, six hours. Yeah.
- 40:12And over the course of many weeks, and many months, and
- 40:16often you revisiting these experiences year after year, it
- 40:20lives with you, you know? And so, I think game companies
- 40:24and game designers and audio directors are game companies
- 40:28have a very different tasks to filmmakers and storytellers like
- 40:32into D worlds. And so, we generally, when we
- 40:37talk about film TV, if there's a budget for it and it's important
- 40:40to the project then it will generally get greenlit and it'll
- 40:43be part of the experience and we've done some amazing work in
- 40:48that world and even to, you know, so for for documentaries
- 40:52where you wouldn't normally serve take this more immersive
- 40:54approach its lent, it has really enhanced and the like the
- 41:00storytelling aspect of these feature documentaries that we've
- 41:03worked on, but I think the conversation that we have with
- 41:08people in Interactive, Storytelling and video games and
- 41:12obviously in VR and AR applications it's different from
- 41:16the get-go because the whole point of doing that work is to
- 41:19try and keep people engaged in sound and especially immersive
- 41:22sound plays a huge part in engagement.
- 41:25And I think that's actually one of the areas specially in VR
- 41:28where we're at. I mean, it's just my personal
- 41:33belief but I think it's one of the reasons why we haven't seen
- 41:37a huge adoption of VR. As a platform because people
- 41:43have approached sound largely like they have for a TV show or
- 41:47film. And so like, oh yeah, like this
- 41:49work. This is hundred percent agree
- 41:50with that. I've replayed so many of yard
- 41:52games. That's 100% true.
- 41:56So, you know, I think that's part of the that's that's part
- 41:59of the problem in it. And that's really like our job
- 42:02as a sound company is to is to push the envelope in that world
- 42:07into and to use sound as a Thing, that enables someone to
- 42:12feel more at home in the platform.
- 42:15Sound plays a different role in immersive environments as it
- 42:19does in 2D environments. So when we talk about Dolby
- 42:23Atmos, so we talked about ambisonics or these Technologies
- 42:25for sound reproduction and and the engineering of sound, the
- 42:31conversation is different for us for in film TV, as it is
- 42:35compared to VR and immersive display.
- 42:40Allergies because the relationship the human
- 42:42relationship is different. And and I think the financial
- 42:45emphasis of where someone is willing to invest in their world
- 42:49is also slightly different. Now in saying that there are a
- 42:54lot of projects that we do, which have to be in Dolby Atmos
- 42:57and we spend a lot of time and a lot of effort and we put a lot
- 43:02of creativity into that world. So I definitely don't want to
- 43:05diminish. The work that we do in linear
- 43:07content, because we do a lot of work in that in.
- 43:10Is formats, but when we're trying to convince somebody to
- 43:14work in it, it's easier to convince someone in 3D display
- 43:18Technologies versus 2D. And I think that's also partly
- 43:22because filmmakers are still learning the power that these
- 43:26see these technologies have in terms of their own production
- 43:30value. And, you know, when you go to a
- 43:34cinema like it's a, you're looking at a specific place and
- 43:39so, Sound 3D sound has a very different kind of a role in
- 43:44these in when you're just looking in One Direction versus
- 43:50when you can look in all directions, you know.
- 43:52So like if you're looking at a big cinema screen, it makes
- 43:55sense that some things, you know, and they're all built to
- 43:58draw you into this main focal point that you have but and yeah
- 44:05so you know, the likely just the the approach to storytelling and
- 44:08I think the emphasis that filmmakers have It's a
- 44:10different. It's a different kind of
- 44:12approach. And so I think filmmakers are
- 44:15still also very much learning the power of these tools.
- 44:18And I think again it kind of comes down to where people are
- 44:21consuming this work, right? So if the only platform that
- 44:25like, if you're, if you're building a feel, if you're
- 44:27making a film and it's going to go and streaming platform like
- 44:29Amazon or apple plus or Disney or Netflix.
- 44:33Like where are people going to listen to this thing and you're
- 44:36like, okay, they might be watching it in bed on an iPad.
- 44:40Okay, how are they listening to it through the little speakers
- 44:43on the iPad. So automatically from a
- 44:45filmmakers perspective. Like well if we're if that's
- 44:48where it's like, we're going to build for where people are going
- 44:50to be watching this stuff and I think, you know, the only place
- 44:56currently where you can watch something on iPad and get a
- 44:58fully immersive experiences on an Apple iPad with Apple
- 45:02headphones. So until that changes, I think
- 45:07we're missing the education layer for young filmmakers.
- 45:10To start to understand the importance of this of this kind
- 45:13of work. You know, let's talk about that
- 45:16because what you said is so important and I think this is
- 45:19going to bring the most value for everybody watching.
- 45:22We have people who are watching who are like very recently, we
- 45:26met with one of the audiences on YouTube he's creating his own
- 45:30virtual music festival in on your land in five.
- 45:32So he's a DJ you made his own sets and his own background and
- 45:36there's a cameras moving around. Well that's one example, we have
- 45:38people who are creating sin Pneumatics with blender and
- 45:41Unreal Engine. 5, we have content creators or watching or
- 45:44creating for Instagram, and they're just doing quick little
- 45:47videos where can people go? And how can they educate
- 45:51themselves on the power of sound?
- 45:53Everything that you just talked about today?
- 45:54Where can they find all these informations to improve the
- 45:57quality of their sound and also be up-to-date with the
- 45:59technology? I mean, selfishly, I would say
- 46:04you call a great sound designer to help you.
- 46:10I think that a good education start Point like there's not a
- 46:15central place that I would say like go to this place and learn
- 46:18all about the things. I mean, I've talked to people at
- 46:21a building courses on educating people on different immersive,
- 46:24audio Technologies, Dolby has an amazing, you know, knowledge
- 46:28base, and education system of how people can work with Dolby
- 46:31Atmos. I'm sure Apple have something
- 46:35for logic, nuendo cubic. Like if you're working in audio
- 46:39platforms. All of the companies that make
- 46:41these systems have tutorials on how to use them and a lot of
- 46:46the, a lot of these, you can try out for free like, you don't
- 46:49have to spend any money, right? I'm doing it in terms of the
- 46:54can, like, just watching a bunch of stuff or it like immersing
- 46:57yourself. I mean, currently I just say you
- 47:00like go to Apple Store, buy some headphones and you know plug it
- 47:03in and and turn on specialization and listen to it
- 47:06for yourself and you'll hear you'll start to hear, you know
- 47:09how Works. And, and how that might have
- 47:12point. I think one is like immerse
- 47:17yourself in some of this content so that you can hear what people
- 47:20are making and you can hear what you hear, what you like, and
- 47:23what you don't like, you know what?
- 47:27But I think ultimately like, we need the sound.
- 47:31The sound gets the sound communities job in every
- 47:34creative industry, to show people how important this work
- 47:38is. And so that's You know I mean
- 47:40that's one of the reasons why I wanted to talk to you to you
- 47:43both on this call is too kind of is like, this is a it's part of
- 47:48this step of what we can do as a company to also engage with
- 47:51people to talk to people about what we're doing, what we think
- 47:54is important. Why we think it's important to
- 47:57show people why it's important, you know, to welcome people into
- 48:01into our creative process in into our world.
- 48:04So that hopefully we can spark some imagination in people like
- 48:09oh this is Yeah, voice thought about it like this, but this it
- 48:12makes a lot more sense to break it up into this sort of, you
- 48:15know, sort of process and then selfishly, you know, I want to
- 48:19put more people to work in creating great great content.
- 48:23And while we have a really great big team here in Vancouver that
- 48:26does this, and we have teams in Los Angeles.
- 48:29We've got Studios over there and I've in the UK you know all of
- 48:32these Studios that we have. They're all producing immersive
- 48:34audio work every single day for huge platform companies to like
- 48:38small content. Ders.
- 48:41So we as a company are like firmly focused in on this on
- 48:44this world but I think until people it's of experience have
- 48:48their own personal experience, a little bit more, they won't have
- 48:51formed an opinion of why, you know, why they want something a
- 48:55certain way. And so I think there's still
- 48:58kind of an education process to start with, but I would say, you
- 49:02know, borrow or buy a pair of headphones and try it out for
- 49:07yourself and do. Thing is, you know, when if
- 49:11people are like, you know, high-end influences on these
- 49:13platforms and you're going to, you know, the next, you know,
- 49:17whatever Instagram developer conference or you know, these
- 49:20platforms talk to the audio teams there and and talk to them
- 49:25about the limitations of their platform, you know, Instagram is
- 49:29mono and it's the and you know, it has the most a, our content
- 49:34our filters and a our content out there.
- 49:37It's a phenomenal place to tell stories.
- 49:39He's and and to engage with the public, but it's mono looks like
- 49:46and I get it bandwidth data, you know, data bandwidth
- 49:50requirements. The idea I get a get why it's
- 49:53mono, but maybe we should start thinking about this being, you
- 49:57know, a more kind of immersive experience.
- 50:01Same thing with Tick-Tock an amazing storytelling platform
- 50:04for short stories and people, you know, people to interact
- 50:08with each other. Like, it's a Media streaming
- 50:11platform but again, it's it's really really, it's yeah, I
- 50:16think it's mono, it's either mono.
- 50:17Yeah, it's yeah, I'm pretty sure it's mother.
- 50:20It might be YouTube, but is well.
- 50:23So YouTube is what is interesting because YouTube
- 50:26supports ambisonics in its full ambisonics being all directions.
- 50:33Right? In terms of an affectionate like
- 50:35a big glass bubble around your head and so this Yeah, maybe
- 50:40we'll quit. So I'll explain what YouTube is.
- 50:42So YouTube is actually doing a really good job and actually,
- 50:44Google might be one of those companies that might, you know,
- 50:47that they have enough money, they don't build enough of their
- 50:51own Hardware that they're sort of married to it.
- 50:53There there, put the reason why they build Hardware's to
- 50:56Showcase how great Android is, you know.
- 50:58So, they, they their Hardware development is firmly in The
- 51:02Proving Ground, for how amazing this software is and their
- 51:06software is open, right? Anyone can make an Android phone
- 51:09and Android app. So but essentially what what
- 51:13YouTube has is, am be Sonic, first order, a Sonic
- 51:17implementation and what first order and be Sonic is you can
- 51:20imagine it like a big glass bubble around your head and you
- 51:24can move your head inside of this glass bubble like this.
- 51:27So if there's a sound that's here, I'll just put it so my
- 51:31camera can see it. Like here, I don't have my head
- 51:35that sound stays in place and my the vision move.
- 51:39Eve's right? So that's ambisonics then, fixed
- 51:43fixed fixed and be Sonic or binaural.
- 51:46What we would call it is where when you turn your head, the
- 51:49bubble moves with you like this, you know?
- 51:52And so you still get the specialization the room, the 3d
- 51:56effect. But when you move your head
- 51:59inside of it, you don't you don't hear anything.
- 52:02But YouTube supports 360 videos and supports first order a
- 52:08Sonic. So, actually, in terms It being
- 52:10an open platform for you. The use of specialized content
- 52:15whether both Visual and audio content.
- 52:18There is a really robust interpretation layer there and
- 52:21anyone can access it with any headphones.
- 52:25So that might actually in terms of Education, that might
- 52:28actually be a good place to start, is to look at plug some
- 52:31headphones into your computer, go to YouTube Type in 360 audio
- 52:35experience, or whatever. And, and you should Be able to
- 52:40find a bunch of content that helps you understand how audio
- 52:44specialization works. And right, I think that's
- 52:48actually a really, that might actually be the best education
- 52:51point because it's free and it's, and it just works, you
- 52:54know? And it works with most
- 52:56headphones, right? It's not, you had fun, you don't
- 52:58have to have an apple, okay? That's great.
- 53:01Actually, it doesn't have to be what any, any pair of
- 53:03headphones, you can plug in. And as you move the 360 video
- 53:07around, you should hear the sounds kind of Shift and change.
- 53:10Now it doesn't support head tracking currently.
- 53:13So again everybody open standard for interpretation but you can
- 53:20imagine once you have that and like you know you can use a VR
- 53:24headset to watch the 360 YouTube video and get head tracking
- 53:28because the VR headset is doing it but you can't do that with
- 53:32just on your arm on your screen when you say head tracking, that
- 53:35would be as if you get closer to the sound.
- 53:37So if you does that mean like if you Walk you get closer to the
- 53:40Sun or if you just move your head, you get closer to this.
- 53:43It's just initially I think we're just talking about head
- 53:45movement like the getting closer and further away from sound is
- 53:49sort of room-scale spatial audio.
- 53:52And we I mean we're currently developing a game.
- 53:55That is that's really there to Showcase room-scale spatialized
- 54:00audio work. So I mean, that's a year away.
- 54:04But will come. I'll come back and talk to you
- 54:07guys about that. Can't come?
- 54:08Yeah, we gotta talk about that. 100%.
- 54:10But it's but it's some so that yeah, initially I would say
- 54:16you're sitting in a chair and you want to experience the world
- 54:19around you, YouTube 360 is a great place to start and a lot
- 54:23of our work as a company has been to build 360 content for
- 54:28YouTube creators. So we work with this company
- 54:30Shutterstock and we launched a huge ambisonics, music library,
- 54:35so specifically for people working in 360.
- 54:39So, First order a Sonic. So it's fairly low-resolution
- 54:42spatial audio but it's low bandwidth.
- 54:44It's only four channels and it works natively in YouTube.
- 54:47That's why we wanted to make it. So you know currently there's a
- 54:50couple of thousand tracks on on Shutterstock that we've mixed in
- 54:53360 audio and then we've built, you know the world's first 360
- 54:59sound asset catalog and again its built-in ambisonics and 5.1
- 55:05so it sort of applies to filmmakers as much as it does to
- 55:08you know 360. Creators on video creators and I
- 55:12think right now there's probably, I don't know.
- 55:14I think it's somewhere around the 70 to 100 thousand assets
- 55:18living on, on the Shutterstock library, in terms of sound
- 55:21effect usage. So and, you know, we talked to
- 55:24that, we talked to Shutterstock and we wanted to build a tool
- 55:29set for creators. I think that's the other thing.
- 55:31It's like, yeah, some good examples of this work, but but
- 55:34people need tools. They need plugins, they need
- 55:37assets like, you guys use, you know, art.
- 55:39List or epidemic sounds or, you know, these kinds of places.
- 55:43Those places are the place where you go to find something to
- 55:47build with. And so there needs to be places
- 55:50like Shutterstock that have 360 content that content creators
- 55:55can buy for like $5 or something.
- 55:59Plug it into their project because everyone has the budget
- 56:02to hire a, you know, a big sound company to do that work for
- 56:06them. So so I think like my I'm
- 56:09hopeful, we'll Start to see a lot more of that.
- 56:11But a big part of our job, as a sound company, is also to help
- 56:14create that work. And so we do a lot of
- 56:16Partnerships with bigger Brands and bigger companies, to build
- 56:19these asset libraries in these asset catalogs for specific
- 56:25companies for specific usages. And and so that's, you know,
- 56:29another big part of our job is one is the creative bespoke work
- 56:33and then building work for other people to use.
- 56:36But for those that are interested in hiring a sound
- 56:40designer or getting a company to do their sound design, at what
- 56:44stage, they need to consider sound designers to come in.
- 56:48Is it before I start shooting, or is it in my storyboard time,
- 56:52like, varies the place that okay, now is time to consult
- 56:55someone. Now, it's time to start creating
- 56:58in fulfillment TV. It's family.
- 57:01I post production process. So that is you finished your
- 57:04filming? You've Finished.
- 57:07Like it's a very there's a lot of Fairly standardized process
- 57:11unless it's a Christopher Nolan film.
- 57:13And you know there's like some kind of specific aspect to the
- 57:17filmmaking process that requires somebody to work far in advance
- 57:23to create a palette of sound, work to be, put into the film.
- 57:27But for most standard films, you could say, it's a post-process.
- 57:31There's sound design, dialogue, editorial sound mix finish.
- 57:35And And the Project's done for games, and for VR games and VR
- 57:43experiences specifically, I would say the storyboarding part
- 57:47is when you need to start talking about sounds, and we're
- 57:50talking about it in terms of these four layers again because
- 57:54you need to be like, what does this scene feel like?
- 57:57Where does that need to go? And then what are the study
- 58:00objects? Were the moving objects?
- 58:01What's the person feeling? You know what?
- 58:03It's the personal experience. The reason why we do that During
- 58:06the storting storyboarding process is because game and you
- 58:10know, like interactive development is iterative, it's
- 58:14not a linear process. You know, you might design the
- 58:18landscape for a specific level of your game and then you need
- 58:22to test that landscape. You need to test on devices.
- 58:26You need to go. Like, you look, you need to look
- 58:27at optimization and and, and so you might build something, and
- 58:33then you get feedback, and you build optimization systems.
- 58:36Make it the grass better or different color, you know,
- 58:39whatever it is, there might be some interactive work that needs
- 58:42to happen so you need to make sure that things interact
- 58:44properly and slowly and slowly you're sort of building the
- 58:47world. You're building The Story,
- 58:49You're Building the games and you're building this experience.
- 58:51And so sound often is part of that layering of stuff.
- 58:57It's integrated into the process and especially when sound and
- 59:02vision affect each other. You need to, you need to And
- 59:06that interaction. And so, you know, that's all the
- 59:10way from sort of timing. Like when you especially when
- 59:12you're doing like cinematic B and games, you need to pre-plan
- 59:16the timing. And and if it's an immersive
- 59:18asset, you need to be able to test how people how someone
- 59:22might experience this thing. So it's safer game and for VR
- 59:27development. It's an iterative process, so it
- 59:29really helps to be part of that initial storyboarding process in
- 59:33a lot of our linear work, we love being part of the
- 59:36Production planning of the work because it allows us to plan for
- 59:41to be able to do our job better. But if yet to your question is
- 59:47probably these two very distinct processes.
- 59:49I think it's post for film and TV.
- 59:51It is very much from storyboard onwards, if possible, if not
- 59:56from sort of first build stages on words but I think it's more
- 1:00:03important for VR to be integrated.
- 1:00:06Into that production line because it's half of what
- 1:00:09somebody's going to experience. You know, it's half of that,
- 1:00:13it's half of the world. No, I think that's very true
- 1:00:18because we do experience the same thing.
- 1:00:20When we talk about video games I generally believe that is the
- 1:00:23way that things should be because it's like we talked
- 1:00:25about that level of Engagement that you have in a video game is
- 1:00:28very different compared to anything else.
- 1:00:31Since we're almost out of time I have one last question I wanted
- 1:00:34to ask you which is we talked a lot about immersive, audio about
- 1:00:37spatial audio and all these cool Technologies.
- 1:00:40What is out there on the horizon that is coming?
- 1:00:44That people should be expecting in terms?
- 1:00:46Audio technology, or maybe something that is missing that
- 1:00:49you think there should exist that, you would be excited to
- 1:00:53see in the world of audio? Well, so well.
- 1:00:55So I'm excited for two things. One is, I'm really excited to
- 1:00:58see what Google do around immersive audio both in terms of
- 1:01:06the technology layer and also in terms of the the the sort of
- 1:01:12open the openness of those standards.
- 1:01:17Secondly, I'm excited about trying to build an open standard
- 1:01:21for headphone tracking data, and I've mentioned times, but but
- 1:01:27that, like we can't have a great.
- 1:01:31We can't have a great experience unless it's accessible to
- 1:01:33everyone. And that is, that's where I,
- 1:01:37that's why I'm excited about these two things is that, you
- 1:01:41know, when you look at how Google develop their tools and
- 1:01:44their apis, and their systems It's like it is it's very device
- 1:01:49agnostic and I think that's kind of that's what I would love to
- 1:01:54see sort of more of and then I'm excited to see what people
- 1:01:57create with it. You know, when these new things
- 1:01:59have come online and Things become more accessible that with
- 1:02:04that's when we start really seeing, you know, people really
- 1:02:07bringing new ideas into the into these worlds.
- 1:02:10And I my hope is that that will be the the sort of the
- 1:02:15turbocharging of of these immersive display systems and
- 1:02:18Technologies and the sort of The Wider adoption for that as work.
- 1:02:24I think it's probably like a third thing that I'm sort of
- 1:02:26excited about to and that in terms of like creative and
- 1:02:29creative approach to sound design for experiences like as
- 1:02:34we see that adoption growth around VR, instead of more
- 1:02:37immersive. Display Technologies is how they
- 1:02:41will start to become more emphasis on the audio.
- 1:02:46Sign of an experience and it not just in games, but just in terms
- 1:02:50of, even like, UI development and user experience development
- 1:02:56on these systems because you know, the way that our user
- 1:02:59experiences in real life is very, it's not always exciting,
- 1:03:03you know, like picking up a pair of headphones and, you know,
- 1:03:06moving a water bottle around or opening a flippy lid on a thing
- 1:03:11like these, you know, these aren't like exciting sounds.
- 1:03:16But they they give us a lot of comfort and security in terms of
- 1:03:21like, understanding the world around us.
- 1:03:24And as we have more people using these 3D display systems.
- 1:03:29We have to as a as all creators of all content, whether that's,
- 1:03:33you know, a warehouse management system all the way to like, you
- 1:03:38know, as super immersive video game sound, will become a big
- 1:03:42part of the success of failure of these variances.
- 1:03:46And so I'm excited for the Sound Community in general because I
- 1:03:50think we're going to start seeing just necessary emphasis
- 1:03:54on sound more and more as we go into more and more immersive
- 1:03:59Technologies. So and I hope that more and more
- 1:04:03companies start coming to the table.
- 1:04:05Like Google building, these systems, building stuff that's
- 1:04:07more open, more accessible and more Universal, more universally
- 1:04:12sort of applicable in saying that again.
- 1:04:15There's lots of great stuff already out there.
- 1:04:17And you know we're definitely not short of like great tools to
- 1:04:21do great work and you know we've mentioned a bunch of them on
- 1:04:24this call so there's we definitely as a company don't
- 1:04:27play favorites with anything we just use the best tools for the
- 1:04:31job and and the more tools that are out there in the more
- 1:04:34accessible they are the more successful we will be in our
- 1:04:37work and the more successful I think content and you know,
- 1:04:40application creators will be in finding an audience and adoption
- 1:04:44for their for their I work as well.
- 1:04:48Miracle. What is the best way for people
- 1:04:49to reach out to you and your company?
- 1:04:52If they, if they want to, you know, start their sound
- 1:04:54designing for their content. We are games films
- 1:04:57documentaries. So, I mean, look on our website.
- 1:05:00There's all look like depending on where you are in the world,
- 1:05:03you can look at our website and each of our cities have has a
- 1:05:05contact info. My email is Mirko at Vaudeville
- 1:05:10dot TV. It's on our website as well.
- 1:05:13You can obviously find find me on LinkedIn as well.
- 1:05:15If you want to chat to me directly.
- 1:05:17And then yeah, I mean, you know, I'm open to talk to anyone and
- 1:05:21everyone about the work that we do and and I hope that we can
- 1:05:25help people. You know, tell some great
- 1:05:26stories and and expand on what they think might be possible in
- 1:05:31terms of Sonic storytelling and and and and hopefully yeah
- 1:05:36future-proof their content a little bit as well.
- 1:05:38You know, if you build something that lists last for a long time,
- 1:05:41you want to make sure that no matter what the experience is
- 1:05:44right now, that that experience is going to be expanded or
- 1:05:46extended. In the future without having to
- 1:05:49rebuild everything from scratch. Well it's been honestly a
- 1:05:53pleasure speaking with you. We couldn't get more excited
- 1:05:56about audio after speaking with you for for about an hour.
- 1:06:00And we're definitely going to be taking in everything you
- 1:06:02mentioned and and thinking through the way we incorporate
- 1:06:06audio into our work and I'm sure everybody watching will be doing
- 1:06:09that as well. And at the same time, hopefully
- 1:06:12by the next time you have this conversation, we do see that I
- 1:06:15guess VR game that you guys were talking about the spatial audio
- 1:06:18that you guys are working on. Plus the open standard is
- 1:06:21something we're looking for. To see happen.
- 1:06:23One prediction before we go. Do you think it's going to
- 1:06:26happen any time soon to open standard?
- 1:06:27You see that as well? I, the more people I speak to
- 1:06:32about the more. I think it will happen.
- 1:06:34It will take a while honestly. Like it's, it'll be like, you
- 1:06:37know, the matter standard for iot devices that kind of came
- 1:06:42about. I think it'll be something like
- 1:06:45that. To be honest, it'll be like a
- 1:06:46bunch of companies getting together a conference and then
- 1:06:49someone like myself or like Pete my peers.
- 1:06:51Ears in this, in this world of immersive audio being like, hey,
- 1:06:55guys. Can we invite you out?
- 1:06:57Like Sony, you know, Apple boughs costs Skullcandy, you
- 1:07:03know? Yadda yadda, yadda, bunch of
- 1:07:05headphone companies and be like, listen, Microsoft obviously,
- 1:07:10right? I'll buy you guys dinner, but
- 1:07:13let's like, let's talk about, like, let's talk about this in
- 1:07:20really, in terms of like the money.
- 1:07:21Seduction of this work and that we can't Silo ourselves.
- 1:07:25Because all it's going to do is create an incredible amount of
- 1:07:28friction for the consumption of content, whether I think it's
- 1:07:33going to happen sooner or not, I don't know.
- 1:07:34I mean product Cycles are generally pretty long, you know,
- 1:07:37to build a new pair of headphones to build, new noise,
- 1:07:40canceling systems that like, you know, bows that these companies
- 1:07:44don't release new products all the time.
- 1:07:47Sennheiser. So now, the big one that I'd
- 1:07:49invite you in but The an AKG obviously Audio-Technica, but,
- 1:07:55you know, these, these the product Cycles are long and so
- 1:07:59you have to come up with a standard and then slowly over
- 1:08:01many years, you're building the adoption of this work.
- 1:08:05I would like to see it in the next five years.
- 1:08:07I think that would that's that would be a great starting point
- 1:08:12and it's something like if the opportunity is presented to
- 1:08:15myself and the, you know, the people are accompanying.
- 1:08:18Obviously, the people we work with, I think we can make a
- 1:08:20pretty compelling case. As to why we need to do
- 1:08:23something like this and it's not motivated by greed, right?
- 1:08:27Like there's no money in it for me to build some open standard
- 1:08:31for this work, but I see it as a necessary way to push, what we
- 1:08:37do creatively forward. And so that the intent for me
- 1:08:42Isn't to be the owner of some standard.
- 1:08:44It's open. Anyone can use a dive to pay me
- 1:08:46anything. Pay us anything.
- 1:08:48It is, it isn't a build is to build a system for us.
- 1:08:51To do more creative work. And so it's to enhance people's
- 1:08:56experience in the new world of audio.
- 1:08:59Yeah, and you take the matter example like, you know, all
- 1:09:02those companies benefit, they can sell more light bulbs, they
- 1:09:05can sell more switches. They can, you know, whether you
- 1:09:08have an apple home pod, that's going to talk to a Philips, hue
- 1:09:11light. That's going to turn on a Google
- 1:09:14thermostat or, you know, whatever it is.
- 1:09:17These like, these Systems and Technology they have to work
- 1:09:20together because People have to have choice in what they buy and
- 1:09:25they have to have choice that fits their price points where
- 1:09:29they are in life and what they're doing and that choice
- 1:09:33can't be. You have to buy a five thousand
- 1:09:35dollar computer and $800 rights and a fifteen hundred dollar
- 1:09:39phone. That is a great system but it's
- 1:09:42not for everyone. It doesn't work for it's too
- 1:09:44expensive you know? And especially if we look at
- 1:09:47like the you know the developing world or countries where there's
- 1:09:50you know, huge Namik disparity. Like we were everyone should
- 1:09:55have access to this world until you can have the eyes of every
- 1:09:59single person that has a phone that can access these things.
- 1:10:04You're not really going to see a revolution in anything.
- 1:10:07You know, the reason why Netflix is everywhere is because you can
- 1:10:10watch it on a phone and you can watch it on phone.
- 1:10:13That's $60. And you can say, even if you
- 1:10:16even if you have no running water, but you have internet
- 1:10:19access. You can watch a TV show That's
- 1:10:23what. Yeah, that's that's the level of
- 1:10:25sort of, you know, adoptability and access that we need around
- 1:10:30the specialization of sound as well.
- 1:10:32And so, I think there's a good case, that's definitely a great
- 1:10:36dinner discussion to be had around that and if anyone from,
- 1:10:40you know, these companies is listening.
- 1:10:41Send me an e-mail, I'd love to talk to you and, you know, it's
- 1:10:46like I'm happy to put on a huge dinner party for all of these
- 1:10:49companies to bring your work. And we can see how successful it
- 1:10:53is in terms of like what the matter standard is doing because
- 1:10:58you can buy an Ikea light switch that works with the, you know,
- 1:11:02Google whatever thing device works with a Philips, you know,
- 1:11:06LED bulb, all of that stuff can work together and that's the way
- 1:11:11we should look at immersive audio both in terms of creation
- 1:11:14and consumption. That's, that's something that I
- 1:11:18think we need to push it as content creator also to happen
- 1:11:21by creating content around it and sharing your burners.
- 1:11:24I think that would be also playing a huge role.
- 1:11:26That's something we were not aware of and I'm sure a lot of
- 1:11:28people are not. The majority is not aware of
- 1:11:31this case that you just spoke of and it's so important because
- 1:11:35like you mentioned it just causes Mass adoption and people
- 1:11:37can truly experience audio the way you guys are creating and
- 1:11:41capabilities that you guys have in a studio, like vote wheels.
- 1:11:44So we are definitely looking forward to this happen.
- 1:11:47Hopefully, it won't take five years.
- 1:11:48I'm hoping for it to happen sooner.
- 1:11:51But yeah, like always, we're very excited to have spoken with
- 1:11:54you. We would there's literally the
- 1:11:56topic of AI that we wanted to cover that.
- 1:11:59I think we have to leave for another discussion because of
- 1:12:01that coming into the world of audio.
- 1:12:02I think that is also a huge topic on its own but we are very
- 1:12:07thankful for your time and we would be looking forward to
- 1:12:10seeing you again. We'll leave all the links down
- 1:12:12in the description so your email your LinkedIn and the company's
- 1:12:16website so people can go and visit it.
- 1:12:18If they have any questions they can reach out to you on LinkedIn
- 1:12:21but just from me a huge. Thank you for coming over today.
- 1:12:25Yeah, thank you so much more. Yeah, absolutely my pleasure and
- 1:12:27thanks for opening the this discussion here.
- 1:12:31I think. It's so it's really it's an
- 1:12:33important discussion to have and I'm I'm glad that we are glad
- 1:12:36that we had it today. Thank you they all.
- 1:12:39There is that all well to everybody watching, thank you so
- 1:12:42much for staying up until now. We're going to be back again
- 1:12:44with another episode next week. We'll announce the guess On our
- 1:12:47Discord channel. So if you guys are not in there
- 1:12:49yet, go to description. That's where you can find.
- 1:12:51Who the next speaker will be, but up until then.
- 1:12:54Take care. And we'll see you guys.
- 1:12:55See you guys next week.