Latest / The KAJ Masterclass LIVE / AI Is Changing Music — But Music Is Still Human | Charney Kaye
Transcript
- 0:24Welcome to this very special edition of the KJ Master Class.
- 0:27Live the show which ensures that you profit from your time spent
- 0:31here with experts, either through the industry, insights,
- 0:35information or simply learning from them.
- 0:38And today we have Chani Kay. He is an artist, musician,
- 0:42hacker, founder of XJ Music is also podcast host, XJ Music
- 0:48Podcast. Welcome to the show, Chani.
- 0:50Thanks, AJ It's great to be here.
- 0:53You are welcome to the show, Chani.
- 0:55You are welcome to India in this online form and I'm sure not
- 0:59just in India, but a lot of people across the globe will
- 1:02benefit from what we are going to talk about.
- 1:05We'll be talking about technology, music and live
- 1:09streaming. But first to understand about
- 1:12you, Chani, I don't know much about music.
- 1:14You are, you know much more about it.
- 1:16So help us understand why you have focused so much of things
- 1:20about around music. Who exactly is?
- 1:24Because you are very much, you know a lot about technology.
- 1:27Also, how have you made these things meet together?
- 1:30And also a bit about XJ Music so that the audience understands
- 1:34fully who they are listening to. Sure.
- 1:37Well, I'm originally from Chicago, IL, and my background
- 1:40in music started with piano and I also got into DJ ING early on.
- 1:46And I was also just always working with computers, always
- 1:49taking apart computers, learning programming languages as a
- 1:52hobby. And I got into the demo scene,
- 1:55which actually was kind of headquartered in Finland at the
- 1:57time. And computer programmers would
- 1:59compete against each other to create musical compositions that
- 2:02were like actually made out of code.
- 2:05So on the one hand, you asked me, you know, how did I get into
- 2:08music? And I think that music found me.
- 2:10It's something that is always, for me, been just such a source
- 2:15of joy and inspiration and passion.
- 2:17And I just always loved music and love performing music.
- 2:21And as somebody that was working with technology and just always
- 2:24had this fascination with building things, it was pretty
- 2:28natural for those two to come together.
- 2:32And so my earliest forays in music were in this format, the
- 2:35demo scene, and they call it tracking, where you're using a
- 2:37lot of code, you're using samples.
- 2:39It's actually music that sounds a lot like early video game
- 2:43music because it's made with the same technology and a lot of the
- 2:46same people that were building that music were also the
- 2:50founders of the demo scene. And as I got into high school
- 2:54and more into D Jing and, you know, throwing parties, I was
- 2:57just part of the sort of group of people up at my school that
- 3:01would throw the parties. I also got into producing more
- 3:04music and performing music live. And I just, I really just love
- 3:09the power of music to communicate with people, whether
- 3:12it's in a live form to unite people and even when it's
- 3:17recorded and broadcast or in a film, the power that music has
- 3:21to move people emotionally. Absolutely, absolutely, Charlie.
- 3:26So to understand from you a bit more about music, how do you see
- 3:31music nowadays? What is music?
- 3:33Because even now you know, artificial intelligence is
- 3:37creating music. So how do you see as an artist,
- 3:40how do you see that part of music?
- 3:43And also you know, how do we then in these times because
- 3:48artificial intelligence is not going to go away soon.
- 3:51How do we calibrate the real music as well as this AI music
- 3:56in today's time especially, you know from coming who knows both
- 4:00the worlds from that world to the present world, How do you
- 4:03see it and how do we mitigate any risks here?
- 4:07Because you are also you know much more about you know
- 4:10software, you know about technology and you also talk
- 4:13about connecting software with nude media and obviously music
- 4:17too. I if I understand.
- 4:19Sure. And we'll sort of work
- 4:20backwards. Like you said, artificial
- 4:22intelligence is not going anywhere.
- 4:24It's incredible how convincing images are, especially these
- 4:29days generated by AI and the startup, the product that we've
- 4:33created, the technology that myself and so my partners have
- 4:36built over the last few years. On the surface, it seems like it
- 4:39might be in that space because this is generative music.
- 4:42But I'll tell you that XJ music has really been built on the
- 4:45principle that music is human, and that no matter what
- 4:48technology is the intermediate media itself, right?
- 4:53Something that's in the middle between humans and other humans
- 4:58that nothing will ever replace, communicating a message that is
- 5:02fundamentally a human experience to another human being.
- 5:07And what we're seeing with AI, you know, and I do think it's
- 5:11important to call it in this context, machine learning,
- 5:15right? Whether it's a language model,
- 5:17models that draw on music in order to create more music, we
- 5:22highlight that that is still a media.
- 5:26And whether you're using a tape recorder to copy some music and
- 5:30play it for other people, and maybe you remix it, you could
- 5:34cut up tape in order to remix that music.
- 5:37You could use a sampler to remix music.
- 5:39You can use a computer to remix music.
- 5:41And even if you're using a very complicated neural network and a
- 5:44language model, you are still fundamentally taking music that
- 5:48was created for some purpose by people.
- 5:51You're curating it and you're remixing it.
- 5:54And one thing that I really am looking for in terms of the
- 5:59future of AI and generative media, whether it's music or
- 6:02visuals, is better attribution. You know, I really wish that we
- 6:06were seeing more attribution. When people are using language
- 6:09models and they're using machine learning and neural networks in
- 6:12order to generate visuals or music, I wish that we were
- 6:16attributing the music and the visuals that that came from, you
- 6:19know, that they used to train those neural networks.
- 6:22So we are seeing some very, very, very fascinating, you
- 6:27know, bleeding that's like for example, a tool called SUNO
- 6:30that's been, you know, all the rage recently.
- 6:32It's extremely cool. But again, I'm disappointed that
- 6:36we're not attributing the sources there.
- 6:39And on the one hand, this allows huge numbers of people, right?
- 6:44Just allows anybody to feel like they created some music.
- 6:49And that's interesting, right? You know, this experience to
- 6:52say, like I made this music because I typed in a prompt and
- 6:56this music came out and it's not that different in a way from
- 7:00being a DJ. We know what the the role of the
- 7:02DJ in front of an audience. You know, you have that
- 7:06immediate experience of actually being the person in front of the
- 7:10audience and you're producing the music, you're putting the
- 7:13records on. You're choosing the music,
- 7:16you're mixing the music together and the crowd, you know, gives
- 7:20you credit for that music to some extent.
- 7:24But that's already something that audiences understand.
- 7:28OK, if I want to understand who's behind that music that I
- 7:31just heard that DJ play, I'm going to follow up with that.
- 7:34And you know, the idea of an artist and and relating to an
- 7:40artist as a person and wanting to experience what they have to
- 7:43say, I don't think that's going away.
- 7:47And actually to make a comment, I sort of really recently
- 7:51actually was at a wedding that was between an American family
- 7:55and an Indian family, the husband and wife.
- 7:57And they had a lot of Punjabi dance music on.
- 8:01And I was really impressed, really amazed.
- 8:04And they really inspired by how much the audience was calling
- 8:08out for their favorite songs and that these songs have got rich
- 8:11history, sometimes whole narratives or they come from
- 8:14films, you know, and there's depth to it.
- 8:17There's a, there's an experience there.
- 8:19So it's not just about the sounds that we're replaying, but
- 8:21all of these cultural connections that go along with
- 8:23that. Absolutely, Absolutely, Charlie.
- 8:27Let me understand it for the audience through XJ Music, What
- 8:31is XJ Music all about, you know, and how do you, what do you do
- 8:37there? And how should people connect
- 8:39with XJ Music? Is it to listen music?
- 8:42Is it to create music? Is it more about business?
- 8:46Help us understand that is quite interesting.
- 8:48That will be interesting to understand.
- 8:50Sure. Well, you know, cutting to the
- 8:52chase, XJ Music is a music engine.
- 8:55We're hoping to work with major video game studios, maybe live
- 8:58streamers in the future. But I really think the best
- 9:00case, the most exciting case that we found is in video games
- 9:04where you know, the biggest video games that are out today.
- 9:07And this is still a category of media that is getting a huge
- 9:11amount of investment. And the the creative
- 9:14professionals that work on video games are still investing an
- 9:17enormous amount of time composing music, recording it
- 9:21performed live in studios, producing those recordings,
- 9:25mastering those recordings. And when they get to the actual
- 9:29final stage of putting the music in the game, that's where it
- 9:32turns out that the options that you have are kind of limited.
- 9:36And you have some really, really cool frameworks like F mod and
- 9:39wise are some of the tools that the biggest video games use in
- 9:42order to sort of code the music into the game so that it can
- 9:45change depending on what you're doing in the game.
- 9:48And what we've created. XJ Music is a really powerful
- 9:52framework for people working on video games to put the music in
- 9:57the game in a much more dynamic way so that depending on what
- 10:00the player is doing, the music isn't.
- 10:02It's not just going to fade from one song to another or you know
- 10:05increase in volume. Like it's really making a lot of
- 10:08dynamic and and random choices in order for that music to
- 10:12continue to be interesting even when you play that game for
- 10:15hundreds of hours. I'll make a note also that we
- 10:18for for some time we actually had an app that you could
- 10:21download and listen to some example streams that we are
- 10:24running in the cloud. That was really fun actually.
- 10:27And and we did actually build up some listenership, but we got
- 10:32past the free tier on Amazon Web Services and we had a a really
- 10:36good month where we shipped like 2 1/2 million chunks of audio in
- 10:40one month. And when I got the bill for, you
- 10:43know, our success, essentially I realized that there just wasn't
- 10:46a model, a business model to sustain that at this time.
- 10:49But it would be exciting if if a company in the future saw the
- 10:53opportunity to use this technology to do live streaming
- 10:56also. OK, OK.
- 10:58And what is the business model? How do you earn means if you
- 11:02continue to just create a business but you don't earn,
- 11:06then you won't be able to grow, grow this particular thing.
- 11:09And in terms of usage, how do you use your music into a video
- 11:14then? Is it, is it different than any
- 11:16other music? But then there is there.
- 11:18You can't go beyond you spare use and obviously there might be
- 11:23copyright strike and all those issues.
- 11:26What about your music? Do you charge for music usage?
- 11:30How does one experience your created music from XJ Music?
- 11:35Right. And everything that we've
- 11:37created is completely original. So I've worked with friends of
- 11:40mine that are professional musicians and they have created
- 11:43original compositions to demonstrate the technology.
- 11:46And you can go to xjmusic.com, you can check out on our YouTube
- 11:50channels, we have some examples of that music that's running but
- 11:54not it's not running live 24/7. You know, what we're really
- 11:58looking for is musicians out there, music producers and
- 12:02people that are working on video games especially, or honestly,
- 12:05if you just have a really interesting music project, talk
- 12:08to us. We're actually very open to
- 12:11letting people use the technology right now in their
- 12:13own music projects. So it's not so much about the
- 12:16music itself, but using XJ Music as a tool for music creators.
- 12:21What we're hoping to do is work with to get a deal with the
- 12:24video game company and through licensing the technology to be
- 12:29used inside of the game. You know that that company would
- 12:32also be producing their own original content, so they're
- 12:35going to own the copyright to that.
- 12:37And perhaps, you know, video game companies already released
- 12:41these albums right, of the original soundtracks of games,
- 12:44and people really enjoy listening to that.
- 12:46So if they built the game soundtrack using XJ Music, they
- 12:49would consider perhaps running a 24/7 live stream of this
- 12:54copyrighted content that they already own.
- 12:56But it allows people to listen to it for much longer time, you
- 13:00know, and have it still be interesting.
- 13:02Another possibility is, let's say a major artist, a recording
- 13:06artist who's produced an album, and they have a body of work and
- 13:09they're taking that work on tour.
- 13:11They have background music in the venues, you know, while
- 13:14they're on tour, and so XJ Music would be a very interesting
- 13:17option for them to have that music.
- 13:21You know that that ambient music that's getting the audience
- 13:23ready for the big show and have that be something that's really
- 13:27dynamic and interesting and actually different every single
- 13:30time, even if you have people going to the show multiple
- 13:33times. Right, right.
- 13:36So how do we should musicians or people who are creating music
- 13:41say from this part of the world in India and they want to get
- 13:45associated with XJ music? So is should they consider or
- 13:49can they consider XJ music also some sort of a marketplace?
- 13:54Can they think of earning some money by, you know, putting
- 13:58their money, their music, onto your platform and others can use
- 14:02it? I would say that we're not doing
- 14:04that at this time. You know, when I described
- 14:06running an app for a while and deciding that that model didn't
- 14:09work, at least for for us because I'm been bootstrapping
- 14:13this project, you know, it is definitely a possibility,
- 14:16especially if there was someone who wanted to work with us as a
- 14:20partner to create that market. You know, if you know that you
- 14:23have a platform where you could take a technology like that and
- 14:27really put it to good use because what you're saying makes
- 14:29sense, You know, we just needed to focus in just a very small
- 14:34team bootstrap startup business. What I really realized is that
- 14:38the most valuable commodity is time.
- 14:41And so we were spreading ourselves too thin trying to
- 14:43build out an entire platform and deal with the monetization of
- 14:47the music as well. So it's very interesting what
- 14:50you say and I think that in the future we'd love to do that.
- 14:53For now, we're really interested in people who essentially
- 14:56already understand their market or where they would use the
- 14:58music and how they would monetize it and are looking for
- 15:01a really interesting technology to to work with in their own
- 15:04space. Absolutely, absolutely.
- 15:08And and you see recently I was talking to another of course
- 15:11another of my guests and we were talking about music licensing.
- 15:15I guess a lot of people are now getting into that line and you
- 15:19also talk about live streaming. How do you utilize your your
- 15:24music into live streaming because that is going to be a
- 15:27big market that is already a big market with lots of you know
- 15:31people wanting to go live streaming because you interact
- 15:34with the audience, you do not have that pressure of editing
- 15:37and all that. You just are live like we are
- 15:40live. But this is, this is a different
- 15:42sort of a live streaming. This is much more of an
- 15:44interview but that live streaming is also entertainment
- 15:47interview also and so many other things.
- 15:49So that's a big market. How do you how does that work?
- 15:53In case you are thinking of that live streaming part, getting HJ
- 15:56music into live streaming, then I will also be tempted to use
- 16:00one of your things. Absolutely, yeah.
- 16:02And we, you know, we have, there's these three pieces of
- 16:05music that we developed ourselves that we're very happy
- 16:08to let people use actually. And this is one of them is
- 16:11ambient music, another one is lo Fi hip hop beats and another one
- 16:15is house music. And we're sort of working on
- 16:17variations of that like synthwave.
- 16:20What you could do as a streamer is run XJ music on the side of
- 16:24the live stream and just, you know it, it really exposes a
- 16:27pretty simple series of buttons depending on the musical
- 16:30composition, right? So it's it's very customized to
- 16:33the specific composition and at different points in your stream
- 16:37you can hit these cues in order to have the music change.
- 16:40And it's not just going to, you know suddenly fade or cut over,
- 16:43but it really evolves in a very organic way as if you kind of
- 16:47have this musician or a musical group playing along with you
- 16:52every any given composition in XJ can be designed differently.
- 16:55So when you deal with a video game, you know it's very
- 16:57customized for that. And you know we would love to
- 17:01work with, especially if you have something like a news
- 17:03broadcast where the it's fairly high value entertainment and
- 17:08they know their format. So our musical team could work
- 17:11with them in order to come up with something custom which once
- 17:15created, they can use every day. Absolutely, Absolutely.
- 17:19I come from a news background though.
- 17:21This is a podcast sort of a thing.
- 17:23But you know that that sense of news is always there and you
- 17:27want to bring that energy, that sense of relevance, sense of
- 17:31importance, sense of use and value.
- 17:33So that thing is always there and it, you know, whatever way
- 17:37you put it, the ultimate thing that people are looking is
- 17:39either value, information or entertainment.
- 17:42And right now we are also going on say right now we are also
- 17:45going on Twitch on YouTube as well as Facebook and later on
- 17:49we'll put it out on audio podcast and other platform.
- 17:52So it is good and and and people want to know about you know exam
- 17:56music right now and it gives a good platform like now I don't
- 17:59know this is from Twitter thing but somebody wants to know about
- 18:02XJ music there. So it creates that curiosity.
- 18:06And more curiosity leads to, you know, more information, more
- 18:10more understanding of good things that are available online
- 18:13and everywhere. So that is good.
- 18:15I like this concept of yours. One thing I want to understand
- 18:19from you, Charney, is you talked about an Indian wedding in terms
- 18:23and you know about music, you also know about software.
- 18:26A lot of music that was created initially, a lot of software
- 18:30that came in was there to help, you know, iron out those
- 18:35technical difficulties. But what happened was a lot of
- 18:39people who were who were not actually, you know, singers or
- 18:43real things. A lot of people started getting
- 18:46into that line and that created a lot of a bit of a discord.
- 18:51I am much more of a traditional person.
- 18:53I would like to listen to a real singer or I would like to listen
- 18:57to an artificial intelligence created music knowing fully what
- 19:01but a non singer becoming a musician or a singer through the
- 19:06use of artificial intelligence or through the use of all the
- 19:09technology that's a bit different like in Beatles they
- 19:13created that old song where using that technology is still
- 19:17understandable. You bring that old world people
- 19:19will have different but the non singer becoming that.
- 19:22That's happening a lot, even in our Bollywood.
- 19:24I want to get your understanding of this.
- 19:27You know that good singers are there, but because I'm a star or
- 19:31celebrity, I can start singing using, whereas my voice will be
- 19:34very discordant. Nobody would want to hear me in
- 19:37real life. I appreciate what you're saying
- 19:40a lot and I I also agree that I, I just, I don't know, I I like
- 19:45the real thing, as it were. And what we've been trying to do
- 19:48is offer a tool to people that have devoted their entire career
- 19:52to creating music. Just we want to give people a
- 19:56way of producing music that is dynamic and it you know, has all
- 20:00of these potential for randomness and generative
- 20:04abilities. But it's actually raising the
- 20:06bar in terms of kind of how much musical thought needs to go into
- 20:10it. XJ is not really automating
- 20:13anything for you if you're not a musician.
- 20:17It's not something that is going to help a non musician press a
- 20:20button and make music. Our target audience, our
- 20:24composers, producers, people who have already devoted, you know,
- 20:28a lot of time to thinking about the music that they want to
- 20:31make. And we find ourselves in this
- 20:33world now where as you say, you know, a lot of non musicians
- 20:37have tools to maybe be able to feel like they're creating music
- 20:41or you know, sing people that Can't Sing at all, whether it
- 20:44started with auto tune or now just complete generative models.
- 20:47So potentially somebody that was doing that could then, you know,
- 20:52also run the music that they make through XJ music.
- 20:55But what we're really hoping for is for people to really kind of
- 21:00push the envelope in terms of very handcrafted, organic
- 21:05musical compositions, which then are just being played back in an
- 21:10interesting way, you know, or or with with random different
- 21:13possibilities being created every time you hear it.
- 21:17Absolutely, absolutely. As I said, there is room for
- 21:20everyone but it and the whole world is changing.
- 21:24So it is good to see you bringing different options to
- 21:27the people. And also, you know, there is so
- 21:29much to I'm not a musician, I know nothing, but I can be a
- 21:33good listener. So I listen to music whenever
- 21:35possible and it is nice to listen to, you know, so many new
- 21:39voices also coming up in terms of music business and and people
- 21:43want to understand. So you have a podcast also XM
- 21:47Music podcast. Tell us about that.
- 21:49What can people learn more about all these changing times
- 21:53changing sort of music from your podcast?
- 21:56Sure. You know, and it also started
- 21:57with wanting to just tell people more and be more transparent
- 22:02about exactly what we're doing. So much of what I see on social
- 22:06media and out in the Internet is just glorifying technology as
- 22:10this general purpose solution to all these things.
- 22:13And someone we thought, how can we show the humanity of this
- 22:17project that we've built? We really just want to invite
- 22:20people into our lab. So you know, the first couple
- 22:23episodes I interviewed the the team that we, you know, worked
- 22:28with to actually create the technology and the original
- 22:31composers. So it's very, very detailed and
- 22:34you know, not even for everyone but especially for music nerds,
- 22:38you know, I think it's very interesting.
- 22:40And then from there, you know, we want to continue to interview
- 22:44musicians and music producers and get it some people's take on
- 22:48artificial intelligence on how that's affecting them, but
- 22:52really also invite people to use XJ music and find out what they
- 22:57think about it first hand, you know, And we're putting
- 22:59ourselves out there kind of being vulnerable and transparent
- 23:03and just inviting people into the process.
- 23:07Absolutely, Absolutely. So a lot of people who would
- 23:10want to know more about you, about your company, what is the
- 23:14best and all the people who would want to, you know, be
- 23:17professionally engaged with your company?
- 23:19What is the best way for them to connect with you?
- 23:22Check out XJ music.com. You can see the podcast on
- 23:26there, you can read about the software, and you can dive right
- 23:30in. We're very excited to let people
- 23:34try out what we've built and work with you directly to help
- 23:38figure out how you can realize some interesting new
- 23:40possibilities using XJ Music. Wonderful, wonderful.
- 23:44All this money that is being talked about, it will certainly
- 23:48be a lot of music to a lot of the decisions, the real ones and
- 23:52even those who are doing it for fun.
- 23:54At the end of the day, it's all about entertainment with this.
- 23:57It's a wrap on this very special edition of the Kaj Master Class
- 24:00Live. Thank you so much indeed for
- 24:02joining us. Thank you, AJ.