Latest / Inside DuckDuckGo / Duck Tales: Voice-mode in Duck.ai. The private, hands-free way to chat with popular AIs (Ep.34)
Transcript
- 0:00SPEAKER_01: Hello,
- 0:00SPEAKER_01: welcome to another episode of DuckTales,
- 0:03SPEAKER_01: where we go behind the scenes at DuckDuckGo and discuss the stories,
- 0:07SPEAKER_01: technology,
- 0:08SPEAKER_01: and people that help build privacy tools for everyone.
- 0:12SPEAKER_01: In each episode,
- 0:13SPEAKER_01: you'll hear about our vision,
- 0:16SPEAKER_01: our product updates,
- 0:17SPEAKER_01: engineering,
- 0:18SPEAKER_01: or approach to AI.
- 0:20SPEAKER_01: In this episode, you are going to hear about our voice AI chat feature.
- 0:28SPEAKER_01: And I have with me today Fran,
- 0:32who played a very large role in building and shipping that
- 0:36feature So Fran,
- 0:37SPEAKER_01: do you want to just briefly introduce yourself?
- 0:40SPEAKER_02: Yeah,
- 0:40SPEAKER_02: so hi everyone,
- 0:41SPEAKER_02: I'm Fran,
- 0:42I'm an engineer at DuckDuckGo And I've been working on DuckAI
- 0:47for a long time now
- 0:48SPEAKER_02: And yes,
- 0:49SPEAKER_02: I was heavily involved in building voice chat And yeah,
- 0:53SPEAKER_02: it's a very exciting feature
- 0:55SPEAKER_01: Awesome.
- 0:55SPEAKER_01: Well, thank you for joining us.
- 0:57SPEAKER_01: And I'm Dia.
- 0:58For anyone who hasn't already met me on one of these podcasts,
- 1:01I'm on our product team.
- 1:04SPEAKER_01: So I have a bunch of questions for Fran,
- 1:06SPEAKER_01: but before I jump in,
- 1:07SPEAKER_01: I want to make a ask of our listeners,
- 1:11SPEAKER_01: actually.
- 1:12SPEAKER_01: So we've been doing these podcasts for a little over six months,
- 1:17SPEAKER_01: I think now,
- 1:17SPEAKER_01: and have a pretty good audience following on Substack.
- 1:22We would love to hear from you,
- 1:25our listeners,
- 1:26get some feedback about,
- 1:28like,
- 1:29SPEAKER_01: Things that you like about how we're approaching this,
- 1:32SPEAKER_01: things maybe you don't like,
- 1:33and also like what topics you would like us to talk more about
- 1:38so we can plan
- 1:39SPEAKER_01: future episodes with your interests in mind.
- 1:42So if you have any feedback or want to talk to us,
- 1:45send us a note at podcast at duckduckgo.com.
- 1:51SPEAKER_01: And we'll also put that address in the show notes.
- 1:54SPEAKER_01: So with that said, let's talk more about voice chat.
- 2:01So Fran,
- 2:01can you just tell me,
- 2:03like,
- 2:03to get started,
- 2:04what is this feature?
- 2:06SPEAKER_01: How does it work?
- 2:07SPEAKER_01: Maybe you can give us a quick demo.
- 2:10SPEAKER_02: Yes, definitely.
- 2:12SPEAKER_02: So voice chat is a hands-free conversation mode inside the KR.
- 2:17So yes,
- 2:18so far our users have been able to talk with many chat models
- 2:23via text.
- 2:25SPEAKER_02: And we wanted to provide the privacy-focused way for you to just have a
- 2:29SPEAKER_02: conversation with your model.
- 2:30SPEAKER_02: There's some
- 2:31SPEAKER_02: Really cool, real-time models out there right now.
- 2:34SPEAKER_02: And we wanted to incorporate this feature on the KI as well.
- 2:39So yeah,
- 2:40with voice mode,
- 2:41you can basically have a call with the model and talk directly
- 2:45to it.
- 2:46SPEAKER_02: It will listen.
- 2:47SPEAKER_02: It will reply out loud.
- 2:49SPEAKER_02: You can also interrupt it mid-conversation.
- 2:51SPEAKER_02: And if you want to correct or actually add some extra information,
- 2:54SPEAKER_02: the model will stop and listen to you and then reply back.
- 2:58SPEAKER_02: It can pick up a little bit.
- 3:00How are you expressing yourself to also help that play into the
- 3:06response that it
- 3:07SPEAKER_02: will give back to you.
- 3:08SPEAKER_02: And so I have here on my phone the KI.
- 3:11SPEAKER_02: And if you want to use it, like we have this very handy voice chat.
- 3:18SPEAKER_02: You can go there.
- 3:21SPEAKER_02: And you can just start talking.
- 3:22SPEAKER_02: So can you give me the weather for New York today?
- 3:30SPEAKER_00: In New York City,
- 3:31the temperature is around 28 degrees Celsius with a heavy
- 3:34thunderstorm expected
- 3:35SPEAKER_00: later in the afternoon.
- 3:36The high will be about 34 degrees Celsius and the low tonight
- 3:39could drop to 24 degrees.
- 3:41SPEAKER_00: There's a heat advisory in effect as well, so it might feel quite humid.
- 3:45SPEAKER_00: Make sure to stay hydrated and be prepared for possible flooding.
- 3:48You can also check the extended forecast on sites like
- 3:50AccuWeather or the Weather Channel.
- 3:52SPEAKER_02: Yeah, that's very nice.
- 3:53SPEAKER_02: So yeah, you can ask follow-up questions inside the same session.
- 3:57SPEAKER_02: Right now,
- 3:57SPEAKER_02: I've muted myself,
- 3:58so you can also mute in case you want the model to not hear you
- 4:02at the moment.
- 4:04SPEAKER_02: And yeah,
- 4:05SPEAKER_02: it has access to web search as well,
- 4:07SPEAKER_02: so you can also get the news,
- 4:09SPEAKER_02: get better information or any up-to-date information.
- 4:14SPEAKER_01: Nice.
- 4:15I am not too far from New York City and I can vouch for being
- 4:19very human today.
- 4:23SPEAKER_01: Cool.
- 4:24SPEAKER_01: Yeah.
- 4:24SPEAKER_01: So tell me,
- 4:25SPEAKER_01: I know that the demo,
- 4:28SPEAKER_01: you know,
- 4:30SPEAKER_01: hopefully people can see it well enough on the screen.
- 4:33But if you couldn't,
- 4:34there's like a little ghosty character with a bow tie.
- 4:39SPEAKER_01: Tell me a little bit.
- 4:40SPEAKER_01: Who's that?
- 4:41SPEAKER_01: What's his deal?
- 4:42SPEAKER_01: His or her deal?
- 4:44SPEAKER_02: Yes.
- 4:45SPEAKER_02: So that is our voice mascot.
- 4:47We wanted to provide like a visual way and like represent that
- 4:51the AI is speaking to you.
- 4:52SPEAKER_02: So you can just see when the AI is listening and replying back to you.
- 4:57SPEAKER_02: So we created this mascot to be there with you during the session.
- 5:02And we wanted this mascot to also have a little nod to Dex,
- 5:06our DuckDuckGo mascot.
- 5:09So that's why it has also the green bow tie and it's white so
- 5:14it's a nod to Dex
- 5:16SPEAKER_01: Yeah,
- 5:16SPEAKER_01: so if you're not familiar with Ducks,
- 5:18SPEAKER_01: that's the name of the DuckDuckGo duck that you see,
- 5:21SPEAKER_01: the debonair,
- 5:22SPEAKER_01: yeah,
- 5:24SPEAKER_01: duck with your bow tie.
- 5:26SPEAKER_01: Awesome.
- 5:27SPEAKER_01: And by the way,
- 5:28SPEAKER_01: like on the point about the demoing,
- 5:30this is a little bit challenging because of the audio and the
- 5:33back and forth,
- 5:33SPEAKER_01: but just go like after this podcast or in the middle of this podcast,
- 5:37SPEAKER_01: go try it.
- 5:38SPEAKER_01: It's,
- 5:39SPEAKER_01: you know,
- 5:39SPEAKER_01: if you don't already have the DuckDuckGo app,
- 5:41SPEAKER_01: you can download the DuckDuckGo app on your phone.
- 5:43SPEAKER_01: You can also try it on desktops.com.
- 5:46And actually,
- 5:47Fran,
- 5:47I should ask,
- 5:49is it free or do users have to pay to use voice chat?
- 5:54SPEAKER_02: It is completely free.
- 5:56So our free tier users can access voice chat directly from
- 6:02either that button or
- 6:03SPEAKER_02: the sidebar,
- 6:06SPEAKER_02: as you could see.
- 6:08SPEAKER_02: And yes,
- 6:09SPEAKER_02: with the pro and plus subscriptions,
- 6:13SPEAKER_02: you do get more time to speak with the model,
- 6:16SPEAKER_02: but it's available for everyone right now in your phone or desktop.
- 6:21SPEAKER_02: Awesome.
- 6:23SPEAKER_01: Cool,
- 6:23so maybe can you tell me a little bit about why we decided to
- 6:27build it at all,
- 6:28SPEAKER_01: like what instigated this whole project?
- 6:32SPEAKER_02: Yeah,
- 6:33SPEAKER_02: so like I was saying before,
- 6:37there's some cool voice models out there and we wanted to give
- 6:41this hands-free way
- 6:44SPEAKER_02: for people to talk with their chat model.
- 6:51SPEAKER_02: And we also wanted to have a private way for them to speak.
- 6:56So we did put in place some technical ways for us to improve
- 7:03like our privacy and
- 7:04anonymizing your voice when you're connecting to the provider
- 7:09to speak with it.
- 7:12And yeah,
- 7:12we wanted to give you this free,
- 7:15hands-free way of talking with the model.
- 7:18SPEAKER_02: It's also better for accessibility.
- 7:20Like we've gotten feedback,
- 7:21like some people struggle using the text chat.
- 7:25So with this,
- 7:26you can just connect and start talking with the model
- 7:29uninterrupted.
- 7:30SPEAKER_02: So it's been a very, very cool feature.
- 7:34SPEAKER_02: And we know voice is a very unique thing for the users.
- 7:38SPEAKER_02: So we wanted to provide
- 7:40a way for our users to be able to use that in a private and
- 7:45secure environment.
- 7:47SPEAKER_01: Yeah, yeah.
- 7:48SPEAKER_01: Can you,
- 7:49SPEAKER_01: is there anything else that you want to add about like how we handled,
- 7:53SPEAKER_01: like how we made it in fact meaningfully private?
- 7:57SPEAKER_02: Yes, definitely.
- 7:59It was challenging because right now there are so many
- 8:02different ways to handle
- 8:05SPEAKER_02: voice models that are out there.
- 8:07SPEAKER_02: Different providers have different ways that they provide.
- 8:10We did this connection directly with the model using real-time
- 8:16web technology.
- 8:17SPEAKER_02: You're actually having a call with the model,
- 8:21SPEAKER_02: but there are other ways where you could parse the conversation,
- 8:25SPEAKER_02: maybe turn to text,
- 8:26SPEAKER_02: but then a lot of the
- 8:27SPEAKER_02: details and the nuances of your talk can be lost in between.
- 8:32SPEAKER_02: So we found,
- 8:33we looked into this balance of having a good user experience
- 8:36while also preserving
- 8:38SPEAKER_02: your privacy.
- 8:40SPEAKER_02: So the way also that we build, like there is this
- 8:43SPEAKER_02: Relay in between you and the provider,
- 8:46SPEAKER_02: and we anonymize all the metadata and the information of your call,
- 8:51SPEAKER_02: so the provider doesn't really know who you are.
- 8:54Although your voice is still unique to you,
- 8:57so you should be mindful of that.
- 8:59SPEAKER_02: But apart from that, everything else we anonymize during the call.
- 9:05SPEAKER_01: Yeah, that's cool.
- 9:07Just to kind of loop back to what you were saying about the why
- 9:10we build it in the first place.
- 9:11SPEAKER_01: I'm personally like I'm not a huge voice input person.
- 9:15SPEAKER_01: I know a lot of people are,
- 9:16SPEAKER_01: but I don't usually talk to my phone unless I'm actually calling a human.
- 9:23SPEAKER_01: And I found it pretty cool because like,
- 9:25SPEAKER_01: I don't know,
- 9:25SPEAKER_01: it is really convenient sometimes just to not,
- 9:28SPEAKER_01: I don't know,
- 9:29SPEAKER_01: like when you're on the go or something,
- 9:31SPEAKER_01: right?
- 9:33SPEAKER_01: Don't have your typing fingers available.
- 9:35I've actually found that pretty handy and just been like
- 9:39impressed by how slick it
- 9:41is with the like handling interruption and I know we had to
- 9:44dial that in a little
- 9:45bit like at least on my iPhone it was way too sensitive at
- 9:48first and it felt like
- 9:49all the background voices were interruptions and yeah but I
- 9:55think now it's pretty
- 9:56SPEAKER_01: slick.
- 9:58SPEAKER_02: No,
- 9:58it's super cool and we've gotten so many positive feedback like
- 10:01from I've got
- 10:02people reach out to me and say like oh I was stuck in traffic
- 10:06so I wanted to check
- 10:08something real quick so they use voice mode so they could still
- 10:11pay attention
- 10:12around them and like while they're sitting there waiting for
- 10:15traffic to move
- 10:16SPEAKER_02: They could quickly use and make some lookups.
- 10:20I've heard from people that also use it to practice a different
- 10:23language since the
- 10:24SPEAKER_02: model can understand so many different languages.
- 10:27SPEAKER_02: And even me,
- 10:28SPEAKER_02: I've tried like speaking in one language and then switching to my native,
- 10:32SPEAKER_02: like speaking English and then switching to my native one.
- 10:35SPEAKER_02: And it can pick up like flawlessly.
- 10:38SPEAKER_02: It's very nice.
- 10:40SPEAKER_02: Yeah, I enjoy a lot the...
- 10:43SPEAKER_02: The hands-free versatility of it.
- 10:46I've used for a few things where me speaking is easier than me
- 10:50typing down what I
- 10:51SPEAKER_02: want to ask the model about.
- 10:54SPEAKER_01: Yeah, I've been using it like, I guess, as like a thought partner.
- 10:57Sometimes if I'm like walking my dog and I'm thinking through
- 11:01something complex,
- 11:02SPEAKER_01: it's the kind of thing that like if my husband were walking alongside me,
- 11:06SPEAKER_01: I would start just like,
- 11:07SPEAKER_01: you know,
- 11:08SPEAKER_01: spewing thoughts at him as a sounding word.
- 11:10SPEAKER_02: I started spewing it at, you know, DuckAI instead.
- 11:14SPEAKER_01: And I don't know, it's been kind of cool.
- 11:18SPEAKER_01: Tell me,
- 11:19SPEAKER_01: Fran,
- 11:19SPEAKER_01: like,
- 11:19do you have either a favorite thing or a favorite use case
- 11:22about about voice chat?
- 11:25Yeah,
- 11:26so I've used it a little bit in the past to help me when I need
- 11:31to write down
- 11:35like some idea that I have in my mind or like formulate some
- 11:38something that I want
- 11:39to share with a colleague but I really cannot put into words
- 11:42but I can express
- 11:43myself so I would open voice chat and then like speak for a
- 11:47whole minute saying oh
- 11:49I want to say this but not exactly that word but so like you're
- 11:52saying like this
- 11:53thought process and then at the end I say now summarize what
- 11:56I've said in two
- 11:57sentences and it has been like really helpful to help me like
- 12:01consolidate a lot of
- 12:03SPEAKER_02: flying ideas
- 12:05SPEAKER_02: And with web search that we added after the release,
- 12:08SPEAKER_02: I also find it really nice to get,
- 12:10SPEAKER_02: oh,
- 12:10give me a summary of the news in my city today or do these
- 12:14quick lookups where I
- 12:16can have it on the side speaking to me while also doing
- 12:18multitasking and doing
- 12:19SPEAKER_02: something else.
- 12:21SPEAKER_02: So yeah, it's been pretty nice for those use cases.
- 12:25SPEAKER_01: Nice.
- 12:26SPEAKER_01: Awesome.
- 12:26SPEAKER_01: Well, anything else you want to add before we wrap?
- 12:32SPEAKER_02: Just want to invite everybody to use voice chat.
- 12:36SPEAKER_02: I'm biased, but I really like this feature.
- 12:39SPEAKER_02: I find it really cool, really like our ghosty guy.
- 12:43And yeah,
- 12:44please test it out and share any feedback that you have with
- 12:47us.
- 12:47We are always looking for ways to improve our features and
- 12:50voice chat and DuckDuckGo in general.
- 12:52So yes,
- 12:53please hit the share feedback button and we'll definitely
- 12:56appreciate it.
- 12:58SPEAKER_02: Does the ghosty guy have a name?
- 13:01SPEAKER_02: No, we didn't give a name.
- 13:02SPEAKER_02: Maybe if anyone suggests one that we like, maybe.
- 13:06SPEAKER_01: Yeah, I think you should have naming privileges, Fran, so think about it.
- 13:12SPEAKER_02: Yeah, I'll think about some ideas.
- 13:14SPEAKER_01: Yeah, okay, sounds good.
- 13:17SPEAKER_01: I was going to suggest Fran, but maybe you don't want to.
- 13:22SPEAKER_02: Ghosty bow tie.
- 13:24SPEAKER_01: Cool.
- 13:25SPEAKER_01: Okay.
- 13:26SPEAKER_01: Awesome.
- 13:26Well,
- 13:26thanks so much for joining and congrats on this neat feature
- 13:32that you launched.
- 13:33SPEAKER_01: Thank you so much.
- 13:35SPEAKER_01: All right.
- 13:35SPEAKER_01: Talk to you later, Fran.
- 13:37SPEAKER_02: Talk it.
- 13:38SPEAKER_02: See you soon.