Latest / Inside DuckDuckGo / Duck Tales: Improving AI chat organization, and feature decisions at DuckDuckGo (Episode 8)
Transcript
- 0:00SPEAKER_00: Hello.
- 0:01SPEAKER_00: Welcome to DuckTales.
- 0:03SPEAKER_00: Inside DuckDuckGo features people, etc.
- 0:07You got me as the host again,
- 0:08this time the founder and CEO of DuckDuckGo.
- 0:12SPEAKER_00: And I got Esteban with me today.
- 0:14SPEAKER_00: Esteban, you want to introduce yourself?
- 0:16SPEAKER_01: Sure.
- 0:16SPEAKER_01: Hi, everyone.
- 0:17SPEAKER_01: I'm Esteban.
- 0:18SPEAKER_01: Hi, Gabriel.
- 0:19SPEAKER_01: Esteban, I'm a designer in the team.
- 0:22SPEAKER_01: I work on DuckAI stuff.
- 0:25SPEAKER_00: Sweet.
- 0:25SPEAKER_00: And that's what we're talking about today, DuckAI.
- 0:28SPEAKER_00: And in particular,
- 0:29kind of new features we've been introducing around conversation
- 0:34organization that
- 0:36SPEAKER_00: Estevan has been designing and working on.
- 0:38And we've been releasing kind of a few of these over the last
- 0:42couple of months.
- 0:45SPEAKER_00: You want to,
- 0:45SPEAKER_00: you want to just jump in,
- 0:46SPEAKER_00: you want to share your screen and,
- 0:47SPEAKER_00: um,
- 0:48SPEAKER_00: walk us through it.
- 0:49SPEAKER_00: And, uh, I'll, I realize we have some of this on audio now only.
- 0:54So let's also try to describe what we're,
- 0:57what we're seeing while we do it.
- 0:59SPEAKER_00: I'll do the same thing.
- 1:00SPEAKER_01: No, um, yes, for sure.
- 1:02SPEAKER_01: Uh,
- 1:02let me just share my screen and I'll walk you through a few of
- 1:06the things that we,
- 1:07SPEAKER_01: um,
- 1:09SPEAKER_01: that we recently dumped.
- 1:12SPEAKER_01: Um,
- 1:14SPEAKER_01: Yes.
- 1:15So if you're like me,
- 1:17you have tons of conversations going at the same time.
- 1:21What we have seen from users is that people who are very
- 1:25engaged with our platform,
- 1:27SPEAKER_01: they end up having tons of conversations.
- 1:29And then sometimes it's harder to get back to them and to find
- 1:32the one that you needed.
- 1:33SPEAKER_01: So we launched three things.
- 1:36SPEAKER_01: The first one, I'll show you an example.
- 1:38I was trying to see if I should ask you for a promotion during
- 1:41this podcast.
- 1:42SPEAKER_01: Clearly no.
- 1:44SPEAKER_01: But the cool thing was that... Good answer.
- 1:50SPEAKER_01: I will wait for a better time.
- 1:52SPEAKER_01: The first thing that we shift was that we had a title.
- 1:56SPEAKER_01: The title of our tabs were basically the same first prompt.
- 2:02SPEAKER_01: It was just duplicated.
- 2:03SPEAKER_01: That will make it harder to read.
- 2:04SPEAKER_01: So the first thing that we launched was this automatic titling.
- 2:08SPEAKER_01: We were using the LLM to come up with a better title at the top.
- 2:12SPEAKER_01: So it's easier to find.
- 2:15So this is similar to how ChatDubt and some of the competitors
- 2:20are doing it,
- 2:20right?
- 2:21SPEAKER_00: So like we used to do,
- 2:22SPEAKER_00: just to repeat,
- 2:23SPEAKER_00: so I understand fully,
- 2:24SPEAKER_00: I think I do,
- 2:25SPEAKER_00: having reviewed this one at lunch,
- 2:28SPEAKER_00: but just to make sure.
- 2:28SPEAKER_00: Yeah,
- 2:30SPEAKER_00: we used to just literally repeat the prompt as your title,
- 2:33SPEAKER_00: like the beginning of the prompt,
- 2:34SPEAKER_00: and so that it was kind of weird sometimes and duplicated sometimes.
- 2:38SPEAKER_00: But now we run in the background something that...
- 2:44SPEAKER_00: summarizes it for you and then automatically does this.
- 2:48SPEAKER_00: You don't have to do anything, right?
- 2:50SPEAKER_01: Exactly.
- 2:51SPEAKER_01: And for example, I'm trying a new one.
- 2:53SPEAKER_01: What day is today?
- 2:55SPEAKER_01: That's my prompt.
- 2:57SPEAKER_01: And then immediately what I get as a title is date today.
- 3:02The one thing is that sometimes the title is not exactly what
- 3:06you will call it.
- 3:07SPEAKER_01: Like maybe date today is not super descriptive.
- 3:10SPEAKER_01: So we added this minor option now.
- 3:13SPEAKER_01: So we can say, I don't know, date today, Thursday.
- 3:18SPEAKER_00: So if you want to do whatever you want,
- 3:21SPEAKER_00: yeah,
- 3:21SPEAKER_00: like if you don't like our casing or something,
- 3:24SPEAKER_00: if you want everything in lowercase or whatever,
- 3:27SPEAKER_00: you can just rename it at will.
- 3:29SPEAKER_00: Yeah.
- 3:30SPEAKER_01: Yes, so I'll tell you how you want to name stuff.
- 3:33It's very helpful when you have like several chats about
- 3:36something similar,
- 3:37SPEAKER_01: but you want to have it personalized so it's easier to find.
- 3:41SPEAKER_01: So super simple,
- 3:42SPEAKER_01: nothing that,
- 3:44SPEAKER_01: I don't know,
- 3:45SPEAKER_01: it's a blowing innovation in a way,
- 3:48SPEAKER_01: but very useful.
- 3:51The second one is we noticed how lots of our users were asking
- 3:56us for ways to save
- 3:58SPEAKER_01: conversations and find new conversations faster.
- 4:03SPEAKER_01: We also have a limit of how many conversations you can have right now.
- 4:08SPEAKER_01: There's just 30 chats.
- 4:10SPEAKER_01: After the 30th chat, the next one gets deleted.
- 4:14SPEAKER_01: We're working on that,
- 4:15but we wanted to offer a way for you to say what's important
- 4:18for you and what are
- 4:19SPEAKER_01: the things that you want to come back to.
- 4:21SPEAKER_01: So,
- 4:21SPEAKER_01: I don't know,
- 4:22SPEAKER_01: this one,
- 4:24SPEAKER_01: let's say it's something that I was working on today,
- 4:27SPEAKER_01: but I want to come back to it.
- 4:28SPEAKER_01: I'll just add it to the top of the list by pinning it.
- 4:33SPEAKER_01: So now it's pinned at the top and it will always be there.
- 4:37SPEAKER_01: It also means that if DocAI needs to delete one of your chats,
- 4:42SPEAKER_01: it will go to the last one on the list and this one will not get deleted.
- 4:47SPEAKER_01: You can pin up to five chats.
- 4:50SPEAKER_01: right now.
- 4:52SPEAKER_00: And yeah, so it's accessible always at the top.
- 4:56SPEAKER_00: Got it.
- 4:57SPEAKER_00: So it's kind of the equivalent of like a favorite or a star or a pin.
- 5:00SPEAKER_00: In this case,
- 5:01all of these things are accessible from this three dot hover
- 5:05menu next to the chat
- 5:09SPEAKER_00: to the individual chat.
- 5:11SPEAKER_00: And then also you're saying, which is which is good that because
- 5:16The reason why we have the 30 limit at the moment is because
- 5:19all this is stored
- 5:20SPEAKER_00: locally on your browser.
- 5:21SPEAKER_00: It's not actually stored on our servers.
- 5:26We're working on an encrypted storage that we won't have the
- 5:28keys to where you can
- 5:30SPEAKER_00: get a much higher limit on it.
- 5:33SPEAKER_00: But at the moment,
- 5:33SPEAKER_00: or if you just want to keep it local,
- 5:35SPEAKER_00: there is a local limit because your browser has storage limits.
- 5:40SPEAKER_00: But what this will allow you to do is...
- 5:43SPEAKER_00: keep ones around that you really want around, right?
- 5:45SPEAKER_00: So you're saying if you favorite these or pin them and our words here,
- 5:48SPEAKER_00: you have a pin section at the top.
- 5:50But if you start making a lot of chats,
- 5:53the non pin ones will get kind of blown away first.
- 5:58SPEAKER_01: Exactly, exactly.
- 6:01We have plenty of requests about chat organization and some
- 6:04people are going as far
- 6:05SPEAKER_01: as like,
- 6:05SPEAKER_01: I want to create projects,
- 6:06SPEAKER_01: I want to create groups,
- 6:07SPEAKER_01: I want to organize my stuff,
- 6:09SPEAKER_01: which it all makes total sense.
- 6:11SPEAKER_01: And I guess up to a point you need those sort of organization tools,
- 6:15SPEAKER_01: but the simple ones will cover most of the needs for most of our users,
- 6:19SPEAKER_01: I would say,
- 6:19SPEAKER_01: because maybe you have a few chats where you keep coming back to them,
- 6:23SPEAKER_01: but then you have a bunch of quick requests,
- 6:25SPEAKER_01: quick checkups with the LLM.
- 6:29and something like this is super simple it doesn't require a
- 6:31lot of effort and yeah
- 6:34we really hope it helps a lot of our usage and you mentioned in
- 6:37there a few times
- 6:38like we did this and we're working on this these features in
- 6:42particular because we
- 6:43SPEAKER_00: get a lot of user requests for them so
- 6:47Speaking to that a little bit,
- 6:48like my understanding is,
- 6:50you know,
- 6:50we get lots of feedback.
- 6:52We're looking through it all and kind of organizing it like
- 6:55which are the most like
- 6:56SPEAKER_00: important issues to work on.
- 6:58SPEAKER_00: But then also when we launch features,
- 6:59SPEAKER_00: because to your point,
- 7:00SPEAKER_00: people ask for all sorts of different things.
- 7:02SPEAKER_00: And then we,
- 7:02SPEAKER_00: and like you in particular design,
- 7:05SPEAKER_00: and you're like,
- 7:06SPEAKER_00: well,
- 7:06SPEAKER_00: I think this is going to be a satisfaction of a lot of people's requests,
- 7:10SPEAKER_00: even if that's not exactly the thing they asked for.
- 7:12SPEAKER_00: Exactly.
- 7:13SPEAKER_00: And then we put it out.
- 7:14SPEAKER_00: And then how do we know whether it worked or not?
- 7:17SPEAKER_00: You know, like, what are we looking at?
- 7:21SPEAKER_01: Yes.
- 7:21SPEAKER_01: So to answer your question, we see a usage in particular.
- 7:26SPEAKER_01: We don't have,
- 7:27SPEAKER_01: of course,
- 7:28SPEAKER_01: data about particular users,
- 7:29SPEAKER_01: but we know that roughly X amount of people are using this feature.
- 7:35We also know from social media,
- 7:37we got a little bit of love after posting that we launched
- 7:41this.
- 7:42And then the other thing that's a really interesting metric is
- 7:46we see the feedback coming in.
- 7:49SPEAKER_01: and compared with what kind of feedback we were getting a month ago.
- 7:53SPEAKER_01: And we see a big decrease on chat organization requests.
- 7:57As I said,
- 7:57there are still things that we can do and we're working on
- 7:59them.
- 8:00SPEAKER_01: But we see a lot of people,
- 8:01SPEAKER_01: a lot less people requesting for things like this,
- 8:03SPEAKER_01: which is also good news.
- 8:05SPEAKER_00: I love that metric.
- 8:06SPEAKER_00: I mean,
- 8:06SPEAKER_00: because it really is,
- 8:07I guess we are lucky that we have enough users and enough
- 8:10sample size where we can
- 8:12SPEAKER_00: be like,
- 8:13SPEAKER_00: wow,
- 8:13chat organization has a category we can ascribe feedback to and
- 8:18now it's like
- 8:19SPEAKER_00: halved or whatever after these features come out,
- 8:22SPEAKER_00: right?
- 8:23SPEAKER_01: Yeah,
- 8:24SPEAKER_01: so something we did for this frame that is super interesting,
- 8:26SPEAKER_01: it was fun for me to do,
- 8:27SPEAKER_01: was that we have this category,
- 8:29SPEAKER_01: you know,
- 8:29SPEAKER_01: like chat organization,
- 8:30and then we get feedback directly from our users asking for a
- 8:33specific feature.
- 8:34I went and looked into all the feedback that was related to
- 8:37chat organization,
- 8:39SPEAKER_01: and I tried to see why we were asking for a specific feature.
- 8:42SPEAKER_01: Some of them actually mentioned it.
- 8:43SPEAKER_01: No, I want this so I can do that.
- 8:46SPEAKER_01: And then those needs,
- 8:47SPEAKER_01: I match them with what type of features will work,
- 8:51SPEAKER_01: even just by naming different types of features.
- 8:53SPEAKER_01: You said this was sort of favorites,
- 8:55SPEAKER_01: or it could be key name,
- 8:56SPEAKER_01: or it could be saved,
- 8:57SPEAKER_01: or it could be bookmarked.
- 8:59SPEAKER_01: We also have bookmarks in the browser.
- 9:00So how do we name the feature related to the benefit that I
- 9:05will have and the need
- 9:06SPEAKER_01: that it will solve,
- 9:08SPEAKER_01: but also how much effort will it require from the users to
- 9:11SPEAKER_01: to actually get the benefit that they were asking for.
- 9:13SPEAKER_01: No.
- 9:14SPEAKER_01: Create projects is a lot of effort.
- 9:18SPEAKER_01: And they will get a lot of benefit,
- 9:19SPEAKER_01: but not many people are willing to spend time organizing on their chats.
- 9:23SPEAKER_01: But pinning is one tackle away.
- 9:26SPEAKER_01: So that's a sort of prioritization exercise that we did to define it.
- 9:31SPEAKER_00: Yeah, that's a super interesting point.
- 9:33Because like all different features have different levels of
- 9:36complexity for us to build.
- 9:38SPEAKER_00: And then also for the user to actually use,
- 9:41SPEAKER_00: to your point,
- 9:42SPEAKER_00: like I've seen,
- 9:43SPEAKER_00: yeah,
- 9:43SPEAKER_00: I've seen lots of requests for people wanting really complex things,
- 9:47but then very small percentage of people would actually go
- 9:50through the effort to
- 9:50SPEAKER_00: use those things.
- 9:51SPEAKER_00: Whereas to your point here,
- 9:54SPEAKER_00: pinning, especially the chat title, it's just automatic.
- 9:58SPEAKER_00: We get that for free to everybody.
- 10:01SPEAKER_00: But then the pinning is just literally just a one click.
- 10:05SPEAKER_00: You don't have to type in a name for it, a folder name, for example.
- 10:09SPEAKER_00: You just get the pinning at the top.
- 10:12SPEAKER_01: Right.
- 10:13SPEAKER_01: And in some cases,
- 10:13you actually need to go and give effort to users in a way
- 10:17because we thought
- 10:18SPEAKER_01: automatic title will solve the problem.
- 10:20SPEAKER_01: We just add automatic title to everything.
- 10:22SPEAKER_01: That's it.
- 10:22SPEAKER_01: And then by testing and seeing how some of the titles reacted,
- 10:27SPEAKER_01: we knew that it's just not going to be bulletproof.
- 10:30SPEAKER_01: Like in some cases, you want to have your own title.
- 10:33SPEAKER_01: So we went back and said, okay, let's ask a manual.
- 10:37SPEAKER_01: option, because then that way we're solving.
- 10:41SPEAKER_00: Yeah, you're covering it.
- 10:43SPEAKER_00: At least there's a backstop.
- 10:45SPEAKER_00: That's who we're interested.
- 10:46SPEAKER_00: So what's next, if anything?
- 10:48SPEAKER_00: Are you moving on from chat organization at the moment,
- 10:51SPEAKER_00: or are you thinking about some other kind of deeper aspects of it?
- 10:55SPEAKER_01: It's still there and it's still one of our top requests.
- 10:59You mentioned that we're working on finding ways to keep you a
- 11:04bigger list of like
- 11:06SPEAKER_01: bigger limits,
- 11:07SPEAKER_01: have more chats,
- 11:09SPEAKER_01: maybe syncing between devices.
- 11:13SPEAKER_01: And we are also thinking about search, of course.
- 11:16SPEAKER_01: So you don't have to read your whole list of chats.
- 11:19SPEAKER_01: Just go straight into that answer that you remember from a week ago.
- 11:24SPEAKER_01: So those are things we're working on.
- 11:27SPEAKER_01: And I'm sure there will be plenty more organization features we could do.
- 11:33SPEAKER_01: But for the moment, that's a plan.
- 11:36SPEAKER_00: Sweet.
- 11:36SPEAKER_00: Well, thank you.
- 11:37SPEAKER_00: I'm excited to have you back and someone,
- 11:40SPEAKER_00: maybe I hope I'm the host,
- 11:41but somebody to talk about these more organization features in
- 11:44the future.
- 11:45SPEAKER_00: But yeah, thanks for coming on and thanks everybody for listening.
- 11:47SPEAKER_00: Thank you.
- 11:49SPEAKER_00: Bye everybody.