Latest / Inside DuckDuckGo / Duck Tales: More ways to customize DuckDuckGo — now you can exclude certain websites from search results (episode 5)
Transcript
- 0:00SPEAKER_01: hello again welcome to DuckTales our inside DuckDuckGo
- 0:05SPEAKER_01: podcast video thing.
- 0:06SPEAKER_01: I don't know what you call us exactly.
- 0:07SPEAKER_01: Today, I have Greg with us.
- 0:11SPEAKER_01: Greg, you want to introduce yourself?
- 0:13SPEAKER_00: GREG FIERENTINO- Hello.
- 0:14SPEAKER_00: I'm Greg Fiorentino.
- 0:16SPEAKER_00: I work on the product team here at DuckDuckGo.
- 0:19SPEAKER_00: I've been here almost seven years, which is wild.
- 0:23SPEAKER_00: Time flies.
- 0:24SPEAKER_00: GREG FIERENTINO- That is a long time.
- 0:26SPEAKER_01: And you're understanding yourself a little bit.
- 0:27SPEAKER_01: Yes,
- 0:27SPEAKER_01: you're on the product team,
- 0:28SPEAKER_01: but for the last while and for the future,
- 0:31SPEAKER_01: you are running our search engine,
- 0:32SPEAKER_01: correct?
- 0:33SPEAKER_00: Yeah, yeah, that's right.
- 0:35SPEAKER_00: Search retention.
- 0:36You know,
- 0:37I do have worked across local search,
- 0:41the search ads,
- 0:43lots of different things.
- 0:45SPEAKER_01: Sweet.
- 0:46And today we are talking about a relatively new search feature
- 0:50that we launched
- 0:51SPEAKER_01: that people are liking.
- 0:53SPEAKER_01: And you know what?
- 0:54SPEAKER_01: I won't even introduce it.
- 0:55SPEAKER_01: Let me share your screen and let's walk through it.
- 0:58SPEAKER_01: Sure.
- 0:58SPEAKER_01: So...
- 1:01We now have the ability for users to exclude individual domains
- 1:10from their search results.
- 1:12SPEAKER_00: So I'll kind of show real quick what this looks like.
- 1:14SPEAKER_00: Let's say I'm writing some code and I want to do a technical search.
- 1:20SPEAKER_00: I want to figure out how to do...
- 1:24SPEAKER_00: an array of strings.
- 1:25SPEAKER_00: Those who don't know TypeScript is a programming language.
- 1:28SPEAKER_00: Programming language, yeah.
- 1:29SPEAKER_00: JavaScript-ish.
- 1:30SPEAKER_00: Superset of JavaScript.
- 1:32SPEAKER_00: So let's say I want to know how to do this,
- 1:34SPEAKER_00: and I get a bunch of search results,
- 1:37SPEAKER_00: and I see some here.
- 1:40And some of these are sites I know and like,
- 1:41and maybe some of them I want to exclude.
- 1:44I don't want to throw too much shade,
- 1:46but let me just pick one and kind of go.
- 1:49SPEAKER_00: So let's say I don't want to get results from W3 schools.
- 1:54I've seen so many comments about people wanting to get rid of
- 1:57W3 schools not to throw shade.
- 1:59SPEAKER_01: I've used W3 schools before, and I don't find it that bad.
- 2:03But there's a lot of people who seem to not like it who would
- 2:06probably want to remove it.
- 2:08SPEAKER_00: Yeah.
- 2:09SPEAKER_00: And I would say,
- 2:09SPEAKER_00: I mean,
- 2:10SPEAKER_00: this feature,
- 2:10SPEAKER_00: I think,
- 2:10SPEAKER_00: is particularly good for use cases like this where,
- 2:13SPEAKER_00: you know,
- 2:14SPEAKER_00: there's a site that maybe comes up a lot.
- 2:16SPEAKER_00: And for whatever reason,
- 2:17the user has kind of a disposition that they just don't want to
- 2:20see that site.
- 2:21SPEAKER_00: Yeah.
- 2:22SPEAKER_00: You know, we have other ways to accomplish this.
- 2:26SPEAKER_00: You know, you can just put minus site and then the domain in your query.
- 2:29SPEAKER_01: So you could do that for a long time, right, this minus site thing.
- 2:32SPEAKER_01: But this menu,
- 2:33SPEAKER_01: which people don't even maybe realize exists,
- 2:35SPEAKER_01: a lot of people,
- 2:37SPEAKER_01: is relatively new,
- 2:38SPEAKER_01: like maybe a year ago or something like that?
- 2:41SPEAKER_00: Yeah,
- 2:41SPEAKER_00: we added this menu a little over a year ago to all organics,
- 2:45SPEAKER_00: and organics being these text results.
- 2:50SPEAKER_00: And, you know...
- 2:51SPEAKER_00: At first,
- 2:53SPEAKER_00: and in fact,
- 2:54SPEAKER_00: I can just show if I click this redo search without this site,
- 2:59you'll see it adds that syntax right to the query and excludes
- 3:03it from the results.
- 3:05SPEAKER_00: So we've had that.
- 3:07SPEAKER_00: since we first launched this menu about a year ago.
- 3:10SPEAKER_00: And it works pretty well.
- 3:11SPEAKER_00: We got some good feedback about that when we first launched it.
- 3:15We also added that menu to give us the ability to have users
- 3:20kind of flag specific
- 3:22SPEAKER_00: results for a variety of reasons,
- 3:24so users can kind of tell us about individual results that they
- 3:29don't like if they
- 3:30SPEAKER_00: click Share Feedback about this site.
- 3:34But the new feature is that you can now sort of choose to block
- 3:38this site from all results.
- 3:40So you don't have to add that syntax to the query every time
- 3:43you want to remove it.
- 3:44So if I do that,
- 3:47you get this little message saying that it's been blocked
- 3:48successfully.
- 3:49SPEAKER_00: And I'm not sure if my screen is showing it,
- 3:52but you get a message at the top that tells you that you have
- 3:57one result hidden
- 3:58SPEAKER_00: from a site that you've blocked.
- 4:01And you can also go into your settings and you can see the
- 4:05sites that you've
- 4:06SPEAKER_00: blocked and manage them.
- 4:09SPEAKER_01: Sweet.
- 4:09SPEAKER_01: And reception so far, I don't think I think it was new.
- 4:13SPEAKER_01: I don't think we've got a lot of announcements of this yet.
- 4:16SPEAKER_01: But curious, like, is it starting to get usage like that kind of thing?
- 4:21SPEAKER_00: Yeah,
- 4:22SPEAKER_00: we're seeing,
- 4:23SPEAKER_00: you know,
- 4:25a relatively growing number of searches per day that use this
- 4:32block in some form.
- 4:32SPEAKER_00: The vast majority are only blocking a single site.
- 4:37We've talked about it a little bit in a couple places on social
- 4:42and also just had
- 4:43SPEAKER_00: users write in through our usual feedback channels to tell us about it.
- 4:48And I think the theme here is that we just are giving users
- 4:53more choice in how
- 4:56SPEAKER_00: their search results work.
- 5:00SPEAKER_00: do some level of customization to their own needs.
- 5:04And so,
- 5:04you know,
- 5:05this is kind of another feature that helps to accomplish that.
- 5:08SPEAKER_00: And I think that's, you know, that's generally appreciated.
- 5:11SPEAKER_00: There are some limitations also to this that,
- 5:14SPEAKER_00: you know,
- 5:14SPEAKER_00: we've heard about too,
- 5:15SPEAKER_00: and we're thinking about how to make it even better.
- 5:18SPEAKER_00: But, you know, yes, growing usage and some positive reactions so far.
- 5:24sweet yeah i agree it's it's uh i mean we've been doing
- 5:26customization for a long
- 5:28time i mean like this the the settings screen you're just
- 5:30showing shows how many
- 5:31settings we actually support in terms of customization which is
- 5:34a lot um and it
- 5:37reminds me of the ai filter that we also recently launched to
- 5:42like remove um some
- 5:45SPEAKER_01: ai image search results um
- 5:49SPEAKER_01: This,
- 5:49SPEAKER_01: like you said,
- 5:49it's a little different because it's more like specific domains
- 5:52that are coming up
- 5:53SPEAKER_01: a lot that you really don't like.
- 5:56SPEAKER_01: But yeah,
- 5:56SPEAKER_01: I'm curious,
- 5:58SPEAKER_01: given the feedback so far,
- 5:59and I remember not seeing several subreddit people finding it
- 6:02and posting positive
- 6:03SPEAKER_01: things about it,
- 6:05SPEAKER_01: subreddit posts.
- 6:05SPEAKER_01: But yeah, where are we thinking of taking this in the future?
- 6:08SPEAKER_01: Or are there other features,
- 6:12kind of like the AI one that kind of merges or circles around
- 6:16the same idea of
- 6:17SPEAKER_01: removing things?
- 6:18SPEAKER_00: Yeah, there are a couple things.
- 6:19SPEAKER_00: I mean,
- 6:20SPEAKER_00: as a starting point,
- 6:24SPEAKER_00: we had a limitation of five domains,
- 6:27SPEAKER_00: up to five domains that users could do.
- 6:30Part of that was based on this hypothesis that most users
- 6:34really would only want to
- 6:35SPEAKER_00: block one or two,
- 6:36SPEAKER_00: which I think is what we're seeing.
- 6:38SPEAKER_00: We have had people ask us for more.
- 6:40SPEAKER_00: We're exploring how we would do that.
- 6:44SPEAKER_00: you know, these things are always.
- 6:45SPEAKER_01: MARK MIRCHANDANI- And pause to that.
- 6:46SPEAKER_01: Partly a couple of follow-up questions to that.
- 6:48SPEAKER_01: One is, it's client-side now, right?
- 6:50SPEAKER_01: Like,
- 6:50SPEAKER_01: if you're,
- 6:51SPEAKER_01: you block the domains,
- 6:53SPEAKER_01: you actually get the results back,
- 6:54SPEAKER_01: and then your client is removing them based on your settings.
- 6:56SPEAKER_00: MARK MIRCHANDANI- That's correct.
- 6:57SPEAKER_00: Yeah, the result is there.
- 6:58SPEAKER_01: It's just not shown.
- 6:59SPEAKER_01: MARK MIRCHANDANI- Got it.
- 7:00SPEAKER_01: And the second thing is,
- 7:01SPEAKER_01: like,
- 7:01SPEAKER_01: I think we were also talking about,
- 7:02SPEAKER_01: like,
- 7:03SPEAKER_01: if you remove too many,
- 7:04SPEAKER_01: that's part of the way I put the message up,
- 7:07SPEAKER_01: Like you may actually want them sometimes when they're really relevant.
- 7:11And then if you remove tons of domains and then you remove
- 7:15actually good stuff
- 7:16SPEAKER_01: sometimes,
- 7:17then you're going to think our search results are terrible
- 7:19because you actually
- 7:20SPEAKER_01: removed stuff that was important that one time.
- 7:22SPEAKER_00: That's right.
- 7:23SPEAKER_00: One of the things we tested when we built this was,
- 7:27SPEAKER_00: you know,
- 7:28SPEAKER_00: how often do we see just a page of all the same domain,
- 7:34SPEAKER_00: right?
- 7:34SPEAKER_00: Such that if a user removed that domain,
- 7:37they would kind of get a no results page and think that the
- 7:41search engine was
- 7:42SPEAKER_00: broken.
- 7:43SPEAKER_00: And, you know...
- 7:46SPEAKER_00: It's not zero, right?
- 7:47SPEAKER_00: If I,
- 7:48SPEAKER_00: for example,
- 7:49SPEAKER_00: typed in,
- 7:50SPEAKER_00: you know,
- 7:50I want to see something on W3 schools from that example from a
- 7:54minute ago and got
- 7:56SPEAKER_00: all results from there,
- 7:57SPEAKER_00: it would just be an empty page.
- 7:58SPEAKER_00: So we want to be able to say,
- 8:00SPEAKER_00: hey,
- 8:00SPEAKER_00: you're,
- 8:00SPEAKER_00: you know,
- 8:01you've made some customization here that's hiding some results
- 8:04from you and you
- 8:05SPEAKER_00: have the option then to see them.
- 8:10SPEAKER_01: But nevertheless,
- 8:10SPEAKER_01: we're,
- 8:11SPEAKER_01: I mean,
- 8:11SPEAKER_01: we set five initially,
- 8:14SPEAKER_01: but we're thinking about increasing it at least a little bit.
- 8:17SPEAKER_01: That's right.
- 8:18They're also,
- 8:19right now,
- 8:20they only apply to those organic text link results.
- 8:25You know,
- 8:26we're looking at expanding that to other kinds of content on
- 8:30the page.
- 8:31SPEAKER_00: that it should also apply to.
- 8:33And there's potentially overlap with the image,
- 8:39AI image feature that you talked about.
- 8:42SPEAKER_00: You know,
- 8:42certainly there's some use cases around news or videos or other
- 8:47kinds of content
- 8:47SPEAKER_00: that users might want to have a little bit more customization around.
- 8:51SPEAKER_01: And I guess it's also possible that similar to the AI image list,
- 8:56SPEAKER_01: we could use a kind of organic AI list to have a different feature,
- 9:02but a similar kind of toggle to like remove AI organics or
- 9:06something like that.
- 9:07SPEAKER_00: Yeah, that's definitely something we're looking at, too.
- 9:10SPEAKER_00: I mean, it's a similar kind of challenge.
- 9:14And part of the challenge there is just that there are so many
- 9:18new sites kind of
- 9:19SPEAKER_00: popping up every day.
- 9:20SPEAKER_00: And so this feature is less geared around that.
- 9:27SPEAKER_00: I would put that in more of the sort of...
- 9:31uh spam category you know results that are uh things that maybe
- 9:37very very rarely
- 9:38get clicked on um you know very fresh um but uh you know not a
- 9:44ton of original
- 9:45content um you know there are potentially other things that we
- 9:48want to add on top
- 9:49of this feature to kind of supplement that and help users uh
- 9:53you know not have so
- 9:54SPEAKER_00: many of those showing up in their results too
- 9:57SPEAKER_01: I guess related to that,
- 9:57SPEAKER_01: I mean,
- 9:58SPEAKER_01: you showed the menu where we have,
- 10:00SPEAKER_01: and you could submit feedback.
- 10:02I think we've also,
- 10:02I mean,
- 10:02you could submit feedback there that it's a spam site.
- 10:05SPEAKER_01: I think we might've also recently added,
- 10:07SPEAKER_01: you could submit that it's an AI spam site,
- 10:09SPEAKER_01: but we actually use that information.
- 10:11SPEAKER_01: And to the extent that
- 10:13SPEAKER_01: we ultimately make a feature that might toggle off some of that,
- 10:16SPEAKER_01: like we would use that feedback.
- 10:19SPEAKER_01: So if you're out there and you want to submit us feedback,
- 10:21that's a good way to do it for like sites that you're finding
- 10:25you are completely
- 10:26SPEAKER_01: not relevant,
- 10:26SPEAKER_01: right?
- 10:27SPEAKER_00: Yeah, that's exactly right.
- 10:30SPEAKER_00: Maybe I'll just show that real quick.
- 10:31SPEAKER_00: Yeah, that's good.
- 10:33SPEAKER_00: Because.
- 10:33SPEAKER_01: I mean, we want more feedback of this particular variety.
- 10:37SPEAKER_00: We do.
- 10:38SPEAKER_00: I mean, the more feedback we get about it, the better.
- 10:41SPEAKER_00: So say I come in here and go share feedback about this site.
- 10:48SPEAKER_00: You can select that a site is AI generated.
- 10:51SPEAKER_00: You can sort of tell us anything you might want to tell us about that,
- 10:55SPEAKER_00: or you can just send that and it will flag it for us to review.
- 11:00SPEAKER_00: And, you know, we obviously we get a bunch of these every day now.
- 11:04SPEAKER_00: We only added this AI generated option a couple of weeks ago.
- 11:07SPEAKER_00: Even we've had the spam option, which we've used for a while.
- 11:12um uh but you know we're sort of looking at these um we're
- 11:17investing in other ways
- 11:18to to help us kind of verify um you know that so that something
- 11:22is in fact uh ai
- 11:24generated um and you know it's a it's a pretty new uh new space
- 11:30and and i think
- 11:30we're we're sort of learning what works well for that but um
- 11:33you know if if if
- 11:35again if you're out there and you want to tell us about these
- 11:38um we are kind of
- 11:40building up our capabilities around this and and making use of
- 11:43of that feedback
- 11:44directly sweet um great anything i don't know i missed about
- 11:50this feature or you
- 11:52SPEAKER_01: didn't tell us that you want to share um
- 11:57SPEAKER_00: I think that just kind of on the topic of choice and customization,
- 12:05we put a decent amount of thought into how we make it clear to
- 12:12users that this
- 12:13SPEAKER_00: feature is in effect,
- 12:15SPEAKER_00: that you've blocked a site,
- 12:17SPEAKER_00: how you kind of manage the list of blocked sites once you've
- 12:24SPEAKER_00: You've done that.
- 12:26SPEAKER_00: I think,
- 12:26SPEAKER_00: you know,
- 12:26SPEAKER_00: we'd love to hear other feedback about how well that's working,
- 12:30SPEAKER_00: how clear that is.
- 12:32SPEAKER_00: You know, we kind of build these things and put them out there.
- 12:36SPEAKER_00: We test them a lot.
- 12:38SPEAKER_00: But,
- 12:38SPEAKER_00: you know,
- 12:39SPEAKER_00: as we add more functionality to this,
- 12:43SPEAKER_00: you know,
- 12:43we're always looking for feedback about how well it works and
- 12:49ways to make it
- 12:49SPEAKER_00: better.
- 12:51SPEAKER_00: So,
- 12:51SPEAKER_00: you know,
- 12:51that's one particular piece that to me was really important
- 12:55when we built it was,
- 12:57SPEAKER_00: you know,
- 12:57SPEAKER_00: we don't want to create a feature kind of thinking it's useful and then,
- 13:01SPEAKER_00: you know,
- 13:01SPEAKER_00: make something that is inadvertently creating confusion or making users,
- 13:08SPEAKER_00: making it harder for users to find what they're looking for.
- 13:10So,
- 13:12you know,
- 13:12that's something we're kind of on the lookout for as we try to
- 13:14improve it.
- 13:17SPEAKER_01: That's great.
- 13:17SPEAKER_01: It reminds me of one last thing,
- 13:19SPEAKER_01: which I think we should just basically have a future episode about.
- 13:22SPEAKER_01: But just to tease out,
- 13:24I'm sure we're going to get this point of feedback in the next
- 13:29prediction in the
- 13:29SPEAKER_01: next month from our subreddit.
- 13:32SPEAKER_01: I set these sites that I don't want to see,
- 13:34SPEAKER_01: and then I cleared all my settings,
- 13:36SPEAKER_01: and now I have to redo them.
- 13:39Unfortunately,
- 13:41outside of our browser,
- 13:43we don't really have a lot of control with that because
- 13:45settings we don't have accounts and settings are getting stored
- 13:49in browser storage
- 13:51and if you clear all the browser storage product i go then this
- 13:54goes away however
- 13:55we are working on uh syncing your search settings to your
- 14:00browser settings so if
- 14:01SPEAKER_01: you're using our browser um
- 14:04we won't just we won't lose your search settings and that is a
- 14:07thing that people
- 14:08have been asking for for literally a decade and so i'm very
- 14:11excited that we're
- 14:11working on it i don't think we're done with it yet but like um
- 14:14maybe when we first
- 14:16SPEAKER_01: have that working we could come back and do another episode with somebody
- 14:19SPEAKER_00: Yeah, I think it would be great to showcase that.
- 14:22And we've tried a number of technical solutions to try to
- 14:27reduce the accidental
- 14:29SPEAKER_00: clearing of settings.
- 14:31SPEAKER_00: And yeah, we have less control outside of our browsers.
- 14:35SPEAKER_00: But even there, I think we've made some strides.
- 14:39SPEAKER_00: But within our browsers, there's a lot more we can do than ways to
- 14:45allow users to sync uh so we could we could definitely showcase
- 14:49that cool well
- 14:51thank you greg for coming on to ducktales and thank you
- 14:54everybody for listening and
- 14:56SPEAKER_01: until next time