Latest / Inside DuckDuckGo / Duck Tales: How DuckDuckGo blocks trackers on third-party websites (Ep.17)
Transcript
- 0:00SPEAKER_00: Hello,
- 0:01SPEAKER_00: and welcome to DuckTales,
- 0:02SPEAKER_00: where we go behind the scenes at DuckDuckGo and discuss the stories,
- 0:07SPEAKER_00: technology,
- 0:08SPEAKER_00: and people that help build privacy tools for everyone.
- 0:13SPEAKER_00: In each episode,
- 0:14we talk about something going on with our product or our company or our
- 0:21company
- 0:21SPEAKER_00: vision.
- 0:23SPEAKER_00: and or how we operate.
- 0:24And today we have our guest is Dave,
- 0:28who's here to talk about the tracker block list.
- 0:32SPEAKER_00: Hi, Dave.
- 0:34SPEAKER_01: Hey, Beah.
- 0:34SPEAKER_01: Thanks for having me on.
- 0:36SPEAKER_00: Introduce yourself briefly.
- 0:38SPEAKER_01: Sure thing.
- 0:39SPEAKER_01: Yeah.
- 0:40SPEAKER_01: My name is Dave Harvidge.
- 0:41SPEAKER_01: I'm a privacy engineer at DuckDuckGo.
- 0:43SPEAKER_01: I primarily work on identifying privacy threats,
- 0:46SPEAKER_01: building features to protect our users from these threats,
- 0:50SPEAKER_01: and ensuring that we deliver a great web browsing experience.
- 0:54SPEAKER_00: That sounds very important, Dave.
- 0:57SPEAKER_01: Yeah.
- 0:58SPEAKER_01: Yeah.
- 0:58SPEAKER_01: It's a constant battle.
- 1:00It's trying to keep up with the developing environment,
- 1:05give our users a good experience.
- 1:07SPEAKER_00: Thanks for fighting the good fight.
- 1:11SPEAKER_00: So if I've posted,
- 1:14SPEAKER_00: if you've seen other DuckTales,
- 1:15SPEAKER_00: you might've met me,
- 1:15SPEAKER_00: but if you haven't,
- 1:16SPEAKER_00: I'm Beah and I am on the product team here.
- 1:20SPEAKER_00: So yeah, let's talk a bit about the tracker block list.
- 1:25SPEAKER_00: First of all, what even is it?
- 1:29SPEAKER_01: Yeah,
- 1:30soourtrackerblocklistisalistofdomainsandURLsthatwefoundtoexhibit
- 1:35SPEAKER_01: what we call cross-site tracking behaviors.
- 1:39We use it in our browsers and browser extensions to block tracking requests
- 1:43and
- 1:43SPEAKER_01: enhance the privacy of our users.
- 1:47SPEAKER_00: Sweet.
- 1:48SPEAKER_00: Okay.
- 1:49SPEAKER_00: So what's the point of all that?
- 1:53SPEAKER_00: Why did we even make this thing?
- 1:55Yeah,
- 1:56so at DuckDuckGo,
- 1:57we believe that privacy is a fundamental human right.
- 2:00And we believe that people should have the option to live their lives without
- 2:04third
- 2:04SPEAKER_01: parties recording their every move.
- 2:08We realized that protecting users' privacy on our search engine was only
- 2:13half of the battle.
- 2:14SPEAKER_01: As soon as users leave our search engine page to visit other websites,
- 2:19they're subject to these third parties tracking their activities anywhere
- 2:23theygo
- 2:24SPEAKER_01: on the web,
- 2:24SPEAKER_01: pretty much.
- 2:26I think you might be shocked at just how many companies are involved in
- 2:30tracking your activity.
- 2:32SPEAKER_01: and also the granularity of the data that they're collecting.
- 2:35SPEAKER_01: Just for example,
- 2:37we've seen individual websites load hundreds of different tracking
- 2:41requestsona
- 2:42SPEAKER_01: single page load,
- 2:44SPEAKER_01: and it's all hidden to the users.
- 2:47So we decided that we wanted to build a product that protects our users'
- 2:51privacy,
- 2:52SPEAKER_01: not just when they're searching,
- 2:54SPEAKER_01: but when they're browsing the web.
- 2:56SPEAKER_00: Yeah.
- 2:57Do you know approximately what portion of websites or maybe of web traffic is
- 3:05toa
- 3:05SPEAKER_00: site with or to a page that has trackers on it?
- 3:10SPEAKER_01: I don't have the exact number on the top of my head.
- 3:14SPEAKER_01: It is...
- 3:16SPEAKER_00: I feel like last I looked at the data,
- 3:17SPEAKER_00: which was a little while ago,
- 3:18SPEAKER_00: it was like something on the order of 90%.
- 3:21SPEAKER_01: Yeah, it's up there.
- 3:23SPEAKER_01: It's apps that you install on your phone.
- 3:26SPEAKER_01: It's websites that you visit in a browser.
- 3:29SPEAKER_01: It's incredibly prevalent everywhere.
- 3:31SPEAKER_01: Yeah.
- 3:33So basic premise here,
- 3:34like,
- 3:34I mean,
- 3:35I'm sure there's a lot of people listening who,
- 3:36like,
- 3:37SPEAKER_00: know this in their sleep.
- 3:38SPEAKER_00: But then for those who don't,
- 3:40SPEAKER_00: it's like as you move around the web,
- 3:43there may be these hidden trackers that have no explicit connection to the
- 3:46site
- 3:47SPEAKER_00: itself.
- 3:48SPEAKER_00: Google specifically is on just a ton of pages on the internet.
- 3:51SPEAKER_00: So you're on some random website,
- 3:54SPEAKER_00: like a community,
- 3:56SPEAKER_00: maybe the school your child goes to or something like that.
- 3:58SPEAKER_00: And Google is actually there watching what you do in some sense,
- 4:01SPEAKER_00: collecting data on your behaviors,
- 4:04SPEAKER_00: right?
- 4:05SPEAKER_01: Yeah, that's exactly right.
- 4:07There are many different reasons that websites add these third parties to
- 4:10their pages.
- 4:12SPEAKER_01: Sometimes it's for analytics,
- 4:13SPEAKER_01: sometimes it's for advertising,
- 4:16but they all are collecting this information about what you're looking at,
- 4:21SPEAKER_01: how you're interacting with the page,
- 4:23SPEAKER_01: and it's all being sent back to these third parties.
- 4:25SPEAKER_01: It's not even the site that you're browsing.
- 4:27SPEAKER_01: It's not clear that they're getting this information.
- 4:31SPEAKER_00: Yeah, got it.
- 4:32SPEAKER_00: So how does that relate to ad blocking?
- 4:37SPEAKER_01: So in the general sense, what we offer is not an ad blocker.
- 4:43SPEAKER_01: A lot of the open web is supported by ad revenue,
- 4:47SPEAKER_01: and we're really not out to destroy that business model.
- 4:50SPEAKER_01: It does, however, block ads that track you.
- 4:54So as I mentioned earlier,
- 4:56a lot of these ads are actually phoning home about your activities.
- 5:00SPEAKER_01: They're either saying, you know, this user
- 5:04lingered on this ad or they had their mouse over it or they're you know they're
- 5:08on
- 5:09this page is might be like kind of personal um and anytime we detect that kind
- 5:16of
- 5:16behavior uh we we block that um i think a lot of people just don't really
- 5:21realize
- 5:22that that these ads that they're seeing aren't just like static images or
- 5:26videos
- 5:27SPEAKER_01: they're also data collection apparatuses
- 5:30SPEAKER_00: Yeah.
- 5:31SPEAKER_00: Yeah.
- 5:31SPEAKER_00: So we didn't set out to build an ad blocker,
- 5:33butbecausealotofthecodethatgeneratesadsorthatservesadsonawebsite
- 5:39SPEAKER_00: has tracking in it,
- 5:39SPEAKER_00: we block it as a consequence of blocking that tracking code.
- 5:43SPEAKER_00: And I notice this personally,
- 5:44SPEAKER_00: like if I use a different browser,
- 5:47SPEAKER_00: I'm often surprised at a lot of sites that I go to on the regular.
- 5:52SPEAKER_00: I'm like,
- 5:52SPEAKER_00: oh,
- 5:53SPEAKER_00: in other browsers,
- 5:54these start halfway down the page because there's this huge ad at the top.
- 5:59SPEAKER_01: Yeah.
- 6:00SPEAKER_00: Got it.
- 6:01SPEAKER_00: So, okay.
- 6:04SPEAKER_00: This tracker block list, we built this.
- 6:06SPEAKER_00: Are we using somebody else's data or did we build this in-house?
- 6:11SPEAKER_01: Yes, we built this entirely in-house.
- 6:14SPEAKER_01: When we first started going down this path,
- 6:16SPEAKER_01: we looked at the existing lists and they didn't quite meet our needs.
- 6:21SPEAKER_01: So there are a lot of different open source lists out there.
- 6:25SPEAKER_01: But what we found was that
- 6:27Itwasn'talwaysclearwhycertaindomainswereontheselistsandwhyother
- 6:31SPEAKER_01: domains weren't on these lists.
- 6:33You know,
- 6:33that leaves some room for bias potentially,
- 6:36whether intentionally or unintentionally.
- 6:41SPEAKER_01: And in order to offer a good product to our users,
- 6:44we really wanted to build a fully objective tracker list that's built on
- 6:50real-time
- 6:51activity observed across the web so that anytime there's a tracker in our
- 6:55block
- 6:55SPEAKER_01: list,
- 6:57SPEAKER_01: If someone were to ask, you know, why is that in there?
- 7:00SPEAKER_01: We can tell them exactly why that's in there.
- 7:03SPEAKER_00: Yeah.
- 7:03SPEAKER_00: So actually, do you want to say what the criteria is?
- 7:07SPEAKER_00: Like, what would be the answer to that?
- 7:08SPEAKER_00: How do we decide if something's a tracker?
- 7:11SPEAKER_01: Sure, yeah.
- 7:12SPEAKER_01: So every month,
- 7:14the way that we do this is we crawl hundreds of thousands of websites from all
- 7:17over
- 7:17SPEAKER_01: the world.
- 7:18And we look at the behaviors that are exhibited by the third-party requests
- 7:22or
- 7:23SPEAKER_01: third-party scripts that are on the page.
- 7:26SPEAKER_01: When we're trying to determine if something is a cross-site tracker,
- 7:31umwefocusonreallyafewkeycriteriaumsothefirstoneisisitsetting
- 7:37cookies or is it storing something locally that then could be accessed to
- 7:41track
- 7:43SPEAKER_01: your activity across websites um the second one is
- 7:48IsitaccessingbrowserAPIsthatarecommonlyusedtocreatewhat'scalleda
- 7:54SPEAKER_01: fingerprint of your browser or device?
- 7:57SPEAKER_01: So that might be,
- 7:58SPEAKER_01: you know,
- 7:58might be checking to see how much memory your computer has or what kind of CPU
- 8:03you
- 8:04SPEAKER_01: have or,
- 8:05SPEAKER_01: you know,
- 8:06SPEAKER_01: the width of your screen or the pixel density of your screen.
- 8:10A lot of tracking happens that way where they gather all the entropy from all
- 8:15of
- 8:15these different signals and they create what's called a fingerprint of your
- 8:20device
- 8:21andthentheycanuniquelyidentifyyoujustbycomparingthatfingerprint
- 8:27SPEAKER_01: across different sites.
- 8:29And the third criteria is we look for things that are present on many
- 8:36different
- 8:36SPEAKER_01: independent sites.
- 8:38So we have like a lower threshold for what we consider to be a cross-site
- 8:43tracker.
- 8:44SPEAKER_00: All right.
- 8:46SPEAKER_00: Gotcha.
- 8:47SPEAKER_00: Do you want to talk about,
- 8:48SPEAKER_00: are there any interesting challenges,
- 8:50like either technical or user-facing challenges that we've encountered in
- 8:55building
- 8:55SPEAKER_00: out this block list?
- 8:58SPEAKER_01: Yeah, absolutely.
- 9:00SPEAKER_01: So the first one is, you know, tracking techniques are evolving.
- 9:04SPEAKER_01: So like as we develop a better tracker identification method,
- 9:09these tracking companies see that we're doing that or they see that others
- 9:12are
- 9:13SPEAKER_01: doing that and they
- 9:14SPEAKER_01: you know,
- 9:15devise very clever ways to evade that and make it look like they're not
- 9:19trackingso
- 9:19SPEAKER_01: they don't get blocked.
- 9:21So we have to continuously update our detection techniques to stay ahead of
- 9:26them.
- 9:28And then I think the most important issue that we run into is making sure that
- 9:34the web works.
- 9:38SPEAKER_01: Because a lot of websites,
- 9:40what they've done is they've integrated these tracking companies in a way
- 9:45suchthat
- 9:46SPEAKER_01: if you block those tracking companies from loading,
- 9:50SPEAKER_01: the site often doesn't work.
- 9:54We've developed a very efficient process for reviewing these breakage
- 9:59reportsthat
- 9:59SPEAKER_01: we get from users.
- 10:01SPEAKER_01: So in our browsers,
- 10:02SPEAKER_01: anytime you hit a site and it's not working right,
- 10:05SPEAKER_01: you can report that to us.
- 10:08And then we take all those reports,
- 10:10we look at them,
- 10:10we figure out,
- 10:12you know,
- 10:12what's going on?
- 10:13SPEAKER_01: Is this like real breakage?
- 10:16andwefixitandwedothatithinkprettyefficientlyatthispointmostofthe
- 10:21timewecangetthingsworkingwithinafewdaysnicesohowumiflikeany
- 10:27listeners are encounter breakage like what exactly should they do to report
- 10:32itto
- 10:32SPEAKER_00: us at broken site i mean
- 10:35SPEAKER_01: Yeah, so there's two different ways to do it for our browsers.
- 10:38SPEAKER_01: The first way is you can open the privacy dashboard.
- 10:41SPEAKER_01: There's a little green, we call it a duck foot icon in the address bar.
- 10:46SPEAKER_01: It's on the left side.
- 10:47SPEAKER_01: Many people might think it's a shield.
- 10:49SPEAKER_01: It's actually a duck foot.
- 10:51SPEAKER_01: It's both.
- 10:52SPEAKER_00: It's a shield and a duck foot.
- 10:55SPEAKER_01: Yeah.
- 10:56SPEAKER_01: If you click that,
- 10:57it'll open up and it'll give you like an overview of the privacy of the
- 11:00website.
- 11:01And there's a little link there that you can click to submit a broken site
- 11:04report.
- 11:05You can also just submit a broken site report from the primary browser menu in
- 11:11all
- 11:11SPEAKER_01: of our browsers.
- 11:12SPEAKER_01: And yeah,
- 11:14andthosecomestraighttousandourteamreviewsthemandmakesurethat
- 11:18SPEAKER_01: everything is working as expected.
- 11:21SPEAKER_00: So if you want the protection of our block list, you have to get that.
- 11:26SPEAKER_00: Just going to DuckDuckGo and searching isn't going to give you the,
- 11:30we can't use our block list to intervene if you're in somebody else's
- 11:37browser,
- 11:37SPEAKER_00: unless you're in a DuckDuckGo browser or you've installed our extension,
- 11:42SPEAKER_00: right?
- 11:44SPEAKER_01: That's right.
- 11:45SPEAKER_01: That's right.
- 11:46So if you're listening and you want all the benefits of this block list that
- 11:51Dave
- 11:52SPEAKER_00: works hard on,
- 11:53SPEAKER_00: go install our browsers or extension.
- 11:57SPEAKER_00: And then report it when you run into a broken site,
- 11:59SPEAKER_00: if you even do,
- 12:00SPEAKER_00: because,
- 12:01SPEAKER_00: again,
- 12:01SPEAKER_00: Dave is working hard to make sure that you don't.
- 12:05SPEAKER_01: Yeah.
- 12:07SPEAKER_00: Nice.
- 12:07SPEAKER_00: OK.
- 12:09SPEAKER_00: So most of this tracking kind of happens behind the scenes.
- 12:12SPEAKER_00: You can't actually see it happening.
- 12:14SPEAKER_00: Is there a way that users can understand what's actually going on?
- 12:21SPEAKER_01: Yeah, absolutely.
- 12:22SPEAKER_01: So we show in our browsers,
- 12:26SPEAKER_01: when you visit a web page,
- 12:27we'll show a little animation in the address bar that shows the trackers that
- 12:31are
- 12:31SPEAKER_01: being blocked.
- 12:33And then if you click into the privacy dashboard,
- 12:36the duck foot or field icon,
- 12:39You can see like a full list of every tracker that we've identified along with
- 12:43the
- 12:43SPEAKER_01: company that it belongs to.
- 12:46SPEAKER_01: And a lot more information about the status of the webpage,
- 12:50SPEAKER_01: like the security of the site,
- 12:53SPEAKER_01: the privacy practices of the site.
- 12:55SPEAKER_00: Yeah, it's pretty wild.
- 12:57SPEAKER_00: Like if you haven't done this already,
- 12:59like go to your favorite news site and click around and then like click on the
- 13:04duck
- 13:04SPEAKER_00: foot shield and you can just like see sometimes like dozens of companies.
- 13:10SPEAKER_00: Sometimes,
- 13:10SPEAKER_00: you know,
- 13:10SPEAKER_00: like Google's off in there,
- 13:12but like sometimes there's companies you've never even heard of that are on
- 13:14the
- 13:14SPEAKER_00: site.
- 13:15SPEAKER_00: It's pretty wild.
- 13:17SPEAKER_01: Yeah,
- 13:17SPEAKER_01: it's crazy,
- 13:18SPEAKER_01: especially the ones you've never heard of,
- 13:20SPEAKER_01: because it's not always clear what they're doing with the data.
- 13:24SPEAKER_01: I think some of the big advertising companies,
- 13:26they're obviously using it to better target you with ads or different
- 13:30content.
- 13:32SPEAKER_01: But some of these lesser known ones,
- 13:36SPEAKER_01: they actually bundle up this data,
- 13:37SPEAKER_01: create a profile of you,
- 13:38SPEAKER_01: and then they sell it to the highest bidder,
- 13:40SPEAKER_01: which is pretty scary.
- 13:41SPEAKER_00: Yeah.
- 13:46SPEAKER_00: OK,
- 13:46SPEAKER_00: so maybe just before we wrap up,
- 13:48SPEAKER_00: is there anything that we haven't touched on that you want to mention,
- 13:51SPEAKER_00: Dave?
- 13:53SPEAKER_01: Most of this stuff is open source.
- 13:55So all of the tools that we use to build our tracker block list,
- 13:59they're all open source.
- 14:00SPEAKER_01: You can find them and you can use them.
- 14:04SPEAKER_01: They exist on github.com.
- 14:06SPEAKER_01: That's g-i-t-h-u-b.com slash duckduckgo slash tracker hyphen radar.
- 14:14We actually have a few different...
- 14:16Maybe we can put that in the show notes.
- 14:18SPEAKER_01: Yeah.
- 14:20SPEAKER_00: I was like, they can spell GitHub.
- 14:21SPEAKER_00: And I was like, OK, it's getting complicated.
- 14:23SPEAKER_01: Yeah.
- 14:25So we have a few different places in our GitHub where we have open source to all
- 14:30of this.
- 14:31And we've actually found that some cutting edge researchers have been using
- 14:34a
- 14:35SPEAKER_01: crawler to find different risks online.
- 14:39umitisit'sprettyit'sprettygoodandwe'rewetrytobeasresponsiveas
- 14:43responsive as possible when you know somebody's trying to use it and has an
- 14:46issue
- 14:46orhasaquestionaboutwhysomethingworksthewayitdoesumyeahhitusup
- 14:52directly um contributing to decked echo's mission of raising the standard
- 14:57oftrust
- 14:58SPEAKER_01: online that's right
- 15:00SPEAKER_00: That seems like a good note to end on.
- 15:02SPEAKER_00: So thank you very much, Dave.
- 15:04SPEAKER_00: Appreciate it.
- 15:05SPEAKER_01: Yeah, thank you.
- 15:06SPEAKER_00: And see you around the hood.
- 15:10SPEAKER_01: Sounds good.
- 15:11SPEAKER_00: Thanks.
- 15:11SPEAKER_00: Later.