Latest / Inside DuckDuckGo / Duck Tales: The performance review process at DuckDuckGo (Ep.47)
Transcript
- 0:01SPEAKER_00: Hello, everyone, and welcome to DuckTales, where we go behind the scenes at DuckDuckGo.
- 0:06SPEAKER_00: We discuss the stories, technology, and the people that help build privacy tools for everyone.
- 0:11SPEAKER_00: In each of these episodes,
- 0:12SPEAKER_00: you'll hear from the employees about our vision,
- 0:14SPEAKER_00: product updates, engineering, or things like approaches to AI.
- 0:18SPEAKER_00: My name is Jeffrey,
- 0:19SPEAKER_00: and I'm on the internal efficiency team at DuckDuckGo,
- 0:22SPEAKER_00: and today I'm joined with my colleague Anne.
- 0:25SPEAKER_00: Anne, do you want to introduce yourself?
- 0:27SPEAKER_01: Hi, I'm Anne.
- 0:28SPEAKER_01: I'm on the People Ops team at DuckDuckGo.
- 0:31SPEAKER_01: It's been about five years now,
- 0:32SPEAKER_01: which I can't believe, but lots of exciting stuff over that time.
- 0:37SPEAKER_00: Great.
- 0:38SPEAKER_00: Today we're going to be talking about our internal performance reviews and how we run them.
- 0:42SPEAKER_00: Anne,
- 0:42SPEAKER_00: how would you describe our performance review process to someone who's never heard
- 0:46SPEAKER_00: of DuckDuckGo?
- 0:48SPEAKER_01: Well, I think the important thing to start with is sort
- 0:51SPEAKER_01: of describing DuckDuckGo's distributed leadership model because
- 0:55SPEAKER_01: with distributed leadership, that's going to feed into performance reviews.
- 1:00SPEAKER_01: And so the short answer I would give with that is that there's no one decider of performance.
- 1:07SPEAKER_01: There's multiple different ways,
- 1:10SPEAKER_01: multiple different people that give input as well as a really strict...
- 1:16SPEAKER_01: Requirement that it be evidence-based.
- 1:19SPEAKER_01: And we'll get into this a bit later, I'm sure.
- 1:21SPEAKER_01: But we've done a lot of work on the evidence-based piece.
- 1:24SPEAKER_01: And being an asynchronous organization really helps with that
- 1:27SPEAKER_01: because mostly everything is written down.
- 1:30SPEAKER_01: So that's the high level that I would give.
- 1:35SPEAKER_00: How do we decide what collaborators get involved with each person's reviews specifically?
- 1:42SPEAKER_01: Yeah, this has been a really interesting question over the years.
- 1:46SPEAKER_01: And I would just love to brag a bit about how we used to do it when we were
- 1:51SPEAKER_01: a smaller organization and then talk about how we've evolved that.
- 1:54SPEAKER_01: Because, well, I think way long ago, the organization was small enough to just kind of know.
- 2:00SPEAKER_01: You knew who should be giving input for who.
- 2:03SPEAKER_01: And then the organization grew to the point where we needed help figuring out, right?
- 2:09SPEAKER_01: One person couldn't hold it all in their head.
- 2:11SPEAKER_01: And so you very generously helped us create an algorithm that put out a spreadsheet
- 2:18SPEAKER_01: that basically ingested information about people's leadership relationships
- 2:24SPEAKER_01: to one another,
- 2:25SPEAKER_01: their work overlap with one another,
- 2:27SPEAKER_01: and their experience giving feedback, among other things.
- 2:31SPEAKER_01: Calculated all of those relationships,
- 2:34SPEAKER_01: also taking into account load and Because,
- 2:37SPEAKER_01: you know, maybe one person should review 50 people, but that's just too many, right?
- 2:40SPEAKER_01: So balancing those tradeoffs and then making a suggestion, which was really cool.
- 2:45SPEAKER_01: And then those suggestions obviously had to be reviewed by humans and still,
- 2:49SPEAKER_01: you know, load adjusted and everything.
- 2:50SPEAKER_01: And there were several rounds of human review.
- 2:53SPEAKER_01: So that was great.
- 2:54SPEAKER_01: And then that also came to the point where we outgrew that
- 2:58SPEAKER_01: because even those suggestions were going to start fraying at a point and
- 3:03SPEAKER_01: the human review was cumbersome.
- 3:05SPEAKER_01: And so we've moved,
- 3:08SPEAKER_01: I think,
- 3:08SPEAKER_01: quite naturally toward leaning on functional calibrators who are closer to
- 3:13SPEAKER_01: the functional work and then pulling in the objective side of the house,
- 3:17SPEAKER_01: which is sort of like where work is getting executed and having those be
- 3:22SPEAKER_01: the default inputs for people.
- 3:24SPEAKER_01: But yeah, that's kind of how that's changed over time.
- 3:27SPEAKER_01: And it's been a really exciting problem.
- 3:29SPEAKER_00: For the most part,
- 3:30SPEAKER_00: it's scaled as the company has grown and we've just had to make small changes here
- 3:35SPEAKER_00: and there.
- 3:36SPEAKER_01: Yeah, as a people person,
- 3:38SPEAKER_01: I also say, you know, people say, how do we keep our culture as we grow?
- 3:41SPEAKER_01: And this is similar to that where I say we don't keep something, right?
- 3:45SPEAKER_01: How do we scale something in accordance with our values as we grow?
- 3:50SPEAKER_01: And this, I think, would be a really good example of that and a really unique one, too.
- 3:55SPEAKER_00: Cool.
- 3:57SPEAKER_00: What makes evaluating performance here different from a typical company?
- 4:01SPEAKER_01: Well, similar to what I said before,
- 4:03SPEAKER_01: right, distributed leadership means you have to figure out who.
- 4:05SPEAKER_01: It's not like a managerial chain where the manager writes a performance review
- 4:09SPEAKER_01: with peer feedback and then that gets approved by their manager and
- 4:12SPEAKER_01: that gets approved.
- 4:12SPEAKER_01: You know, it's not a chain of approvals.
- 4:14SPEAKER_01: It's a collaborative process, which is also why that was one of the main reasons.
- 4:20SPEAKER_01: There were several,
- 4:20SPEAKER_01: but one of the bigger blockers for us purchasing performance review software from
- 4:25SPEAKER_01: a company was that None of them had the functionality to have the level
- 4:29SPEAKER_01: of collaboration that we have, like back and forth collaboration.
- 4:33SPEAKER_01: So there's that.
- 4:34SPEAKER_01: And then the real, just like I said earlier, reliance on data.
- 4:40SPEAKER_01: We are an asynchronous organization that really leverages processes
- 4:45SPEAKER_01: in our project management tool,
- 4:47SPEAKER_01: Asana, to fill the gaps of what a lot of live meetings would be.
- 4:50SPEAKER_01: And I would imagine other DuckTales have talked about
- 4:53SPEAKER_01: no meeting Wednesdays,
- 4:54SPEAKER_01: which is like for real at other companies is kind of In air quotes,
- 4:57SPEAKER_01: but I would say here,
- 4:58SPEAKER_01: not all other companies to be clear,
- 4:59SPEAKER_01: but oftentimes that can slip, but here it's pretty legit.
- 5:05SPEAKER_01: And so,
- 5:06SPEAKER_01: we're generally meeting light and so everything is in Asana and you can pull that in
- 5:10SPEAKER_01: to work summaries.
- 5:12SPEAKER_01: And that's also something you've been involved with is really having a set of
- 5:18SPEAKER_01: And yeah,
- 5:19SPEAKER_01: that's the other thing I would really be,
- 5:29SPEAKER_01: I would say is unique that the reliance on evidence and links
- 5:34SPEAKER_01: and things you can actually see and look at and review is pretty high.
- 5:38SPEAKER_00: Great.
- 5:40SPEAKER_00: You touched on this a little bit, but can you go into how the process has scaled as we've grown?
- 5:48SPEAKER_01: Yeah, so yeah,
- 5:50SPEAKER_01: that was one of the things is obviously figuring out how
- 5:54SPEAKER_01: to fill those collaborative evaluator roles.
- 5:58SPEAKER_01: Another is automation.
- 6:00SPEAKER_01: We've really built our own system that integrates with where work gets done for us,
- 6:07SPEAKER_01: which is Asana.
- 6:08SPEAKER_01: And as a people operator,
- 6:10SPEAKER_01: I feel blessed that I'm just given IT resources to be like,
- 6:14SPEAKER_01: hey, you need this system to work.
- 6:16SPEAKER_01: Here's some really awesome skilled IT folks to help you make it a reality.
- 6:21SPEAKER_01: And we have some really cool people on the team working
- 6:24SPEAKER_01: to build our own performance review projects.
- 6:29SPEAKER_01: That integrates exactly with where work happens for us.
- 6:32SPEAKER_01: And so I'd say that is one that we've built that system and it's evolved
- 6:36SPEAKER_01: over time alongside other systems, right?
- 6:39SPEAKER_01: So we have things like our daily asynchronous personal stand-up.
- 6:43SPEAKER_01: Right.
- 6:43SPEAKER_01: So everybody does a stand up for themselves every day and that gets recorded.
- 6:46SPEAKER_01: And so then that can filter back into this whole performance review process
- 6:50SPEAKER_01: because you have a record of what you were focused on every day.
- 6:53SPEAKER_01: You have a record of the project you were focused on every week.
- 6:56SPEAKER_01: We have a whole summary of the relationships of your project advisory,
- 7:00SPEAKER_01: career advisory, everything.
- 7:02SPEAKER_01: We've basically been automating more of these things to be centralized in
- 7:05SPEAKER_01: a way that's digestible.
- 7:10SPEAKER_01: I'm really
- 7:15SPEAKER_00: proud of our daily stand-up.
- 7:17SPEAKER_00: We call our daily one must, but it's been with us for a while now.
- 7:20SPEAKER_00: And it's all asynchronous where people can fill it in in the morning and
- 7:24SPEAKER_00: then everybody who needs to know can see what their stand-up is.
- 7:29SPEAKER_01: Yeah, that's the transparency part too, right?
- 7:31SPEAKER_01: You can kind of go see what anyone's working on at any time, which is pretty cool.
- 7:37SPEAKER_00: How is this process suited for our remote asynchronous first culture?
- 7:42SPEAKER_01: Yeah, I mean,
- 7:43SPEAKER_01: I think similar to the things I've said before, too,
- 7:47SPEAKER_01: it fits the culture because,
- 7:49SPEAKER_01: for one, we have all of this substrate to work with, right?
- 7:52SPEAKER_01: We have all of the...
- 7:54SPEAKER_01: The asynchronous culture is really reliant upon things being written down.
- 7:59SPEAKER_01: And when things are written down, you can really shortcut a lot of the...
- 8:05SPEAKER_01: You know, forgetting what happened or whatever, or even just misremembering.
- 8:10SPEAKER_01: And so, you know,
- 8:12SPEAKER_01: we have like bias checks that can happen on the data because
- 8:16SPEAKER_01: the data are actually there, obviously all reviewed by people.
- 8:19SPEAKER_01: But yeah, so it's fit for us for that reason because of what you're actually working with.
- 8:24SPEAKER_01: And then the collaboration too is, I think this is just part of asynchronous work in general.
- 8:30SPEAKER_01: If you're in a live meeting discussing something,
- 8:33SPEAKER_01: it really just kind of depends on your Processing speed in the moment
- 8:36SPEAKER_01: for what you're thinking and deciding on.
- 8:39SPEAKER_01: And we don't make decisions as a general rule live.
- 8:42SPEAKER_01: We can have discussions about them or maybe this is a really gnarly one,
- 8:46SPEAKER_01: but generally decisions are happening in a really thought out way.
- 8:49SPEAKER_01: And that's the same thing with performance conversations, right?
- 8:53SPEAKER_01: So it's not just having a live debate about something in a calibration, right?
- 8:56SPEAKER_01: You're actually looking at,
- 8:58SPEAKER_01: you're having time to consider things and look at the actual evidence as opposed
- 9:02SPEAKER_01: to just having a live conversation with all of its associated biases.
- 9:07SPEAKER_01: So that's one thing I would say.
- 9:09SPEAKER_00: Default to having things written down helps with the evidence, yeah.
- 9:14SPEAKER_00: Yeah.
- 9:15SPEAKER_00: What are the challenges with the process?
- 9:19SPEAKER_01: Yeah, I guess the flip side
- 9:20SPEAKER_01: of having everything written down is it's not actually everything written down,
- 9:24SPEAKER_01: right?
- 9:25SPEAKER_01: There's a lot that happens with context and in a chat or in a live call,
- 9:31SPEAKER_01: and we don't want to over-rotate on,
- 9:34SPEAKER_01: well, if it wasn't written down, then it didn't happen.
- 9:37SPEAKER_01: And that just relies on people's judgment.
- 9:40SPEAKER_01: And so that does rely on people actually taking the time to look at things
- 9:44SPEAKER_01: and make those judgments.
- 9:46SPEAKER_01: I think we have really smart, capable people doing that.
- 9:49SPEAKER_01: So it's a challenge that just is something that they need to keep in mind.
- 9:53SPEAKER_01: It's not really something we've had to solve for necessarily.
- 9:57SPEAKER_01: And then as we've grown the question, you know, a lot of this is very time intensive, right?
- 10:02SPEAKER_01: There's a lot of conversation around each of these pieces and a lot of consideration
- 10:07SPEAKER_01: that goes into it.
- 10:09SPEAKER_01: And then,
- 10:09SPEAKER_01: you know,
- 10:09SPEAKER_01: just the question organizationally is how can we make this easier for everyone?
- 10:14SPEAKER_01: As much as, you know, we all really value performance reviews.
- 10:17SPEAKER_01: And also it can be if you're someone who has a lot to do, it's a lot of work.
- 10:21SPEAKER_01: We very much appreciate everyone who puts the work in because everyone cares
- 10:25SPEAKER_01: about doing it well and doing it well takes a lot of time.
- 10:28SPEAKER_01: So that's been a challenge for us is how can we keep the quality bar while,
- 10:34SPEAKER_01: you know, making it easier and easier to do every time.
- 10:38SPEAKER_00: And it kind of leads into the last question of what our future plans are.
- 10:43SPEAKER_00: Do you want to go into any of that?
- 10:44SPEAKER_01: Yeah.
- 10:46SPEAKER_01: So high level.
- 10:46SPEAKER_01: Yeah.
- 10:48SPEAKER_01: We've done a lot of work over the years to streamline,
- 10:52SPEAKER_01: like I was talking about, all of the data.
- 10:53SPEAKER_01: And then it feeds into, you know, we have up to five different, like, categories of ratings.
- 10:58SPEAKER_01: We call them professional dimensions.
- 11:01SPEAKER_01: And we've done a lot of work to sort of categorize those things and how,
- 11:03SPEAKER_01: so to streamline the amount of work you have to do as someone who's evaluating.
- 11:09SPEAKER_01: And all of that work, really,
- 11:11SPEAKER_01: we're trying to take it to the next level of having that happen in
- 11:16SPEAKER_01: a real focused time period.
- 11:18SPEAKER_01: Rather than in combination with other work.
- 11:21SPEAKER_01: And also we used to give.
- 11:24SPEAKER_01: So I'll finish that thought first,
- 11:25SPEAKER_01: which is we're going to move to a shorter cycle,
- 11:28SPEAKER_01: which is going to be about three weeks.
- 11:30SPEAKER_01: That's the goal where everyone we talked about our daily stand up earlier,
- 11:35SPEAKER_01: where if you have a task to do that day for the performance review,
- 11:38SPEAKER_01: your daily stand up will be write myself reflection.
- 11:41SPEAKER_01: Everyone at the company writes it that day and then they can move on to other things
- 11:44SPEAKER_01: so that it's not this kind of.
- 11:47SPEAKER_01: Organizational costs that's dispersed across some time.
- 11:49SPEAKER_01: And it also gives people the freedom to really focus on it that day
- 11:52SPEAKER_01: because it is their one must.
- 11:54SPEAKER_01: So you can really put all your attention there.
- 11:57SPEAKER_01: And that follows through the rest of the process.
- 12:00SPEAKER_01: The other piece is,
- 12:01SPEAKER_01: you know, we used to do these annual, you know, shout outs and focus areas, right?
- 12:06SPEAKER_01: Which was the sort of written part of the review.
- 12:09SPEAKER_01: Sometimes they can be quite long and that takes a lot of time to review also.
- 12:13SPEAKER_01: And as we thought about it,
- 12:15SPEAKER_01: Scaling,
- 12:16SPEAKER_01: and we're just thinking also about scaling our career advisor function and coaching
- 12:20SPEAKER_01: and leveling up career advisors as we scale,
- 12:23SPEAKER_01: which I think is a very normal company scaling thing,
- 12:27SPEAKER_01: is our annual shout outs and focus areas right for everyone.
- 12:31SPEAKER_01: Like, really, we shouldn't just be doing this once a year.
- 12:33SPEAKER_01: And of course, we should all be getting coaching conversations in an ongoing way.
- 12:38SPEAKER_01: And so we're actually building a process around ongoing coaching and That happens
- 12:43SPEAKER_01: in folks one-to-ones regularly as opposed to sort
- 12:46SPEAKER_01: of having this heavy text written piece in the performance review.
- 12:50SPEAKER_01: So that's something we're experimenting with.
- 12:52SPEAKER_01: And I say experimenting with because everything at DuckDuckGo is an experiment
- 12:56SPEAKER_01: and changes in response to evidence and how it's going and the needs of
- 12:59SPEAKER_01: the organization.
- 12:59SPEAKER_01: But that's what we're looking at next.
- 13:02SPEAKER_00: I'm really excited about the shorter time period and the focused week that it'll be great.
- 13:08SPEAKER_01: As someone who was one of the highest loaded folks at the organization,
- 13:11SPEAKER_01: I bet, yeah, you'd be very excited.
- 13:14SPEAKER_00: Yeah.
- 13:16SPEAKER_00: All right.
- 13:17SPEAKER_00: I think that covers all of our topic today.
- 13:20SPEAKER_00: Thanks for joining me, Anne.
- 13:23SPEAKER_00: See y'all.
- 13:24SPEAKER_01: Great to see you, Jeffrey.
- 13:25SPEAKER_01: Bye.