Latest / No Way Out / Red Teaming with Colonel (Ret.) Steven Rotkoff
Transcript
- 0:21Brian "Ponch" Rivera: We all have a face for radio, so it doesn't matter.
- 0:24Brian "Ponch" Rivera: So we're a good shape there, all right, hey, mark, I'm fired up to have Colonel retired Steve Rotkoff here today.
- 0:30Brian "Ponch" Rivera: Many people that follow our work and follow his work should be excited about this conversation as well.
- 0:35Brian "Ponch" Rivera: We're going to talk about red teams, red teaming, mitigating cognitive biases, critical thinking amazing concepts that are applicable to not just warfare but to business as well, and you and I have known this for quite some time.
- 0:49Brian "Ponch" Rivera: So, without further ado, I want to introduce our guest.
- 0:54Brian "Ponch" Rivera: It's Colonel retired Steve Rotkoff.
- 0:55Brian "Ponch" Rivera: He's here with us today.
- 0:56Brian "Ponch" Rivera: Where are you calling in from, sir?
- 1:00Steve Rotkoff: I'm outside of Leavenworth, so I live in Lansing, kansas.
- 1:03Steve Rotkoff: The school was established in Leavenworth because it was the Army's University town and after teaching and then running the school, I just stayed here.
- 1:17Brian "Ponch" Rivera: All right, and the school you're referring to as UFMCS, it's the.
- 1:20Steve Rotkoff: Yeah, yes.
- 1:21Brian "Ponch" Rivera: Yeah, it's the.
- 1:23Steve Rotkoff: University of Foreign Military and Cultural Studies, and that was the name that was given to it by General Schumacher when he was Chief of Staff of the Army, and it was a deception operation because he did not want our adversaries to know that we had invested in red teaming education.
- 1:41Steve Rotkoff: So he wanted to come up with a name that was a cover story, and that's how, because we're not, we were never a university, we had subordinate colleges or a football team.
- 1:52Steve Rotkoff: It was just a cover name because he did not want to call it red team university, which is what we wanted to call it.
- 2:00Brian "Ponch" Rivera: I'd never do that story.
- 2:01Brian "Ponch" Rivera: I used to be a foreign area officer in the US Navy.
- 2:04Brian "Ponch" Rivera: I worked with a lot of foreign area officers within the US Army and Marine Corps and, of course, the Air Force.
- 2:08Brian "Ponch" Rivera: When I became familiar with the school, it actually was after my active duty time and I came across this thing known as liberating structures.
- 2:16Brian "Ponch" Rivera: Keith McCandless is up there in Seattle, so I got some time with him on learning about liberating structures.
- 2:22Brian "Ponch" Rivera: We came across the UFMCS Liberating Structures Guide and I'm like what is this thing?
- 2:26Brian "Ponch" Rivera: At the time I was also doing consulting for a military-themed company and we used a lot of red team approaches not necessarily red teaming approach, but red team approaches and that's something that I would like to have you kind of help navigate and separate.
- 2:40Brian "Ponch" Rivera: What is a red team and what is red teaming?
- 2:42Brian "Ponch" Rivera: What does all this mean when we look at red teaming in general?
- 2:45Brian "Ponch" Rivera: So that's my first question to you is when we look at red teaming versus a red team, what's the difference?
- 2:53Steve Rotkoff: Okay, so red teaming as a concept is a meta way of thinking.
- 2:58Steve Rotkoff: That's why I believe, and that's, certain underlying principles that drive your conduct of red teaming.
- 3:11Steve Rotkoff: One is divergence before convergence.
- 3:16Steve Rotkoff: Right, You're going to get as many ideas onto the table before you decide which is the best idea.
- 3:21Steve Rotkoff: So that is a key element.
- 3:24Steve Rotkoff: Learning structures, which you've already talked about, are key in terms of methodology to get at that.
- 3:33Steve Rotkoff: Divergence Tools around groupthink mitigation, and those can be use of role play.
- 3:41Steve Rotkoff: They can be some sort of structured methodology that gets people to touch with the power.
- 3:49Steve Rotkoff: They can clearly be the use of anonymity, which is very powerful.
- 3:53Steve Rotkoff: But it's this idea that if we could get everybody to give us their best ideas and then we could separate the source of the idea from the quality of the idea, right, Because the idea of the senior person in the room isn't necessarily the best idea, nor is the idea of the person who is most eloquent.
- 4:20Steve Rotkoff: You can have somebody with a really good idea who just can't garner their arguments very effectively, but their idea is fundamentally sound.
- 4:28Steve Rotkoff: Or nor is the idea of the guy who simply will outlast you He'll just continue to plow away.
- 4:36Steve Rotkoff: So you want to separate the quality idea from the source of the idea.
- 4:40Steve Rotkoff: You want the best idea to win, and red teaming is about how do we get there.
- 4:46Steve Rotkoff: And while we're doing that, how do we ensure that our bias, that our system one to go back to canamine isn't driving what we're deciding?
- 4:57Steve Rotkoff: So it's a meta approach to conversations in groups and decision making.
- 5:06Steve Rotkoff: A red team is a group that is brought together to solve a specific problem using red teaming methods.
- 5:16Steve Rotkoff: Right, and those red teams can look very different.
- 5:20Steve Rotkoff: I spent two years working for Verizon.
- 5:23Steve Rotkoff: They now have a red team capacity inside of their strategy group.
- 5:29Steve Rotkoff: They took what we did and taught them and adjusted it in some serious ways to meet the needs of their company.
- 5:37Steve Rotkoff: That's fine.
- 5:38Steve Rotkoff: There's no orthodoxy in terms of how you conduct a red team.
- 5:45Steve Rotkoff: As long as you're adhering to the principles divergence before convergence best ideas win.
- 5:51Steve Rotkoff: So I don't know if that answers your question, but that's my shot at it.
- 5:56Brian "Ponch" Rivera: No, I think it does a great job and we talk a lot about John Boyd on this show, his Oodaloop, and one way I explain red teaming and a red team is a lot of the To me.
- 6:09Brian "Ponch" Rivera: If you look at John Boyd's Oodaloop, it's a thing that interacts with an external environment.
- 6:14Brian "Ponch" Rivera: So that's one way to look at John Boyd's Oodaloop.
- 6:16Brian "Ponch" Rivera: It's something that's interacting with an environment.
- 6:18Brian "Ponch" Rivera: So if you put a boundary around a team, that team is a thing that's interacting with an external customer or whatever it may be.
- 6:26Brian "Ponch" Rivera: Red teaming encompasses the red team on the outside and the critical thinking, mitigating cognitive biases, tools and techniques that we use on the inside.
- 6:34Brian "Ponch" Rivera: So the way I'm looking at this is for red teaming, I want to use things like Think, write, share, driz, 5get you 25.
- 6:43Brian "Ponch" Rivera: We could talk about these a little bit more down the road.
- 6:45Brian "Ponch" Rivera: And on the outside I have an independent group that's going to provide information from the as an external source to the thing in the middle, in this case a team.
- 6:55Brian "Ponch" Rivera: So we can look at John Boyd's Oodaloop and look at it red teaming as the overarching idea of what's external, what's internal.
- 7:05Brian "Ponch" Rivera: Red team external, red teaming, internal.
- 7:08Brian "Ponch" Rivera: Am I wrong in thinking like that?
- 7:11Steve Rotkoff: I haven't thought about that before.
- 7:12Steve Rotkoff: I'd have to think a little bit more deeply about it.
- 7:15Steve Rotkoff: But I think you're right in the macro sense that a red team can't be insular.
- 7:22Steve Rotkoff: It has to bring information in Frequently.
- 7:26Steve Rotkoff: The quality of the red team work will depend upon how well they build a relationship with the blue team and how much they recognize the blue team's pain and goals and things like that.
- 7:40Steve Rotkoff: So there's clearly an external interchange for the red team to be successful.
- 7:49Steve Rotkoff: You can't sit in a monastery by yourself and red team Right.
- 7:52Steve Rotkoff: You can't be in a red team individually.
- 7:54Steve Rotkoff: But the key dynamic inside the red team that is different from external to the red team is how the red team communicates internally, how it values insight, what its composition is Right.
- 8:14Steve Rotkoff: I mean the analogy I use for people when they ask me how do I build my red team?
- 8:20Steve Rotkoff: As I said, the analogy I use, just because it makes sense to me, is, if you are going to red team, how to do better surgical procedures for brain surgery.
- 8:32Steve Rotkoff: You're going to talk about brain surgery.
- 8:35Steve Rotkoff: You don't want all brain surgeons, right?
- 8:38Steve Rotkoff: If you have all brain surgeons, they've all been trained to already do it a certain way and they're fairly limited in terms of how they think.
- 8:45Steve Rotkoff: But you don't want carpenters either, right?
- 8:49Steve Rotkoff: So you might want a thoracic surgeon, you might want an operating room nurse, you might want a brain surgeon or two.
- 8:57Steve Rotkoff: You might want somebody who deals with.
- 9:00Steve Rotkoff: You know, I don't know.
- 9:02Steve Rotkoff: You know the bone structure.
- 9:06Steve Rotkoff: I don't know.
- 9:07Brian "Ponch" Rivera: Right right.
- 9:08Steve Rotkoff: They should be brain surgery adjacent, but not all brain surgeons.
- 9:11Steve Rotkoff: So the composition of the red team matters a lot.
- 9:13Steve Rotkoff: And then, once you have the right people in the room who have expertise around the problem but don't all have the same expertise around the problem how they then communicate internally, how they engage externally to bring information in, right.
- 9:29Steve Rotkoff: I mean you can have a great red team that reaches out to the blue team and says, hey, we're looking at your plan, so are you guys just stupid?
- 9:36Steve Rotkoff: Right?
- 9:37Steve Rotkoff: In which case the red team will not work.
- 9:40Steve Rotkoff: So those engagements matter as well.
- 9:43Steve Rotkoff: But I haven't thought about it in terms of how it interleaves or overlaps with the oodaloupe.
- 9:51Steve Rotkoff: When you get to the oodaloupe, I have thought about and I just think it's interesting.
- 9:56Steve Rotkoff: I think it's interesting to look at the oodaloupe vis-a-vis MDMP, right, because what's the last step of MDMP?
- 10:07Brian "Ponch" Rivera: It should be orders, orders and production right.
- 10:11Steve Rotkoff: You know production of orders, okay.
- 10:13Steve Rotkoff: So what does that mean?
- 10:15Steve Rotkoff: It means we're done right.
- 10:16Steve Rotkoff: There's no loop to that.
- 10:18Brian "Ponch" Rivera: Yeah, you're right, absolutely yeah.
- 10:21Steve Rotkoff: I mean there's no.
- 10:22Steve Rotkoff: Okay, now we've told everybody what to do and we're done.
- 10:23Steve Rotkoff: So now where's the observed part?
- 10:26Steve Rotkoff: You know, because that's the act part.
- 10:28Steve Rotkoff: So where does the loop come in?
- 10:30Steve Rotkoff: And there is no oodaloupe in MDMP, no matter how much we think it's valuable.
- 10:37Brian "Ponch" Rivera: Yeah, so, mdmp, for our listeners that aren't familiar, it's the military decision-making process, right, mdmp?
- 10:44Steve Rotkoff: It is, and it's pretty much universally accepted across the services and most of our allies.
- 10:49Brian "Ponch" Rivera: Yeah, and there are some challenges with it that you know when you have to build a coa, that you throw away a course of action.
- 10:56Brian "Ponch" Rivera: There's some funny things that we used to do when we were working at the operational level of warfare with it.
- 11:01Brian "Ponch" Rivera: So it's not perfect and, if I understand you correctly, it doesn't have that element where we get feedback from the external environment.
- 11:09Brian "Ponch" Rivera: It's just a passive approach to planning.
- 11:13Steve Rotkoff: Yeah, well, yeah, I mean, yeah, we'll leave it at that.
- 11:17Steve Rotkoff: Yeah, okay, I have lots of problems with MDMP.
- 11:19Steve Rotkoff: Oh yeah, I'm with you.
- 11:22Brian "Ponch" Rivera: Yeah, yeah, it's a nice place to start, but I don't know how old it is.
- 11:26Brian "Ponch" Rivera: You know, we used different planning processes within fighter aviation that I think are far better than that, and I think the planning process that we offer up to clients are better than that.
- 11:38Brian "Ponch" Rivera: And, of course, it's hard to write a nonlinear planning process on a piece of paper, right, right?
- 11:45Brian "Ponch" Rivera: Well, that's the problem with UDA.
- 11:46Steve Rotkoff: right, Everybody starts at O yeah, and it's a loop for crying out loud you know, yeah, right, you can start anywhere.
- 11:53Steve Rotkoff: And you know, I mean the Israelis, in their current situation, are probably going to have to start at A Yep.
- 12:01Steve Rotkoff: Right, they're going to act and they're going to observe, then they're going to orient, then they're going to decide, then they're going to act again Because they can't observe everything they want to observe, because they're in tunnels and you know they practice good opsec and that kind of thing.
- 12:15Brian "Ponch" Rivera: Yeah, you're right.
- 12:15Brian "Ponch" Rivera: So we've done a lot of connections between John Boyd's Doodle Loop and the Kinevan framework.
- 12:19Brian "Ponch" Rivera: So everything you just said is spot on.
- 12:21Brian "Ponch" Rivera: In the Kinevan framework, you have to start.
- 12:25Brian "Ponch" Rivera: If you're in chaos which I believe they were for temporarily you have to act, you have to do something, and what you're trying to do is get back to a complex environment or a complicated environment.
- 12:34Brian "Ponch" Rivera: That way you can find repeatability and execute Absolutely.
- 12:37Steve Rotkoff: Yeah.
- 12:39Brian "Ponch" Rivera: And that's I think that's what Redteam allows us to do as well.
- 12:41Brian "Ponch" Rivera: And Redteam allows us to do is create that environment where we have to shift from using again the Kinevan framework, from an ordered system to an unordered system, and find our way back Right and always use the divergent convergent approach.
- 12:58Steve Rotkoff: And the other thing I'd say that Redteam as I've been practicing at these past few years allows you to do is by using the anonymous techniques and what I call weighted anonymous feedback.
- 13:11Steve Rotkoff: So you know, dot voting is weighted anonymous feedback, five will get you 25 is weighted anonymous feedback.
- 13:17Steve Rotkoff: You can do some other tools and methods for weight anonymous feedback, but when you do that, what you're able to do is separate the key and essential thing that you have to focus your attention on from those things that are important but not critical.
- 13:36Steve Rotkoff: And I think that's one of the hardest things is we allow ourselves to be distracted by things that are legitimately important but they're just not central.
- 13:47Steve Rotkoff: I was telling you earlier that one of my jobs was to orchestrate FM3O the first FM3O.
- 13:54Steve Rotkoff: So you know, offense, defense, stability and support.
- 13:57Steve Rotkoff: And as we wrote the draft, we went and showed the draft to General Scales, who at that time was the head of the War College at Carlisle, and we briefed him on it and he said something I've always carried with me that I thought was really silly at first but I think is essential for quality planning.
- 15:16Steve Rotkoff: And that is he said remember, as you write this book, that the main thing is to keep the main thing, the main thing, right, and frequently you don't keep the main thing, the main thing.
- 15:32Brian "Ponch" Rivera: I want to go back in time to UFMCS, when you're standing up at school, and to some of the research.
- 15:39Brian "Ponch" Rivera: You know what?
- 15:40Brian "Ponch" Rivera: Where did you?
- 15:42Brian "Ponch" Rivera: I know you looked at Gary Klein's work, the premortem, which is fantastic.
- 15:45Brian "Ponch" Rivera: We use it all the time.
- 15:46Brian "Ponch" Rivera: We had Gary on the show as well.
- 15:47Brian "Ponch" Rivera: But what research did you gravitate towards when you were working on coming up with the red team approach for the, for the US Army and the DOD?
- 15:59Steve Rotkoff: Okay, so first you have to have a little, a little history on why, the why the army chose to build UFMCS.
- 16:07Steve Rotkoff: Right, and the reason the army chose to build UFMCS is there was a recognition at the senior levels.
- 16:14Steve Rotkoff: This is now, in 2004, that Iraq specifically because we were much more involved in Iraq at the time than Afghanistan but Iraq had not turned out how we had expected.
- 16:25Steve Rotkoff: And then the question was why and I was at the time the chief of staff for lessons learned for General Alexander, who was the two of the army at the time and there was this myth inside army intel, and it was very prevalent, and that was if you only had all the information, you would always make the right decision.
- 16:49Steve Rotkoff: Okay, so it was about data management, and my experience at in the run up to the war was that that was simply not true, that we had a lot of people who told us what we were going to encounter, but we were incapable of hearing it, incapable of changing our minds, incapable of challenging our senior leaders and assumptions, etc.
- 17:12Steve Rotkoff: And so by the time I'm working for Alexander, there's a recognition that all that had happened, that that we had lots of people who told us what Iraq was going to be like and we didn't plan for any of it.
- 17:26Steve Rotkoff: And so the question was how do we change it?
- 17:29Steve Rotkoff: So Schumacher grew up as a special forces officer and he had this idea of red teaming, where you would, in prepping for a special special lot, you would have people really challenge it, really murder, board it or they or they play red and you'd you know, you'd go through an exercise.
- 17:50Steve Rotkoff: And so he bought into this idea.
- 17:53Steve Rotkoff: So I shopped the idea around to a bunch of different places and ultimately trade ox signed on and said you know, maxine McFarland said I'll take this.
- 18:05Steve Rotkoff: When that happened, we had no idea what this was.
- 18:10Steve Rotkoff: We knew that we needed to try and change the nature of army decision making, but we weren't sure how.
- 18:16Steve Rotkoff: So one thing that we knew was that we were culturally blind, that that in that for most soldiers and Marines that went into Iraq there was this notion that inside every Iraqi there was this little American just struggling to get out right and you know, if we, if we help them be more like us, they'd be happy.
- 18:44Steve Rotkoff: That was clearly not true.
- 18:46Steve Rotkoff: So we knew we needed anthropology.
- 18:48Steve Rotkoff: So the first person we reached out to is Misty McFate, who was an anthropologist who had written several articles saying that the academe of anthropology were wrong to put up sort of a fire law with the military, which was a consequence of Vietnam Project Phoenix, things like that, and that we, that the anthropologist, should not stand on the sideline and yell at the military that you don't understand Iraqis and then be unwilling to teach us anything about Iraqis.
- 19:24Steve Rotkoff: Right, you couldn't have it both ways.
- 19:27Steve Rotkoff: So she and a bunch of other anthropologists designed a curriculum so we had anthropology that piece.
- 19:33Steve Rotkoff: Then we knew that we needed military history case studies.
- 19:43Steve Rotkoff: Remember Greg Fontenot was the director.
- 19:45Steve Rotkoff: He had been a director of SAMS.
- 19:47Steve Rotkoff: So the course initially looked very SAMS like.
- 19:51Steve Rotkoff: There was a lot of reading, a lot of case studies and some anthropology that's how I would describe it, like the first two years.
- 19:58Steve Rotkoff: Then we got a call from who was the chairman?
- 20:08Steve Rotkoff: Who a chairman of Joint Chiefs of Staff who preceded Millie Dunford, General Dunford.
- 20:17Steve Rotkoff: But preceded Dunford.
- 20:19Steve Rotkoff: Dempsey, that's what I'm trying to think of.
- 20:21Steve Rotkoff: So Dempsey is a tradeoff commander and Dempsey had been downrange a lot and knew that he needed to fix the way the army made decisions and the way the army communicated amongst itself.
- 20:34Steve Rotkoff: And he had read a book by Ori Brothman called the Starfish and the Spider and he loved that book.
- 20:42Steve Rotkoff: So he said I want to make the army more star fishy, right For your listeners.
- 20:49Steve Rotkoff: The difference is that if you destroy a web, the spider and everybody who uses that web basically dries up and dies.
- 20:58Steve Rotkoff: You destroy the web, you destroy the spider.
- 21:01Steve Rotkoff: If you cut a leg off of a starfish, the starfish grows a new leg and the leg grows a new starfish.
- 21:08Steve Rotkoff: So starfish organizations are things like Alcoholics Anonymous, the abolitionist movement, isis, al Qaeda, etc.
- 21:17Steve Rotkoff: And the problem is that spider organizations have this really hierarchical decision making that goes up to the top of the web when starfish organizations, every leg makes its own decisions inside of a general ethic or set of values.
- 21:37Steve Rotkoff: So you can be in Al Qaeda or ISIS and you can blow something up.
- 21:42Steve Rotkoff: You don't need anybody's permission, as long as you're blowing up the right people, whereas as we try to make change, you have to go through this chain of events.
- 21:49Steve Rotkoff: So Dempsey reached out and he said I think you guys could be the agent for this star fishy change in the military.
- 21:59Steve Rotkoff: So for two years I ran around with Ori Brothman and he and I gave the starfish program.
- 22:08Steve Rotkoff: It is out of the starfish program that came liberating structures, groupthink mitigation.
- 22:14Steve Rotkoff: Those are both a direct consequence of starfish because he brought in people who did those things.
- 22:24Steve Rotkoff: We also, much more greatly, we were already on the line of doing some of this, but we further embraced the idea of knowing yourself and fostering empathy.
- 22:38Steve Rotkoff: That also came out of starfish.
- 22:40Steve Rotkoff: The things that were probably already there before starfish were anthropology and this idea that we could foster empathy for other cultures and alternative futures, the idea that the future is not going to turn out the way you want it to, no matter how much you plan it.
- 22:58Steve Rotkoff: So that's how it came together.
- 23:02Steve Rotkoff: And then I had had all the starfish experience and when Greg retired I became the director and I changed the program along these four basic pillars that are UFMCS Know yourself and sharing that shared vulnerability, so that people understand that other people bring a different perspective to the table and that that perspective should be valued.
- 23:27Steve Rotkoff: That's how you encourage honored divergence of thought, then fostering empathy, trying to get your head into other cultures.
- 23:38Steve Rotkoff: We have a bunch of tools that we taught around that specific thing Groupthink, mitigation, a lot of alberting structures and then finally, alternative futures, scenario planning, premortem analysis, etc.
- 23:51Steve Rotkoff: So that's the evolution of sort of the UFMCS curriculum in a nutshell.
- 23:57Brian "Ponch" Rivera: Okay, and then what happened to it?
- 23:58Brian "Ponch" Rivera: We know, in the last couple of years they shut down the school.
- 24:01Brian "Ponch" Rivera: Why is that.
- 24:03Steve Rotkoff: Well, they didn't shut it down, just to be clear.
- 24:06Steve Rotkoff: They made it.
- 24:07Steve Rotkoff: They put it in a warm mode, if you will.
- 24:09Steve Rotkoff: So what happened was I can't remember when exactly, but the government was hemorrhaging money I think it had to do with COVID, probably and there was a bill on the table hey, you know, we need to save money.
- 24:30Steve Rotkoff: And in the room where that decision was made there was nobody who understood what UFMCS was or could advocate for it.
- 24:40Steve Rotkoff: So it was chump change.
- 24:41Steve Rotkoff: I mean, I was gone by that time.
- 24:43Steve Rotkoff: It was $3 million a year, nothing really, and it budgeted us.
- 24:48Steve Rotkoff: So what they ended up doing is they went down to one administrator, that's Steve Hall, and then three contractors, and then what happened was Special Forces Command, or it might be the school, I don't remember, but somewhere in the Special Forces world, it could be JASIFSA, or it could be SOCOM, or somebody said you know what we like this so much?
- 25:16Steve Rotkoff: We're going to continue to pay for these three contractors.
- 25:19Steve Rotkoff: So they continue to pay for them, they continue to do programs for SOF, and then, when they're not doing SOF programs, these same three guys can run around the Army and do programs.
- 25:30Steve Rotkoff: And then what happened was last year, maybe a little over a year ago, secretary of Defense Austin published a paper.
- 25:40Steve Rotkoff: His office published a paper called Civilian Harm Mitigation.
- 25:45Steve Rotkoff: It's something like that.
- 25:46Steve Rotkoff: Cmhr is what it is, and this was a study that was done in response to the killing of the Afghan family following our departure from Afghanistan.
- 26:04Steve Rotkoff: When they responded by killing this family, that was really innocent because they were looking for the terrorists that hit us, hit the Marines.
- 26:15Steve Rotkoff: So they did this big study and the study has five recommendations.
- 26:18Steve Rotkoff: One of the recommendations is we need a red team program.
- 26:23Steve Rotkoff: We need to challenge the conventional wisdom.
- 26:25Steve Rotkoff: So Steve Hall, if you want to talk to Steve, has been heavily involved with the Army and with joint staff trying to figure out how to rebuild the red team program, where to rebuild it, what it would look like.
- 26:40Steve Rotkoff: Interestingly enough, the paper also recommended a reestablishment of something like the human terrain system, which is adjacent in many ways but was also killed.
- 26:54Steve Rotkoff: It was permanently and totally killed, unlike UFMCS.
- 26:57Steve Rotkoff: So that's what's happened In the meantime.
- 27:01Steve Rotkoff: I used to say as director all the time that the graduates of our program needed to go out and spread the virus, that that was their job, and I think we've done a pretty good job of spreading the virus.
- 27:13Steve Rotkoff: The virus is out there in lots of places, so I don't think it's died.
- 27:21Steve Rotkoff: I think it's a little bit warm or it's popped up in other places.
- 27:27Brian "Ponch" Rivera: Well, I'll tell you, one of the key deliverables we have when we engage with the clients is it's usually think, write, share, write into a red team liberating structure to show them something that they can use immediately.
- 27:40Brian "Ponch" Rivera: And the response is just through the roof.
- 27:42Brian "Ponch" Rivera: They're like where'd you find this, how do you know this?
- 27:44Brian "Ponch" Rivera: And it's like these are fundamental things you need to know to mitigate cognitive biases.
- 27:48Brian "Ponch" Rivera: It doesn't necessarily create psychological safety.
- 27:51Brian "Ponch" Rivera: There's other aspects that are ways to do that, but we were finding that companies love this and they don't know what it is right.
- 27:58Brian "Ponch" Rivera: So we tell them it's red team.
- 28:01Steve Rotkoff: So I will give you a quick tool.
- 28:03Steve Rotkoff: It's not in the red team handbook I don't think you can use with clients that I found to be enormously successful.
- 28:10Steve Rotkoff: So I was still the director of UFMCS at the time and I was asked to come to the New York Federal Reserve in the city and they had a bunch of leaders there and they had one hour and they said we've heard about this red team thing, we want to know more about it.
- 28:28Steve Rotkoff: Can you demonstrate for us in one hour what the value of this is?
- 28:32Steve Rotkoff: So I said OK, we're going to do a quick exercise.
- 28:36Steve Rotkoff: I said all large institutions tell themselves lies.
- 28:41Steve Rotkoff: I said I'm going to give you two lies that the Army tells itself.
- 28:46Steve Rotkoff: The first lie that all of DOD tells itself is that the draft was terrible and we don't want it back.
- 28:52Steve Rotkoff: And that's fundamentally not true.
- 28:54Steve Rotkoff: General's do I mean at the more junior levels they don't necessarily buy that lie, but senior leaders will always say we don't want a draft and the reason is they're never going to get it back, so they might as well not want it.
- 29:08Steve Rotkoff: But the reality is that there are lots of good things about the draft.
- 29:12Steve Rotkoff: There's all sorts of data about you know, if you have a corporal from Harvard in your infantry platoon, he makes the entire infantry platoon smarter, right, I mean, and there's a lot of data about that.
- 29:25Steve Rotkoff: But we tell ourselves we don't want a draft because we're not going to get it.
- 29:28Steve Rotkoff: We also tell ourselves that we're a pure meritocracy, and that's nonsense.
- 29:33Steve Rotkoff: Right, you have lots of sons and daughters of guys who have the same last name, who happen to be generals who have done well, or you have the acolytes of somebody who've done well.
- 29:47Steve Rotkoff: So I said I want you to take this five by eight card and I give everybody the same color pan, the exact same pan.
- 29:53Steve Rotkoff: I bring them with me and I want you to block letter so we maintain anonymity.
- 29:57Steve Rotkoff: I want you to write down a lie.
- 29:59Steve Rotkoff: The Federal Reserve tells itself.
- 30:01Steve Rotkoff: They wrote those down and we gave it to the guy who was in charge and they were so blown away.
- 30:08Steve Rotkoff: They had me back three more times until the leadership changed.
- 30:12Steve Rotkoff: And then, of course, when the leaders changed, they're never interested in what the previous guy did, but I've used that in several places.
- 30:18Steve Rotkoff: It's quick, it's enormously powerful and you get to talk about things you otherwise would never talk about.
- 30:24Brian "Ponch" Rivera: Yeah, the block letter thing is fantastic.
- 30:27Brian "Ponch" Rivera: We use the little three by five cards in the same pen and all that and it's amazing how well that works.
- 30:32Brian "Ponch" Rivera: But what I'm getting at is when businesses, organizations they're dealing with the same type of complexities that we had in the military.
- 30:40Brian "Ponch" Rivera: Nobody's going to necessarily die from it.
- 30:43Brian "Ponch" Rivera: However, their organization may fail in the future if they don't figure out how to improve their decision making skills.
- 30:49Brian "Ponch" Rivera: So let's talk about that.
- 30:51Brian "Ponch" Rivera: Where are you seeing companies pick up on red teaming and you mentioned Verizon earlier Do you have any other success stories where companies embrace this type of thinking?
- 31:06Steve Rotkoff: So we have a couple of different companies we've worked with.
- 31:09Steve Rotkoff: I'm trying to think of who I can share and can't share.
- 31:12Steve Rotkoff: So we've done a lot of work for Nextdoor.
- 31:16Steve Rotkoff: They deal with a lot of issues around.
- 31:21Steve Rotkoff: You know, without going into any detail, social media it's tough.
- 31:27Steve Rotkoff: There are a lot of issues that come up in their business.
- 31:31Steve Rotkoff: We've done a lot of work for them.
- 31:32Steve Rotkoff: We did work for one company that was in the software intelligence, software space.
- 31:42Steve Rotkoff: I think this story is interesting because the CEO I won't mention the company he hated us, hated us with a passion because we had signed a contract for three engagements.
- 31:53Steve Rotkoff: We did all three, but he hated us because our methodology was hey, you may be the smartest person in the room, but you're not the only smart person in there and you need to hear from other people.
- 32:04Steve Rotkoff: So at the end of three engagements he said I don't want you guys anymore, it's okay.
- 32:11Steve Rotkoff: I got a call from one of their people a couple of months later and he said Steve, I have to tell you.
- 32:18Steve Rotkoff: You know the rest of the executive leadership team.
- 32:21Steve Rotkoff: We all loved what you guys did and we started doing it on our own, without the CEO there, and recently we brought a recommendation to the CEO.
- 32:32Steve Rotkoff: This was several months ago.
- 32:34Steve Rotkoff: This was before the event I'm about to describe, he says, when we looked at vulnerabilities in our company and so we went to our CEO and we said, you know, we realize that we have all of our money in Silicon Valley Bank and maybe we should do something about that.
- 32:52Steve Rotkoff: And he said, oh, this is a bunch of red team crap.
- 32:55Steve Rotkoff: He said, no, we're fine, it'll be fine, just leave it alone.
- 32:59Steve Rotkoff: Now, you know as it turned out, it was covered down.
- 33:04Steve Rotkoff: I mean, people, they probably got their money out, but nonetheless, you know, you can't force red teaming on toxic leaders, right?
- 33:15Steve Rotkoff: I mean, there's just no way to do that.
- 33:18Steve Rotkoff: And this is a good illustration of where the red team was great.
- 33:21Steve Rotkoff: Their ability to affect the changes was poor.
- 33:27Steve Rotkoff: So we've done software, we've done social media, we've done telecommunications, we've done Department of Energy, worked a lot with the Department of Energy on.
- 33:40Steve Rotkoff: My partner as a woman named Whitney Hisher, and Whitney was in charge of executive education at Berkeley High School of Business Many years.
- 33:53Steve Rotkoff: So she's got an MBA and she's a Stanford and Berkeley graduate, and so we've done a lot of work for the Department of Energy on how do you build the business case for rare earth minerals in support of specific technologies, and that's been very successful and interesting.
- 34:19Steve Rotkoff: And we also do some work for Los Alamos, for Lawrence Livermore.
- 34:25Steve Rotkoff: We do some work for USAID in Cambodia, and that's a very interesting work because the Cambodians are traumatized by, you know, the Khmer Rouge and the ability to get people to speak truth to power is pretty difficult in a place where you know your parents and grandparents.
- 34:50Steve Rotkoff: If they spoke truth to power, they were killed.
- 34:51Steve Rotkoff: So that's been interesting.
- 34:55Steve Rotkoff: And then we're doing some work for Fletcher, which is the International Policy School of Tufts University.
- 35:03Steve Rotkoff: So we've done a variety of different things.
- 35:07Steve Rotkoff: I've been the red teamer on the Lieutenant General Honorary Task Force that looked at security in the national capital region following January 6th, and that was very interesting.
- 35:21Steve Rotkoff: So my point is and I think you know, give me an opportunity to make that point this idea of better decision making, bringing people into the room group, think mitigation, alternative futures, all that stuff.
- 35:37Steve Rotkoff: It's really universally applicable.
- 35:40Steve Rotkoff: It's not just applicable to the military, it's not just applicable to business, it's applicable to anything where you don't have the enemy in the wire, and that's the one caveat I would make.
- 35:49Steve Rotkoff: Red teaming takes time and there's nothing you can do about that.
- 35:53Steve Rotkoff: It's intended to take time.
- 35:55Steve Rotkoff: It's intended to slow the decision making process so you can make a better decision.
- 36:00Steve Rotkoff: It's not in Boyd's very rapid application illustrations.
- 36:09Steve Rotkoff: It's not the same right, because the side piece is longer, because you're going to apply different tools and you bring different people into the conversation.
- 36:21Steve Rotkoff: So that is the one place where I tell people you know, if the enemy is in the wire, just do your crew drill, you know no red team it.
- 36:32Steve Rotkoff: You know there's no time to red team it.
- 36:34Steve Rotkoff: You bring in a lot of interesting points there with culture.
- 36:37Brian "Ponch" Rivera: So power distance index is critical and we always are asked these questions how does red teaming, things like liberating structures, think rights, share, think, chat, send all these things?
- 36:47Brian "Ponch" Rivera: How do they help in different cultures?
- 36:49Brian "Ponch" Rivera: And the point is, if you're given the opportunity to be heard and you're giving it, in this case, liberating structure to do that, you're going to see an increase in participation.
- 36:58Brian "Ponch" Rivera: We've seen that in many cultures, especially in software, so we know it works quite well in planning.
- 37:08Brian "Ponch" Rivera: So when we teach people how to plan, let's go back to MDMP.
- 37:11Brian "Ponch" Rivera: We give them better approach to planning and we give them different red teaming techniques that they can use to mitigate cognitive biases and enable critical thinking and they plug and play those things as necessary right.
- 37:23Brian "Ponch" Rivera: So we build that internal capability up.
- 37:26Brian "Ponch" Rivera: And I want to go back to your toxic leader point.
- 37:27Brian "Ponch" Rivera: If there's a toxic leader on the team or leading the team, you're not going to do this right, you're not going to actually take the time, because you do have to slow down to leverage the diversity of people you have in the room or cognitive diversity.
- 37:43Brian "Ponch" Rivera: I want to focus on that and that's essential.
- 37:45Brian "Ponch" Rivera: So everybody talks about we need diversity of thought.
- 37:48Brian "Ponch" Rivera: They hire diverse folks to become into their organization and then what do they do?
- 37:54Brian "Ponch" Rivera: They just continue to do what they normally do, right?
- 37:56Brian "Ponch" Rivera: They just expect magical things to happen.
- 37:58Brian "Ponch" Rivera: In my view, red teaming allows us to leverage that cognitive diversity so you can get multiple perspectives to create a better reality or better orientation of the external environment, and that's what's required in this environment.
- 38:13Brian "Ponch" Rivera: With the amount of VUCA, we use volatility, uncertainty, complexity and ambiguity.
- 38:17Brian "Ponch" Rivera: So I don't know of a better way to explain to folks or maybe you have one why they need red teaming and red team techniques in their organization.
- 38:30Brian "Ponch" Rivera: Do you have an elevator pitch for that?
- 38:35Steve Rotkoff: Well, I think the reason you need red team techniques in your organization is that group think in any small group.
- 38:45Steve Rotkoff: Group think is not a function of bad leadership.
- 38:49Steve Rotkoff: Group think is a function of human condition, right?
- 38:54Steve Rotkoff: Human beings immediately assess who the power is in the room.
- 38:59Steve Rotkoff: We do that all the time, and then we self-censor.
- 39:03Steve Rotkoff: And so I'm convinced that the Pope and the Dalai Lama have people who lie to them, not because they're bad people, but because they're in charge.
- 39:12Steve Rotkoff: So if you want people to tell you the truth, you need methods.
- 39:18Steve Rotkoff: It's not enough to say come on, everybody, I'm open, let's brainstorm.
- 39:23Steve Rotkoff: People don't believe you.
- 39:25Steve Rotkoff: And besides, brainstorming is a broken system anyway, Because the way you win at brainstorming is to be the first person to talk, and then everybody talks about what you're talking about, right?
- 39:35Steve Rotkoff: So I'll give you an example of I can't fix toxic leadership.
- 39:42Steve Rotkoff: I get that, but a lot of times you don't know if the leader is toxic or not.
- 39:47Steve Rotkoff: The leader is there.
- 39:48Steve Rotkoff: The leader may be a good leader, they may be a positive leader, but that doesn't mean people are afraid of what they're going to say in that room, because they don't know what's in the head of that leader and they're afraid that somehow they'll step on an unseen landmine and they'll piss that leader off.
- 40:05Steve Rotkoff: That's human nature.
- 40:06Steve Rotkoff: You can't say well, you ought to have the courage of your convictions.
- 40:10Steve Rotkoff: Yeah, that's swell, it's just not true.
- 40:13Steve Rotkoff: People aren't going to do that.
- 40:15Steve Rotkoff: So I was once brought in by a new one star who had taken a job in the Pentagon.
- 40:20Steve Rotkoff: And it was one of these jobs where you'd come in for a year and then you'd go to another job.
- 40:26Steve Rotkoff: I mean, they'd have a new one star almost every year and the guys who ran the office were the 15s or the 14s SES, whatever they had who were there year after year after year.
- 40:42Steve Rotkoff: So I used anonymous techniques I don't need to go into details, but anonymous techniques to get everybody to say because the general's question was I've only here a year, I want to make a difference, when should I focus my attention?
- 40:56Steve Rotkoff: And we collected all the ideas around the room and they were put on a board and then everybody voted anonymously and at the end, when we tallied all the votes, it was way to anonymous feedback.
- 41:11Steve Rotkoff: At the end, the ideas are up there, the votes are up there, and the general goes to the board and points an idea that has one vote and he says that's my idea, that's my vote.
- 41:26Steve Rotkoff: Tell me what I just don't understand about this office, because clearly I don't understand this office.
- 41:32Steve Rotkoff: So you guys who gave lots of votes here and lots of votes there, talked to me about why those things are so important, because they weren't even on my radar screen.
- 41:43Steve Rotkoff: Now that guy had me back year after year after year after year until he retired as a four star, and so you don't know that the leader is necessarily toxic.
- 41:55Steve Rotkoff: You just know he's there, and so the fact that he's there drives you to use anonymous techniques, because otherwise people will undoubtedly self-censor.
- 42:04Steve Rotkoff: The other thing I would mention when you talk about power, distance and sort of empowering people is do you guys use my 15%?
- 42:21Brian "Ponch" Rivera: I haven't in a long time.
- 42:22Brian "Ponch" Rivera: No.
- 42:24Steve Rotkoff: I find that to be very, very effective and the more depressing the organization is the more hierarchical it is, the more effective it is, because you ask people to look at.
- 42:38Steve Rotkoff: You know the pitch for this tool is nobody controls everything, and the exception, possibly, of Kim Jong-un.
- 42:46Steve Rotkoff: Everybody else has to coordinate with somebody.
- 42:49Steve Rotkoff: Okay, you know, the president has to deal with both parties, has to deal with, you know, the press has to deal with foreign leaders.
- 42:57Steve Rotkoff: Nobody controls everything, but everybody controls 15%, and the 15% that everybody controls is how they treat other people, what they prioritize, you know how they organize their time, things like that.
- 43:17Steve Rotkoff: And so what I want you to do is I want you to light a candle, vice, curse the darkness in your organization, and I want you to write down what your 15% is.
- 43:28Steve Rotkoff: What can you do without any additional resources, without any change in policy, without anybody's help, to make your organization just a little bit better?
- 43:39Steve Rotkoff: That's your 15%, and you have people do that, and then you share that and what you find out is there are a whole bunch of ideas that people have.
- 43:48Steve Rotkoff: They can write a SOP that they found that they wish somebody had right.
- 43:53Steve Rotkoff: They can counsel in a different way.
- 43:56Steve Rotkoff: They can, you know, do coffee and donuts once a month, whatever it is, but it's very empowering, and it's a tool that I recommend if you're not using it already.
- 44:07Brian "Ponch" Rivera: No, I love it.
- 44:08Brian "Ponch" Rivera: You know, what I like about this work is it's not standalone, right, it's.
- 44:13Brian "Ponch" Rivera: You just don't teach red teaming, we don't anyway.
- 44:16Brian "Ponch" Rivera: We look at things like effective planning, effective communication, decision making with the Kinevin framework, worldly mapping.
- 44:23Brian "Ponch" Rivera: We even do story pointing occasionally with software teams if that's what they want to do, and we use the dot voting technique that's in the UFMCS red teaming handbook, the applied thinking, critical thinking handbook as well.
- 44:35Brian "Ponch" Rivera: So what does this mean?
- 44:36Brian "Ponch" Rivera: It means that when you bring in red teaming tools and techniques and methods, you can apply them to what works as well.
- 44:45Brian "Ponch" Rivera: For example, worldly mapping.
- 44:46Brian "Ponch" Rivera: We try to map the external environment, starting with the customer, their needs and figuring out the activities that we need to focus on as a production team I'll just call it a production team for now.
- 44:56Brian "Ponch" Rivera: Use liberated structures for that, or red teaming techniques to help that.
- 45:01Brian "Ponch" Rivera: You accelerate ideas, the quality of ideas that are out there.
- 45:06Brian "Ponch" Rivera: But what's nice about this is, once you show people how to do this and why it works because inattentional, blindness and some other biases out there, why we want to do these things they start to do them on their own.
- 45:19Brian "Ponch" Rivera: So you start to develop this internal capability.
- 45:23Brian "Ponch" Rivera: You're not going to be dependent on Mark McGrath coming into your place every quarter to run a planning session.
- 45:28Brian "Ponch" Rivera: It's something that you can do, you can teach your coaches to do, you can teach your leaders to do, and it's absolutely critical.
- 45:35Brian "Ponch" Rivera: What's fascinating about this is in universities I didn't learn this in a university, I learned it in the military right and you ask your kids are they learning any of these techniques at school?
- 45:48Brian "Ponch" Rivera: And the answer is no.
- 45:48Brian "Ponch" Rivera: And, mark, I don't know if your kids have that experience at all with their education.
- 45:52Brian "Ponch" Rivera: Are they learning any of these techniques anywhere?
- 45:55Mark McGrath: No, they're not, and you said the L word.
- 45:58Mark McGrath: It's all about learning and expanding the orientation and keeping it aligned to the reality such that when things happen, you're able to act faster.
- 46:06Mark McGrath: Steve, you mentioned earlier the current situation unfolding in the Middle East.
- 46:11Mark McGrath: The Israelis went right to act because the orientation is aligned enough that they can.
- 46:16Mark McGrath: It's implicitly getting a controlling action that they can get to it right away, because they've spent the time maybe learning, weighing out these ideas, talking about these sorts of things, to gain more perspectives.
- 46:31Steve Rotkoff: Yeah, the one thing I want to say, ponch yeah, I agree, mark, about what you said, that it's very important to me is, you know, when we stood up UFMCS our client, if you will, our customer we're going to be mostly majors.
- 46:52Steve Rotkoff: That's who we were aiming at, and those majors were going to be all over the place and they were going to have all sorts of resources available.
- 47:04Steve Rotkoff: Some might be, you know, in a place where they've got all sorts of bandwidth and data and they can do all sorts of fancy stuff, and some might be in a tense someplace with a butcher board, and we were very rigorous about the idea that these tools need to be simple, they need to be replicable, that people, when we walk away, can do what we did for them and they can pass the word.
- 47:33Steve Rotkoff: That's what spreading the virus is about.
- 47:35Steve Rotkoff: So I think it's very important that the tools be easily understood, intuitive.
- 47:42Steve Rotkoff: I mean I love it when somebody you know I teach a tool and somebody says why the hell didn't, I think about that.
- 47:49Steve Rotkoff: That's I mean, that's so easy, so easy to do, and so that's kind of my focus.
- 47:57Steve Rotkoff: If the tool becomes too complicated like there are tools in the Red Team Handbook, like Stringer Pearls, other tools.
- 48:06Steve Rotkoff: I don't do them at all Because they're too damn complex for me.
- 48:10Steve Rotkoff: I can't keep track of them.
- 48:12Steve Rotkoff: How can I expect my customer to keep track of them or to ever do them after I leave?
- 48:17Steve Rotkoff: And then the last thing I would say is that part of Red Teaming being a meta way of thinking is that the tools that are taught, or the tools that you know, are not all the tools there are.
- 48:31Steve Rotkoff: Sometimes you have to design a tool.
- 48:34Steve Rotkoff: You go huh, none of the tools that I have really fit this problem exactly.
- 48:41Steve Rotkoff: So let's take a tool and modify it or change it or conduct it in a different way.
- 48:47Steve Rotkoff: Sometimes I will need to bring in somebody from the company I'm working with and make them a seconded Red Team, because I don't understand enough about their work to intelligently craft the tools.
- 49:06Steve Rotkoff: But I can explain the tools and the intent and then they help me craft that tool so that it works for their business.
- 49:14Steve Rotkoff: But I have found myself creating lots of tools since the Handbook was published that aren't in the Handbook because I needed them.
- 49:25Brian "Ponch" Rivera: So in the flow system we added something known as complex facilitation techniques, which kind of sounds like Red Teaming.
- 49:30Brian "Ponch" Rivera: It's separate.
- 49:31Brian "Ponch" Rivera: So Dave Snowden recommended that we separate them out and it would be something like the future backwards, something that he created, the future backwards, maybe some side casting and back casting as well, ritual descent, something like that.
- 49:44Brian "Ponch" Rivera: We don't call them.
- 49:46Brian "Ponch" Rivera: I actually call them part of Red Teaming because it's easier to explain to a client than hey, here's complex facilitation techniques and here's a Red Teaming technique.
- 49:53Brian "Ponch" Rivera: But you're right, you can still use the basic think, write, share to come up with a future backwards scenario which is fantastic to use to help leaders stay on course, to make sure they avoid the pitfalls of execution two months, three months down the road.
- 50:10Brian "Ponch" Rivera: So it is a mix and match thing.
- 50:13Brian "Ponch" Rivera: I tell you we have so much fun with it once the coaches and the coachees learn how to use it, because you never know how it's going to come, what's going to emerge from that, what you're going to see.
- 50:26Brian "Ponch" Rivera: And I'll give you an example.
- 50:27Brian "Ponch" Rivera: You used to do Ritual Descent quite a bit, which is something we get from Dave Snowden's Cognitive Edger, the Conevan company.
- 50:35Brian "Ponch" Rivera: You do that, which is very, very complicated to set up, it's hard to do, but it's very powerful.
- 50:43Brian "Ponch" Rivera: And the organization we were working with some of the people learned that and came to me and said, hey, we want a Red Team.
- 50:49Brian "Ponch" Rivera: I'm like, well, they're two different things.
- 50:52Brian "Ponch" Rivera: Ritual Descent and the Red Team are two different things, but the language gets mixed and some coach tells them that this is what this is, and so forth.
- 50:59Brian "Ponch" Rivera: The bottom line is you're using something that leverages that divergent thinking, which is absolutely critical in all aspects of planning, executing and assessing that feedback loop.
- 51:11Brian "Ponch" Rivera: So if you can learn how to do something, even if it's one thing think right, share you're going to get better at planning, executing and assessing.
- 51:22Brian "Ponch" Rivera: And once you learn how to build these, or build these Red Teaming techniques with complex facilitation techniques together, you start to see things you couldn't see before.
- 51:33Brian "Ponch" Rivera: And it's so powerful and so exciting to see teams and organizations pick up on this and we have to thank UFMCS for this.
- 51:42Brian "Ponch" Rivera: We try to stay as true as possible to a free document anybody can download online, which brings me up to this thing.
- 51:48Brian "Ponch" Rivera: So Mark and I want to create a certification tomorrow on UFMCS's Red Team Handbook or the Applied Critical Thinking Handbook.
- 51:57Brian "Ponch" Rivera: What's stopping us from doing that?
- 51:59Brian "Ponch" Rivera: Is there anything?
- 52:01Steve Rotkoff: I don't think anything.
- 52:02Steve Rotkoff: I will tell you that Bryce Hoffman and his Red Team thinking, I think, is named as his company.
- 52:12Steve Rotkoff: He's got a whole bunch of certification programs and all of it.
- 52:17Steve Rotkoff: That's out there.
- 52:18Steve Rotkoff: A lot of it, not everything.
- 52:20Steve Rotkoff: I would say that Mark Mateski has created a whole bunch of tools independent of UFMCS, but most of the tools that are out there they have their lineage in the Red Team Handbook.
- 52:34Steve Rotkoff: So I don't think there's anything that prevents you from doing that.
- 52:38Steve Rotkoff: Just one comment, poncho, on what you said, but I don't want to let it go before I forget.
- 52:42Steve Rotkoff: You said you can use Think Right Share in concert with X, y or Z.
- 52:48Steve Rotkoff: I would tell you we do not do a single exercise, a single tool in any of our practice that doesn't start with Think Right Share, always Think Right Share, and we beat it into them.
- 53:02Steve Rotkoff: So it doesn't matter what we're doing, it always starts with Think Right Share.
- 53:06Brian "Ponch" Rivera: You're going to love this, steve.
- 53:07Brian "Ponch" Rivera: At the beginning of COVID we had to shift from being in person to going online.
- 53:11Brian "Ponch" Rivera: I'm like, how do we do Red Teaming techniques online?
- 53:14Brian "Ponch" Rivera: And I say there's an advantage to doing it online.
- 53:17Brian "Ponch" Rivera: So with the mural boards, the different white boards out there, you can do Think Chat Send.
- 53:25Brian "Ponch" Rivera: You can do it on Microsoft Teams, you can do it on Zoom.
- 53:27Brian "Ponch" Rivera: There are different ways to do it.
- 53:28Brian "Ponch" Rivera: So think about it, put it in chat, send it to one person Either you're a Scrum Master or a designated leader or a designated facilitator.
- 53:35Brian "Ponch" Rivera: You keep everything pure in there and it works.
- 53:37Brian "Ponch" Rivera: And the same thing with dot voting and you could do several things online using Red Teaming techniques that I wasn't expecting in 2019 to use in 2020, 2021.
- 53:50Brian "Ponch" Rivera: So it's pretty universal.
- 53:53Steve Rotkoff: Are you guys using a lot of role play?
- 53:57Brian "Ponch" Rivera: We do a lot of experiential learning activities and simulation where we use Red Team techniques.
- 54:01Steve Rotkoff: Yes, no role play.
- 54:05Brian "Ponch" Rivera: No, not right now.
- 54:06Steve Rotkoff: So I would tell you one thing to consider because I think it is really illustrative is let's say you have a problem and you say, for the purposes of this exercise, we're going to take the guy who's in charge of marketing and you're no longer in charge of marketing For this exercise, you're in charge of sales and the guy who's in charge of sales for this exercise you're in charge of marketing or logistics and supply or whatever it is, and you force them into an alternative perspective as they think about the problem and they will garner insights that they otherwise would not have, because being forced into that role forces them to think like that designated person.
- 54:58Steve Rotkoff: So just a thought I use a lot of role play.
- 55:01Steve Rotkoff: I find it very valuable.
- 55:02Steve Rotkoff: I take that back.
- 55:04Brian "Ponch" Rivera: I take that back.
- 55:05Brian "Ponch" Rivera: So we do it all the time with a customer and that's very hard for people to do because when we get back to like wardly mapping, put yourself in your customer's shoes and ask what do I need, and that changes everything.
- 55:18Brian "Ponch" Rivera: This goes back to empathy.
- 55:19Brian "Ponch" Rivera: Can you empathize with your customer and figure out what it is they need, because they may not need what you're trying to give them?
- 55:25Brian "Ponch" Rivera: And generally I'll tell you when we get a red team or when we do think right, share, get everybody using sticky notes or notes on a whiteboard, electronic whiteboard, start with the customer.
- 55:37Brian "Ponch" Rivera: Who is your customer?
- 55:38Brian "Ponch" Rivera: Answer that question, think right, share, go Right, and that's an amazing conversation right there.
- 55:43Brian "Ponch" Rivera: That is just the most critical conversations to have as an organization.
- 55:48Brian "Ponch" Rivera: And then you move on to what do they need and then, once you get that, everything starts falling in place.
- 55:54Brian "Ponch" Rivera: I mean, it just starts working.
- 55:58Steve Rotkoff: The only piece I'd add in there.
- 55:59Steve Rotkoff: First of all, I think that's great.
- 56:01Steve Rotkoff: So the other big thing that we spend a lot of time up front is asking people to look at the problem and using think right, share, make the explicit and implicit assumptions what are you assuming about the future?
- 56:22Steve Rotkoff: What are you assuming about supply chain?
- 56:26Steve Rotkoff: What are you assuming about the economy?
- 56:29Steve Rotkoff: What are you assuming about the workforce?
- 56:31Steve Rotkoff: What are your assumptions?
- 56:33Steve Rotkoff: And then you can not vote the assumptions and say, okay, which of these assumptions is really critical?
- 56:37Steve Rotkoff: Because the problem is that and I saw this in the military all the time once you'd gone through the step of collecting assumptions, it was okay, we did that step check mark, let's move on.
- 56:52Steve Rotkoff: Well, if an assumption is critical, then there needs to be metrics around that assumption.
- 56:58Steve Rotkoff: You need to be tracking that assumption, because if the assumption does not become true, your plan needs to change and we don't spend enough time on that.
- 57:07Steve Rotkoff: So that's something we do.
- 57:09Steve Rotkoff: I don't know if you guys do that or not.
- 57:10Steve Rotkoff: Absolutely, it's something I would recommend.
- 57:12Brian "Ponch" Rivera: Yeah, we use that for contingency planning.
- 57:13Brian "Ponch" Rivera: Yeah, so we'll do that in a okay, let's think right, share possible threats to our current objective or outcome or whatever it may be, and we can look and prioritize those threats, because you can't go after everything, right, and kind of go, do we have contingencies around these things that we can control?
- 57:27Brian "Ponch" Rivera: And how do we monitor?
- 57:28Brian "Ponch" Rivera: This goes back to, I think, your human terrain mapping experiences.
- 57:31Brian "Ponch" Rivera: How do we monitor what's going on?
- 57:33Brian "Ponch" Rivera: So get into the fat tail risks of what's going.
- 57:37Brian "Ponch" Rivera: The black swans you can't identify a black swan.
- 57:40Brian "Ponch" Rivera: In the same manner, you can't identify a unknown unknown, you just know you need to scan for it.
- 57:46Brian "Ponch" Rivera: And you can use red teaming techniques to continually scan the environment, right?
- 57:51Brian "Ponch" Rivera: So there's so much more to how we use these tools and techniques within an organization and what they can do for safety, resilience, innovation and agility that I mean there's not enough time to talk about on this podcast.
- 58:04Brian "Ponch" Rivera: But that's why you have, that's why you do what you do, that's why we do what we do.
- 58:08Brian "Ponch" Rivera: That's why we're here is to help people hedge and I'm gonna use a term from the markets hedge against the future, right?
- 58:17Brian "Ponch" Rivera: How do we hedge against something that could happen, or probable, plausible and possible things.
- 58:23Brian "Ponch" Rivera: How do we do that?
- 58:24Brian "Ponch" Rivera: And you think about the current context and we're one and a half weeks into the Israeli, palestinian, hamas issue.
- 58:33Brian "Ponch" Rivera: I mean, think about what's going on now in our US military.
- 58:38Brian "Ponch" Rivera: Are they using red teaming techniques?
- 58:41Brian "Ponch" Rivera: I hope they are.
- 58:42Brian "Ponch" Rivera: I might believe that they're not, you know.
- 58:49Brian "Ponch" Rivera: I do know that the Israelis have one heck of a design school for operation design, strategic design.
- 58:56Brian "Ponch" Rivera: They're very advanced in their thinking when it comes to leveraging the wisdom of crowds, if you will.
- 59:01Brian "Ponch" Rivera: But I wanna get your thoughts on the current condition.
- 59:05Brian "Ponch" Rivera: What do you think is going on in the Pentagon when it comes to red teaming right now?
- 59:11Brian "Ponch" Rivera: What should be happening and how should businesses be using red teaming techniques in this current environment?
- 59:21Steve Rotkoff: So I think that, ultimately, you know, red teaming is not about predicting the future.
- 59:29Steve Rotkoff: Right, you can't predict the future, and one of the traps that planners fall into is belief that if I have three sleepless nights and giant whiteboards with all sorts of matrices on them and all sorts of actors on them, that somehow I can get the future to conform to my will.
- 59:51Steve Rotkoff: And you know that's just not the case.
- 59:53Steve Rotkoff: What red teaming is about is making you open to the fact that the future is going to be emergent and that there are things about the future, as the future emerges, that you need to track.
- 1:00:11Steve Rotkoff: You need to.
- 1:00:12Steve Rotkoff: I mean, that's what premortem analysis, as we teach it is all about.
- 1:00:16Steve Rotkoff: Right, what are the things that I want to measure and track as I move into the future, to recognize whether or not I'm now going down a divergent path.
- 1:00:28Steve Rotkoff: And you know, I think that it's not only that, but the piece about alternative perspectives.
- 1:00:38Steve Rotkoff: I mean, you know, I think that the failure, when people talk about intelligence failure whether it's Hamas or it's 9-11 or whatever it is it's really about two failures A failure to respect your opponent and a failure of imagination.
- 1:01:03Steve Rotkoff: And the failure to respect your opponent is to believe that somehow what worked yesterday and defeated your opponent is going to work tomorrow, because your opponent is not a learning part of a learning organization themselves.
- 1:01:18Steve Rotkoff: Right, you guys are familiar with the 11th Tachelcopter Regiment story from Operation Rocky Freedom.
- 1:01:27Steve Rotkoff: Are you familiar with that story?
- 1:01:29Steve Rotkoff: Okay, so that is a story that also helped inform the decision to develop red teaming.
- 1:01:36Steve Rotkoff: It's written about in the official history of Seaflic of the war.
- 1:01:41Steve Rotkoff: So the 11th Tachelcopter Regiment is the worst going on and it's been given the mission to do a deep attack to take out one of the tank divisions that's, you know, gonna enter into the fight and kill them before they can get to the battle space.
- 1:01:58Steve Rotkoff: And they're doing a.
- 1:02:01Steve Rotkoff: They're doing a rock drill and, because they're in the desert and it's 2003, they're doing it old fashioned way.
- 1:02:08Steve Rotkoff: They've got blue ribbon laying out the rivers, right, they've got some camouflage netting for the desert, they have boxes for the built up areas and they're doing their walkthrough and they're thinking about the suppression of enemy air defense and how they're gonna do that.
- 1:02:26Steve Rotkoff: And you know who they're gonna jam, who are they gonna shoot at, et cetera.
- 1:02:30Steve Rotkoff: And they're walking through and they're rehearsing it and you've got the XO of the regiment who's leading this, with all the senior pilots walking through, and there's one person in the room who looks different than all the others and that is a female Lieutenant, mi.
- 1:02:50Steve Rotkoff: And she raises her hand during the rock drill and she says can I ask a question?
- 1:02:56Steve Rotkoff: And they say sure, what's your question?
- 1:02:58Steve Rotkoff: She said what if, instead of using air defense which we can track, the Iraqis somehow figure out a way to coordinate massed small arms fire?
- 1:03:11Steve Rotkoff: What would that look like and what would we do about it?
- 1:03:14Steve Rotkoff: And the XO of the regiment says, in effect I mean, he doesn't say these exact words, but what he says in effect is men are talking here, you know, why don't you go in the corner of someplace?
- 1:03:29Steve Rotkoff: And color?
- 1:03:30Steve Rotkoff: We got this.
- 1:03:33Steve Rotkoff: So then the radio traffic in the operation.
- 1:03:36Steve Rotkoff: You can hear them, pilots, talking to each other because as they're flying over, each built up area there's a guy with binoculars and a cell phone who's tracking them.
- 1:03:46Steve Rotkoff: And they talk about that.
- 1:03:47Steve Rotkoff: They said I wonder what that's about?
- 1:03:49Steve Rotkoff: Hell, I don't know.
- 1:03:50Steve Rotkoff: You know, maybe he's never seen a helicopter before, you know, maybe it's just fun.
- 1:03:54Steve Rotkoff: And but each built up area there's a new guy with, you know, cell phone, binoculars.
- 1:04:00Steve Rotkoff: And when they arrive at the battle area, they are met by mass small arms.
- 1:04:05Steve Rotkoff: Fire everything that you can pick up and fire in the air.
- 1:04:08Steve Rotkoff: And of the 51 helicopters that go out on the mission, one is shot down and the pilot and copilot take him prisoner, and the other 50 returned to base without killing a single tank full of holes.
- 1:04:23Steve Rotkoff: That takes months to recover.
- 1:04:24Steve Rotkoff: Okay, so that is a failure to respect the enemy.
- 1:04:29Steve Rotkoff: That lieutenant in the room was the only one who respected the fact that the Iraqis could learn something from the Valley of Death during Desert Storm and change their tactics.
- 1:04:42Steve Rotkoff: I think that's the same thing that happened with Hamas, and that they didn't respect the fact that Hamas was gonna figure out a way to defeat Israeli streps.
- 1:04:56Brian "Ponch" Rivera: And yeah, I wanna bring up something there.
- 1:04:59Brian "Ponch" Rivera: So we call that a weak signal.
- 1:05:01Brian "Ponch" Rivera: So when we use red teaming techniques, you can potentially uncover that lieutenant that identified that one off thing right that nobody else saw.
- 1:05:13Brian "Ponch" Rivera: And this goes back to inattentional blindness.
- 1:05:15Brian "Ponch" Rivera: You only see what we expect to see.
- 1:05:16Brian "Ponch" Rivera: So we demonstrate this quite a bit to folks in the workshops and when we work with clients that I forgot the number 20% of the folks in the room are gonna see something that the other 80% don't see.
- 1:05:28Brian "Ponch" Rivera: Right, it might actually I think it's 17%, but you wanna look for those signals in your organization.
- 1:05:35Brian "Ponch" Rivera: You could see them once you do a think right, share, you can cluster them up or you can bucket them and you can see the one offs that go hey, look at these things over here, what are we doing about them?
- 1:05:44Brian "Ponch" Rivera: Right, and that's that lieutenant story, right there.
- 1:05:46Brian "Ponch" Rivera: That is exactly how do we uncover weak signals so we can include that in our decision-making process.
- 1:05:55Mark McGrath: It sounds like the team that developed digital photography at Kodak even right.
- 1:06:01Steve Rotkoff: Oh sure, it's all those stories, it's Blockbuster and Netflix, it's all those stories.
- 1:06:08Steve Rotkoff: But yeah, I think that I don't remember where I was going with all this.
- 1:06:13Steve Rotkoff: Other than, that was also one of the stories that informed the decision by the army.
- 1:06:17Steve Rotkoff: I mean, there were lots of stories, but it was one of them.
- 1:06:21Steve Rotkoff: They said, okay, so we need to change our decision-making methods, we need to be able to hear from that lieutenant.
- 1:06:27Steve Rotkoff: And again, a lot of times when I tell that story, people focus on the misogyny of it, and that's certainly a part of it, but that's not really the key takeaway.
- 1:06:38Steve Rotkoff: The key takeaway is the disrespect of the enemy, and I think that we do that all the time.
- 1:06:45Steve Rotkoff: I did a I can't mention the names in this particular case, but I did a red team work for a corporate client and they had a competitor who invariably would make fun of them, try and discredit any of their initiatives, and they were very, they were hyper aware of this competitor and they had a giant initiative that they were, that they were getting ready to launch, spent a lot of money on them and they said we need to red team this.
- 1:07:17Steve Rotkoff: So I went out and I bought t-shirts from the competitor, of the competitor's name and brand, and I, when I went into the red team, I said okay, I want you guys to all wear these t-shirts.
- 1:07:31Steve Rotkoff: You are this company.
- 1:07:34Steve Rotkoff: You are no longer your own company.
- 1:07:36Steve Rotkoff: You are now this other company.
- 1:07:38Steve Rotkoff: You know everything there is to know about this initiative that's coming out.
- 1:07:42Steve Rotkoff: I want you to craft the counter programming.
- 1:07:45Steve Rotkoff: What would that look like?
- 1:07:47Steve Rotkoff: That comes out, how are you gonna respond?
- 1:07:49Steve Rotkoff: How are you gonna denigrate it, how are you gonna suborn it, et cetera.
- 1:07:53Steve Rotkoff: And then we briefed that to the board of directors and they changed the initiative.
- 1:08:00Steve Rotkoff: You know, once they were faced with people role playing, this alternative view, because unfortunately, most people look at whatever decision they're gonna make only through their own eyes, which is why another tool that we use all the time very valuable is the Four Ways of Sea, and I would tell you that I did work, before I retired, in Korea where we did the 25 Ways of Sea, and it was China, the US, north Korea, south Korea and then the US South Korea Alliance, which operated as an independent entity because it saw things differently than either South Korea or the US.
- 1:08:50Steve Rotkoff: It acted independently.
- 1:08:52Steve Rotkoff: So you had these five on one side and we had how they saw each other and how they saw themselves, and we out briefed it to the two star general and it changed some of their planning.
- 1:09:04Steve Rotkoff: It changed some of the ways that they went about business, because once you're forced to take that alternative perspective, you start to think differently about what you're doing.
- 1:09:13Steve Rotkoff: I mean, there were things that we were doing that were that were absolutely going to elicit a reaction from the North and we hadn't looked at it from a North Korean perspective, so we could still continue to do those things.
- 1:09:34Steve Rotkoff: We can't continue to do those things and not expect the North to react From a Northern perspective.
- 1:09:41Steve Rotkoff: That was a I don't know, I can't grab the right word, but it was a provocative event.
- 1:09:50Steve Rotkoff: So anyway, I think Four Ways of Seeing is very powerful.
- 1:09:55Brian "Ponch" Rivera: Steve on Four Ways of Seeing.
- 1:09:56Brian "Ponch" Rivera: I want to know if you ever used Pemissi to help organizations.
- 1:09:59Brian "Ponch" Rivera: I know it's one of our constructs with politics, military economics, social infrastructure, intelligence.
- 1:10:05Steve Rotkoff: So, Bonch, I will tell you that I'll go back to what I said earlier I believe in simplicity.
- 1:10:11Steve Rotkoff: I don't use jargon.
- 1:10:13Steve Rotkoff: I don't use any of the decision-making jargon.
- 1:10:16Steve Rotkoff: I don't use difficult tools.
- 1:10:20Steve Rotkoff: So when I have the cause to do something like that, I use dime.
- 1:10:27Brian "Ponch" Rivera: It's simple, it gets it most of them.
- 1:10:30Steve Rotkoff: Pemissi just takes more time.
- 1:10:32Steve Rotkoff: It's more complex.
- 1:10:33Steve Rotkoff: Who needs it?
- 1:10:35Brian "Ponch" Rivera: So dime is a diplomatic, information, military, economic, is that right?
- 1:10:39Brian "Ponch" Rivera: Yeah, so, and I think what you're saying is look through this through these lenses.
- 1:10:45Brian "Ponch" Rivera: In this case, we may not want to use dime with the company.
- 1:10:48Brian "Ponch" Rivera: You can use economic, you can use infrastructure, maybe I don't know, but if you provide the make tool to go, okay, how are you going to look at this?
- 1:10:57Brian "Ponch" Rivera: Look at it from these different lenses, all right, and use the techniques to do that.
- 1:11:02Brian "Ponch" Rivera: There's another question that I want to ask you Absolutely.
- 1:11:07Steve Rotkoff: What we generally do.
- 1:11:08Steve Rotkoff: Are you there?
- 1:11:09Steve Rotkoff: You look like you're frozen, you guys there?
- 1:11:12Steve Rotkoff: Yep, we're here, you're there now.
- 1:11:14Steve Rotkoff: Okay, yeah, you're frozen on my screen.
- 1:11:16Steve Rotkoff: So I will tell you that, although I absolutely believe in tailored programs and I do tailor my programs to the needs of the customer and I have long conversations with the customer before I build the program but the fundamentals that we do when we do a program are assumptions analysis first and foremost.
- 1:11:39Steve Rotkoff: Okay, we do that upfront.
- 1:11:42Steve Rotkoff: What are the assumptions about the future and how do those assumptions inform your planning?
- 1:11:47Steve Rotkoff: Then we do stakeholders and we lay out stakeholders to try to identify the stakeholders that are both critical and not on the team already with the plan.
- 1:11:58Steve Rotkoff: So we're not interested in stakeholders that are really supportive and don't matter, or stakeholders that are not supportive and don't matter.
- 1:12:08Steve Rotkoff: We're only interested in those that are not entirely supportive and matter.
- 1:12:12Steve Rotkoff: And then we do a four ways of seeing around that stakeholder.
- 1:12:15Steve Rotkoff: How are you going to influence that stakeholder?
- 1:12:17Steve Rotkoff: Then we might do a scenario planning tool where we look at four alternative futures that the company or organization cannot control.
- 1:12:28Steve Rotkoff: So I did this with a relative of mine once who works for construction and he asked me to outline a tool that he could use quickly.
- 1:12:38Steve Rotkoff: And he does this massive construction.
- 1:12:41Steve Rotkoff: And I said, okay, chris, you cannot control the cost of building materials.
- 1:12:48Steve Rotkoff: He says that's true.
- 1:12:50Steve Rotkoff: I said, okay, on one axis it's going to be the cost of building materials.
- 1:12:54Steve Rotkoff: Remain stable or get cheaper, or they get much more expensive.
- 1:12:59Steve Rotkoff: So the much more expensive axis is here, the cheaper axis is at the end of the axis, is on the other side.
- 1:13:06Steve Rotkoff: The other thing you can't control is the weather right, and the weather matters.
- 1:13:11Steve Rotkoff: So the weather is conducive or the weather is not conducive.
- 1:13:15Steve Rotkoff: You know you have bad weather.
- 1:13:17Steve Rotkoff: I said now you have four alternative futures.
- 1:13:19Steve Rotkoff: You have a future where the weather is good and building materials cheap.
- 1:13:25Steve Rotkoff: You have a future where the weather is good but building materials are expensive.
- 1:13:29Steve Rotkoff: You have a future where the weather is stocks and building materials are expensive, or the weather sucks and building materials are cheap.
- 1:13:37Steve Rotkoff: Those are four different futures, none of which your company controls, but all of which are possible.
- 1:13:43Steve Rotkoff: So if you knew that was the future, what would you be doing today In order to prepare yourself for that future?
- 1:13:50Steve Rotkoff: And then, when you look across those four matrices, you come up with some common things that you can do to better prepare yourself for going into that future.
- 1:14:00Steve Rotkoff: And so we'll do that, or we'll do dine, or we'll do something else to help them develop and test the plan, and then we'll always end with a premortem.
- 1:14:11Steve Rotkoff: So here's your plan let's do premortem.
- 1:14:14Steve Rotkoff: We do premortems individually, think right, share.
- 1:14:17Steve Rotkoff: Then we collectively share premortems.
- 1:14:20Steve Rotkoff: What's supposed to come out of the premortem at the end are three things.
- 1:14:25Steve Rotkoff: The first is how do I change the plan to preclude these kinds of things from happening?
- 1:14:34Steve Rotkoff: The second is if they're going to happen, how will I know they're happening?
- 1:14:39Steve Rotkoff: One of my indicators and warnings.
- 1:14:41Steve Rotkoff: And finally, if they happen, despite my best efforts, what am I going to do about it?
- 1:14:46Steve Rotkoff: How am I going to react to it?
- 1:14:47Steve Rotkoff: So that's sort of our program in a nutshell.
- 1:14:50Steve Rotkoff: We can do that in about two days with a company.
- 1:14:54Steve Rotkoff: With some companies we'll stretch it out, we'll do it in five days and they can go in more depth to different things.
- 1:15:01Steve Rotkoff: But that's what our red team program generally looks like.
- 1:15:04Brian "Ponch" Rivera: I love it.
- 1:15:05Brian "Ponch" Rivera: I want to ask a question about something I saw in an article you wrote several years ago.
- 1:15:10Brian "Ponch" Rivera: This connects back to effects-based operations that we had in the military.
- 1:15:13Brian "Ponch" Rivera: I don't know if you remember that Value-focused I do.
- 1:15:18Brian "Ponch" Rivera: One of the challenges that we see in organizations they try to start with a desired future state with a SMART goal specific, measurable, achievable, realistic and time box goal.
- 1:15:28Brian "Ponch" Rivera: The problem we tell them with that is in some cases, and actually in a lot of cases, you can't predict the future.
- 1:15:34Brian "Ponch" Rivera: So how can you give me a SMART goal when you don't even know what the future looks like?
- 1:15:38Brian "Ponch" Rivera: So in the military, at the operational level of war, we were quite successful in using effects-based operations, especially in the Air Operations Center, which is paring weapons to targets.
- 1:15:48Brian "Ponch" Rivera: It's pretty complicated work.
- 1:15:50Brian "Ponch" Rivera: It's not complex work.
- 1:15:53Brian "Ponch" Rivera: So we see a lot of these military-themed companies come out and say this is how we did it in the military, this is how you need to do it.
- 1:15:59Brian "Ponch" Rivera: But I believe it conflicts with the definition of a complex environment.
- 1:16:05Brian "Ponch" Rivera: You cannot do that.
- 1:16:07Brian "Ponch" Rivera: So we have to start a direction of travel and say we're going to go in that direction, whatever it may be, and we're going to do these little probes and we're going to use red teaming techniques, if you will, to figure out what this environment or this landscape actually looks like.
- 1:16:21Brian "Ponch" Rivera: So my question to you is where do you stand with effects-based operations, value-focused thinking, starting with a defined, high-definition future state in mind and working backwards from that, based on your experience in the red teaming school and what you're seeing now?
- 1:16:38Steve Rotkoff: So I think that in general, if you are talking about conventional warfare, conventional ops, that effects-based operations make sense.
- 1:16:54Steve Rotkoff: I think the less you're in killing people and breaking things and the more you're in influencing and trying to generally move in a general direction, the challenge becomes that you have the illusion of precision in effects-based operations and people buy into that illusion of precision much more than they should.
- 1:17:26Steve Rotkoff: So I think a tool can be really good in one circumstance and can deceive the user in another circumstance.
- 1:17:38Steve Rotkoff: I agree with your idea that what you really want for the future are general trends.
- 1:17:45Steve Rotkoff: Here's where I'd like to see the general trend in this situation be.
- 1:17:51Steve Rotkoff: Now, how far am I going to get down that trend line?
- 1:17:54Steve Rotkoff: I don't know and I'm going to have to act and then observe and then orient and then decide and act again, Because it's not knowable how far I'm going to get down that trend line and that trend line may not even be correct.
- 1:18:11Steve Rotkoff: I may discover things as I'm on that path that redirect me.
- 1:18:17Steve Rotkoff: But my challenge with effects-based operations, with design, with a lot of those things, is that they create this illusion of precision.
- 1:18:31Steve Rotkoff: And I'm not a fan of methodology, to be honest with you.
- 1:18:36Steve Rotkoff: I believe that when you have a rigorous step-by-step methodology, then completion of the process becomes the product.
- 1:18:45Steve Rotkoff: We got through MDMP, we did our job, we are a go at this station and what happens is people want to stop thinking in order to move to the next step.
- 1:18:57Steve Rotkoff: So I don't believe in that and I believe design is just another process.
- 1:19:02Steve Rotkoff: I believe that you take each problem, you try and understand the root cause of that problem, so that you're not solving the symptoms of the problem, but you're getting at the root causes, and then you design a methodology for engagement around.
- 1:19:19Steve Rotkoff: How many people do I have in the room?
- 1:19:21Steve Rotkoff: How much time do I have to discuss this, what is the nature of the problem and which tools do I apply?
- 1:19:29Steve Rotkoff: So my analogy for the use of red teaming tools is that of golf.
- 1:19:38Steve Rotkoff: The more expert you are as a golfer, the more you can use all those tools in your bag.
- 1:19:45Steve Rotkoff: If you don't know, Jack, about golf you don't golf very frequently you'll end up using three or four clubs right, Because the nuance in the other clubs doesn't work for you.
- 1:19:56Steve Rotkoff: The more you learn to golf, the better a golfer you become, the better you can apply the right tool to the right problem.
- 1:20:03Steve Rotkoff: So it's about constantly practicing and applying the right tools.
- 1:20:08Steve Rotkoff: That takes experience, and you don't get that out of a book.
- 1:20:11Steve Rotkoff: That's why you need a red team practitioner who's done a lot of this.
- 1:20:17Steve Rotkoff: I'm not pimping myself for work, but I would tell you I've done more of it than anybody on the planet at this stage.
- 1:20:26Brian "Ponch" Rivera: You know a guy right?
- 1:20:27Brian "Ponch" Rivera: Yeah, you heard it again, I do.
- 1:20:31Steve Rotkoff: I'm happy to help you guys as well.
- 1:20:32Steve Rotkoff: I love it.
- 1:20:33Steve Rotkoff: You know I'm always a… I love this.
- 1:20:37Steve Rotkoff: I mean, I do this because I love it.
- 1:20:40Steve Rotkoff: I believe that the VUCA world that you describe requires a different way of thinking, and that way of thinking can be called red teaming or it can be called something else, but it requires a different way of thinking and making decisions.
- 1:20:54Mark McGrath: There's no way out.
- 1:20:55Mark McGrath: That's, I think Boyd would agree, in the brief conceptual spiral.
- 1:20:59Mark McGrath: You know, you brought up earlier the illusion of precision and he said that mathematical and precision is one of the things, one of the factors that affect us as we continue to operate within complexity.
- 1:21:09Mark McGrath: And there's no way out with that continuous reorientation to learn.
- 1:21:14Mark McGrath: And I think red teaming is a phenomenal way to ensure your learning.
- 1:21:20Mark McGrath: It also makes me think of destruction, creation, where you can't determine the character or the nature of a system within itself.
- 1:21:28Mark McGrath: Moreover, attempts to do so lead to confusion and disorder.
- 1:21:31Mark McGrath: So, by challenging assumptions and taking opposite views and doing as we've laid out, as we've discussed here, that's how you keep your orientation matched and aligned and that's how you can identify mismatches faster.
- 1:21:46Mark McGrath: Going back to your example, they can just act.
- 1:21:48Mark McGrath: That's the real value of red teaming, is the ability to keep the orientation dialed in, constantly learning, constantly adapting in order to thrive and improve the capacity for free, independent action.
- 1:22:04Steve Rotkoff: And to go back to where we started, the problem with MDMP is it ends on act.
- 1:22:08Steve Rotkoff: It never loops back.
- 1:22:12Brian "Ponch" Rivera: Yeah, I want to bring up a point there.
- 1:22:15Brian "Ponch" Rivera: A good planning process always has a feedback loop at the end of it.
- 1:22:21Brian "Ponch" Rivera: We call it assessment, it's called debrief and AAR.
- 1:22:23Brian "Ponch" Rivera: Debriefing is part of your plan.
- 1:22:27Brian "Ponch" Rivera: It's the most important thing you can do right, and that's why feedback loops, according to neuroscience and some of the folks that we've had on the show, James Gimmie and being one of them saying that feedback is a factor of 10 greater than feet forward.
- 1:22:43Brian "Ponch" Rivera: So I agree with you 100%.
- 1:22:45Brian "Ponch" Rivera: Yeah.
- 1:22:46Mark McGrath: That makes sense Absolutely Well, steve, we've loved this.
- 1:22:50Mark McGrath: We've enjoyed this.
- 1:22:51Mark McGrath: We'd love to have you back because I think that we could go in several different directions and maybe even boil down on some of the techniques that we could continue to help individuals and teams with, as they look to thrive in complexity and now it's really in line.
- 1:23:11Mark McGrath: Thanks for sharing the story, too, about the School of Fort Leavenworth sitting majors.
- 1:23:18Mark McGrath: We hope that there's a good model of people going to a school to learn that they could go back and, as you say, spread the virus and a lot of the things that we've talked about on no Way Out with various things like fighter weapons school either, both in the Air Force and in Top Gun.
- 1:23:36Mark McGrath: Maybe we'll be close with.
- 1:23:39Mark McGrath: Do you have any good success stories about those that went to learn red teaming and took it back to their home units that were the most successful in spreading the virus?
- 1:23:46Mark McGrath: Were there any techniques or ideas that made them more successful than others?
- 1:23:54Steve Rotkoff: Well, I mean, there have been several general officers that have really embraced this and then brought it into their units and brought UFMCS or UFMCS trained people back in to continue proliferating the program and unfortunately I'm having a senior moment, I can't get their names, but I will, I'll send them to you.
- 1:24:21Steve Rotkoff: But a lot of them retired as four star generals and they engaged with red teaming at every step along the way.
- 1:24:29Steve Rotkoff: They got introduced to it as Michael Tennant-Colonels and then they continued throughout.
- 1:24:35Steve Rotkoff: So in their organizations there's been some spreading of the virus.
- 1:24:41Steve Rotkoff: I still I get notes from people all the time that went through school and say hey, I just want you to know I still use this and you know it really made a difference in my life and how I think and all that kind of stuff.
- 1:24:54Steve Rotkoff: There can be a downside, I will tell you.
- 1:24:59Steve Rotkoff: Frequently my wife turns to me and says stop red teaming me.
- 1:25:03Steve Rotkoff: So, so, so you have to use it when it's appropriate and let it go when it's not.
- 1:25:09Steve Rotkoff: So, guys, I have another appointment.
- 1:25:13Steve Rotkoff: I was great talking to you.
- 1:25:16Steve Rotkoff: Thank you so much for inviting me and I look forward to hearing from you again.
- 1:25:20Mark McGrath: Yeah, we'll look forward to having you back.
- 1:25:21Mark McGrath: Thanks again for your time, Steve.
- 1:25:23Mark McGrath: We really appreciate it.
- 1:25:24Steve Rotkoff: Take care Bye.