Latest / Identity at the Center / #386 - InfoSec World 2025 - CISO Tradecraft for IAM
Transcript
- 0:04This is identity at the center. Welcome to the Identity at the
- 0:11Center podcast. I'm Jeff, and that's Jim.
- 0:12Hey, Jim. Hey, Jeff, how are you?
- 0:14Not so bad yourself. Hey, good man.
- 0:16We're in the land of the Mouse. Yes, Mickey Mouse.
- 0:20And we're at influence SEC World 2025, you see from the
- 0:24background banner. Yep.
- 0:25So we've got a little recording booths.
- 0:27It's out on the Expo floor and I've had some great conversation
- 0:31already. One thing that you can be sure
- 0:34is clear is that identity is identity, and the world of
- 0:39identity is on the mind of the information security
- 0:42practitioner. Yeah, well, I don't think, I
- 0:45don't think you can avoid that in any specific way.
- 0:47And it's everywhere. You could say it's at the
- 0:49center, you know, like some podcasts.
- 0:52Yeah. So shout out to Shirley from
- 0:53Cyber Risk Alliance for, you know, helping us out, getting
- 0:56this set up. Shout out to RSM for sponsoring
- 0:58or partnering. I guess just I don't the way
- 1:00where it is, but you know, having us out here.
- 1:01So, you know, that is our day job.
- 1:04The podcast is the night and weekend stuff.
- 1:06But it's very cool to come out this conference.
- 1:07First time I've been to this conference.
- 1:09So I'm kind of taking it in a little bit.
- 1:11And I will say it's going to be very distracting for you as I'm
- 1:14talking to you because as I look past you, there is a company, I
- 1:19won't name them just in case people aren't into it, but
- 1:21they're all wearing like witch's hats and wizard hats.
- 1:24It's like a trick or treat theme.
- 1:27And so I know I'm going to be looking at that as I look past
- 1:30you for this episode. So if I you know.
- 1:33Just think of it as your family reunion over there and then.
- 1:36Yeah, right. One of the things that was very
- 1:39cool as we came out here and Ross, who enters here a second,
- 1:43you know, came up to me and said, Oh, I got a podcast.
- 1:45I know we have a podcast too. And we just started talking and
- 1:47then we realized like, Oh my gosh, like so the podcast is CSO
- 1:50tradecrafts. We've got Ross and we've got
- 1:53Mark G Mark the the OG Mark. I don't have an O in there.
- 1:58It's that, it's that Irish. But the O is not at the
- 2:00beginning. All right, so G Mark and they
- 2:01have a podcast. It's called CSO, trade calf,
- 2:03CITO trade calf.com. And we were started talking and
- 2:07saying, Oh my gosh, like we all, we're using the same tools.
- 2:09We have like very similar formats.
- 2:11You guys have been going weekly for like 5 years.
- 2:13Like there's a lot of parallels here.
- 2:15And so why don't we just go ahead and start there.
- 2:18So we're also, I'll start with you since you're in my line of
- 2:21sight. So tell me a little bit about,
- 2:23first of all, how did you get into information security?
- 2:25And then tell us what about the podcast?
- 2:27How did you, you know, get that thing going with AG Marker?
- 2:30Yeah, so I'm one of those people who always wanted to be in
- 2:33cybersecurity. I I used to say I want to be the
- 2:37guy that when the Chinese go to sleep, they're thinking about me
- 2:39at night time, right. And, you know, it's just the
- 2:43coolest thing. I grew up in Las Vegas and
- 2:46there's magicians there, so they're always doing magic
- 2:48tricks. And when I learned how to start
- 2:50doing hand hacking and pen testing, it's kind of the same
- 2:53way. Like, you know the trick and so
- 2:55you know how it works, but anybody else, it's just like
- 2:57magic. Like, Oh my gosh, you could do
- 2:59that, you know. And so that was the thing I went
- 3:01and I studied computer science. I got an MBA in cybersecurity
- 3:05and I did this program called Scholarship for Service where
- 3:08they said, Hey, we will pay your master's and pay you go to grad
- 3:11school if you just work for the government.
- 3:14I said, sounds amazing because I want to go to NSA or CIA and be
- 3:18a nation state actor. And that's what happened.
- 3:21So I had a, a fantastic career and years later I decided to,
- 3:25you know, share some of this tradecraft back and G Mark and I
- 3:29started a podcast five years ago.
- 3:32So what was the like? Why was it that was like, oh, we
- 3:34should start a? Podcast So I was at Capital One
- 3:38and I was a director and then I took a job as a CSO at
- 3:42Caterpillar Financial and all my friends were like, how do I copy
- 3:47paste what you just did? Right?
- 3:49And so I had the same conversation over and over and
- 3:52over and I was like, I need to just record this once as a
- 3:56podcast and then say hit play, right?
- 3:58Why do I need to have this in 45 minute?
- 4:01And so G Mark, he was the SANS instructor on cybersecurity
- 4:05leadership. So I said that's who I want as
- 4:08my Co host. And I kind of, you know,
- 4:11finagled him to come join me. Well, he had something about me
- 4:13having a face for radio, so you. Definitely have a voice for it,
- 4:16that's for sure. You've got great pipes as you
- 4:19say in the BIV, so let's find out about your background.
- 4:22He mentioned the SANS instructor, but how did you get
- 4:24into INFO? In cybersecurity, my first full
- 4:27time job doing cybersecurity, I'm going to date myself here
- 4:30because, well, nobody else will. 1976, got hired by the state of
- 4:33New York to plug all the holes in all the high school kids and
- 4:37punch in their systems, of which I was probably the Finder, about
- 4:3980 or 90% of them. Just saying.
- 4:41But I don't want to be one of the good guys.
- 4:43I always want to be the person who went ahead and made things
- 4:45work, not the person who broke stuff.
- 4:47And so after that went on, sold my soul for my college degree,
- 4:51took a Navy ROTC scholarship to Northwestern, the degrees in
- 4:54computer science and mathematics and then off to the fleet and
- 4:57then about five years into my Navy career.
- 4:59I mean, do for sure to her it's like, hey, I want to go to work
- 5:02for a three letter agency like NSA.
- 5:04So I was able to get a set of orders to NSA and then I got
- 5:09this call from Washington a couple weeks later from a
- 5:11detailer. The person owed your career
- 5:13saying, Lieutenant, what are you trying to do that says I'm
- 5:16trying to go to NSA. Well, why would you do that?
- 5:18I want to do computer security. Now here's a quote for the ages.
- 5:23The Navy has no need for computer security.
- 5:25You're going back out to sea. It's like, but this is what I
- 5:28want to do it. I got a short tour coming up.
- 5:30Well, then gave the big lie. If you take this job, kiss your
- 5:33career goodbye, you'll never promote pass Lieutenant.
- 5:35Well, detailers make their points by putting square pegs
- 5:40and square holes and round pegs and round holes.
- 5:42That was definitely the wrong shaped peg for that hole.
- 5:44So I was like, well, what do I do?
- 5:45I love the Navy, loves cybersecurity, but I can't
- 5:47apparently do both. So not being able to perceive
- 5:50what was true, it was not. I left active duty, went to work
- 5:53for Booz Allen Hamilton, stuck around in the reserves, and two
- 5:57years, six months after I left, I started National Security
- 6:00Corporation named after the job I could never get.
- 6:03So here we are many years later and have continued to the
- 6:06cybersecurity stuff. And as Ross and said, this is
- 6:09our opportunity to go ahead and help a lot of other people with
- 6:11their careers because you get to a certain point where you're
- 6:13going to give back phase of your career path.
- 6:15And I'm trying to see what can I do to help the next generation
- 6:18of cybersecurity experts not just know the technical merit of
- 6:22things, but how do they navigate their way through their
- 6:24technical part of their career, through their management years,
- 6:27into their leadership years, and ultimately become enough
- 6:30political awareness to be successful as a sea level?
- 6:33She mentioned the P word plot. Politics comes up everywhere.
- 6:37And yeah. And it's something that people
- 6:40have to deal with. So I got to ask that Navy person
- 6:43that told you there was no career there, did you ever touch
- 6:46base with that person again? No, and it's probably just as
- 6:49well because there was a guy who was a year behind me who also
- 6:54spent five years at sea, who also put in for orders for NSA,
- 6:58but if you will, drank the kool-aid and change career
- 7:00patterns to cryptography or cryptologists.
- 7:03What cryptologists back then wasn't really breaking code.
- 7:05You're sitting there listening to the Soviet Union and then
- 7:10years later that became cyber. Well, the guy who was a year
- 7:12behind me was Mike Rogers and Admiral Mike Rogers retired as a
- 7:17director of NSA. So they had a 12 month jump on
- 7:19the guy. Not that he could have done what
- 7:21he did because a lot of it has to do with politics.
- 7:23You'll you'll make it to captain or Colonel on leadership skills,
- 7:27you make it to Admiral or general on political skills.
- 7:30And that's something that at the time I was just not good at.
- 7:32I'm probably still not very good at it, but I recognize that as a
- 7:35weakness. So it's kind of one of the
- 7:37things we put out to our people is that if you don't like
- 7:39politics, don't aspire to a job that requires it.
- 7:41You'll be miserable every day. So you guys talked to a lot of
- 7:46Seesos. Russell, start with you.
- 7:48I do you guys have a lot of seasons on your show and what is
- 7:52top of mind for those folks right now?
- 7:55Yeah, we we definitely bring in a lot of seesos.
- 7:57We bring in a lot of people with industry expertise.
- 8:01I would say right now there's a couple of things that are top of
- 8:04mind. The first thing I would say is
- 8:06AI security. You know, how do I secure my
- 8:08MCPS? How do I make sure my employees
- 8:11aren't uploading sensitive data to ChatGPT?
- 8:14How do I think about the models in my tools?
- 8:18Are they corrupted? Are they good?
- 8:20A lot of that is being talked about.
- 8:22And the other thing I would say is identity is also a big thing.
- 8:27You know, certainly if we look at the Verizon data breach
- 8:30report, it's the number one most attack thing, but also the deep
- 8:33fake. How do I actually know what to
- 8:35trust when I see a video of my CEO with a girl?
- 8:40Was it real? Was it true?
- 8:42I don't know. And how do I defend that?
- 8:44And things like that I think are also starting to come up more
- 8:47and more. Yeah, I think it's really
- 8:49interesting this the whole AI can learn to remember, we'll get
- 8:52into that. But even in the identity space
- 8:54you talk about there's AI for identity and then there's
- 8:58identity for AI. So that makes it kind of
- 9:01interesting is like two different angles.
- 9:04You can't just use the term AI for everything, right?
- 9:07So G Mark, do you have anything to kind of add to that in terms
- 9:11of what's top of mind for Cesar's right now?
- 9:14Yeah, I think there's a lot of concern that people are looking
- 9:16at their careers and we hear that, oh, there's millions and
- 9:19millions of cybersecurity jobs unfilled.
- 9:22Yeah, good, go try to find one. But we're also finding when you
- 9:25talk about AI in those careers is that there's a lot of
- 9:28pressure from organizations to control costs.
- 9:30There always is. But now they're saying don't
- 9:32hire any junior people, just turn over to AI.
- 9:35What we run the risk of is creating a vacuum in our career
- 9:39pattern where there's going to be one or two or north years of
- 9:42few to no people so that when you need them at year 3:00 to
- 9:455:00 to 7:00 to 9:00 and let's say I get super, super
- 9:48complicated, they're not going to be there.
- 9:50And the other thing is Ross was talking about, it was identity.
- 9:53And you know, you talk about identity at the center and also
- 9:55assert that identity is your new perimeter because you can't rely
- 9:58on a firewall to say everything is behind the firewall.
- 10:01It just don't get behind that because everything is
- 10:03distributed and ultimately the attackers are saying, yeah, your
- 10:06technology is pretty good. Zero days are pretty expensive.
- 10:08But boy, if I could become you for a day and look at all the
- 10:11damage I can do. And then as Ross had mentioned,
- 10:13with the deep fakes and some of the really quality tool sets
- 10:16that are out there, as I see. So I'm not so worried about the
- 10:19technology breaking as I am my people holding the door open for
- 10:22the bad guys because they didn't know any better.
- 10:24And it's kind of on us to make sure that everybody realizes
- 10:27just what those capacities are out there.
- 10:30And I'll just share what Oh. Go ahead.
- 10:32And I'll just share one more thing that I thought was really
- 10:35interesting about identity. I Ann's just released a paper on
- 10:39their on their blog where they showed the cost of identity
- 10:42between a small and a medium and a large company.
- 10:45And there were no economies of scale.
- 10:48That means if you're a Fortune 100 or Fortune 500, you're
- 10:52paying more per person to do identities than a small company.
- 10:56So there's a lot of opportunity to innovate because it shouldn't
- 11:00get more expensive, it should get cheaper.
- 11:02I. Have a son who's a junior
- 11:06cybersecurity major and I remember telling him like,
- 11:09there's so many jobs. There's more jobs than there are
- 11:13people. Is that still true?
- 11:15Because I think his generation is starting to get the message
- 11:18that AI is going to take all the jobs that people like you are
- 11:22going to school for. You can still get a job sweeping
- 11:25floors or about the thing and and I mean that kind of
- 11:28flippantly, but that point is this is we take a look at what
- 11:31are the skill sets that are being replaced by AI.
- 11:34What is it good at? It's good at, if you will, what
- 11:37we call cognitive processes, processing data and coming up
- 11:40with an answer. It's good for doing mathematical
- 11:43calculations that are need to be precise, but you're doing lots
- 11:45and lots a lot for them. It's good for tedium where
- 11:48things like that, you go right down the list of all the things
- 11:50that we look at that kind of fall within the area of
- 11:54cybersecurity and we go that's a little bit concerning as
- 11:58compared to being a plumber or Carpenter or somebody that's out
- 12:00there. Physical proximity and the
- 12:03ability to interact with physical devices is going to be
- 12:07one of the last frontiers for AI, OK?
- 12:09You're not going to see a terminated robot out there with
- 12:11a hammer and a bunch of nails working on your house anytime
- 12:14soon. And so the concern therefore is,
- 12:16is that if somebody is a junior and senior and then like, where
- 12:20are the jobs? Of course, the first source of
- 12:22retreat is dad. I want to go to grad school.
- 12:24I can put off reality for another year.
- 12:26So get prepared for that. Introduce them to the concept of
- 12:29scholarship for service because it's a good alternative to
- 12:32paying for it by mom and dad. But the other one is, is that
- 12:36somebody needs to be able to own these things going forward.
- 12:41There's a generational gap. We find out that.
- 12:43But when you get Gray hair or your forehead becomes A5 head
- 12:47and you get on in years that you're not thinking about
- 12:50technology of the same way you used to when you're young, you
- 12:53tend to willing to be embracing new ideas.
- 12:54You're going to try more and you're willing to fail more.
- 12:57You have less at risk. You can fail spectacularly at
- 13:00your job at age 21 and recover at age 21 and three months, but
- 13:05try doing it at 50 or 60 and lose everything.
- 13:08It's a little bit harder to start over at that point.
- 13:10So I think what you're going to find then is the way that you'd
- 13:13portray yourself going into the job market is make the lack of
- 13:18years of experience and asset. I'm not beholden to any old
- 13:22ideas. Things are changing very
- 13:24rapidly. Years ago I wrote G Mark's Law
- 13:27as a corollary to Moore's Law, half of which you know about
- 13:30cybersecurity will be obsolete in 18 months.
- 13:33Anybody who had a Windows 10 machine, guess what?
- 13:35Last week, and if you go back 2 cycles, 3 years, nobody was
- 13:39doing prompt engineering, nobody's doing chachi.
- 13:42It just wasn't there yet. And then you go another 18
- 13:44months from now, another 13 months.
- 13:46So it changes very, very rapidly.
- 13:47So the hiring managers are going to be using an old metric saying
- 13:53dollars per person is programmers per the by the
- 13:58pound. You need to convince the
- 14:00management that you need a different metric.
- 14:02And a different metric is somebody who could think at the
- 14:05speed of the evolution of the technology, can adapt to that
- 14:11and is willing to go ahead and put the time and effort into
- 14:14mastering new technologies. Even if it dead ends, you
- 14:18haven't dead ended the career of a senior executive vice
- 14:21president and this person can still dust themselves off and
- 14:24said, well, I just learned a whole bunch of things that will
- 14:26be very applicable someplace else.
- 14:27So just never give up on yourself.
- 14:30But it's tough to find a job that will let you do that,
- 14:32especially as a entry level person, let's say into the
- 14:35market, right. It's your your leaders who are
- 14:38bringing those people in need to encourage that sort of fail
- 14:41fast, learn things, etcetera. There's always the federal
- 14:44agent. I mean, I, as I said, I sold my
- 14:46soul for my college degree with an ROTC scholarship.
- 14:48Now when you go in the Navy, it was my choice.
- 14:51All of a sudden you find yourself.
- 14:52I remember an old recruiting poster, it said be on the board
- 14:55of directors at 22 and it showed a destroyer wardroom of about
- 14:59the fourteen officers sitting around the table and merely a
- 15:01couple of junior officers there. I didn't have any college debt
- 15:05coming out of my undergraduate because the Navy had paid for
- 15:07that. I had a guaranteed job and
- 15:09people who, for example, do scholarship for service.
- 15:11I've spent nine years working on the Advisory Board for National
- 15:16Cyberwatch, and what we did is we aligned the curriculum from 2
- 15:19year schools to four year schools so that you could go to
- 15:22a Community College for two years, then go on to a four year
- 15:24school like Hopkins, have 100% of those credits transfer to go
- 15:29over to Hopkins without having to retake courses.
- 15:32And oh by the way, if you scholarship for service to pay
- 15:34for the latter 2 years, you then have a guaranteed job of the
- 15:37federal government. You're going to probably now, at
- 15:39the end of that cycle, have an associate's degree, a bachelor's
- 15:42degree, two years of job experience, most likely one or
- 15:45two certs of the security world and 0 debt.
- 15:49And that, I think is the master recipe for being able to move
- 15:52forward and not worrying about it because there will always be
- 15:55requirements for expertise in the military and in civil
- 15:59service as you get closer to the top.
- 16:02The pay isn't all that great, but when you're 22 years old and
- 16:05you can live in a dorm room, what's the difference whether
- 16:08you're making X or 1.3 X? It's still your life and you'll
- 16:12be fine. You've got punt.
- 16:13Grab that experience and go with it.
- 16:15It's very fungible later on. So let's take it back to the
- 16:19CSO. Where does identity fit from a
- 16:23ranking perspective with CSO's? You know, Ross, like when you're
- 16:26talking with folks, is identity the first word that comes out of
- 16:29the mouth? Is it the second, third?
- 16:31Does it not come out of certain mouths?
- 16:33Like help me gauge where CSO's are at today when it comes to
- 16:36identity? So it's not as high as as you
- 16:40think AI or product security is. But at the same time, I've also
- 16:45seen a shift over the last five years where identity may have
- 16:49belonged to the network or the help desk team now squarely
- 16:54falls under the sea. So it's one of the pillars along
- 16:57with GRC and product security in the sock.
- 17:00So I think there's going to be a lot of discussions of how do we
- 17:04MFA all of the things, how do we protect against stolen
- 17:08identities and customer fraud. But I would probably put it as
- 17:13like 1/8 priority on the list of priorities for Cesos today
- 17:19occur. Identity you looking for yes or
- 17:25no and there or maybe yeah, all these equivocate, right.
- 17:31But I was talking to one of the vendors over here a little bit
- 17:33earlier and they had their little authentication card.
- 17:37Oh, great little car. All the certs said how many
- 17:39certs does it store 30. I said if I go to my Microsoft
- 17:43Authenticator, I have more than 30.
- 17:45And this is the BAT phone and my regular phone here I've got
- 17:48another 20 some odds. So between these two I've got 50
- 17:51different identities that I have to manage and those are just the
- 17:54ones that I've been able to enable MFA for.
- 17:56And so our identity becomes extraordinarily important is any
- 18:01system that is critical. And I would say any system
- 18:03period that you're going to touch, you ought to have some
- 18:05sort of MFA involved. Why is that important?
- 18:09Because passwords can be socially engineered.
- 18:13Somebody goes ahead and can create an artificial identity
- 18:17that looks like the CEO or looks like the help desk or whatever,
- 18:20and people cough things up. Phishing campaigns, vision
- 18:23campaigns, mission campaigns and the like.
- 18:26All those combined to do what? Single factor authentication,
- 18:29saying my identity consists of an ID and a password doesn't
- 18:34work anymore. And we have something, you know,
- 18:38something you are, there are something you have, but we have
- 18:42a fourth identity factor has to do with those little GPS things
- 18:47up there someplace you are. And now I can go ahead and say,
- 18:50wait a minute, you're trying to log in from Romania, but 5
- 18:54minutes ago you were in Orlando. That's sort of impossible
- 18:56travel. And that's on a factor that I
- 18:58should consider. So I think we're extending our
- 19:00concept of what identity is to include a number of factors that
- 19:04have to be thought about because attackers are going to try to
- 19:07get around the controls. They've realized their technical
- 19:09controls are getting pretty good.
- 19:11You're not going to go ahead and find a dozen 0 days anytime
- 19:14soon, but boy, can you go ahead and convince the user to hold
- 19:16the door open for you digitally. You win.
- 19:18So I think that identity is a big target for attackers and it
- 19:22has to be one of the things we defend the most.
- 19:26Having heard that, do you want to jump back in?
- 19:28Because I was thinking as you were saying, your answer is, I
- 19:30think you said like 8th, right? It's kind of on the list.
- 19:33Is that also maybe because the seeso might be thinking that
- 19:37they're good enough at it from an identity standpoint where
- 19:40they do need to focus on other things?
- 19:42I think there's things that are top of mind for a seeso like how
- 19:46do I get my budget approved? What do I do for AI security and
- 19:51and those are right now top of mind for where I would put
- 19:54things. Now, where there's some novel
- 19:57space is is, I would say, agents.
- 20:01How do we trust an agent and what level of capabilities do we
- 20:05give that person? Is it going to be the same as a
- 20:08human or are we going to really limit that agent and not give it
- 20:13the full permission? So that may be something that's
- 20:15that's kind of up there. The other thing that I would say
- 20:18is is kind of a nightmare is not the human identity.
- 20:21I think, you know, the Pam systems do that pretty well.
- 20:25It's the non human identities and when you look at the
- 20:28numbers, there's something like 40 non human identities, laptop
- 20:32servers, AP is all of those things that require permissions
- 20:36and it is very much the wild Wild West.
- 20:39You go to a Fortune 500 company, say tell me how many non human
- 20:43identities you have. Show me how that's being
- 20:45governed and I think you will just it, it, it's perfect for
- 20:50Halloween. I, I think that's just maybe
- 20:52what we should dress up as, right?
- 20:54Trick or treat, here's the, you know, bazillion machine and non
- 20:57human identities in your organization.
- 20:59Good luck. Well, fully you've got workforce
- 21:02identity, customer identity, you've got the non human
- 21:06identity. It's like this space keeps
- 21:09getting bigger and bigger and more and more complicated.
- 21:11I mean, I feel sometimes like we're identity practitioners,
- 21:15we've devoted our careers to understanding this space.
- 21:19And sometimes it's like overwhelming to me.
- 21:23I'm wondering like, how is it for Caesars?
- 21:25Are they overwhelmed by it? Do they do they have their arms
- 21:28around it? And then I kind of tangential to
- 21:32that, I feel like a lot of sees a lot more Caesars are coming
- 21:36from identity backgrounds into Seeso ship.
- 21:40Are you seeing that as a as a real trend?
- 21:43I, I haven't seen it as much because identity and having a
- 21:46deputy CSO and identity is, is still pretty new, probably five
- 21:51years or less. So we just haven't seen that,
- 21:53that those folks come in. Now certainly if you're going to
- 21:56go to a network company, let's say you're going to be the head
- 21:59of a Cisco as the CSO there. I absolutely think something
- 22:03like that would be extremely important.
- 22:05Historically, we've seen more CSO's come from the GRC side
- 22:09because you're a highly regulated bank and you need
- 22:12someone who understands all that compliance or you have someone
- 22:16who grew up in the SoC and it's a post breach scenario.
- 22:20Hey, our company just had a bad issue.
- 22:22We need to bring someone in who can fix this and don't let it
- 22:25happen again. Now.
- 22:27Now behind the scenes identity may be the most important thing
- 22:30to implement, but historically they brought, you know, the head
- 22:33of a SoC who understands that clean up and and that may be
- 22:37something that changes in the future.
- 22:40You too Mark, do you think that Csos have a comfort level with
- 22:44identity or they come more and more from an identity
- 22:46background? I think at the end of the day,
- 22:50most Csos make decisions based on what's in the best interest
- 22:54for themselves and their own careers.
- 22:56Now you're not trying to be saying it's self-centered, but
- 22:58let's think about it. You're not going to go ahead and
- 23:01do something very risky without a very good reason because
- 23:05otherwise, like, all right, sorry you lost your job.
- 23:07Now I think one of the other talk presenters is talking about
- 23:10how when the Fortune 500, the Sisos are playing musical
- 23:13chairs. You move here, then two years
- 23:15later you're there. And two years later, I got a
- 23:16buddy of mine has been a Siso 8 different times.
- 23:19Anything like, wow, I can't hold down a job.
- 23:21Well, he's actually adding value every place he goes.
- 23:23So why am I bringing that up? Because when you look at things
- 23:25such as identity, if it's something you understand, it's
- 23:28something that you know, you're something you're comfortable, if
- 23:30you'll make decisions accordingly and you'll feel that
- 23:32this is going to go ahead and preserve where I am.
- 23:35And of course, career wise, it helps out.
- 23:37But if you don't understand something, then you either look
- 23:41for an expert to help you or you try to gain the knowledge
- 23:44yourself or you ignore it. Well, number 2 is difficult
- 23:48because as a see so you got way too many things to be doing.
- 23:51And so you go back to #1 or #3 as Ross was saying, the concept
- 23:54of having a deputy see. So for identity, fairly new and
- 23:57not fairly prevalent. And the last part is like, well
- 24:01do I just ignore it and hope it goes away?
- 24:03And and what I would say is a proxy for who's going to be the
- 24:07next CSO usually is head count. So if the identity team is 10
- 24:12people, but the sock is 50 people, that deputy CSO over the
- 24:16sock much more likely to get promoted into that CSO role than
- 24:21the smaller team. That's a that's that's a really
- 24:25interesting look at I you're absolutely right.
- 24:27I don't know why I didn't think about it that before, but yeah,
- 24:29that's that's the way it works. So let's stay with that track of
- 24:32money. So Seesos, they're a constant
- 24:36being pitched projects by either themselves, the rest of the
- 24:40organization or parts of their information security, you know,
- 24:42organization. What are some tips that, you
- 24:44know, people listening to this are probably an identity, just
- 24:48probably, right? We're not on Netflix, so I'm
- 24:50assuming they're identity perfection, you know,
- 24:51practitioners. Hey, come over to the dark side
- 24:53with identity. We've got cookies.
- 24:55That's right. So how do those people make
- 24:58those pitches to see So's or maybe other parts of the
- 25:03organization that control funding?
- 25:05I want to invest in this program or project or technology to
- 25:10solve for this issue. How do they make that that
- 25:12investments up? Why do I make any investment?
- 25:16Because it's either is going to improve my return on investment,
- 25:21that's what the NBA's want, or it's going to reduce my risk,
- 25:24which indirectly improves my return on investment.
- 25:27The hard part and return on security investment or ROSI,
- 25:30it's like return on seat belt investment.
- 25:33Hey, I put my seat belt on every single time I drive a car.
- 25:36Been doing that for many, many years.
- 25:38It's never saved my life. Why do I keep doing it?
- 25:42Because in the event of some low probability, high impact event,
- 25:46it's going to save my life. It's not the click it or ticket
- 25:48marketing that's doing that. I'm not.
- 25:50Worried about the plate? Yeah.
- 25:51On the other hand, yeah. You're worried about the officer
- 25:52friendly pulling you over there. And hey, Sir, if I gave you one
- 25:55of my beer models, we call it even.
- 25:58But what we take a look at then is if I can't educate the CSO
- 26:02because he's too busy, can we then do it incrementally?
- 26:07And what do I mean by that? One of the things that Ross and
- 26:09I have built with the Cecil Tradecraft podcast, which as you
- 26:11said, we're done with five years, 256 episodes, is we've
- 26:15created bite sized chunks of knowledge that are what we
- 26:19consider high nutritional value. There's no marketing flop in
- 26:22there. We don't keep talking, just that
- 26:23we still got another 37 minutes to go to fill out the podcast.
- 26:26We're done, We're done. But the idea there is that we're
- 26:28trying to create a place, a watering hole if you will, for
- 26:31CSO's to not in the negative sense of watering hole where you
- 26:33go ahead to mail her, but you get smart and you're a little
- 26:36bit smarter every day. So for somebody trying to get
- 26:38their CSO or the executives to understand why they should fund
- 26:41identity, help them get smart a little bit at a time.
- 26:44It doesn't mean you can't sit them down and make them listen
- 26:46to an 8 hour seminar, but 3 minutes here, 5 minutes here, a
- 26:50little discussion there, and make it around how it provides a
- 26:54better return for the business and an alternative investment.
- 26:59What would happen if somebody like the CFO believed that the
- 27:04CEO told her to transfer $8 million for a special private
- 27:08acquisition that nobody's supposed to know about?
- 27:10And here's the data for this bank over here in Asia.
- 27:15Well, that could be very expensive if it goes sideways.
- 27:17And now you can demonstrate that with some of the deep fake
- 27:20technology to say, watch this. Would you believe it?
- 27:24Well, there's even the story of Esther, I think it was Malaysia,
- 27:26right, with the bank that got hit by 25,000,000 because now
- 27:29this was in my mind very clearly targeted because it was, you
- 27:33know, this poor person joins a call, teams call with the board
- 27:36or something. And every single person on that
- 27:38call was not a real person. Clearly that's targeted, but
- 27:42that just shows like it's getting easier to pull that off.
- 27:44It's. Getting harder and harder to
- 27:46detect that. So it used to be he said, hey,
- 27:47if you're a fake, put your hand up in front of your face.
- 27:49Well, now the deep fakes can do that.
- 27:51So Lavis when I started said, hey, draw it.
- 27:53If you're doing like an interview, for example, you want
- 27:55to make sure this person's not from DPRK, draw a smiley on a
- 27:58piece of paper and hold it up. Well, AI hasn't quite figured
- 28:01that out, but it will. So you ideally what it comes
- 28:04down to is to have either unpublished knowledge, this
- 28:12shared mutually or what to call like a code word.
- 28:14What do we mean by that? Hey, what do we have for dinner
- 28:17last night, Ross? I'm not.
- 28:18Well, I yeah, maybe you're not, Ross, but if we said yeah, we
- 28:24just grazed the buffet and we starved a whole bunch of free
- 28:27food from the vendors, Yeah, that's what we did.
- 28:29But another reason why nobody wants pictures of their food on
- 28:31Instagram, because now you can social engineer and say, OK,
- 28:34well, now I know what Ross had for dinner last night.
- 28:36I'm not saying you do that, but. Might be an interesting point.
- 28:38So what we find then is that the sources of where these dangers
- 28:41are coming from are ourselves, as you had indicated.
- 28:45Hey, yeah, here's my dinner, here's on the Facebook, here's
- 28:47what I'm doing, here's my whole life story up here.
- 28:50Here's my home address and things such as that.
- 28:52And then we'll be fine then. And put yourself up on LinkedIn
- 28:55or on Facebook or one of the other identity sharing pages.
- 28:59And I'll use that term specifically is that it makes it
- 29:02easier for adversaries as well to salt your data, throw a
- 29:06little bit of fake stuff out there so you know that a person
- 29:09who knows you would not use assaulted data, but somebody who
- 29:12doesn't know you would like. Oh, yeah.
- 29:14Well, we went out for such and such, OK.
- 29:17I'm 6 feet 2. Salted right there, child.
- 29:20Named Rudolph the Reindeer. Ross, let me ask you a question
- 29:23around that, that idea of getting funding.
- 29:26If I am, let's say starting out and I've been brought in to kind
- 29:32of kick start the I am program for an organization, what are
- 29:35some of the questions that I should be asking myself to be
- 29:38able to make that case to a cease service?
- 29:39OK, it's risk related or it is return on investment, I don't
- 29:44know yet. How do I figure that out?
- 29:46So I think there's only two real reasons you get something
- 29:49funded. 1 is risk reduction and the other is compliance.
- 29:54And I'll just give you the example of compliance.
- 29:57First, there are standards like if you're a bank, you have to
- 30:00meet the New York Department of Financial Services, which is
- 30:03going to require MFA for all sorts of things.
- 30:08I don't really get a choice. I don't want to wear an orange
- 30:10jumpsuit. So I'm going to do compliance to
- 30:12make sure that law is satisfied, especially when I'm the CSO
- 30:16signing my name off on that. So if somebody says we have to
- 30:19do it, that's that's Tier 1 of what gets funded.
- 30:23The second thing is risk reduction.
- 30:25So I would always go and look at things like the Verizon data
- 30:29breach report and say, what are the most common attacks that we
- 30:33see? Because chances are we're going
- 30:36to get a little bit more of last year.
- 30:39Yeah, there's going to be something new next year where an
- 30:41AI agent happens to go rogue. But I guarantee if phishing and
- 30:46stolen session credentials and those things are bad last year,
- 30:50we're probably still going to see a huge overlap this year.
- 30:54So then I have to say, well, what am I going to do when my
- 30:57employee goes to a random web page, gives up their username,
- 31:01gives up their password, gives up their MFA challenge code?
- 31:05How did I still keep the company safe?
- 31:08Do I have Microsoft conditional access policies?
- 31:11Do I have, you know, really good allow listing on the firewalls
- 31:15that that come say, oh, this wasn't from the corporate VPN?
- 31:18What is it I put as these layers of defense because one human got
- 31:23tricked? My whole company can't go down
- 31:26because one person fell victim to fraud.
- 31:30And that's how they usually start, right?
- 31:32So shifting gears a little bit, what are you hearing from your
- 31:36guests in terms of how they feel AI is going to impact
- 31:41cybersecurity in the years to come?
- 31:44Ultimately in cybersecurity, the desirable outcomes is to do
- 31:49things cheaper, faster and better than last year.
- 31:52So we know the bad actors are going to do things like use AI
- 31:56to write crafty phishing emails, use AI to auto exploit publish
- 32:01Cbes. We're going to have to use AI to
- 32:04safeguard our companies. That means, you know, start vibe
- 32:08coding to fix vulnerabilities. I know that sounds scary, but
- 32:12but imagine this. If you have 200 vulnerabilities
- 32:14and it takes you 30 minutes for each phone to fix it, that means
- 32:18you have to spend 100 hours. What developer can give up just
- 32:22over 2 weeks to go fix it? Probably nobody's has that
- 32:25luxury. But if AI vibe coding fixes that
- 32:28in 10 minutes, now I have the ability to go and start fixing
- 32:32things and, and I think that's the change.
- 32:35And we're going to also look at that on the sock.
- 32:38Hey, how do I automate the sock? Because if the bad guys can
- 32:41automate their scripts and I take a 15 minute coffee break or
- 32:44bathroom break, I'm not fast enough.
- 32:47I need to identify the sock operator.
- 32:49Every little thing is going to happen like that.
- 32:52And specifically to identity, if the business units is we're
- 32:56going to shift to just in time identity approvals, well, it
- 33:00better be just in time approved because I don't really feel like
- 33:04waiting, you know, a week for two people to approve my my
- 33:08ticket and sale points. So now I can actually get the
- 33:11access. So, so those types of automation
- 33:14tasks I think are really also going to be super important.
- 33:17Yeah, I'd make sure. She Mark, what did the Earth
- 33:19bill find for new gas? I think Ross has covered a lot
- 33:23of it. We see what we find out is AI is
- 33:25inspiring an arms race and the attackers can do more because
- 33:30we've democratized the specialized skills it takes to
- 33:34write really nefarious code. And now it doesn't take anything
- 33:39more than a free license and a little bit of prompt engineering
- 33:43to go ahead and get something that works.
- 33:45So Ross mentions vibe coding. OK, great, that sounds scary,
- 33:49but do it. If it gets you 90% of the way
- 33:51there, that's 90% better than what you had before, and you go
- 33:54back and then you can clean up the boundaries.
- 33:56And it's also prioritization as well.
- 33:59There's an awful lot of vulnerabilities out there that
- 34:01really aren't critical path for what's critical in our
- 34:03organization. I don't care if somebody steals
- 34:06the trash. I don't care if somebody reads
- 34:09all the garbage as long as it's not from the sensitive bucket.
- 34:12I'm glad you put that caveat in there because I was about to get
- 34:14it out. I know you're going to lie after
- 34:15that. I can see you squirting in.
- 34:16Your sage is ready to jump all over your your gas, right?
- 34:19And things like that coming over the top of the table.
- 34:22But ultimately what comes down to is understanding what is a
- 34:26business imperative. And the business imperative is
- 34:28to protect revenue, to protect the revenue, the processes that
- 34:32generate revenue. And therefore, we protect those
- 34:35processes that generate revenue by ensuring that these new AI
- 34:40tool sets, which can operate faster and perhaps more
- 34:44convincingly, are not going to be as effective.
- 34:47Because we've inoculated our users, we understand a little
- 34:50bit more about what's out there for the capability.
- 34:53We've automated some of our responses.
- 34:55So there's not time necessarily for a human in the loop.
- 34:58You don't need it. Take the first two or three
- 34:59steps, something that would least hold them at the Norway
- 35:03and said like, I think I got 1 and your dog's like, let it go,
- 35:06OK, fine, and it comes or throw it out.
- 35:09But if you just had nothing there, you're asking for
- 35:12trouble. So AI is here, and it's going to
- 35:15continue to progress. It's going to go at a very, very
- 35:17rapid rate, whatever we define AI to be.
- 35:20But think of it as a way to take deliberate processes, make them
- 35:26move a lot faster. Take things that normally
- 35:29require some cognitive process and make them available to
- 35:33people who don't think as smart as that and things like that.
- 35:37And then allow the nefarious people who are out there who
- 35:40could then distribute this out there to multiple places.
- 35:43If we're aware of what that threatened environment is, we
- 35:46can go ahead and better defend. Ross, you guys both brought up
- 35:49the vibe coding. What is your sense for how
- 35:53prevalent that is today? Is it like all coding is going
- 35:57through kind of a vibe guarding process now or is this somewhere
- 36:01in between, you know, 50% a hundred?
- 36:04What's your sense for how prevalent that that approach is
- 36:09being used? If we look at the GitHub state
- 36:13of the the developer report, what you're going to see is high
- 36:1780s to 90% of all developers are using AI assisted coding tools.
- 36:24And that number is only going to go up because it's all about
- 36:28effectiveness. If I can prompt query instead of
- 36:32write code from scratch and searching, I can write way more
- 36:37code faster. Now it's going to have pros and
- 36:39cons. It's going to write crap code
- 36:42and it's going to write good code and I have to be able to
- 36:44distinguish it. But the problem is the more I
- 36:47start to rely on it, the less I'm actually going to be able to
- 36:50code. I'm just going to say it doesn't
- 36:52look good. And when I look at that user
- 36:54interface, and if it does, hey, that's good enough for me,
- 36:58submit. If it doesn't, then you know,
- 37:01I'll just re prompt. So we're going to become Dumber
- 37:05in our ability to develop even though we write more code
- 37:09faster. So I think it's a totally
- 37:11different skill set it and now what we're going to have to do
- 37:14in cyber is we're going to have to ship the trust from the
- 37:17developers to trusting in the supply chain scanning of code as
- 37:22it goes through the CICD tools. How do I scan code for
- 37:26regulation adherence? Does this code meet the EEI app?
- 37:30Does that meet CCPA or HIPAA? And that's things we haven't
- 37:34really looked for in code. I I think that'll be the next
- 37:37generation of where code scanning and vulnerabilities.
- 37:40Go So does that leave a gap then, which I think is what you
- 37:44were maybe getting at earlier is you've got you're, you're
- 37:47missing sort of that middle career almost right where the
- 37:50people who came in, they spent maybe a couple years, five
- 37:52years, even 10 years, right, building up their skill set.
- 37:55And then now maybe they're in a leadership position if there's
- 37:58nobody in that funnel. And that was a problem we had in
- 38:01the military in 1990190293 fall of the Soviet Union.
- 38:07All of a sudden, like our pure competitor is gone.
- 38:10Like I remember seeing a joke ad that put in a, you know, in the
- 38:13ad it says wanted pure competitor who can go ahead and
- 38:16feel the Navy. You know, I'll apply at the
- 38:18Pentagon. It was like a help wanted ad.
- 38:22But as I recall, going to the Naval Academy that year and said
- 38:26we don't need this many new junior officers.
- 38:29If you've got your four year degree and you don't want to put
- 38:31on a uniform, just go in peace. They're like, really?
- 38:34I can leave. Yep, free education.
- 38:36Yep, out of here. And so it didn't go to 0 because
- 38:40then people said, no, this is what I really want to do.
- 38:42But we do that planning as senior leaders, we have to plan
- 38:4610 to 15 to 20 years in advance on the flow of what we do.
- 38:50And maybe we let a little bit more in than we need because
- 38:53we're going to have a requirement through natural
- 38:55attrition. Everybody who starts out at the
- 38:58beginning, by the time you get down to the point where you're
- 39:01like in the Navy or a captain, you've lost six or seven out of
- 39:04eight and you want to make one star, you're going to lose 199
- 39:07out of 200. So it gets very, very narrow at
- 39:09the top and you have to have that to select from.
- 39:12So short sighted HR and manpower policies that say let's replace
- 39:18people with AI, it's going to bite those companies, going to
- 39:21bite them hard. Now I'm going to have to go turn
- 39:22to somebody else as a source. So what that's going to be is
- 39:25that if you manage to get in now in three to five years, when
- 39:29everybody else realizes there's a huge vacuum and there's nobody
- 39:32out there, you can write your own ticket, but you got to talk
- 39:35your way in today. So maybe go to a company that
- 39:37doesn't understand, but then how to use AI and then you get in
- 39:41the pipeline and then make that your hobby because all of us do
- 39:44something in addition to our day jobs.
- 39:46Well, that's the whole point of being a subject matter expert.
- 39:48Now is how do you know that the AI isn't hallucinating, right?
- 39:51Making up facts. If you don't have that
- 39:54background, that skill set, that expertise, how are you going to
- 39:57make that determination? Well, it's interesting.
- 39:59You look at the hallucinations that I've found.
- 40:02The more precise, the more accurately you build your Proms.
- 40:07The less likely you are to get a hallucination.
- 40:10And if you understand how these large language models work,
- 40:13where they're just a mathematical correlation between
- 40:15tokens, tokens in this case usually being English words.
- 40:19So you feed it a few petabytes of the English language.
- 40:21You let it do unsupervised learning and it says, hmm, the
- 40:24word the often appears before cat, but it very rat rarely
- 40:28appears after cat. And this we appeared that that,
- 40:32that. And after a while you start
- 40:34getting these probability ladies.
- 40:35And then after a while you can say I can predict things.
- 40:38So what do you mean you can predict things if I say the word
- 40:41peanut, Peanut butter? It's a little bit like looking
- 40:45at the old Terminator. Bean Ming Ming Ming BB Be.
- 40:48Picked that out to peanut butter and peanut butter and Jelly,
- 40:51peanut butter and Jelly sandwich.
- 40:53And then we go, wow, it's writing something.
- 40:55But if we say try the next most probable thing, it could be
- 40:57peanut allergies are a problem for children and you pick
- 41:01another one and you get like peanut, the squirrel was killed
- 41:04by the New York State Department of Aggregate or whatever.
- 41:06And if we go far enough down these probability chains, you'll
- 41:10find change of thought that humans would have rejected
- 41:13immediately. I'm a little chess player and
- 41:15you got to know that by the time you get 20 moves into a game of
- 41:17chess, the number is spectacularly huge of the
- 41:20possible things. And yet you can play really well
- 41:22because you know how to trim that tree.
- 41:24You get rid of 99 point some number of nines, percentage of
- 41:27the things that don't make sense.
- 41:29AI doesn't do that. It ingests all of them.
- 41:32And So what we call a hallucination might be a 0.001%
- 41:36probability, but that's the highest thing that's left
- 41:40because it has no way of answering your question with
- 41:44those three magic words. I don't know.
- 41:48And if you have an AI model, unless you can prompt it to say
- 41:53any confidence factor below this number, I want you to always say
- 41:56I don't know. Never give me an answer below
- 41:59this. Well, you might get rid of a lot
- 42:01of hallucinations that way and you'll get some.
- 42:04I don't knows which should be better.
- 42:06And I do that when I go to Lake Lowe's and I'm looking for
- 42:07something, I say like, do you know where such and such it is?
- 42:10And I tell the guy and honest, I don't know.
- 42:11It's better than the wrong answer can.
- 42:13I can tell he's puzzled. He's like, yeah, I'm not sure.
- 42:15I says thank you for telling me you're not sure.
- 42:17Like people feel comfortable with not knowing and AI is not
- 42:20comfortable with not knowing. It's got to know the answer.
- 42:22Well, it's got to be a great product, right?
- 42:24And a great product doesn't say I don't know, at least in the
- 42:27minds of consumers. So we even think they're
- 42:29thinking about that. Should it be a tunable item,
- 42:31though, within these large diagonal models, whether it's
- 42:33Open AI or Enthropic or Google or Meta, whoever's building
- 42:36these things, should there be a setting somewhere that says only
- 42:41tell me if you're X percent sure?
- 42:44You might be able to prompt that in because what you have with
- 42:47the. Should I have to crop it in?
- 42:49Should I have? With the, with the AILM, here's
- 42:51the thing here, because if you take a really low probability
- 42:54thing, you might say, hey, this thing you just invented a new
- 42:56drug or it's discovered a way to fold the protein that nobody
- 42:58would have thought of before. It's because it's a .00001.
- 43:02It just happened to be right. It's like winning the lottery.
- 43:04Statistically, someone's going to win the lottery.
- 43:07Statistically, I will never live in the lottery.
- 43:09OK, I'm OK. You won by being on the identity
- 43:11I'm. Comfortable with both of those
- 43:13things. So when we look there at the
- 43:15LLMS and setting that threshold or whatever and saying can a
- 43:18user pick that? What you have is a problem
- 43:21called in band signaling. Now in band signaling is a
- 43:24problem, goes all the way back to John Draper AKA Captain
- 43:28Crunch and the old s s fives were being able to blow a
- 43:31whistle at 2600 Hertz and reset the connection.
- 43:35Because in band signaling means you inserted data into your data
- 43:38channel and it becomes executable as code.
- 43:41Thank you von Neumann for your model.
- 43:43In any case, what happens now is an AI you have in band
- 43:47signaling. That's what we call escapes.
- 43:51You can go ahead. Instead of it giving the data
- 43:53that it needs to come up with an answer, we're inserting commands
- 43:57because of the way it's designed to do in band signalling, and we
- 44:00have not yet perfected the way to separate the signal that's
- 44:04valid from the signal that's malicious.
- 44:06And that's really where the research needs to be done.
- 44:09And I guess they're trying, but I don't think the current models
- 44:12support that just because the way they're architected.
- 44:15So should it come with a minimum threshold?
- 44:17It does. It's zero.
- 44:18Should you be able to set it higher?
- 44:20I try it, I haven't tried it yet.
- 44:23Just go back to ChatGPT and any answer below .0001% or whatever,
- 44:27don't tell me. And then ask it some stupid
- 44:29question and keep doing that until you get a threshold where
- 44:31you get and I don't know, and then maybe you feel comfortable
- 44:33with. It Ross you've been looking on,
- 44:36do you have thoughts on this? Say the question one more time
- 44:39and then I'll. Keep.
- 44:42The second thing that goes with old age is your memory.
- 44:45I forget the 1st. Well, I guess, I guess my
- 44:48question is, is should the consumer, whoever the consumer
- 44:54is of AAI product that is using a large language model to make a
- 45:01statement, right or question answer a question?
- 45:03Or maybe should the consumer have the ability to tune it to
- 45:10say OK, if you're not sure to X percent, don't give me the
- 45:15answer because I have not seen that as a out-of-the-box
- 45:19configurable setting. Now can you prompt it?
- 45:21Maybe I haven't tried it, I will.
- 45:24I think you're. Right.
- 45:26I think you're right. I haven't seen that feature, but
- 45:28I'll give you a different view. If you were to ask ChatGPT tell
- 45:32me about X, it'll give you a text response.
- 45:36But if you ask something like perplexity to give you a thing,
- 45:40it will be like a college essay where it sites all of those
- 45:43things. I think that is going to become
- 45:46the new norm. You know, where I should be able
- 45:49to have a pedigree and lineage on everything and then I can
- 45:53actually go and verify. Now sure there may be a
- 45:56hallucination problem where it invents this thing, but if
- 45:59somebody does the due diligence and looks it up then you should
- 46:02be able to say wow this is from a trusted resource right?
- 46:06Yeah, that explainability, I remember the the early part of
- 46:09AI was, oh, here's just an answer, right.
- 46:11And then I don't know who started at first.
- 46:13I want to say Bing actually started to yeah.
- 46:17But at least in the AI world was like, oh, now you start to see
- 46:19these little numbers and asterisks and like, OK, it's
- 46:22starting to that. And now I'm seeing it almost all
- 46:24the AI products. I pull in the string shield
- 46:26back. I know that and it's getting
- 46:28better all the time, but I remember trying some girly stuff
- 46:30with some of the open AI products and it gave me a bunch
- 46:32of references and every last one of them was a four O 4.
- 46:36So it was hallucinating the references.
- 46:38So that's. Or worse, it's vibe coding its
- 46:41own answers, and all of a sudden it's a web page that looks real.
- 46:44Maybe the trick is we asked one AI to validate the other AIS
- 46:50output because that because they're, you know, then they
- 46:54have to be a syndicate if you really want to get past us.
- 46:56But you know, if Claude validates chat sheet PT and
- 46:59says, no, this is all hallucinated, that's probably a
- 47:02strong indicator. And you didn't have to do all
- 47:04that research, right? Or maybe you asked three AIS to
- 47:07say, do the first AI make something up.
- 47:10And if all three give you a thumbs up, now you've you've
- 47:12kind of given a level of trust, right?
- 47:15Well, it's almost crowdsourcing open source.
- 47:17What do I mean by that? If I want to get a whole copy of
- 47:20something like Truecrypt, well, first of all, what version do I
- 47:24get? And then if I go ahead and I
- 47:27look around for this code, which is in different places, I find 5
- 47:30of them. I download 5 copies.
- 47:32Well, what do I do? We do a shot 256 on it and four
- 47:35of the five match and one doesn't match, which is the
- 47:37likely the good one. Statistically, the good one to
- 47:39be the four that match and the one that's not matching is going
- 47:42to be your malware because you've got them from all over
- 47:45the place. That's a pretty imprecise
- 47:46science. I don't know if I want to base
- 47:48this excuse. I don't know if I base this like
- 47:50beat the correct one and it's a possibility and you assign
- 47:52probabilities to that. But you know, if you have no
- 47:55authoritative source, which is what we're talking about with
- 47:58AI, because if you had the authoritative source, you knew
- 48:00the answer, you go look it up yourself unless you're stupid
- 48:02lazy and then you don't deserve your job.
- 48:04But that's the subway thing. Podcast if you're here.
- 48:09Yeah, the podcasts are the stupid, lazy, the
- 48:12Procrastinators podcast show. We start next week and.
- 48:15Listen whenever. Yeah, maybe.
- 48:17Yeah, we've been starting next week for the last several years.
- 48:20But back to the idea of being able to know the fidelity and
- 48:24being able the provenance of data and really it ties back to
- 48:27identity. It's a provenance of the
- 48:29identity of the information. We think of identity as being
- 48:33human identity, human actors, non human actors.
- 48:36But what if your information is assigned an identity?
- 48:40That's a little bit different mile, but what would you run
- 48:43with that? Don't dismiss it out of hand.
- 48:45Sit around, think about it, discuss it a little bit and say
- 48:50if information had identity, how would that be manifested?
- 48:55Would it be a label and would it be inherent in it?
- 48:57Would it be embedded in the information?
- 48:59Would be a containerized? How would it interact with other
- 49:02identity providers? Would we have an identity
- 49:05provider for information? How would they validate that?
- 49:08And this is a whole, you know, maybe you guys have covered this
- 49:12up, but if I were to say, hey, go sit in the corner with a
- 49:14bunch of smart people and invent something, then identity, that's
- 49:18what I would start with. And maybe one of your listeners
- 49:20going to be on Shark Tank in a few on saying hello sharks.
- 49:24I got an idea for you. What if, Well, I think there's a
- 49:27lot of companies right now that have settled on sort of this
- 49:29matrix or graph based a, you know, identity thing.
- 49:32That's like, all right, how do you do a one to many or many to
- 49:34one relationship? That's just what we have now,
- 49:38right? Somebody will figure out a
- 49:39better way to do things. I do want to be respectful of
- 49:43time. We're here at the conference.
- 49:44We didn't really get to talk so much about CSO tradecraft itself
- 49:47though, so I want to do the hot wing style.
- 49:50OK, now tell the people what you got going on, where it's like,
- 49:53tell us about the podcast itself.
- 49:55Give us like the elevator pitch because I think the people
- 49:57listening to this are generally identity people, but we are part
- 50:00of information security. If they weren't on any people,
- 50:03they still would not be listening after this much time.
- 50:05OK, right. Yeah, the both of you people are
- 50:07still listening. So where do I get the podcast?
- 50:09What is it about? How often do you put out
- 50:12episodes? That's just kind of tell me a
- 50:13little bit more about that. Yeah.
- 50:14So the podcast can easily be found on all your favorite
- 50:17podcasts and platforms, Apple, Spotify, Pandora, any of those
- 50:21things. YouTube, we have videos or you
- 50:24can go to see so tradecraft.com. And the focus of our show is how
- 50:29do we train the next generation of cybersecurity leaders.
- 50:33So think of a lot of people can teach you more technical things
- 50:36like here's how to go configure D mark on an e-mail.
- 50:39We don't do that. What we do focus on is how do
- 50:43you lead an identity access management program?
- 50:45How do you build an application security program?
- 50:48What metrics would use to gamify vulnerability management?
- 50:52And then what do you do when you take those budgets to the chief
- 50:55financial officer? How do you actually socialize
- 50:58and get adoption from 10,000 developers in your organization?
- 51:02That level of leadership and stewardship is what we try to
- 51:06build with our tradecraft. Yeah, and it's funny, a bunch of
- 51:10D Mark really had to fix AD Mark record over the weekend.
- 51:13By the way, if you use comcast.com or Yahoo and your D
- 51:17Mark record says none, but in terms of what you do with things
- 51:21that didn't pass, it's going to reject your messages and delete
- 51:24them and you can get non delivery problems.
- 51:26That's something I just figured out this past weekend when I got
- 51:28a panic message. When we get that we can't get
- 51:30the emails through to Comcast and like pull the string, it's
- 51:33like, oh, how about that? It's a config change, so.
- 51:36G mark with the D mark. Yeah, there we go.
- 51:39I thank you very much. In any case, the idea with the
- 51:43podcast is to be able to provide a body of knowledge for
- 51:46cybersecurity professionals who want to aspire to or stay in the
- 51:50executive suite. There's a whole bunch of
- 51:53information that is not technical that's required to be
- 51:56effective. The best see So's are not
- 51:58technical experts. A we've had a discussion Cecil
- 52:02versus VC SO and AVC. So sometimes you don't have a
- 52:05lot of depth in your IT's team and you might have to roll up
- 52:08your sleeves and climb under a desk.
- 52:09You tend not to do that as a fortune and see so, but
- 52:13nonetheless, whether you have a background in GRC, whether it's
- 52:16in technology, whether it's in government, whatever happens to
- 52:19be identity, those are the tools that you bring to the job.
- 52:24Our goal is to ensure that you remain aware of what is required
- 52:28to be successful in your job and your career.
- 52:30If you still have a ways to go in your career, how to get to
- 52:32the next level, what are the things going to work for you and
- 52:35how to stay at the top. This is not really for newbies.
- 52:38The newbie doesn't care about how do you brief a board of
- 52:40directors. They newbie doesn't care about
- 52:43reading a corporate financial statement, but it's a see.
- 52:45So you need to know these skills.
- 52:47So what we've done then is you kind of also the genesis of it
- 52:50is that I've been, I used to exhibited trade shows for years
- 52:53and years. We're talking about, I think he
- 52:54said. This is your first.
- 52:55In first one. First for this one, yeah.
- 52:57I've been having almost 30 years.
- 52:59I spoke here in 199798 and 2000. I had the best attend and talk.
- 53:04It was called PK. I don't think so and the next it
- 53:09is about the name. I got to the keynote and the
- 53:11three keynotes here the last year did the keynote.
- 53:13The next year they had William Shatner is a keynote.
- 53:15Let me know it was 2006 Bill Shatner keynote of this thing.
- 53:17I think he got paid better than I did.
- 53:19But the point was is that because of our audience, there
- 53:24is strength in terms of the peer group.
- 53:26And so for our subscribers and our followers our sees a trade
- 53:29craft. We put episodes on every single
- 53:32week, comment on them, provide a big string on LinkedIn so that
- 53:37we get good, smart people talking to each other, and then
- 53:41build your network based upon the core that we've created.
- 53:43So we're really trying to create a community of both practice as
- 53:48well as thought for chief information security officers.
- 53:52I see goes the switch to great chemistry, different
- 53:55personalities. It makes for an interesting
- 53:58episode I'm sure. I always find it like crazy that
- 54:03people always say, how do you guys keep coming up with topics?
- 54:07To me it's like, how do you keep, how do you narrow down the
- 54:10topics? And seriously, there's so much
- 54:12to talk about that once a week is barely enough to address
- 54:16everything. Well, you're right, I didn't.
- 54:20Think we'd be going this far, but the input queue just keeps
- 54:23getting bigger and bigger. And it's also partially because
- 54:26G marks law. Remember, half of what you know
- 54:28is obsolete in 18 months, so you go back 18 months, and half of
- 54:32those episodes before that probably have been overcome by
- 54:34events. It's a time capsule, right?
- 54:36This is what was happening at that point in time and this is
- 54:39what people are thinking about. Your RSA 128 bit teams and yeah,
- 54:43maybe we should upgrade this section, that's why.
- 54:46But more to the point, it does provide a historical reference.
- 54:51And because what we do on our GitHub page, if you go to see so
- 54:54tradecraft.com and click on the GitHub, you'll see it broken out
- 54:57into 10 different domains. So you see, I really want to go
- 55:00ahead and focus on this area of my see so skill set rather than
- 55:04that, do so and then move. These are the 15 episodes that
- 55:07are on that subject. So it really helps people go
- 55:09ahead and pick through the library.
- 55:11We don't have a Dewey Decimal system for it, but something
- 55:13similar. We just we just go straight
- 55:15numbers and then, you know, keyword and find it that way.
- 55:18Like we're going to try to find it.
- 55:20Well, I'm really glad we met. We're going to wrap up.
- 55:23We always do on a lighter note, that's just kind of our style.
- 55:26And since we're all, you know, podcasters, what better question
- 55:29than say if you were going to start a podcast, but it's not
- 55:32infosec, it's not security, it's something else.
- 55:36What podcast would you start? What would it be about?
- 55:39Ross, you get to go first. So I thought about this and it
- 55:43and I may do it. I don't know if I will, but me
- 55:46and my kids play this Roblox game called blocks for it's a
- 55:51One Piece themed game. So if you like Japanese anime
- 55:54and you're like I need to watch more than the cartoon, I got to
- 55:57play the video game on Roblox. I would do a channel to teach
- 56:00dads how to connect with their kids because I've been playing
- 56:03with my four kids video games. And I think there's a lot of
- 56:07dads who could, you know, connect with their kids or maybe
- 56:10moms connect with their kids playing video games, but they
- 56:13haven't the foggiest idea of how do I get into this world of
- 56:16video gaming with my kids. And, and I think that'd be a
- 56:19really interesting adventure. Yeah, it's super cool.
- 56:21You're hitting on something that's like in the zeitgeist,
- 56:23right, too. So I hate to say it, but the
- 56:25total addressable market for that podcast might be way
- 56:27better. Anything in the world we're
- 56:29doing right now. What about you, G Mark?
- 56:32I think it's a little addressable, but I could be a
- 56:34lot smarter because I, as I said, I mean the give the give
- 56:37back phase, we're trying to help you get to the next stage.
- 56:39So we do say create a podcast. It would be a podcast biotically
- 56:43about self referential. Why?
- 56:45Because a lot of people out there with great ideas who have
- 56:47good networks who are not quite sure how to get going.
- 56:49They don't know, hey, how about this microphone equipment?
- 56:54How about that hairstyle? Whatever happens to me that is
- 56:57going to make you more successful.
- 56:58So that might not be a 256 episode podcasts, but it would
- 57:03be helping people get that information out.
- 57:06And pretty what we're doing is so that the people who want to
- 57:10listen to the message that you have, you'll be able to reach it
- 57:15and they'll be able to talk month after their lives.
- 57:18So that's the thing. That's why you do a podcast.
- 57:20It's not to listen to yourself talk.
- 57:21There's a lot better races can be done.
- 57:23But if we do is you're trying to help other people, some live.
- 57:26Where is this reward? And I'd love to be.
- 57:31Absolutely subscribe to that because I subscribe to podcast
- 57:34or Youtubers today that are all about audio visual, right?
- 57:38What are the right cameras, lighting, audio editing, right?
- 57:42All that stuff. And you know, if you listen to
- 57:45episode 1 of this podcast. Before going to teams.
- 57:49It was, yeah. I think it was probably a Zoom,
- 57:52a condenser microphone in a very echoey basement with seemed to
- 57:56be made of nothing but echoes. Yeah.
- 58:00And to listen to that episode and then to listen to something,
- 58:04you know, more recent, that's all stuff that I learned doing
- 58:07that stuff. And I totally relied on that
- 58:09concept of people who are willing to take the time.
- 58:12Yes. You know they're Youtubers.
- 58:13Well, good. Maybe they need to be first
- 58:14games. Yeah, I I'll, I'll be.
- 58:16Happy to do it. How about you, Jim?
- 58:17What's the back at you? So in July, I moved to the Black
- 58:20Hills of South Dakota. I want to tell everybody that I
- 58:24always get a similar reaction, which is John Strand.
- 58:26Wow. But no, it's like, wow, that's
- 58:28really cool. And why did you move there?
- 58:30And I think there's just so much that people don't know about
- 58:34that area, but people are interested.
- 58:36Maybe they know that Mount Rushmore is there, or the
- 58:40Sturgis Pike Rally, or the Black or Badlands.
- 58:45So I just feel like that has endless topics and I'm still
- 58:48exploring and learning about it. So I get to learn as I was
- 58:52building the podcast. I think it'd be a fun topic.
- 58:55How about you? Feel like I Black Mountains
- 58:58influencer of some sort. Yes.
- 59:00Black Hills. Black Hills.
- 59:01Yeah, Yeah, I've been to the Black Hills.
- 59:03It's very, very cool, especially at night where there's like, no
- 59:06light pollution. You actually see, you know, the
- 59:08stars in the Galaxy. So the reason why they call it
- 59:10the Black Hills, by the way, is that there are these pine trees
- 59:13that are on the hills. There's there's hills.
- 59:16They're not quite mountains, but they're somewhere in between.
- 59:20And when you see them from a distance, they look black and it
- 59:24makes the hills look black. And it was actually the native
- 59:27populations that named them Black Hills and, you know, in
- 59:32their local language. I don't know what I would do.
- 59:37I think I am at the phase of my life where I just like to talk
- 59:40with people and find out what they're thinking about different
- 59:43things. So people who don't know what
- 59:45they wanted to do. So something along those lines,
- 59:48like, yeah, it's just, you know, a standard talk show, right?
- 59:52Where it's like, oh, OK, tell me about yourself.
- 59:55What's that like? You, you have this position on
- 59:59something. What's that like comment on that
- 1:00:01I mean? I, I think I've probably
- 1:00:02mentioned this show, I'm a big fan of the Bennington show on XM
- 1:00:05or I, Sirius now it's just kind of a radio show about anything
- 1:00:08and everything. It's part comedy, it's part
- 1:00:11news, it's part sports, kind of over everything.
- 1:00:14It reminds me of going and back and sitting on the couch with my
- 1:00:16friends when I was, you know, in my early years and just talking
- 1:00:21about the world, know what's going on and trying to
- 1:00:23understand different viewpoints. And so I think, I think there's
- 1:00:28a market for that and I, I hope at some point, but if it's, it's
- 1:00:32just, hey, Ron, you came up man. And you're like, now we're doing
- 1:00:36a podcast, what, 3 hours later? Like that's the kind of thing I
- 1:00:39think is super cool on having that connection and being able.
- 1:00:42To do this podcast, that's your. Yeah.
- 1:00:44We don't know when it will happen.
- 1:00:46It will happen at some point and yeah, that kind of thing.
- 1:00:48So. Chapman, Jim, thanks for having
- 1:00:50us own process. I appreciate that.
- 1:00:51Yeah, yeah. Thank you so much for being part
- 1:00:53of this. And Ross, again, thanks for
- 1:00:55coming up. What encourage people to go out?
- 1:00:57Visit cisocherrycraftf.com. I'll have links in our show
- 1:01:02notes for people to click that out.
- 1:01:04Again, shout out to Shirley and Cyber Risk Alliance and RSM for,
- 1:01:08you know, helping us out here. And yeah, we'll go ahead.
- 1:01:11We'll be there for this week. Find us on the web,
- 1:01:13idacpodcast.com. Like, subscribe, do all that
- 1:01:16cool stuff, and we'll talk with everyone the next time.
- 1:01:21You've been listening to Identity at the Center.
- 1:01:25We hope you've enjoyed the show. Make sure to like, rate and
- 1:01:29review, and we'll be back soon. But in the meantime, hit the
- 1:01:33website at identity@thecenter.com.
- 1:01:37See you next time on Identity at the Center.