Latest / Full Tech Ahead / How to Help Your AI Team

Transcript

How to Help Your AI Team · Full Tech Ahead

• 0:19
  SPEAKER_01: Hello and welcome to Full Tech Ahead.
• 0:22
  SPEAKER_01: I am your host, Amanda Razzani, and I'm excited to have Mary Zade here.
• 0:27
  SPEAKER_01: She is the Senior Vice President of AI Governance and Risk Assessment at or Risk Consulting rather at Luminova.ai.
• 0:38
  SPEAKER_01: How are you?
• 0:39
  SPEAKER_01: Hi, Amanda.
• 0:40
  SPEAKER_01: Nice to be here.
• 0:42
  SPEAKER_01: Happy to have you on the show.
• 0:44
  SPEAKER_01: Can you share a little bit about a little bit about your background and then what does Luminova AI offer?
• 0:52
  SPEAKER_00: Sure.
• 0:53
  SPEAKER_00: So I have a finance background.
• 0:55
  SPEAKER_00: I started with risk and compliance.
• 0:57
  SPEAKER_00: I worked for KPMG for 10 years, was a director and head of risk transformation in KPMG Norway.
• 1:05
  SPEAKER_00: And then started in Luminova as SVP of AI governance and risk consulting.
• 1:11
  SPEAKER_00: So what we do is that we have the unified AI governance, risk and compliance platform.
• 1:17
  SPEAKER_00: We help organizations govern, monitor, and scale AI systems safely.
• 1:22
  SPEAKER_00: So basically, we're turning AI risk to possibilities.
• 1:26
  SPEAKER_00: I love that.
• 1:27
  SPEAKER_00: I love to say that.
• 1:29
  SPEAKER_00: So risk to possibilities, Amanda.
• 1:32
  SPEAKER_01: Wonderful.
• 1:33
  SPEAKER_01: Well, I'd love to hear more about that.
• 1:34
  SPEAKER_01: And um, our topic today is about um all things AI.
• 1:39
  SPEAKER_01: And I'd love to hear more about building AI governance teams and from your experience, where are their issues with a lack of skills and how can those be addressed?
• 1:52
  SPEAKER_00: It's a very interesting topic because uh, you know, I love talking about AI governance, and I think it's a very important topic to talk about in 2026 because we see that AI governance requires a unique blend of um technical, regulatory, and business fluency.
• 2:11
  SPEAKER_00: You know, it's you need people that are able to speak these languages fluently.
• 2:17
  SPEAKER_00: And the problem with that is that we're not creating carrier paths for these specialists.
• 2:22
  SPEAKER_00: We're just we're just looking for the unicorn that has all these three um, you know, qualifications and um and skill sets.
• 2:30
  SPEAKER_00: So I see it as a, you know, as I mentioned, a three language problem because they are so the technical teams, um, they have to understand regulation, while you know, compliance teams, they have to understand the model structure, you know, data flows and you know, the business, their perspective is like, what is the risk tolerance?
• 2:52
  SPEAKER_00: What is the operational impact?
• 2:53
  SPEAKER_00: But they have to be able to communicate that to the technical teams and to the regulatory teams in order to for the teams to be able to function together and work together.
• 3:04
  SPEAKER_01: Well, so where you know communication is absolutely key.
• 3:10
  SPEAKER_01: So, what tips do you have to improve that communication between departments so everyone's on the same page?
• 3:18
  SPEAKER_00: So I think we should stop as organizations.
• 3:21
  SPEAKER_00: We should stop as when we're building AI governance teams, we should stop looking for, as I mentioned, a unicorn that has all of it because usually we come from different domains.
• 3:30
  SPEAKER_00: I come from you know risk compliance and um internal auditing, I'm a certified internal auditor.
• 3:36
  SPEAKER_00: And even my path was starting there, but I had to uh you know start understanding the technical team's language, right?
• 3:46
  SPEAKER_00: You we have to, so if you come from that domain, you have to educate yourself on the technical aspects of AI, right?
• 3:54
  SPEAKER_00: You have to understand model structures, AI systems, why a model drift, what is the trained data, what is you know, why you have to evaluate and why are you evaluating your AI systems on to be able to communicate with the technical teams.
• 4:09
  SPEAKER_00: So, first don't look for the unicorn, start on career paths, start on education.
• 4:16
  SPEAKER_00: So, for example, you can have different rotation systems.
• 4:20
  SPEAKER_00: Like if you come from internal auditing and you know you have to be auditing an AI system, you need to be maybe rotated in a technical team for a while to understand, to learn, you know, to and then if you're if you're a compliance person and you you see frameworks, you see regulations, and you just see a set of set of regulations that we have to comply with, in order to be able to translate that to uh to the technical teams, again, you have to understand what does it feel in in AI, different AI systems.
• 4:53
  SPEAKER_00: So um we actually in Lumanova, we start building um training programs because nothing existed from from before.
• 5:02
  SPEAKER_00: But rotation, education, and and invest in career paths.
• 5:08
  SPEAKER_01: Absolutely.
• 5:09
  SPEAKER_01: I think that I think more companies now than ever are realizing that they need to provide their own training in order to get the the employees with the skill set that they need.
• 5:21
  SPEAKER_00: Definitely, definitely.
• 5:22
  SPEAKER_00: And it's not easy because the AI is uh evolving every day, this the frontier models are evolving every day, the evaluation criteria changes in the sense that sometimes we just we don't even know what regulation are we going to comply with.
• 5:38
  SPEAKER_00: So if you're going for NIST, this is a jet, this this is just a guideline, right?
• 5:43
  SPEAKER_00: It's different than if you're looking to um you know implement I ISO 40 2001 or if you're looking at EU AI Act.
• 5:51
  SPEAKER_00: And interesting problem going forward as well, how like global organizations are able to comply with the different regulation.
• 6:01
  SPEAKER_00: But going back to the topic, definitely invest in education of um your your already existing uh you know resources and people.
• 6:12
  SPEAKER_01: What is your in having worked with so many business leaders, what is the best advice you can give them to have success in this area?
• 6:21
  SPEAKER_00: I think we're we're when we're talking about AI implementing AI governance, I have a lot of um talking points.
• 6:29
  SPEAKER_00: But in terms of skill sets, I would say looking at different um building different teams and making sure that these different teams, technical, business, and compliance, you know, framework, um, legal people, build the teams cross-functional.
• 6:46
  SPEAKER_00: Because if you if you just let's say that you you are um you're building AI internally, yeah, systems, it can be a chatbot, right?
• 6:55
  SPEAKER_00: And you have to go through a life cycle.
• 6:58
  SPEAKER_00: This is like the best practice.
• 6:59
  SPEAKER_00: You have to go through a life cycle, you start with an intake process, a questionnaire to making sure which business starts, right?
• 7:06
  SPEAKER_00: You have an intake process that business starts, and then you you should have a risk assessment that legal and you know risk people, the second um second line people should be involved in.
• 7:17
  SPEAKER_00: And then be these two have to communicate together to make sure the output is correct.
• 7:22
  SPEAKER_00: And then you get to the build phase where the developers come in and then, like, okay, so why are we what are we building and why are we building this?
• 7:31
  SPEAKER_00: So from you know, phase one to which is intake to phase two, which is build, even like in the beginning of um building an AI system, they have to be able to communicate.
• 7:45
  SPEAKER_00: And as an organization, we have to build the life cycle of an AI system because we know the outcome will be best at the end because they have communicated and they have worked together, making sure that it's technically correct, complying with the right regulation and have the audit-ready documentation, and also it's built for the intended use.
• 8:06
  SPEAKER_01: Absolutely.
• 8:07
  SPEAKER_01: Well, the other part of this is that AI is constantly evolving, and so are the regulations in tune with that.
• 8:15
  SPEAKER_01: And so, what do you envision the future of AI and um regulations, say a year from now?
• 8:22
  SPEAKER_00: So we have the EU AI Act that is going to be uh enforced in August 2026.
• 8:28
  SPEAKER_00: And then we have in the US, we have you know, Colorado Act, we have we have different state-level acts, and then we have the guidelines like ISO 42001 or NIST um risk management frameworks.
• 8:43
  SPEAKER_00: I think we will have more regulation.
• 8:47
  SPEAKER_00: Um, I mean, in Europe it's different.
• 8:49
  SPEAKER_00: They have they already have a regulation and they have to comply with it and starting from um, as I mentioned, 2026.
• 8:56
  SPEAKER_00: But in US, I think the way we've looked at it in the US is a bit different, right?
• 9:00
  SPEAKER_00: So we started um with less regulation in order to make sure that the innovators, it's an open, like open road for the innovation, right?
• 9:10
  SPEAKER_00: We didn't want the regulation to be a showstopper.
• 9:13
  SPEAKER_00: But I think as we evolve, as the AI evolve, we need more regulation on different parts, probably, because we we see that it's it's not the AI of 2023.
• 9:25
  SPEAKER_00: It's not, we're not talking about, you know, even we're not talking about traditional AI, we're not even talking about the gen AI, where we were worried about the output, like uh right, because um until now we were like, okay, we're giving it a prompt, we have a chat bot, we are worried if the output is correct or not.
• 9:45
  SPEAKER_00: Is this output representable?
• 9:47
  SPEAKER_00: Is it uh hallucinated, right?
• 9:50
  SPEAKER_00: But in 2026, it would be more focused on agent EGI, where we would be worried about if it if it has the right permission, if it's within what we gave the agent to do.
• 10:02
  SPEAKER_00: For example, if you have an agent that is supposed to book meetings for you and it does it perfectly by canceling your other meetings to optimize your calendar, right?
• 10:15
  SPEAKER_00: So it's doing its job, but in order for you to make sure that it's actually doing the right thing, you need to have right controls in place.
• 10:24
  SPEAKER_00: You need to have continuous monitoring.
• 10:27
  SPEAKER_00: And that's basically one of the key learnings we've seen in 2025.
• 10:31
  SPEAKER_00: In general, you need to have continuous monitoring.
• 10:35
  SPEAKER_00: So the annual audit that worked perfectly for traditional AI and maybe for Gen AI a little bit, it's not going to be doable going forward.
• 10:46
  SPEAKER_00: You need definitely to be more on real-time monitoring and continuous observability going forward.
• 10:54
  SPEAKER_00: Another thing is that, as I mentioned, it will require frameworks that makes real-time authorization decisions, not just postdoc um reviews.
• 11:06
  SPEAKER_00: We need to, again, as I'm mentioning, real-time monitoring and having alert, having dashboards that show you how your model is performing, if it's not hallucinating, if it's actually doing what it was intended to do in the right way with the right risk.
• 11:23
  SPEAKER_01: Yeah, that was so helpful.
• 11:24
  SPEAKER_01: Thank you for sharing your insights.
• 11:26
  SPEAKER_01: Well, if there was one key takeaway that you could wrap it all up with and share with our audience today, what would that be?
• 11:34
  SPEAKER_00: I think they have to start with, in general, what I always say is that they have to start with mapping of the AI systems, because I always say that you can't govern what you can see.
• 11:46
  SPEAKER_00: So a simple way to start is that you start with an AI inventory, making sure that you have an overview of all your AI systems in place.
• 11:55
  SPEAKER_00: Also, um, I would say invest in education, invest in cross-functional teams in order to make sure that they are communicating.
• 12:04
  SPEAKER_00: Because if if you want to succeed in this era, we need to have humans, uh, the right humans with the right education, with the right um, you know, understanding of AI in order to help it to be more reliable and um, you know, trustable.
• 12:23
  SPEAKER_00: Also, I would say the organizations that will succeed with AI governance in the future, they are not the ones with the like perfect AI governance in place and perfect policies, perfect structure, the perfect tool, but they are actually the ones that are understanding what is required to uh for the teams again to be able to work together.
• 12:49
  SPEAKER_00: Because we don't want AI governance, we don't want a perfect AI governance.
• 12:53
  SPEAKER_00: We want something, we want we want governance that practitioners actually use.
• 12:57
  SPEAKER_00: So we want the control sets, we want the evaluations, we want the monitoring set up from you know legal teams and compliance and AI governance at you know, CI uh COI uh teams that the developers actually use and they follow.
• 13:16
  SPEAKER_00: So it was a long, you know, closing, but what I would say is that um make start with your AI systems and then make AI governance practical so the developers would use it and see the value in it, basically.
• 13:33
  SPEAKER_01: Great.
• 13:34
  SPEAKER_01: Thank you so much for all the tips and advice for our listeners.
• 13:38
  SPEAKER_00: You're welcome.
• 13:39
  SPEAKER_00: I hope it's useful.
• 13:41
  SPEAKER_01: Yes, and thank you to be here.
• 13:43
  SPEAKER_01: And thank you to our audience.
• 13:45
  SPEAKER_01: Uh please share any questions or comments you have below in the comment section, and I will be looking and try to respond.
• 13:53
  SPEAKER_01: And until the next podcast, have a wonderful day.