Latest / Full Tech Ahead / Stop Using AI for Everything

Transcript

Stop Using AI for Everything · Full Tech Ahead

• 0:19
  SPEAKER_01: Hello and welcome to Full Tech Ahead.
• 0:22
  SPEAKER_01: I'm your host, Amanda Razzani, and with me today, I'm excited to have Federico Romalo, founder and CEO of Density Labs.
• 0:29
  SPEAKER_01: How are you doing today?
• 0:32
  SPEAKER_00: Hello, Amanda.
• 0:33
  SPEAKER_00: It's a pleasure to be here today.
• 0:35
  SPEAKER_01: Happy to have you on the show.
• 0:37
  SPEAKER_01: Can you share a little bit about your background and what do you do over there at Density Labs?
• 0:43
  SPEAKER_00: Yeah, sure.
• 0:44
  SPEAKER_00: So at Density Labs, what we're doing is AI engineering.
• 0:48
  SPEAKER_00: We partner with companies that are trying to figure out how to leverage AI within the organization.
• 0:57
  SPEAKER_00: We take all the hype away and we focused on business impact outcome.
• 1:04
  SPEAKER_00: We track the return of investment of those efforts.
• 1:08
  SPEAKER_00: The other thing we we do is we track the total cost of ownership.
• 1:13
  SPEAKER_00: We've seen a lot of projects where the token consumption goes to the roof and then the cost for running these projects goes super high.
• 1:23
  SPEAKER_00: So we we we work on that.
• 1:25
  SPEAKER_01: Okay, great.
• 1:26
  SPEAKER_01: So we're gonna talk today about your experience in working with these companies and what are some of the challenges and the ROI for software development companies when they're utilizing AI tools.
• 1:38
  SPEAKER_01: I know everybody's trying to harness AI in the best way possible.
• 1:42
  SPEAKER_01: So let's start with the fact, though, that roughly 95% of enterprise AI pilots never reach production.
• 1:50
  SPEAKER_01: Why is that, do you think?
• 1:52
  SPEAKER_00: It's a very interesting situation that is happening with that.
• 1:55
  SPEAKER_00: The main reason is that they test the demo with the best case scenario, and then they don't consider all the use cases.
• 2:06
  SPEAKER_00: That's the first issue.
• 2:07
  SPEAKER_00: The other issue that is happening is that even though AI is a technology tool, it is actually an organizational change.
• 2:16
  SPEAKER_00: And uh a lot of companies don't see it that way, and that's the the uh underlying reason or the root cause of why uh this type of projects fail.
• 2:25
  SPEAKER_00: And the the last issue that I've seen is that because you have so many different possibilities of outcomes or use cases, what we start doing is setting up a model that evaluates another model.
• 2:40
  SPEAKER_00: Uh, that way we reduce those uh that that complexity towards expected outcomes, expected behaviors.
• 2:49
  SPEAKER_00: And then we set guardrails to to avoid that, right?
• 2:52
  SPEAKER_00: But basically that that that issue that that that is that is the the core issue is that it becomes unwindling, unwindly complex when you have so many use cases and you don't have a way to track that the outcome is what you actually expect.
• 3:13
  SPEAKER_01: Can you share a little bit more about you said create a model to review the the model?
• 3:18
  SPEAKER_01: Can you share more about that?
• 3:20
  SPEAKER_00: Yes, absolutely.
• 3:21
  SPEAKER_00: So the first thing we need to understand is that the when we have agents executing and doing actions for us, right?
• 3:32
  SPEAKER_00: What we are actually doing is we're providing tools to a model, to a large language model that is making those decisions and then executing for us, right?
• 3:42
  SPEAKER_00: The issue is that these are non-deterministic outcomes, is what we're going to get, right?
• 3:48
  SPEAKER_00: So, how can we test that the outcome is what we expect?
• 3:53
  SPEAKER_00: What we do is we build uh it's called Eval LLM, and basically uh what we have is another model, and by model what I mean is uh thinking it of as an engine, right?
• 4:04
  SPEAKER_00: Uh, it's the core of every um AI automation tool that we use that can that we can have a conversation or we can it can read images, there are different models, but basically what we do is we set up one model to analyze and make a decision to execute, and then another model to evaluate what the first model is going to do, and then make the decision.
• 4:28
  SPEAKER_00: Okay, does that make sense or it doesn't make sense, right?
• 4:31
  SPEAKER_00: The reason, technical reason we need to use two models is because what we want is to have uh let's call it second opinions, right?
• 4:40
  SPEAKER_00: If we if we have the same models evaluating themselves, then we have the higher probability of them to be to agree to a wrong decision.
• 4:51
  SPEAKER_01: Okay, so when putting AI agents into an engineering org, what are some of the things that break or some of the challenges that you see?
• 5:03
  SPEAKER_00: Even though I am advocating for uh the use of AI, I believe that using at l as little AI as possible is the best approach.
• 5:15
  SPEAKER_00: So when uh what are the best scenarios to leverage AI within an organization?
• 5:21
  SPEAKER_00: So when we have uh business processes, right, um, and we want to automate them, we can use uh an AI agent to just automate the whole workflow, right?
• 5:35
  SPEAKER_00: Or we can build software, we can build code that is actually going to automate that workflow, right?
• 5:41
  SPEAKER_00: So what I am advocating is to build code to solve the automation uh for all the deterministic workflows.
• 5:53
  SPEAKER_00: By deterministic, I mean uh think of math.
• 5:56
  SPEAKER_00: Math is deterministic, one plus one equals two, right?
• 5:59
  SPEAKER_00: It's always the same result.
• 6:01
  SPEAKER_00: So when we have those types of rules, or we can uh set up those types of rules, then we can build code, we can build software that is going to run those automations.
• 6:11
  SPEAKER_00: But when you have to analyze an email, understand the sentiment within it, or um think of it as intuition, you know, you have a problem and you don't know exactly what the outcome should be.
• 6:24
  SPEAKER_00: So you have to uh intuitively find the outcome.
• 6:28
  SPEAKER_00: So for for those problems, AI is great.
• 6:34
  SPEAKER_00: So what I suggest is to build a software for the deterministic workflows and then use models as fallback only when we have a situation that is non-deterministic, right?
• 6:48
  SPEAKER_00: That means we can save money on running tokens or on running models, and uh we can have a faster uh automation process and it's uh safer because when you have a model running um within your organization, somebody has to supervise what it's doing, right?
• 7:09
  SPEAKER_00: Um no agent, no model can be accountable for anything, only humans can.
• 7:15
  SPEAKER_00: So if we have code, it is easier to manage, it is easier to test and make sure that it works properly, right?
• 7:24
  SPEAKER_00: And then the models, they can be um supervised, they can be uh tested, but the level of effort is much higher, and the cost of operating them is much higher, right?
• 7:38
  SPEAKER_01: So you argue that AI agents are not necessarily good junior engineers.
• 7:44
  SPEAKER_01: Explain that a little bit further.
• 7:45
  SPEAKER_01: I see a lot of people using AI agents to develop all sorts of things.
• 7:50
  SPEAKER_01: Where do they encounter problems doing that?
• 7:54
  SPEAKER_00: Well, what I was explaining before was mostly about automating business processes.
• 8:00
  SPEAKER_00: Um, what you're talking about, uh asking me now, is about why uh models are not good software engineers.
• 8:07
  SPEAKER_00: And I think that one of the reasons is that the software engineers, what we do is we abstract, we build abstractions, layers of abstractions of a of a of a problem in real life, right?
• 8:21
  SPEAKER_00: Um, and then we set uh expectations of behavior.
• 8:25
  SPEAKER_00: What do we want the application to do?
• 8:28
  SPEAKER_00: The models are not really good at those levels of abstraction, and they um they lose um they lose that that ability, right, uh of abstracting and understanding what is the core problem.
• 8:41
  SPEAKER_00: They are becoming better though, but they're not there yet, right?
• 8:45
  SPEAKER_00: So the quality of the code becomes uh lower than what a senior engineer could do, right?
• 8:52
  SPEAKER_00: What I called the craftsmanship.
• 8:54
  SPEAKER_00: Now, what is going on is that once you start building code with agents, now the the code is easier to be replaced.
• 9:04
  SPEAKER_00: You can build new code easier because you have agents to help you with, right?
• 9:08
  SPEAKER_00: So even though I I come from that craftsmanship of building high-quality code, now I'm learning that it becomes less relevant when you can just replace it faster, right?
• 9:21
  SPEAKER_00: Um having said that, the key um uh key tip for successfully build software with agents is uh you need to be very, very specific on the specifications, right?
• 9:38
  SPEAKER_00: The more specific, the better, because that's when you can do the analysis on how the application should work, and then the agent can focus on executing and building the application, right?
• 9:52
  SPEAKER_01: So we are seeing the use of AI more and more.
• 9:55
  SPEAKER_01: What are some of the cybersecurity risks, and how do leaders address that?
• 10:00
  SPEAKER_00: The security agents can mimic human behavior, right?
• 10:05
  SPEAKER_00: And that that is becoming an issue.
• 10:06
  SPEAKER_00: It used to be that you could have captchas to to you know separate bots from humans.
• 10:12
  SPEAKER_00: Now agents can overcome CAPTCHAS, they can overcome a lot of the behavior of patterns that we used to use to track bots and feed out cyber attacks.
• 10:26
  SPEAKER_00: Uh, and that complexity is going to increase because the attackers, hackers are also using agents, so they're having they can elaborate, uh, they can build more elaborate uh attacks, right?
• 10:38
  SPEAKER_00: Um on the other hand, on the on the safety part, what we're seeing is uh more increasingly complex applications that can detect attacks.
• 10:50
  SPEAKER_00: Because the issue with with attacks is what happens if you have a lot of false positives, right?
• 10:54
  SPEAKER_00: Then eventually somebody is going to turn off the alarm, right?
• 10:58
  SPEAKER_00: Because who's going to listen for a tool that is not providing real threats, right?
• 11:03
  SPEAKER_00: They're building tools to filter that and being being able to double check if it's actually a threat and can make decisions to autonomously uh fix the the attack, right?
• 11:16
  SPEAKER_00: Or defend for the attack, right?
• 11:19
  SPEAKER_00: Uh so that's going to be very interesting happening.
• 11:21
  SPEAKER_00: And the other thing that I've seen happening is we have we used to have phishing for humans, now we have phishing for agents.
• 11:29
  SPEAKER_00: So we have emails or or links or things like that that uh are target to agents to act on, right?
• 11:40
  SPEAKER_00: And that that is becoming an issue, right?
• 11:43
  SPEAKER_00: And the last thing we're going to see, or where we're seeing already, is um a higher volume of both attacks and uh defense actions because both can be automated now.
• 11:55
  SPEAKER_01: So what tips do you have for business leaders when it comes to building and leading high trust engineering teams across countries and different time zones?
• 12:06
  SPEAKER_00: The first thing is that building a culture around how to build software, understanding uh or being able to transmit to the software engineers that what they're building has an impact to the users, what is the value for the user becomes the most important question that the developer should ask, right?
• 12:27
  SPEAKER_00: Once they understand that, then the developers can leverage agents to build the software, right?
• 12:34
  SPEAKER_00: To build the tests, to test specifically the value for the user, right?
• 12:40
  SPEAKER_00: To spend additional effort on testing that, right?
• 12:43
  SPEAKER_00: Because if you do that, then the application you're going to build is going to be uh more useful for the user, right?
• 12:49
  SPEAKER_00: Um, so that's the first part.
• 12:52
  SPEAKER_00: Uh on the business process automations, I think that the core suggestion that I can give is think of it as an organizational transformation.
• 13:02
  SPEAKER_00: It's not only a technology implementation, right?
• 13:05
  SPEAKER_00: And getting the team to adapt to these new tools, right?
• 13:10
  SPEAKER_00: There are organizations that uh are capable of those of adapt, uh adapting, and that makes them uh leverage AI faster, and they can have a competitive advantage over other organizations that are still trying to figure that out.
• 13:29
  SPEAKER_01: Fantastic.
• 13:30
  SPEAKER_01: Well, if there was one key takeaway you could leave our audience with today, what would that be?
• 13:35
  SPEAKER_00: Think of AI as a new hire that doesn't have accountability.
• 13:40
  SPEAKER_00: Use uh or or lean on the context of your team, right?
• 13:46
  SPEAKER_00: If you have a team with long tenure, lean on that because they know the business, they understand how everything works.
• 13:53
  SPEAKER_00: So what they they need to think is that the new responsibility of the humans is going to be to manage those agents and to guide them when those agents are making a mistake within the business process automation.
• 14:08
  SPEAKER_00: It also applies for software, right?
• 14:10
  SPEAKER_00: But uh, I think that's that's the core takeaway that I can give is lean on that on that team, lean on the humans and help them upskill to use AI as augmentation instead of replacement.
• 14:26
  SPEAKER_01: Absolutely.
• 14:26
  SPEAKER_01: Well, thank you so much for coming on the show and sharing your insights.
• 14:30
  SPEAKER_00: Absolutely.
• 14:32
  SPEAKER_00: A pleasure to be here, Amanda.
• 14:34
  SPEAKER_01: And thank you to our audience.
• 14:35
  SPEAKER_01: If you have any questions or comments, leave them below, and I'll make sure to respond as soon as possible.
• 14:40
  SPEAKER_01: And have a wonderful day.