Latest / The Adults In The AI Room / The Earley AI Podcast with Seth Earley - Episode #54 Demystifying AI for Business Leaders: Insights from Tobias Zwingmann

Transcript

The Earley AI Podcast with Seth Earley - Episode #54 Demystifying AI for Business Leaders: Insights from Tobias Zwingmann · The Adults In The AI Room

• 0:00
  SPEAKER_01: Good morning, good afternoon, good evening, depending upon your time zone when you're listening to this.
• 0:04
  SPEAKER_01: My name is Seth Early.
• 0:05
  SPEAKER_02: And I'm Chris Featherstone.
• 0:07
  SPEAKER_01: And welcome to the Early AI podcast.
• 0:09
  SPEAKER_01: And we're really excited to introduce our guest today.
• 0:12
  SPEAKER_01: But when what we're going to discuss a number of things that are very important to our space, you know, certainly why a lot of vendors fail to grasp the core fundamentals of AI and the significance of things like data labeling, taxonomies, ontologies, and metadata.
• 0:29
  SPEAKER_01: We'll talk a little bit about the limitations of generative AI and why it should be considered a supplemental tool rather than a fundamental enabler and really how business leaders can better navigate AI technologies to make sure they're getting meaningful and impactful applications.
• 0:46
  SPEAKER_01: Our guest today is an analytics and AI expert from Hanover, Germany, Germany.
• 0:51
  SPEAKER_01: He has a background in both SaaS platforms and consulting.
• 0:55
  SPEAKER_01: He brings tremendous insights to the strategic implementation of AI.
• 0:59
  SPEAKER_01: He emphasizes the need for some of the non-technical aspects of AI implementation and really advocates to setting realistic expectations within the industry.
• 1:10
  SPEAKER_01: Tobias Vingdan, welcome to the show.
• 1:13
  SPEAKER_00: Hi, Tess.
• 1:13
  SPEAKER_00: Thanks for having me.
• 1:14
  SPEAKER_00: It's great to be here.
• 1:16
  SPEAKER_01: So the first thing we'd like to begin with is, you know, common misconceptions.
• 1:20
  SPEAKER_01: Like what are you seeing in the industry that people are not understanding?
• 1:24
  SPEAKER_01: And I know that's changing, it's a moving target, right?
• 1:27
  SPEAKER_01: People are starting to understand, okay, well, Gen AI, you know, can certain do certain things, but then we need to uh leverage corporate data.
• 1:34
  SPEAKER_01: But even when they get that piece and go, yeah, okay, rag.
• 1:38
  SPEAKER_01: And we want retrieval augmented generation.
• 1:40
  SPEAKER_01: We want to use our our knowledge as a ground as ground truth.
• 1:43
  SPEAKER_01: What are they still missing?
• 1:44
  SPEAKER_01: Like, what are the things that people are not getting, both on the vendor side and on the customer side?
• 1:50
  SPEAKER_00: Oh my God, there are so many.
• 1:53
  SPEAKER_00: Yeah, I know.
• 1:53
  SPEAKER_00: I'm sorry.
• 1:54
  SPEAKER_00: Let's start, let's start on the customer side.
• 1:57
  SPEAKER_00: Yeah.
• 1:57
  SPEAKER_00: So like to be honest, like the like the biggest misconception that I see from my consulting work is that AI um is very often still treated as a uh pure software NIT topic.
• 2:08
  SPEAKER_00: And I think this is like both on the customer side, but also on the vendor side.
• 2:12
  SPEAKER_00: Lots of companies are you know trying to sell AI as a as a software, as a tool.
• 2:16
  SPEAKER_00: You know, that's like what comes most natural, both to like big consulting, but also to you know uh SAS companies.
• 2:22
  SPEAKER_00: But I think especially with uh generative AI, there's a certain limit to how you can scale and you know, or not scale, but adopt AI by just looking at from a software perspective.
• 2:33
  SPEAKER_00: Because like software is very often just very transactional.
• 2:36
  SPEAKER_00: Like you give something in and you expect a certain output, and ideally you can do that at scale, and then they know that's your business.
• 2:41
  SPEAKER_00: Uh but with generative AI, you know, we have a much more like creative approach to working with generative AI and also in terms of like handling the outputs you know provided by generative AI, which are like inherently more non-deterministic or more probabilistic, however you want to call that, but definitely different to you know what you expect from a normal software as a service product.
• 3:03
  SPEAKER_00: And I think like having both vendors and customers that go through that mind shift is a big challenge right now because like the whole market has been educated towards software.
• 3:13
  SPEAKER_00: Like, you know, you just pay 39 bucks a month and you know, you get this thing out of there.
• 3:19
  SPEAKER_00: But with generative AI, it turns out it's very hard to define what you get as an outcome.
• 3:23
  SPEAKER_00: And if you want to be really crystal clear and define that outcome, that often turns out to like taking the LLM or whatever Gen AI service you have, wrapping a lot of stuff around that in order to tame it and then you know selling the output, and then suddenly it becomes extremely expensive.
• 3:38
  SPEAKER_00: Uh so I think this is you know one of the misconceptions that I currently see, and and also a lot of like uh missed potential by uh, you know, on on the on the customer side.
• 3:47
  SPEAKER_01: Yeah.
• 3:48
  SPEAKER_01: And and so when you I I I like I like the way you put it, you got to put a lot of things around it to tame it, right?
• 3:54
  SPEAKER_01: To put guardrails around it to tame it.
• 3:57
  SPEAKER_01: And so what are the some of the hidden costs?
• 3:59
  SPEAKER_01: Because, you know, what I what we have found, and again, I know I've presented this scenario is when you tell the large language model to only answer from this data source.
• 4:10
  SPEAKER_01: And if you don't have the answer from this data source to say, I don't know, that will reduce hallucinations or mitigate them.
• 4:17
  SPEAKER_01: I haven't found a situation where I've had significant hallucinations in that situation when I've turned the temperature down to zero and I've and I've done that, but still it's it's still possible and you do need to do a lot of testing.
• 4:30
  SPEAKER_01: But tell me about some of the hidden costs.
• 4:32
  SPEAKER_01: So, you know, you're trying to tame it, you're trying to put guardrails around it.
• 4:36
  SPEAKER_01: And then when people, you you when we did the prep call, you talked a little bit about uh in a couple of days, they they do some, you know, they'll use some uh out-of-the-box tool uh tools, just some open source tools, and then uh, oh wow, this is great.
• 4:49
  SPEAKER_01: We just need to put another couple of days into this and we'll be set.
• 4:52
  SPEAKER_01: Tell me about that thought process and that scenario and then what does and doesn't work.
• 4:58
  SPEAKER_00: Yeah, like I I call it the 80% fallacy.
• 5:01
  SPEAKER_00: So people are really eager, and it's very easy to like ship an 80% kind of like ready prototype in even a couple of hours.
• 5:08
  SPEAKER_00: And uh people then start to extrapolate that and say, oh, if we did that in one day, like you know, what can we do in one month?
• 5:15
  SPEAKER_00: And it turns out that in one month, like you can't do that much actually, because like every percentage point that you try to get like more and more accuracy becomes like almost exponentially harder.
• 5:26
  SPEAKER_00: So going from 80% to 90%, maybe you can go do that in like you know, three months or so, but like going from 95 to like 100% or even like 98% becomes incredibly hard because, and I think this is what a lot of people underestimate is like the especially in like these open-ended conversations that you had that you have, or you know, where where people interact with large language models, like you have an infinite number of possibilities of what people can like throw in there.
• 5:52
  SPEAKER_00: And we would expect that, for example, if you just have a slight variation in the type way you question that, or slight variation in the you know, punctuation or whatever you did, that the LLM will be able to figure it out and still give the wrong uh the wrong um output uh the right the right output.
• 6:06
  SPEAKER_00: But it turns out, and like a recent research paper also show that that there are very strange ways that LLMs behave sometimes.
• 6:13
  SPEAKER_00: And there's it's it's literally impossible to catch all these different uh different exceptions.
• 6:18
  SPEAKER_00: And that's not saying that you can't use these tools in production, it's just saying that like there will always be a like minimal risk of that something might go wrong.
• 6:28
  SPEAKER_00: And the really hard part is to quantify that risk.
• 6:31
  SPEAKER_00: Like, are we talking at like you know, 1% uh failure here or 2% or 1.5%?
• 6:37
  SPEAKER_00: And I think this is where we have to approach that a little differently, and this is where the hidden costs come in because you need to have that both expertise but also these systems in place to monitor and assess the risk that you're actually operating at, uh both in terms of accuracy, but also in terms of security and like securing your actual applications and uh software that you especially if you have customer facing LM applications.
• 7:01
  SPEAKER_02: So, Tobias, when you start thinking about those pieces, right?
• 7:04
  SPEAKER_02: Because we look at this from and I don't, by the way, I don't ever see that an organizations take cost up front.
• 7:12
  SPEAKER_02: Right.
• 7:12
  SPEAKER_02: It's usually, which is not not the the bad a wrong thing, because part of it to me is let's understand the use case first and what we're trying to solve.
• 7:21
  SPEAKER_02: Or uh or as I you know, as I see them do this, well, we just want to do something that's really cool and innovative.
• 7:27
  SPEAKER_02: That's the wrong way to approach it as well.
• 7:30
  SPEAKER_02: So when we see these these uh conversations uh going, uh where else do you see them missing?
• 7:36
  SPEAKER_02: Because you brought up IT a bit, but I want to kind of tease that a little bit, but where else do you see the organizations missing?
• 7:41
  SPEAKER_02: So it's one thing to miss on the the the overall use case, it's um cost is usually a miss up front, but then it comes back in because now what does this thing, you know, what does it look like in production?
• 7:53
  SPEAKER_02: But where else do you see organizations missing?
• 7:55
  SPEAKER_02: Like across IT, what does that look like?
• 7:57
  SPEAKER_02: And what have you seen?
• 7:58
  SPEAKER_00: Yeah, I think like what's often missing is the overall, like I mean, strategy is such a uh you know broad word, but just the the big idea of what you want to do.
• 8:08
  SPEAKER_00: To give you an example, like we have uh we have companies like like Tesla, for example, right?
• 8:13
  SPEAKER_00: AI for them is like super mission critical because they want to have autonomous driving.
• 8:17
  SPEAKER_00: If they fail at autonomous driving, like the whole company will go backdrop, maybe not, but it's it's super important, right?
• 8:22
  SPEAKER_00: Uh but then we also have companies like, for example, Moderna, which is like the big shining star use case for uh OpenAI, and they have like you know, uh 80% of their employees are using ChatGPT.
• 8:31
  SPEAKER_00: So it's a very like horizontal approach, but like with lots of like individual like use cases that people do on a small scale, but that have a collective large impact.
• 8:41
  SPEAKER_00: And then we have companies, for example, like you know, big retail giants, like you know, Walmart or like you know, lots of big retailers here also in Germany that have a very pragmatic approach to AI.
• 8:50
  SPEAKER_00: You know, they say, okay, if it saves us like 2% in our supply chain, like you know, of course we're going to do this, like it's a no-brainer.
• 8:56
  SPEAKER_00: Um, and just figuring out where you are in your overall like organizational ambition towards um approaching AI, I think this sets the stage for all the things that come like after that.
• 9:07
  SPEAKER_00: Because if you want to have this whole transformation, then you need to have also someone in your organization that is driving that transformation because ultimately it's also a cultural and people problem and aspect.
• 9:17
  SPEAKER_00: If you want to have these pragmatic approaches to AI, then you need to empower the different business units to just like go out and you know do whatever works for them.
• 9:25
  SPEAKER_00: If you have this transformative use case, then you have to be sure and you also have to manage your stakeholders that there's an expect, there's a certain risk attached to that, that it will eventually fail and not work out.
• 9:35
  SPEAKER_00: And what I see is that you know, companies are not really sure what kind of these games they are playing and kind of like sprinkling in different things from all of these, and sometimes you know, trying to copying what you know currently is on in in hype in Silicon Valley, you know, sometimes just buying a tool, doing stuff here and there, and throwing things against the wall, hoping that something sticks.
• 9:55
  SPEAKER_00: And I mean, to a certain degree, you need to experiment and also need to have like lots of these like low shell like touch points with AI and try things out.
• 10:03
  SPEAKER_00: But I think you should be aware from a leadership perspective, where's your organization going here?
• 10:07
  SPEAKER_00: Because it makes a big difference whether you are an like insurance company, company that I currently work with, like insurance is like heavily affected by AI, their whole business model is kind of like at risk.
• 10:17
  SPEAKER_00: But then there are other uh business models like you know, uh more brick and mortar types of businesses, you know, carpenters, handymans, and so on.
• 10:24
  SPEAKER_00: I don't know, who are probably not that much affected.
• 10:26
  SPEAKER_00: We can still use it here and there, but it's yeah, they will still like be there even after AI, probably.
• 10:31
  SPEAKER_00: So I think this is important to navigate that.
• 10:33
  SPEAKER_00: And you don't have to overthink that, right?
• 10:35
  SPEAKER_00: But you have to figure it out and somewhere have that alignment across leadership, what to do.
• 10:41
  SPEAKER_02: You feel like they should be going into it because I because the the the use cases and stuff they're looking at, I always feel like there should be, which I try to help them understand, you know, risk versus value in terms of the use case they're thinking about.
• 10:54
  SPEAKER_02: But then that leads into well, what's what is the risk assessment according to what this looks like and that could vary for organization?
• 11:01
  SPEAKER_02: What is like I love that you brought up organizational alignment because it's so important.
• 11:06
  SPEAKER_02: The cost assessment, what's the feasibility of the technology feasibility, right?
• 11:10
  SPEAKER_02: They're also thinking about this from the perspective of well, these are technologies we've never even looked at before.
• 11:17
  SPEAKER_02: So, how do we retool our organization to actually understand these technologies?
• 11:21
  SPEAKER_02: And some of them jump in because they know the Microsoft stack.
• 11:24
  SPEAKER_02: So, okay, that means that makes sense, or we see a lot of these types of things.
• 11:29
  SPEAKER_02: So there's a lot that goes into, I think, thinking about this also from the perspective like you brought up.
• 11:35
  SPEAKER_02: What about pattern recognition technologies?
• 11:37
  SPEAKER_02: What about propensity models?
• 11:39
  SPEAKER_02: What about classification models before you even get into generative models?
• 11:43
  SPEAKER_02: Yeah, and what can that look like?
• 11:44
  SPEAKER_02: And I think it feels like there's just a lot of re-education that needs to happen and/or uneducation and then re-education that I find that that is absolutely critical.
• 11:54
  SPEAKER_02: So it's interesting, but at the same time, it's disheartening.
• 11:57
  SPEAKER_02: At the same time, it's so exciting, right?
• 11:59
  SPEAKER_02: All at the same time.
• 12:00
  SPEAKER_02: So but you know, but I'd love to I'd love to get your take too in terms of when we start looking at at some of these challenges and stuff.
• 12:09
  SPEAKER_02: What is what does it look like?
• 12:11
  SPEAKER_02: And where have you seen where we've disappointed these inflated expectations?
• 12:16
  SPEAKER_02: I know you talked about that before, right?
• 12:18
  SPEAKER_02: In the pre-call, but what does that look like?
• 12:21
  SPEAKER_02: And how do we how do you help you know these leaders get over that hump?
• 12:25
  SPEAKER_00: So I think one of the big uh missed expectations, or expectations that we we could not live up to.
• 12:30
  SPEAKER_00: I mean, I'm gonna agree, but generally the AI industry is that there will be more and more progress happening on the LLM front in the same pace that we have seen before.
• 12:39
  SPEAKER_00: So like we have not like we are, I think we are not in the like exponential phase where like you know, we will have superintelligence next year.
• 12:46
  SPEAKER_00: Maybe we'll have, let's see.
• 12:47
  SPEAKER_00: Uh I don't believe in that.
• 12:49
  SPEAKER_00: I I think we will like we are already hitting a limit with with LLMs.
• 12:52
  SPEAKER_00: And this is not to say that like they are they are not useful, but now we kind of kind of like you know concentrate on the use cases that actually work with the technology that we have right now, because there are tons of use cases we can do with that.
• 13:02
  SPEAKER_00: And I think we need to educate you know customers to just focus on you know what's there, not to wait on like what's next in two months.
• 13:12
  SPEAKER_00: Because like from my experience, there are like business leaders sitting there like, you know, and just waiting, you know, waiting what will happen and say, okay, like you know, let's wait until Christmas.
• 13:22
  SPEAKER_00: Like we will have a much better model there.
• 13:23
  SPEAKER_00: We maybe we don't even need rack until then.
• 13:25
  SPEAKER_00: So and I don't think this will happen.
• 13:28
  SPEAKER_00: Maybe it will happen in the long term that we don't need these like toolings around large language models.
• 13:33
  SPEAKER_00: But I think thinking strategically about your use cases, you should position yourself in a uh in a way that you benefit from like AI progress, but not in a way that you kind of like depend on it on like at all expenses.
• 13:46
  SPEAKER_00: Uh so to give you to give you a concrete example, right?
• 13:48
  SPEAKER_00: If you have a chatboard use case uh for customer support and you're currently using a rag architecture to deliver that, you know, that's great.
• 13:54
  SPEAKER_00: Like go ahead and do that.
• 13:56
  SPEAKER_00: However, like keep your eyes and eyes and ears open and like just consider the fact that there might be a you know point in uh in the future where a single call to LLM costs maybe you know not two cents or 0.2 cents, but maybe 20 cents, but like it has all like the RAG tooling included because like you have very high context limits or other AI services or whatnot.
• 14:18
  SPEAKER_00: Would you be able to make the switch?
• 14:19
  SPEAKER_00: Like, would you be able to adopt that technology, or are you so locked in and committed to your current infrastructure that you can't actually move anymore?
• 14:28
  SPEAKER_00: And uh in the end, you know, that comes down to like make or buy decision.
• 14:31
  SPEAKER_00: Like, are you going to like invest in all that technology and build it up yourself, or are you just like using what's there and like consuming these rack services as a services, as a service as they are offered right now?
• 14:41
  SPEAKER_00: And I think right now it's it's good to stay flexible, but it's not like advisable to just like wait and see what's happening.
• 14:49
  SPEAKER_00: So there is this fine border of like taking action, but at the same time not locking yourself too much away into like long-term obligations, which is a fine line to walk.
• 14:59
  SPEAKER_00: But I think like managing that, this is like this is really critical right now.
• 15:04
  SPEAKER_01: So one of the things that um we talked a little bit about in the prep call was um aspirational functionality, right?
• 15:12
  SPEAKER_01: Things that that vendors say they can do, but maybe they can't quite do it today.
• 15:17
  SPEAKER_01: And I think that's a real danger when you're talking about plan making plans around use cases and hearing what you know what vendors say they can do versus what they can actually do.
• 15:29
  SPEAKER_01: Do you want to talk a little bit about that in terms of you know what you've seen and then you know, how do you kind of mitigate uh that risk that they're uh they're ahead of their skis uh on on some of this?
• 15:43
  SPEAKER_00: Yeah, so uh I don't want to call a specific vendor out, but I I think we all have one vendor at least in mind who's kind of like on underleivering on on their promises, especially with uh co-pilot like uh interactions on their on their computers.
• 15:57
  SPEAKER_00: And I think the really important point here for business leaders is to figure out that's why I always say it like in my roadmap, everything starts with AI understanding.
• 16:06
  SPEAKER_00: Like don't fall for you know being sold snake oil and you know having other people like just selling you like you know something out of the blue just because you don't understand it.
• 16:14
  SPEAKER_00: And like there are so many tool vendors out there who that will just tell you something or sell you something because you have no idea what they are talking about.
• 16:21
  SPEAKER_01: Yeah, and they won't make it clear, they won't they won't make it clear, like on purpose, you know, on purpose.
• 16:26
  SPEAKER_00: And and that's why I think if you like if you cover some basics around AI and LLMs, and again, this is not about like you know, taking PhD program.
• 16:35
  SPEAKER_00: So it's about like committing a few hours, uh maybe taking a course, or you know, just diving deeper, trying some things out, you will be in a position where you can ask the right questions, you know, where you can ask these vendors, like, hey, how do you deal with this and that?
• 16:48
  SPEAKER_00: Like, how do you how do you manage the uh non-deterministic behavior of LLMs?
• 16:52
  SPEAKER_00: How do you make sure that like we actually use the data sources?
• 16:56
  SPEAKER_00: So which kind of format does my data need, or what are the requirements for my data in order for your solution to work?
• 17:02
  SPEAKER_00: Because lots of vendors are not transparent about that.
• 17:04
  SPEAKER_00: And like you don't even have to answer these questions for yourself, but just by being able to ask these questions, I think this will make it so much easier for you to like you know cut through the you know, vendors that are just selling something out of thin air and those who actually have a mission and know what they are talking about and helping you implement that.
• 17:24
  SPEAKER_01: Yeah, I totally agree.
• 17:25
  SPEAKER_01: And I think one of the other interesting points that you had made is you said, you know, the generative AI is kind of the cherry on top of things, right?
• 17:35
  SPEAKER_01: Because you need to have so much, so many other elements that are aligned aligned, such as the data.
• 17:42
  SPEAKER_01: And you know, one of the things that we're doing for a large um medical equipment manufacturer is we're going in and we're we're using some of the you know templated agent-based approaches using LLMs to fix the data, right?
• 17:55
  SPEAKER_01: To fix their product data, to enrich it.
• 17:58
  SPEAKER_01: And that's kind of a foundation for everything else that we want to do.
• 18:03
  SPEAKER_01: And and no matter what, you're still going to need good data.
• 18:06
  SPEAKER_01: Like one of the biggest challenges around customer service operations and using Gen AI is again, you don't want to use the Gen AI to answer the questions.
• 18:14
  SPEAKER_01: You want to use the Gen AI to interpret the questions and make the results more conversational, but you need to have your knowledge base and that needs to be you know correctly structured and tagged and organized.
• 18:26
  SPEAKER_01: What are you seeing in terms of you know when vendors are not getting it right or when they're not understanding that piece?
• 18:33
  SPEAKER_01: And you and you kind of alluded to this already where you said, you know, they want to sell software and get licenses, and they don't want to necessarily spend a lot of time with customers trying to go upstream and fix a lot of stuff, but but that is fundamentally what needs to happen.
• 18:49
  SPEAKER_01: So, you know, do you want to talk a little bit about what you're seeing?
• 18:52
  SPEAKER_01: What are they not quite understanding or getting or wanting to deal with?
• 18:56
  SPEAKER_01: Maybe they understand it, but it's like, I want to sell my software, you know, I don't want to, I don't want to fix your data problems.
• 19:04
  SPEAKER_00: Yeah, I think like I don't know if they don't want to understand, but I think the big uh takeaway is that these software vendors uh are selling solutions to problems that they can't fully they they they just can't solve.
• 19:18
  SPEAKER_00: Like if clients don't have data in the right shape, in the right format, or if you know knowledge is contradictory, you can have the best software and in the end it won't work.
• 19:26
  SPEAKER_00: And the software company, it it just can't solve that for you.
• 19:30
  SPEAKER_00: It's just like you know, it's selling you the car keys, but the car is not there.
• 19:33
  SPEAKER_00: It's like very hard to to come up, but then like you have the expectations from investors, external stakeholders, internal stakeholders, to you know, to just drive that software adoption.
• 19:45
  SPEAKER_00: And I think this is yeah, this is this is so important, or this is the critical thing that they don't they don't quite get.
• 19:51
  SPEAKER_00: Um where they are just like maybe like thinking by themselves, really honestly thinking that AI will like at some point fix it in the future, like just hoping that OpenAI will release GPT 5 in the next three months, and then we don't have all these issues anymore because we have superhuman intelligence.
• 20:09
  SPEAKER_00: Uh, maybe that's the bet they are having, but honestly, I don't know, right?
• 20:13
  SPEAKER_02: Well, I mean, you get also get into the thing I love about Germany is Germany pushes the envelope for GDPR and for a lot of the security standards for data out there.
• 20:23
  SPEAKER_02: However, with a CEO that's in a global you've got you know data that is all over the place, and you're also trying to think about that from the perspective of what can be shared, what's sensitive, what can't be shared.
• 20:38
  SPEAKER_02: So, how do you get a whole roll-up view using you know these types of tools?
• 20:43
  SPEAKER_02: How do you how do you instruct customers with those types of perspectives and issues?
• 20:48
  SPEAKER_00: Yeah, uh like for me, I try to um get back the original, get back to the original alignment, like what are we actually to do here, doing here?
• 20:56
  SPEAKER_00: Like if we if we look more for a kind of like divide and conquer approach for AI, I think then you have to also empower the different business units also globally to like ship their own solutions and just like build their own stuff.
• 21:08
  SPEAKER_00: If you see, like, for example, customer support or whatever that is as your one single killer use case, then I think the first step, and that's what I I tell them, is to think about this organizationally.
• 21:21
  SPEAKER_00: Like, what does it mean?
• 21:22
  SPEAKER_00: Who is the owner of this?
• 21:23
  SPEAKER_00: And if you don't have that aligned ownership from the beginning, there's no way you can approach any, like you can get any technology to solve that for you.
• 21:30
  SPEAKER_00: Because in the end, it's about like enforcing rules, ownership, budgeting these things, and then like shipping it and like also taking the risk that it might not work.
• 21:38
  SPEAKER_00: Like, and who's like who is willing to take that risk?
• 21:41
  SPEAKER_00: And that's where a lot of companies, at least the you know, customers that I work with, are rather going for these, yeah, what like what I call like atomic use cases where they give like responsibility away to different business units.
• 21:52
  SPEAKER_00: You have a kind of central alignment where you know what is the high level strategy, like what's the general direction you want to go to, but then at the same Time you empower different business units to just run their own experiments and like um adopt AI as they as they need.
• 22:06
  SPEAKER_00: Of course, like the trade-off of that is that you are really not doing this like whole transformation of your organization.
• 22:12
  SPEAKER_00: You will still run the same business model as before, just like more efficiently and maybe like you know, in a more qualitative and you know, a more powerful way.
• 22:20
  SPEAKER_00: But at the same time, it's a pretty safe bet to do that because you don't have that huge upfront investment, then also there's like the chances for success are just much higher.
• 22:28
  SPEAKER_00: But yeah, like it that that's why I say like it comes back to the original alignment and having that like high-level leadership commitment of saying, okay, like what role does AI play for us actually, and then living that up.
• 22:40
  SPEAKER_01: Yeah, and I'll tell you, I think that in large enterprises that have a lot of fragmented processes and fragmented systems and fragmented data, yes, you can have some point solutions.
• 22:52
  SPEAKER_01: I mean, we went into this project, not even considering it an AI project, right?
• 22:56
  SPEAKER_01: Considering it a knowledge and information architecture and product data project, right?
• 23:01
  SPEAKER_01: We are going to be using AI approaches in solving those problems, but that is not, they they knew they weren't ready for AI at, you know, in the way most people interpret it.
• 23:12
  SPEAKER_01: But but we're going to have small, you know, we're going to have multiple interventions to fix certain aspects.
• 23:19
  SPEAKER_01: But the fact that this whole ecosystem is so fragmented is what's problematic, right?
• 23:25
  SPEAKER_01: That is, you know, growing by acquisitions and you know, who owns the knowledge for this area, who owns the knowledge for this area, where, you know, where do we go upstream for you know level three support, right?
• 23:36
  SPEAKER_01: And there's 20 plus applications that people have to go to, that their field service uh engineers and they're uh they're uh remote service engineers and their technical consultants.
• 23:48
  SPEAKER_01: There's there's dozens of applications that need to go.
• 23:50
  SPEAKER_01: So I think on the one hand, that's where you're kind of saying, well, how can we have a transformation?
• 23:57
  SPEAKER_01: We can have limited interventions in these areas, but we do still need to think of this in an overarching uh manner.
• 24:04
  SPEAKER_01: And I think that's you know, that's where you have to start thinking about what are those incremental value points, right, that that we can show and then show in a longer-term roadmap how all these things can come together.
• 24:18
  SPEAKER_01: So, you know, you know, what what are you seeing there when you work with your customers?
• 24:23
  SPEAKER_01: Are you putting together, you know, like 12-month or 18-month roadmaps?
• 24:26
  SPEAKER_01: I think if you go beyond that, it's it's it's hard to it's hard to say.
• 24:31
  SPEAKER_01: But um, how are you kind of helping them, you know, bring those pieces together?
• 24:35
  SPEAKER_01: Because again, it is lower risk to do have them as atomic projects, but that is you as you observe, it's it's not going to have that overarching transformation.
• 24:45
  SPEAKER_01: So, how do you kind of resolve those two things?
• 24:49
  SPEAKER_00: So, like the the one that you brought up with rope is is exactly it.
• 24:52
  SPEAKER_00: I like I recently um have a customer that is um in in is running a call center operation.
• 24:58
  SPEAKER_00: So, you know, they they are offering call center services here in Germany, and they obviously had that use case to use AI voice bot to like handle the conversations, right?
• 25:05
  SPEAKER_00: Okay, so that's where I came in, and this is like a perfect example because this is like you know, if you have the uh matrix of you know integration and automation, this is a highly integrated and highly automated use case with AI, which is like the most difficult thing you can do.
• 25:17
  SPEAKER_00: And um, you know, after like the first like trials, they figured out, okay, maybe this is not going to work the way we want to.
• 25:23
  SPEAKER_00: And like, you know, this is where like I came in, and then we started working on that.
• 25:26
  SPEAKER_00: And uh the way we scoped that was to say, okay, like this is the high-level goal, like that's where you want to be.
• 25:31
  SPEAKER_00: And obviously, technology right now is not there, it might be there in a few months or maybe years, but like what's the roadmap like to get to that point?
• 25:39
  SPEAKER_00: And so we trimmed down the use case and split it up into different like you know, atomic elements or individual assets.
• 25:45
  SPEAKER_00: For example, the first uh thing that we shipped was a customer support chatbot, which is not integrated and not automated, but uh, which customer support agents, like human agents, could just use while they are on the phone to quickly retrieve information and give that to customers.
• 26:00
  SPEAKER_00: So we just like took a whole part of that journey out and realized that first.
• 26:04
  SPEAKER_00: And then we have the uh text-to-voice feature as kind of the next step on the roadmap to see if we can use, for example, new multimodal AI models where you don't have the voice-to-text and then text-to-voice transcription, which is really like a poor user experience.
• 26:19
  SPEAKER_00: But maybe in a few months where we have like true voice input to generative AI models and also voice outputs from them, which will just have a uh much, which is just much faster interaction, also much better experience.
• 26:31
  SPEAKER_00: And if we are at that point, if technology is coming at that point, then we already have the data sets or the database uh ready and the knowledge ready that we know AI is able to respond to customer questions, and then we can actually validate the next feature, which is uh shipping that as a voice feature.
• 26:47
  SPEAKER_00: And then the next option would be to have that in live conversations with customers.
• 26:52
  SPEAKER_00: And that's what I mean with road mapping and trying to have that high-level goal, but kind of like chunking it down and seeing what's possible today, and then validating step by step.
• 27:00
  SPEAKER_00: And I think this is like the big difference between like just trying lots of use cases in your organization and seeing what works, uh, but then also like in contrast to that, like having that ambitious and like you know forward-looking goal, but being able to bring it down to okay, what can we do right now in order to take the first step?
• 27:17
  SPEAKER_00: And also, if that first step works, what is step number two?
• 27:21
  SPEAKER_00: And typically I look for six-month roadmaps on these projects and uh just reassess after that where where we're standing and what the next steps are tremendous sense because you they build upon one another, they're building blocks, right?
• 27:34
  SPEAKER_01: In order to get agents assist to work correctly for the agents, you know, when they can just refer to something, you're basically improving search, you're improving retrieval, but you're also using some of the AI tools to make that more conversational and understandable.
• 27:50
  SPEAKER_01: You still need to think about the structure of that information, you need to make sure it's correctly curated, right?
• 27:56
  SPEAKER_01: You need to give the rag uh engine something to um uh uh to pull from and then present that to the customer.
• 28:05
  SPEAKER_01: And then you can validate that, right?
• 28:06
  SPEAKER_01: Then you can say, oh yeah, that's working really well.
• 28:08
  SPEAKER_01: Oh, look, our agent productivity has improved.
• 28:11
  SPEAKER_01: Uh, you know, we're spending less time, you know, on callbacks or you know, uh we're we have higher first call resolution, we have shorter time per incident, right?
• 28:20
  SPEAKER_01: We have higher CSAT, we have higher agent satisfaction, right?
• 28:24
  SPEAKER_01: Then that whole component is that building block for that next piece that you that uh gets built.
• 28:31
  SPEAKER_01: So I totally agree with that.
• 28:32
  SPEAKER_01: I think it makes a lot of sense.
• 28:34
  SPEAKER_01: And again, uh for organizations to be successful with these things, you know, they do need to think first about the the use case and then what data is needed to satisfy that use case, what what functionality?
• 28:46
  SPEAKER_01: So when you go into organizations to help with them, uh help them with these processes, where do you begin that?
• 28:53
  SPEAKER_01: Yeah, of course, you start with some education, then you start with, well, what's important to the organization?
• 28:59
  SPEAKER_01: How do you then start breaking it down, say at the board level?
• 29:02
  SPEAKER_01: Because that's one way to start is say, start at the at the most senior level in the organization.
• 29:08
  SPEAKER_00: Yeah, I mean, I would love if it's always that linear way where we start with like uh uh like uh educating on AI uh knowledge and so on.
• 29:16
  SPEAKER_00: But like what typically happens is that uh where I come in is when organizations kind of like try something and it's not working.
• 29:24
  SPEAKER_00: So and that's where we have to kind of reassess the whole situation and in many cases uh circle back, and as I just explained, like maybe reassess the use case.
• 29:33
  SPEAKER_00: And um then there are two ways, like for larger organizations that typically you know becomes a certain business unit or department we are looking at.
• 29:41
  SPEAKER_00: But if the organization is uh is smaller, something like you know, 100 employees or something like that, or up to 1000 at max, uh then you can have um a real like you know, boardroom conversation of you know what's the uh what's the overall goal or the overall challenge that that that we are facing here.
• 29:57
  SPEAKER_00: And then I typically you like run workshops in order to have commitment and alignment on that top level and make sure everyone has the right uh understandings.
• 30:06
  SPEAKER_00: Because like I I remember one conversation like where we had like one uh one group of executives like believing in AI being the next thing and like becoming better and better, and the other group saying like you know, this will never work.
• 30:19
  SPEAKER_00: So and just having this like commitment to what do we all believe actually, what does it mean for our business?
• 30:26
  SPEAKER_00: Yeah, uh, this is it's super critical because like this makes all the difference whether you will say, Okay, uh, this is just another tool or another technology, like you know, let IT deal with that, or whether you say, Okay, we need to treat that seriously.
• 30:38
  SPEAKER_00: And I think this is really where every organization needs to kind of like find their own way in terms of like what's their business model, what have they tried before, and also as we you know said and and as Chris already mentioned, not only looking at generative AI, but you know, AI in general, which is also kind of like you know, uh classical machine learning on so on.
• 30:56
  SPEAKER_00: Uh, and this is where I like you know do AI design sprints and and so on in order to figure out what's like the best uh use case mix here for that organization.
• 31:04
  SPEAKER_02: Obviously, there's a disconnect between above the budget line and below the budget line in most cases, right?
• 31:10
  SPEAKER_02: One of the teams is super advanced, the the um executive team isn't, right?
• 31:15
  SPEAKER_02: Or the opposite, right?
• 31:16
  SPEAKER_02: Somebody wants to go.
• 31:17
  SPEAKER_02: So I would love to get your take too on we find these use cases, and generally the use case is broken in terms of maybe it's too far advanced.
• 31:27
  SPEAKER_02: Because part of this, to your point, in that uh customer experience use cases, we want to completely remove all voice or all you know agents, and we want to do all digital voice, right?
• 31:38
  SPEAKER_02: Because which is a cost savings metrics, which seems like to make a ton of sense in terms of uh all these you know scenarios.
• 31:46
  SPEAKER_02: And when we when we get to a perspective though, centered around, okay, instead of thinking about this from I just want to remove all costs out of out of the equation and make this, I don't want to have agents stuff.
• 31:59
  SPEAKER_02: I think Seth brought up a good point where now we get up, you know, in terms of of the scenarios centered around, it's not necessarily we, you know, we want to shock the system and remove all agents out of the environment because of first call resolution or because of of uh just the overall scenarios.
• 32:17
  SPEAKER_02: It's a matter of, well, why don't we think about this from the perspective of let's provide augmentation scenarios for them to make them more effective so we don't churn as many agents out of the out of the perspective, right?
• 32:29
  SPEAKER_02: So the cost savings can still be there, but let's look at it from a crawl walk run as opposed to shocking the system.
• 32:35
  SPEAKER_02: So what I find generally, and I don't know if you do as well, uh Tobias, is the generally the use case is big, hairy, and audacious, which is super fun and and really neat and interesting.
• 32:45
  SPEAKER_02: However, it's missing the crawl walk run.
• 32:48
  SPEAKER_02: They want to go straight from zero to a thousand in like this, right?
• 32:53
  SPEAKER_02: Yeah.
• 32:54
  SPEAKER_00: Which is, and I think the reason for that is that you know, customers have been educated over a long time by SaaS businesses that that's the case.
• 33:01
  SPEAKER_00: Like you give me 99 bucks a month and you get the full solution, like we all do all everything for you.
• 33:06
  SPEAKER_00: And uh, like every SaaS, like for SaaS businesses, there is no like crawl, uh crawl, walk, run.
• 33:12
  SPEAKER_00: It's just like you know, here you pay, and that's just that's yeah, it's on off.
• 33:15
  SPEAKER_00: You know, that that's it.
• 33:16
  SPEAKER_00: Um, but especially if you build these AI capabilities in your organizations, like, you know, and that's exactly the way I approach it, like, you know, to figure out how can we make our first baby steps into this project.
• 33:27
  SPEAKER_00: And like in 99% of all cases, that's augmentation.
• 33:29
  SPEAKER_00: Like we want to have augmented use cases because it's easy to control.
• 33:33
  SPEAKER_00: It doesn't cost us anything really to try it out, and if it doesn't work, we can just abandon it.
• 33:37
  SPEAKER_00: Like there's no, like, yeah, nothing happens.
• 33:39
  SPEAKER_00: And scaling up from there is much easier because there are so many learnings that you can use in order to take the next steps.
• 33:45
  SPEAKER_00: Um, but at the same time, I think this is like the most critical or the the the critical thing then is that it's not so kind of like easy to sell to you know executives or external stakeholders who have these super high expectations of AI, and then you come and say, hey, maybe we get a 10% increase in productivity here.
• 34:03
  SPEAKER_00: And they're like, wait, that's it.
• 34:05
  SPEAKER_00: You know, and I think this is this is where I think the hype that we currently have is not kind of like benefiting these practical use cases.
• 34:12
  SPEAKER_00: But at least in my impression, like we're we're getting there slowly, that people realize that even a 10% productivity improvement is like a super huge deal if you know if if there's a good RI on that, like depending on what kind of investment you have for this.
• 34:25
  SPEAKER_00: But I think this is um yeah, uh we have to circle in that people are coming from an expectation where you know we have social media posts uh that say like we will all be out of jobs in five years, and AI is doing everything for us, and no one needs to be a programmer anymore, and all these things.
• 34:40
  SPEAKER_00: So like getting that back into reality and saying, okay, like here's the best I can do is 10% productivity improve.
• 34:48
  SPEAKER_00: This is the you know uh communication or the conversation we're having.
• 34:52
  SPEAKER_01: Well, you know, I have a really interesting story about that and setting expectations, and that is where when there are multiple vendors in an organization in a in a project, like when a customer brings in a customer, uh, you know, a vendor that specializes in this, and this customer special uh vendor specializes in that, et cetera.
• 35:11
  SPEAKER_01: And we had somebody who was doing their user experience, right?
• 35:14
  SPEAKER_01: And we do user experience, but for whatever reason, they decided this company was going to design the user experience.
• 35:20
  SPEAKER_01: Now, it's a lot easier to design a user experience than it is to build the application, right?
• 35:26
  SPEAKER_01: Yeah, it's like designing in PowerPoint, designing in Figma, right?
• 35:30
  SPEAKER_01: And mocking things up.
• 35:31
  SPEAKER_01: Where does the data come from?
• 35:33
  SPEAKER_01: We don't know.
• 35:33
  SPEAKER_01: You know, what's the shape of that data?
• 35:35
  SPEAKER_01: I don't know, right?
• 35:36
  SPEAKER_01: What what what happens behind this button?
• 35:38
  SPEAKER_01: I don't know.
• 35:39
  SPEAKER_01: You know, it's like you tell me, let's we have to trace it back.
• 35:42
  SPEAKER_01: And what I was saying to people, this this uh user experience company was saying uh it's not a user experience company I'm working with today.
• 35:49
  SPEAKER_01: So they this is the customer's user experience company, right?
• 35:52
  SPEAKER_01: We have a great vendor uh partner that we work with, but they were saying things like, oh, it's gonna be so great, and everybody's gonna find exactly what they need in the context of what they need it, when they need it, the old, you know, the right information at the right time for the right person, the promise of knowledge manager for everybody.
• 36:08
  SPEAKER_01: Researchers are gonna be able to do this, and and commercial people will do this, and executives are gonna, and they're like setting these expectations sky high, right?
• 36:16
  SPEAKER_01: Like everything's gonna be wonderful.
• 36:19
  SPEAKER_01: And apparently and according according to their beautiful pictures, yeah, it was gonna be wonderful.
• 36:25
  SPEAKER_01: And I had to be the one to say, hey guys, I think we have to manage and temper expectations, right?
• 36:31
  SPEAKER_01: This is not going to be, you know, information nirvana because there's so much other work that needs to be done, maybe in two or three years, right?
• 36:39
  SPEAKER_01: But not in two or three months, because you cannot fix all this stuff.
• 36:42
  SPEAKER_01: And I was hammered for that.
• 36:45
  SPEAKER_01: I was beaten up uh, I was taken out back by a couple of uh executives and beaten with, you know, with rubber hoses, right?
• 36:55
  SPEAKER_01: Because I figuratively, because I said the wrong thing, you know, and I brought everybody down.
• 37:01
  SPEAKER_01: I'm like, dude, you can't, you know, is it better, it's better to set expectations realistically today than have people be disappointed tomorrow.
• 37:09
  SPEAKER_01: And I think the challenge was many of those executives were going to be on to their next project, right?
• 37:14
  SPEAKER_01: So so I think it's it really is important to set those expectations and manage those expectations and be realistic.
• 37:21
  SPEAKER_01: But you know, a lot of times that does not get the excitement.
• 37:24
  SPEAKER_01: So I think sometimes when you're too realistic with organizations, they they don't really like it.
• 37:30
  unknown: Yeah.
• 37:31
  SPEAKER_00: Same here.
• 37:32
  SPEAKER_00: Yeah, I have exactly the same experience.
• 37:33
  SPEAKER_00: Like I was in a project doing an architecture review for a RAG application and like giving recommendations of what it costs to implement that.
• 37:39
  SPEAKER_00: And like in the end, like there was no business case anymore for that, for the internal product.
• 37:44
  SPEAKER_00: Yeah.
• 37:44
  SPEAKER_00: Uh turns out uh they just got someone else in who had a different opinion, and that's it, right?
• 37:50
  SPEAKER_00: Like because the problem is that the owner of that product already sold the solution internally to the top-level management.
• 37:57
  SPEAKER_00: So they were actually not really interested in having a real uh assessment of that application.
• 38:02
  SPEAKER_00: It's about getting external confirmation that this is actually working.
• 38:06
  SPEAKER_00: But that's not how I work.
• 38:08
  SPEAKER_00: And the problem is that there are a lot of people out there actually who just sign these things off and say, oh yeah, you know, if we have these and these assumptions, you know, we'll be fine.
• 38:16
  SPEAKER_00: Just, you know, maybe take six months more to work out.
• 38:19
  SPEAKER_00: And this is exactly where lots of organizations are right now, deeply invested into very, very complex AI use cases that get more expensive by the day and not delivering the results that they were originally promised.
• 38:33
  SPEAKER_00: And um, I think this is just not useful for AI adoption in general.
• 38:37
  SPEAKER_00: And um, yeah, but it is what it is.
• 38:39
  SPEAKER_00: And I think I think we have seen that in other technology type cycles before.
• 38:42
  SPEAKER_00: So, you know, I've I yeah digital transformation.
• 38:45
  SPEAKER_00: We we had big data, uh like yeah, I I don't know where we would start with that.
• 38:50
  SPEAKER_00: So there's so much, and I think this is happening all over again.
• 38:53
  SPEAKER_01: Um, and and you know, what's really funny is I was on the ground with um, I'll name the company because uh I I I used all public information when I wrote about this, and I used my own experience as Verizon, right?
• 39:06
  SPEAKER_01: And and according to and when I was talking to people at Verizon, you know, I'm hearing stuff on the ground, but I as a customer had a terrible, terrible, miserable, like impossible experience, right?
• 39:17
  SPEAKER_01: And I wrote an article about it in Customer Think, and it started off me being so angry at how I was dealing with Verizon and how you know difficult they were, and how I got sent in endless loops and then told go here and go there.
• 39:31
  SPEAKER_01: And then I found out, you know, even a year after the fact, they still weren't honoring the deal.
• 39:36
  SPEAKER_01: It's a long, long story, but my point was I put it in the context of six fails and six fixes around their digital transformation.
• 39:44
  SPEAKER_01: And one of the things that they were saying publicly was, oh, our digital transformation is this huge success.
• 39:49
  SPEAKER_01: And all the executives say it's a huge success, and all their marketing says it's a huge success.
• 39:54
  SPEAKER_01: And I, as a customer, and and plus I knew people internally, but I as a customer was experienced it as a miserable failure, miserable failure.
• 40:04
  SPEAKER_01: Yet everything was saying it was an enormous success.
• 40:07
  SPEAKER_01: And I think the executives are fooling themselves, I think they're they're lying to themselves.
• 40:11
  SPEAKER_01: I think they get other executives that don't want to speak the truth, that don't want to say the emperor has no clothes.
• 40:17
  SPEAKER_01: And I think that's what's happening with AI these days is that people are so dug into these projects.
• 40:24
  SPEAKER_01: And for those organizations that kind of feel like, hmm, there's something not right here, you know, it's not too late to reassess and and to come back to some real value, right?
• 40:36
  SPEAKER_01: And that's where, you know, people like you and people like me, you know, and I'm sure Chris, in your in your dealings, you try to be, you try to speak the truth and you try to give people the real answers.
• 40:46
  SPEAKER_01: And even if they don't want to hear it, it's like it's a your duty to tell people what the reality is and what they need to do.
• 40:53
  SPEAKER_01: But a lot of times it's in a politically fraught environment, nobody wants to make that that statement, nobody wants to say that stuff.
• 41:00
  SPEAKER_02: And you you cannot report on assumptions, right?
• 41:04
  SPEAKER_02: Most of the data is assumptions, and so you can't say, hey, I'm gonna report this to Wall Street or to the world or to whatever else.
• 41:12
  SPEAKER_02: And oh, yeah, let me just make sure that points two, three, and six are just broad assumptions.
• 41:17
  SPEAKER_01: Right.
• 41:18
  SPEAKER_01: They have asterisks at the bottom of the report, right?
• 41:21
  SPEAKER_01: That said, you know, this is aspirational functionality based on what our vendors are telling us.
• 41:25
  SPEAKER_01: Yeah, but but you know, at the same time, even though things can be so fraught, I don't want to end on a negative note.
• 41:30
  SPEAKER_01: I want to say that it's very, you know, there's a lot of possibility, there's a lot of potential, there's a lot of value.
• 41:36
  SPEAKER_01: And, you know, going about these things in a certain way that will ensure that value, right?
• 41:42
  SPEAKER_01: Because you can do validation points, right?
• 41:44
  SPEAKER_01: As you were mentioning, you build on things, you make things modular, you have building blocks, you validate your assumptions, you you get proof points, right?
• 41:53
  SPEAKER_01: You show in use cases that you can actually accomplish something, right?
• 41:57
  SPEAKER_01: That's why use cases are so critically important and baseline measures, right?
• 42:02
  SPEAKER_01: So uh if you can get the data and show the data, you know, you can make tremendous, uh, tremendous uh inroads.
• 42:08
  SPEAKER_01: So uh Tobai, so where can people find you?
• 42:11
  SPEAKER_01: I know you have your website, uh your it is uh rapid uh uhai, correct?
• 42:20
  SPEAKER_00: Absolutely.
• 42:21
  SPEAKER_00: I also have my uh you know personal website, to beastswigmon.com, uh, where people can sign up to my newsletter.
• 42:27
  SPEAKER_00: Uh but rapidai is also a uh perfect address to check out.
• 42:30
  SPEAKER_00: And obviously LinkedIn.
• 42:31
  SPEAKER_00: Like I'm posting on LinkedIn regularly, so if you want to connect with me or you know, follow me there uh anytime.
• 42:36
  SPEAKER_00: And uh yeah.
• 42:38
  SPEAKER_01: And and tell me about your your world.
• 42:40
  SPEAKER_01: Like I know you uh what else do you like to do outside of the generative AI and AI in general?
• 42:45
  SPEAKER_00: What do you like to do with your watching watching human watching human AI unfold?
• 42:50
  SPEAKER_00: I have three kids under 10, so it's really fascinating to spend a lot of time with them and just play and hang out and you know.
• 42:57
  SPEAKER_01: Watching those large language models get built, right?
• 43:01
  SPEAKER_00: Get built, yeah, and and produce some real hallucinations.
• 43:05
  SPEAKER_02: But you you gotta you gotta be careful because you're doing the fine-tuning.
• 43:09
  SPEAKER_02: Exactly, yeah, exactly.
• 43:10
  SPEAKER_01: Yeah, it's a really good point.
• 43:13
  SPEAKER_00: A bunch of random data, so let's see how that turns out.
• 43:15
  SPEAKER_00: Yeah, yeah, and guardrails, right?
• 43:19
  SPEAKER_01: Guardrails, yeah.
• 43:20
  SPEAKER_00: Yeah, you know, I like my my daughter is turning 10 soon, so I'm not sure if these guardrails will like, you know, how long they will last, but let's see.
• 43:28
  SPEAKER_01: They get all torn down.
• 43:29
  SPEAKER_01: Have you seen uh is it what's the name of the the the uh uh Pixar movie?
• 43:34
  SPEAKER_01: It's about the the the emotional oh yeah, with the emotions.
• 43:37
  SPEAKER_00: Yeah, I've seen the first one.
• 43:39
  SPEAKER_00: Is that what it's called?
• 43:40
  SPEAKER_00: Yeah, yeah, yeah.
• 43:41
  SPEAKER_00: I just know the German title, alles steht Kopf.
• 43:43
  SPEAKER_00: I don't know the English title, but yeah, to be seen.
• 43:45
  SPEAKER_01: Uh there's is there two of them now or three of them?
• 43:48
  SPEAKER_01: Two of them, right?
• 43:50
  SPEAKER_01: Absolutely brilliant, absolutely brilliant, and and absolutely represent representative of what goes on when we you know build our world and our mental models and our representations, and then tearing down that model and rebuilding it, you know, when you when certain things happen.
• 44:07
  SPEAKER_01: It's a brilliant, brilliant movie.
• 44:09
  SPEAKER_02: But absolutely I like one of my 16-year-olds actually was like, Dad, that's exactly how I feel for anxiety because they got anxiety really good.
• 44:19
  SPEAKER_02: And he was he was super serious and he turns, he's like, He's 16, and he's like, Oh my gosh, that's exactly how I feel.
• 44:26
  SPEAKER_02: Holy cow! And he's on this spectrum as well, so he couldn't articulate that until he saw yeah.
• 44:31
  SPEAKER_01: Oh, it's a it was so well done.
• 44:33
  SPEAKER_01: I mean, I think it's one of the it's it's great when a movie can be entertaining and insightful and not pedantic, but but but you know, really, really meaningful.
• 44:44
  SPEAKER_01: I think it's such a great movie um for for humans and uh and for for humans for humans building their AI models, right?
• 44:53
  SPEAKER_01: They're they're they're uh they're they're it's not artificial, right?
• 44:57
  SPEAKER_01: It's real, it's reality, it's actual intelligence, right?
• 45:00
  SPEAKER_01: It's it's absolutely intelligence.
• 45:02
  SPEAKER_01: So anyway, but um, well, that's that's great.
• 45:04
  SPEAKER_01: And you I guess you like to do a lot of outdoor stuff with the kids.
• 45:07
  SPEAKER_00: Yeah, we go swimming and outdoors playing football, like you know, uh I have two boys, so yeah, hiking.
• 45:14
  SPEAKER_00: Yeah, we went to uh Switzerland for summer holidays and went there for some uh you know mountain touring and so and you know it's just like a uh really beautiful spot to be there the whole time.
• 45:25
  SPEAKER_01: I love Switzerland, it's a beautiful place.
• 45:27
  SPEAKER_01: Well, Tobias, this has been a lot of fun.
• 45:30
  SPEAKER_01: I really want to thank you for your time.
• 45:32
  SPEAKER_01: It's been great to have you, and uh, we'll have all uh your contact information in the show notes.
• 45:37
  SPEAKER_01: And um again, thank you for your time.
• 45:39
  SPEAKER_01: Thank you for participating.
• 45:41
  SPEAKER_01: Thanks for having me.
• 45:42
  SPEAKER_01: It was a pleasure.
• 45:43
  SPEAKER_01: Thank you.
• 45:43
  SPEAKER_01: And thank you to our audience for tuning in.
• 45:46
  SPEAKER_01: Um, and uh Carolyn doing all her work in the background.
• 45:50
  SPEAKER_01: Thank you, Chris.
• 45:51
  SPEAKER_01: And again, uh, this has been another episode of Early AI, and we will see you next time.
• 45:57
  SPEAKER_01: Thanks.
• 45:58
  SPEAKER_01: Thanks, Tobias.
• 46:00
  SPEAKER_01: Thank you.
• 46:01
  SPEAKER_02: Visit early.com to find links to the full podcast on all audio platforms to listen on the go.
• 46:08
  SPEAKER_02: Thank you for watching.
• 46:09
  SPEAKER_02: Contact us today at info at early.com.