Latest / Agentic Conversations (formally mlops.community) / AI, Marketing, and Human Decision Making // Fausto Albers // #313
Transcript
- 0:00So my name is Fausto, and I'm an absolute enthusiast in live
- 0:07innovation and technology. I'd like to connect seemingly
- 0:11despairingly ideas and most of the times I'm dead wrong.
- 0:14But sometimes I'm not. And, and at least we can have an
- 0:19interesting conversation about it.
- 0:20And that is the very human quality that you'll see in this
- 0:24podcast that really counts. We are back for another ML OPS
- 0:28Community podcast. I'm your host, Dimitrios, and
- 0:31today we're doing a session that I like to call Fridays with
- 0:35Fausto. He has become one of my good
- 0:39friends and every time I talk to him, I thoroughly enjoy it.
- 0:43I love talking to him because he is very transparent about how
- 0:46he's building, how he is trying to use all the new stuff that's
- 0:50coming out in the world. We get into some of the topics
- 0:54like the new image generation models, and of course,
- 0:57everybody's favorite MCP. Let's jump into the conversation
- 1:03now and as always, give us a review.
- 1:06Leave some stars. Do what you can to help the
- 1:10algorithm know. This is awesome.
- 1:18Wild. The image Gen. stuff is
- 1:21absolutely wild and we wanted to talk about this before even Open
- 1:27AI dropped. And then I found Rev AI, or if
- 1:32you put it all together, it kind of looks like it says reveal,
- 1:35which I have no idea how that's working.
- 1:38So first thing on my mind with the image use case is that I've
- 1:44been seeing a lot of folks in the marketing department take
- 1:48Facebook ads and then they say to their prompt is basically use
- 1:54this photo, but put my product, which is another photo in the ad
- 2:00and AD like this text and it will do it so well.
- 2:05And that is highly valuable in itself, but is quite manual if
- 2:10you think about it. So I'm almost extrapolating it a
- 2:14few steps forward and thinking, you know what, what about when
- 2:20you set up a pipeline that will just continuously look for the
- 2:26best performing Facebook ads or the best performing ads on
- 2:31different platforms? Exactly, this was just I was
- 2:34thinking about that man. And then you're taking those,
- 2:37you're just swapping out your product and then you are
- 2:40throwing them in and testing them on different platforms and
- 2:44seeing how well they work for your specific product.
- 2:48Yeah, it's like real time generation.
- 2:52I mean in anything that we see in Gen.
- 2:54AI, I think an interesting thing is like not just on itself, but
- 3:00how you know to combine it with existing technologies and in
- 3:04this case AAB testing a scale, right.
- 3:08And before we kind of had to make all the content ourselves
- 3:13and then test it. And there is still sort of
- 3:17aiming at user groups and this makes it possible to aim it at
- 3:22the individual. But one step back and maybe from
- 3:26a bit of like meta perspective, like what Gen.
- 3:29I, what generative AI lets us do is to create the world's that we
- 3:34are envisioning. This was literally the first
- 3:37thing that I thought when I was introduced to GPT in GPTS in
- 3:42back in 2022, I was taking a walk with my girlfriend to the
- 3:46forest and I couldn't stop talking about like this.
- 3:48I dare that we're entering a world where anything that you
- 3:52can envision can be created in the digital world and therefore
- 3:56has an I have an impact on the real world and so that it's
- 4:02still hard, you know, even even when you know what you're doing
- 4:05because to translate your creativity, do anything useful.
- 4:11I mean, you're concept is as strong as your ability to to to
- 4:19explain it, right? To to explain to someone else or
- 4:22to an AI. Now, before we're going to
- 4:27touch, I'm sure a lot of interesting topics, but one of
- 4:30those things in the AI ecosystem that can really help there is
- 4:35like Super whisper and Wisp flow and all these kind of things
- 4:38that are based essentially helping you yeah to to give
- 4:44words to your concept, right. So that's one I mean you could
- 4:48do that iteratively with any kind of tool as well.
- 4:53But yeah, I think that that's that's very interesting because
- 4:56sometimes you sort of have this vision almost this this not just
- 5:00urge like, oh, this is like the the app or the thing that I want
- 5:03to create. But you know, you don't exactly
- 5:06know how to put words with. And it gets more and more
- 5:08important to do that. And whether it is to prompt a
- 5:13image generation model or in a more complex workflow where this
- 5:17gets integrated right, because, you know, making images is nice,
- 5:21that's one thing. But to be able to integrate it
- 5:24into a workflow, say you're building an app with a sick
- 5:30front end in cursor, then first of all, you should have have
- 5:35your, you know, your idea in in in in intricate project
- 5:40description, which is where AI can help you.
- 5:44But then it's extremely important because a is are
- 5:47absolutely infallible right to feed the right context
- 5:52information, what to do, what not to do, what libraries to use
- 5:57at the right time. So at inference and yeah, with
- 6:01with coding ID ES like cursor, like windsurf and and many
- 6:05others like they let you granularly adjust this and then
- 6:11image generation becomes one part of that workflow.
- 6:14I mean, I didn't check, but the last MCPI was using for image
- 6:19Gen. was stability II. But most likely there's already
- 6:22an MCP out there, right? For the new open AI 4 O and
- 6:26native image generation. So, yeah.
- 6:31So to make a jump here at how I was using it, I was building
- 6:33this this website and I wanted to have a check box between two
- 6:37elements. And instead of going to Excel
- 6:41draw and draw it and then point at it and then feed it to back
- 6:44to the AII actually had it, you know, I made a print screen of
- 6:48the current state. I fed it to GPTI said like I
- 6:51want a chat box in between make it, you know, design it nicely
- 6:54and it came back and all the text, everything in that whole
- 6:57wireframe was exactly correct with the chat box added.
- 7:01Then I added back to cursor. Then I call my 21st half magic
- 7:05front end MCP 2 draws like this, element chooses by itself,
- 7:10injects the code into the workflow and voila.
- 7:14Well, let me tell you how I'm thinking about this because
- 7:16you're during it. And again, this is incredible
- 7:21how you're seeing like lift on your workflow in a way.
- 7:26But I, I think about it as a platform engineer or an ML
- 7:30engineer that is trying to create business value for their
- 7:35company and they're looking for use cases that can add
- 7:40significant value for the company, right?
- 7:43And so I can imagine if you're a good ML engineer or engineer,
- 7:53even product, it's probably more of the product folks that are
- 7:56going out there and they're talking with the company and
- 7:58saying, hey, how can we plug in AI to your workflow?
- 8:02What is what are the things that you do on a daily basis that are
- 8:06time consuming? And somebody in the marketing
- 8:09department says, well, I'm constantly doing research on ads
- 8:14and then I'm asking our designer to create different variations
- 8:19of ads. And then I take those and I add
- 8:21them to Facebook or I add them, I add them to XYZ.
- 8:24And with Facebook, it's incredible because the creative,
- 8:28the actual image is your targeting in a way.
- 8:34These days, you don't have to be.
- 8:35It used to be where you would have to try and figure out the
- 8:39exact persona down to since their birthday, their
- 8:44neighborhood, that type of thing.
- 8:47But now it's not as much that because the ads algorithm is so
- 8:52good that it can look at the creative and know, all right,
- 8:58let's show this to these people and then let's see what kind of
- 9:01signals we get and then we'll show it to similar people.
- 9:04And so the marketers say the creative is the targeting.
- 9:10And because of that, like we were saying, you can just AB
- 9:13test so much more and you can create so many more variations.
- 9:18Whereas when you were bottlenecked before and saying I
- 9:21can only create 30 pieces of creative per day and we're
- 9:27paying quite a lot for that whole workflow in time.
- 9:33Now it's like I can just have the human looking at all of
- 9:38these different creatives that are being churned out
- 9:40continuously and making sure that the text and the words are
- 9:44are correct or there's nothing funky in it.
- 9:47And then you can imagine the workflow is just clicking a box
- 9:50and pushing it right to Facebook.
- 9:54There is still the human in the loop right in this in this
- 9:58paradigm. And I think what is what is
- 10:02interesting to me is that with every new innovation there is as
- 10:09now like the the the talk about how is this going to be
- 10:12implemented? It's going to be human loop.
- 10:14Is the quality going to be good enough and and how is it going
- 10:18to affect industry XYZ. Now those are valid discussions
- 10:24to have, but I think that it's also interesting to look how
- 10:29it's going to not influence the current state of the world.
- 10:33Like, for example, take marketing content.
- 10:37This post of this dude went viral on.
- 10:39I saw it on LinkedIn, but but he created sort of like Don Draper
- 10:44style advertisements and he said like marketing ads.
- 10:48It's it's so over, right? And then I thought, yeah, it may
- 10:52be in the short run, but in a sense, marketing is about
- 10:56influencing humans on an emotional level in order to, you
- 11:02know, in manipulate decision making, right.
- 11:07Another interesting development in AI and actually Cass Sunstein
- 11:12from one of the authors from the influential book Nudge Nudge
- 11:17Theory published an interesting paper last year called
- 11:22Patronalistic AI and Choice agents.
- 11:24It was picked up by nature Google it.
- 11:26It's interesting and where he argued that AIS are AI agents
- 11:32are efficient decision makers, right?
- 11:34And we're going into a world where AIS are making decisions
- 11:38on behalf of the their users. Now, I think we can see some
- 11:42some early stage examples from this, this already happening.
- 11:47But that essentially means that marketing traditionally tries to
- 11:51influence the end user, the buyer.
- 11:54But what if the decision maker, maybe not the end decision
- 11:59maker, but in large part is an AI or a set of AI agents?
- 12:03And then how is the traditional marketing still useful if, you
- 12:10know, people make their decisions on what their AI agent
- 12:15is basically suggesting, right? Because we know that we're
- 12:19manipulative. We know that we're that we do
- 12:23that we do buy things that we should not, right?
- 12:25So I think when marketing becomes so much more effective,
- 12:29you're also going to see a backlash, especially when in the
- 12:32younger crowd of Gen. Z that are saying like, all
- 12:36right, I'm, I'm going to sort of like offload my decision making
- 12:39because I'm making too many decisions.
- 12:40I don't want to be manipulated, especially not when you know
- 12:45more and more capable AI and people understand that stuff as
- 12:49well, right. So then I think that the whole
- 12:52sort of like Don Draper style advertisement, the advertisement
- 12:57may be dead, yes, but in a different way that they are
- 13:00suspecting now. Not because the images are
- 13:03getting generated, but because it's going to be a whole nother
- 13:07way. Like they probably need to find
- 13:09a way to influence the descriptions and and and all the
- 13:16information that a buyer's AI would spider to to sort of
- 13:21influence that if you if it doesn't make sense.
- 13:23It's almost like the tactics aren't going out of style
- 13:27anytime soon. They're still going to be
- 13:29useful, but the way that we implement those tactics are
- 13:32going to be different. Those are fascinating things to
- 13:35touch on, but I also wanted to steer the conversation in the
- 13:40direction of MCP. And just because I've heard some
- 13:47folks in the community talk about how useful it is, but also
- 13:53how it's like, huh, I don't know if I really get it.
- 13:56And then most recently I have been reading a thread in the
- 14:01community from MEB who started this and shout out to MEB who's
- 14:06like talking about using anthropic API and just having
- 14:12the worst time ever. So I know they're having some
- 14:16uptime issues over there at Anthropic.
- 14:20Godspeed to them. Hopefully they get it sorted
- 14:22out. But it's like you want to try
- 14:25and, and build a service and there's this cool thing that now
- 14:29has a lot of attention, attention like MCP.
- 14:33And next thing you know, you're trying to integrate it in and
- 14:37there's these bottlenecks in your stack where you're
- 14:40recognizing like I, I can't have this as a service for my company
- 14:46if we have specific SL as, and that's not a specific MCP thing.
- 14:51It's more just like a general system thing that where MCP
- 14:57might not be the point of failure, but then you're
- 15:01recognizing like, oh man, I've got this.
- 15:03I'm I'm relying on Cloud 3.7 and it's just not working.
- 15:07No, but that of course Entropic came up with the multi context
- 15:14protocol as an open, an open thing to use, right.
- 15:18I've even heard that Open AI is looking to yeah, is looking to
- 15:21adopt it as well. So those are two separate
- 15:24things, right? You're talking about the uptime
- 15:26of the model. I think that is something, I
- 15:29mean, as developers and people that use AI for coding
- 15:34assistance, we've been relying on a sonnet since that 3.5
- 15:40release upgrade I think in autumn 2024.
- 15:43It's just by some margin the best.
- 15:47SO 3.7 was much anticipated 3.7 thinking 3.7 Max now in cursor
- 15:52as well. So I feel it might just be sort
- 15:55of overload use and and and and honestly, I have been, I've been
- 16:03actually since I upgraded to a cursor dot .481.
- 16:10I think it was like the last update, still a little buggy,
- 16:13but they introduced an enhanced and improved model routing
- 16:19system, which is on itself something to be seen in a in a
- 16:24bigger scheme as well. Because again here, like making
- 16:30choices is a hard thing to do. Making informed choices is a
- 16:34harder thing to do. And to be using the most
- 16:39efficient, most capable model for whatever your use case is,
- 16:43that's, that's a hard thing to do.
- 16:45So we probably as a whole tend to use too much force.
- 16:50Yeah. And I'm sure that that that
- 16:55cursor will improve this capability.
- 16:58And also then sort of walks around the problem if models
- 17:03have downtime, because there's a lot of models that we can use.
- 17:07I mean, DeepSeek-V3, the new one, Gemini 2.5 Pro was, I just
- 17:14saw it pop up in my model listing all benchmarks, right.
- 17:18But yeah, yeah. And, and the context window, I
- 17:20mean, because, you know, in the beginning, you know, we were
- 17:24just using it for scripts then then a few scripts in your
- 17:28project. But especially when you're like
- 17:29integrating back end and front end, there's can be hundreds of
- 17:33different files and, and, and all sorts of dependencies that
- 17:38you're that you're relying on. So the context window becomes
- 17:40really important. And I'm curious to see how our
- 17:43Gemini is going to change that, if if if anything.
- 17:48Yeah, because now we know that you might see it does so well on
- 17:53all these different benchmarks, but that doesn't mean much.
- 17:57It is a cool thing to use in your marketing material when you
- 18:00come out with this and it's great for people to share
- 18:03online. But until you actually get your
- 18:07use case in front of it and see how it works and see how or even
- 18:12your workflow and see how it integrates with what you're
- 18:15trying to ask it, you don't have the best idea of what it's
- 18:21actually going to do. Now you know, you know that I
- 18:25that I used to own a restaurant, right?
- 18:27And, and it was inspired on New Orleans, LA because I thought
- 18:33that that that history was amazing because creativity was
- 18:37born out of scarcity, right? The kitchen and the music.
- 18:42It's, it was all from very little and that and, and, and
- 18:48and and and scarcity is the model of innovation, right?
- 18:51And, and at the moment with AI, we're in an age of abundance and
- 18:58we're getting, we're really waiting for another crazy good
- 19:04model to solve our problems instead of being really creative
- 19:08and seeing what we can do. For example, like in what
- 19:13intricate way you could use NCPS and, and, and, and rules
- 19:18incursion I'm referring to. But in, in general, it's more
- 19:21about making all these different calls and making sure that the
- 19:24right information is being sent at the right moment.
- 19:27And MCPS are a way that you could orchestra this rules are
- 19:32another way. But and, and like we're, it
- 19:38feels like we're sort of spoiled and it takes some focus of our
- 19:44ability to creatively come up with problems and really think
- 19:47hard and deeply and longer about a certain problem with a certain
- 19:50model and. Because there's always, so it's
- 19:53like the grass is always greener.
- 19:55So you're like, well, maybe if this model can't do it, then
- 19:57we'll try it, we'll swap it out. Yeah, And, and, and I think, you
- 20:02know, there's a lot of voices that say like, oh, like people
- 20:05are getting lazy. It's going to kill creativity.
- 20:08I don't think so. I mean, there's, there's,
- 20:09there's different. People have always responded
- 20:12differently to innovation and you know, the the, the naturally
- 20:17curious. We'll explore and and and we'll
- 20:20do, I think, but. Is the.
- 20:26Ever expanding model capability, ever going to come to and halt?
- 20:30Well, there is a way to look at it that you know, scaling laws
- 20:33and as in pure pre training. Yeah, I mean, it's going to stop
- 20:40once right there, there's only so much energy and and money in
- 20:46the world. But maybe I'm actually curious
- 20:50to see maybe that's a good thing because that will force us both
- 20:53the, the innovation labs, PPC, open AI, etcetera, to do all
- 20:59these different things like latent latent reasoning without
- 21:05tokens, inference time, compute different algorithms like the
- 21:11ones that the DeepSeek release and, and at the application
- 21:15layer as well. Like how do we make sure that my
- 21:18AI gets, you know, these calls the right information at the
- 21:21right time, etcetera. So while there's no real reason
- 21:24to think that the raw capability of a is is going to go down
- 21:28quickly, it is interesting to see if, if, if there's maybe a
- 21:33little rest, maybe maybe this is me just just just sort of like
- 21:38wishing for for a little Peace of Mind to figure out what I
- 21:43should do to get the most out of what is now, you know, Well, the
- 21:47other side of that is things that I've heard folks talk a lot
- 21:50about, which in a way could be likened to the term forward
- 21:56compatibility. Where you have backwards
- 21:58compatibility, but then you also want to be thinking about
- 22:02forward compatibility. And a perfect example of this is
- 22:05when we had Flores on the podcast, I think a month or two
- 22:09ago, and he was talking about how he did so many janky things
- 22:14in the beginning to try and extend the context window.
- 22:18And then three months later, he basically had too much context
- 22:23window in all the models, and so he no longer had to do that
- 22:27stuff. And he also was thinking, would
- 22:30my time have been better spent trying to optimize other things
- 22:34and then recognizing that the context window was going to get
- 22:38better? And so because you don't have
- 22:41this crystal ball, you don't really know which part of this
- 22:45whole system is going to get better in the near future.
- 22:50So I can let time be the one that optimizes that for me
- 22:56instead of myself spending the time and brute forcing it.
- 23:02Yeah. Well, I mean to answer the
- 23:04question, one should really know where what it is that you're
- 23:08optimizing for, right? I think a lot at the moment
- 23:14feels, you know, the energy that we spend on, on, on on learning
- 23:20about new things and and and and and, yeah, learning to work with
- 23:25this new technology. And for myself, it's, it's
- 23:29genuine curiosity and, and, and for marvelling.
- 23:35But I have to admit there's also this sort of race, right?
- 23:38I, I have to keep up with, with, with the beer, the beers in, in
- 23:43the builders community and, and everyone is, is doing it.
- 23:48And, but you have really, we don't really know yet what it is
- 23:52that we're optimizing for to become the best.
- 23:54What I mean, it's only a few years ago we said prompt
- 23:57engineer and now prompt engineering is still important.
- 24:02But I think it's important in a way that you are able to, to use
- 24:06the tools to write the prompts for you Again, same as with the
- 24:11cursor rules. I mean, a set up, a good cursor
- 24:15rule set up for a, for a, for a large project would in my
- 24:19opinion, require hundreds of rules like different NDC files.
- 24:24And now there's ways to have the AI in cursor write your cursor
- 24:29rules and update things that are good and, and, and and make note
- 24:34of things that were that didn't work out.
- 24:36So then it, it is maybe less of a skill of writing those rules,
- 24:41but it is, it is and, and increasingly a skill of knowing
- 24:46how to work with these little tools to, to do what's, yeah,
- 24:52optimal. Yeah, and knowing what good
- 24:54looks like, so that if it does break the rules or if it does go
- 24:58off the rails, then you you have that.
- 25:00But dude, how are you? How have you been playing with
- 25:03MCP and where have you found it intriguing or absolutely mind
- 25:11blowing? If we want to.
- 25:13Get really out there on it. Yeah, man, it's, I mean,
- 25:18essentially it's nothing new because we could already do it
- 25:22with function calling, right? And when agents were introduced
- 25:27to cursor, literally the first thing that I did was to create a
- 25:31tools dot Pi file and then define the tools that I wanted
- 25:35there and then instruct the agent to use the tools dot Pi
- 25:39file. If so, that that was kind of
- 25:41doing the same, but not as good. So what makes MCPS special?
- 25:47That it is yet another abstraction around complexity.
- 25:53It is a unified manner to connect server and client and
- 25:58that makes it well. And there's a huge open source
- 26:01community evolving. So if you have a need, then you
- 26:05can just, you know, look in one of these forums or or on GitHub
- 26:10and you'll find an MCP quite surely.
- 26:13And that has been quite impactful because so my my game
- 26:20is more back end than front end. And when designing apps, there's
- 26:26now MCPS, for example, the one of 21st Def magic.
- 26:31I highly recommend you check that one out.
- 26:33What? What is that?
- 26:34At 21st def is a platform where there is a huge library of
- 26:39components, templates, basically pieces of code, front end code
- 26:44that you could use in your project.
- 26:46And the MCP 2 is you can call it by back slash UI or it
- 26:51recognizes your intent. But mostly with MCPS if you
- 26:56really want them to use then call them you know deliberately
- 27:00and and it will communicate to 21st dev.
- 27:05And based on your description. For example, I want a hero
- 27:09section with nice gradient colours and the text must stream
- 27:14in. Then it will search that
- 27:16platform, find the code snippets and then communicates those back
- 27:19to cursor, injects them and then and then just implements them
- 27:24and it works really good. Then there's another MCP tool
- 27:27called Browser Tools. It works with a Chrome extension
- 27:32and you have to run a little server on your side and and it
- 27:36will give the cursor AI, the cursor agent access to your
- 27:40browser console, to your logs, to everything.
- 27:43It can make print screens. So if there's an element or
- 27:46something that you want to change before then you were like
- 27:49trying to look, yeah, this element or you make a print
- 27:51screen and then make a mark on it and then feed it back to
- 27:54cursor. And now it can sort of see what
- 27:58you're making in the front end when you're running it in a
- 28:01local host. And that is pretty, that's been
- 28:03pretty amazing. Like for someone that I mean,
- 28:07I'm, I wouldn't say I'm, I'm, I'm able to make a production
- 28:11ready apps for front end, but it is another way of letting people
- 28:18see what it is that I'm trying to envision what I'm trying to
- 28:21communicate. And then, you know, you can go
- 28:22further on that. And something that I highly
- 28:26recommend any source scraper, NCP, there's a hyper browser
- 28:31that I really like. And so when you're building,
- 28:34you're starting your project and often you're working with new
- 28:37libraries. I mean, for example, the new
- 28:40Open AI Agents SDK that also already has its own MCP by the
- 28:45way. But then there is documentation
- 28:48and you can with this MCP, you can literally just in the cursor
- 28:52check, you can tell it to go fetch the new documentation of
- 28:58Open AI Agents SDK, save it to individual markdown files in a
- 29:03dedicated folder. And then you can have adapt to
- 29:06create your cursor rule set of on that.
- 29:09And so it can constantly refer to the new endpoint to the new
- 29:15whatever instructions that it has.
- 29:17So scraping front end tools and yeah, cool one just for best
- 29:23practices, the GitHub one can in like search GitHub make all your
- 29:29pushes and it that's also been in sometimes forget it.
- 29:33And then I really regret it in the morning, you know, yeah, So
- 29:39those, those and of course sequential thinking, but I think
- 29:41everyone that works with has worked with MCPS knows the
- 29:45sequential thinking ones. I'm I'm curious to see because
- 29:47I'm using one, but surely there's different ones around.
- 29:49And if, if people think what is the best and does it work for
- 29:55them? When do they call it and?
- 29:56Yeah, yeah, exactly. And really, it feels like it is
- 30:00unlocking your workflow to help you, like you said, get that
- 30:07idea that you have out from your head onto something tangible.
- 30:12So then you can go from there. It's not necessarily that you're
- 30:15looking for that final product, but you're really thinking about
- 30:19how can I get to something as quickly as possible.
- 30:26Yeah, yeah. And, and, and what we're seeing
- 30:29is we have, you know, the developer or whatever your
- 30:34position is at one side, then there's this huge ecosystem of
- 30:39options, possibilities and emerging capabilities of AI
- 30:44tools at the other side and what you need.
- 30:47Is. A router in between and zoomed
- 30:50out like this. The cursor is an interface of
- 30:54such router, it's not just an IDE.
- 30:56And I'm saying cursor because I work with it, but I don't want
- 30:59to say that's the. Yeah, could be windsurf, could
- 31:03be GitHub Copilot if you really weren't.
- 31:05And. I think they have agent
- 31:09capabilities now. I mean, I would expect, yeah, I
- 31:12thought I saw something on that. So.
- 31:14But yeah, maybe, maybe not that one, but for sure windsurf.
- 31:18Yeah. And, and, and, and we're going
- 31:20to see much more of that because just that just the way that a
- 31:26recommender algorithms, quote UN quote helped us and, and having
- 31:32the illusion of unlimited choice while only feeding as a subset
- 31:36of it. Yeah.
- 31:38And this this thing is is also like a router between all these
- 31:45different tooling. Now I was actually having a was
- 31:48giving a talk yesterday at a Congress of responsible AI,
- 31:52which was very focused on environmental and, and, and, and
- 31:57responsible use and the environment.
- 31:59And I was sort of that cowboy that that they that they got
- 32:04into a tell about the other side.
- 32:06And I mean, I fully agree with the fact that we should take
- 32:11good care of of our earth and all, but this was about like,
- 32:16how do we have people use AI responsible?
- 32:21For example, if you have a use case that requires text
- 32:24classification, you could use a simple Burt model and that only
- 32:28uses very little resources compared to the heaviest
- 32:33thinking models. And I think I heard some Altman
- 32:36saying something similar as well, that he didn't like the
- 32:38interface of Jetty BT at the current time where there's so
- 32:41many different model options where you have to make these
- 32:43choices again and again. And yeah, you know, the, the,
- 32:48the, the request can be routed to the right model.
- 32:51But with every other abstraction that comes on top of this, that
- 32:56takes away choices that we make, which surely programmers are
- 33:01also saying about coding with AI is, you know, I want to make,
- 33:04you know, these decisions myself.
- 33:06And this is, I don't know man, I don't know what, what is the
- 33:10best answer, but we are putting an awful lot of trust more and
- 33:17more into decision making. And this is what I referred
- 33:20earlier to that the the paper about choice engines and really
- 33:26nicely touches upon well, this sunshine is a behavioural
- 33:29psychologist, not necessarily a technical dude.
- 33:32He was on on point there that we're yeah, on of loading our
- 33:41decision making into a is and we're doing that all the time
- 33:46and more and more. Yeah, which it, it almost like
- 33:50atrophies that muscle of critical thinking on it, because
- 33:55you, if you're going to trust that it can make the decision
- 33:59for you better than you can, or at least as good as you can,
- 34:02then you now no longer have to spend so much time in that
- 34:09decision making process. And on one side, that's a great
- 34:14thing because it frees you up to do other stuff.
- 34:16But on the other side, when you actually have to figure out an
- 34:20important decision or you have to walk back and look at why was
- 34:24this decision made. Good luck.
- 34:26Yeah. And.
- 34:27It's in you know, I think a lot of people like non-technical
- 34:32people as well, use AI for brainstorming, for generating
- 34:36ideas. But that also is is is is
- 34:41already slippery slope because if you don't use very specific
- 34:47prompting, and here prompting is important, but again, you can
- 34:50automate that as well, then then for example, an image generation
- 34:57model will create sort of the same style images and so your
- 35:03set of choice is already limited.
- 35:05So you're in a illusion of having choice while you're only
- 35:10seeing a very small subset of the possibilities.
- 35:13And same with I don't know, I have seen a lot of AI generated
- 35:18content on LinkedIn lately. It's so bad and LinkedIn almost
- 35:22encourages it with those replies that I think they got rid of
- 35:27that feature, but the reply is where it would just be already
- 35:31generated. Like great job or wow this is
- 35:34awesome. Now, I, I think one of the,
- 35:36because most people are using Jet GPT, right?
- 35:38And what I think that I'm seeing is that people have a certain
- 35:42topic that they think is, you know, viral worthy or they just
- 35:46find it generally interesting or they know something about it.
- 35:49And maybe they let Jet GPT write the entire post of say 1000
- 35:54words or they write their posts and have GPT sort of edited.
- 36:00But either way, especially GPT 4 O, but also the 4.5 research
- 36:06preview model as well, tend to do this really annoying thing
- 36:10that is yada yada yada yada and then recap it.
- 36:14So here and then. Here's the catch.
- 36:17If I see that one more time and it's like a rhetorical question,
- 36:24you know, like, so there there's a that's, that's not just a, a,
- 36:30a new is, is this a new era? No, it's a new blah, blah, blah.
- 36:34I don't know. Like it's, it's, it's sort of
- 36:37like asking itself a question and then answering it.
- 36:40And I, I didn't look, you know, I'm not a linguist expert, but
- 36:43it doesn't take much AI used to recognize this pattern.
- 36:47So whether it be with image generation or text generation,
- 36:52you see that if you're not giving examples, which is the
- 36:58stage before fine tuning, which I don't expect marketeers to do
- 37:02right, or whatever people outside of the technical
- 37:05community. And and there's of course like
- 37:08spiral and that's sort of in in between, which is SAS is sort of
- 37:11fine tuning, but it starts with giving it the input output
- 37:15examples that you want to see. And that requires thinking, that
- 37:20requires critical thinking. And so it's, it's, it's almost
- 37:24like there's a group of people that don't use AI at all.
- 37:27And there's a group of people that use AI, but they use it for
- 37:30too much. And the, the, the, the, the, the
- 37:33golden ratio is, is, is somewhere in between where you
- 37:36do have to think like this is how it should look.
- 37:40And with text, I think that's that that's, that's sort of easy
- 37:46to do. I think with images and video,
- 37:49it's harder and also not my my game.
- 37:51But you know you only have this mental mental image then, right?
- 37:55Yeah, but also with text, it's blaringly obvious for us.
- 38:00And with images you can, you used to be able to really see,
- 38:05oh, this they I generated. But now there's some of these
- 38:08models like this Rev AI. I'm not sure how you pronounce
- 38:13it. The realism in that model is I
- 38:17can't tell. And I like pride myself in being
- 38:21able to tell when it was AI generated.
- 38:23But coming back to the idea that you're talking about here, it
- 38:27reminds me of when I was just talking with Devanch on a
- 38:34podcast a few days ago, and he mentioned this thing called the
- 38:40Doorman Paradox. Have you heard of this?
- 38:43No, but I love paradoxes so bring it on.
- 38:47For some reason, I knew it was going to be important for you.
- 38:50Basically a hotel said, oh, we're going to cut costs and we
- 38:54have sliding doors right now, so why do we need somebody to stand
- 39:01at the door and open the door for people?
- 39:04We can get rid of that job and they got rid of that job, but
- 39:08there were secondary and tertiary effects that kicked in
- 39:12when they no longer had somebody at the door.
- 39:15And I'm sure you can think of them right away.
- 39:17You're thinking like, oh, well, people don't get greeted as they
- 39:19walk into this hotel and that's a worse experience.
- 39:23But then also potentially you have more people loitering
- 39:27outside of the the entrance. So then walking into the
- 39:30entrances, it's not as good of an experience and these things
- 39:36were kept in check or they were done by the doorman, but it
- 39:41wasn't necessarily their job. This is Murafak's paradox.
- 39:47Oh no, I mean, not not the specific example of the doorman,
- 39:50but Murafak AI scientist legendary thing back in the 70s.
- 39:56I propose more effects paradox where he has said that in the
- 40:00future jobs will not be entirely replaced by AI, but jobs
- 40:07consists out of consists out of tasks and different.
- 40:11I mean, that is even like an abstraction, but there's
- 40:14different tasks in one job and some tasks can be economically
- 40:19feasible replaced by AI and some cannot.
- 40:23And then what might happen is that if.
- 40:26Jobs get sort of like split up, then we can see the truly human
- 40:33capabilities specialized on the remaining parts of the job
- 40:38because you know, whatever realistic an AI can be.
- 40:45And I'm going on dangerous territory here, but one of the
- 40:49most important things that I have seen in the restaurant
- 40:53industry is, you know, when is a customer happy?
- 40:56And mind you, I actually developed an application for the
- 41:00recent industry, and I learned in the hard way, and I was
- 41:02wrong, you know, because one of the most important things is
- 41:10social recognition. As the species that we are, we
- 41:14are constantly. Yeah, looking for social
- 41:18recognition. And we can only get that by
- 41:22other humans. But I don't know if this stays
- 41:27true. Right, so they're I might be
- 41:32wrong here, but obviously when it comes to say the job of a
- 41:35waiter and part of their job is to predict what product the
- 41:39customer will be most happy with in experience wise, then an AI
- 41:46could probably do a better job. But if I am sitting in a
- 41:52restaurant and it's really nice, Somoye is saying this and that
- 41:58wine is great. If I really look deep into my
- 42:01thought process and my experience, then I trust this
- 42:07entity. So let's say this woman has
- 42:11knowledge I perceive to have have knowledge that I don't
- 42:14have. So there's a game of trust and
- 42:16there's also maybe I don't want to sort of like make her happy,
- 42:19you know, I want to impress her that I choose the right wine and
- 42:23and I don't think I have that with, with, with an AI, right?
- 42:27There's a lot of complex decision making and experience
- 42:30there. Yeah, exactly.
- 42:31And the whole reason I brought this up was because of this
- 42:34thought that we're outsourcing too many of our decisions
- 42:37sometimes or we maybe it's not too many, maybe it's just the
- 42:41right amount, but we're, we're definitely outsourcing more and
- 42:44more decisions. But the, the, we do that because
- 42:46we feel that we're both two things.
- 42:51There's an awful lot of decisions to make.
- 42:55You know, the, the, the downside of ultimate individual freedom
- 43:00is that you have a lot of decisions to make.
- 43:02I mean, you can't really see like we can the whole thing that
- 43:08you see happening with like conservatives, the conservative
- 43:11right wing populism and, and such is also like populism in
- 43:15itself is in a simplification of complexity and and therefore the
- 43:20diminishing of decision making. And so that there, there is a
- 43:26need for for us humans to make less decisions.
- 43:32And there, and then at the and the other end, there's also,
- 43:35it's becoming increasingly more complex to determine what is
- 43:40increasing my social status. And it's just very, it's very
- 43:45hard to grasp. And yeah, I think and I think
- 43:50Yuval Harari writes beautifully about this, about this affected
- 43:54AI might have and coming back to image generation mimicking the
- 44:00real world, take it all the way to a virtual reality.
- 44:04But essentially what he says, we're the brim of an age where
- 44:08people are able to create the world's that they want to have.
- 44:13And therefore 1 point that is always being brought up when
- 44:18it's when we're talking about image generation or video
- 44:20generation, whatever. Like how realistic is it?
- 44:22Well. I back to differ.
- 44:24It doesn't really matter even when there is watermarks,
- 44:26weather is it's it's it's clearly AI generated.
- 44:30If men define situations as real, they are real in their
- 44:33consequences. Thomas and Thomas sociology and
- 44:37and and and if people want to believe stuff, they are
- 44:42believing it. And and you know, all this sort
- 44:45of like cognitive biases saying like, yeah, but it could be
- 44:47real. Yeah, yeah.
- 44:49I mean, this picture might not be real, but it could have
- 44:51easily been real. And if it fits their world view.
- 44:56So one being here like the, the of course, like the creator side
- 45:07is faster than the response. The, the, the, the, for example,
- 45:11the European Union almost has to respond to, with policy to new
- 45:16innovation and they're notoriously lagging behind.
- 45:19And there will always be the way.
- 45:21But also it might not even be effective at all because I don't
- 45:25think, yeah, I'm getting kind of lost my train of thought here,
- 45:31but it is that when something is in abundance, it sort of loses
- 45:36value. So if if AI generated content in
- 45:41whatever form is abundant, it loses value.
- 45:45So that is shining some light on this sort of dystopian negative
- 45:50view that maybe we are perceiving value in the new
- 45:57world of yeah, the source, the authority that is creating the
- 46:04content. And yeah, and and I don't know
- 46:08if it's going to happen, but it seems like a positive thought,
- 46:11you know, to to think that if generation is sort of free, then
- 46:17something else is going to inject value into that process.
- 46:22Yeah, because that becomes the commodity and that is the piece
- 46:27that is like the least human part about it.
- 46:33And So what is going to be the valuable part about that and
- 46:37where, where is that part going back to the doorman's paradox
- 46:41that we were talking about, or as you called it, what was it?
- 46:45And modavec. Modavec's paradox, you're
- 46:49looking at the uniquely human pieces of this.
- 46:52How can, how are we now extracting that?
- 46:55And it potentially is just that when you walk into a hotel and
- 47:00someone says hi to you, that is the most valuable part of it.
- 47:08So maybe so that do you the human connection.
- 47:10So maybe the world, the world oldest profession is going to be
- 47:14the worst last. Yeah, but it it's funny to think
- 47:19about that as you're as you're pondering it.
- 47:21It's like something so quote, UN quote, simple as engaging
- 47:29another human is actually the best part of the value chain.
- 47:36Like it's the biggest thing out of all the stuff that that
- 47:40person does in their job or going to the the sommelier.
- 47:44It's not necessarily the wines they recommend or getting to
- 47:49know you. It's that you're talking to
- 47:51another human face to face. Yeah, it's it's, it's the the
- 47:55the human. Experience and the social
- 47:56recognition, like the the worst thing that can happen to a
- 48:01human, to a customer in the service industry is to be
- 48:06ignored relative to what they perceive other people are
- 48:10getting for personal attention. If you ignore someone and give a
- 48:19lot of attention, human quality attention to someone else,
- 48:23they're going to notice and they're going to hate it.
- 48:28So, so I mean, hopefully this, this opens because things are
- 48:36going to get automated and yeah, it's like, you know, eating,
- 48:43watching, what is it? Ray Dalio said, looking into the
- 48:48crystal ball is anyone who's looking into the crystal ball is
- 48:52bound to eat ground glass. So don't, don't, don't pin me on
- 48:57it. But we're definitely seeing some
- 48:58very interesting shifts and it's going so fast.
- 49:01And I think in, in, in your community, people are, I think a
- 49:07lot of people are very open to, you know, to, to, to innovation,
- 49:10to change. But I think you have to realize
- 49:12that there's a huge part of society that responds very
- 49:15differently to innovation. And like, like, you know, like
- 49:19this, I don't understand it. I, I will ignore it.
- 49:23And yeah, it's it's an interesting dance for sure.