Latest / Agentic Conversations (formally mlops.community) / The Modern Software Engineer
Transcript
- 0:00Nobody watches these anyways, as you know.
- 0:02OK, OK. Well, well then what am I doing?
- 0:05Here now, enjoy the side quest because now we all of a sudden
- 0:19have the ability to do so many things and go down so many
- 0:22rabbit holes that we didn't necessarily before.
- 0:25Like if I wanted to learn how to fucking code front end shit
- 0:30before it would take months but now I'm like.
- 0:33I saw this skill that someone was making online and I forget,
- 0:37I forget her name, but she's actually on quite a bit of good
- 0:38educational content and she has this this other thing inside
- 0:43there Claude skill. Or maybe like, I think it's a
- 0:45skill that every time any implementation is made, it'll
- 0:49it'll sort of like summarize the learnings the like the
- 0:52implementation details that are actually that that, that you
- 0:55should commit to your own memory, right?
- 0:58And so you. As a human, not you as the
- 1:00human. Exactly.
- 1:01So different from like Claude Ception where it creates a
- 1:04skill. That's right.
- 1:05Yeah, exactly. It's not Claude Ception.
- 1:06I mean that that there's enough that almost feels that that's
- 1:09clearly top of mind for people is how do these agents like self
- 1:12learn, become more autonomous that that that's almost obvious
- 1:15in my opinion. But but I think what is less
- 1:18obvious and interesting here is hey, yeah, I think this is
- 1:21especially true for more junior engineers.
- 1:23It's there's this huge question of, hey, the seniors are going
- 1:27to keep having jobs because they're seniors and they've been
- 1:29around a while. The juniors are now in the
- 1:33workforce. They're like, holy, you know,
- 1:35crap, what are we going to do? I need to, I need to actually
- 1:37get a job here, but no one wants to hire me because I can just be
- 1:39replaced by cursor. At least that's the running
- 1:41hypothesis. And that just creates this huge
- 1:45gap of basically like a training gap where people, you know,
- 1:49typically you, you, you hire juniors, you kind of train them
- 1:51into the senior roles. Right.
- 1:53And you pair program you. Pair program with them, you like
- 1:55review their code and and and you effectively are creating
- 1:57this gap of knowledge between one generation and the the most
- 2:01senior engineer and and and that generation like that gap has to
- 2:04be filled some way. So I like this idea of using the
- 2:06agents to actually fill that gap, because in the same way
- 2:10that they can generate code, they can also understand code,
- 2:12probably, you know, arguably better, if not at the same
- 2:14level. Actually, there's something to
- 2:16be said for that because somebody was just talking about
- 2:19in the community Slack, how before they'll go into a new
- 2:24area that they don't know about, they'll go back and forth with
- 2:28just the chatbot to learn about it, and then when they implement
- 2:32it, they can be better suited. For that's right, that's right
- 2:35one maybe of those side quests you're alluding to, which is
- 2:37hey, I just want to keep learning about the craft,
- 2:39learning about the discipline and all the things that are that
- 2:41are that the agent help me do more quickly.
- 2:43And then I think there's also any I don't know what the
- 2:46distribution is of these two. There's also an equally big
- 2:49movement here maybe of of just yeah, I don't know if you ever
- 2:53want to look at this. I am fine to just exist in the
- 2:56world of ignorance and and you know we can talk about what that
- 2:59means and how you can make sure that isn't just a recipe for
- 3:02disaster at the level of like financial crisis when you start
- 3:05having that, you know working bank that happened in banking
- 3:07institutions. But but yeah, I mean there's
- 3:11there's a lot of implications there.
- 3:12And I think of that, that second category of we're going to
- 3:15forget about it is more like non-technical people.
- 3:18What do you do when you encounter a issue where the
- 3:25agent will implement something and it's not the way you would
- 3:29have implemented it, but it still works?
- 3:31And so you're like, I guess I'm a little out of my depth here.
- 3:35I guess this might be the better way.
- 3:37So fuck it. Like I've come to just accept
- 3:40everything and eventually it figures it out and if it doesn't
- 3:44then I'll prompt it again. Yeah, Yeah, I, I think that's,
- 3:49it depends on what task you're working on.
- 3:52And and I think there's, there's somewhere you do want a stronger
- 3:56say on architecture, on design, on having a handle on these
- 4:00things. That's probably true.
- 4:01Like core infrastructure stuff, You know, I would be careful to
- 4:07have no control over some like core piece of elites at this
- 4:11level, at the, you know, at this current point in time of, of
- 4:13having no understanding of what's happening there.
- 4:17That being said, like I, I do think that, you know, people may
- 4:20not call it creativity. So, you know, don't people on
- 4:23online shouldn't, shouldn't hate me for this, you know, saying
- 4:25that the agents are creative. Yes, they're pattern matchers
- 4:28that glorify pattern matchers that extrapolate.
- 4:30But I think that there is something to be said about
- 4:32creativity to respect what you understand at least, right.
- 4:34So like you don't know this implementation, this way of
- 4:36doing something and it's new to me.
- 4:38And in that way, it's as if somebody had come to me and
- 4:40presented something that didn't exist before.
- 4:41And so I actually like that aspect.
- 4:43I think that should be controlled, but but encouraged
- 4:48in its own way. Exactly.
- 4:49And so like, yeah, I don't I don't know next JS tremendously,
- 4:54I don't know view. I don't know these things.
- 4:55But if it got to that point and I don't have very strong
- 4:58opinions, yeah, like it's it's clearly generating this because
- 5:03it's pretty well supported. It exists in the world.
- 5:05It's seen this a good number of times.
- 5:07And so at least use this for a starting off point.
- 5:09I'm not saying you should literally just let it go off the
- 5:11rails but but you know, as far as a prior is concerned, if you
- 5:15don't have an opinion then then it's not a bad prior to start
- 5:17with. I heard from chip stock that she
- 5:20did at our agents in production a few months back.
- 5:24She was saying like, what do you think the hardest programming
- 5:29languages for agents? And it had, you know, Russ,
- 5:32Python, TypeScript, JavaScript. It was JavaScript.
- 5:38You know why? Because there's so much shitty
- 5:42JavaScript on GitHub. That's true.
- 5:44That's very. True that it trains on all that
- 5:46and then next thing you know it's like it's outputting what
- 5:50it trained on. Yeah, Yeah, I think that's fair.
- 5:54And where I think this is one of those places where I was
- 5:58actually talking with Eno who's who's the CTO factory a little
- 6:01while ago and he. Well, dude, you just dropped
- 6:04something over there, Did I? Yeah, I think it's a name.
- 6:12Nice, nice. I'm going to use that one.
- 6:15That one I like. I was like, I didn't see
- 6:18anything in my periphery. That's good.
- 6:24It was also convincing. Good on the acting Good on the
- 6:26acting. You have a you were a
- 6:27salesperson once the time, weren't you?
- 6:29You you know how to how to sell the story.
- 6:33Hilarious. I gotcha.
- 6:35Got me All right. No, you.
- 6:37Were talking to you know. Well, I mean, not, not for any
- 6:39like I'm not really not trying to to to name drop here.
- 6:42I'm just, I was talking to him like legitimately not a little
- 6:44while ago and and. My favorite part?
- 6:47I'm the worst culprit. If I can name drop anybody I
- 6:50will so. I'm a little That's why no one
- 6:52can. No one takes you seriously
- 6:54because you just lost all your legitimacy when you when you
- 6:56your credibility. Yeah, exactly.
- 6:58No, but but I actually no affiliation to factory at all.
- 7:03And you know, I'm not getting endorsed by them in any respect.
- 7:06But but I'm they actually do like a lot of really cool work.
- 7:08And I I'm a big fan of like, you know, in particular, and I've
- 7:11also spoken to they're both very smart.
- 7:13You know, I spend more time with, but very, very thoughtful
- 7:15about how he thinks about like coding agents and, and just, you
- 7:17know, develop the future of AI software systems.
- 7:20I think what he is his. Core hypothesis and thesis
- 7:24around how they build factory androids, which is their their
- 7:28coding agent is that the most crucial piece that you have to
- 7:31get right as a developer is like the, the, the validations, like
- 7:36the the testing harness, like the checks to make sure that
- 7:38what if you let the agent go off autonomously on one small task
- 7:42on many, many tasks for single agent, on many tasks for many
- 7:45agents, that at the very least there's some set of checks you
- 7:47put in place that the agent can validate that it's correct.
- 7:50It opens up a browser. It tries playing around with the
- 7:52website inside a little bit. It has some some tests that
- 7:54exist in back end, you know, so some way of checking that it
- 7:57that it's not going completely off the rails.
- 7:59And that's I think the strongest thing we can do right now as
- 8:01humans is like being still in the loop for those validations.
- 8:05But the validation can only work in some use cases, right?
- 8:09You can't validate everything, and that's probably one of the
- 8:14hardest pieces of it. Yeah, I think that's absolutely
- 8:16right. And, and it's a good nuance that
- 8:18you bring up because he, you know, I was talking to him in
- 8:21the context of this new thing. They, they're, they're rolling
- 8:24out called missions, which is essentially their answer to this
- 8:27question of long running autonomous agents.
- 8:30You know, we see some blog posts and cursor, we see some blog
- 8:31posts, Anthropic, I think probably even one from, from
- 8:33Devon as well. And so, you know, there, there,
- 8:36there's a lot of experimentation happening in how long can we
- 8:39have these agents run? Can I launch them for an hour,
- 8:41multiple hours, multiple days and weeks?
- 8:43And what is possible if you remove the constraint of time.
- 8:47And so mission is their kind of answer.
- 8:49They're, they're, they're attempted at least positing a
- 8:51future. And you know, what I think was
- 8:54just interesting was as we were talking about missions, he, he
- 8:57was acknowledging that there is something where they're reaching
- 9:00almost like a, the frontier of what is verifiable or what is
- 9:03like easily validatable. That's a word.
- 9:06And, and, and you know, and we're trying to define what that
- 9:10line is a little bit. Is it stuff related to
- 9:12infrastructure? Is it stuff related to when I
- 9:14have to go in like interact with some to get API keys from
- 9:17somewhere, you know, like then yeah, you probably have a human
- 9:20there if I'm deploying DNS things.
- 9:22I mean, that's like tricky, right?
- 9:23Because you're talking about how, how traffic is getting
- 9:25routed through the web. And, you know, maybe that won't
- 9:28always be the case, but, but at least for now, there's
- 9:31definitely stuff and, and, and systems that we interact with
- 9:34the software developers when we're creating production code
- 9:36that are not yet verifiable in an easy way.
- 9:40And and that's probably where coding agents even today will
- 9:43like hit their limits a little bit.
- 9:45But that's not to say we shouldn't keep pushing that
- 9:46frontier. And I think the frontier will
- 9:48keep getting. It's funny, if you look at the
- 9:51graph of how long a coding agent can run without human
- 9:57intervention, it's just like Moore's Law type of thing where
- 10:02it's doubling every six months and you're seeing it go up and
- 10:05up and up, right? So this episode is brought to
- 10:08you by the good folks at ML Flow, the open source platform
- 10:12for developers who want to build production ready AI
- 10:15applications, enhance your AI applications with end to end AI
- 10:20observability, all in a single integrated platform.
- 10:23With ML Flow's Gen. AI capabilities, you can
- 10:26evaluate AI applications using a suite of built in or custom
- 10:30judges, visualize trace executions and agentic
- 10:34analytics, and continuous mostly monitor evaluations, all while
- 10:39tracking every run in one place. Ship better agents faster.
- 10:44You know that's the name of the game.
- 10:46Get started at mlflow.org. I notice that I will try and
- 10:54kick off these tasks where I'm like, oh, this is a meaty 1.
- 10:58And then next thing you know, it's like 10 minutes later or
- 11:01even 5 minutes later, I'm getting hit with yeah, all
- 11:04right, it's all done. Right, right.
- 11:06That's right. Fuck.
- 11:07That's right. Where are these long running
- 11:09tasks that we're talking about because I can't find them.
- 11:11Yeah, yeah, I, I think I think that's a really, really
- 11:14interesting point. And, and what what is worth
- 11:18really drilling down there a little bit is, is it's actually
- 11:20important to find them. You know, that's almost like a
- 11:23first point that I would make is like, it's actually important to
- 11:25find those because you, you know, one of the questions that
- 11:29people have now with how, how good agents have become and, and
- 11:32especially as you think about scaling to multiple agent
- 11:34workflows, it's, it's like, where does deep work still
- 11:37exist? What does deep work mean for a
- 11:38developer? Because deep work almost
- 11:40requires at least like, I mean, definitionally when you know,
- 11:43you know, like kind of brain science is like at least like 20
- 11:44to 30 minutes or something, just get into something and then flow
- 11:48Exactly. And multiple hours of that in,
- 11:50in the, in the to actually get some really, really many tasks
- 11:52done. If you can't find those points,
- 11:55there's a gentle cast, you know, you ideally like an agenda cast
- 11:57that is in that sweet spot of time, so you can switch to
- 12:00something else and then kick off a new thing and then switch to
- 12:02another thing in here. And you need to, you need to
- 12:03like be able to identify those things.
- 12:05But I think what, what is true to your point is, is what
- 12:08constitutes those media tasks is, is getting constantly
- 12:12shifting in terms of definitions.
- 12:13And we're going to have to keep kind of pushing that.
- 12:15What 1. So that's like thought one.
- 12:17And the second thing that may be interesting here is I I find
- 12:20that it's it's probably more true in like brownfield code
- 12:24bases where the verify the verification step, the
- 12:28validation is actually takes a lot of time, right?
- 12:30If you imagine running making a change in Google as an example.
- 12:34And you and I don't work at Google or anything like that.
- 12:38So so take what I'm saying with a grain of salt, but I'm just
- 12:39using, let's say Mughal. If you don't want to use a name
- 12:43Mughal. No.
- 12:44And you have these like massive multi million lines of code and
- 12:47then you make like even the smallest change.
- 12:49And that's certainly is before that even gets reviewed by
- 12:51human. You wanted to go to like the
- 12:52extensive set of testing suite that exists.
- 12:55Takes hours. Takes hours now meanwhile,
- 12:57you're not going to let go and you know you don't want to like
- 12:59spend their baby time babysitting that and and and
- 13:01fixing a little error here. And I wonder if the tests and I,
- 13:05I have no idea what it's like so we could ask somebody that works
- 13:08at Google, but I guess Google, yeah, their their tests probably
- 13:13happen where you do a few. Does it pass that and then it
- 13:17gradually increases? That that's correct.
- 13:19That is correct, yeah. So I mean their build systems
- 13:21are sophisticated at I don't know about Google, but certainly
- 13:23Moogle the build systems are are sophisticated enough that they
- 13:26that they are they're good at identifying sort of what what is
- 13:29impacted by the change that you've made.
- 13:31And so that is true and that but you know, that's all to say that
- 13:34that iterative loop of try a thing, build a thing, test the
- 13:37thing, fix the thing based on some error that it detects and
- 13:40and your errors can have many different flavors.
- 13:42That is something you that that loop can happen multiple times
- 13:45as as as a system gets built. And I think that's I I think in
- 13:49my in practice, I've seen that's where it starts getting a bit
- 13:51meteor. Yeah, like a one shot, make a
- 13:53whole thing. That's fine.
- 13:55But if you don't have like, the tests are where you have to keep
- 13:57kind of hitting. That's where the rubber hits the
- 13:59pavement. That's true.
- 14:00That's right. What have you been seeing when
- 14:03it comes to teams working together?
- 14:05Because in our lunch and learns last week, we were talking about
- 14:10how companies and specifically teams need to start or are
- 14:19thinking more about like, I'm not going to say like governance
- 14:23structures because that might be a little bit too strong of a
- 14:25word. But are we using skills?
- 14:29How are we making sure that if we are committing skills back to
- 14:32it, it's not just like constantly doing skills?
- 14:35When do we have a skill that we commit back versus we keep it
- 14:38for ourselves? When do we use the prompts?
- 14:40When do we create rules? When do we spin up multiple
- 14:43agents? How do we look at like creating
- 14:47a lot of parallel agents for the same task to try and pass the
- 14:50test, etcetera, etcetera. There's so many questions that
- 14:53are involved in how you operate now as a team.
- 14:57It's a moving goal post, honestly, and no one has the
- 15:01answer here. I, I think so much of what we're
- 15:04what we're, we're discovering a lot.
- 15:06I think as a community, everyone has like a hypothesis, but, but
- 15:10it's funny, even again, I keep bringing up, you know, but this
- 15:13was mentioned also in the conversation.
- 15:14That was what, you know, what's becoming relevant here is like
- 15:16cybernetics, like this concept of like, how do you, what does
- 15:18it mean to have like feedback loops in, in, in systems?
- 15:21And how do you, how do you oversee those feedback loops so
- 15:25the system can use to improve? And so there's like a, there's
- 15:27a, there's a broad literature around what that looks like in
- 15:29practice. Again, I don't think any of that
- 15:31was designed necessarily with, with the intention that one day
- 15:33we were going to have software systems that that sort of do
- 15:36what they're doing now. But you.
- 15:38Know that's all to say that like it is kind of.
- 15:40This for the first time we're, we're, we're maybe putting some
- 15:42of these, these theories a little bit into practice.
- 15:44So, you know, theory suggests that we don't yet know how all
- 15:48the answers, but in practice, what I've seen and it different
- 15:51players of questions. I mean, I think one of those
- 15:53important aspects here is just teams need to disseminate
- 15:56information. They need to share their
- 15:57learnings, they need to share their failures and they need to
- 15:59have the channels to do that. I think what I, what I've seen
- 16:01with some, some teams is they are, they've gotten really good
- 16:05at, hey, everyone has quad code access, everyone has cursor
- 16:07access. Everyone is now has as much
- 16:10tokens, as many tokens as they need to to kick off any tasks
- 16:13they want. No limitations there.
- 16:15And they start seeing the gains as they normally should.
- 16:17And then, but they, we would expect that they would, and
- 16:18they're hitting like that 20 to 30% mark or something.
- 16:21Now, now in practice, what is maybe not as clear is like, hey,
- 16:24how do you like centralized information now to, to, to
- 16:28everyone so that we have a shared set of practices and
- 16:30everyone, like everyone is as good at this.
- 16:33A top 1% user in your team, you know, 'cause there's always even
- 16:36if everyone has access to cloud code, there's people that
- 16:39prompted fairy vanilla and there's people that are have the
- 16:41most intricate setups. I'm not saying intricacy
- 16:43suggests that it's the most that it's the most helpful, but it at
- 16:47least suggest more thoughtfulness maybe here.
- 16:49And so how do you bring like, how do you raise the bar on, on
- 16:52everyone having that, that knowledge?
- 16:53And so I think a lot of this is just like human process a little
- 16:56bit. You go and you have the lunch
- 16:58and learns, you go and you, you put, you have a shared Slack
- 17:00channel. You go, when you create a, a
- 17:03maybe centralized team that's responsible for instituting best
- 17:06practices. I think in a lot of ways it, it
- 17:09mimics what happened with, you know, Cici or the fact that it's
- 17:13a lot of teams have internal dev dev success or dev UX teams that
- 17:18with our sole responsibility is to make sure that CI and the
- 17:20build system is well instituted and, and any developer can join
- 17:24the team and they can be productive from day one, right?
- 17:26There's literally teams dedicated to just that aspect,
- 17:28like internal developer infrastructure.
- 17:30I think the same that this will probably also fall under their
- 17:32purview is like, hey, now, should we use an agents MD which
- 17:35go into our agents MD? What's what suggestions you have
- 17:37to a new team for agents MD. So a lot of these these like
- 17:40follow on questions that I think actually may still exist with
- 17:43the under the under the umbrella of responsibilities for for
- 17:47those existing teams actually. Also a bit higher up the
- 17:50questions are how do we enable the teams to have what they
- 17:56need? But then how do we not spend out
- 18:00the ass but. You know, I, I don't think this
- 18:02the future is always going to be like this where I don't even
- 18:05know that in the long term, this token based pricing model is
- 18:08going to be exactly what what the ways these companies are
- 18:11going to charge. I think that there's, there's
- 18:12conceivably a reality where because like you don't, because
- 18:16the tokens is, is like an implementation detail, right?
- 18:18Like the fact that there's a, a token that's being generated, A
- 18:21token that's being input, a token that's being output, some
- 18:23maybe tokens that are cached in the middle, maybe some thinking
- 18:26or reasoning tokens that are happening.
- 18:27And in some of these reasoning models, that is sort of not
- 18:30really, it's not made it visible to you, but it's happening.
- 18:33And sometimes those reasoning model, those reasoning tokens
- 18:35can actually take up quite a bit of the context because they're
- 18:36doing a lot of thinking and, and sort of trying this, trying that
- 18:39and kind of unwinding and trying again.
- 18:41So, so, but, but at the end of the day, you, you don't really
- 18:45care too much about the trajectories.
- 18:47A tokens are just a proxy for the trajectory that the agent
- 18:49took. And, and to an to an extent, at
- 18:51the end of the day, you just care about the task being
- 18:52completed. And so I think that there, there
- 18:54is definitely a world where maybe these, these companies
- 18:58actually start pricing based on like some, some flavor task
- 19:00completion more so than just number of tokens, right?
- 19:04Because you can imagine a system where you literally just while
- 19:06loop something and you keep trying.
- 19:09And and I mean, that's super like the Ralph loop.
- 19:10I'm sure that's exactly what it's doing.
- 19:12It's just it's just wild truing until it completes something
- 19:15very token and efficient in a lot of ways.
- 19:17And I don't think that's that people aren't going to be happy
- 19:20with that for for long. But if you if you but what you
- 19:23really care about is that the end success of the thing you're
- 19:25doing. So maybe just charge people for
- 19:28almost like a task rabbit, like you pay them to to, you know,
- 19:30human, human context. You pay them to to assemble your
- 19:33furniture, you pay them to do your laundry.
- 19:35And that's you don't care if they like went and sat for like
- 19:37an hour and, you know, huffed and puffed in the last five
- 19:40minutes. Got it done in some sense,
- 19:41right. So so maybe something's true
- 19:43here, right? We just, we like want to see, we
- 19:45have like a good system. And of course there's big
- 19:47questions here like how do you define that task success?
- 19:49But you define the task, you define some success criteria and
- 19:52then go agent, go do something. I was thinking more, how do you,
- 19:55as a company that is not a model company, have that be a
- 20:00possibility? Because right now, if you don't
- 20:02own the model, yeah, you're just going to be paying out the ass
- 20:05to Anthropic or opening up. Yeah, that's, that's tricky
- 20:08that, that I don't have a great answer.
- 20:09And I know you have a lot of friends that, that run these
- 20:13companies and, and they're involved in these companies.
- 20:14And so, yeah, it's, it's a huge tension for them because they're
- 20:17both simultaneously some of the biggest users of these, of these
- 20:21of the underlying model and at the same time maybe competitors.
- 20:25And they're, they're going and you know, they're, they're going
- 20:27to buy it to dinners with the, with the providers, but they're
- 20:30also when they try and sell the providers like, and actually we
- 20:33were building our own version of that.
- 20:34And then, you know, there's interesting dynamics around.
- 20:38Yeah, they see that, right? Like they can, they because so
- 20:41much of it is getting proxy to them in terms of the tokens and
- 20:43the Proms. They also have the the the
- 20:45underlying models can have a clear sense for where's the,
- 20:49where are people's needs, right? In a way that that that allows
- 20:53them to basically repurpose and build offerings on top of that,
- 20:56right. You can think of it almost as
- 20:59like, yeah, I, I mean, at least what people claimed that Amazon
- 21:02did are like, oh, yeah, hey, we, we, we, you're like, you're,
- 21:06you're all these third parties are in the marketplace.
- 21:08But you know, hey, like, and I don't know whether this is
- 21:10actually true, but but you know, then people would at least
- 21:13nominally claim that they were saying, Oh, well, that implies
- 21:16that now you can just RIP off based on the data and make your
- 21:18own, like Amazon Basics, you know?
- 21:20Which I mean, they did it with products on their marketplace,
- 21:23they did it with products in AWS.
- 21:26They we're pretty aggressive in that strategy.
- 21:29So it makes sense. There's always going to be the
- 21:32argument for open source models. I guess that's what we have to
- 21:38like cross our fingers for that the open source models are going
- 21:41to get good enough to play ball and be frontier enough or not
- 21:47far enough behind to where that would work.
- 21:50So in that world I could see the outcome based pricing.
- 21:54Right, right, Yeah, right, right.
- 21:55That's an interesting one. And and and that feels like one
- 21:58of those. It's almost like once people's
- 22:01once people's wallets are getting hit, then they're
- 22:03actually fine with some of the deceptive practices that at
- 22:06least now many people have have accused the Chinese companies of
- 22:09doing right. The distillation of anthropic
- 22:11models and things like that where where fundamentally still
- 22:14completely deceptive and definitely cheating in in its
- 22:17own way. But then.
- 22:18They're like, yeah, but if I get like.
- 22:19A Kinney model that's like now Opus 4-5 level and I don't
- 22:23really. Care too much?
- 22:25Yeah, then all of a sudden. Principles go out the window a
- 22:28little bit like. I guess that's a chance to
- 22:30happen in in general with economics is like everyone has
- 22:33an opinion until everyone has is sitting on their moral high
- 22:35ground. Until until they look at their
- 22:37PNA. Until they.
- 22:38Yeah, I don't know about that. That one.
- 22:40She. I think that that principle is a
- 22:42little too expensive. For me to hold, for me to.
- 22:45Hold. Yeah, exactly.
- 22:47Which when I list out my principles, which ones are like,
- 22:50like they're good enough, but nice to have, nice to have, must
- 22:54have indefinitely, like wow, we just dropped our revenue by 50%
- 22:57because of that principle. Oh, man.
- 23:00And you're funding your competitor.
- 23:03That's the craziest part. That's about it, is that all
- 23:06these folks are funding the competitors.
- 23:08And So what are you going to do about that?
- 23:10Like, yeah, yeah, it's tricky. Claude Code, did you see the
- 23:13revenue for Claude Code? Is that like 14 billion now?
- 23:17That's wild. And a year ago, is that 1
- 23:19billion? I mean, it's only a year old.
- 23:21Of a product. Exactly dude, that is.
- 23:24It was 0 actually a year ago. I mean, like if you for like a
- 23:26year, like very technically speaking, it was nothing, right?
- 23:29That's. So maybe somebody will have to
- 23:32Fact Check me on that. Maybe it's all of Anthropics
- 23:35revenue is that 14 billion and Cloud Code makes up whatever
- 23:37like 80% of that. I mean, if it's a billion,
- 23:40that's a lot, right? I mean, and I don't know the
- 23:41exact numbers, but, but, but I suspect probably in the handfuls
- 23:45of billions at this point. I mean, yeah, their, their,
- 23:48their growth has been, has been astronomical.
- 23:52How do you feel about just the ever changing nature of how
- 23:57folks? This week it's cloud code.
- 24:00Last week it was cursor, next week it's something else and
- 24:05you're jumping around to all of them and just like the tides and
- 24:10the winds of change are coming. Yeah.
- 24:13And you think more from the what is that experience as a
- 24:15developer or what, how do I, how would I, what do you think about
- 24:18that as, as the one who has to service the developers?
- 24:21I think how do you look at what you need to be testing versus
- 24:26not? How do you think about what
- 24:29actually is valid here? Should I listen when people are
- 24:32saying of a cloud code now because it's not that good?
- 24:35I'm using codecs and. Yeah.
- 24:38So OK, a few few thoughts here. 1 is, I think there is something
- 24:43to be said about too much optimization and people micro
- 24:48optimizing the hell out of their setups and, and maybe almost
- 24:50enjoying the setup optimization, glorifying it more so than the
- 24:54actual thing that they're trying to do right.
- 24:56Like I, I love development, but I also, I think I'm compared to
- 25:00many developers. I'm a lot more of a pragmatic
- 25:01developer where like the most important thing to me is that I
- 25:03have a toolkit that enables me to solve problems.
- 25:05That's like how I've always thought about the discipline of,
- 25:07of, of engineering, at least for me personally, versus some
- 25:10people are like, they just love geeking out about, you know,
- 25:13their vim plug insurance Once Upon a time.
- 25:14That's I don't like irrelevant anymore, but Once Upon a time
- 25:16that was people cared. And maybe there's still some
- 25:18developers that, that are really devout in that respect, But I
- 25:22think people do tend to micro optimize and, and I think it
- 25:24would be, given how much FOMO there is in the industry, people
- 25:26are very there. They'll switch because they hear
- 25:29this is like a few percent better and some benchmark comes
- 25:31out and they've won and, you know, beat the benchmark by a
- 25:33few percentage points. So maybe I should have this
- 25:34again. I, I think there's actually a
- 25:36lot my, my, my prescription. I genuinely believe for most
- 25:40developers who are feeling that FOMO like there, there's a lot
- 25:43more value in just picking one of the top three and sticking
- 25:47with it. And just really more exercising
- 25:50the muscle around how to think about building systems with this
- 25:52tool rather than, hey, does this one, how is it?
- 25:56How does this one do on sweet bench versus how does and how it
- 25:59is it an ID? And then the you know, so
- 26:01there's like there's like a base on set of almost a commoditized
- 26:04features that they all have. Pick one of the top three and
- 26:06then just really spend the time to get good at it more so then,
- 26:10yeah, do I have to like at the moment, 4-5 Opus 47 comes out
- 26:14versus Codex 54 and you know, then I you swap, swap it around.
- 26:17I don't, I don't think we're not seeing like tremendously massive
- 26:20gains yet that I think it's going to meaningfully change the
- 26:24scope of things you can do. Though the one caveat that I
- 26:27would say here is where I, you know, so, so I'll commit to a
- 26:31set of tools in my own sort of work flows, but where I think
- 26:35there is flexibility that at least I'm comfortable with
- 26:37switching to another one is. And you see this often is the
- 26:40one there's downtime, right? So the fact that these, these
- 26:42these services are moving so quickly, they're building so
- 26:44quickly and as they should, they're trying to aggressively
- 26:46capture market share. That means probably the systems
- 26:49are like the most stable in the world.
- 26:50And we see anthropic go down. We see, we see, you know, other
- 26:53systems go down. Not not, you know, Anthropic is
- 26:55great and that's the those are usually the moments where you
- 26:59see on Reddit and subreddit, the people are are ho and topic is
- 27:04down. Go to codex.
- 27:04Wow, codex is actually the best thing since sliced bread.
- 27:06And then codex goes down and they're like, oh, actually,
- 27:08like, you know, cursor is the best thing since sliced bread.
- 27:11And so that's where you see the switching and it's comical to
- 27:14see this thing play out in in real time.
- 27:15But it's also it's it's it's like having the fall back like
- 27:19you, it's good to have some fall backs and that you're
- 27:21comfortable with. And so like, I think I'm very
- 27:23comfortable with Claude. I'm also quite comfortable
- 27:25cursor. I'm also quite comfortable with
- 27:26with Devin, you know what I mean?
- 27:27And and if one of them goes down I I can go to the other one and
- 27:30and my my work flows. It won't be hindered in any way.
- 27:33How do you create more parallel agents?
- 27:38Because this is another one that I try and do super often but
- 27:42then by the time I set it up agent 1 is already done and I'm
- 27:46like damn I can't have more parallel agents because I I'm
- 27:50too slow to like have them fan out and do their shit.
- 27:53Yeah, I think people are, people are, are are romanticizing this
- 27:57a little bit too much. My in my opinion, and I think
- 27:59part of it is, is well. It's because your boy Boris all
- 28:02over Twitter. Saying he's like 10 of these,
- 28:04Yeah. And it's like, do one of his 10
- 28:07commandments is like run more agents in parallel?
- 28:10And so no, whenever I talk to people, it's like, Oh yeah, we
- 28:13got to be running them in parallel.
- 28:15Yeah, versus awesome. And and this is super, super
- 28:19cool guy and then super smart. I think that can be true.
- 28:23And for some people that works. I think it can also be true that
- 28:26that I don't know, when you see these these Twitter demos, these
- 28:29Twitter videos of people where that, you know, they'll show the
- 28:32video of someone like panning across their three screens.
- 28:34There's like 15 tessellated, tiled, clawed code instances and
- 28:39they're just like going and it's become like a meme at this point
- 28:41how you can just do this circular view of yourself of
- 28:44like 700 agents like you're not doing like.
- 28:47That's just what are they working on.
- 28:49Yeah, what are they doing? It's like those long running
- 28:52tasks, like I can't get anything to do those beefy tasks.
- 28:55How do you have 50 different agents?
- 28:57Yeah. No, I don't.
- 28:58I don't buy it. And quite frankly, like I think
- 29:01the most productive developers that I've seen do these things.
- 29:04I you know you have what I would consider.
- 29:09Maybe on the order of two like really needy tasks, right?
- 29:12Ones that you have to be like very heavily involved with as a
- 29:14human to like really carefully review spec docs, feature
- 29:19requirements, all these things. And you know, that's where
- 29:22you're like really injecting your, your own taste and your
- 29:24own design principles and your own understanding architecture.
- 29:28And then I think the stuff that they can be like kicked off more
- 29:30is the ones where you are, they're not such meaty tasks
- 29:33actually by design. You have to change a
- 29:35configuration file, you have to make a small refactor, you have
- 29:37to add a test here or something like that.
- 29:39You know, that's if you can, like, you don't have to be like
- 29:41overly detailed and prompting to just a kick it off, right.
- 29:43And just like do these things. And so, you know, in, in
- 29:45practice, what I, what I've seen and I think where you know, so
- 29:49that's how I think you can achieve some of that scale.
- 29:51And there's a few notes I want to make about that is in order
- 29:54for that for to confidently kick off sub agents, you know,
- 29:57multiple agents, you do have to go back to the thing we were
- 30:00discussing, which is like the validations.
- 30:02They like to have have a meaningful harness in place
- 30:05that, that the agent can do work and then check that it's still
- 30:07OK and it hasn't broken something and that it's added
- 30:10enough coverage of tests and then test will pass.
- 30:12That still has to exist, right? I think what I honestly
- 30:15recommend for more for people is start with the one, get really
- 30:19good at the ones, then add two if you feel like you've gotten
- 30:22like start exercising that context switching muscle.
- 30:24And then once you have one and two, you're like, well, like I'm
- 30:27doing good here. And you know, there's kind of
- 30:28running some tasks that that requires a lot of test, test
- 30:31checking. And therefore it's taking a
- 30:33little bit longer. And then you're like, well, I
- 30:34have a bit of downtime and rather than doom scroll, let me
- 30:36go and let me go and fix, fix another thing.
- 30:39And I think that does require that way of thinking does
- 30:42require more planning upfront. And that's simply the way I
- 30:44think about the tasks a lot is you, you start the day by, hey,
- 30:47here's like the three meaty hard tasks that I do.
- 30:50And here's the five not so hard tasks that I need to do.
- 30:52And then you at least always have this like running list of
- 30:54things you can you can kick off to an agent when the time is
- 30:56right. I can see that.
- 31:02Are you always writing your own tests?
- 31:05I mean, not manually like I, I'm, I'm at least what I'm
- 31:08always doing is checking that the things I want the test to
- 31:11check are valid and and are, are in the the and I'm thinking
- 31:15thoughtfully about what are those edge cases that I want to
- 31:18make? Like what are the things that I
- 31:19want to start to be true? That part I am absolutely still
- 31:22involved in. But yeah, when it when it comes
- 31:23to actually, if I'm writing Python, if you know, making the
- 31:26Pi test lines of code, absolutely not.
- 31:28I'm not doing that. But I am making sure that those
- 31:31those assertions and those validations are existing in some
- 31:33files, some spec that I've given to the to the agent, yeah.
- 31:38There there was something else on the.
- 31:40I'll put this down for a SEC. Just another thing that might be
- 31:43interesting to talk about is just like, you know, I don't
- 31:45know what what the what the byline for this episode is going
- 31:47to be, but the kind of the future like a native teams.
- 31:49I think there's there's there's in the coding agent specific
- 31:52things and there's also just what I think is interesting and
- 31:55interesting. The size of the team or.
- 31:57The well, it says the team, but also like how, how
- 31:59interdisciplinary the the roles are getting yeah, like there's
- 32:048, you know, engineers getting, you know, and there's.
- 32:07And I fucking product people are taking down websites all over
- 32:12the place. Yeah, yeah, yeah.
- 32:14Well, I don't, I don't endorse that, but but I but it was.
- 32:17You said it, not me, shit. And it's not the product people,
- 32:21it's the designers. It's they're not even.
- 32:23No, it's. Still not saying it.
- 32:26I'm just, I'm not going to, I'm not going to incriminate myself
- 32:28here. That's what I'm saying.
- 32:29Like you're trying to, you're trying to goad me into something
- 32:31that's going to be caught on camera and then and then held
- 32:34against me in a court of law and I.
- 32:35Refuse to give you that that firepower.
- 32:38We do love the designers and the product folks.
- 32:40Actually, that's one of the I've seen and I've been reaching out
- 32:43to a ton of product folks for the conference that we're doing
- 32:46because they stand to benefit and they potentially are the
- 32:50ones that are benefiting from this whole revolution more than
- 32:52anyone. Yeah.
- 32:53But I do think that like you're saying, the product engineer and
- 32:57designer, that role is kind of merging into one and you're
- 33:01expecting that you have depth in one of those.
- 33:05But you can get by pretty easy with letting the agents to those
- 33:11other parts. Yeah, yeah.
- 33:13And I think it's a welcome expansion of responsibilities
- 33:17across every single role, quite frankly.
- 33:20And you can, I don't know if it's converging to one role per
- 33:22SE, but but there's definitely some, you know, people on the
- 33:25right coming to the left, people on the left come to the right.
- 33:26I mean, directions really matter here.
- 33:28But but the engineer, you know, we as engineers are getting
- 33:31faster, faster at, at generating code, building features and
- 33:33things like that. As a consequence, we are in a
- 33:37good way, I think, being tasked down where we're thinking
- 33:39through like product considerations.
- 33:41So we also have to start asking ourselves a little bit more
- 33:43like, Hey, my own, my own responsibility is not finger on
- 33:45keyboard, write this function. It's it's designing, it's
- 33:48architecting. And, and beyond that, it's, it's
- 33:50actually like understanding more intimately, like why does this
- 33:53feature acquired? So, so we're putting on more of
- 33:55the product app product people, I think are also, you know, they
- 33:59were always living in the, in the user stories and, and the,
- 34:02and talking to the users and, and developing like a very
- 34:04intuitive and intimate understanding of a feature
- 34:07requirements. They also, but, but you know,
- 34:10their attention has always been, I don't want to wait for the
- 34:12engineer to implement this. That's always been the the like
- 34:15one of the gripes of most modern engineering organizations.
- 34:17How many story points? Yeah, exactly.
- 34:20Like how can I get 3 resources to do this two cycles for this
- 34:23particular feature? And and they, they, and that's
- 34:25always been obviously a, a big source of tension, I think in
- 34:28teams and it's annoying people. But now, I mean, we do this in
- 34:32in my company and, and, and it's, it's, it's awesome.
- 34:34Like I encourage it all the time.
- 34:36We're we're, you know, our product people can put a TRS,
- 34:38they still have to get a review, they still have to go through
- 34:40our checks. It's not Willy nilly push to
- 34:42prod, but they're meaningfully kicking off little, you know,
- 34:46few, few, few line changes through factors like things that
- 34:50are actually touching parts of the code base.
- 34:51And and I think that's awesome, right, Because the alternative
- 34:55is I have to contact switch into that, right?
- 34:56I have to go in and make like a relatively not super complex
- 34:59change just to unblock them and they can unblock themselves.
- 35:03And so those two roles are like kind of coming toward each other
- 35:06in a good way. I think the designers, to your
- 35:07point also, so I think we're even seeing one thing we're even
- 35:11encouraging is a lot of GTM people and you know, these,
- 35:14these, these folks that are effectively salespeople are,
- 35:16are, are in calls and, and they're, they're selling a
- 35:19product and they need to have a little more clarity on, Hey,
- 35:23what feature was shipped in last week and what features now
- 35:26present? And you can actually, you know,
- 35:28and, and in yesteryear that would be, hey, now go message
- 35:32someone on slack and say, Hey, engineer, what's the latest?
- 35:36Like, what did, what did we ship?
- 35:37What's, what are the new, the things that are in the road map
- 35:39or what not? It's a way easier now.
- 35:41And we encourage it and have it given the tools to our own teams
- 35:44to ask Claude and, and have Claude, of course, it's
- 35:47connected to our code base, get the most up to date source of
- 35:50truth on these things. And I think that's awesome.
- 35:53So even they, you know, they're maybe not shipping code, but
- 35:55they're at least using it to understand from the source of
- 35:58truth the code base, what is already there and what maybe you
- 36:02know, was not there a week ago. And because you can now look at
- 36:04the get logs or something like that.
- 36:06So it's all a bit of a convergence, which I think is
- 36:09just just everyone is up leveling.
- 36:11Do you buy into the idea that you're now going to have smaller
- 36:15teams? I, I would, I mean, here's the
- 36:19thing. I think that that is, I think
- 36:21that would be good. I think that that would be like
- 36:25a welcome thing for new teams, right?
- 36:27Where I think it is absolutely the case where if you're
- 36:31designing an engineering org or a team from scratch from day
- 36:33one, then you should be very thoughtful about what was
- 36:39typically the answer to the question, which is you're more
- 36:41people enables you to move faster.
- 36:43We always said that, but it was never true that if you doubled
- 36:46an engineering team, you doubled output.
- 36:48That was never the case. Why?
- 36:49Why is that the case? Because fundamentally, more
- 36:52people means there's now communication that has to be
- 36:55things that have to be communicated across.
- 36:57Law for that isn't there. I think there's a law that they
- 37:00call it where it's like, yeah, N yeah, now you have N
- 37:03communication or n ^2 or whatever the hell it is.
- 37:06I can't remember exactly but I've seen it in memes.
- 37:09I think I know you're talking about I also the name eludes me,
- 37:11but it's never it's never linear in number of people, right?
- 37:14That that's never the case. And that's just a human process,
- 37:17human limitation problem, human communication problem.
- 37:19And so I, I, it is the case that the more people you, you throw
- 37:23into the mix and something more, the context gets distributed and
- 37:26more the context that needs to get communicated when you're
- 37:27moving from one thing to the other.
- 37:29And so if, if that, if you have fewer people, more context is
- 37:32concentrated. And that's, I think a net
- 37:34positive because then you, if the goal is speed, then yes,
- 37:38that is the way to have more speed, right?
- 37:39Because now people are able to have more context if the goal
- 37:43is, you know, now if the goal is team bonding and team dynamics,
- 37:48which is which is like it's it's this is nothing with
- 37:50productivity per se, but it has it has all the human happiness
- 37:53is like then that's not the answer, right.
- 37:55It people do still want to go in like imagine the future one
- 37:59person billion dollar startup and imagine their off site.
- 38:01It's just you by. Yourself at a dinner and having.
- 38:03Dinner. You know what I mean?
- 38:05Hey, you know, and they're like, hey, what like let's listen.
- 38:07Every day is an offsite. Every day is an offsite.
- 38:10And they're like, hey, let's let's get a rundown from our
- 38:11CFO. You go and put on like a
- 38:12mustache, like, Hey, what is what is our marketing person
- 38:15think you want to put on a hat? You're just like, you know, this
- 38:19is that's very sad. It's like that that Pablo
- 38:21Escobar meme from Narcos. You know, he's like waiting,
- 38:25like it's a little bit of that. So I, I don't, I don't again,
- 38:30that's, that's a different effect, but not a not an
- 38:32insignificant one. It's just it depends what you're
- 38:34otimizing for. But if you're otimizing for
- 38:36reliability. Yeah, I I think like in the
- 38:39case. Of.
- 38:40There I would argue that fewer is also better just because
- 38:44again, on in the context is more concentrated.
- 38:47You know, I've certainly run into issues in the past where
- 38:51you know, you, you're some, some something goes down or
- 38:54something, and in some of the code base and you just like it
- 38:56takes your time to understand what is, how this was set up,
- 38:59who's responsible for this? And usually even then you're not
- 39:02that comfortable making the change because you're not the
- 39:04one who built it and you don't know what the, what the
- 39:06downstream effects are making that change.
- 39:08And so I do also think that they're it, it, it does
- 39:11introduce attention does like make things a bit slower versus
- 39:14if I built the whole thing, I'd be, I like, I know how this is
- 39:17set up. I know what, what's going to
- 39:18break if I hit this thing, if I issue this command.
- 39:20And so I'm a little bit more comfortable doing that.
- 39:23So that's the, that's the teams. Anything else on the new
- 39:27paradigm of just like the skills as a person that you need or the
- 39:34skills and the team structure and the team?
- 39:37Yeah, I think maybe that's the last thing I can a set of
- 39:40thoughts I can offer. There is you know when we talk
- 39:42about multi agent, I think one of the the set of skills that
- 39:44has become increasingly more important is like is the
- 39:47planning and the delegation. Planning and delegation, I think
- 39:49are still undervalued and yet super crucial if you want to
- 39:54institute, If you wanted to kick off multiple agents and have
- 39:57them do meaningful work, then you have to be the one at least
- 39:59delegating and being technical lead on their work.
- 40:01And so I think what we're going to see is people earlier on in
- 40:05their career developing manager skill sets, basically people
- 40:09that that, you know, came on as a junior and sort of indirectly.
- 40:14They are effectively managers the moment they start
- 40:16instituting multiple agents, right?
- 40:17The moment they're a couple of agents, they are effectively
- 40:20managers. And so they've gotten there way
- 40:22before maybe the typical career trajectory where you spend one
- 40:26year as a software dev one, then two years of software dev 2,
- 40:29then three as a senior range. And then that year six, you're
- 40:32like ready to be in a manager if you start from like fresh out of
- 40:35school grad. Well, and if you want to go down
- 40:38that path. And if you want to go, that's
- 40:40right, that's right, you could just keep going down the ICIC
- 40:42entirely. Yeah.
- 40:43Now there's no IC choice. Yeah, exactly.
- 40:46Everyone has to be manager. As an IC you are still a
- 40:49manager. Good luck, but at least you
- 40:51don't have to deal with people because that's thinking you're
- 40:53messy. That's and I wonder if that's I
- 40:55wonder if that's the piece that is.
- 40:58I mean, that's the piece that both draws people to the
- 41:00management route and turns in the way from the management
- 41:03route is like the the people. Like I like to be the the the
- 41:07figurehead and and and have my inspire exactly lead.
- 41:10But the student. What is it?
- 41:11The servant leader, right? Be be the one who who who guides
- 41:14it to the path forward. And then there's also be like, I
- 41:17also never want to talk to human being in my life at any part of
- 41:19my day. So why?
- 41:20How can I not do that? And put me in a room and just
- 41:23with my my terminal and my IDE. And so I think it does.
- 41:26It also bifurcates a little bit there.
- 41:29But yes, by design, I think now more people are getting.
- 41:31I noticed with myself and the skill that I really appreciate
- 41:36and want to work more on is my ability to articulate and.
- 41:41Not good at that. Yeah, no.
- 41:45Dude, words are hard. All right, give.
- 41:47Me a break. So the, I think if I, you know,
- 41:52as I'm raising my daughters, that's one thing that if we're
- 41:56going to lean in on one skill, it's how do you articulate what
- 42:00you're needing and what you want and what good enough is and what
- 42:04success looks like, all of that stuff.
- 42:06Because if you start talking to agents and you can't properly
- 42:12articulate it and you can't give it that context, then it makes
- 42:16it really hard. And I've noticed in my own life
- 42:20when I deal with others, working with others humans, it can be
- 42:25very difficult. If somebody comes and they ask
- 42:28you something and it's like, hey, can you take care of this?
- 42:31It's like, well, what is this? And that ambiguity is so hard to
- 42:36deal with. And it causes, OK, now we got to
- 42:38go back and forth. And so if you can properly
- 42:42articulate things, give the right context, that is a
- 42:46superpower and it's only going to get rewarded more as time
- 42:50goes on. I think that's a fantastic
- 42:52point, honestly. Yeah, I think that that's super,
- 42:54super on the nose. It it it is a forcing function
- 42:56for us to get better at words and get better at.
- 42:59At yeah, I mean, so I'm fucked basically.
- 43:03Well, we'll start practicing exercise that muscle.
- 43:05Yeah, exactly. Duolingo.
- 43:08Have you heard of it, Grammarly? No, no, I think that that is
- 43:12absolutely right and and it's a good forcing function.
- 43:15It's a good up level. Of us as as just a species as as
- 43:18like a skill set to have in in your yeah you you you don't
- 43:22speak clearly you're going to be misconstrued with people and
- 43:26certainly with agents and. So you're just going to waste
- 43:28time, right? And it happens already.
- 43:31But I think because we're dealing with another human, we
- 43:35almost take it for granted because they normally can come
- 43:39back to us with the right questions to ask to understand
- 43:43it. I guess with agents, they can do
- 43:45like I have the, I love this skill, the brainstorming skill
- 43:50that was from like the superpowers pack, and that is
- 43:55fairly good at interrogating me before kicking off any tasks.
- 44:00That's right. That's right.
- 44:01Yeah. So yeah.
- 44:06I mean, and maybe it's just that that you create a skill that
- 44:11will make sure to get everything, you know, and get
- 44:14all the right context. And so we don't need to be good
- 44:17at articulating, but it is time. Like if you and I, if you're
- 44:21good at articulating and I'm not, I need that skill to ask me
- 44:25things. I'm going to spend an extra 5
- 44:27minutes for every time that I wanted to get something done.
- 44:36I'm a fucking masochist. We're trying to organize
- 44:39conferences, dude. They suck.
- 44:42Except you do them and you have that moment of bliss afterwards
- 44:46and you're like, it wasn't that bad.
- 44:48And then leading up to it, it's like, why did I ever think that
- 44:53I wanted to do this? I've heard that.
- 44:55I mean, I don't, I can't speak for this, but I've heard this
- 44:58through my friends to be true of childbirth as well.
- 45:01For for women at least. Again, I don't, you know, take
- 45:03everything with a huge grain of salt and I'm not trying to
- 45:05mansplain. I don't know any about anything
- 45:06about this. Don't dudes talk about.
- 45:09I, I, I only know this through, through, through my fiance and
- 45:13and her friends who, who, who like, you know, sometimes will
- 45:16have like really bad childbirth, right?
- 45:19Like it's just, it's a. There's a hormone that gets
- 45:21released. Yeah, yeah, exactly like, which
- 45:22is fascinating to me. It's like, it's like this thing
- 45:24that is, I mean, you know, the bleak and the bleak as it's true
- 45:28is like Once Upon a time, like 1/3 of women died in childbirth
- 45:30or something like that, like some, some really stark
- 45:31statistic, which is crazy, right?
- 45:33And and yet modern medicine has made that no longer true.
- 45:36And in a lot of ways, reducing that rate is, is indicative of
- 45:39like a very forward culture, like a society, which is, which
- 45:42is, which is great. But but yeah, like you have, you
- 45:46have friends that go through like really bad, really bad
- 45:49childbirth. And it's like, you know.
- 45:52C sections are crazy. I don't want, you know, again,
- 45:54it's wild stuff. And then and then they're like,
- 45:56hey, like like 3 months later they're like, yeah, how about
- 45:59Round 2? And I like if, if I got cut open
- 46:02for, I mean, I've got, I've had many surgeries and you know,
- 46:05even like some that are more evasive than others.
- 46:07I mean, I had a knee surgery a few months ago and even just a
- 46:09knee surgery where all they did was like poke a thing in my knee
- 46:11with a little camera and like twiddled around a little bit.
- 46:14I'm like, dude, that I would never want, I don't want to ever
- 46:17do that again. Or, or every like consider doing
- 46:20that again. And even the fact that it was
- 46:21just a little tiny hole in my knee was was enough for doing
- 46:24like, you know. Yeah.
- 46:26So basically me organizing this conference.
- 46:29It's your. It's your brainchild.
- 46:31Is what I'm saying. My birth.
- 46:36Well, that that yes, I think that they, by the extension of
- 46:38the analogy, you are in fact birthing A brainchild, which is
- 46:41this conference, which is a good brainchild as all children are
- 46:45generally good children. Yeah, well, yeah.
- 46:47I mean, except for Dimitri. I know some shitty kids too, but
- 46:52I think it's great. Like to bring it back.
- 46:55That was an incredibly long analogy that I hope is not
- 46:57considered as mansplaining because I don't know anything
- 47:02about childbirth at all. But and we'll say that 1000
- 47:06times, but but what I will say is when it comes to AI coding
- 47:09and AI software development, which I have an opinion or two.
- 47:12About a little more. Which I feel more qualified to
- 47:15talk about. What I'll say is this that that.
- 47:20There is. There's so much changing so
- 47:23quickly. FOMO is a huge, huge thing.
- 47:26Maybe this is an obvious take away, but but there is genuinely
- 47:30a, a, a need and desire to, to formalize what's happening a
- 47:33little bit and, and, and mean this can take so many different
- 47:36forms from yeah, what agent to use, what model to use, what
- 47:39harness to use Devon, you know, cognition cursor, Claude,
- 47:43etcetera. But but also just as it's skills
- 47:46is it is it, is it MCP? Is it tools, it's API, is it, is
- 47:50it sub commands? I mean, sub agents like all
- 47:52these things and people. It's so easy when you combine an
- 47:57incredibly rapidly moving industry with a with a, a lot of
- 48:03a lot of social conversation suggesting that if you're not on
- 48:08it, you are going to be left behind.
- 48:10You're you're cooked. Like the end of the technical
- 48:12term. Yes, yes, you are cooked in the
- 48:13in the strictest sense, that's a, that's a, that's a that's
- 48:17basically a recipe for a lot of anxious engineers and, and I
- 48:20think it's it's good to. Bring it all back a little bit.
- 48:23I mean, I, I, I, I think, you know, when I teach classes and
- 48:27things like this for me and I don't, I don't know the people
- 48:31necessarily value this. I, I, I try to make it more of a
- 48:33point And because it's not very tactical, it's a little bit
- 48:36abstract. But like one of the things I
- 48:38genuinely, I'm trying to get people to appreciate is like
- 48:41just a breathe, you know, like breathe a little bit like, like
- 48:43in a very meta sense, just like breathe like it's, I understand
- 48:46things are changing. I understand things are
- 48:48incredibly quickly and they will continue to move quickly, except
- 48:50that is part of the process, right?
- 48:51Like that, that is experimentation is going to be
- 48:53part of the process. And we are developers and we're
- 48:55engineers and we love building and we will, we will need to
- 48:58experiment And, and you know, you're not going to lose your
- 49:00job immediately and, or maybe if at all, right, if you, if you
- 49:03learn how to like up level and, and up skill in the right ways.
- 49:06And so it, but, but before we dive into the anxious, you know,
- 49:10I think in, in moments of anxiety, you're just kind of
- 49:12grasping for security, however you can.
- 49:15And that might mean you, you like immediately look at a tweet
- 49:17and say, should I do that? And then you try that thing and
- 49:19then you know. Dude.
- 49:21But you know what I love about this time is that we're all our
- 49:25own little mini R&D departments. Yeah, R and DI guess is
- 49:30departments is a little repetitive in that sentence.
- 49:33Research and department departments and it's research
- 49:35and development departments, right?
- 49:36Oh, right, you're good. What research?
- 49:38Department Departments. What did you think of DUS?
- 49:43As I said, words are hard. We've.
- 49:46Already established. That, I think that's the name of
- 49:48this podcast, is Dimitra's discoveries.
- 49:50Words are hard. Yeah, that's the thumbnail
- 49:54words, me looking all dumb on the thumbnail.
- 49:58But basically we're all out there exploring and we are
- 50:03reporting back. And that's the cool thing.
- 50:05That's why I wanted to have this conference is because we get to
- 50:08report back. There's some people that are
- 50:11getting more exposure to it because of the companies that
- 50:14they run and they have seen hundreds or thousands of these
- 50:21little R&D departments and they get, they're on calls everyday
- 50:24where people are talking about what's working, what's not
- 50:26working. And there's people like you that
- 50:27are out there on the forefront. And so you get to showcase, hey,
- 50:33this is a design pattern that's happening now.
- 50:37And if we can bring all of those people together into a room, I
- 50:41think there's potential for at least, at the very least, you
- 50:47miss out on having to bang your head against the wall because
- 50:53you're thinking, oh, this is the new one, or that's the new one,
- 50:55or I'm trying it like this and it's not working.
- 50:59But now you get to hear from other practitioners that, yeah,
- 51:02well, I tried these five things. Here's the one that really was
- 51:04important. Yeah, love that.
- 51:06Yeah, I think that that's that's absolutely right.
- 51:08I think that's why there's so much value in these kinds of
- 51:10efforts and, and, you know, masochism aside, putting
- 51:13yourself through this experience and it was a ton of work.
- 51:15But but genuinely, I think there's so much value in these
- 51:17conferences where you know, you're getting the best of
- 51:20you're getting the best of the insights, you're getting the,
- 51:22the, the, the summary on the summaries.
- 51:24You know, you're getting the, the best of the Twitter feed in
- 51:26one tweet. You know, I mean in, in the, in
- 51:29the most very practical way. And so I think there's a there's
- 51:33genuinely a lot of value. People should invest more in
- 51:35these things And, and, and then you, you, you build your
- 51:37connections as well, right where then you, the people that you
- 51:40trust, that you develop more rapport, people, people that you
- 51:42can keep bouncing ideas off of. I think the, this is the, the
- 51:46part of like us being social creatures that I think is, is
- 51:50one of those beautiful things, right?
- 51:51Is that actually we, we do share information and especially
- 51:54engineers, they love, like, I mean, that's why open source is
- 51:57such a, such a core pillar of, of what, what we do is we love
- 52:00sharing those things. We love proudly sharing what
- 52:03we've built and we love, we love sharing of, of our own ideas
- 52:06around these things. And so giving forums for that to
- 52:08happen organically is, is, I think healthy.
- 52:11And it's also definitely a a way to combat the inherent anxiety
- 52:16that might happen when you're just on Twitter doom scrolling
- 52:19and you don't know any of these people.
- 52:21And but they're all the strangers in the grand scheme of
- 52:24your life. And you will never talk to them.
- 52:25But somehow they have such a huge influence on on what you're
- 52:28thinking and feeling at any given moment, which I think is
- 52:29just a funny, it's brutal, very funny dynamic.
- 52:32Yeah, it is. Hard on the mental health.
- 52:33Totally, totally. Even just coming to San
- 52:35Francisco, it's hard on my fucking mental health.
- 52:37I don't know how you. Live here dude.
- 52:39Seeing all the. Billboards.
- 52:40Ever a lot of Academy. Yeah.
- 52:44You see this? This Burning Man is up on the
- 52:464th floor. No, it's a.
- 52:47Burning Man is how people resolve these things.
- 52:48No, it's. True.
- 52:49Kind of a little bit. Right pressure valve that you
- 52:51escape. Yeah, I mean, I don't think
- 52:54that's the topic of this conversation, but like, it's
- 52:55just because we are in a building where I discovered that
- 52:59Burning Man has a floor. Turns out they are renting out a
- 53:02floor of a San Francisco building.
- 53:04Turns out that is a thing. People at home, so much burden
- 53:07for beating the man. It is so novel that they have
- 53:10that right. Like.
- 53:11Yeah, it's so. It's they're paying rent
- 53:13somewhere. They're paying rent.
- 53:14They're, they're, they're paying taxes if they're doing it
- 53:17correctly, which is very much against.
- 53:20Anyway, the only reason I bring that up, outside of the fact
- 53:22that it's a very funny anecdote, is is the fact.
- 53:24That, yeah, I think that that is a little.
- 53:25Bit how people deal with this is is you, you play you play
- 53:29serious adult person most of your life 99.9% of the year and
- 53:34then you go into a desert and and then don't ask you what
- 53:36happened there.