Latest / The Ruby AI Podcast / Real vs. Fake AI with Evan Phoenix

Transcript

Real vs. Fake AI with Evan Phoenix · The Ruby AI Podcast

0:00
SPEAKER_00: Hey everybody, welcome to another episode of the Ruby AI Podcast.
0:03
SPEAKER_00: I'm one of your hosts today, Valentino Alstol, and joined by Joe.
0:07
SPEAKER_00: Joe?
0:08
SPEAKER_00: Hey, I'm Joe Leo.
0:09
SPEAKER_01: I'm the other host.
0:10
SPEAKER_01: And I'm here to ask Evan Phoenix the question that everybody's been dying to know.
0:16
SPEAKER_01: And this is Evan.
0:17
SPEAKER_01: Please introduce yourself and tell us who is more famous, you or Evan Phoenix and the Raven hosts, front man Evan Phoenix.
0:27
SPEAKER_03: Actually, I have a great story about this.
0:29
SPEAKER_03: I'm glad that you brought up hi Evan Phoenix, longtime Ruby programmer.
0:33
SPEAKER_03: Not as much lately, but still in the scene.
0:36
SPEAKER_03: We're just riffing here.
0:37
SPEAKER_03: So the very minor backstory is that when I got married, I gave myself this last name.
0:44
SPEAKER_03: My wife also.
0:45
SPEAKER_03: So my last name used to be Webb, her last name used to be Tam.
0:48
SPEAKER_03: And we made a decision like, let's just come up with a brand new last name.
0:52
SPEAKER_03: And so we were engaged for like 18 months.
0:54
SPEAKER_03: And so this is the name that we came up with, and we love it.
0:56
SPEAKER_03: And so I chose this name, like in a very real way.
1:00
SPEAKER_03: I chose this particular name.
1:02
SPEAKER_03: And so I'm always on the lookout.
1:04
SPEAKER_03: Evan is not the most common name in the world, and Phoenix is not the most common name.
1:07
SPEAKER_03: So it's like, are there other Evan Phoenixes and will they pop up?
1:10
SPEAKER_03: So the musician Evan Phoenix, which I don't know if it's his real name or if it's his stage name or not.
1:17
SPEAKER_03: Oh, now we're gonna dig into this.
1:19
SPEAKER_03: What I do know is that he wrote a book.
1:22
SPEAKER_03: I know he wrote a book because for about a year I would get phone calls from someone who wanted to represent me in book sales and basically promote my book.
1:34
SPEAKER_03: And I was like, what is going on?
1:36
SPEAKER_03: And of course, it's just like it was for a year where I get this call, it'd be like months between.
1:40
SPEAKER_03: So I forget what the phone number was, and so I wouldn't answer it.
1:42
SPEAKER_03: And I look at the voicemail and be like, Hi, Mr.
1:44
SPEAKER_03: Phoenix, uh, this is such and such from Publishers Weekly.
1:48
SPEAKER_03: And we'd love to get you on the line.
1:50
SPEAKER_03: We're doing a this is that, whatever, some author thing.
1:52
SPEAKER_03: And I'd be like, This is so strange.
1:54
SPEAKER_03: It happened one time and then it happened again.
1:56
SPEAKER_03: And finally they called and I remembered the like I remembered something about the number.
2:00
SPEAKER_03: I was like, oh my God, it's the book people.
2:02
SPEAKER_03: So I answered the call and I was like, they're like, hello, like, oh, this is Evan Phoenix.
2:07
SPEAKER_03: And I was like, yes, hey, this is such and such.
2:09
SPEAKER_03: And I was like, okay, I gotta stop you right there.
2:11
SPEAKER_03: I've gotten your voicemails.
2:12
SPEAKER_03: You have the wrong Evan Phoenix.
2:14
SPEAKER_03: And they're like, Oh my god, we've been calling you for a year.
2:18
SPEAKER_03: And I was like, I know, and you still have the wrong one.
2:21
SPEAKER_03: This sounds like a great deal, maybe, but you should find out how to contact the correct person.
2:25
SPEAKER_03: So given that, am I the more famous one?
2:29
SPEAKER_03: Because my phone number, I guess, is more on the internet.
2:32
SPEAKER_01: So you are the most famous Evan Phoenix, at least if we go by YouTube, which let's just go by YouTube.
2:39
SPEAKER_01: You've got some talks out there that have thousands of viewers.
2:42
SPEAKER_01: You've also been around a lot more.
2:43
SPEAKER_01: You're definitely the OG Evan Phoenix.
2:46
SPEAKER_01: Yeah, and I would say the more famous.
2:48
SPEAKER_01: Though Evan Phoenix has been doing a lot of SEO work, is my opinion.
2:53
SPEAKER_03: Okay.
2:54
SPEAKER_03: Well, so that's gonna be disappointing to the Evan Phoenix that used to be a college basketball player and is now a YouTube real estate influencer.
3:01
SPEAKER_03: Oh, he's gonna be he's gonna be disappointed that I'm the more famous one.
3:04
SPEAKER_03: That's a trouble.
3:05
SPEAKER_03: His livelihood, evidently, is being some kind of influencer.
3:08
SPEAKER_03: So uh I just get into the German cosplay Evan Phoenix.
3:12
SPEAKER_03: That's another one.
3:13
SPEAKER_03: So he cosplays as Loki, he looks exactly like it.
3:18
SPEAKER_03: He's it's he's an excellent cosplayer.
3:20
SPEAKER_03: So all right, all right.
3:23
SPEAKER_00: I just think it has like your long time ruse to confuse AI agents.
3:28
SPEAKER_00: Yeah, yeah.
3:29
SPEAKER_03: Well, it's funny is like it's a handful globally, there's not that many, and so it's easy for me to know most of them, or at least know of most of them.
3:37
SPEAKER_01: So yeah, I mean, I think you're right, Valentino.
3:40
SPEAKER_01: This is an AI podcast.
3:41
SPEAKER_01: We use AI to prepare for our guests.
3:43
SPEAKER_01: And you know, if I just say, hey, give me some questions about Evan Phoenix, I'm gonna get poetry stuff, I'm gonna get cosplay stuff.
3:49
SPEAKER_03: Very good.
3:49
SPEAKER_03: Yeah, but my book, yeah, yeah, my book of sonnets.
3:53
SPEAKER_01: Yeah, yeah, it is a book of poetry.
3:55
SPEAKER_03: Yeah, yeah.
3:56
SPEAKER_03: So who are you, Evan?
3:58
SPEAKER_03: I am the programmer, Evan Phoenix.
4:00
SPEAKER_03: As far as I know, uh that's the only Evan Phoenix with that persona.
4:03
SPEAKER_03: Um, right now I'm the CEO of Mirin, which is my own company.
4:06
SPEAKER_03: We're building deployment systems.
4:08
SPEAKER_03: I'm a longtime infrastructure backend programmer.
4:12
SPEAKER_03: Even when I was in Ruby, I the thing I was most known for was building back-end tools.
4:17
SPEAKER_03: I built a Ruby VM for many years and building things like Puma and benchmark IPS and all that kind of stuff.
4:25
SPEAKER_01: So and now I saw the announcement for Mirin.
4:30
SPEAKER_01: It seems like it's been about 10 months, yeah.
4:32
SPEAKER_01: Which, you know, now that we have code gen tools, is like 10 years.
4:37
SPEAKER_01: And so where is Mirin in the marketplace?
4:40
SPEAKER_01: Are you dominating yet?
4:41
SPEAKER_01: Have you taken over all deployment software?
4:45
SPEAKER_03: It's such a great question.
4:46
SPEAKER_03: I mean, not yet.
4:47
SPEAKER_03: We did our first preview release just last week.
4:49
SPEAKER_03: So it was me for a long time.
4:51
SPEAKER_03: Well, not a long time, but like it's only three of us, three engineers.
4:55
SPEAKER_03: I hired the other two engineers back in March.
4:59
SPEAKER_03: It was three of us for most of the year.
5:01
SPEAKER_03: I can say definitively, the amount of work that we've been able to get done as three people using Claude for the most part as our AI assisting tool is way beyond, I think, where we would be able to get done as three people without it, right?
5:15
SPEAKER_03: And so back looking and more so forward-looking that like we have this roadmap, and I'm like, okay, we're gonna get this done, this done, this done, this done.
5:22
SPEAKER_03: And I would say that the productivity that we have seen over the course of the last six months has really informed me in like looking at the roadmap and being like, okay, we got this big feature.
5:31
SPEAKER_03: How long do we think that'll take?
5:32
SPEAKER_03: I don't know, maybe a month.
5:33
SPEAKER_03: I think that without those tools, it'd be like, I don't know, maybe six months.
5:36
SPEAKER_03: That is probably where it's mostly changed.
5:39
SPEAKER_03: It's like we all have to like kind of lick our finger and put it up and be like, I think that how long is this gonna take?
5:43
SPEAKER_03: And I think that's the biggest thing that I've noticed is that my wild ass guesses about stuff has completely changed.
5:50
SPEAKER_01: I'm gonna say something that sounds funny, but I don't mean it to be.
5:52
SPEAKER_01: That also changes, like when we as engineers inevitably take twice as long as we think, that means that it's a year, it's two months and not a year, right?
6:02
SPEAKER_01: So it's an order of magnitude.
6:03
SPEAKER_01: Well, not really, but it's it's a lot, lot shorter.
6:06
SPEAKER_03: Yes, exactly right.
6:06
SPEAKER_03: I mean, we always underestimate how long it's gonna take.
6:09
SPEAKER_03: I sort of just build that into that calculus, right?
6:12
SPEAKER_03: Like I look at it and I go, like, I don't know, I could do this in two weeks.
6:15
SPEAKER_03: So it's gonna take six weeks or whatever it is.
6:17
SPEAKER_03: That's the normal calculus.
6:18
SPEAKER_03: But again, it now it's six weeks and not okay, well, I don't know, like I probably three months and then it takes six months.
6:24
SPEAKER_03: That's exactly exactly right.
6:25
SPEAKER_03: Yeah.
6:26
SPEAKER_00: Right.
6:26
SPEAKER_00: When you say you're like you've integrated Claude into your like workflows, like how deep does the rabbit hole go there?
6:35
SPEAKER_03: It's mostly every day.
6:36
SPEAKER_03: So, you know, like as we're writing code, it's probably the first stop on what we do.
6:42
SPEAKER_03: So we have a pretty good writing culture.
6:44
SPEAKER_03: I was at HashiCorp for a number of years, and one of the things about HashiCorp is having a good writing culture.
6:49
SPEAKER_03: HashiCorp is a remote-only company, or was when I was there.
6:52
SPEAKER_03: I don't know how things have changed in the last year since they've been part of IBM.
6:56
SPEAKER_03: My company, Mirin, is remote only.
6:58
SPEAKER_03: And so I knew how important it was for there to be writing culture.
7:02
SPEAKER_03: And so one of the places that we start for any large piece of functionality is hey, let's write this down.
7:08
SPEAKER_03: We call them RFDs, request for discussions.
7:10
SPEAKER_03: And so we sit down and like write it down.
7:12
SPEAKER_03: And we used Claude in those tools.
7:14
SPEAKER_03: It's like, hey, I'm gonna write an RFD on this topic.
7:17
SPEAKER_03: I want you to hit these points, I want you to hit this, and then we use that to sort of like flesh it out.
7:21
SPEAKER_03: And then a lot of that's like, okay, I need you to hit this point, I need you to hit this point, and then going back and being like, okay, I'm gonna put this in my own voice or I'm gonna address this stuff, but hey, can you add an example that looks like this?
7:33
SPEAKER_03: Can you add an example that looks like this?
7:34
SPEAKER_03: So using it at that phase, and then we go through the human review process.
7:38
SPEAKER_03: And then once we okay that, what we usually do is we literally take that RFD over to the directory that has the mechanically, we download it as markdown, we put it in the directory where Claude has the code, and we say, go read this RFD and make a plan to implement it.
7:55
SPEAKER_03: And it goes and it does that.
7:57
SPEAKER_03: Okay, great.
7:57
SPEAKER_03: I see what we're trying to do here.
7:58
SPEAKER_03: I understand the product definition.
8:00
SPEAKER_03: Great, we're gonna go through with this.
8:02
SPEAKER_03: And sometimes we one-shot features like that sometimes.
8:05
SPEAKER_03: Because again, I feel like the defining the boundaries for these tools is the name of the game.
8:12
SPEAKER_00: So we had you on here to talk about like real versus fake AI.
8:17
SPEAKER_00: Yeah.
8:17
SPEAKER_00: What do you mean by that?
8:18
SPEAKER_00: And maybe like how does that fit into your workflows, which seem like very much, I would assume, real AI.
8:26
SPEAKER_00: Yeah, for sure.
8:27
SPEAKER_03: I think about it in the frame of how companies advertise AI.
8:35
SPEAKER_03: Like our tool doesn't have any AI built into it right now.
8:38
SPEAKER_03: So, for instance, you download it, you can deploy an AI agent onto it, but like as a part of the thing that we build and we give out, we're not selling an AI-enabled thing.
8:46
SPEAKER_03: We've got plans, but we don't do anything like that today.
8:49
SPEAKER_03: And so I think about it more in the like, uh, what is the product part of AI?
8:54
SPEAKER_03: Like, in other words, what if I look at a product and I'm like, oh, this thing has AI, what does that mean?
9:00
SPEAKER_03: What does that mean from a product context?
9:03
SPEAKER_03: Have AI in your product?
9:04
SPEAKER_03: And so I think that's really what I get into like what is fake and what is real.
9:08
SPEAKER_03: My take in this, and I've got other examples, like technical examples of this, is like AI can't be the product feature.
9:16
SPEAKER_03: It can be like a technical feature that you use to implement something, but it can't be the feature unto itself.
9:22
SPEAKER_03: Let me give you the example.
9:24
SPEAKER_03: You maybe have a workout app, and the workout app says, we now have the ability to do customized workouts based off your past workout history.
9:33
SPEAKER_03: If they use AI for that, fine, I don't care.
9:36
SPEAKER_03: But the feature was custom workouts, right?
9:39
SPEAKER_03: Whereas if I go to another workout app and they say, workouts now with AI, I'm like, that's not a thing.
9:45
SPEAKER_03: That's like workouts now with blue.
9:47
SPEAKER_03: I was like, I don't know what blue is.
9:48
SPEAKER_03: Like, what is blue in this context?
9:50
SPEAKER_03: Like are blue weights, blue, like, and so this is a sort of a viewpoint cultivated in the history of seeing how blockchain is used for the most part.
10:01
SPEAKER_03: Blockchain, I think, is a really interesting technology, but it's not a product, it's just a way of building a product.
10:06
SPEAKER_03: And so I think that's really what I mean by like fake versus real AI.
10:11
SPEAKER_03: Is it just a way to implement some product surface area, or is it the product surface area?
10:15
SPEAKER_03: Because if it is the product surface area itself, it's probably what are we talking about?
10:19
SPEAKER_03: Are we talking about just like you shoved a chat bot into this thing that it doesn't a real product?
10:24
SPEAKER_03: That's what I mean.
10:25
SPEAKER_00: I see.
10:26
SPEAKER_00: Yeah.
10:27
SPEAKER_00: Is it actually using I agree with that in a lot of ways?
10:30
SPEAKER_00: It is becoming more and more blurred to the point where, like, do you even foresee like cloud code living in your product in some capacity?
10:39
SPEAKER_00: Or is that like you would never do that?
10:42
SPEAKER_03: I think that cloud code is a good example as it relates to our product in like some of our like longer-term vision stuff, right?
10:50
SPEAKER_03: So I think that cloud code is itself a product, and so it has real tangible value that it uses an AI for.
10:57
SPEAKER_03: And so I can see us integrating cloud code in that like one of our far-turn roadmap items is we want to be able to provide good development environments, right?
11:06
SPEAKER_03: We want to say, like, instead of having people have a wiki page or Google Doc that lists how to set up your dev environment, we want to have a story for that.
11:14
SPEAKER_03: And I think that coding agents are part of that story today.
11:17
SPEAKER_03: So it's, oh yeah, could we have cloud code in the product insofar as like we give you a development environment that has cloud code?
11:23
SPEAKER_03: Yeah, absolutely.
11:24
SPEAKER_03: I think that from a perspective of like using AI, I think we have one way that you use AI today, and I will talk about because I think it's so much fun.
11:34
SPEAKER_03: And the second one is a more product focused way.
11:36
SPEAKER_03: I'll start with the product focused way because it's more boring, which is that one of the things that I think as people in working with AI that's been clear is that it's so good at summarization.
11:46
SPEAKER_03: It's so good at picking out the signal from the noise.
11:50
SPEAKER_03: And so, like, one of the things that we want to start doing is like, okay, well, we're gonna have like, for instance, all these logs for somebody.
11:55
SPEAKER_03: We want to be able to say, like, hey, I want to turn on daily summary.
11:59
SPEAKER_03: And the daily summary can be AI driven.
12:02
SPEAKER_03: It can be taking in what happened with your deployment today, all your logs, and it can say, like, hey, everything was good, just one sentence, everything is fine.
12:08
SPEAKER_03: Or, hey, we had a weird 20% latency spike.
12:11
SPEAKER_03: I don't know that it's anything, but you might want to look at it.
12:13
SPEAKER_03: Those are good examples of where you just want something that's summarized and surface.
12:18
SPEAKER_03: I like that actually.
12:19
SPEAKER_01: I don't think that's so boring.
12:20
SPEAKER_01: So I'm excited for the exciting part.
12:22
SPEAKER_01: Sure.
12:22
SPEAKER_01: Just because you know, we spend so much time trying to instrument everything so that it can tell us a story, but right almost inevitably we end up looking at multiple screens or we spend a ton of time putting a dashboard together.
12:34
SPEAKER_01: I like that quite a bit.
12:36
SPEAKER_03: Yeah.
12:36
SPEAKER_03: One of the design philosophies that I have is that people don't really want to look at an Excel spreadsheet of numbers and then try to figure out what the numbers mean in a like higher level context.
12:48
SPEAKER_03: Yes, that's like philosophy.
12:50
SPEAKER_03: Right.
12:50
SPEAKER_03: And so lots of the tools in the deployment space are like, here's all the numbers, figure it out.
12:55
SPEAKER_03: Right.
12:55
SPEAKER_03: We just want the ones that are red or green or you know, somewhere in between, you know, or why yeah, or like some gut check, like, hey, you know what?
13:03
SPEAKER_03: These numbers look like they did last week.
13:05
SPEAKER_03: If you were okay with last week, you're okay with this week.
13:07
SPEAKER_03: Yeah, that's okay too, right?
13:09
SPEAKER_03: I think that understanding baselines and being able to just like give uh things are looking weird.
13:14
SPEAKER_03: I don't know if it's bad.
13:16
SPEAKER_03: Maybe you got really popular and all of a sudden the metrics changed in some radically different shape, right?
13:22
SPEAKER_03: But I think that the philosophy we have is like if there is important data, we should have an idea of how to show it.
13:29
SPEAKER_03: And if the data isn't important, we should just not show it.
13:32
SPEAKER_03: We should just be like, everything's fine.
13:34
SPEAKER_03: Yeah, you're good, move on with your day.
13:36
SPEAKER_01: It also addresses something that I think we all experience, which is this notification fatigue.
13:41
SPEAKER_01: Absolutely.
13:42
SPEAKER_01: I could have a talk at RailsConf, and in the middle of the talk, I stopped and I asked the audience like how many people had ignored a warning that had come in like on Slack or email in the time that I had been in talking, every hammer.
13:55
SPEAKER_01: You know, and it's amazing.
13:56
SPEAKER_01: Yeah, which you know, there's a lot of people that are like taking their job and their program and their software seriously, but it's just too much.
14:04
SPEAKER_03: That is the place that I think that I'm really excited to use those sorts of tools to apply to because I think that is tangible, it's real, it's a everyday sort of thing.
14:15
SPEAKER_03: It's like I don't have to worry about it telling me when something is weird.
14:18
SPEAKER_03: I know that the weirdness detector will literally go off and say, like, I'm glad that I haven't talked to you since last Thursday, but that weird thing is happening again on Thursday.
14:26
SPEAKER_03: Like, you can tell in the way that like I also think about these things, I think about them in a conversational way that like I think that that's the human interface.
14:33
SPEAKER_03: I think that we're better in terms of digesting conversation than digesting like field of numbers, you know.
14:40
SPEAKER_03: So if you may, I want to talk about the other use that internal use that we have, which I love.
14:44
SPEAKER_03: One of my founding engineers, Paul, is going to do a blog post about this, but I can't not talk about it.
14:50
SPEAKER_03: The ability to summarize, the ability to pick out signal for the noise is also the thing that I think really makes the coding tools great.
14:58
SPEAKER_03: I had a session yesterday where I had this weird bug that I was trying to fix before doing this release, and it showed up in this kind of weird way.
15:06
SPEAKER_03: It was just like unknown type empty string.
15:09
SPEAKER_03: And I was like, unknown type, what are we doing?
15:11
SPEAKER_03: And so I kind of dug through the code and I was trying to figure it out.
15:14
SPEAKER_03: And I worked on it for like, I don't know, half an hour, 45 minutes of like trying to trace the flow, and I couldn't get anywhere.
15:20
SPEAKER_03: And so then I used Claude code.
15:23
SPEAKER_03: I have a custom agent called Go, the product's written in Go, Go Distributed Debugging Engineer, which is like literally optimized for like your job is to go find really weird problems.
15:37
SPEAKER_03: And it's amazing at it.
15:39
SPEAKER_03: Like I basically said, like, hey, I got this weird message.
15:41
SPEAKER_03: Can you go off and see if you can figure it out?
15:44
SPEAKER_03: And it's spun for five, seven minutes or something like that.
15:48
SPEAKER_03: And it's like, okay, yeah, I figured it out.
15:51
SPEAKER_03: This code in this place was not reading its arguments, which was leaving data on the stream, and then that data was getting interpreted by the next thing as a request.
16:00
SPEAKER_03: And I was like, that would have taken me quite a while to figure out, if at all, right?
16:05
SPEAKER_03: That summarization that like finding the signal in the noise is the big part.
16:09
SPEAKER_03: So, one of the things that one of my engineers built was when I started in the company, I was like, let's try to not go overblown on tools.
16:17
SPEAKER_03: If we can get along with a simple tool, let's just work it for a while.
16:20
SPEAKER_03: And so for that reason, we didn't get a Zoom subscription.
16:22
SPEAKER_03: We're like, we're just gonna use Google Meet.
16:24
SPEAKER_03: We just want to see how far we can get with Google Meet, right?
16:26
SPEAKER_03: And one of the things that we did was we were like, you know what, this sucks that you can't start a Google Meet from Slack.
16:34
SPEAKER_03: We really wanted to be able to start a Google Meet from Slack.
16:36
SPEAKER_03: So we're like, okay, well, eventually we'll build our own little Slack bot that can go start them.
16:40
SPEAKER_03: So we go and build that and we're like, oh, very good it's working, you know.
16:43
SPEAKER_03: Like again, we use cloud code to build that.
16:45
SPEAKER_03: And so then we kind of like we're spreadballing, what else could this little Slack bot do?
16:50
SPEAKER_03: And we have this idea and it is so great.
16:53
SPEAKER_03: So Gemini will do this.
16:56
SPEAKER_03: Is using Gemini as a cloud, Gemini will do the summaries.
16:59
SPEAKER_03: Like if you do a call, you can say, hey, give me the call summary of what happened, right?
17:03
SPEAKER_03: And it'll output its own version of the call summary.
17:06
SPEAKER_03: But you've also got the transcript in there.
17:08
SPEAKER_03: So what Paul, my engineer, did was he used that and fed that whole thing.
17:16
SPEAKER_03: I can't remember if he fed the summary or the transcript itself back into Gemini again, but with a different prompt, which was I want to send a bullet point list of what happened in this meeting to Slack.
17:25
SPEAKER_03: So I need you to give me bullet points.
17:26
SPEAKER_03: I need you to pull out bullet points to give over there.
17:30
SPEAKER_03: I need three to six bullet points of work.
17:34
SPEAKER_03: And if there are any off-topic, off-work items, I want you to pull those out separately and include those in a separate section.
17:42
SPEAKER_03: And I can't tell you the amount of joy that it brings us to see the summaries after the meetings because it's like talked about debugging.
17:50
SPEAKER_03: Uh, Evan and Teresa talked about debugging, and then at the bottom will be like Evan and Teresa expressed a fondness for making snow angels.
17:58
SPEAKER_03: Like that'll be the thing at the bottom.
17:59
SPEAKER_03: And I can't tell you the amount of amazing, just like it's so great.
18:04
SPEAKER_03: Yeah.
18:05
SPEAKER_01: I wanted to uh go back to the writing culture that you talked about.
18:09
SPEAKER_01: The thing that I love about what you described, and we do some of that as well at Def Method, but some of the stuff that you described, if AI wasn't involved, we would be saying, but that's big upfront design.
18:22
SPEAKER_01: That's so much work that you're doing ahead of time, right?
18:25
SPEAKER_01: And I think that's a really interesting shift in how agile methodologies can be understood when you have all these tools at your disposal.
18:34
SPEAKER_01: Studying like the waterfall patterns that don't work or anti-patterns that don't work, it's always like, well, it's because it takes you two months to write all of this and then design it and then come up with a plan, which is what you described happening in basically like less than a day.
18:48
SPEAKER_01: And so all of a sudden it's like, okay, well, the plan is always wrong because the plan is not faced with reality.
18:53
SPEAKER_01: So you have to change the plan.
18:54
SPEAKER_01: But if you have AI helping you along the whole time, then why not?
18:58
SPEAKER_01: Why not do the big upfront design?
19:00
SPEAKER_01: It's you're actually not doing it, you're having it done for you.
19:03
SPEAKER_03: For me, in some ways, it's less a fact that the AI is doing it and more in terms of the time investment, right?
19:09
SPEAKER_03: Like, so in other words, if it takes an afternoon to do, do it.
19:14
SPEAKER_03: The problem was it was taking two months to do an upfront design, right?
19:17
SPEAKER_03: And so one of the things that I really try to push and cleave to is like just try things, right?
19:23
SPEAKER_03: Like we're in the age where just spend the afternoon trying three or four different solutions to a problem and to see which one you like.
19:32
SPEAKER_03: In the past, the developer time was always seen as this thing that, like, it's very, I have to guard it very carefully and preciously.
19:40
SPEAKER_03: And agile is a reflection of that, right?
19:42
SPEAKER_03: Like, I want to be able to like engineer time is so precious that I want to be able to pivot that engineer time to actively look for oh, we're going this direction, now we're going that direction.
19:51
SPEAKER_03: Like, I don't want to put them on a path that they're not able to get out of because they might not be able to get out of it for six months, right?
19:57
SPEAKER_03: Right.
19:58
SPEAKER_03: I think now we're at this place where it's like, no, like I have an idea.
20:01
SPEAKER_03: It would normally have taken me a month.
20:02
SPEAKER_03: I'm just gonna spec it out.
20:04
SPEAKER_03: It's a Friday, I'm gonna try to build the whole thing out in a Friday.
20:07
SPEAKER_03: And oh yeah, that did work.
20:08
SPEAKER_03: Okay, great.
20:09
SPEAKER_03: What did I learn?
20:09
SPEAKER_03: What did I not like from it?
20:10
SPEAKER_03: What did I want to incorporate into like the my next attempt at this?
20:14
SPEAKER_01: Yeah.
20:14
SPEAKER_01: Yeah, I think it's a fascinating development and how we can work together.
20:18
SPEAKER_00: You make some interesting points here, and I want to call out a few of them.
20:22
SPEAKER_00: A lot of people are like, I save so much time, and I'm like not coding as much anymore.
20:26
SPEAKER_00: And I think what I hear is that you're just not spending the same time on the same things.
20:33
SPEAKER_00: And it's not like we're actually saving any time yet.
20:36
SPEAKER_00: Yeah.
20:37
SPEAKER_00: And that we're just now like writing more up front, spending a lot of time thinking about what it should be making.
20:44
SPEAKER_01: Well, that's the thing, right?
20:45
SPEAKER_01: Code is a liability.
20:46
SPEAKER_01: Yes.
20:47
SPEAKER_01: So if you're spending a whole ton of time coding, that may not be great.
20:50
SPEAKER_01: Spending less time coding could be good.
20:52
SPEAKER_03: I get that perspective, but I actually think that it depends on the person and the task.
20:59
SPEAKER_03: Maybe I'll give you a little bit of background to like what my own process looks like.
21:04
SPEAKER_03: I am a systems thinker, so like in my head when I'm building a thing, I end up having like a map.
21:11
SPEAKER_03: I have a very tangible to me view of what I want to build in my head.
21:16
SPEAKER_03: Okay, there's gonna be this, and it's gonna be this, and this is gonna do this, that, and the other thing.
21:20
SPEAKER_03: And like I have it in my head, right?
21:22
SPEAKER_03: I can now just describe that thing.
21:25
SPEAKER_03: I can sit down and I can say, like, okay, I want this to talk to that, and this should be using this, that, and the other thing, and then be like, okay, great, I will go off and do it.
21:33
SPEAKER_03: And so for me, the code was never deliverable.
21:36
SPEAKER_03: For me, the system was always the deliverable, right?
21:38
SPEAKER_03: The code was just the thing that implemented that system.
21:41
SPEAKER_03: And so the ability to work with the coding agents to say, like, this is how I want the system to work.
21:47
SPEAKER_03: And I give it those guidelines.
21:49
SPEAKER_03: I give it, hey, this thing should go over here and this thing should do that.
21:51
SPEAKER_03: In some ways, it acts like a typist, right?
21:54
SPEAKER_03: Like it's gonna do a lot of the legwork, it's gonna do a lot of that stuff for me, but it's also gonna say, like, hey, like, you didn't Mention this thing over here, but I went and I did this abstraction for it.
22:03
SPEAKER_03: I was like, oh yeah, that was a great way to handle that sort of thing.
22:06
SPEAKER_03: Right.
22:06
SPEAKER_03: And so I think for me personally, because of the way that I approach the problem, which is like in a systems way, and I describe it in a systems way, I do save a lot of time because what I am getting very quickly is a, even if it's a broken system, I can go and look at the code and I can be like, okay, great, we're 75% of the way there.
22:25
SPEAKER_03: It doesn't work because I under specified this section and we'll go fix that, right?
22:29
SPEAKER_03: I think that where it falls down is when you go into the problem space and you don't have a clear idea of what the outcome is supposed to be from a product perspective, right?
22:42
SPEAKER_03: Or from a systems perspective.
22:44
SPEAKER_03: So if you're like, someone should be able to log in, is a horrible thing, an absolutely horrible thing to ask a coding agent to solve for you because there's a mountain of different variation that you could get.
22:55
SPEAKER_03: And sure, I guess if you want to just see like what it's going to do so that you can form your own opinions, that's fine.
23:01
SPEAKER_03: But then you're going to be doing that thing.
23:02
SPEAKER_03: What you're going to be doing is iterating with, oh, okay, oh, you logged in.
23:06
SPEAKER_03: Oh, actually, I know that's not, I wanted you to use JWTs.
23:09
SPEAKER_03: Oh, okay, great.
23:09
SPEAKER_03: Let me go redo it again.
23:10
SPEAKER_03: Oh, actually, no, no, no, no, that's a bad idea.
23:12
SPEAKER_03: Go off and do that.
23:13
SPEAKER_03: If you want to do that iteration, that's fine.
23:16
SPEAKER_03: I guess in the way that I think about it is that person is probably saving themselves some time, not a lot of time, because I'm old enough to remember that when teachers would tell you to write stuff out longhand and rather than type it out.
23:28
SPEAKER_03: The value of writing stuff out longhand is that your brain has time to think about what the next word is before you get to the next word, right?
23:36
SPEAKER_03: We're basically just accelerating that times a thousand here.
23:38
SPEAKER_03: So now, whereas before it was like, okay, while I'm typing, I'm also thinking about what the architecture is going to be.
23:43
SPEAKER_03: And I'm writing this method, and then I'm thinking like, oh, I should write the next method that should look like this.
23:47
SPEAKER_03: And the next message should look like this, right?
23:49
SPEAKER_03: We're sort of skipping that step with the coding agents, but that also means that if you don't have a clear-eyed view of what that outcome is, you're going to go back and be like, no, uh, sorry, no, let me re-specify three or four times in order to get what I wanted.
24:02
SPEAKER_00: Yeah, I don't know how many times I pseudocode pair just to see what like communication patterns evolve out of that.
24:09
SPEAKER_00: So that it can help inform me of the system thinking that I should be thinking about, also, right?
24:15
SPEAKER_00: Like, do you see any of that where you're like you had this map in your head and it was like, uh, maybe you shouldn't think about that map that way.
24:22
SPEAKER_00: Are you getting surprised by some of your own like use out of it?
24:27
SPEAKER_00: Or are you getting a good guardrail out of your own use?
24:32
SPEAKER_03: I would say I get pretty good guardrails, right?
24:34
SPEAKER_03: So, like, if I go in and I am wildly under-specifying, or I have it completely out to lunch, what I will get is a thing.
24:43
SPEAKER_03: One of the things I love, a newer feature of Claude Code, is now it'll ask you questions in plan mode.
24:49
SPEAKER_03: For Claude Code users out there, if you're not using plan mode, it's amazing.
24:53
SPEAKER_03: It can ask you questions.
24:54
SPEAKER_03: So you will specify, hey, I want to do this, that, and the other thing in plan mode.
24:57
SPEAKER_03: And it will say, like, okay, I have some questions.
24:59
SPEAKER_03: Did you want a big house or a little house?
25:02
SPEAKER_03: And that's like, I didn't specify the house size.
25:04
SPEAKER_03: Did you want a driveway or did you want it to be like an underground garage?
25:08
SPEAKER_03: Oh, let's do some Batcave shit.
25:10
SPEAKER_03: Great, let's go off and do that, right?
25:11
SPEAKER_03: And so I think that when it asked me those questions, I have been reflecting off the fact that, like, man, I really am under-specifying a lot of these sections, right?
25:20
SPEAKER_03: And so I think that those questions end up representing guardrails that I didn't get to, right?
25:25
SPEAKER_03: Because I've definitely done had sessions where I've been like, hey, let's go off and build this thing and I'll go and see that it completely cheated its way out of it.
25:32
SPEAKER_03: It's like, oh, well, yeah, like uh you wanted this to return true.
25:36
SPEAKER_03: I just made it return true.
25:37
SPEAKER_03: And I was like, okay, well, I radically underspecified that like the reason it's true is because you went and looked at the logs and you figured out the answer, right?
25:44
SPEAKER_03: And that's on me, that's not on it, right?
25:46
SPEAKER_01: It's interesting because that also may influence your behavior the next time you go and plan.
25:51
SPEAKER_01: Right.
25:51
SPEAKER_01: You're thinking about, oh, right, there were some edge cases I didn't think of the last time.
25:55
SPEAKER_01: So let me make sure I attend to them the first time now.
25:57
SPEAKER_01: Absolutely, absolutely.
25:59
SPEAKER_00: You've spent a ton of time low-level optimizing things, I imagine.
26:04
SPEAKER_00: Yeah.
26:04
SPEAKER_00: Do you find yourself maybe not doing that nearly as much because the LM's just gonna make stuff and you can run script later to optimize itself?
26:14
SPEAKER_00: Or do you find yourself still being like, I really need to go benchmark this thing and fix this performance?
26:21
SPEAKER_00: Do you even think about that anymore, or is it not really anything?
26:25
SPEAKER_03: No, I definitely think about it the intentional way.
26:27
SPEAKER_03: I used to think about it, but I don't dread it anymore.
26:29
SPEAKER_03: Like one of the things I used to do would be like, okay, we finished a thing, now we gotta go and figure out is this fast enough?
26:34
SPEAKER_03: What are the performance characteristics, what are the runtime characteristics of it?
26:38
SPEAKER_03: I used to be like, oh man, it took me a week to get this done.
26:41
SPEAKER_03: I don't really want to go back and do that right now because it's gonna be another week of like, and so sometimes I would just skip it.
26:48
SPEAKER_03: I gotta move on to the next thing.
26:50
SPEAKER_03: Like now, what I get is we talked about it briefly earlier.
26:54
SPEAKER_03: I'll reiterate again.
26:55
SPEAKER_03: Now what I have is like in Claude specifically, I have a bunch of custom agents that are specifically tuned for those activities.
27:02
SPEAKER_03: The one that I love is called production deployment readiness engineer.
27:08
SPEAKER_03: And it is literally says you are supposed to give your hard and fast opinion about whether or not the code that you're asked about is okay to deploy to production.
27:20
SPEAKER_03: And you should be very critical, but also like don't make the bar so high that no one can jump over it, or I can't remember exactly what it looks like.
27:28
SPEAKER_03: That's really smart.
27:29
SPEAKER_03: Yeah.
27:29
SPEAKER_03: Well, so what I will do is after I've done something where I'm like, I think there's probably something in here is I will just say, like, I'm gonna go use the bathroom and get a drink.
27:36
SPEAKER_03: Can you go tell me if this is ready to deploy to production?
27:39
SPEAKER_03: It produces a report in Claude afterwards.
27:41
SPEAKER_03: It basically says, Hey, this is kind of weird.
27:44
SPEAKER_03: Like, obviously, you stub this out.
27:46
SPEAKER_03: You probably don't want to have this in production.
27:48
SPEAKER_03: This section right here is like quadratic performance-wise.
27:52
SPEAKER_03: I do not deploy this, whatever you do, because it's gonna be insane, right?
27:55
SPEAKER_03: And so great, it's finding things.
27:57
SPEAKER_03: Then I feed that back into the workflow and I'm like, okay, great.
28:01
SPEAKER_03: Like, let's refactor that out, let's write some performance tests for it.
28:05
SPEAKER_03: And, you know, I kind of just use it in that way.
28:08
SPEAKER_03: And so that's work that I, you know, I'm uh what were Larry Walls, like hubris, laziness kind of things.
28:15
SPEAKER_03: Like, that's where it comes into it, right?
28:17
SPEAKER_03: Like I have the hubris to ask this tool, dude, can you see if you can figure this out?
28:21
SPEAKER_03: And then also, like, I wouldn't be doing this in the past, right?
28:24
SPEAKER_03: And there's a lot of these second things that I would just be like, I gotta move on with my day.
28:28
SPEAKER_03: I'm not gonna check this out.
28:29
SPEAKER_03: I'm just gonna deploy it and great, I'm done.
28:32
SPEAKER_01: Right.
28:32
SPEAKER_01: And then you wait and see like what exactly what performance actually gets hit or what it actually looks like and make the changes.
28:38
SPEAKER_01: Yeah.
28:38
SPEAKER_01: Agile deployment.
28:40
SPEAKER_01: Yeah.
28:40
SPEAKER_01: Right.
28:41
SPEAKER_01: Right.
28:41
SPEAKER_01: Iteratively improve it.
28:43
SPEAKER_01: Now I'm I'm interested in what you mentioned about the product side of using AI to summarize what's happening.
28:52
SPEAKER_01: I was wondering if you could give us the sort of low-level details of what LLMs are deployed, you know, how it's deployed and what what all goes into that so that it can make accurate decisions about what's interesting.
29:06
SPEAKER_03: It's not deployed yet.
29:06
SPEAKER_03: It's not fully built.
29:07
SPEAKER_03: It's really just spec out as a thing that we're planning on building.
29:10
SPEAKER_03: But we've gone through a number of experiments.
29:13
SPEAKER_03: Even just this experiment, like I said, with analyzing the transcript was really great in the same way, right?
29:18
SPEAKER_03: Like, hey, I've got this field, and what I really want to know is I think that what we have learned over little experiments in summarization in sort of like looking for signal and noise is asking for something extremely specific is hard, right?
29:35
SPEAKER_03: So, in other words, asking for like there's so many memes about like asking an LLM to count for you or asking it to like do math or count letters in strawberry, right?
29:48
SPEAKER_03: Like all those sorts of things.
29:50
SPEAKER_03: So I think that what we have learned is that you don't really want to ask questions that are of that variety.
29:57
SPEAKER_03: You want to ask questions that are of a sort of a higher order, like more of a summarized thing.
30:03
SPEAKER_03: So, in other words, you want to say last week you said that this field of numbers was okay.
30:10
SPEAKER_03: The field of numbers this week looks like this.
30:12
SPEAKER_03: Can you compare and contrast your feelings as it relates to those numbers and your previous stance?
30:20
SPEAKER_03: That is a thing that it's actually quite good at because what you're doing is you're asking for a difference summarization between these two things.
30:28
SPEAKER_03: And then you had a an opinion about this number.
30:31
SPEAKER_03: And so you're saying, like, okay, well, the difference between I had this opinion about this.
30:35
SPEAKER_03: Now I'm asked to forget an opinion about this, given the difference.
30:39
SPEAKER_03: Well, how do I think my opinion changes?
30:42
SPEAKER_03: That is like, again, a very human.
30:44
SPEAKER_03: The LLMs are trained on human sentiment, human language.
30:47
SPEAKER_03: And so they're better at giving answers in human sentiment and human language than they would be giving it in mathematical terms, right?
30:54
SPEAKER_03: But you can still feed it mathematical data.
30:57
SPEAKER_03: You just can't expect to get reasonable mathematical data on the output unless you're doing something specific with a math model.
31:03
SPEAKER_03: I don't mean like that.
31:04
SPEAKER_03: I just mean like the frontier models, right?
31:06
SPEAKER_03: And so that's why the way that I think about it is in terms of like human-centric, human-oriented data and interactions that you're gonna ask for.
31:15
SPEAKER_03: Like that's why I talk about this idea of like just a Slack bot that you ask it, like, how's things going?
31:20
SPEAKER_03: And it's like, yeah, things are fine.
31:22
SPEAKER_03: They look like they did last week.
31:23
SPEAKER_03: And you're like, okay, great, I'll move on with my day, right?
31:25
SPEAKER_03: Yeah, the no status update.
31:26
SPEAKER_03: Right.
31:27
SPEAKER_03: Exactly.
31:27
SPEAKER_01: When I saw the demo and the walkthrough online, I thought one of the things that I thought was killer was that Mirin detects your architecture.
31:39
SPEAKER_01: Like you don't have to do any setup, right?
31:40
SPEAKER_01: It says, Oh, okay, this is a Ruby on Rails app and it's being deployed with X or Y.
31:45
SPEAKER_01: I will say Capistrano.
31:46
SPEAKER_01: Sorry, I'm dating myself.
31:47
SPEAKER_01: But we'll say it's deployed.
31:49
SPEAKER_01: I'm here for I'm here for Capistrano.
31:50
SPEAKER_01: So yeah.
31:51
SPEAKER_01: Now I'm gonna, yeah, now I'm gonna try and test you know 2010's architecture out on.
31:56
SPEAKER_01: Please do.
31:56
SPEAKER_01: But I was curious when I first saw it, I was like, oh, okay, that's where they're using some AI to do some detection.
32:02
SPEAKER_01: But are you actually, is it just a tree where it's like, okay, I if I see X, then I know it's Y?
32:06
SPEAKER_01: Okay.
32:06
SPEAKER_01: That's right.
32:07
SPEAKER_01: That's right.
32:07
SPEAKER_01: All right, interesting.
32:08
SPEAKER_01: And then what about when it moves down to deployment files?
32:10
SPEAKER_01: Because you also don't have to write those, which I really like.
32:13
SPEAKER_03: Yeah.
32:13
SPEAKER_03: So it's still just doing it on a decision tree today.
32:16
SPEAKER_03: I think that one of the things that we wanted to be able, so one of the features of the product is that you can just run it offline.
32:22
SPEAKER_03: You can just run it wherever you need to run it and it won't do anything else.
32:25
SPEAKER_03: And so we always wanted to have that, like, hey, the deterministic system version of this, which is just like, hey, you've got these files.
32:32
SPEAKER_03: I'm just gonna assume that this is the situation.
32:34
SPEAKER_03: We are exploring the higher level things, which is like, hey, I've got this big app.
32:40
SPEAKER_03: Can you just derive information that you want from?
32:43
SPEAKER_03: We've done that experiment.
32:44
SPEAKER_03: We didn't put it in the product because we wanted to run offline for now.
32:47
SPEAKER_03: But in that experiment is like, I want you to go through and I want you to figure out like, what are the databases this thing uses in production?
32:54
SPEAKER_03: What kind of configuration does it need in order to configure those databases?
32:58
SPEAKER_03: Does this need S3?
32:59
SPEAKER_03: Like, what is the storage?
33:00
SPEAKER_03: Like asking systems questions.
33:02
SPEAKER_03: I don't think that we're ever going to ask systems questions from a decision pre perspective because the decision tree would be massive.
33:09
SPEAKER_03: Because, like, where am I looking?
33:10
SPEAKER_03: Right.
33:11
SPEAKER_03: And so our intention is actually to use the agents in that way eventually, which is to say, like, I want you to go analyze this code base and I want you to give me back a bunch of specific things that I'm pretty sure are true about it.
33:24
SPEAKER_03: And I want to present those to the customer or the user.
33:27
SPEAKER_03: I want to say, like, hey, I you analyze your code base, looks like you're using S3, looks like you're doing this is how S3 is configured, looks like you're using Postgres.
33:33
SPEAKER_03: This is how that's configured.
33:35
SPEAKER_03: Is that correct?
33:35
SPEAKER_03: And you're like, oh yeah, absolutely.
33:37
SPEAKER_03: That's exactly how it is.
33:38
SPEAKER_03: But now we can use that information to say, like, okay, great, you need Postgres.
33:42
SPEAKER_03: Let's just go spin up Postgres for you.
33:44
SPEAKER_03: You need S3, let's just go give you an S3 bucket endpoint within the cluster to do that kind of stuff.
33:49
SPEAKER_01: Yeah, yeah.
33:49
SPEAKER_01: Make it so that I don't ever have to persist in a Postgres password in a dot file again.
33:55
SPEAKER_01: And I would be very, very happy.
33:56
SPEAKER_03: We're gonna get there.
33:57
SPEAKER_03: That's really our aim.
33:58
SPEAKER_03: Our aim is to say, like, look, you're gonna spend a bunch of time developing an application.
34:04
SPEAKER_03: Eventually, hopefully, we can help you do that.
34:06
SPEAKER_03: But for now, you're using whatever workflow you're using.
34:08
SPEAKER_03: We want to meet people where they are.
34:10
SPEAKER_03: We wanna then apply our taste to what that means to take that thing into production, what that means to deploy it.
34:18
SPEAKER_03: And a lot of that is I don't want to have to configure it.
34:20
SPEAKER_03: I just want it to just sort of figure it out or at least go attempt to configure this thing and say, like, hey, is this true?
34:26
SPEAKER_03: Pretty sure this was true.
34:28
SPEAKER_03: Can you just confirm with me that that was true?
34:30
SPEAKER_00: So, yeah, this makes me think a lot about like ambient AI, where things are just watching and taking notes.
34:38
SPEAKER_00: And I could totally see, you know, circling back to the where do these agents fit?
34:43
SPEAKER_00: Yeah.
34:44
SPEAKER_00: Do you foresee maybe like an ambient mirroring agent just like sitting in and watching what you're doing and then suggesting and then auto-configuring stuff?
34:53
SPEAKER_00: Right.
34:53
SPEAKER_00: Like, where does it stop?
34:55
SPEAKER_00: Right.
34:55
SPEAKER_03: Like, I'm I'm actually really I'm glad that you brought it up.
34:58
SPEAKER_03: That was one of the things that when I was first going out looking for funding, that was actually one of the things that I was like, we're gonna build that eventually.
35:04
SPEAKER_03: I'm gonna I pitched almost what you said, which is what I really want the ability to do is have it's maligned at this point, but a coding version of Clippy, right?
35:14
SPEAKER_03: A thing that's basically like it's not soaking up CPU, it's not trying to exfiltrate your data, but what it's doing is it's just quietly saying, like, it looks like this person's working on this, it looks like they're configuring this over here, it looks like they're doing this, and that maybe when it says, like, I could help you do this better.
35:32
SPEAKER_03: Do you want me to go ahead and configure this for you?
35:34
SPEAKER_03: It can, based on activity, say, Hey, do you want me to go turn this on?
35:39
SPEAKER_03: Because I think it would, or I noticed that you've been running some stuff.
35:42
SPEAKER_03: I just ran some profiling for you.
35:44
SPEAKER_03: You don't need to worry about it.
35:45
SPEAKER_03: I ran the profiling, and here was the output from it, right?
35:48
SPEAKER_03: I think that like that's absolutely the place that we also want to get to because I think that again, it becomes this thing of like we have taste.
35:59
SPEAKER_03: Like one of the things that I talk about with Biran is how do we put out our view of how things should be done?
36:06
SPEAKER_03: And one of the ways is to say, like, hey, we have this thing that is sort of encodes our taste about how to write apps, our taste about how to configure your systems.
36:15
SPEAKER_03: And so you can always just ask it.
36:17
SPEAKER_03: You could say, like, how should I set this up?
36:18
SPEAKER_03: Oh, great, you should go, I can do that for you.
36:21
SPEAKER_03: Or, hey, I've been running in the background and I see that you've got all these files sprinkled around.
36:25
SPEAKER_03: Do you want me to write a config file manager for you instead?
36:28
SPEAKER_03: Oh, great, yeah, go go go do that, please.
36:30
SPEAKER_03: Right.
36:30
SPEAKER_03: So that you didn't know to ask about.
36:32
SPEAKER_00: That's why Reels was successful, really.
36:34
SPEAKER_00: Is it was like super opinionated, but also flexible.
36:38
SPEAKER_00: And so, like, because it was opinionated, it was very straightforward to like follow the paths that you needed to follow, like within building a web thing.
36:45
SPEAKER_01: I think that you're right about that, Valentino.
36:47
SPEAKER_01: And I also think that when you have something that's that opinionated and becomes very popular, you also get to find out what people actually care about and are gonna like dig in about and what they're like, okay, that's good.
37:00
SPEAKER_01: That's good enough.
37:01
SPEAKER_01: Right.
37:01
SPEAKER_01: And so then, and I see the similar thing happening here with Mirin, right?
37:04
SPEAKER_01: If your ambient agent goes and does 12 different things by default and it sets things up and it gives you notifications, you could start to find out, well, okay, great.
37:12
SPEAKER_01: You know, 90% of developers actually don't care that much about this, they just want it done properly and they don't care that much about the format.
37:19
SPEAKER_01: And here's the other 10%, which, you know, inevitably other libraries, potential plugins, stuff like that will address.
37:26
SPEAKER_03: Maybe backtrack slightly.
37:28
SPEAKER_03: What a crazy 18 months it's been in this field.
37:31
SPEAKER_03: Yeah, yeah, sure has.
37:32
SPEAKER_03: This wild.
37:34
SPEAKER_00: And I think Claw didn't exist a month or a year ago, right?
37:38
SPEAKER_03: That's exactly right.
37:39
SPEAKER_03: And so I feel like we are finding real interesting uses for this technology all the time.
37:48
SPEAKER_03: And one of the things that I am really excited about is software has been accelerating for a long time.
37:57
SPEAKER_03: It feels like there's so much we've put up with such crappy solutions for things for a long time because it's like, well, who wants to go invent another expense system or whatever it is?
38:09
SPEAKER_03: Just something that's not exciting, that's been sort of a legacy piece.
38:14
SPEAKER_03: Maybe I want to go finally do that for real.
38:17
SPEAKER_03: Like, and how do we enable people the ability to like stretch their wings and say, like, let's go try this?
38:23
SPEAKER_03: I love experimentation.
38:25
SPEAKER_03: I think that you learn so much about the edges of a problem by doing experimentation.
38:29
SPEAKER_03: And so I really want people to use these tools, to use Marin, to use all the different coding tools to really exercise those muscles to say, like, let's just go build this.
38:41
SPEAKER_03: Maybe it's a travel tool where it only shows you places where there's great raccoons.
38:46
SPEAKER_03: I don't know.
38:47
SPEAKER_03: Like, do it, man.
38:48
SPEAKER_03: Like, see what it's like.
38:49
SPEAKER_03: Maybe there's something there, right?
38:51
SPEAKER_03: I feel like I'm so excited by that.
38:54
SPEAKER_03: And that the tools have gotten from where they were 18 months ago to today.
38:58
SPEAKER_03: I don't think anyone would predict that.
39:00
SPEAKER_03: I don't know what the next 18 months is going to look like.
39:02
SPEAKER_03: Maybe it'll be just like this.
39:04
SPEAKER_03: Maybe we've sort of like we've eaten all of that initial plateau.
39:07
SPEAKER_03: Maybe we've got tons of plateau in front of us.
39:09
SPEAKER_01: Actually, I know.
39:09
SPEAKER_01: I already know.
39:10
SPEAKER_01: I know most people are just guessing, but I actually know what the 18 next 18 months are.
39:13
SPEAKER_01: Oh, super.
39:13
SPEAKER_01: And actually, this is let me get my notepad.
39:15
SPEAKER_01: Yeah, this is my prediction.
39:16
SPEAKER_01: And actually, it benefits Mirin tremendously.
39:19
SPEAKER_01: So I think you'll you'll like it.
39:20
SPEAKER_01: My own personal hobby horse is that we're still in this phase of, okay, this new technology can do amazing things.
39:27
SPEAKER_01: So let's do everything a lot faster and more efficiently.
39:30
SPEAKER_01: And I don't actually think that's the way paradigm shifts in our industry work.
39:34
SPEAKER_01: I think if you look back over the history, once we get, you know, an amazing new efficiency gain, what we actually start doing is building much more complex and structured systems that did not exist before.
39:44
SPEAKER_01: And so I think for that reason, and I always go back to this example, even though it's imperfect, is before and after cloud computing.
39:51
SPEAKER_01: Even though cloud is really just a bunch of machines sitting in a room somewhere, all of a sudden we started by just building the same web applications with the same architecture.
39:59
SPEAKER_01: And then, you know, over time we said, oh, actually, we can do much more complex things, right?
40:04
SPEAKER_01: Which necessitates something like Mirin.
40:06
SPEAKER_01: And I think that a further challenge for small software development teams, which is what Mirin targets, is that, well, hey, now table stakes is going to be you building something in this way, right?
40:18
SPEAKER_01: And you probably can afford a two or three person DevOps team to make that work, but you're gonna need it because no other application is going to work, you know, unless it's like a today's equivalent of like a restaurant web application, right?
40:31
SPEAKER_01: That's just telling you what's on the menu.
40:32
SPEAKER_01: Right.
40:32
SPEAKER_01: And so I really do think that over the next 18 months, you're gonna start to see that kind of the growth and complexity of systems.
40:42
SPEAKER_01: That's my guess.
40:43
SPEAKER_03: I'll piggyback off that and I'll throw a little mini bomb into the conversation, which is to say I feel like the rise of the monolith is also going to continue to occur.
40:53
SPEAKER_03: So, in other words, I feel like we shifted towards microservices because we wanted to sort of like lean into Conway's law.
41:00
SPEAKER_03: We wanted to be like, you're this team, you own this thing, you're this team, you own this thing.
41:04
SPEAKER_03: And the ability to integrate that software was a difficult, hard problem.
41:08
SPEAKER_03: That difficult, hard problem about doing that integration is kind of gone.
41:12
SPEAKER_03: It's not entirely gone, but it is 90% gone.
41:14
SPEAKER_03: And so I think people are gonna be like, hey, like, what's the point of that?
41:17
SPEAKER_03: Like, I can work in the monolith, I can tell my coding agent, hey, just make this work within the confines of this thing, find out the edges, stick it in another directory, go refactor it so all the code inside here to use my new interface.
41:29
SPEAKER_03: And it's like, sure, no problem, boss.
41:31
SPEAKER_03: And then it's like a thing that would normally take a week that your manager would never give you the ability to do happened while you were at lunch.
41:38
SPEAKER_03: And so now you're like, okay, I can just have a big monolith.
41:40
SPEAKER_03: I don't need to break this stuff up in microservices.
41:43
SPEAKER_03: And I think that we've, you know, the last two years or so has sort of seen a retrenchment of the monolith.
41:50
SPEAKER_03: I've seen that as well.
41:51
SPEAKER_03: And I think people just like them better.
41:53
SPEAKER_03: Well, I think they're easy in order to fit in someone's head.
41:56
SPEAKER_03: Yeah.
41:56
SPEAKER_03: It's yeah, they're just easier to fit in somebody's head.
41:58
SPEAKER_03: And I think that we're gonna continue to retrench that.
42:01
SPEAKER_00: I feel like you're right until you get to certain scale.
42:04
SPEAKER_00: And like maybe this will be solved with context window issues, right?
42:08
SPEAKER_00: But that ultimately is like a huge problem.
42:11
SPEAKER_00: Is like once you get to a certain scale of like everything in the same place, the coding agents start to lose track of what everything exists.
42:20
SPEAKER_00: And so once you have a certain size of an application or code base, you try and like get it to like how do you then orchestrate the agents, right?
42:29
SPEAKER_00: So they find the path and be able to cross-collaborate across those things in the monolith.
42:34
SPEAKER_00: Sometimes it's easier in like a separate service, and you could just say, here's the API for it, right?
42:40
SPEAKER_00: You don't need to worry about how it works.
42:42
SPEAKER_00: And that can definitely work better currently.
42:45
SPEAKER_00: Not to say it won't.
42:46
SPEAKER_00: Like, I feel like the monolith is still the right bet because, like, from what we've seen, things only get better.
42:52
SPEAKER_00: I want to circle back to like because you're both Joe, you have a great point of like your outlook.
42:57
SPEAKER_00: We've been talking about like real versus fake AI, but I feel like there's like this middle imaginary line, Evan to your point of experimentation, of like hypothetical AI.
43:08
SPEAKER_00: You know, like the AI is being like getting them to come up with ideas of what hypothetically would be.
43:14
SPEAKER_00: We have this exercise which we all enjoy of like, oh, what would it look like if it were this, right?
43:20
SPEAKER_00: And we run this experiment.
43:21
SPEAKER_00: What happens when the AIs start doing this?
43:24
SPEAKER_00: I experiment this all the time personally.
43:26
SPEAKER_00: I call it autogenetic, like from biology, where like, you know, self-assembling things, where it's just like reflecting on its own things, but also its environment, right?
43:35
SPEAKER_00: What happens when it starts to uh imagine things, right?
43:39
SPEAKER_00: If you give it certain personas, if you're like one of these sub agents of yours, right?
43:43
SPEAKER_00: And it's like honed up focused on like reviewing, make sure it's production ready.
43:48
SPEAKER_00: Well, what if it starts having an imagination of its own of like what production ready looks like, right?
43:53
SPEAKER_00: Like, how does that evolve as an agent?
43:56
SPEAKER_00: Do you mess around with any of this style of like hypothetical?
44:00
SPEAKER_03: With your coding habits for I have weird projects that I'm like, hey, like let's just go build this thing.
44:07
SPEAKER_03: I want to know what this looks like.
44:08
SPEAKER_03: Just give it a shot.
44:09
SPEAKER_03: I want to see how it works itself out.
44:12
SPEAKER_03: But I think that like I kind of want to hit on a slightly different point that you brought up, which is the software is for the most part only good if it's good for other people.
44:24
SPEAKER_03: In other words, like the human-centric version of what we create is going to become more and more and more and more important, right?
44:33
SPEAKER_03: I think that there is a whole bunch of backend systems, like this backend system talks to this back end system that talks to this backend system, but it's doing that not because it's like that would be fun to do.
44:43
SPEAKER_03: It's doing that because like the power needs to stay on in someone's house because it needs to keep them warm or they want to watch TV, right?
44:50
SPEAKER_03: So there's a human in all of those loops for the most part, right?
44:53
SPEAKER_03: And I think that we're going to get to situations even more that are like, okay, well, like what does the person want?
45:00
SPEAKER_03: And I think that that is such a great place for us to get to because again, that gets us to taste, that gets us to aesthetics.
45:07
SPEAKER_03: And we're sort of rapidly approaching, like, okay, well, what is the art of building a thing that people like that is good for people, right?
45:14
SPEAKER_03: As opposed to just like, what's possible?
45:16
SPEAKER_03: In other words, like we could all differentiate between the aesthetics of like that old XKCD that's like a web page with a million options, right?
45:26
SPEAKER_03: Versus a thing that's just like a wizard that will walk you through.
45:28
SPEAKER_03: Like the second is obviously human-centric because it's like, I need the context, I need to know what I'm doing, right?
45:34
SPEAKER_03: We're gonna see just more and more conversations about that.
45:38
SPEAKER_03: Because the inverse is that, like, again, if it's software for another machine, the API doesn't matter.
45:46
SPEAKER_03: How you describe it doesn't matter.
45:48
SPEAKER_03: The fact that there are even words involved doesn't matter.
45:51
SPEAKER_03: It becomes a pure mathematical construct.
45:54
SPEAKER_03: And yeah, maybe there's a place for that, but I think that the bulk of what people work on is going to be like, okay, well, what is the interface boundary between this code and the person?
46:04
SPEAKER_03: And how can I inject my own taste about how that should work into that conversation?
46:10
SPEAKER_00: Yeah, and to extend that too, how does that change over time?
46:12
SPEAKER_00: Right.
46:13
SPEAKER_00: You mean the human preferences?
46:15
SPEAKER_00: Yeah, human preferences, but also like usage.
46:18
SPEAKER_00: Say, like, you know, clock codes out, like that changes how people use the internet, how people change all kinds of different things in their life, right?
46:25
SPEAKER_00: Like which are human-centric.
46:26
SPEAKER_00: How do other things evolve when there's change?
46:29
SPEAKER_00: That's true.
46:29
SPEAKER_01: But we do change slower.
46:31
SPEAKER_01: Maybe there'll be a faster rate of change, right?
46:32
SPEAKER_01: As we get more and more used to all of these different tools and all this different advancement.
46:37
SPEAKER_03: But I think that that's where the experimentation is really interesting, right?
46:40
SPEAKER_03: Like, I think that the easy example here is we didn't know how great the smartphone was as a tool, human tool, until we had the smartphone.
46:49
SPEAKER_03: We had to attempt that experimentation, but to go down that road and to say, like, oh, this is actually like the human hand is this big, right?
46:57
SPEAKER_03: And so the device needs to be this big exactly.
47:00
SPEAKER_03: Like it has very specific human-centric things, right?
47:03
SPEAKER_03: And so I think that that's where the experimentation is really interesting for people to try out, right?
47:08
SPEAKER_03: And I think that the push in AI right now from the people who have Boku dollars is like, how do I put a hardware AI thing on your body, in your face, on your whatever?
47:20
SPEAKER_03: And I think that, sure, run those experiments, go to town, burn as much money as you want down.
47:25
SPEAKER_03: I have nothing to say about that.
47:27
SPEAKER_03: But I think that the You mean you don't own VR goggles?
47:30
SPEAKER_03: My kids have a quest too.
47:31
SPEAKER_03: How about that?
47:32
SPEAKER_03: I bought them for that during the pandemic.
47:33
SPEAKER_03: That was a really good pandemic purchase, by the way.
47:35
SPEAKER_01: That sounds great.
47:36
SPEAKER_01: It sounds like a lot of fun for the kids.
47:37
SPEAKER_01: Yeah.
47:38
SPEAKER_03: Yeah.
47:38
SPEAKER_03: But I think that like I love the fact that the coding tools are making solving problems more accessible.
47:46
SPEAKER_03: I have a friend of mine who works in the, I live in LA and he works in the film industry.
47:51
SPEAKER_03: And he vibe coded an entire app on his own because he's like, I just want to understand this.
47:57
SPEAKER_03: I have feelings about it.
47:58
SPEAKER_03: I want to just vibe code this whole thing.
48:00
SPEAKER_03: He showed me like a couple months in.
48:02
SPEAKER_03: He's like, is this a real thing?
48:04
SPEAKER_03: And I was like, man, it looks like a real thing to me.
48:06
SPEAKER_03: His first few iterations were literally like uploading code to Chat GPT, telling it, and then telling him what to change, him copying the files and putting them locally.
48:14
SPEAKER_03: I was like, man, I got to show you some of these tools that you can just run locally, right?
48:18
SPEAKER_03: It'll be a big unlock for you.
48:20
SPEAKER_03: But he wouldn't be here.
48:21
SPEAKER_03: He wouldn't be doing that experimentation.
48:23
SPEAKER_03: He wouldn't be saying, like, what is the interface between this?
48:25
SPEAKER_03: What makes sense?
48:26
SPEAKER_03: How can I change this?
48:27
SPEAKER_03: Right.
48:28
SPEAKER_03: I think that outcomes are based off of human time.
48:33
SPEAKER_03: How long your manager is going to let you work on polishing up this interface is a direct influence of what your time is worth in terms of money, because we live in capitalism.
48:43
SPEAKER_03: And so I think that by cutting down the amount of time it takes, we can run more of those experiments.
48:50
SPEAKER_03: Now there's going to be companies out there that are like, okay, great, you can do stuff 10 times faster.
48:53
SPEAKER_03: I'm going to give you 10 times as much work.
48:55
SPEAKER_03: I actually hope that doesn't happen as much.
48:57
SPEAKER_03: I hope that it's like, okay, great.
48:59
SPEAKER_03: I have more time to iterate.
49:00
SPEAKER_03: I have more time to come up with novel, unique, interesting solutions to this problem that normally I would have to do the most obvious one because that's all I've got time for.
49:10
SPEAKER_01: Yeah, that's interesting.
49:10
SPEAKER_01: I'd like to see that too.
49:11
SPEAKER_01: And I've got a little bit more of a dim view of it.
49:13
SPEAKER_01: I guess I should say I have a dim view of it across the entire landscape, but I also think that the companies that do take the time to say, let's experiment and let's build something new, let's be a little bit more ambitious with the time that we have are going to go really far.
49:28
SPEAKER_01: So that's what I think.
49:30
SPEAKER_01: I am forever the optimist.
49:32
SPEAKER_03: So good.
49:33
SPEAKER_01: We should spend more time.
49:34
SPEAKER_01: We should spend more time together.
49:35
SPEAKER_01: The first thing I thought when you told me about your friend was, well, as soon as he gets a couple of users, tell him to call Deaf Method because that application is going to be a wreck and we could help.
49:43
SPEAKER_01: Yeah.
49:44
SPEAKER_00: You know, there's a lot of truth there.
49:46
SPEAKER_00: Sure.
49:47
SPEAKER_00: Absolutely.
49:48
SPEAKER_00: I was at the AI e code summit in New York City recently.
49:52
SPEAKER_00: I saw Google up on C.
49:53
SPEAKER_00: You were at the summit?
49:54
SPEAKER_00: I was there.
49:54
SPEAKER_00: We should have hung out.
49:55
SPEAKER_00: Oh, you were there.
49:55
SPEAKER_00: I don't know how you have to.
49:56
SPEAKER_00: All right.
49:57
SPEAKER_00: We've just been done next time.
49:58
SPEAKER_00: We got podcasts from there.
50:01
SPEAKER_00: They had a booth setup.
50:02
SPEAKER_00: We probably could use.
50:03
SPEAKER_00: Yeah.
50:04
SPEAKER_00: You know, Google's up there and they're showing their AI studio.
50:07
SPEAKER_00: And so I mess around.
50:08
SPEAKER_00: I'm like, can I make something out of it?
50:10
SPEAKER_00: And then there's like a little deploy button.
50:12
SPEAKER_00: I'm like, okay, yeah, I'll just deploy this thing.
50:15
SPEAKER_00: Deploys it to some like subdomain on Google and it like kind of works.
50:19
SPEAKER_00: But like so many things were missing because you can't just push a button to deploy something.
50:25
SPEAKER_00: And like as soon as you want to change any aspect of that deployment, like I wanted to cache stuff in a database.
50:30
SPEAKER_00: It's like, well, you gotta hook up a database.
50:32
SPEAKER_00: Right.
50:33
SPEAKER_00: Yeah, I started asking for too many things.
50:36
SPEAKER_00: Yes.
50:36
SPEAKER_00: And I'm just like, maybe it's not there, but like it could be.
50:40
SPEAKER_00: But you know, at the same time, like, do we even want it to be there at that level?
50:44
SPEAKER_00: Because like I just foresee, like, people that just don't know what they're doing, they're like, how do they even know they need a database?
50:50
SPEAKER_00: Right?
50:51
SPEAKER_00: Like, they don't know that.
50:52
SPEAKER_00: How does that consideration even come up?
50:55
SPEAKER_01: I love the idea, Evan.
50:56
SPEAKER_01: I want to let you respond, but I just love the idea of those people at that Google booth that just were getting rubes all day long saying, This is amazing, just did not see Valentino coming.
51:05
SPEAKER_01: Like, oh God, this one's gonna be hard.
51:08
SPEAKER_03: I think that like it's a real frustration with these tools that are built on a pedestal or where the cliff is like a thousand feet tall, right?
51:19
SPEAKER_03: Where you're like, oh, I deployed a thing, and you're like, oh, this is great.
51:22
SPEAKER_03: I absolutely love this.
51:24
SPEAKER_03: This is what I want.
51:25
SPEAKER_03: And then they're like, okay, how do I do the next thing?
51:27
SPEAKER_03: And they're like, sorry.
51:29
SPEAKER_03: You're like, sorry, what what do you mean sorry?
51:31
SPEAKER_03: It's like that's not for me.
51:33
SPEAKER_03: Yeah.
51:33
SPEAKER_03: It's like, okay, so why did I even spend my time here?
51:37
SPEAKER_03: I think that that is good marketing and user hostile, in my opinion.
51:42
SPEAKER_03: Because I think what you're doing is if that tool is not actually available for that person to grow and evolve with, then you're sort of cheating them.
51:51
SPEAKER_03: You're sort of trying to like, oh, this is really only good for single page apps that only run HTML and JavaScript and are completely stateless.
51:59
SPEAKER_03: It's like, okay, like, but what do I do if that's not the case?
52:02
SPEAKER_03: And they're like, I don't know, you can find another system.
52:04
SPEAKER_03: Yeah, yeah.
52:05
SPEAKER_03: Call someone else.
52:05
SPEAKER_03: What are we doing?
52:06
SPEAKER_03: Yeah.
52:07
SPEAKER_00: So yeah.
52:08
SPEAKER_00: We've talked about a lot of great stuff here.
52:11
SPEAKER_00: Circling back to the Ruby aspect of this show.
52:14
SPEAKER_00: Where do you see Ruby's strengths being in this landscape?
52:18
SPEAKER_00: And like, where do you see it missing where the industry is heading, right?
52:23
SPEAKER_03: Ruby is a really ideal platform and language and stack for doing a lot of like writing a lot of agent work because it's always been really flexible and like, oh, well, like I want to take this data in and I want to massage it in this one way, and I want to talk to these network services to do this, that, and the other thing.
52:40
SPEAKER_03: And there's a lot of that going on right now where you're offloading to an agent to do something or do whatever.
52:46
SPEAKER_03: There's a whole ton of automation that's just that sort of thing where you're going to be doing so much daily iteration on just like what that automation looks like.
52:57
SPEAKER_03: That Ruby is super great for, right?
52:59
SPEAKER_03: Because you're not writing very much.
53:01
SPEAKER_03: You're just like, oh, go do this.
53:02
SPEAKER_03: And when this comes back, go do this, that, and the other thing.
53:05
SPEAKER_03: And great.
53:05
SPEAKER_03: I've expressed that in exactly as many lines as I had sentences there.
53:09
SPEAKER_03: And I can move on with my day, right?
53:11
SPEAKER_03: A lot of the things that people fault Ruby for are just disappearing, right?
53:17
SPEAKER_03: So it's like, oh, well, it doesn't have types.
53:18
SPEAKER_03: It's like, well, for the most part, the coding agents are actually really good at this.
53:22
SPEAKER_03: And if you really want types, there's a billion type tools that the coding agent would be happy to fill in 90% of the types for if that's what you really want, right?
53:29
SPEAKER_03: So I think that is sort of going away.
53:31
SPEAKER_03: I think that like we've seen these huge advances in just what a single core computer can do.
53:36
SPEAKER_03: So like the performance disadvantages that Ruby has as a comparison to Go or whatever are rapidly declining in terms of what the actual application is supposed to do.
53:47
SPEAKER_03: Right.
53:47
SPEAKER_03: So if it's supposed to like, oh, I'm gonna go off and I'm gonna talk to this, that, the other thing, great, like the performance is not a problem anymore.
53:54
SPEAKER_03: Like I think that those things are starting to sort of bleed away, right?
53:57
SPEAKER_03: So I think that in many ways, it feels like the reality of writing Ruby apps is that those disadvantages are slowly melting away.
54:07
SPEAKER_03: And all of the advantages that have always been core to the idea of dynamic typing and the organization and the framework and all the code and the libraries and gems that are available for Ruby are starting to outweigh any of those disadvantages because all the advances in other technology are just sort of eating away at those disadvantages, but they're not eating away at the advantages.
54:27
SPEAKER_03: You could probably make the argument that, like, oh, well, you don't really need to write small chunks of code anymore because the coding agent can.
54:35
SPEAKER_03: And so I can just write this thing that I would normally write in Ruby in C, and now it's 10 times faster.
54:39
SPEAKER_03: It's like, yeah, but then we get into, as you were talking about Valentino, we get into context, we get into understanding, we get into all these things.
54:46
SPEAKER_03: It's like we're still in token count world.
54:49
SPEAKER_03: The fact that Ruby generates fewer tokens to in and fewer tokens out is a distinct advantage, also in terms of like how it can reason and what it can hold and how it can know what the system does.
55:00
SPEAKER_03: And so I see the technological advantages eating away more at the disadvantages that people would bring up for Ruby and less so at the advantages.
55:10
SPEAKER_01: I like that a lot.
55:11
SPEAKER_01: I was one who was swayed, it was probably a year ago, by the hey, Ruby doesn't have types, and isn't that going to be a disadvantage as we go forward?
55:18
SPEAKER_01: And I'm glad to see that that's not the case.
55:20
SPEAKER_02: Yeah.
55:20
SPEAKER_01: Because I don't really want to use Sorbet.
55:22
SPEAKER_01: I guess that's what it comes down to.
55:25
SPEAKER_00: Custo makes use of Sorbet and very effectively, especially with GraphQL coupling.
55:30
SPEAKER_00: It's like it works in a lot of ways.
55:33
SPEAKER_03: I think what's funny is that the coding agents don't care about types.
55:38
SPEAKER_03: I guarantee you they do not have a type inference engine built into the LLM at its core layer.
55:44
SPEAKER_03: Like it is reasoning about the types in exactly the same way that a human would reason about the types.
55:49
SPEAKER_03: And in that way, it can reason about having the code not having types in exactly the same way that someone else could do that, right?
55:57
SPEAKER_03: And I think the advantage in terms of Ruby is that it's got a really great testing culture, it's got a really great way of managing that.
56:04
SPEAKER_03: And that's where you're like, hey, you're gonna go write this thing.
56:07
SPEAKER_03: Okay, I need you to go make sure that like we have 100% test coverage.
56:10
SPEAKER_03: It's like, yeah, no problem, boss.
56:12
SPEAKER_03: I got it.
56:13
SPEAKER_03: And so that was always the structural advantage that the Ruby community had was that it had built itself up off agile, it built itself up off, hey, let's have tests.
56:23
SPEAKER_03: Now, those tests, those are the bumpers, those are the guardrails for those AI agents.
56:28
SPEAKER_03: And great, you come into adding a thing to a gem, and that gem's got huge test coverage, you're feeling good about going through and adding that stuff because you know that that test coverage is there, but also the agent can like help you enhance that test coverage.
56:43
SPEAKER_00: Yeah, I agree with that.
56:45
SPEAKER_00: The biggest advantage I've seen from like Ruby from an AI perspective has been the training data available to it based just solely on the people that have been in.
56:56
SPEAKER_00: Rubyists, like they're a unique bunch, right?
56:59
SPEAKER_00: You go through any like any online forum and you're just like, oh, they're Rubyists that are like strange and crazy.
57:05
SPEAKER_00: Um I feel like that's historically accurate.
57:10
SPEAKER_00: And I feel like that does influence, and you do get a different result than you might get out of another language, which is kind of funny.
57:18
SPEAKER_03: You bring up such a great point because the training data has a huge impact on their abilities.
57:24
SPEAKER_03: I know that you had Chad Fowler on the podcast previously.
57:27
SPEAKER_03: Chad, he's mentioned a friend that was building a language that looked exactly like React from three years ago, explicitly because React from three years ago is what most of the Frontier AIs were trained on.
57:40
SPEAKER_03: And so they're so good at it, right?
57:42
SPEAKER_03: And in that way, the fact that Ruby's tastes they move a lot slower than, say, JavaScript's tastes in what packages to use and all that kind of stuff.
57:53
SPEAKER_03: That is a structural advantage to using the coding agents, right?
57:56
SPEAKER_03: If you go out to use, like if you go say, hey, build me a JavaScript app that does this, that, and the other thing, it probably is gonna use a bunch of dependencies from two or three years ago.
58:05
SPEAKER_03: And the JavaScript devs would be like, why did you use the no one's using that today?
58:09
SPEAKER_03: Everyone's on this other thing.
58:10
SPEAKER_03: That's a good impression because they are gonna yell at you.
58:12
SPEAKER_03: Okay, yeah, they are gonna yell at you, and they're gonna say, like, no one uses React, that's React with a Q.
58:18
SPEAKER_03: I'm just making up a random library here.
58:20
SPEAKER_03: Everyone is using React, the one with a K now, and it's not gonna know that because that community moves so fast, and that is a structural disadvantage to using the coding agents.
58:29
SPEAKER_03: Whereas you want to go reach for, I'll beat my own drum here.
58:33
SPEAKER_03: You want to go reach for a web server.
58:35
SPEAKER_03: The web server market, the web server gems in Ruby have changed very little over the course of the last 10 years.
58:40
SPEAKER_03: You want to go reach for an HTTP client.
58:42
SPEAKER_03: Again, it's changed very little over the so it's gonna make a choice that you're gonna be like, totally.
58:47
SPEAKER_03: That is the simplest choice that everybody would make.
58:50
SPEAKER_00: So that's really funny.
58:52
SPEAKER_00: You know, I also see a unique advantage in Ruby switching from SVN to Git so late.
58:58
SPEAKER_00: Yeah.
58:58
SPEAKER_00: In that the training data is missing for a lot of the old stuff, yeah.
59:04
SPEAKER_00: You know, yeah, yeah, yeah.
59:07
SPEAKER_03: It'll be interesting to see how that works itself out over the course of the next many moons, right?
59:12
SPEAKER_03: Because I think that like I don't know that it's necessarily going to go away because I think there's always gonna be a lag on the training data and what those things are capable of doing.
59:21
SPEAKER_03: The tool use has an impact here, but I definitely think that you could make the argument that the AI coding as tools are better modern Ruby S than they are better modern JavaScript programmers, because modern means something different in those different communities.
59:40
SPEAKER_00: Are there any departing words you want to share?
59:43
SPEAKER_00: I'm gonna personally check out Mirin because uh definitely deployment for small teams is a good mantra to have for a deployment company.
59:50
SPEAKER_00: And you know, some things I miss about Roku in that way, now that they've clopped on so many different features.
59:56
SPEAKER_03: Yeah, I mean, like our mentality is also based off of us being small teams.
1:00:01
SPEAKER_03: We want to be a small team that's building things for other small teams.
1:00:04
SPEAKER_03: And equally, I feel like if I had to give an 18-month prediction, mine would be that like by small teams, I mean like fewer than 15 people are going to be punching way above their weight over the course of this 18 months than they were maybe in 2019.
1:00:20
SPEAKER_03: And that means them moving faster, that means them doing more experiments, and that's really where we want to be supporting those sorts of people.
1:00:28
SPEAKER_01: So yeah, strong prediction.
1:00:30
SPEAKER_01: I like it.
1:00:31
SPEAKER_01: I don't want to let us go without wishing everybody a happy holiday season.
1:00:35
SPEAKER_01: And I just would like to, maybe on Valentino's behalf, or maybe he doesn't feel this way, I'd like to thank everybody who's been listening to the show and anybody who's sent a message or come up to me at a meetup or to Valentino at a meetup.
1:00:48
SPEAKER_01: It means the world to me.
1:00:49
SPEAKER_01: I've had so much fun doing this, and I never expected to have this much fun.
1:00:53
SPEAKER_01: So thanks to everybody listening, and thank you, Valentino, because it's really been great.
1:00:56
SPEAKER_01: I almost did a podcast on my own, which would have been so boring for everybody.
1:01:02
SPEAKER_01: Instead, I got you, and it's been wonderful.
1:01:05
SPEAKER_00: Yeah, absolutely.
1:01:07
SPEAKER_00: Surprise, Evan, your last recording of the year.
1:01:11
SPEAKER_03: That makes sense.
1:01:12
SPEAKER_03: I'm glad to hear that you guys are exercising good work-life balance in the last one of the year.
1:01:16
SPEAKER_03: So yeah.
1:01:17
SPEAKER_00: I'm out the rest of the year.
1:01:18
SPEAKER_00: Yeah, I don't know about Joe, but yeah.
1:01:21
SPEAKER_00: This has been like pretty wild.
1:01:22
SPEAKER_00: You know, Joe and I met at a small meetup in New York City, thanks to Scott Werner, and yeah, just snowballed into this.
1:01:29
SPEAKER_00: And we haven't quite got the full year of recordings in, but like pretty close.
1:01:33
SPEAKER_00: And uh, we finally got a regular schedule.
1:01:35
SPEAKER_00: And Evan, I've been a huge fan of yours since was that 2015 Ruby Kyagi.
1:01:40
SPEAKER_00: I'll never forget the JIT, you know, how does a JIT work?
1:01:43
SPEAKER_00: Yeah.
1:01:45
SPEAKER_00: That was that was a fun one.
1:01:46
SPEAKER_00: That was a fun one.
1:01:47
SPEAKER_01: Yeah, getting to talk to some of our heroes is the is one of the biggest, uh the biggest benefit of doing this show.
1:01:54
SPEAKER_00: Thank you to all our listeners.
1:01:56
SPEAKER_00: You know, we appreciate you.
1:01:57
SPEAKER_00: I definitely share your sentiment, Joe.
1:01:58
SPEAKER_00: Yeah.