Latest / Cables2Clouds / What is Spec-Driven Development?
Transcript
- 0:13Tim: Hello and welcome back to another episode of the Cables to Clouds podcast.
- 0:17Tim: And uh with me as always is my co-host, Chris Miles.
- 0:21Tim: I am Tim McConaughey, and we have a guest with us uh from Learning at Cisco, uh Jason Belk.
- 0:28Tim: Jason, go ahead and introduce yourself.
- 0:30Tim: I don't think you've been on the podcast before.
- 0:31Jason Belk: Hi.
- 0:32Jason Belk: Thanks, Tim.
- 0:32Jason Belk: Thanks, thanks, Chris.
- 0:33Jason Belk: Yeah, I am Jason Belk.
- 0:35Jason Belk: I am a senior technical advocate with Learned with Cisco.
- 0:38Jason Belk: Um, the people who do the training and certification, CCNA up to CCIE and everything in between.
- 0:43Jason Belk: And uh a little bit about myself.
- 0:44Jason Belk: I live in Reno, Nevada, married 12 years, have two young daughters, a black lab, and uh my background is in I've been at Cisco since 2010, off and on.
- 0:54Jason Belk: And I I started out at Cisco IT as an analyst, network engineer, network automation, started teaching networking automation before DevNet to my our networking team, learning it myself, and then I left and went to network to code for a few years.
- 1:07Jason Belk: Um, came back to Cisco as a in developer relations in the Cisco NSO BU, which is like basically a big automation product, and then now more recently in learning with Cisco.
- 1:15Jason Belk: So kind of done around the circuit inside and outside of Cisco and have some operational chops to show for it.
- 1:21Jason Belk: So I kind of know the struggles of all the operators out there, uh at least for the on-premise stuff and the enterprise.
- 1:26Jason Belk: I was on the campus and branch team when I was on call.
- 1:28Jason Belk: Um, so yeah, and and I'm really thrilled to be here.
- 1:30Jason Belk: I mean, we've had conversations with with you guys off and on for a while now, and big fan of the show and love what you guys do both for the news perspective as well as covering, you know, all the different stuff for network engineers who are trying to grapple with AI and cloud and everything else.
- 1:43Jason Belk: Thanks, man.
- 1:45Tim: Um, so yeah, yeah, what's that?
- 1:47Tim: Oh, I just said I appreciate that.
- 1:50Tim: Oh, appreciate that.
- 1:51Tim: Yes, we are appreciative.
- 1:52Tim: Uh it's always nice to meet someone who actually listens to the show.
- 1:55Tim: I'm just kidding.
- 1:56Tim: Um anyway, so we brought actually we brought Jason on uh because he is working on something that's actually pretty cool.
- 2:05Tim: Uh we've been we've been talking it back and forth for a long time, actually.
- 2:08Tim: We've been having trying to get uh Jason on the show, so we finally made it work.
- 2:11Tim: Um and Jason is here to talk about something that I didn't know existed, and I guess that probably a lot of the listeners were not aware existed.
- 2:18Tim: Uh something called spec driven development.
- 2:21Tim: And uh I believe it has something to do with with building for AI, but actually, Jason, I'll you're the expert.
- 2:26Tim: I'll let you I'll let you take it from here.
- 2:28Tim: What is spec driven development?
- 2:29Jason Belk: Sure.
- 2:29Jason Belk: I mean, I've been using it for about six weeks.
- 2:31Jason Belk: Uh and AI speak that makes me an expert.
- 2:34Jason Belk: Um that's right.
- 2:35Jason Belk: Uh to be fair, no, like one I actually asked Claude Coder or today how much I'd been using it just on one project, and it said 150 hours in the past three weeks.
- 2:46Jason Belk: Um project, one one personal project.
- 2:51Jason Belk: Um and I've and I I have like five or six personal projects going on top of some work stuff.
- 2:56Jason Belk: And and so all that to say is what is spectrum development?
- 2:58Jason Belk: I mean, if you think if you've been in IT or any amount of time, you're familiar with project managers.
- 3:04Jason Belk: They're those friendly people who help keep you on track and get all your T's crossed and your I's dotted.
- 3:10Jason Belk: And if you if you've tried to build anything of significance, you know it helps to have a plan.
- 3:14Jason Belk: And so when you're talking about an AI, you you I think we've all heard of the example of AI being, you know, like an expert idiot or something.
- 3:23Jason Belk: Like they have tons of knowledge, tons of ability to execute, but what I would say is very poor wisdom and judgment.
- 3:28Jason Belk: And so how do how do you help somebody who is able to do whatever you say and sometimes interprets it a little too in a direction you weren't expecting?
- 3:38Jason Belk: Is that that you give them a plan.
- 3:40Jason Belk: And there's definitely this isn't the only way of approaching that problem.
- 3:43Jason Belk: And this isn't for um, you know, I'm on chat GBT, Jim and I, Claude, you know, I'm just doing my chat bot and I'm talking back and forth.
- 3:50Jason Belk: I'm not talking about that scenario.
- 3:51Jason Belk: The the way that I'm I'm talking about specifically is is for a quote unquote agentic coding, um, where where you are giving prompts, instructions to your computer through a text interface, in my case, usually a terminal, and you're you're typing in just as you would on ChatGBT or Claude or Gemini, and instead of getting a response back that says, hey, I can't do that, sorry, it actually goes off and tries to do it using your computer resources.
- 4:17Jason Belk: Um so you have to have permissions and trust in the place where it's running for it to execute that code.
- 4:24Jason Belk: And by default, something like Claude Code, which is one I'll be referencing in the rest of this conversation just for sake of simplicity, um, will ask you permissions when it wants to create files, when it wants to do web searches, when it wants to edit edit or delete files, do bash commands, stuff like that.
- 4:37Jason Belk: But all that to say is that it can do all those things for you.
- 4:40Jason Belk: And not just from a coding perspective.
- 4:42Jason Belk: Um, there's another podcast I really enjoy called Software Defined Talk.
- 4:45Jason Belk: And they had a whole episode about cloud code I'd recommend people check out.
- 4:48Jason Belk: If you haven't heard about it before, played around with it before, it gives you a good primer of what I would say somebody who's not a coder or an active coder using cloud code just for productivity stuff, like sorting your screenshots in your screenshots folder and naming them, um, or uh, you know, putting together your notes and things like that.
- 5:05Jason Belk: Because it can basically once you give it access to those files, and that's of course a trust issue, it will then be able to do instructions based on renaming, reading, and all that kind of stuff.
- 5:13Jason Belk: So going back to spec driven development is that okay, you you give this a local AI agent the capability to do things on your behalf.
- 5:21Jason Belk: And if you start asking to do things, as I think we've people who have worked with AI for a while will experience there's a context window issue.
- 5:29Jason Belk: And I'd say there's also like a scope issue.
- 5:32Jason Belk: And like I meant to do this, but actually you started doing this other thing, and then that's not too bad, but actually you were kind of deviating from what I originally talked about, or you built a production grade system, and I was just trying to figure out if it worked.
- 5:42Jason Belk: Um, and or most common one I still even run into, even with spec driven development sometimes, is that you're trying to pip install this on my system Python, and I want to use UV.
- 5:50Jason Belk: Um, so spec driven development, not to say it solves every possible problem, but I've gone from like having to intervene and course correct my quad code multiple times per session to like maybe once a week.
- 6:04Jason Belk: And I can just let it run for anywhere between 30 seconds and a minute.
- 6:08Jason Belk: I've had it sometimes running up to several hours.
- 6:12Chris: So it's funny you mentioned that episode of Software Defined Talk.
- 6:16Chris: I just listened to that last week and it was uh it's it's it's funny because like they that was like my motivator was like, man, I I really need to dig in with clawed code because they even call it out in the episode, but like the fact that it's called clawed code kind of limits what you think in your brain that you can do with it because you can do very vast things with it.
- 6:35Chris: But um, yeah, I like I like what you said about the the idea of you know spec driven development kind of being that specification that you define up front to kind of keep your AI in line.
- 6:46Chris: But I'm I'm curious, like uh I feel like I've I've heard of spec-driven development uh uh you know several times, obviously very recently as well.
- 6:54Chris: Um, was this the thing that just came along with AI almost as a not guardrails, but kind of like guiding light for AI um coding?
- 7:03Chris: Or was this there before?
- 7:05Jason Belk: I'd say that the principles, um, and and I'm I'm we'll share some links in the show notes that people can take a look at.
- 7:10Jason Belk: Um the principles I think go back to project management principles in terms of defining requirements and and and executing executing upon them, uh, you know, clarifying assumptions uh in a more formal way.
- 7:21Jason Belk: Uh, but I'd say, at least from my knowledge of it, I've been following it since August of 2025.
- 7:27Jason Belk: I think that's around the time it came out.
- 7:30Jason Belk: Um, because I I follow a lot of different YouTube channels.
- 7:33Jason Belk: One of them is like the GitHub, you know, AI folk, and and they had some Microsoft Developer Day back then where they were walking through it.
- 7:40Jason Belk: Um and so the the the one that I use is the GitHub, what they call spec kit, and it's on GitHub for free.
- 7:47Jason Belk: I'm I'm also sharing, um, I'll share a link to my personal spec-driven development kind of fork of it, um, with the caveat that the cut the code I have in there that is the spec driven development part is uh is not like updating with the remote fork.
- 8:02Jason Belk: I haven't got that complicated on it yet.
- 8:04Jason Belk: So if you want to have the latest GitHub spec kit part, you might have to swap that part out and then use the rest of my bits I have in there.
- 8:09Jason Belk: All that to say is um it's it's still relatively recent, as of August.
- 8:13Jason Belk: And then I I tried to get it set up myself a couple times, but I'd say the documentation out there for me as an intermediate level programmer, novice level AI person who is figuring stuff out as long as I for the past since 2023 or whatever, since GPT 3.5.
- 8:29Jason Belk: Um I I I had a couple of stops and starts until this guy named Jason Gekki, who who's um I I'm connected with who's people at work pointed me to some um documentation that he does.
- 8:39Jason Belk: He basically he created a presentation that is happy to share with whoever it would help.
- 8:43Jason Belk: And he's using this a lot, his startup and and consulting.
- 8:45Jason Belk: And so I'm gonna share the link with that as well, which I think just helps visualize the flow and how all the pieces fit together.
- 8:52Jason Belk: Because if you just go to the GitHub repo, and this is where I got stuck, I'm like, okay, so what do I do with this?
- 8:56Jason Belk: I I see we have a repo and I see I have clawed code, but like, where do the dots connect?
- 9:01Chris: Yeah, for sure.
- 9:02Jason Belk: And and the first couple of times I tried, I kind of gave up before I got through his stuff.
- 9:06Jason Belk: Um, not through it in a bad way, but like before I I I went through his his the way he explained it, and then I've tried to explain it as well on Cisco U and a tutorial we'll talk we can talk about a little bit later, is just kind of like connecting that dots of like, okay, how do I actually use this?
- 9:19Jason Belk: And like it's not it's really not as mystical as it sounds.
- 9:22Jason Belk: It's and once you I I even went through a demo of this with one of my friends from church, and he's he's like he has some ideas on on a potential business idea, and so I I shared my screen and my laptop on the computer, and I literally did the spec spec flow with him for his idea.
- 9:36Jason Belk: He was defining the requirements verbally to me.
- 9:38Jason Belk: I would just type in whatever he said, and then we literally built a product in like 45 minutes.
- 9:41Tim: So help me out here because um I'm new to the spec driven thing.
- 9:45Tim: Sure.
- 9:46Tim: Uh the spectrum, so you know, I've been messing around with cloud code, I've done some things, I've failed at more things probably than I've succeeded at.
- 9:54Tim: Uh I tried to make a news agent for the show and I posted that about that on Substack.
- 9:58Tim: Um if you know, me being knowing as little as I do, but and and knowing, you know, being dangerous with it, I supposedly.
- 10:05Tim: How do I how would I, as a person who's messing with it, getting better but not great, um integrate?
- 10:13Tim: Or where do I even start trying to pull in spec driven development into like my own workflow to build stuff?
- 10:19Jason Belk: Sure.
- 10:20Jason Belk: I I would say start with a greenfield project, something that like you had an idea.
- 10:23Jason Belk: It's you're not trying to boil the ocean, like I need I need to make the next Facebook app or something.
- 10:27Jason Belk: But if you're an infrastructure engineer, you're like, okay, maybe I I'm not super comfortable with Ansible and I want to deploy some Terraform as well.
- 10:34Jason Belk: And like, okay, uh, or I know Terraform really well and I don't know Ansible.
- 10:38Jason Belk: And so it's like you have an you have a context area that you already kind of understand, but it's kind of rusty and you have to look up a lot of docs.
- 10:43Jason Belk: So you're able to define the requirements reasonably well.
- 10:45Jason Belk: So I'd say, like, like brainstorm, okay, this is what I kind of want to do.
- 10:49Jason Belk: And you don't have to get it all right in the first shot.
- 10:51Jason Belk: This is more just kind of like to make sure set you up to succeed.
- 10:53Jason Belk: Now I'd say check out the links that we were we set up because it's it's something that I'll talk through, but it's almost more important for you to look through and do it yourself with your fingers on the keyboard.
- 11:02Jason Belk: Um, because it it's it's really not rocket science.
- 11:04Jason Belk: Like once you have on one screen the flow and the other screen your terminal, and like you have it set up.
- 11:09Jason Belk: Okay.
- 11:09Jason Belk: The the installation process is basically just a bunch of bash scripts.
- 11:13Jason Belk: It's not like installing any new software, it can kind of run independently too, just as it's a bunch of markdown files and bash scripts that kind of like guide the quad code to do the the project management workflow.
- 11:25Jason Belk: And so the the the GitHub repo that I have for for my um kind of additional context, I'll just say some additional instructions on the spec kit flow, which is optional, or the core one that you can get from the official Microsoft GitHub.
- 11:37Jason Belk: Um you can basically get clone down the spec kit.
- 11:40Jason Belk: I'd say the one thing I learned the first time I did that I did it incorrectly is that I initialized my clawed code at the wrong directory because I was kind of new to Claude Code, where I was like, okay, uh I'm I have my project folder, make dira project, and then I put spec kit in that in that subfolder, and then I ran clawed code at that layer above where the spec kit was installed.
- 11:58Jason Belk: So it didn't look because these are technically what are called claud skills, and it doesn't it doesn't load in the skill if you're not in that directory when you initialize claude code, which it didn't tell me.
- 12:06Jason Belk: And I mean like I I went all that to say is like if you're doing it, just make sure initialized when you type in claude on your terminal when you have it installed, do it in the same place, the same layer of the directory where you have the spec kit installed so it can load in those skills.
- 12:19Tim: Oh, okay, I see.
- 12:20Tim: So so I mean you're pulling down a repo, like you said, basically, and and and in that repo is gonna be like skill file, like files essentially that that define all the skills for that you're gonna use for the for the workflow that you're gonna follow on the spec driven development.
- 12:34Tim: Okay, that that makes it a little bit more real to visualize.
- 12:37Tim: Okay, I see.
- 12:38Jason Belk: And you can inspect them, and it's not like some binary that you can't ever touch.
- 12:42Jason Belk: You can look at the bash scripts, you can look at the the markdown files that are a part of it.
- 12:46Jason Belk: Um but basically as soon as you load up that clawed instance and it loads in those skills, you can then access on slash commands so you to to load it to use those skills.
- 12:55Jason Belk: So you go, you know, like slash spec kit dot, and then the first one would be constitution.
- 12:59Jason Belk: And if you do it in the wrong order, it'll kind of like gently correct you.
- 13:02Jason Belk: It's like, oh, you're trying to implement, you don't have a plan yet.
- 13:05Tim: You want to have a plan it's a workflow, it's yeah, it's a whole it's like uh uh waterfall.
- 13:10Tim: Yeah, yeah.
- 13:11Tim: Okay, yeah, that makes sense.
- 13:13Jason Belk: Yep.
- 13:13Jason Belk: So so the the the first step, and this is one that I'd say it doesn't always enforce, but it's good to start with because it kind of gets you in the right headspace and helps it up farther down the road, is the constitution.
- 13:23Jason Belk: So just like in the United States and other countries, they have a governing body that defines the principles of what should be executed.
- 13:30Jason Belk: Uh so in in this case, it's between I think three and five.
- 13:34Jason Belk: Generally, it suggests.
- 13:35Jason Belk: And and it's not that you have to walk in with like a quill and like some parchment and and and and have it all worked out before you start.
- 13:42Jason Belk: Like Hancock on there.
- 13:44Chris: Yeah, get your drawing Hancock.
- 13:46Jason Belk: That's right.
- 13:46Jason Belk: I actually use um this is kind of like a JSON hack that I started recently, one of my friends pointed me to as Whisper Flow.
- 13:53Jason Belk: This is different than spec hit development, WISPR flow.
- 13:56Jason Belk: It allows you to do voice to text real easily.
- 13:59Jason Belk: So you have to have a hotkey, and you can do that prompting into your terminal.
- 14:02Jason Belk: So it makes my prompts so much better on Claud Code, where I'm not like getting carpal tunnel DM VPN on my on my Claud Code.
- 14:11Jason Belk: I just hold down option, that's the key I set up, and I just talk for like 30 or 45 seconds, brainstorming what I want to do at the consultation at the constitution where it'd be more at first principles like, okay, yeah, I'm trying to do a in this case Ansible Terraform app.
- 14:23Jason Belk: I kind of I know Ansible really well, but I don't know Terraform so well.
- 14:26Jason Belk: Um my my resources are all gonna be public cloud, AWS, Azure, and like my keys are gonna be in this.m file or in my you know my my ZH S HRC and all that kind of stuff.
- 14:38Jason Belk: So you just kind of like give it the lay of the land and kind of what direct what what direction you're heading.
- 14:42Jason Belk: And I just kind of record 34 to 5 seconds, paste it in there, and I'm done.
- 14:47Jason Belk: And and then it processes through there and uses the the LLM.
- 14:51Jason Belk: And that's a one other key thing for me is not to use sonnet, but to use Opus.
- 14:54Jason Belk: When I did spec driven development, like it default.
- 14:58Jason Belk: I mean, I think quad code defaults to Sonnet, which is fine for like you know setting simple stuff, but you can do slash model and switch to opus.
- 15:05Jason Belk: And yeah, you're gonna use up your tokens a lot faster, but it's like cry once, try once, or whatever, and like because otherwise it was just spinning in circles with Sonnet.
- 15:13Jason Belk: It's like, oh sorry, I broke something.
- 15:14Jason Belk: Let me fix it.
- 15:15Jason Belk: Oh, I broke something else.
- 15:15Jason Belk: Let me fix it.
- 15:16Jason Belk: And so I was like, with Opus, it still breaks things on occasion, like once a day for me, or and what stuff like that.
- 15:22Jason Belk: But I'd just say, even if you have less Opus tokens based on your pro or whatever level, just wait till it refreshes.
- 15:29Jason Belk: Yeah.
- 15:30Tim: Yeah.
- 15:30Tim: So this is interesting because when I was working on my agent, um, I was trying to save save tokens.
- 15:37Tim: So like I was using um I used haiku, which I was like, oh wow, this is a really bad idea.
- 15:42Tim: It's a really bad idea.
- 15:43Tim: I realized it after the fact, after I was building the code for it, I was like, wait a minute, I shouldn't use haiku to build this.
- 15:48Tim: But what haiku is good at is writing.
- 15:50Tim: So maybe from like this part of it, this constitution defining like doing the writing part of it, would that be better just to get it all in the mod?
- 15:59Tim: Like get it because all you're doing at this point with spec I think, and correct me, is at this point, really what you're doing is creating the files that clause refer to uh refer to for the development part of it, right?
- 16:12Jason Belk: Yeah, yeah, I'd say I haven't tried that.
- 16:14Jason Belk: It's a good idea.
- 16:14Jason Belk: Like in terms of the flow, I'd say definitely when you get to the implementation layer, you want to switch to over.
- 16:19Jason Belk: But you could probably get away with it on Sonic and Haiku on the on the initial ones.
- 16:23Jason Belk: I I haven't done like A-B testing to see what the difference is, but I think for most, I think on the implementation level, that's definitely for your own.
- 16:29Tim: Oh, it's definitely no doubt, no doubt.
- 16:31Tim: I can tell you haiku is terrible at implementation, not accident.
- 16:34Tim: I can tell you that for sure.
- 16:35Jason Belk: That's a good idea.
- 16:36Jason Belk: Um, and so yeah, for once you get your constitution.
- 16:39Jason Belk: So I I do my brain dump, it responds back basically, usually like, hey, I've noticed based on what you said, or if you didn't give enough information, I'll ask them follow up questions.
- 16:47Jason Belk: Um, based on what you said, here's three to five principles that I'm seeing.
- 16:52Jason Belk: Like that you you want to have simplicity as a design, you want to have cloud native as a design, you want to have these you're doing this as a proof of concept rather than a production build.
- 17:01Jason Belk: So like it kind of extracts out or clarifies for you what type of project you're trying to build.
- 17:07Jason Belk: And this doesn't just have to be for coding.
- 17:08Jason Belk: Um, this could be for for other stuff too.
- 17:10Jason Belk: Like that's but all all that to say is like what then it creates from the that response, then it generates your constitution file for you.
- 17:17Jason Belk: So I'm not like going in there handcrafting.
- 17:19Jason Belk: You can you can go in there and edit the file, but it basically writes it for you.
- 17:22Jason Belk: And then you go to specify.
- 17:23Jason Belk: So once you have your constitution going, you flow through through these this loop of this workflow for each of your features.
- 17:30Jason Belk: So you go from specify to plan to tasks to implement, back to specify to plan to tasks to implement for each of your features, basically.
- 17:40Jason Belk: Um, and and and I've found for bigger projects, oftentimes my first spec is like an architectural one where its output is not code, but just like architectural documents, um, where I'm like, okay, let's specify what cloud we're gonna be using, what you know, what logging we're gonna be using, what um all this kind of stuff.
- 17:56Jason Belk: Where uh if it's a much bigger, if you know it's gonna be a big project, that'd be my recommendation because sometimes it just it just makes decisions and does even with the spec kit flow is gonna start making some assumptions on things that you might have to go back and rework later, which isn't in the world, but like that'd be my one recommendation for a bigger project.
- 18:10Jason Belk: But if you're just getting started doing a small thing like this, it doesn't matter.
- 18:13Jason Belk: I would say you're probably just gonna have maybe two or three specs tops.
- 18:16Jason Belk: Um so the first the first one would be, you know, like the first one that flows.
- 18:19Jason Belk: So we have the constitution, and then you go to and then you do the slash command slash spec kit, and it'll have like tab complete if that skill is you know um loaded in there correctly.
- 18:28Jason Belk: And then it sometimes really it'll even suggest, like at the end of its constitution, like, okay, we have the constitution already.
- 18:32Jason Belk: Do you are you ready for spec kit specify and like copy and paste?
- 18:35Jason Belk: Yep.
- 18:36Jason Belk: Um and and and so then for spec kit specify, you're documenting your requirements.
- 18:41Jason Belk: So going back to that project management example, you're sitting down with the project manager, and they're like, Okay, so what's what's the problem?
- 18:46Jason Belk: Like, well, we have a new sales office and we need to get access in for salesforce.com.
- 18:52Jason Belk: And they we we have an app we'll have to take down the network over the weekend in order for this this network change to take place.
- 18:59Jason Belk: Um, and no, we're gonna do it on the Cisco iOS cat9 gates and Cisco Catalyst Center or something.
- 19:06Jason Belk: So you're just defining your your requirements in terms of what you're trying to accomplish for this particular feature.
- 19:12Tim: Yeah, that makes sense.
- 19:13Tim: I mean, you're setting up the guard essentially the guardrails, like what are you going to be working with?
- 19:18Tim: What are you gonna be doing, right?
- 19:19Chris: Like I think uh I think one thing that I've definitely observed is it's amazing to me how fast Claude and Anthropic have kind of switched to the front runner in this in this conversation.
- 19:32Chris: Um it's it's been you know specifically over the last it seems like over the last month like it's really really picked up steam.
- 19:40Chris: Um but one thing I've also noticed is the the kind of you know kind of variety of tools that people are using.
- 19:47Chris: Like you said, you're using something specifically for voice to text, and there's integrations and there's people's building skills and using different MCPs and things like that.
- 19:56Chris: So maybe can we can we take a step back and let's talk a little bit about skills and because I know with with spec driven development, um it seems one of the kind of concrete things is is the idea of because you've well defined your requirements and your intent up front, this allows for kind of parallel development, right?
- 20:16Chris: You have this you have agents working on one piece of it and agents working on another piece of it, and they can operate autonomously, right?
- 20:23Chris: And they won't conflict with each other because they all are working off of the same requirement, right?
- 20:28Chris: Correct.
- 20:28Chris: Um, so can you tell me a little bit how agents and skills play into that?
- 20:32Jason Belk: Yeah, I I I'm by no means an expert on um skills, but I'll my humble explanation is that they're just a series of bash scripts and markdown files, primarily markdown files, that um help the model, usually Claude, understand what parts of its training and brain to use in that particular context.
- 20:50Jason Belk: So just like if you're on ChatGBT and you say, pretend you're an expert network engineer and analyze this ACL.
- 20:55Jason Belk: Okay.
- 20:56Jason Belk: Um it's it's it's it's it's it's it's funny because like on the software-defined talk podcast, they actually even talked about like if you if you look at like the market share that's been destroyed by a bunch of markdown files, they're like, it's tremendous.
- 21:08Jason Belk: They're like, you know, you're destroying accounting, it's destroying legal.
- 21:11Jason Belk: It's like you look at what actually is destroying, it's just it's just like some markdown files on these repos.
- 21:15Jason Belk: It's not like they they did anything super special, it's just like it it's such a powerful model, it just needs like little guardrails and like some to say, okay, just focus on this part and take on this identity.
- 21:27Jason Belk: Um yeah.
- 21:29Tim: So actually, real quick, because uh you just reminded me of something, and I I this is more of an opinion thing because like I don't think anybody knows what's gonna happen in the next six months or three months or two months with AI, these things.
- 21:40Tim: But isn't this this feels like uh, you know, what I'm hearing more and what I truly believe probably will be the the result, the end result here is as we seek to make these things more efficient, and as training becomes things that, you know, we have enough material uh hardware to start doing more training, specialized training.
- 21:56Tim: Do you think that we're gonna gravitate towards more like small, you know.
- 21:59Tim: Small specialized models that are going to be built kind of for this, or unless, or do you think it's going to be like, oh, well, here's an agent, we're going to put the guardrails in place, and then we're just going to have the LOM still back at all?
- 22:11Jason Belk: I think it's going to, my opinion, just the way I've seen other stuff work, you're not going to know or care as a user.
- 22:16Jason Belk: Sure, no, 100%.
- 22:17Jason Belk: But but but like from a technical perspective, um Yeah, that's what I'm thinking.
- 22:21Jason Belk: I I I I can definitely see that being in the approach.
- 22:23Jason Belk: I mean, that's why I work at Cisco, like they released a security um L um special trained model.
- 22:30Jason Belk: Yeah, a small language model for that last June on Hugging Face.
- 22:34Jason Belk: Because uh yeah, like I think it's also just not feasible to maintain these models.
- 22:39Jason Belk: I mean, I might be wrong, I'm not an expert by any means, to like try to pretend like the corpus of every possible job in existence that will exist and that will exist, could be maintained by something that or would want to be maintained, even if we could, it's like, well, we could we could use all of the power from Idaho to like power this thing, or or or we could just run it on your run on your phone.
- 22:59Tim: And so that's kind of my feeling too.
- 23:01Tim: Like, so I I think that's probably where we're going to be headed once once we get more of the of the process of being able to truly kick crank out these small language models or specialized language models, depending on how you want to talk about it.
- 23:14Jason Belk: Yeah, I think it's right now such a new thing for so many people and so disruptive to people's workflows and such an open form thing.
- 23:21Jason Belk: Or previously, with like cloud, you're like, okay, I have to get like my AWS keys and like you know, go onto the console and like figure out what I want to do here, or or even from a SaaS perspective, like okay, I need to like get my credit card and like get this SaaS thing plugged into my work workflow.
- 23:35Jason Belk: And that there was still like some complexity there and like some changes to people's existing paradigm.
- 23:40Jason Belk: They're like on-prem versus cloud, hybrid, you know, all that kind of stuff versus like LMs just blows everything out of the water.
- 23:45Jason Belk: I was like, what if you could just like talk to your computer like in Star Trek and it could like answer?
- 23:49Jason Belk: Right.
- 23:50Jason Belk: And it's just like I I I I mean, I'm not trying to like trivialize anything about this, but I think that's in my mind one of the foundational differences that it's so open form and free form that it's hard to train people on like what to do.
- 24:02Jason Belk: You're like, oh, I you mean I can have it help me cook dinner or build out ACLs on my router.
- 24:10Jason Belk: Okay.
- 24:10Jason Belk: Um, but I guess we'll do that.
- 24:13Jason Belk: Um, so I I I think that's my mind what the adoption curve is gonna is is is gonna eventually look like is that it's gonna get more adopted as you get more specialized bottles where people can understand their use case.
- 24:25Jason Belk: They're like, oh, this is my security model, I'll ask it security questions, even though they could probably do that right now.
- 24:29Tim: Um yeah, yeah, yeah.
- 24:31Tim: But efficiency-wise, of course, you gotta when you every time the ask and LM a question, you're lighting up like half the planet to to get the answer.
- 24:38Tim: Um you said something earlier also about the um oh about the uh oh man, I just lost my train of thought, of course.
- 24:47Tim: Darn it, I I had it for a second and then I just lost it.
- 24:50Tim: I give up.
- 24:51Tim: Uh Chris, uh I'll head it over to you.
- 24:52Tim: I was I was kidding.
- 24:54Jason Belk: I was I was put I was put in the spot for no reason for that.
- 24:57Tim: Sorry.
- 24:58Jason Belk: I I can keep going through this stuff that's uh so so we we we covered constitution, we covered specify.
- 25:05Jason Belk: So after specify, you have the planning phase.
- 25:07Jason Belk: So you've defined your requirements, you've defined your governing principles, and then now you have your requirements, you go per feature designing your technical approach.
- 25:15Jason Belk: And and and this would be just the next flash command.
- 25:18Jason Belk: So after it does the specify, and that might take several minutes or longer in terms of the specifying the constitution.
- 25:22Jason Belk: So you gotta be patient, go to the bathroom, take the dog for a walk, um, and then come back and then do the spec kit plan.
- 25:29Jason Belk: And you can do these in multiple tabs.
- 25:30Jason Belk: Like I'll sometimes have three or five different spec kits running on different projects at the same time, which just makes you feel like superhuman.
- 25:37Jason Belk: Um and so, like spec kit plan per feature design technical approach, and that that's basically like, okay, now that we have our requirements, like what's gonna be our approach for the Ansible Terraform example?
- 25:49Jason Belk: It's like, okay, you know, like what modules are we gonna use or for Ansible and and what um providers are we gonna use for Terraform?
- 25:55Jason Belk: And this isn't something that like you have to define that out because like it based on the LM's knowledge, and if it has access to the internet, it can figure that stuff out.
- 26:02Jason Belk: So, like this plan is generally, in my experience, generated from the your main input is on the specify, and then the plan it builds a plan for you.
- 26:11Jason Belk: You're not like okay, I have to spend half an hour figuring out my plan.
- 26:14Jason Belk: It's like, hey, based on your requirements, this is why I think a good plan would be based on your governing principles from your constitution.
- 26:19Jason Belk: And you're like, that is a good plan.
- 26:20Jason Belk: Let's do that one, or you can go in there and you can clarify, and this is for the voice to text input, I'd be like, I'd be like, no, actually, like I decided not to use Ansible.
- 26:28Jason Belk: We're we're we're gonna use Puppet and Chef instead.
- 26:30Jason Belk: And it'd be like, okay, I guess we need to go, we we need to rechange everything.
- 26:34Jason Belk: And so, like, you you can still part way through change your mind and do different things, but or maybe a more realistic change to the plan would be like, okay, we're gonna have this on specific jump posts that you need to know about and and and and stuff like that, having more details on your on on what is gonna affect the plan.
- 26:49Tim: Actually, you just reminded me, just reminding me what I lost my frame of thought on, which is what we were talking about, and and I think everybody who's probably now put any amount of time into AI is figuring has already figured this out, but just for setting purposes, um, the more you know about the technology you want to use, the easier it is to get the AI to to under because of course, because you can say, like, oh, I know you're gonna need this information, right?
- 27:14Tim: I know you're gonna need to know about this, I know you're gonna end up like if you know Ansible, like if you know enough about Ansible, you know exactly what that you gotta tell make makes it into the spec.
- 27:24Tim: Yeah, you you know exactly what needs to go in there.
- 27:26Jason Belk: Yeah, yeah, you know what the gotchas are.
- 27:28Jason Belk: And so this is where I think people who don't have a technical background use AI, do kind of get caught up or get stuck or get in rabbit holes.
- 27:35Jason Belk: And so this is like exactly to your point, like your advantage as a technologist in defining these things is that you can front load your assumptions on all the things you wish, as if you were talking to yourself from a mentor version of yourself where you've forgotten everything, but you also you're like this is yeah, or a junior, a junior engineer, and so you need to clarify your assumptions.
- 27:55Jason Belk: And and this is kind of my thing that I've realized over the past year, year and a half is that like your leadership skills, your soft skills as a human being, make your ability to execute prompting and planning like this uh significantly better.
- 28:09Jason Belk: So I'd say brush up on some books on leadership if you have nothing to do and you're bored on the technology side, and it's gonna help you be a better AI user in the future because it gives you things like clarifying assumptions, you know, defining requirements and all these things that like project managers and people with with you know technical leadership backgrounds are all used to or consultants oftentimes too, where you have to sit down and define your workflows.
- 28:35Jason Belk: Um it's uh it's all in your head somewhere where you you need to get it on paper, kind of assuming nothing.
- 28:40Chris: Yeah, I think um one thing I've definitely noticed in working with AI for specifically this type of uh this type of use case is uh I'm very good at giving context, and I often give a very large amount of context, which as you guys talked about, it really uh it really messes with your you know your windowing uh availability when you're interacting with AI, so it's like burnt me a few times because I'm like I'm like no, this is important, you need to know this.
- 29:08Chris: So I do like this idea.
- 29:11Chris: Yeah, I do like this idea of being able to define that up front and that just using that as a reference source over and over again.
- 29:18Chris: Um because yeah, I mean, but then there's tools as well out there, like it we should we should put a link to that software defined talk episode in the show notes because it's so valuable to me.
- 29:28Chris: Um but there's um they referenced that there's even tools out there that you can use that actually remove all the fluff from any of your prompts that like can't will not, you know, so that you're not eating up tokens that's cost.
- 29:42Chris: You might be saving them.
- 29:43Chris: Yeah, exactly.
- 29:44Chris: Like you might be using them uh, you know, maybe 10% less, but that 10% can be you know that's valuable for you down the down the road, right?
- 29:52Jason Belk: And I'd say if you have other documents, you can reference those as long as you're you're willing to give access to those files to this system.
- 29:58Jason Belk: Right.
- 29:58Jason Belk: So like for one of my projects, I had done some work in a planning phase, not even before I even knew about Spectre Development.
- 30:04Jason Belk: I I had like a 20-page Microsoft Word document that I I had defined basically requirements.
- 30:09Jason Belk: It was the first half of it was governing principles, and the second half of it was execution lines, not like code, but more like defining tasks and things.
- 30:18Jason Belk: Yeah.
- 30:19Jason Belk: Um, and I p I found PDFs to be the longer franca of of AI, and so I exported the doc.
- 30:25Jason Belk: I think you can read doc X, but I always just do it as a PDF just to make sure the formatting's right.
- 30:29Jason Belk: So I export as a PDF, included that in my constitution specifying that like it was really good at that, because it's like it it extracted all the important details and kind of like filled out the stuff for me on that stuff.
- 30:39Jason Belk: So if you already have a project plan from like an actual project manager, and they're like, okay, okay, Chris, we need we need you to to build out this cloud deployment.
- 30:47Jason Belk: Here here's your here's your project plan.
- 30:49Jason Belk: You're like, okay, I'll export as a PDF, and if my company lets me use these types of tools, I could just use spectrum development to extract out and build out the plan from their plan.
- 30:58Tim: Yeah, that makes sense.
- 30:58Tim: And I don't run into that.
- 31:01Jason Belk: Oh, go ahead.
- 31:02Jason Belk: I was just saying once so once you one thing is that it sometimes your plan might have ambiguities where e either um based on what you're trying to implement or the different technologies and outcomes you're trying to achieve.
- 31:13Jason Belk: And I'm trying to think of a good one.
- 31:15Jason Belk: Um, but an example might be if you weren't specific on a cloud.
- 31:17Jason Belk: If you're like, okay, I want to do Ansible and Terraform, but you never really said if it was AWS, Azure, or something else.
- 31:24Jason Belk: And it will oftentimes auto-suggest in at the end of its response, like, do you want to go to the next phase or do you want to do spec kit for clarify?
- 31:32Jason Belk: And you can still run it, even if it doesn't suggest it, and it might say, Nope, there's nothing just to clarify, but uh sometimes it will it will actually go through a clarify phase where it goes through all the tasks, I mean all the plan that it's built and say, Here's my plan.
- 31:44Jason Belk: There are actually some ambiguities on some of these plans, and then it will it'll do between one and five questions that are multiple choice, or you can fill in your own answer and and it and and allows you to clarify.
- 31:56Jason Belk: So it's like like, for example, those questions you'll say, like, I noticed you know our plan we're we're we're we're not saying which cloud we're using.
- 32:02Jason Belk: Do you and it'll kind of know because it's smart in terms of like, did you mean to use AWS A, B, Azure, C, you know, GCP, or D, something else?
- 32:12Jason Belk: Fill it in.
- 32:12Jason Belk: And it doesn't have to be a one-word answer.
- 32:14Jason Belk: You could I can say, well, I I I I have an Azure account, but I prefer AWS, and so it'll be like, okay, no, let me update the plan.
- 32:20Tim: Yeah.
- 32:21Tim: I like to use the uh I mean, I this is uh obviously spec driven is much more uh not just complicated, not just complex, but obviously very, I assume in the weeds with it.
- 32:31Tim: But I mean I've been using the planning mode of Claude quite a bit.
- 32:35Tim: Um for the it for the same for the same reason, right?
- 32:38Tim: Create me a file because I know what's gonna happen is that I'm gonna run out of context when you can compact the conversation.
- 32:44Tim: I'm gonna lose all the details I put in.
- 32:46Tim: Exactly.
- 32:47Tim: Go back and refer to this file again when when you've when you after you've done that, right?
- 32:52Jason Belk: Exactly.
- 32:52Jason Belk: And that's one thing I mentioned early on, but I forgot to mention again, is that that is the huge advantage of this or the planning mode on Claude Code is that once you get to a certain point, all its tokens in its brain get scrunched down to a little dot, and and then it you you kind of have to start over again to certain steps.
- 33:05Jason Belk: But when you have this plan all written out, it just refers back to the files.
- 33:08Jason Belk: It kind of knows where it is in the flow, it has like its own checklist.
- 33:10Jason Belk: Like, okay, I'm on the planning phase.
- 33:12Jason Belk: Now let's move on to the tasks phase.
- 33:14Tim: Yeah, it's a it's a big big bonus.
- 33:17Tim: Um I I yeah, I had to learn about it uh because I didn't realize that until I did three or four projects and I was losing all my context and it was forgetting everything.
- 33:26Tim: And I was like, man, there's gonna be a better way.
- 33:28Tim: And so yeah, that's the anyway.
- 33:30Tim: No, this is good.
- 33:31Tim: Um we've got all the so we have all of the the links, including the one for uh that goes through the entire process of spectrum development.
- 33:39Tim: I think that's gonna be use uh really useful.
- 33:41Tim: I think we just that I think that's probably the first thing where people what I'm thinking about is okay, there's two things, right?
- 33:47Tim: One is where do people start?
- 33:48Tim: We kind of covered that, which is like literally just go look at these documents and then go fork a repo or grab download the repo.
- 33:54Tim: That's so that's just to the listeners that are already work with AI or that want to start working with AI and want more of a framework to start from.
- 34:02Tim: That's the first one.
- 34:03Tim: Um, the second one is uh since we have to we'll we'll start uh wrapping up here in a minute, but let's talk a little bit just before we wrap about the Cisco U cores that you built.
- 34:13Tim: What's at like compared to the to the docs that are the the docs we were like to see?
- 34:18Tim: What is the what covers what's covered in the course?
- 34:20Jason Belk: So so yeah, I we have a couple links here.
- 34:22Jason Belk: We have one that's a tutorial, these are free.
- 34:24Jason Belk: You don't need any subscription, you just need a CCO Cisco account, which doesn't even have to be a Cisco customer.
- 34:29Jason Belk: You just you can create one for free with your Gmail, I think, or whatever.
- 34:31Jason Belk: And and so this to Cisco U tutorial, Cisco U is our learning and certification, learning with Cisco, place where you get your certification training officially from Cisco.
- 34:40Jason Belk: So they have you know CCNA up to I think CCNP and and other training in between.
- 34:45Jason Belk: Um and so we also have free tutorials on a variety of topics from cloud, security, AI, networking, the gamut.
- 34:52Jason Belk: Uh I think we have over 200 at this point.
- 34:54Jason Belk: So not just this one tutorial, but check out the other ones.
- 34:56Jason Belk: We have ones linked to different certifications you might be pursuing as well.
- 35:00Jason Belk: So for for this particular one I wrote a few weeks ago, I basically took the spec driven development um gecky link that I share, I talked about earlier and kind of converted that to a network engineering context.
- 35:10Jason Belk: So if you uh if you look at his great presentation link and you're like, okay, I kind of get what it is, but how do I do that as a network engineer?
- 35:17Jason Belk: Look at my link on the Cisco U1 where I basically have you go through a spec driven flow for setting up the skill and then using it to like basically build like a simple Ginja 2 YAML parser thing that creates some config files.
- 35:28Jason Belk: Um, so that should get you up and running, at least with a very simple use case that's all gonna be run locally.
- 35:33Jason Belk: You don't need any remote devices, you can just kind of do it with your Claud code locally on your personal laptop or whatever to get started.
- 35:38Jason Belk: Uh and then I'd say on top of that, so that's the free one on the paid side, and I think they might have it free right now, depending on when this gets published, of a Cisco AI technical practitioner course.
- 35:47Jason Belk: And we came out with a certification last December.
- 35:49Jason Belk: So, this in terms of complexity level, on those who are familiar with Cisco certifications, the CCNA Cisco certified network associate is an associate level exam.
- 35:57Jason Belk: This is one step before that.
- 35:58Jason Belk: So this is meant to be entry level.
- 36:00Jason Belk: I don't know what I'm doing quite yet.
- 36:02Jason Belk: Let me figure it out, type of course and exam.
- 36:04Jason Belk: So we came out with a course and exam in December.
- 36:06Jason Belk: So it's been out for a few months now, and it it covers prompt engineering, you know, AI security, AI-driven software engineering, um, advanced prompting strategies, uh, you know, what is an LLM, what is RAG, and all that kind of stuff.
- 36:19Jason Belk: And I'm I'm actually doing a Cisco Live session covering this AI tech course and certification.
- 36:24Jason Belk: So if you're coming to Cisco Live US, US, come check out my breakout session with with George.
- 36:28Jason Belk: Nice an hour, it'd be a lot of fun.
- 36:31Jason Belk: Um and then I'm also doing another um Cisco Live session on the new um CCMP automation, autocore, EN core, like the enterprise networking automation, professional level that used to be called DevNet Professional Exams.
- 36:43Jason Belk: So I have another one there that people should check out.
- 36:46Jason Belk: We're running Cisco Live, and then third, I have what's called Cisco U session.
- 36:49Jason Belk: So we have 45-minute sessions on on the floor, and that one will be on Spec Driven development specifically.
- 36:54Jason Belk: So if you're still unsure and you happen to be a Cisco Live, check out my session there or the recording will be up, you know, after Cisco Live as well.
- 37:00Jason Belk: Awesome.
- 37:01Chris: Yeah, we'll definitely get all those shows or all those links in the show notes as well.
- 37:05Chris: I think this will definitely publish before Cisco Live.
- 37:08Chris: So yeah, for sure.
- 37:10Chris: If you are if you are going to Cisco Live US, make sure you do check out the session.
- 37:14Chris: That sounds great.
- 37:15Chris: Is it our details?
- 37:16Chris: Do you have details of the session as well?
- 37:17Chris: We can put the I can get this, yeah.
- 37:18Chris: Yeah, let me pop.
- 37:19Chris: I can pop the side.
- 37:20Tim: Yeah, the catalog is up, catalogs up now, so we should be able to we'll we'll get that.
- 37:23Tim: Um I'm doing uh I'm doing a lab, but I'm not here to plug.
- 37:26Tim: I'll plug my stuff on a different show.
- 37:29Tim: But uh yeah, so we'll get we'll get that.
- 37:31Tim: We'll get that in the show notes.
- 37:32Tim: Uh definitely sign up for all of Jason's stuff.
- 37:36Tim: Um also, Jason, where can people find you online before we uh wrap up?
- 37:40Jason Belk: Sure, yeah.
- 37:40Jason Belk: So I I'm primarily on LinkedIn and and X Twitter uh as Reno Belk.
- 37:47Jason Belk: I have a blue sky, but I I I only have so many places I can keep track of.
- 37:50Jason Belk: And so I'd say I'd say but and then I'm you know, I'm also on a number of different Discords there out there, but yeah, uh like I'm on the R of Network Exchange.
- 37:59Jason Belk: People want to ping me there for that one.
- 38:00Jason Belk: Um, but uh of course I'd say like the primary primary one would be LinkedIn.
- 38:03Jason Belk: That's the one I check the most often for Reno Belk.
- 38:05Jason Belk: Reno Belk.
- 38:07Jason Belk: At Reno Belk.
- 38:08Tim: Yeah.
- 38:08Chris: We'll we'll make sure we have the links on the sky's dying.
- 38:11Chris: Um hate to say it, but you know.
- 38:13Tim: Yeah, is it well?
- 38:14Tim: I mean a lot of people that's the problem with the that's the problem with moving uh people over, is that a certain center of gravity has to move in order for the thing to work.
- 38:24Tim: So anyway.
- 38:24Tim: Yeah.
- 38:25Tim: All right.
- 38:27Tim: Um okay, well, yeah, let's go ahead and uh wrap it there.
- 38:30Tim: And we'll get all the links, and there's gonna be a lot of links in this one.
- 38:32Tim: Uh so definitely go through all of them.
- 38:35Tim: And uh yeah, we will thanks for joining us, Jason, and we'll um see everybody on the next uh show.
- 38:41Tim: Sounds good.
- 38:42Chris: Thanks for guys.
- 38:42Chris: See you guys.