The Walking Dead of Security: When AI Resurrects the Build vs. Buy Debate
With Chris Romeo, Izar Tarandach, and Matt Coles
Are cybersecurity technologies really dead, or are reports of their demise greatly exaggerated? Today’s episode is a discussion on how AI is reshaping the classic build vs. buy debate, empowering non-engineers to create working prototypes and potentially reviving the DIY coding culture of pre-open-source days.
About this episode
Are cybersecurity technologies really dead, or are reports of their demise greatly exaggerated? Today’s episode is a discussion on how AI is reshaping the classic build vs. buy debate, empowering non-engineers to create working prototypes and potentially reviving the DIY coding culture of pre-open-source days. We also talk about how developers trained on open source are now leveraging AI built from that same foundation, raising questions about innovation and originality in modern programming.
Build vs Buy is Dead - AI Just Killed It
Traditional Code Review is Dead
Follow AI Security Table:
➜ Home: https://securitytable.ai/
➜ X: https://x.com/AISecurityTable
➜ LinkedIn: https://www.linkedin.com/company/ai-security-table/
➜ YouTube: https://www.youtube.com/@AISecurityTable
Transcript · 40 min conversation
0:10Chris Romeo Hey folks, welcome to another episode of The Security Table. This is Chris Romeo, joined as always by Matt Coles and Isar Terrandas. And it is late January 2026, and we are in the midst of snowpocalypse, is what we've been calling it here in the South. We have roughly 2 inches of some type of white substance on the ground with some ice on top of it. And it is, it's not a 1970s kind of club event.
0:43Matt Coles So that's just icing on the cake.
0:46Chris Romeo Yeah. Well, I actually haven't gone out to test it now that you make that kind of reference. I thought it was just snow and various precipitation, but do you have lawn furniture?
0:56Matt Coles Because you could have a table cake.
0:57Chris Romeo That's true. I do have some lawn furniture that I'm looking at out the back window here. I don't see a cake that's been provided though. So yeah, and you are—
1:08Matt Coles you guys are in the United States North, uh, where the table and the cake have become one.
1:16Chris Romeo Yeah. I didn't spend most of your night, uh, you didn't get one of those autonomous, uh, snowblowers I've been watching on social media.
1:24Izar Tarandach I haven't. My wife has.
1:26Chris Romeo Yeah. His name is Isar. No, they have these battery-powered, they're like a Roomba, but it's a snowblower.
1:35Matt Coles Battery-powered Roomba.
1:36Chris Romeo Yeah.
1:36Matt Coles Snowblower.
1:36Chris Romeo It's snowblower. But like, so I've been watching these videos of people, they seem to be relatively powerful. Like people are running them through this whole storm. They're just going, they go and run and then they go like the Roomba, they go back to their battery charging station and then they launch back out and keep, blowing out the snow. So I just figured, Matt, you, of everyone I know, you would be the one with an automated snowblower.
1:59Matt Coles Oh no. Yeah. I'd have to mortgage my house to, to get one.
2:03Chris Romeo But I don't have no, I don't have any idea because I live in the south. Like, I'm like, there's no way I would even be able to use, like, I would've been able to, I'd be able to use it once every 3 years. So I was like, I didn't even bother looking to see how much it was.
2:16Matt Coles You know, if the batteries were interchangeable, you could use it for your, your leaf blower. Actually, the snow is light enough that somebody was— I saw somebody using a leaf blower to blow the snow.
2:26Izar Tarandach I do that.
2:27Matt Coles Nice.
2:27Izar Tarandach On my deck, I blow it with the leaf blower. But Matt wouldn't be the one running the thing. He would be the one running after the thing with a laptop and an I2C connector. Wait, wait, I want to talk to you.
2:40Matt Coles Come here.
2:44Chris Romeo Well, this is the zombie episode of security table. It's kind of a montage to The Walking Dead. Brave.
2:54Matt Coles Yeah.
2:55Chris Romeo Of cybersecurity.
2:56Izar Tarandach We, we just connect to the snowmageddon cuz, uh, we were expecting like to, to lose power and everything. Hey, hipster Conrad, no losing power.
3:05Chris Romeo All of a sudden, bam, fades to black. Like, wait, what?
3:11Izar Tarandach Oh no. Hard Mecca.
3:14Chris Romeo Power outages ravaging the East Coast. All right, well, we got two different takes. And Yezar, I think you had some, uh, some apt analysis here that, uh, apparently everything is dead.
3:28Izar Tarandach Yeah, the thing is, and even we have done that once or twice, but apparently everything is dead. AppSec is dead. Uh, I started hearing that even LLMs, a certain kind of LLMs is already getting dead because there's a new kind of LLMs coming on. So everything is dead. We live in a zombie world and I don't know.
3:53Matt Coles Batteries. Remember Batteries Included?
3:55Izar Tarandach Right. I think that the rumors of a lot of things' death have been greatly exaggerated, as they say.
4:03Chris Romeo Who is that? This was, who's that quote from?
4:05Izar Tarandach Uh, one of the presidents.
4:07Chris Romeo Is it Hemingway or is it Mark Twain?
4:09Izar Tarandach No, no.
4:10Matt Coles Batteries Included?
4:11Izar Tarandach No, the rumors.
4:13Matt Coles Oh, the rumors of my death are greatly exaggerated.
4:16Chris Romeo We have all this LLM power.
4:22Izar Tarandach Mark Twain?
4:23Chris Romeo It was Mark Twain.
4:24Izar Tarandach All right.
4:24Chris Romeo Yeah. I was right, right with my second guess. I don't know why I went with Hemingway.
4:28Matt Coles Mark Twain. Yes.
4:29Izar Tarandach No, wait, wait, wait. There's a foreign joke. Apparently that quote is dead.
4:33Matt Coles It's greatly exaggerated.
4:35Chris Romeo Yes. Everything's dead.
4:37Izar Tarandach That quote is dead. Uh, that there's a lot of attribution. John Davis, Mark Twain. Yeah, no, we can't go down that rabbit hole right now. No.
4:51Matt Coles Well, or raven hole. It's very dark.
4:54Izar Tarandach So let's talk about this build versus buy is dead. AI just killed it. Okay.
5:01Matt Coles Oh yes. Let's do that.
5:03Izar Tarandach So it comes from VentureBeat.
5:06Chris Romeo Well, that's people that are out there doing things.
5:09Izar Tarandach Right?
5:10Chris Romeo Well, already successful people.
5:11Izar Tarandach Or pay, yeah, paying for other people to do things. So perhaps they're happy because now they're paying for AI agents to do things and they can pay less. Yeah.
5:21Chris Romeo So I mean, their premise that I'm seeing here is that AI creates a world where non-engineers can generate working prototypes and code using natural language prompts. So not really anything new. Like we kind of knew that already, right? That people have been vi— this whole vibe coding we've talked about in the past. All right.
5:43Matt Coles I am, I'm going to, I need to bring it up. What's old is new again. Remember before the world of open source, people used to build their own components.
5:52Izar Tarandach Remember? Yeah.
5:54Chris Romeo I don't remember that.
5:55Matt Coles You are, we are all old enough to remember that.
5:58Chris Romeo Speak for yourself.
5:59Izar Tarandach And now that we are all, we are all old enough to have forgotten that there is a time.
6:05Chris Romeo We can just say we are all old.
6:06Matt Coles You may remember there, there is, there was a time. Where open source was considered bad.
6:11Chris Romeo Yes.
6:12Matt Coles And building components was good because you have control. And then open source came along and now reuse was good and reinventing the wheel was bad. And now about that, here we are back again with reinventing the wheel is good because the AI is reusing all of that old code.
6:32Chris Romeo So it's like combined reuse I don't think that, I don't think the people that are, that are generating working prototypes using LLMs even know any of that that you just said.
6:46Matt Coles No, I know.
6:46Chris Romeo They just take what the, what the LLM spits out as—
6:50Matt Coles wait, but Joe Surreality, that's what's happening. Back in the old day, we used, back in the old day, like 20 years ago, we used to invent our own code.
6:58Izar Tarandach Back in my day.
7:00Matt Coles And then open source came along and we used to reuse their code. And now we have AI reusing their code to reinvent the code.
7:07Izar Tarandach You, you're just reminding me of like The Cathedral and the Bazaar. Mm-hmm. Remember the book and how if you use open source, you are basically a communist because it's soon as you put that code into your code, then your code becomes everybody's code.
7:24Chris Romeo Yeah.
7:24Izar Tarandach And all that stuff.
7:26Matt Coles And that's different with, uh, AI that's been trained on public models, you know, public models that are trained on GitHub and whatnot.
7:36Izar Tarandach So here's the interesting thing.
7:40Matt Coles Oh, I don't want to go there.
7:42Izar Tarandach It could be said that today's developers have also been trained on open source code, right? Because yeah, some learned coding at the university and whatnot and had the whole computer science thing. Explained to them very nicely. And some just, hey, made stuff work, right? And then you look at a piece of code that does sort of what you want to do and you learn from it and you move on. And where do you get that piece of code? Mostly from open source.
8:16Matt Coles And, uh, oh, didn't you recently post something about this on LinkedIn? Is our—
8:21Izar Tarandach what, the Stack Overflow? Yeah, I was just, I was just telling Chris about it. So the thing is, I was talking to a developer and we ended up, as one does, talking about coding agents. And he was like, yeah, remember when the solution was to go to Stack Overflow and get whatever code you needed from there? So he remembers when Stack Overflow was the solution. And I had to say, hey, you know what? I remember when Stack Overflow was a problem. And apparently not a lot of people on LinkedIn Connect to the fact that there is Stack Overflow, the place where you go to read code. And once upon a time, Stack Overflow, you're writing C or any other non-memory-managed language, was actually a problem. You could have a stack overflow and blow out of your recursion or whatever.
9:14Matt Coles Yeah, it's where you went to read code and then occasionally you would just borrow that code and it would end up in your production stack.
9:19Izar Tarandach Yes, exactly. Exactly. Right. And, um, uh, I don't know, it was, it was just a bit of a funny way to, to close the week to me. Cause I was like, dude, you know, Stack Overflow had its own problems and nobody knew if the code coming from there was actually good or not, but people were just cutting, cutting, pasting. And now we look at it and we say, oh, the good old time, good old days, right?
9:44Matt Coles Yep.
9:45Chris Romeo And now it gets used to train all of the models that are out there recommending code to people.
9:50Izar Tarandach Exactly, exactly.
9:51Matt Coles Yeah. So, but you know, I'm looking at the article and it's an interesting one. And I think there's a really important point about halfway down the article that they actually make. And I'll be modifying my sort of soapbox a moment. In the past, we used to simulate real-world systems to figure out how they function and whether it's something we want, right? We would try different concepts and then pick one of those concepts and move forward and see if it worked. What the article seems to be suggesting is not that, not that they build components, you know, bespoke components because AI can. The suggestion here is build to learn what to buy. And I'll extend that to build to learn what to integrate. Right. So, if that's the, if that's where it stops, meaning rather than building a component bespoke so that you don't have to buy anything, this is prototyping, right? This is concept engineering. And that's not horrible, right? As is our, I think you've mentioned AI can't brainstorm. AI can brainstorm, but AI can't invent, right? It can only build what was previously known or stitch together previous things, it may end up with something new, but it did it by accident. And so we're talking about conceptualizing ideas to inform humans on a path forward. And that's not a bad thing.
11:26Chris Romeo I don't get how this works in the real world though. So like, okay, I'm thinking about buying a customer relationship management tool for my company. So I ask AI, build me Salesforce. So that I can, so that I can, uh, evaluate it and get real clarity about what I need from a feature perspective.
11:47Matt Coles There's an open source version of Salesforce somewhere, I'm sure.
11:49Chris Romeo AI just starts spitting out smoke, like it's like smoking out of the back of it. 'Cause Salesforce is probably 100 million lines of code or more, and it's a big thing, right? So like, I don't get how that's really practical advice to say, I'm gonna have AI build a knockoff of the solu— the problem, the solution that I'm evaluating, and then I'm somehow gonna be better informed. Like, if you don't understand the problem enough to choose an enterprise-grade solution, how are you gonna describe it to the AI in such a way that it gives you something of value?
12:24Izar Tarandach So, all right, so let, let, let's take some things with a grain of salt here. The, the person who authored this, uh, piece, let's call it piece. Has a very non-veiled interest in, uh, in this scenario being true. But what I find— okay, I don't want to use that word. What I find a bit of a problem here is that, uh, on one side they infantilize everybody, and on the other, on the other hand, they, they, they make everybody a superhero. So they're saying you're not capable to know what is it that you need right now for your business, but you are really, really capable to go take an AI and build it in 2 hours and show 80%. No, that's exactly what he's saying here.
13:13Chris Romeo Yeah.
13:13Izar Tarandach After 2 hours, they have 80% of the functionality. Dude, after 2 hours, I haven't found yet the door to the bathroom. I mean, there's no—
13:23Matt Coles turn on the lights. There is our—
13:25Chris Romeo if you could, if you could prototype, you could build something to 80% after 2 hours, you could invest another 10 hours and get to 100% in this logic and you wouldn't have to buy anything.
13:36Matt Coles Exactly.
13:37Chris Romeo You could just use your newfangled AI-generated solution. Now, you know what they didn't mention in this article?
13:43Izar Tarandach But wait, wait, wait, wait, wait, wait. Before you go to, before you go to the, the thing that links these both things of infantilizing and superheroizing, whatever, is if I don't know what I need, how am I going to get to 80% of it?
13:58Matt Coles What's 80%?
14:00Izar Tarandach Like, who's going to decide what is this 80%? I, I, I, as you said, uh, uh, Chris, I just tell the AI, build Salesforce, and I have one agent that goes down and researches what is it the Salesforce does, and another one that comes and builds a plan, and another one that builds a to-do list, and another one that checks the, like, how in this person's mind the physics of this thing work? I don't know what I need. 2 hours later, I have 80% of what I didn't know that I needed. Now I can look at this 80%, understand what is it that I need, and decide if I want to buy or if I want to spend 10 more hours and build the other 20%. I mean, in which world does this make sense?
14:44Matt Coles Well, okay, to be fair, they said built a version of this last night. That could have been 2 hours or that could have been 10 hours. Who knows how much they sleep?
14:51Izar Tarandach No, no, no, no, no. He says here 2 hours. He says 2 hours.
14:54Matt Coles Uh, oh, okay. Yes, you do. You're right.
14:57Chris Romeo Yeah.
14:57Izar Tarandach In the beginning.
14:58Matt Coles Yeah.
14:58Izar Tarandach At the end he says last night, but in the beginning he says 2 hours.
15:01Matt Coles And then he says, shows them something built in 2 hours. Yep. Yeah.
15:06Izar Tarandach But even if it was last night, 10 hours, really?
15:12Matt Coles Like, where's the logical consistency here? Take a, take a smaller example, right? They didn't build Salesforce, but they built, um, Nessus. They reinvented Nessus. And I chose that specifically because I know Isara's background.
15:31Chris Romeo I mean, it wouldn't take long.
15:34Izar Tarandach Oh, I'm just thinking of the— I'm glitching here. I'm just thinking of the commercial where the ladies sit in front of the wall and they paste like Polaroids. And the lady is saying, this is my wall, this is my social media wall, and somebody says, this is not how those things work? This is not how those things work! I mean, I'm still trying for the logic consistency here. I understand we live in a world where logic went out of the door that I couldn't find a long time ago. But seriously, if you're going to step up and say X is dead, Don't you think that, uh, you owe X a nice way of killing it at least? And not this, this, this BS of I can do whatever in 2 hours with an AI agent. You can't.
16:28Chris Romeo Well, apparently according to AI, declaring something dead is intentionally provocative to force reconsideration.
16:37Matt Coles Is that the new Gen Z term?
16:39Chris Romeo I don't know. I don't know what that means.
16:40Izar Tarandach I don't do Gen Z.
16:42Chris Romeo No.
16:44Matt Coles SNL had a, SNL had a Gen Z translator on, uh, this weekend.
16:48Izar Tarandach So you have a nephew? It's true.
16:53Chris Romeo I just need to talk to, uh, I talk to my children sometimes to say, what does this mean? Because they say, I'm not, I'm not, I'm not joking though. Like I'll, they'll say something or I'll hear somebody else say something and I'm like, I don't know what that is. And I'll ask them, what does this mean?
17:08Matt Coles I wonder if Google Translate will take care of that for you.
17:11Izar Tarandach I just assume that it means nothing. You know, because again, saying that something is dead nowadays means nothing. You can kill and bury something, it's coming back.
17:28Chris Romeo So you're saying that saying something is dead is dead.
17:33Izar Tarandach Yeah, basically.
17:35Chris Romeo Very meta.
17:36Izar Tarandach No, wait, I'm saying that we should kill saying somebody is dead, something is dead.
17:42Chris Romeo Hmm. Okay. So, I mean, at the end of the day, do you disagree with this?
17:49Izar Tarandach Uh, completely and totally.
17:50Matt Coles That build versus buy is dead?
17:53Chris Romeo Yeah.
17:54Matt Coles Well, okay. So I think that they bounced around that concept. In the first place.
18:00Izar Tarandach So I think that somebody's trying to sell us something.
18:05Chris Romeo So somebody's always trying to sell you something. That's how the world works.
18:08Matt Coles I think, I think the important part of the VentureBeat article though, we're talking, oh, actually we are talking about the VentureBeat article still.
18:13Chris Romeo Yeah. Yep.
18:13Matt Coles So, so in that one, it's, it's kind of confusing because again, they're talking about being smarter about what they need to buy, which is different than implementing something to replace what they bought or to not buy something in the first place. Right? So if you're doing concept development and simulating and you can mock it up and say, hey, uh, company XYZ, I know you have your pitch deck, but here's what we actually want.
18:46Izar Tarandach Right?
18:46Matt Coles We mocked up what the interface we'd like it to look like or what functionality we want, and they can make a better purchase decision, right? Hey, can you do this for us or something like this? Or do you already have this feature, right? Versus we don't need to buy from you because we just invented it ourselves, right? Or we don't need to buy, take this open source component that's already been pre-running, pre-built and code reviewed for past decade and, you know, is functional. And we, we just created a new version of that ourselves and are using it cuz well, you know, you can put into production faster. That's two different things. Okay.
19:22Izar Tarandach So as somebody who has done a startup or two, two things come to mind. First of all, it seems to me that marketing is dead because there's no interest for me. Everything is dead. That there's no interest for me to come into a boardroom and show somebody my deck. If the guy there in the back taking notes is just going to slip out to his coding agent and come back with 80% of what I'm showing in 2 hours, right? But then it comes to the, well, I'm a startup. I'm, I'm really small. I need some capital. I go to a VC and I show my deck. And now they're going to go to their team in the background and say, oh, look at this deck. Can you do this in 2 hours, 80%? Oh yeah, we can. Well, what about, what about the marketing? How do I, how do I, uh, I get that?
20:13Matt Coles What about if the startup does capital? Well, what if the startup does that, that 2 hours of work a ahead of time and, and tries to predict what the VC or what the customer's gonna do. And so they go, hey, look, and by the way, if you wanna do some comparative shopping here, we did it for you already.
20:29Izar Tarandach Oh, you just went into, I know that you know that they know that I know that they know that this is what I want to buy.
20:35Chris Romeo And I know what you did last summer.
20:38Matt Coles Well, you know, if you have, if you have infinite age, if you have infinite agents, why not just test the agents? Predict what this customer might want or predict what any customer might want and produce various versions of it.
20:50Chris Romeo I was gonna say, are we getting to a future where every, like a company creates a million different versions of what their product is tailored to you? Like it's the Burger King, you can have it your way.
21:01Izar Tarandach I'm going to write that and I'm going to call it an infinite army of monkeys. Right?
21:08Matt Coles So just, just think about that, that concept though, with infinite compute power, why not?
21:15Chris Romeo Of having, like, my, my, so the solution I buy from ACME Corporation and that they deliver to me is not the same one that you buy, even though, like, There's a way of doing where that's possible.
21:29Izar Tarandach No, that's already true. If you go to any, any SaaS, okay, today, just to use a name that you already mentioned, two companies saying we use Salesforce. Can you say that they use exactly the same suite of products in exactly the same way with exactly the same kind of results?
21:45Chris Romeo No, it's true. No.
21:46Matt Coles The un— well, the underlying— wait, wait, wait. The underlying components are all the same and then you customize them, right?
21:50Chris Romeo So.
21:51Izar Tarandach Exactly. So that's the point.
21:52Chris Romeo So you would have—
21:54Izar Tarandach but I'm saying version. Of Salesforce, that's for you. That's the way it works for you.
21:59Chris Romeo What if there's a world where like a startup is providing a product called, uh, ABC, but the— what they're providing to Matt and what they're providing to you are, are entirely different products that solve problems in different ways and have different features, but they're, they're, they're using AI to create derivatives of the core concept of their product that solves your particular need uniquely to you.
22:27Matt Coles Oh, I have an even, I have an even more dystopian example, a dystopian thought on that. Why not have the startup just implement an MCP server and make it an API?
22:38Izar Tarandach But wait, wait, wait, wait, wait, wait, wait. It's not that far ahead.
22:41Matt Coles Look, look at this. 'Cause then you can tell, then you can tell the startup what you want and let them make something for you.
22:46Izar Tarandach Go back in time. Go back in time to the depths of a year ago, 2 years ago, no code. Oh, we're going to give you blocks and you just connect them, blah, blah, blah, blah, blah, blah, blah, blah. Right? I don't know where that stuff went, but yeah, whatever.
23:01Matt Coles That would have been awesome.
23:02Chris Romeo It disappeared.
23:02Matt Coles That would have been awesome to, by the way, I think that would have been amazing if it had worked.
23:07Izar Tarandach It disappeared from Lord knows where, but if you go into the marketing and finance pits of hell that sometimes we see. They're alive and kicking in there. Joe from marketing loves to connect things with things and get things.
23:20Chris Romeo True.
23:21Izar Tarandach But nowadays you go and you look at, uh, things like, uh, uh, N8N, uh, what's the name of the other one?
23:29Matt Coles Uh, LangChain?
23:31Izar Tarandach No, not, not LangChain. It's, it's on top of, like, it, it, it's higher in the—
23:35Matt Coles LangGraph?
23:36Chris Romeo No, no, no. Landman?
23:39Izar Tarandach So it, it's, it's—
23:41Matt Coles Chris is dating himself with Landman.
23:44Izar Tarandach It, it's basically old, old— It's basically no-node stuff that behind each node has a very clear interface to code and already has AI nodes inside. And I already has AI to create, uh, uh, sequences of nodes, right? So the AI is getting meta in here. The AI is telling the AI how, how to. So my, my point is, and already I forgot where I was going with this. My point is, if you use those things, you end up with different versions, customized versions of sequences of of, uh, uh, operations.
24:16Matt Coles Was it Zapier you were looking for?
24:18Izar Tarandach With the same blocks that at the end of the day is like a different product built of the same, same pieces.
24:25Chris Romeo Yeah.
24:25Matt Coles Yeah.
24:26Izar Tarandach So we're, we're not that far from there. Yeah. But again, my, my whole point here and where I got, uh, uh, uh, where I got irked with, uh, Matt's example was that it's not like we're moving forward because You can't tell me that you built in 2 hours something that then you say, I used this to learn what I needed, because then it's not like you built a prototype. You, you, you built a, a wisp of an idea that you remotely had that you might need something. You didn't know what it was, but it had to be beige.
24:59Chris Romeo Yeah. It's naive to say that just saying something's beige and that's gonna solve the problem.
25:04Izar Tarandach Right. Is, I mean, there are processes in here. Organizations work in a certain way. Sure. We want to optimize that, but even to optimize something, you have to understand whatever is it that you are already doing. So I, I think that it walks back to my whole problem with this democratization of development or whatever. Some things should not be democratized.
25:27Chris Romeo Some things should be left in the hands of people who actually know what they're doing. Cause I wanna, I'll argue with you on that cause I'll take the other side of that equation. But let's, let's wrap up our conversation on the fact that things are dead. We had another article, Traditional Code Review is Dead.
25:42Matt Coles Oh my God. That's going to be—
25:43Izar Tarandach Oh, definitely.
25:44Chris Romeo What comes next?
25:45Matt Coles That's a whole show.
25:48Chris Romeo Yeah, but we have to, we have to do this in the context of the Is Dead show.
25:52Izar Tarandach Yeah.
25:53Chris Romeo Or the Walking Dead of security. So just to summarize, the article argues that traditional manual line-by-line code review is becoming obsolete in modern software development due to the rapid adoption of AI-assisted tools and automated quality gating practices. The idea that engineers manually inspect syntax and logic and pull requests is no longer the primary mechanism for ensuring software quality. I don't want to use computers anymore at this point, if that's the case.
26:28Matt Coles Well, also, code review was not just a line checker, right? We had grep for that. We had static analysis tools for that.
26:36Chris Romeo True.
26:37Matt Coles Right. The, the reason why threat modeling, and sorry, there's a lot of paradigms between, or a commonality between threat modeling and line-by-line code review. It's so that individuals can share understanding about what they just are about to and just built. So just doing the scanning. So basically these, basically this argument is Everything is becoming a scanner, right? If you just scan, absolutely, right? AI, sure, have at it. Use a linter, you know, you call an MCP server to use a linter or whatever, or do your own linting, whatever it is. Line-by-line code review for correctness, sure. Line-by-line code review for Understanding of what we just built? No. Although the code, although the AI can, can, can describe it for you.
27:39Chris Romeo But it gets worse than that. The, a little deeper in the article, it's talking about the idea that reviewers verify outcomes. For example, that automated tests pass and behavior in preview environments aligns with expectations. What I hear when I read that is we no longer understand what builds, how, how to measure quality of something that we've built. And without being able to understand that, we have to rely on the things the machine tells us, which means we're very quickly going to get away from building things of quality. Because if we don't understand how to get quality, how can we, well, adjust the program?
28:22Matt Coles As somebody who used to do quality engineering, and I won't say it was a major part of my life, but it was a portion. Having developers become QA engineers and understanding how to think about quality as a problem or security or whatever. Uh, I mean, okay. Uh, right. So I'm a big fan of developers working in tech support for a period of time because they learn and understand customer behavior while developers working as QA engineers, but Not being dev and QA, right? Being QA, meaning shift roles, not dual role, because that's DevSecOps or DevOps or whatever, you know, DevStar, because they're taking on multiple responsibilities, doing equal each of them, not as well as they could specialize.
29:16Chris Romeo It's a really good definition of that. The whole concept, doing everything poorly.
29:22Izar Tarandach Yeah, here's my problem with this whole thing. We are asking a black box that we don't know how it works to transform our systems now in black boxes that we don't know how they were built. And to do that, we are going to do black box testing by putting some input and checking if we get the output that we expected.
29:42Chris Romeo But even worse is testing that we don't understand because we probably didn't write the test. So we're probably using AI-generated tests.
29:50Izar Tarandach This is like a dumbification of the whole process that it's not only criminal, it's dangerous.
30:01Chris Romeo Is this the idiocracy of security?
30:03Izar Tarandach This is the idiocracy of not only of security, of code quality. Because what happens now, when this whole thing, when this whole let's use LLMs to write PRs thing started, I wrote a very short piece. Where I said, okay, we have been suffering from alert fatigue for a long time. We just like stamp alerts because we get millions of them and we don't have the time and basically the mind to check all of them. Are we looking into the PR fatigue era now where we are just going to stamp, rubber stamp, whatever comes from the PR creation machine and let it go through because we don't understand that word that's overly used, context of the whole thing. And we are just trusting the LLM does it better. And here we are looking at that.
30:56Matt Coles I mean, so you know what happened with, um, with, uh, curl, right? Recently curl got inundated by AI slop, uh, PRs and they shut down their bug bounty as a result.
31:12Izar Tarandach So something that used to be a high signal quality input channel of things that we should really pay attention to, because Lord knows that curl moves the internet. Now it's closed because, you know, some people decided that just running an agent that reads code and burps PRs was a nice way to monetize this whole thing.
31:38Chris Romeo Are we in that era right now where things that have a public interface that can result in you getting money are gonna be inundated with AI slop no matter what it is?
31:51Izar Tarandach For sure. Look at Medium, look at Substack, uh, the amount of AI slop going in there, right? Cuz people get paid for the hits, I, I, I guess. So yeah, nobody reads, so why should I care if what I put in there is bad quality?
32:06Matt Coles I mean, there, there is a, there are ways that AI can help make the code review process easier with a caveat because nobody's threat modeled this, I'm sure. But if the AI were doing code explanation, right? So if you, if you had the AI summarize what the code is doing, you could review the summary to understand the flow. And if you did formal verification, you could, where the AI could assist with the verification steps or sorry, producing the evidence for the verification steps, right? That's potentially one option. Lastly, what about test-driven development? I've seen this pop up in a couple of places. If you had test-driven development as a paradigm. Even if the AI wrote the tests, but, but importantly, you need the human in the loop to verify that the tests are the right tests.
33:08Izar Tarandach But Matt, that, that's okay. So I saw something called spec-driven agent coding, which is what a human would look at probably as test-driven development, but basically it's write your spec in a markdown, feed it to the, the agent and watch magic happen. Agents.
33:29Matt Coles Yeah, that's the Claude Code approach, isn't it?
33:32Izar Tarandach I believe it's one of the ways that was suggested that this is the best way of working with one of those agents. But my problem is we can't ignore at some point that hallucinations happen and sometimes they happen badly. And now we are taking a process that, okay. We have created tools and we have reached a level of certainty in this process that enabled us to create this whole new organism, right? And now we are saying, okay, so I'm going to have this thing that, again, I don't quite understand, that may hallucinate at any given point. I'm going to let it read my spec, write the code. Write the tests, run the tests, and I am the human in the loop, and I'm doing scary quotes with my fingers, and because I am the human in the loop, everything is going to be fine because there is a human in the loop. The problem is that at the same time that we introduce these things more and more and more and more, the human in the loop that wasn't, uh, much of a human to begin with, right, is going to start losing touch with what's happening. They're going to start to adjust to all the moving parts.
34:49Chris Romeo Are we heading towards a world where developers no longer know how to code? Because that's what I'm hearing when you describe that.
34:55Izar Tarandach Yes, we are. Yes, we are. Even worse.
35:03Chris Romeo Or classic. They don't know how to, they couldn't, they can describe to the AI how to build what they need, but they couldn't sit there and write it in Java.
35:11Matt Coles Yeah, software engineering you're talking about.
35:12Izar Tarandach No, but now we are expecting. This next generation to be able to sit down and read that code and critique what the AI did to a point where they say, no, this is wrong. This has to be, this has to be corrected. No, this is an edge case that I can identify, but this automatic mechanism couldn't.
35:32Matt Coles So somebody needs a threat model, this new software engineering paradigm where AI, where, where AI is, is breaking the chain because they are causing, and the big story is right, that entry-level developers are are the ones who are going to suffer here, right? Because AI is basically the entry-level developer. So today you have senior engineers who can do the validation as a human in the loop. Tomorrow, 10, 15, 20, 30 years from now, there will be no senior developers because there weren't any junior developers. And who then is the human in the loop?
36:09Izar Tarandach It's worse.
36:10Matt Coles So it's a delayed reaction.
36:12Izar Tarandach It's worse. The senior developer of tomorrow is the AI of today that got trained on everything that all the other AIs did. And because of the volume of things, because of the way that it was trained, because of the compute time that was put in it, because we write amazing transformers and whatnot, this yesterday's junior AI developer is going to be tomorrow's senior AI developer. And I don't know, are we going to end up with a cast of developers that actually know how to write AIs, or are we going to have AIs that write AIs? I don't know.
36:49Matt Coles Are you going to retrain AI using AI-generated code?
36:54Izar Tarandach I'm not going to do anything because I'm going to tell an AI to do it. But no, really, from what I've been reading, and please, I could be totally wrong here, and I'm not an AI expert by any means or whatever. I think that it's been understood that AI trained on AI output collapses at some point. I should go and do more reading about this.
37:18Chris Romeo It seems like it's an entropy type of thing. It's going to get, it's going to get, it's going to, it's going to break down until there's nothing left.
37:24Izar Tarandach Yeah. But in, in my head, I don't understand how the fact that something is created by AI ingests itself into the process of training to a point where the result collapses. So that's what I have to educate myself on. But, uh, I, I, I'm just very afraid of, uh, uh, uh, um, Middle Ages case where we know that back in antiquity we, we knew a lot of stuff and the Alexandria Library burned down and these and that and the other one. And we ended up with, I don't know how many years of Middle Ages where a lot of knowledge got lost.
38:04Matt Coles About 500 years, I think.
38:05Izar Tarandach Yeah. A lot of knowledge was like copied from one hand to another, but the emphasis was not in the knowledge. It was on the illustrations that went around the page. That, that's what gave them value, not what was written in them. Right. So that, that's my biggest fear today. We are heading towards a middle age and like any good catastrophic movie, it begins with everything being dead and becoming a zombie. So, you know, that to me closes the, the, the loop. We are killing everything, we are creating zombies, and now in 2 hours we are rewriting the OS for the world. Somebody already wrote a full operating system with, uh, uh, vibe coding, from what I understand.
38:49Matt Coles If we could, if we could figure out how to make them zombie processes, that would be, uh, we'd be would be perfect, right? So just start them, kill the terminal, start them, kill the terminal, move away.
38:59Chris Romeo Yeah. So, all right, well, I think what we've concluded is that in fact everything is dead, but also nothing is dead.
39:08Izar Tarandach Exactly.
39:10Chris Romeo And people who say things are dead in articles are really just trying to get people excited. Clickbait.
39:16Izar Tarandach Yeah, but Dask, that's, that's dead.
39:19Chris Romeo Dask is dead. I mean, I'll—
39:20Matt Coles but that's just dead.
39:21Izar Tarandach Like, that one is dead. That one is dead.
39:22Chris Romeo Wait, wait, wait, what about if you wanted to have Dask but you knew Dask was Instead, you ask the AI to resurrect it and create a new, better version of it.
39:31Izar Tarandach It's going to scan only 80% of the surface.
39:35Chris Romeo That would make it probably better.
39:36Matt Coles That might be better. That might be improvement.
39:40Chris Romeo I'm getting ready to start trashing the whole industry again. I just got them all back in my good graces, and then I get dragged back in. Well, folks, thank you for listening to the original Security Table Podcast, not to be confused with other things called Security Table Podcast. Um, but for, uh, Isar and Matt, I'm Chris Romeo and, uh, get out there and say stuff's alive.
40:07Izar Tarandach Please.
40:09Chris Romeo Yep.
40:09Izar Tarandach Make stuff alive.
Transcript supplied by AssemblyAI. It may contain transcription errors.
Originally published as The Security Table. Part of the AI Security Table archive.
