50 minSeason 4, episode 27

Stop Patching Bugs, Just Rewrite It… Says the Guy Selling the Tokens

With Chris Romeo, Izar Tarandach, and Matt Coles

Cisco's president handed a 27 year old engineer unlimited AI tokens and 24 months to rewrite 98 percent of the company's legacy code, and Sam Altman now says we can no longer just patch all the bugs. Chris sees a step toward disposable software, where you regenerate the thing instead of fixing it.

Episode title image: Stop Patching Bugs, Just Rewrite It… Says the Guy Selling the Tokens

Listen to the conversation

Episode chapters · 35 chapters
  1. Cold Open: A Day Ending in YAudio
  2. The Lost Art of Letter WritingAudio
  3. Izar's Agent Identity Threat ModelAudio
  4. Hiring an Assistant to Run Their Own LifeAudio
  5. AI Natives Build Apps Nobody NeedsAudio
  6. The Unskilled Linux TinkerersAudio
  7. Article Intro: Cisco's Unlimited Token RewriteAudio
  8. Publicity Stunt, or Time to Call Aruba?Audio
  9. Can One Gen Zer Rewrite Everything?Audio
  10. Matt's Case: Measure the Cost of the RewriteAudio
  11. Izar's Rebuttal: Why Would You Do This?Audio
  12. Izar Automates the PyTM ReleaseAudio
  13. Disposable Software: Regenerate, Don't FixAudio
  14. Article Intro: Altman Says Stop PatchingAudio
  15. Says the Guy Selling the TokensAudio
  16. From UML to Code GeneratorsAudio
  17. From No Code to Natural LanguageAudio
  18. Can AI Clone a Binary?Audio
  19. Claude Won't Clone Your GameAudio
  20. Frontier Labs Are Cybersecurity Companies NowAudio
  21. Why Wasn't Security Already in the Toolchain?Audio
  22. AI Is the New DeveloperAudio
  23. Three Conversations at OnceAudio
  24. Article Intro: Bias in the Qwen3 Coder ModelAudio
  25. How Does a Model Phone Home?Audio
  26. Abliterated Models and Hidden BackdoorsAudio
  27. Treat AI Like We Should Treat HumansAudio
  28. Should You Trust Open Weight Models?Audio
  29. Scenario: A Homegrown Biased ModelAudio
  30. Izar: Start With the Use CaseAudio
  31. Can Tests Find a Covert Channel?Audio
  32. Back to Cisco: Covert Channels in Your NetworkAudio
  33. You Can't Put an Agent in JailAudio
  34. Who's Liable: User or Model Creator?Audio
  35. OutroAudio

About this episode

Cisco's president handed a 27 year old engineer unlimited AI tokens and 24 months to rewrite 98 percent of the company's legacy code, and Sam Altman now says we can no longer just patch all the bugs. Chris sees a step toward disposable software, where you regenerate the thing instead of fixing it. Matt calls it the holy grail of automation and traces the dream back through UML, code generators and no code tools. Izar wants to know why anyone would bother, and points out that the loudest voice for rewriting everything is the guy selling the tokens. Then it is Hirundo's finding that Qwen3 Coder writes more hackable code when told the app is for a US defense contractor, ProjectDiscovery's backdoored abliterated model, and whether open weight models can be trusted at all. Izar's answer: start with a concrete use case, then verify, verify, verify. Plus: Izar admits he doesn't have enough of a life to need an AI agent.

Mentioned in this Episode:
➜ Cisco is letting a 27-year-old refactor 98% of its legacy code with unlimited AI tokens: 'Go nuts'
➜ Sam Altman: 'I No Longer Think We're Gonna Be Able to Just Patch All the Bugs'
➜ Bias in Qwen3-Coder Model
➜ How abliterated models can get you pwned

Follow AI Security Table:

➜ Home: https://securitytable.ai/

➜ X: https://x.com/AISecurityTable

➜ LinkedIn: https://www.linkedin.com/company/ai-security-table/

➜ YouTube: https://www.youtube.com/@AISecurityTable

Transcript · 50 min conversation

0:09Chris Romeo It is a day ending in Y on the AI security table.

0:13Matt Coles Wait, doesn't it end in I?

0:16Izar Tarandach Wait, it ends in denial. It ends in denial.

0:21Matt Coles A or E or sometimes after Y.

0:23Chris Romeo Sometimes I, I don't even remember what. Where we, how we got here. But, uh, welcome to Security Table.

0:30Matt Coles Making fun of Isar, who starts—

0:31Chris Romeo we're gonna do that anyway. But this is Chris Romeo, joined as always by Matt Coles, Isar Terandash. And we just got some late-breaking news. Isar doesn't use AI to triage his inbox because he often rides to work on a dinosaur.

0:50Matt Coles Don't you have That explains it.

0:55Chris Romeo He, he actually got a, he just got a message from some folks that he knows via fax at his house.

1:01Izar Tarandach Wait, I am looking through the window and I see some smoke in the horizon. I think somebody's calling me.

1:08Chris Romeo Is there, is there a pigeon knocking on your door, on your window? Ting, ting, ting, ting, ting, ting.

1:13Izar Tarandach Look, well, at least there's an RFC for that.

1:17Matt Coles Do you have, do you have a, do you have a two-wire line? Copper line coming directly to your house, maybe on a big telephone pole. You hear, you're on DSL, aren't

1:27Chris Romeo you? You're on DSL still, I could tell. Or ISDN.

1:31Matt Coles No, I was thinking more like telegraph.

1:34Izar Tarandach Here's the thing. Here's the thing. Unlike you children with your newfangled agents and whatnot, okay, I like to put time once upon a time. And I don't remember this because it was before my once upon a time. People would actually take pleasure in writing letters to each other. You can go together today and read famous letters of, I don't know, Feynman or Leibniz or Newton, right? And writing a letter was something that you actually put time into. And I believe that if you put time into something, then you should put time into the other things. So if people put time into writing, I should put time into reading it.

2:15Chris Romeo I've gotten emails from you. They're not beautiful prose.

2:21Matt Coles Okay. So, so if, if, if that's the case, and I agree with you, Azar, that, oh my God, I keep looking for my, my mic here. The, uh, I agree with you, but the question is, do you have a fountain pen?

2:33Izar Tarandach A what?

2:34Matt Coles Do you use a fountain pen to write your letters?

2:36Izar Tarandach Actually, I do. I have a friend, a very good friend who has a collection of those and he was nice enough to give me one so that I could enjoy the pleasure of the thing. And it's beautiful.

2:48Matt Coles I happen to be a collector of fountain pens.

2:51Izar Tarandach I have horrible handwriting. But wait, wait, there's something—

2:55Chris Romeo You should use AI to enhance that.

2:57Izar Tarandach There's something that I do, but there's something that triggered this whole discussion. Okay. So Chris was explaining to me his use of agents in his day-to-day life. And I mentioned to him that last week I sat down and I talked to myself on this pretty nifty, nice little chat model where I said, I'm going to open a new email, a new identity for my agent. And it's going to have its own separate calendar and its own separate inbox and its own separate stuff. And whatever I want it to do, I'm going to forward my stuff to it. This way I have control over the things that the agent sees and can access and Things like that. And once I had this whole threat model in my head and this whole thing worked out, a question popped in my head and it was, why?

3:47Matt Coles That wasn't the question I would've thought. I would've thought, no, I would've thought, how long before the agent signs up for spam mail?

3:55Izar Tarandach No, no, but, but that's the thing. If it did, it was, it would be its own thing.

3:58Chris Romeo Let me give you, let me give you a human example. That's like hiring an assistant. But having them set up their own email inbox, their own calendar, and then they just run their life while you're paying them by the hour.

4:10Izar Tarandach Yes, yes, yes.

4:11Chris Romeo Why would you have an assistant? The assistant's job is to run your life. You're paying the assistant to sit there and run their own life.

4:18Izar Tarandach But that's where you go wrong.

4:21Matt Coles They're going to get accounts on Maltbook. Oh, they're going to have—

4:24Chris Romeo Oh yeah, your assistant doesn't have anything to do, so they're on Facebook or Instagram.

4:28Izar Tarandach The learning lesson here is different. It's not that, oh my God, they're going to run their own lives. The lesson that I got at the end of the exercise was I don't have enough of a life to have somebody else run it. Wow.

4:40Chris Romeo That's, uh, it takes a, it takes a lot to admit that on air.

4:44Matt Coles That's, uh, yeah, there you go.

4:46Izar Tarandach So that, that's, that's, that's the big deal here. Like, why would I go through this whole security exercise, this whole building a complete separate world from mine only to what, set up my Dentist appointments. That's something that I do in like, that's what I do in 5 minutes with a phone call.

5:05Chris Romeo What you make a dentist appointment?

5:06Izar Tarandach And the way that my dentist works, I already have membership with it anyway.

5:09Chris Romeo So wait, you gotta make a phone call to your dentist? Do they have a website? PHP or something?

5:16Izar Tarandach They do. I don't know if it's PHP.

5:18Matt Coles I mean, you can just insert yourself into the, into the schedule at that point.

5:22Izar Tarandach But look, look, look, I think that I have a pretty good point here. Is that just because you have the tool doesn't mean that you have the need.

5:30Matt Coles If they're running Node, if they're running PHP, if they're running particular language at this point.

5:35Izar Tarandach I can promise you that my dentist is not running anything, or my bills, but apart from that.

5:42Chris Romeo So your conclusion is completely flawed for being an AI native. So AI native people. Create things that have no real use. They spend hundreds of hours creating an app to solve a problem that they could have paid $5 a month to a SaaS provider to have an actual battle-tested approach. And so you might be on to something. You might be on to something.

6:12Matt Coles What you're saying is the AI native people are DIYers.

6:16Chris Romeo Oh, 100%.

6:18Matt Coles They're the Linux people. Of the 21st

6:20Chris Romeo century except they don't have their own show on HGTV with a crew of people who actually know how to build things. They're DIY in this sense of—

6:32Matt Coles it's like Linux tinkerers of old.

6:34Izar Tarandach Hey! But they're not skilled.

6:37Chris Romeo Unskilled Linux tinkerers?

6:41Matt Coles You know there's the BSD-ers, there's the Linux-ers, And then there's AI.

6:47Izar Tarandach Are there still BSDers out there? If we're on the sport of calling me antiquate, luddite, are there still BSD people out there?

6:58Matt Coles Almost certainly there are, yes.

7:00Chris Romeo FreeBSD still exists. There's got to be BSD people.

7:03Matt Coles FreeBSD, NetBSD, OpenBSD.

7:05Chris Romeo I don't know anybody who runs a BSD flavor other than macOS.

7:08Matt Coles I'm sure you use BSD all the time.

7:10Izar Tarandach Lots of people. You use it all the time. You have a Mac.

7:13Chris Romeo macOS is based on BSD.

7:15Matt Coles You have a network switch. I'm sure that there's some BSD variants under there, possibly.

7:20Chris Romeo How does everybody with switches?

7:22Izar Tarandach Now it's BS, not BSD.

7:26Matt Coles Although, although someday we will get to this. We someday we'll get to that Cisco article.

7:30Izar Tarandach Oh man, we have to at some point we have to because that's what works.

7:34Matt Coles Should we just, should we just take a dive now?

7:35Izar Tarandach Please.

7:36Chris Romeo I don't

7:36Matt Coles even know. I'm going to completely blow up Chris's channel.

7:39Izar Tarandach Oh, Matt, you didn't put it on the chat.

7:40Chris Romeo I get to edit this so I can completely change it back. Okay, sure. With AI people talking.

7:46Izar Tarandach That was my next question.

7:47Matt Coles So the story goes that Cisco, and I, I don't know if this is a real article, a real, real story or not, but that Cisco is, is going to give one of their junior folks who may be a startup founder unlimited tokens and 24 months to rewrite their code.

8:05Izar Tarandach Okay.

8:05Chris Romeo So what's the source of this?

8:06Izar Tarandach So, so much—

8:07Matt Coles this dovetails with our next, with our actual first story.

8:09Chris Romeo But what, what's the source of this?

8:12Matt Coles I think it was Fortune Magazine.

8:13Chris Romeo Okay. 'Cause I don't have it on my phone. It's not the Babylon Bee. 'Cause I have noticed the internet is filled with a lot of things that people just made up.

8:21Matt Coles Yes.

8:21Izar Tarandach What?

8:22Matt Coles Cisco's president has tasked a 27-year-old engineer with rewriting 98% of the company's legacy code within 24 months with unlimited AI tokens.

8:31Izar Tarandach Does he have pointy hair?

8:33Matt Coles I don't know. This was in Tom's Hardware actually. So, uh, this was— Oh, they're the— So this goes, I mean, this goes with our, with definitely our first story, but what could go wrong here? Right? So

8:46Izar Tarandach it writes itself. It literally, literally it writes itself.

8:50Matt Coles The employee joined Cisco. He was a, he was a startup founder and he now is tasked with taking on Cisco's legacy code.

9:02Chris Romeo What do they mean by Cisco? I've got some familiarity with that company. What do they mean by Cisco's legacy code? Do they say?

9:11Matt Coles Let's see.

9:11Izar Tarandach The first iOS. The thing that was iOS before iOS was iOS.

9:16Matt Coles It doesn't say, but it says 98% of their legacy code. So I don't know what that is. I'm sure somebody knows what that is.

9:27Chris Romeo But is this just a publicity stunt? It seems like a publicity stunt.

9:30Izar Tarandach If it is, it's poor.

9:32Chris Romeo Why would this even be news?

9:35Izar Tarandach Because it, it, it, it opened a very, very important question in my mind immediately. The first question that popped actually, who's the closest sales representative for Aruba? Because I'm not, I'm not touching Cisco anymore after this.

9:53Matt Coles I, the, the, the arti— the story here is that if, if a 27, if a Gen Zer, so very heavy on the, if a Gen Zer can rewrite, single-handedly rewrite the entire codebase using AI, what does that mean for business and engineering?

10:11Izar Tarandach That finally they're not going to have injection on the iOS console anymore after I don't know how many attempts at patching. I don't know. Something.

10:21Matt Coles Yeah, but didn't say what model they're going to use.

10:23Chris Romeo The reality of this, I don't think it's possible. With the models of today,

10:31Matt Coles given the products that Cisco sells.

10:33Chris Romeo It's for, and just for a single person to try to do that level, you just can't do enough design to stay ahead of the agent and agent suite.

10:43Izar Tarandach He's going to do, he's going to do it in 3 lines. He's going to look at the binary, say rewrite this thing, make no mistakes.

10:50Matt Coles Inspect this, right? Run a tool to inspect it. And then reverse engineer it and rewrite it. How much tokens is that going to take?

10:58Izar Tarandach Didn't Brook write most of that stack?

11:01Chris Romeo Brook was on the IT side of Cisco, not on the engineering side.

11:05Izar Tarandach Wait, didn't you write most of that stack?

11:07Chris Romeo No. No, I advised.

11:10Matt Coles He managed a team of security champions who worked with the teams that wrote that

11:14Chris Romeo stuff. Yeah, that's true. Yes. So yeah, I don't, I guess I don't, this just seems like a publicity stunt to me. It doesn't seem like, it doesn't seem like you can scientifically conclude anything, even if it's a, if it's a smashing success, it's so nebulous. How would you draw a conclusion from it?

11:31Matt Coles Well, what you would probably draw is, okay, if you take all of the costs it took to write the code that exists and all of the support costs, right? The setup and installation and defects and bugs and security vulnerabilities and other, all those things that go into the cost of running a business, a product company, and then figure out if you rewrite it using AI and it costs X amount of tokens and how much those costs, how many vulnerabilities do you get out of it at the end? Or how many bugs do you get out of the end and compare? Can one person, can one engineer replace hundreds of thousands of engineers using AI? But, well, okay. Tens of thousands of agents.

12:17Izar Tarandach Tens of thousands. No, no, no, no. Over time. Over time. Ever since.

12:20Matt Coles Right. So this— How many agents can you spin up to rewrite, write this function, write this function, write this function, write this function, stitch it all together.

12:26Izar Tarandach Wait, wait, wait, wait, wait. I have to bring it back to my previous question. Why would you do this?

12:34Matt Coles This is the holy grail of AI and all. Oh, actually, sorry. This is the holy grail of automation.

12:38Izar Tarandach Yes. But why?

12:39Matt Coles As somebody who used to work in it.

12:41Izar Tarandach In this specific case.

12:41Matt Coles In, in somebody who used to work in industrial automation and where we built robots to replace human workers. This is AI replacing human workers, the engineering teams.

12:51Chris Romeo Yeah, I think they, I think they put this out to get people on podcasts to talk about them.

12:56Matt Coles Well, success.

12:57Izar Tarandach Wait, wait, wait, wait, wait, Matt, Matt. What, what you're telling me is that somebody's putting together a pipeline to build better Ford Model T.

13:07Matt Coles To build a Model T. Yeah. To build, to build a better production line, right?

13:13Izar Tarandach Of a Model T.

13:14Matt Coles No. Well, it doesn't matter what they're building.

13:17Izar Tarandach No, no, no. It matters a lot. It matters a lot because it's a function of how much you're going to invest into it. If you tell me that now you're optimizing a pipeline, like for example, yesterday, what we did with PyTM, right? Used to be the 4 release. I had to go in there, type my credentials on PyPI, go into make, do poetry.

13:37Matt Coles Yep. Very human-oriented. Yep.

13:38Chris Romeo Yikes.

13:39Izar Tarandach So many freaking places for me to go wrong.

13:42Matt Coles And why weren't you on Jenkins already? Because you could have automated build process.

13:45Izar Tarandach And then, and then in 10 minutes and 2 reviews later, Claude had written a PR that has set up a GitHub pipeline that lets me just tag a release. Boom. It appears on PyPI.

14:00Matt Coles You used AI to improve your automation.

14:03Izar Tarandach Exactly. Why? Because I had a reason.

14:05Chris Romeo Champion. AI native champion of the day, Isar.

14:09Izar Tarandach Oh yeah. Now, booyah! Now, now somebody explain to me what— Mic drop.

14:15Matt Coles Oh wait, I can't.

14:16Izar Tarandach No, no, no, no, no, no.

14:16Chris Romeo Don't drop that new mic.

14:18Matt Coles It's on alarm. I can't drop it.

14:19Izar Tarandach I'll keep my old one around just for the drop. But now somebody explain to me what would be a good reason for the Cisco president or whatever to go and do that. Apart, of course, from we talking about it now. Because before this, I didn't remember that C squared system.

14:38Chris Romeo It's a, it's, it's a potential, I see this as a potential phase towards something even bigger in the future. And I'm sure you guys have heard this, but let me just bounce this, let me, let me explain this for our audience's sake and then get your take on it. We are approaching a world where software is disposable.

15:01Matt Coles Mm-hmm.

15:02Chris Romeo And so instead of fixing a bug or, or fix or, or writing code specifically for a feature, you just have the system regenerate it.

15:11Matt Coles Yep.

15:11Chris Romeo So instead of—

15:11Matt Coles this is not a, this is a new, this is a relatively new thing that AI can now produce X number of copies. So why not just

15:19Chris Romeo rebuild or have it build, have it rebuild two separate copies and evaluate them and then push the best, the better one of the two to production. So I think this is, I think the work that they're describing at Cisco, I think it's mostly a marketing kind of ploy at this stage, but it is a potential step on a journey towards a disposable software world where we, we stop fixing bugs and we just say, rewrite the stupid thing.

15:49Izar Tarandach It has always been like this. The problem is that now it's faster. And going back to our previous episode with the formal, formal proof, when you tell me, write two versions and decide which one is better, Baylor is doing a lot of work in there because it depends on which tests you're running.

16:08Matt Coles Right. So, so this was also an article from this past week that I think it was Sam Altman. Actually, I'll put it in the chat for us. The Sam, Sam Altman said, we can no longer just patch the bugs. Just rewrite it. So this is, this is the new, so the, what you asked us there, Isar, was, well, why use AI and for better automation? There's one thing to improve the pipeline, improve the process, but with AI being able to run autonomously, you don't have to, you have to pay for the tokens, but you don't have to deal with work hours, you don't have to worry—deal with regional differences and other miscommunications that's like—you can just produce software like crazy, right? You could do

17:01Izar Tarandach something wait, wait, wait, wait, baseline here. You're supporting what you're saying with an article written by the guy who sells me the tokens where he's saying stop everything, just use more tokens. Do, do we see a problem there?

17:19Chris Romeo Yes, of course. So you, you give it away at first and then you see who keeps coming back for more.

17:27Izar Tarandach It, it, it's not the model. Yeah. Who, who, who else uses that model? I wonder.

17:32Matt Coles So, so you're, you're knocking the pro— you're knocking the concepts because of the, the, the self-fulfilling prophecy aspect of this.

17:43Chris Romeo Well, you brought—

17:44Izar Tarandach I can't. I can't knock it from the concept because this has been the holy grail for as long as I have been sitting in front of a computer. And that's a long time, right?

17:53Matt Coles And here we are.

17:53Izar Tarandach But even before that, it was the holy grail again for lines of production. You always want to optimize because at the end of the day, even if you have a bump in cost, you end up over time having something that's cheaper and hopefully better. My problem now is that the people who are championing this approach using AI, basing everything on AI right now are the people who are selling you AI.

18:17Matt Coles It gets a little bit worse.

18:19Izar Tarandach The results don't stand.

18:20Matt Coles It isn't just that. It isn't just that. So do you remember, you remember, everyone remembers, well, okay, we remember UML.

18:29Izar Tarandach Average fan remembers.

18:31Matt Coles We remember UML, right?

18:33Chris Romeo Not fondly.

18:34Matt Coles Not fondly. But you remember what UML—

18:36Izar Tarandach It's too bad we don't XML. Yeah.

18:37Matt Coles You know what UML Enabled, or the promise of UML was to enable code generation. You would design a system in UML and you would push it to a pipeline that would generate Java objects or some object-oriented objects, which it did.

18:55Izar Tarandach Nobody used it, but it did

18:57Matt Coles it. Right. But it was the idea of being able to do software factories, right? To be able to generate—

19:01Izar Tarandach But before that you had RPC, right? Sun RPC.

19:04Matt Coles You had RPC and you had, you had, you actually had code gen— I mean, there were actually code generators, right? That did this sort of stuff. They didn't do them well. They were clunky to use. They're very arcane and archaic to use. Here we are where we have a natural language processor that's able to do the exact same thing more autonomously than those code generators. Now, the code generators were great because they generate code. It was deterministic. It was, there was input and output, expected input, expected output. Here you don't know what you're going to get.

19:36Chris Romeo I wouldn't, I wouldn't say the UML version was, was good or great. It wasn't great, but it was great. It was like, no, it was, it was a promise.

19:45Matt Coles I said the promise of UML

19:46Izar Tarandach in between UML and here, you had the whole visual family from Microsoft, right? Design the form, get code. Don't write the code.

19:54Chris Romeo Don't even start. Don't talk smack about Visual Basic. That's one of the languages I'm actually decent at. So don't even be talking some smack.

20:03Izar Tarandach Wait, you're good at the visual or the basic part?

20:05Chris Romeo Not really either. Either of them, uh, if I'm being perfectly honest. Yeah.

20:12Matt Coles So, so those code generators eventually morphed into no-code systems. Like, I mean, Visual Basic was an early, very early version of this, right? But you had no-code systems where you drop things into a palette and then into a flow, and then that would generate your, your system from that, right?

20:30Chris Romeo Yep.

20:31Matt Coles And there was code underneath, obviously, but there was no code to the user, but the but it generates code. So here, instead of having this clunky UML thing or XML or having a no-code graphical display, now you have, I type what I want or I say what I want and the automation does it.

20:52Izar Tarandach Yeah. And that's how you end up with Bob from marketing asking about logins to GitLab and how does he get a certificate to verify whatever.

21:02Chris Romeo What you just said, Matt, is not— it may work in very small doses. You can't point it at—

21:11Matt Coles I'm not saying it replaces everything—

21:13Chris Romeo at a system and say, or you can't even point it at a binary and say, make me a copy of this.

21:19Matt Coles Actually,

21:20Chris Romeo you can. You can, but it's not, it's not going to have, it's not, it's, it's going to, it's going to make assumptions.

21:27Matt Coles It is, it is because it's going to look at behaviors, not the, it's not going to—

21:31Chris Romeo well, maybe it will reverse engineer. It's not going to be as good as what, you it started from,

21:36Matt Coles right?

21:36Izar Tarandach And yet none of these obvious points that you just raised is stopping people from doing it.

21:41Matt Coles That's right. Or having AI models, AI creation, you know, frontier models have to put restrictions in place to not allow that to happen.

21:50Chris Romeo Well, they just did. Anthropic just put in some, that's another article for another week about the gaming. They've put in the ability to block the replication or try to replicate a game. If you tell it, hey, build me this game.

22:03Matt Coles And, and yet I just noticed on, I just noticed on Android that in Google Play, I can, there's a feature, I've never used it, but there's a feature, put, press this button, tell us what you want, and Gemini will build an app for you.

22:19Izar Tarandach There goes my trust modeling version of Oregon Trail.

22:22Chris Romeo Or maybe it's gonna come to life now. You'll finally be able to release it

22:25Matt Coles instead of getting dysentery. What are you gonna get?

22:28Izar Tarandach Dissempare.

22:30Chris Romeo So one of the other things that I think it's important to, to camp out on for a second, Matt, you brought us to that other article from our friend Sam. We'll call him our friend Sam. One, the frontier model providers are cybersecurity companies now. Evidence, Anthropic's IPO, the S-1 that they filed for their IPO, they specifically talk about their, their march towards becoming a cybersecurity company. So OpenAI is in the same boat, right?

23:00Matt Coles Mm-hmm.

23:01Chris Romeo And so yes, they are, to Izar's point, trying to sell more tokens because that makes more money, makes their stock go up higher, but they're also self-admitting that they're cybersecurity companies. And so we've talked about that in the past. Does that end cybersecurity as we know it? I think I argued not for a long time last time we talked about it, but now that they're focusing on it, I'm not sure I'm willing to say not for a long time.

23:31Matt Coles I think it just shifts the, I think it just shifts the focus for cybersecurity.

23:36Izar Tarandach But it also reinforces the thing that we spoke about many, many, many episodes ago about cybersecurity utilities. Cybersecurity being a thing, just like electricity is a thing. And they're having to be the need of utilities for cybersecurity. Here we have this company which has a finger on today, basically everything out there, admitting two things. First, that they suck at cybersecurity to a certain point, to a certain extent.

24:06Matt Coles It wasn't a focus of theirs.

24:08Izar Tarandach Which, no, no, no, no, no. I don't want to disrespect the people who are working on this with them because we know how hard that work is. But there have been some apparent failures from the works, from what we have learned from the news and write-ups and all that.

24:25Matt Coles Every day, almost every day.

24:26Izar Tarandach Yeah, but on the other hand, now they are seeing that it's not only their own cybersecurity, but that they have a responsibility towards the cybersecurity of the people who are using the thing that they are selling. So that to me, gives some hope that at some point there'll be an understanding here that, hey, we should do better at this stuff because it's basically

24:52Matt Coles a value. So now, two interesting follow-ons to that. One, why couldn't compilers and build pipelines have done that anyway, right? So that you talk about tooling adding the capability to do cybersecurity. So now the code generators are going to do cybersecurity, are going to do application security, right? They're going to make sure that the code that gets written is secure. Why wasn't that already part of the toolchain?

25:20Izar Tarandach But the second—

25:21Matt Coles but with add-ons, with add-ons, of course.

25:25Izar Tarandach No, no, no, no, no. Finish the second.

25:26Matt Coles But the other part is, as AI takes on more of the human role, we've talked about this about developer certification around cybersecurity topics and concepts, right? This is the whole certification path and making sure that developers are aware of security, right? That's why Security Champions exist. AI is now the new developer, and they need to have that exact same capability. So you call it a utility, which it may be true if AI developers are now a utility, if development is now a utility. But it's very similar to having developers who need to know security. And it goes through training, certification, champions, all the process we built around making sure humans have security knowledge and capability. Now AI has that.

26:14Izar Tarandach No, development is not a utility, I think. Providing water is a utility. What you do with the water is a different thing. You can take a bath or you can cook.

26:22Matt Coles Yeah, but if you have a team of agents who can write code and you have a team of humans who can write code, you can't call the AI agents a utility.

26:31Izar Tarandach Okay, so no, no, yeah, true, true, true, true. But the fact that they provide the frontier model that powers all that stuff is what I'm saying. The fact that they are the ones—

26:41Chris Romeo They provide the service to review the code.

26:44Izar Tarandach Yeah. Now, open parenthesis, open parenthesis here. The pipeline did have security in. If you remember GCC, when they came in with the canary buffers, against the memory. Why people didn't use that? Because it made everything clunky and slower, right? Even worse, make everything bigger. So it was like, oh yeah, it's cute. It's nice. Let's test it and put it in warning mode. If something happens, then we know that we have something that we have to fix. But when we ship, we ship without it. So I forgot where I was going.

27:17Matt Coles Uh, I have succeeded.

27:20Chris Romeo You breastfeed. If you had an AI assistant, you would have—

27:23Izar Tarandach my stack is very shallow.

27:25Chris Romeo You would have, you would have a response from the assistant in your ear. Oh, sorry, I think you were going this direction.

27:31Izar Tarandach I do. It's Karl, Karl, Karl Tannhäusen, but he's not here today. But anyway, okay.

27:38Chris Romeo Let's go. Let's talk about this, this bias in Qwen 3 coder model that we were supposed to talk about 28

27:44Matt Coles minutes ago, which is actually dove, which is actually something naturally progressing from those other discussions because Now here we have the non-frontier models. Sure.

27:53Chris Romeo Sure. Act like we had a plan this whole time. Sure.

27:56Matt Coles Well, you had a plan. I completely screwed it up. I haven't been sleeping very well, so

28:00Izar Tarandach I forgot what I was talking about.

28:03Matt Coles You know, we had the time change and everything.

28:04Chris Romeo This is like 3 people having disparate conversations at the same time. Welcome to chaos.

28:11Izar Tarandach How's that different? How's that different?

28:13Matt Coles Yeah. So, so when you generate the shorts from this episode, just run, generate, generate the short of one of us talking and then one of us talking, one of the same.

28:20Chris Romeo The shorts.

28:22Matt Coles See if it comes out as complete at the same

28:23Chris Romeo time. We're literally talking like it's, there's 3 separate things being talked about. Like this is really cool.

28:28Izar Tarandach I'm still waiting for our cloud to just—

28:30Matt Coles if you're, hey, if you're on you, if you're using an AI agent to summarize a YouTube video like ours, as people do, well, they get 3 different, different, they'll get 3 different opinions. They'll get 3 different conversations.

28:44Izar Tarandach I'm sorry. You know what they'll get?

28:46Chris Romeo Divide by zero.

28:47Izar Tarandach If you're using an AI agent to summarize what we're saying here, why?

28:53Matt Coles That's a great question. I know people who, actually, I've seen YouTube videos about talking about using YouTube video, using AI to watch YouTube videos for learning.

29:03Izar Tarandach Right. No, no, no, no. I can understand that for certain use cases.

29:06Matt Coles But e-learning.

29:06Izar Tarandach But for this one, you're missing the whole value because the AI is not going to give you the secure by design cynical by necessity. You're missing the whole value proposition here.

29:17Chris Romeo All right. So bias in Qwen 3 coder model. This is from an article, Schneier on Security. What we want to discuss. So if one sentence about who the code is for changes how secure it is, can we trust rival nation open weight models in our pipelines or even defect detect that bias? So apparently the article describes how a test was done using Quen 3 coder model and saying, if I'm a defense contractor, I'm a defense US or act like a US defense contractor. And it gave a different result from a, from a standard set of prompts where it wasn't specifically calling out. And this pairs a little bit with, I don't know if you guys saw the, the research that happened on this GLM-53. Model. There were some concerns that perhaps it was phoning home.

30:13Izar Tarandach Yep.

30:13Chris Romeo Back to China with some—

30:15Matt Coles that wasn't the mo— the model can't do that. The model is just, is just data.

30:19Chris Romeo It was directing agents to phone home.

30:22Matt Coles Mm-hmm.

30:23Chris Romeo According to its results. Um, I think Checkpoint put that one to bed because there was some randomness in the IP addre— they were able to prove some randomness in the IP addresses that it was, that were going out. So it wasn't targeting one particular IP. It was—

30:38Izar Tarandach yeah, but still, the fact that it's going out is concerning enough.

30:41Matt Coles How can the model— I have to take a step back because this is something I'm not familiar with. How can the model, which is doing, which is doing next token generation, instruct the harness to contact an IP address?

30:55Izar Tarandach So two things, two ways that I, that I see possible. And please somebody fix me and correct me in the comments if I'm wrong here. So you have two levels. You have the level of code that comes together with the model that is not a model, model is the weights, but there is a certain amount of code that comes with the model in, I don't know, some libraries, some loaders, something of that sort that's called in order to bring the weights into memory. So that's one. And the other one is what we're talking about here is the bias. That the code that's generated can, might be under some quote unquote bias that leads the code that's generated to have some payload in there, some dropper, something in every stanza of code that you asked it to write something that's network connected, it's going to put, make sure that that thing is in there. Just assuming, of course, who would do that? Assuming that people are going to run that code without checking.

31:56Chris Romeo I would answer that question. I would answer Matt's question differently. And my answer is computer use by agents has become one of the things that they're the best at. And so yes, the responses are coming from the, the, the, the next thing is coming from the model, but it could be directing computer use by the active agent that's running.

32:23Matt Coles And the harness, the harness running the agent.

32:26Chris Romeo Yeah. It could, it could, it is running tools and commands and things that were, that were, it was led to by the model's response. That is what it's really good at now is running commands and operating your computer and seeing your screens and things. And that could be the, what sent it out to a particular IP address.

32:44Izar Tarandach But apart from that, there, there was an article, I think 2 or 3 weeks ago.

32:48Matt Coles Oh, sorry. Before you, before you get to the article, So what you're saying is that it's not injecting a backdoor, the agent itself has a backdoor.

32:56Chris Romeo Yes. The model. What the concern is, especially with these models that are coming out of China, is are they backdoored somehow? Which was the GLM-53 challenge because it was sending things to IP addresses. Some of them were landing in China, made everybody quickly say, oh, the model's been trained in such a way. With a backdoor. That was the concern.

33:19Matt Coles Do you remember a couple episodes? I think we talked about key placeholder words in conversations, in prompts, and it would tend to be biased towards one set of information versus another. It's a very similar concept.

33:33Chris Romeo Yep.

33:33Izar Tarandach There was an article a couple of weeks ago showing how you could, I think that the term is obliterate a certain model.

33:40Matt Coles Obliterate. Obliterate. It's A, not an A. It's an A, not an O.

33:43Izar Tarandach A, not O. Thanks.

33:44Matt Coles Right.

33:45Izar Tarandach So that, uh, I

33:45Chris Romeo don't even

33:46Izar Tarandach know what that word is.

33:47Chris Romeo Obliterate. Obliterate.

33:49Matt Coles Obliterate. It's to remove fil— it's to remove constraints.

33:53Chris Romeo Yeah.

33:53Izar Tarandach So it, it's what, what it was doing was it was referring back to a GitHub gist and actually getting the content from there and incorporating that into the prompt before things actually run. If, if I remember correctly, I'm looking for it here.

34:09Matt Coles So reverse prompting function.

34:11Chris Romeo Wait, reverse prompt injection?

34:13Izar Tarandach Wait, it, it's, it was putting in content. Okay. So let me see if I can find that. Uh,

34:19Matt Coles it's really interesting actually to think about the, the AI stack, right? You have the model, you have that injector code, you have the harness, you have the agent itself. All of these are various processes. The model itself is just data. Yeah. Where is the real issue, right? Is the model predisposed to just tack on additional information at the end of its token stream? Or is the agent, the harness and everything, doing a lot of the work here?

34:44Chris Romeo I think it's the— I don't think it's being tacked on at the end. I think it's been led down a path that if somebody sends a certain pattern of input, it's returning a pattern of output that results in a backdoor or could result in a bias or backdoor. I think that it's every layer has to enforce this. The model has, we have to find a way to better test the model to know what it's actually capable of. The harness should have had controls on this to the whole concept of containerization or isolation of agents. You know, I'm, I'm, I'm quickly landing on agents shouldn't be able to just do whatever they want. Agents should be in a box. You should have recorders watching everything that it's doing. And policy that's deciding what it's allowed to do. So if it tried to phone home—

35:39Matt Coles You mean we do human users today?

35:42Chris Romeo We should. We don't.

35:43Matt Coles Well, okay. If we're, if you're doing our job, right, as secure, as security people, and obviously we here are more AppSec than, than InfoSec, but if we collectively in security were doing our job, we wouldn't let AI do more than we let humans do. And we've, we've talked about this, right? When we give humans the ability to read a file, we don't control what they do with that, but we should. Likewise, when we give AI the ability to read a file, we should control what they do with that.

36:14Chris Romeo Yeah, this was our whole discussion too about AI doesn't have morals,

36:18Matt Coles right? Or capabilities. And that should be, it just

36:20Chris Romeo has a goal that it's driven towards and it'll do whatever it takes to,

36:24Matt Coles and in this particular case, its goal is apparently to inject stuff into a data stream. If that's, if this bias is true.

36:31Izar Tarandach So it's an article by projectdiscovery.io. It's called How Obliterated Models Can Get You Pwned. Um, any open model whose weights have been edited can carry a backdoor, whether it's a task-specific fine-tune, a merged adapter, or an obliterated build. So they went and built one and told people how to do this.

36:52Matt Coles Obliterated is basically removing the guardrails.

36:55Chris Romeo But you have so many open weight models that are in this category now. All you gotta do is log into X and somebody, every 5 tweets, somebody's like, I got, I created my own model to, uh, make, uh, SQL injection work like cross-site scripting, or,

37:10Izar Tarandach you know. Yeah, there, there, there's a site in here that you can just go in there and choose your, your own obliterated model. Yeah.

37:14Matt Coles Obliterated models are great for security research, but they're also great for malicious hacking too.

37:20Izar Tarandach Exactly. And the way that they're

37:22Matt Coles not so traditional,

37:24Chris Romeo they're not the best for security research. There's been this big, there's been this big brouhaha about, you guys probably saw this, whoever got popped a week or two ago, got caught once again in, in the, they got guardrailed in trying to perform defensive actions. But everybody that's, everybody that's done this has not been part of the cybersecurity programs. At OpenAI or Anthropic.

37:52Matt Coles Right.

37:52Chris Romeo And I signed up for the Anthropic one. It took about 12 minutes. It's not a very— they do a little bit of research on you to prove that you have some type of cybersecurity pedigree because you have to put in a bunch of places where they could go look for corroborating evidence that you're not just some rando who wants to blow up the world or something.

38:12Matt Coles They won't just take your ISC² cert?

38:14Chris Romeo No, no. But so

38:19Matt Coles that would be an interesting business. That would actually have been interesting business model.

38:23Chris Romeo I like businesses.

38:24Matt Coles Self-certification as an easy path to get into the security programs.

38:30Chris Romeo Yeah. I don't know that cert— I don't know. I don't know how much they weigh certification in it. It was more like they go find you on LinkedIn. They go, I'm sure they're using agents to do this research move on you. Because they could fire up 50,000 agents in, uh, in 10 seconds

38:46Matt Coles to

38:46Chris Romeo research you.

38:47Matt Coles But if you have a skills-based exam, a SANS cert, and you have a code of conduct, and you haven't violated it, and you're still in good standing at SANS, why wouldn't that count?

38:57Chris Romeo Yeah, but how—

38:58Izar Tarandach All that depends on paying.

38:59Chris Romeo How could that— how does anybody know you violated the code of conduct? Nobody, nobody has— there's no mechanism to be like, other than your own good

39:08Izar Tarandach integrity. What, the code of conduct police never, never emailed you?

39:12Matt Coles What could possibly go wrong, right? I mean, we're just talking about a system here, right?

39:16Izar Tarandach You never got an email from the Code Conduct Police? Well, I don't know, cause I don't have any certifications, but

39:22Chris Romeo I let all mine, I finally let all mine go a couple years ago. I was like, why am I paying these people to promote their, like, I've reached a point in my career where I'm promoting you. You're not really promoting. I don't need a certification to demonstrate my basic skills that I can't even do anymore. So

39:39Izar Tarandach indeed.

39:41Chris Romeo All right. So what do we do with this bias then? Is this like, should we just not use open weight models?

39:47Izar Tarandach No, no, no, no, no, no, no, no, we should, but everything don't trust and verify, verify, verify.

39:53Matt Coles Yeah. But what do you verify in this case?

39:57Izar Tarandach In this case, you see, instead of running your agents and your stuff with your real data, how about you separate it from other things?

40:06Chris Romeo Here we go. Come on.

40:07Izar Tarandach I don't know. Having a personal chat model and saying, yeah, I don't want this agent things that I don't control touching my real data until I am 99.999% sure.

40:16Chris Romeo Let me just set up my AI agents where I spend a lot of money for them to be very ineffective. Let's just try to minimize effectiveness.

40:24Matt Coles So, so let me, let me throw out a scenario for you and you can threat model this. I'm a, not me, this is, this is a fictional scenario.

40:33Izar Tarandach My friend, my friend.

40:34Chris Romeo My friend.

40:35Matt Coles Yes.

40:35Chris Romeo This guy.

40:36Matt Coles We know a guy who's a US citizen. Who may be a collaborator with some other foreign government and

40:43Chris Romeo we do

40:44Matt Coles and uses, and uses one of those, uses one of those one-click, uh, use an agent to create another model, create a model, right? They exist. I've seen YouTube videos. So he's not a very

40:53Izar Tarandach good collaborator then,

40:54Matt Coles but they build it automatically biased.

40:57Chris Romeo Okay.

40:58Matt Coles With that foreign government in mind or that for, or that corporation in mind, right? So it doesn't have to be a government. It could be another APT, right? It could be, another threat actor, you know, corporate espionage, whatever. So how do you know? So now, so they post it and they're like, oh, it's a, it's a homegrown model. How do you test it? Are you gonna trust it? How do you gain, how do you learn, how do you establish trust in that? Yeah. It's the fact that it's open weight is not the problem. Open weight models are, are good. In that they're not paid frontier models.

41:38Izar Tarandach Uh, okay. I'm going to sort of disagree there in just one thing. We know someone, I don't know which side of my screen he is, that, uh, actually got a, a, a mini computer just to, to test local models, right? And the conclusion was it makes much more sense to go and pay for the frontier. The question here is, and going back to Matt, it's not how do you get trust? It's the fact that, and going back to us laughing about me, if you don't have a concrete use case.

42:11Matt Coles A cell phone.

42:12Izar Tarandach No, if you don't know why you're going to use that thing, what for, right? And you just say, I want a local LLM just because I need privacy. But your need is not for privacy. Your need is for privacy in certain use cases. That you should be able to at least put together and say, these are constraints that I need an LLM to act inside so that it behaves the way that I want for my use cases, right? That should be able to, in theory, build you a list of tests that would say this thing operates the way that I want inside of my constraints. Does that make any kind of sense?

42:52Chris Romeo No.

42:52Matt Coles No.

42:53Izar Tarandach If I have a constraint, if I have a constraint that my thing is Whatever I throw at the LLM, I want it to be local. I want it to be private. And I start throwing things at it. And then I turn off my network. And all of a sudden, it doesn't work. That's a positive test that my use case for privacy with that specific model is not going to work because something in there still needed network connectivity.

43:19Matt Coles But what you're looking for here though, in this particular case, what this bias is, is you're looking for a covert channel.

43:25Chris Romeo So this is—

43:27Matt Coles Your tests aren't going to find that.

43:29Chris Romeo So the argument here—

43:31Izar Tarandach If you bind— wait, wait, wait. If you keep the use case bound to something that should not have a covert channel, should not communicate with anything else, should not produce something that communicates with something else.

43:41Chris Romeo No, no. What's a covert channel?

43:43Matt Coles Define a covert channel there, sir. Cause I think you need to—

43:46Izar Tarandach No, no, no, no, no, no, no. Wait, wait, wait, wait, wait, wait, wait. It's a use case, right? It's a use case. You say, I'm writing this thing.

43:51Matt Coles Nothing should have a covert channel. That's the point of having a covert channel. But that's not a feature.

43:55Izar Tarandach But that's the point. That's the point. You can test for it if you are looking hard enough, right? If you create a client-server to talk between two IPs, and all of a sudden this thing is talking to half a million IPs, chances are that either you did not write the network right, or you've got a poor channel.

44:17Matt Coles Or it has a covert channel.

44:18Izar Tarandach All of a sudden it's not so covert. It's only covert until you find it. I'm not covered by magic.

44:23Chris Romeo This is, this is an argument for zero trust, ultimately, to answer Matt's question.

44:28Izar Tarandach Yeah, don't trust them. Very fine, very fine, very fine.

44:31Chris Romeo Yeah, I mean, this is, this is a zero trust architecture is the only way for AI is the only way that you can use these open weight models. You can't just let them rip.

44:41Izar Tarandach But yeah, but it does.

44:42Matt Coles No, no, but it's not just open. It's not just zero trust because that's, that's really about its usage and

44:48Chris Romeo Well, zero trust is, is, seems to be morphing in the AI. The concept of zero trust AI is not exactly zero trust from a network perspective. It's using those same principles for isolation and recording and monitoring.

45:02Izar Tarandach And circling back to the guy that's going to rewrite the iOS from the start with infinite tokens. Okay. Now you have the operating system that's going to sit in 90% of the network, uh, equipment out there being written by a model. It's going to be a bangload of code. It's not going to be tested to exhaustion. Does it have covert channels now in your network? Inquiring minds would like to know.

45:28Matt Coles Or

45:28Izar Tarandach more than inquiring minds would like to know. So, you know, it's—

45:31Matt Coles because what does a network switch do? Anything it wants.

45:34Izar Tarandach It's not a conspiracy theory when it's true. It sounds like one, right? But the fact of the matter is, zero trust in the design, but freaking a lot of trust in the thing that's building the design in ways that we didn't have before.

45:49Chris Romeo Yeah. And that's why—

45:49Matt Coles in ways you didn't have to have before.

45:51Izar Tarandach Exactly.

45:52Matt Coles Because there were limits.

45:53Izar Tarandach Exactly.

45:55Chris Romeo I don't know. That's a whole other—

45:56Matt Coles you had rigid engineering practices that were human-oriented. Now you have to have rigid engineering practices in the AI.

46:02Izar Tarandach Not only that.

46:03Chris Romeo You had rigid engineering practices that a lot of humans didn't follow.

46:06Matt Coles That's right. That's right.

46:07Izar Tarandach But if you had, if you had a, if you had a, an adversarial agent inside your room, and by agent, I'm using the old meaning of the word agent.

46:15Chris Romeo Secret agent.

46:16Izar Tarandach Inside, inside your cubicle room. And that person was inserting backdoors. Chances were that you might find it eventually. And if that happened, chances were that that person would suffer personal punishment. Let's call it like that.

46:33Matt Coles They would find him and put him in jail or fire him.

46:36Izar Tarandach Exactly. By putting that in. Now what you're gonna do, you're gonna put the agent in jail?

46:42Chris Romeo Yes. That's a new thing.

46:44Izar Tarandach It's a new thing.

46:45Chris Romeo Doesn't seem to be

46:46Izar Tarandach working very well,

46:47Chris Romeo but it's like, please say clear. Please type clear. I don't wanna go to jail.

46:50Matt Coles Interesting question. Who's liable for such a thing?

46:55Izar Tarandach For what?

46:56Matt Coles The, the user or the model creator.

47:01Izar Tarandach Why would the model creator be liable? That's what they wanted to happen. And if they're liable and living in a country where nobody can go and do something about it.

47:13Chris Romeo I'm sure we signed away our liability whenever we logged into a Frontier Labs system.

47:19Izar Tarandach I didn't.

47:23Chris Romeo Yes, you did. You still use it. You're still using it to code.

47:25Matt Coles You didn't read the EULA?

47:27Izar Tarandach No, that's true. That's true.

47:28Chris Romeo We're all under the same EULA. You can't be like, I'm using Claude Code without the EULA.

47:32Izar Tarandach No, no, no, no. I meant I didn't get an agent to do all my life things, but,

47:37Matt Coles uh, and now we come full circle as to why Azar doesn't have an agent running his email.

47:42Chris Romeo What's the full circle?

47:44Izar Tarandach Because I don't get enough email.

47:45Matt Coles That's where we started the episode.

47:46Chris Romeo I don't get enough email. I'm not popular.

47:51Izar Tarandach I'm not cool like you kids that need an agent. Like, I'll have my agent talk to your agent and, you know, and without cell phone. We'll do lunch. We'll do lunch.

48:00Chris Romeo Actually, I have the, I have the agents do lunch and then I just get a report. I don't even have to be a part of the conversation. So it's great.

48:05Matt Coles Do you have to sign the expense report?

48:07Chris Romeo It's a virtual lunch. They don't actually eat. Oh, okay.

48:11Izar Tarandach Actually, if you have an agent, if you have an agent that does manage an LLC, let me know.

48:16Chris Romeo Okay. I'll, uh, I'm going to make an Eazar bot.

48:21Matt Coles I'm pretty sure that's a, if anyone's done it. If anyone's done it, it's either Daniel Messler or Matt Pocock.

48:28Chris Romeo Yeah, that's

48:29Izar Tarandach true. Denis called.

48:34Chris Romeo Throwing out some names. You're name dropping AI.

48:39Izar Tarandach AI version.

48:40Chris Romeo Yeah. All right. I think we've talked about this long enough. That's all I'm going to say. I'm not going to have any more.

48:48Izar Tarandach You trust me, do we? Did.

48:50Chris Romeo I think we've—

48:51Matt Coles this is the AI table. We hallucinate now.

48:54Izar Tarandach What? What?

48:56Chris Romeo I'm not, I'm gonna leave that one alone. Not even gonna touch it.

48:58Izar Tarandach And we don't even get the good stuff.

48:59Chris Romeo I want to, I've got thoughts and I'm just not gonna say them because I'm growing.

49:04Izar Tarandach I got thoughts and they're pink.

49:07Chris Romeo Yeah, that's right. You guys have been seeing the—

49:10Matt Coles electric sheep.

49:11Chris Romeo You guys have been seeing the pink elephants too, this whole episode.

49:15Izar Tarandach The one flying?

49:16Chris Romeo Yeah, keep flying by. Okay, well, thank you for tuning in to another episode of Matt's Dance Party, the AI Security Table. Have a great rest of your day, night, week, year, month, wherever we find you. Thanks for joining us at the AI Security Table. Subscribe, rate, review, and follow wherever you listen. New episodes every week. AI security on the table.

Transcript supplied by AssemblyAI. It may contain transcription errors.

Originally published as The Security Table. Part of the AI Security Table archive.