The Human In The Loop Illusion: Why AI Approvals Are Failing Security
With Chris Romeo, Izar Tarandach, and Matt Coles
In this episode, a debate about hacker movies turns into a deeper conversation about AI, security, and the human-in-the-loop illusion. We explore how approval fatigue and AI-generated code can create a false sense of security and why fundamentals still matter.
Part of: AI agent security: agents, MCP, and prompt injection
About this episode
In this episode, a debate about hacker movies turns into a deeper conversation about AI, security, and the human-in-the-loop illusion. We explore how approval fatigue and AI-generated code can create a false sense of security and why fundamentals still matter.
🚀 Join the Conversation
Are we improving security, or just automating bad decisions faster?
Follow AI Security Table:
➜ Home: https://securitytable.ai/
➜ X: https://x.com/AISecurityTable
➜ LinkedIn: https://www.linkedin.com/company/ai-security-table/
➜ YouTube: https://www.youtube.com/@AISecurityTable
Transcript · 48 min conversation
0:09Chris Romeo Hey folks, welcome to another episode of the Security Table. This is Chris Romeo joined by Matt Coles and Isar Terrandas. And we were just discussing, debating what to talk about, and Isar made just a very untrue statement.
0:26Izar Tarandach So, hey, this is another opinion.
0:28Matt Coles This is an episode of Rock 'Em Sock 'Em Robots. Yeah.
0:31Chris Romeo Well, when it goes— when it comes to hacker movies, there is no opinion. It's just truth. So, Isar, you claim that Sneakers is not a hacker movie?
0:42Matt Coles Wait, say that louder. I don't think our listeners heard that.
0:45Izar Tarandach Sneakers, hacker movie, not.
0:48Chris Romeo Okay, you can reach Isar at isar_tarendas at gmail.com for all of your, you know, emails you want to send him about how wrong That is. So what, okay, so what makes a hacker movie?
1:04Izar Tarandach Well, I can't tell you what makes, makes Sneakers not a hacker movie.
1:07Chris Romeo I know, I want to know why. No, no, no, no, no, no, no. That's not how requirements work.
1:12Matt Coles We have to start with, are we, are we, are we, are we doing the UFO interviews? Is that what we're doing? We're playing Spectre and Velma to hackers.
1:19Izar Tarandach We'll find a way to get to the serious part later. What makes a hacker movie? How many black screens with, uh, uh, uh, green text do you have in sneakers?
1:34Chris Romeo That's, that's not a requirement.
1:36Matt Coles How many Unix prompts do they have? Excuse me. Excuse me.
1:38Chris Romeo I need a requirement. So all that, so that means Matrix, The Matrix is the only movie that applies to your criteria.
1:48Izar Tarandach No, Hackers also has it.
1:49Matt Coles Hackers. Jurassic Park. Swordfish.
1:53Chris Romeo So Jurassic Park is a hacker movie now, according to this requirement set.
2:01Izar Tarandach Well, it does have an SGI box and they do declare that it runs Unix and that they know it.
2:09Matt Coles So, and, and, and because they know Unix, they automatically know the password.
2:16Izar Tarandach And so, plus it has very simple, it has a very, a very, uh, uh, big monster slobbering with non-functional typing short arms. So management is represented as well.
2:36Matt Coles So, uh, so it is a hacker, hacker movie too.
2:39Chris Romeo Yeah. That was bizarre. Under [email protected].
2:43Izar Tarandach If a velo, velo, there is There's no way in my life that I'm going to say that word right. Velociraptor.
2:53Matt Coles Velociraptor.
2:53Chris Romeo Velociraptor.
2:54Izar Tarandach Yeah. If they do, you hacked.
2:57Matt Coles Yeah. What's your first rebuttal?
3:01Chris Romeo I guess we'll just have to agree to disagree first of all on whether Sneaker—
3:05Matt Coles I mean, Sneaker is absolutely a hacker movie.
3:08Chris Romeo I think so. I mean, 'cause they're, they're doing physical security, they're breaking stuff.
3:15Izar Tarandach I watch it only for Madam President, but my last line is, if your basic premise is that there is some magic black box that decrypts everything, no, you're not accurate.
3:28Matt Coles You know, you know, you know about the Clipper chip, right?
3:31Izar Tarandach The Clipper chip. I, I, not only I know, I know how it didn't work and I know how specific it was. So yeah, I know. And, uh, my premise stands if you start with a deus ex machina that, uh, Solves everything.
3:46Matt Coles Okay. So the Clipper, the, no, sorry. The, the hack. Nah, now you got me into it. Sneakers.
3:51Chris Romeo He's flustered.
3:52Matt Coles Sneakers had, maybe what Sneakers had unbeknownst, you know, unbeknownst to the audience was a quantum computer.
4:04Izar Tarandach Even then.
4:05Matt Coles And it could decode, it could decode all of that, all that stored ciphertext that the NSA has been ciphering, siphoning off the internet for the past—
4:15Izar Tarandach Claims of decoding everything from what I, from the little I understand of quantum computing are also very exaggerated. So, ah, you know, really? Let's just say that. Yeah. Well, I mean, let's just say that we'll survive.
4:27Chris Romeo If you have the ability to potentially decrypt anything that wasn't a quantum safe algorithm, could you decrypt the entirety of the internet? I think that's Isar's point here is like, you couldn't just say, well, I'm making the internet unencrypted now, all traffic. I have enough capacity to generate unencrypted versions of all traffic that crosses the internet. Like, true.
4:51Matt Coles But my point is cracking keys, cracking keys, session keys is, is no longer theoretical, right? That, that can happen.
4:58Izar Tarandach But again, my limited understanding of quantum computing, aren't we talking here only about keys that depend on primes and that kind of stuff. We are not talking about any single key.
5:10Matt Coles So AES keys, we believe, are safe from quantum computing, but the RSA or Diffie-Hellman exchanges or the EC, ECC keys, EC keys, elliptic curve keys that are used to transfer symmetric keys are vulnerable.
5:27Izar Tarandach Yeah. Which, which power a lot of the crypto. I'm not going to, to minimize it at all.
5:32Matt Coles Powerful open crypto. AKA, it's how TLS works.
5:36Izar Tarandach But no, but to go from here to, hey—
5:38Matt Coles If you have the AES key, you can do the decryption because the AES key is a single symmetric key, right?
5:43Izar Tarandach To go from here to, hey, there's an encrypted blob, go decrypt it, go quantum, go quantum.
5:50Matt Coles No.
5:51Izar Tarandach No, sure.
5:53Matt Coles Sure, you're right. You need the key exchange in order to do the decryption.
5:57Izar Tarandach You need a bunch of things to align correctly before you get the—
6:01Chris Romeo And maybe a little bit of imagination would help. So wait, if we put AI and quantum together and we mix in a little bit of blockchain, you're gonna get random garbage, I'm sure, but just random garbage.
6:20Izar Tarandach Plus, plus my last point, my last point, when you have to use the name of a, a chocolate bar to name your movie. It's not a hacker movie.
6:28Matt Coles Sneakers, not Snickers. It's called Sneakers cuz they run places.
6:35Izar Tarandach Hey, coming from me, it sounds all the same. True.
6:39Matt Coles It's where, if it, if it wasn't a hacker movie, then where would Sneakernet have come from? I mean, come on.
6:44Chris Romeo Look at the roster of this movie.
6:49Matt Coles You got Robert Redford, not a single programmer among it.
6:53Chris Romeo Dan, Dan Aykroyd's always been a nerd.
6:55Izar Tarandach Come on.
6:55Matt Coles He was a Ghostbuster. Yeah, but telling me he was also in Spice Like Us, if I remember correctly.
7:03Chris Romeo Yeah, he was. Good, good, good '80s movie pull. All right, well, we'll just have to agree to disagree that there are no hacker movies, apparently, according to Isar and his criteria.
7:16Izar Tarandach There, there, there are, there are, just Sneakers is not one of them.
7:19Chris Romeo But you, but you listed Hackers where their, their claim to fame is they wear helmets and rollerblades.
7:26Izar Tarandach Hack all the things, man. Hack all the things.
7:28Matt Coles Hack the planet.
7:29Izar Tarandach Hack the planet. Hack the planet.
7:32Chris Romeo Gotta get the tagline right.
7:33Izar Tarandach Plus Angelina Jolie. That makes it a hacker movie.
7:40Matt Coles All right. Swordfish. Was Swordfish a hacker movie?
7:44Izar Tarandach Ooh, that's a That's a hard one.
7:53Chris Romeo It's because you can't remember it.
7:56Matt Coles Because it was—
7:58Izar Tarandach no, because I'm trying to remember it, but all I can see is John Travolta in Pulp Fiction.
8:03Chris Romeo Yeah, that's true. Now, Pulp Fiction, that's a hacker movie.
8:08Matt Coles That's a, that's a, that's a hack, uh, slash.
8:11Chris Romeo I mean, it ran in reverse. It just seems like that's a post-hacking move.
8:19Matt Coles But, uh, that's when hacking goes kinetic.
8:23Izar Tarandach Oh, Johnny Mnemonic.
8:27Chris Romeo Keanu Reeves.
8:27Matt Coles Mm-hmm.
8:29Izar Tarandach That's a good one. A Scanner Darkly. That's a good one.
8:33Matt Coles What about a lawnmower man?
8:39Izar Tarandach It's right there with the one of the guy with the pointy things. What's the one?
8:45Chris Romeo Uh, wasn't that like a VR?
8:47Matt Coles It was long ago. It was a VR movie.
8:48Izar Tarandach Yeah.
8:48Chris Romeo It wasn't a hacker movie. VR was getting you or something.
8:51Matt Coles Yeah. It wasn't a hacker movie. It was a VR movie.
8:54Izar Tarandach But yeah. The 13th Floor.
9:00Matt Coles 13th Floor. No, not the 13th Warrior. That's a different movie.
9:02Izar Tarandach No, no, no. That's a totally different thing. Totally different thing.
9:05Chris Romeo They haven't yet made an AI hacking movie, but there's gotta be one coming.
9:09Matt Coles Wait, a movie about AI hackers or a movie about hacking AI?
9:14Chris Romeo I don't know. One of those combinations.
9:17Izar Tarandach Well, there's, there's, there's Matrix. Yeah, of course.
9:20Matt Coles Which was AI.
9:21Chris Romeo Yeah. But that's before AI took on the shape that it has now. That was kind of, that was a lot more science fiction. Wait, so that's more than a real thing now. There's a real thing to back it up. You're gonna go watch AI movie with Chris Pratt where he's the police officer. And he's in Los Angeles.
9:43Matt Coles Is that Timecop?
9:45Chris Romeo No, no, no. No, it's actually pretty good because like the criminal justice system of the future is completely AI driven and he's a cop and he wakes up and finds out he's committed a crime and he's got 90 minutes to use the AI to try to prove his innocence.
10:00Matt Coles Is that a, is that Minority Report?
10:03Chris Romeo No, it's a new movie. It just came out.
10:05Matt Coles Oh, okay.
10:05Chris Romeo 2026.
10:06Matt Coles Yeah, it was, but yeah, it was, but it's, oh, well then actually what about Blade Runner? Was Blade Runner a hacker movie? Wow.
10:13Chris Romeo Ooh. Ooh.
10:15Izar Tarandach That's a, ooh.
10:21Chris Romeo I think we're with Blackfish Corps. It's a revolution movie. Like they're trying to, like the robots are trying to rise. That doesn't make it an AI or a hacker movie though. Mm-hmm. Because they weren't really trying to, they weren't really compromising anything. They were just trying to revolt and and stand up for themselves.
10:39Izar Tarandach Independence Day. Is that a hacker movie? Yeah. Oh yeah.
10:47Chris Romeo There was a sequence in Independence Day.
10:49Matt Coles They used hacking techniques, but they, they're not exactly a hacker movie. That wasn't the core of the issue. The core of the issue was human survival.
10:56Izar Tarandach Wait, wait, wait. How, how, how did they win the war? Yeah.
11:00Chris Romeo They sent the virus into the, they sent the virus, the mothership.
11:03Izar Tarandach They not only sent the virus, it was live coding the virus in the mothership. And I have long ago reached the conclusion that the only way that that storyline was plausible was if the aliens were running Linux.
11:27Chris Romeo I have a feeling like aliens—
11:28Matt Coles No, the aliens would have to have been running mainframe. So that all the little ships were terminals.
11:34Izar Tarandach No, you're looking—
11:35Chris Romeo No, I think it was BSD.
11:37Izar Tarandach No, you're looking for something that has enough reach, that is compatible humans and aliens, basically can run on anything.
11:48Matt Coles Yeah, but why would it run?
11:49Izar Tarandach I mean, it could be Doom. It could be Doom.
11:51Matt Coles Why wouldn't the little thing, why wouldn't the little ships be autonomous from the big ship? Why would it? And by the way, they use the same approach in the Avengers. The first Avengers movie, remember they got the mothership and all the things died? What's up with this command and control system?
12:09Chris Romeo We've really taken a turn because now we're designing alien spaceship systems and searching for vulnerabilities.
12:19Izar Tarandach He's got a good point here because some people, it's like, hub and spoke like that would like immediately jam up. Unless to, to go back to you using one of the fancy quantum communication things where everything is entangled and, and you can't jam that thing.
12:37Matt Coles But, uh, hey, it wasn't, it wasn't just that they were like not getting their communications. As soon as you killed the mothership, everything died.
12:47Chris Romeo That seems like a really bad design, doesn't it? Like, that's like token ring networking. Where there's a break in the ring and everything goes off the network, I guess.
12:57Izar Tarandach Yeah, and the bytes spew all over the floor. It's horrible. You gotta get two boxes, put the zeros in one, the ones in another. Horrible.
13:05Chris Romeo But that doesn't seem very resilient to have this kind of failure.
13:09Izar Tarandach Because somebody's always getting the token ring and trying to run to Mordor.
13:14Matt Coles You've all used token ring, you know. If you know, you know.
13:17Izar Tarandach Oh yeah, if you know, you know.
13:18Chris Romeo If you know, you know, but most people have no idea what we're talking about at this point.
13:23Matt Coles FDDI anyone?
13:25Izar Tarandach Novell. Novell with vampire connectors.
13:34Chris Romeo Come on, Novell was some of the most performant networking software.
13:39Matt Coles Because it was the only networking software for a while.
13:42Izar Tarandach Yeah.
13:43Chris Romeo You had OS/2.
13:49Matt Coles Yes, yes you did, but why?
13:50Chris Romeo I remember trying to run OS/2 once, thinking like, I'm going to be the cool kid, the only person I know that runs OS/2. That experiment lasted about 18 hours before my kids saw us.
14:04Izar Tarandach The name of the thing was OS, but then they found the other person who also runs it and said, do you run OS/2? And then it stopped.
14:12Matt Coles No, hold on. But wasn't it spelled OS/2? So really what they found was half an operating system?
14:23Chris Romeo Ooh. That's a great one. Wow, this is like stand-up night on this security table.
14:30Izar Tarandach The thing is that it never got upgraded because they didn't want to lose all the printed material for OS/2 to go to OS/3.
14:39Matt Coles I mean, running those line printers was expensive, right?
14:49Chris Romeo Yeah. Come on, you can still hear the sound of it.
14:51Matt Coles I can and feel the vibration.
14:54Chris Romeo I can, I can still hear it. Once again, for those people born after the year 2000, you have no idea what we're talking about.
15:05Matt Coles All right, so here's the question. Can we put together, can we have AI use, uh, between like Nano Banana and VO to create, recreate the '70s and '80s computing technology.
15:20Izar Tarandach But no, wait, it's even worse. I don't know if he was doing the sound of a printer or a modem.
15:26Matt Coles It could be both.
15:27Izar Tarandach It could be both.
15:28Matt Coles It could be both.
15:31Izar Tarandach But yeah, we could use to—
15:32Chris Romeo Oh my. Yeah. 9600 8N1.
15:40Matt Coles Yeah. When you had to type in those parameters exactly, or else, or else, you know.
15:48Izar Tarandach So what was it that we wanted to actually talk about today?
15:52Matt Coles You started this mess.
15:54Chris Romeo Oh, actually I didn't.
15:56Matt Coles Yes, you did. You said Sneakers was not a hacker movie.
15:58Chris Romeo That's true.
15:58Matt Coles And that caused mayhem.
15:59Izar Tarandach And I stand for and by it.
16:03Chris Romeo Well, uh, folks, I just want to announce that we're interviewing for a new host on the Security Table.
16:08Matt Coles We've got an opening. Must think Snacky Sneakers is a hacker movie.
16:12Izar Tarandach Yeah, apparently we have two candidates, right?
16:17Chris Romeo Uh, yes, must, uh, appreciate solid hacker movies and, uh, agree with Chris. That's your, that's your criteria. Now there's a—
16:28Izar Tarandach we have—
16:29Chris Romeo we've got one article we can just, just talk about for a minute or two. Uh, Chris Hughes wrote this article, The Human in the Loop Illusion. Something that we've talked about this a couple of times. Matt, with some hand signals for those watching on YouTube. Is that jazz hands that you just did or what was that? No, I think it was the raining.
16:51Izar Tarandach It was the raining.
16:53Chris Romeo That was rain. That was chocolate rain. No, that was a— it was a rain or something. All right. So if I look at the executive summary, this Chris states human in the loop is not a real security control. Anthropic's own data shows users approved 93% of AI agent permission prompts, with experienced users auto-approving 40+% of sessions. Approvals are rubber stamps, not meaningful reviews.
17:21Matt Coles This is the whole human behavior of, uh, what is it, um, prompt overload or, uh, prompt fatigue.
17:29Chris Romeo Prompt fatigue, yeah, which is a UX construct, right?
17:32Matt Coles It is. It goes to that psychological acceptability portion of, uh, of secure design. Make it easy and informative as opposed to what becomes a rote activity. I click, I click there, I must, therefore I click.
17:53Izar Tarandach That's great. I actually created the new, uh, job description, right? The chief officer of pressing enter when the agent asks me to. Like you can stand the whole startup just doing that.
18:13Matt Coles In fact, that would be a robotics company.
18:16Izar Tarandach Yeah. No, no, you just get, what's the name of that bird? That wooden bird?
18:21Chris Romeo I know what you're talking about.
18:24Matt Coles Or what is it? That rain thing where it goes, dum dum, and like drains water, you know?
18:31Izar Tarandach Yeah, yeah.
18:32Matt Coles The Japanese one.
18:33Izar Tarandach Or you just grab like a toothpick, break it in half, press the key, stick the toothpick in there and just hold Enter down.
18:41Matt Coles Well, if you're going to do that, you might as well find the, you know, get the pin that does it and just, they have a hacking cable for that, I see.
18:48Izar Tarandach No, I know. Let's write a daemon. Let's write a daemon that clicks Enter. If nobody remembers how to write the daemon, you can just bytecode it.
18:56Matt Coles What is it? Uh, 10 lines of assembly code or something?
19:00Izar Tarandach No, no, just don't forget to press enter.
19:02Chris Romeo But 10 lines of Python. Come on.
19:05Matt Coles Actually, it's probably even less than PowerShell these days. Yeah. Just have to intercept the signal. Right.
19:10Chris Romeo So the other things that, that, uh, Chris is talking about here. So Anthropic created some auto mode. Which replaces per-action human approvals with an AI-based two-layer classifier that scans inputs for prompt injection and evaluates each action before execution. What he's saying is that Auto Mode has real gaps, 17% miss rate on genuinely dangerous actions, and it won't catch supply chain attacks, which makes sense.
19:41Matt Coles Yeah, 'cause it's, I mean, so model-based classifier, right? That's trying to make a decision, right? It's basically saying, is it in Or is it out? And supply chain attack, of course, makes it look like it's in because it, you can't tell it's out.
19:57Izar Tarandach The, the decision point happens somewhere else.
20:00Matt Coles It's not necessarily that, I mean, supply chain attacks, things like typosquatting, it looks the same. Or, uh, it has the same name, a similar name, or it's a newer version of the same thing, but it's actually been hacked. Right.
20:14Izar Tarandach Right.
20:15Matt Coles So, so depending on how it's doing the detection, unless it's doing deep analysis and I, by deep analysis, like not just analyzing the package, but also analyzing what happened upstream. Right. Then how does it know?
20:31Izar Tarandach But if even that case, then it would be going upstream. We had this discussion before, where do you stop threat modeling? Right. You go upstream to where? To the compiler, but the, the, or the project.
20:45Matt Coles I mean, you look at the project history and see, you know, was there any strange, was there any strange commits, right?
20:53Izar Tarandach But it's important to, like, Chris pointed out that this is a user experience pattern. And it's important to point out that even in security, this was already an existing problem with people having PR fatigue. For a long time. So I would go and question, okay, so you tell me that you are doing code reviews. Cool. How do your code reviews happen? Oh, we look at every PR. Okay. Who looks at every PR? Oh, we have the one senior engineer that looks at every PR. Every PR?
21:26Matt Coles One engineer? Does he work 24/7, 365?
21:30Izar Tarandach Not only that, but You know that there's a lot of places that don't actually have any kind of guidelines and standards for PRs, and you end up with this one PR with 30 files in it. Every file is 300 lines changed. You want to tell me that one person can hold all that freaking word context in their head?
21:53Chris Romeo We used to have a name for that in the old days. It was called a release.
21:58Izar Tarandach Only if it happens on Fridays.
22:01Chris Romeo Yes.
22:02Matt Coles Yes. 4 o'clock on Fridays.
22:03Izar Tarandach Yeah, but, uh, no, the, the rubber, rubber stamping is, is real. And now the rubber stamping is becoming AI rubber stamping. So the AI is checking the AI with an AI classifier. That's an AI thing that happens on an AI other thing.
22:20Chris Romeo I mean, as long as you use a different AI from the one that created the code, you should be fine, right?
22:25Matt Coles Well, actually, you shouldn't even be using AI. You should be using machine learning.
22:31Chris Romeo Wait, what do you mean?
22:32Izar Tarandach Which you are if it's a classifier.
22:34Matt Coles Right. AI and ML are different slightly, right?
22:39Izar Tarandach One comes from the other, but they are not the same.
22:41Matt Coles They're not the same.
22:42Izar Tarandach That's right. But the thing is that even if it's ML, right? ML is not perfect.
22:50Matt Coles No, it's not perfect. It's trained. It's a trained model, right?
22:53Izar Tarandach Right.
22:54Matt Coles It's all models are wrong. Some are useful.
22:58Izar Tarandach Oh my God. Fox must be like spinning so fast, so fast. But the thing is, it's not that I'm claiming that, uh, it's perfect because we know that it isn't. My problem is that when you, when you bring together the fatigue that Chris points at and both Chris's, the author and our Chris, and, and, uh, the fact that people are developing this expectation, at least at some levels, are developing this expectation that, yeah, the model's gonna take care of it. And it's not a rational expectation because we all know that it fails. But many of us have seen so many cases where it doesn't fail that it's creating this expectation that it's going to continue not failing.
23:48Matt Coles It's 'cause you set the constitution file or the agent file and that, that takes care of it, right?
23:56Izar Tarandach Right. You just have to write, uh, make no mistakes.
24:01Matt Coles Do what I would do.
24:04Izar Tarandach Make no mistakes. You are now a 30-year experienced, uh, uh, senior developer. Make no mistakes. And you walk away, right? You just put the toothpick in the enter and you walk away.
24:16Matt Coles Yeah. It must be, it must be perfect, right?
24:18Chris Romeo That seems like a recipe for disaster.
24:22Izar Tarandach Yeah, but I think that we know that is a recipe for disaster. I don't think that we know that we are seeing the disaster for what it's going to be. I think that we are very, very busy right now acting like doomsayers and nobody has started yet saying, I'm a naysayer, so AI up to here. We don't have yet any revolutionary movement saying, uh, the dites of the world, uh, uh, come together and, and stop the AI before it goes somewhere.
25:00Chris Romeo Wait, do you think that's coming?
25:02Matt Coles Oh yeah, for sure. I think it is actually.
25:04Chris Romeo Do you think there's a lot of movement of stop the AI, like we're not using AI anymore?
25:09Matt Coles Yeah, this, this is, this is a thing. I mean, I've, there have been articles, I have seen them on various places that actually, so Gen Zers of all place, of all people are preferring analog things, at least on their downtime to AI and which I'm all for.
25:30Chris Romeo And I'm not changing. What is an analog thing? Like a record player?
25:34Izar Tarandach Like a book in their hand.
25:36Matt Coles Like a book under a tree.
25:37Chris Romeo Some of my children have, I've seen that that trend. I'm like, don't you have a Kindle? She's like, I like books better. And I'm like, I have a Kindle because when I travel I want to have 4,000 books from my library with me. Exactly. I'm a nerd like you guys are. And so, yeah, there is something nice about a paper book.
26:02Izar Tarandach The smell.
26:03Matt Coles Yep.
26:04Chris Romeo And just the, the feel, sound of the page turn. And there is something tactile about it.
26:09Matt Coles Scrambling for your bookmark when you've Misplace it.
26:12Chris Romeo That's true.
26:14Izar Tarandach The fact that there is nothing in any corner that is blinking and asking for my attention when I'm trying to read.
26:22Chris Romeo Yeah. Maybe I should go back to old OG books.
26:27Matt Coles You know, I still, I still take notes on, on paper with a pen.
26:32Chris Romeo What is, what is paper?
26:35Izar Tarandach I do, but I do, but I have a problem. I can't read them afterwards.
26:39Matt Coles Well, the, I have a problem. I have stacks of them.
26:41Chris Romeo The research shows though that it's not the, a readability of it that locks it into your brain. It's the fact that you wrote it down in the moment, right?
26:52Matt Coles The physical, the mental and the physical combined.
26:55Izar Tarandach No, no, no, no. Then you have what Matt says, you have the mental thing where you go, I know that I wrote it, but where is it?
27:02Matt Coles Is it in the stack?
27:03Chris Romeo Is it recorded into your Long-term RAM. Or ROM.
27:10Izar Tarandach What was it that I saw?
27:11Matt Coles I should put in my yellow wiki, is that what you're saying? Yeah.
27:14Izar Tarandach So my son has taken an interest in neuroscience and that means that whatever newsfeed I ever had now has a big dose of neuroscience in it because as one does.
27:27Matt Coles Psychology Today.
27:27Izar Tarandach You get interested in that thing too. Psychology Today, man, that thing is Okay.
27:32Chris Romeo Don't, don't get me there.
27:34Izar Tarandach Anyway, so I saw this one of a neuroscientist saying that one trick, one trick that doctors use, right? It's going to surprise you. It's that they read things and they close their right eye when they have like a list of things that they have to remember because then it like goes to the other side of the brain, blah, blah, blah, blah, imprint, blah, blah, blah. And that, that was great until I had my first work meeting where people say, okay, we have to do these 3 things.
28:07Matt Coles And I'm like, and he knocks, he bumps into the wall because he lost all of his spatial reasoning.
28:14Chris Romeo Exactly.
28:15Matt Coles I go, zero depth perception.
28:17Chris Romeo So I close my right eye and then it's gonna help me remember cuz it's going to the, cuz it goes to the right side of my brain, to the thought process as opposed to the emotional side.
28:25Matt Coles Right. So.
28:28Izar Tarandach The good thing about closing my right eye is that I don't see the people on that side of the room.
28:33Chris Romeo So I, you could also get an iPad. Just go with that.
28:37Matt Coles You could be a pirate. So we're gonna do a little computer thing. We're gonna unwind the stack topic back to Bob. We were talking about psychological acceptability in AI.
28:52Chris Romeo Okay.
28:53Matt Coles And we got sidetracked with how to do better memory and the smell of books. We'll unwind the stack. Little bit of computer training while we're at it here. If people remember the stack.
29:08Izar Tarandach It's not a hacker movie.
29:14Chris Romeo Okay. You rewound too far. Can you hit—
29:15Matt Coles Too far.
29:16Chris Romeo Push the forward button.
29:17Matt Coles Put something back on the stack.
29:18Izar Tarandach Oh yeah, okay, okay.
29:22Matt Coles Uh, where were we? Oh yeah, so, um, oh my God, where were we? We were talking about—
29:31Izar Tarandach you did them write down?
29:32Matt Coles I had a Stack Overflow is what I had.
29:36Chris Romeo Uh, psychological acceptability.
29:38Matt Coles Uh, yes, but something specifically that got us on that, on that tangent about— oh yeah, uh, the, the anti-AI So I have been, I think there are some who are looking at AI as job killers and that may be true in the same way. So I think I heard this recently, I forget who exactly said it, but you know, there, every industrial revolution resulted in loss or change. Right? Electricity, the wheel, the water wheel, not, not the wheel, but well, maybe the wheel, but the water wheel, right? Every steam engines, all these things cause transformation and AI is one of those transformations.
30:28Chris Romeo But have any of those transformations had the fear of putting people completely outta work?
30:35Izar Tarandach That's the one.
30:37Matt Coles Well, what do you mean completely? Like you'll have nothing else to do?
30:40Chris Romeo Yeah. I mean, if you, if you listen to Elon talk about this idea that like 10 years from now, no human beings on the planet are going to have to work. I bet it's an exaggeration, but you could see a path forward where I don't think, I think 10 years is a, is very aggressive to, to make it to Mars in 10 years. I mean, yeah, the AI driving the bus for me, you know, that I'm riding on. but I think is possible.
31:09Matt Coles And so, I mean, even, even Star Trek has people working and there's, there's not an infinite AI.
31:15Chris Romeo The AI doesn't do, the AI is a, is just works for them, right? No, no, wait, wait, wait, wait, wait. Answers commands. It doesn't ever appear to be, well, it runs the sh—
31:24Matt Coles it runs the ship. I mean, it flies the ship for them basically.
31:27Izar Tarandach Wait, do, do you remember, do you remember the original Star Trek that they had the, the, the machine? The almost 3D printer thing that could create anything and people would make food out of it and stuff.
31:37Matt Coles Replicators.
31:38Chris Romeo Replicators.
31:39Matt Coles They became replicators throughout the universe.
31:41Izar Tarandach That's an economy killer. And they completely glossed over the, the fact.
31:46Matt Coles But they also went to universal basic income effectively, because nobody has money in the start, in the Federation universe.
31:53Izar Tarandach No, they still, they still used something to bet on stuff. What was it? Didn't they have credits or stuff?
32:00Matt Coles They may have credits. Credits.
32:02Chris Romeo Yeah. Yeah. That sounds right. So they have cryptocurrency.
32:04Matt Coles They have cryptocurrency.
32:05Chris Romeo They had cryptocurrency. Yeah, but it's, it's, wow, my God.
32:07Izar Tarandach Basically it's money. Basically it's money. It's, I'll give you something, you give me something back.
32:11Chris Romeo Right. Uh, but coming back around to the AI Luddite movement, because that's, but wait, wait, I'm actually, I'm actually interested in this idea.
32:20Izar Tarandach So think of this, think of this industrial revolution. The mechanical loom. Okay. All those people who did that work manually before, they didn't get retrained to be technical loom technicians. They lost their jobs.
32:35Matt Coles Right.
32:36Izar Tarandach So for example, did you know that the word sabotage, do you know where it comes from?
32:41Chris Romeo No.
32:41Izar Tarandach So apparently during those times, uh, most workers would use those, uh, uh, Dutch, uh, uh, shoes that are made of wood. And they're called sabot and they would just stick them into the machinery to stop the machinery from working. I just learned that this, uh, this weekend. Yeah. Interesting.
33:00Chris Romeo Because they wanted to do it manually.
33:03Izar Tarandach They want, no, they wanted the machine to not work.
33:05Matt Coles Yeah.
33:06Izar Tarandach Because then you had to fall back into what used to be. But I think that the point I'm trying to make here is that people who say, oh, AI is going to kill some jobs, they immediately, some of them immediately follow with, uh, that's going to create different jobs.
33:22Chris Romeo And I, I, I certainly think it is.
33:25Matt Coles Yes, but not yes and no.
33:31Izar Tarandach Yes, but so the, the, the thing is, okay, we already have Roomba for, uh, for farmers, right? There's already stuff in there that you can put in your, in your garden and it's going to tend to it and, and things like that. And it even has some, I believe so.
33:46Chris Romeo Yeah.
33:47Izar Tarandach But we, you have lawn mowers, that's enough. It, it's a beginning to go in that sense.
33:51Chris Romeo I mean, tractors in the commercial farming world are almost completely autonomous right now, at least from the point that you got the whole John Deere problem. Right.
34:02Izar Tarandach So the, even things that we keep saying, oh, that these job and that job, they're safe because you, you always need somebody to actually go and do the work. Even those are, are somehow under, under attack. Let's call it like that.
34:16Chris Romeo Well, you need robotics though to be able to take out 60% of the jobs in the world.
34:24Izar Tarandach Mm-hmm.
34:24Chris Romeo Right. That are manual, that require, that aren't desk-driven, anything that's not desk-driven.
34:31Matt Coles And who maintains the robots?
34:34Chris Romeo Well, that's probably gonna be a new job.
34:36Izar Tarandach That's the thing. Or it's gonna be robots.
34:38Chris Romeo Or robots take care of the robots though.
34:41Izar Tarandach Or if a robot assembly line gets to the point where you don't have to maintain, you just have to recycle, then you just take them apart and you put them apart new. You put them together new, right? And I know, I know that I'm closing the loop here and going to the Matrix.
35:00Matt Coles It all roads lead back to the Matrix.
35:02Izar Tarandach I'm just going to go out there and say any computer trying to, to use my body energy to work, guys, that's the one to attack because that thing is gonna be weak.
35:13Matt Coles We, we, we, we did talk about, we did talk about how much energy the human body actually produces and it's a loss leader.
35:20Izar Tarandach Mine, mine, absolutely none. But, uh, when the resistance comes, tell them to point at that one, like the one with my number when they see it.
35:29Matt Coles But, uh, so again, let's talk about, let's talk about the fallibility of, of, of robotics here because You know, you have the, you have this command and control system for aliens that if you kill the command, everything dies. In The Matrix, when they seed the clouds and they made the Earth dark, why didn't the robots just put something up like a space elevator and now they had infinite solar energy? They had the technology.
35:57Izar Tarandach Because the model hadn't been trained for solutions.
36:01Chris Romeo Okay.
36:01Izar Tarandach No, no, no, no, no, no, no. It's always a training problem.
36:04Chris Romeo Stick with me here. Stick with me here.
36:07Izar Tarandach Okay. What we have today is a big problem. Sorry, let me walk that back. What AI has today is a big problem of creativity. And it's not about adjusting the temperature, right? It's about thinking about things that nobody has ever thought before.
36:20Matt Coles Right. People said invent.
36:23Izar Tarandach Yeah, no, no. People say that they are being able to invent. They are creating this amazing chemistry and biology things and whatnot. A given. I know nothing about that stuff, so I could be completely wrong in talking about my wrong end, but I don't think that it's actually creating. I think that it's bringing out things that have been figured out and published in papers all over, bringing them together, saying, oh, look at this thing together with this thing. They seem to be next to each other. Perhaps somebody should look at this thing and see if it does the other thing.
36:55Chris Romeo Or it's hallucinating.
36:56Matt Coles I was gonna say it's hallucination.
36:57Chris Romeo Hallucinating.
36:58Matt Coles Accidentally.
36:59Chris Romeo Inventing something, and if, or if you put these two things together, it actually kills people. It doesn't, doesn't help, but it tells you, oh, this will be a super cure.
37:08Izar Tarandach Which is interesting cuz there is a, a, a school of people actually addressing hallucination as machine creativity. Of course there is. Why not?
37:18Matt Coles But, uh, what's this, uh, make, uh, make lemonade out of lemons or what's this thing?
37:23Izar Tarandach But the, the, the, the point that I, that I think I was trying to make is that at some point it's, it's, it's okay. I don't know if I really want to say that at some point it's going to happen, but at some point it's going to simulate enough of human thought to come up with something that looks like invention. I'm not going to say it's going to come aware and perhaps yes, perhaps no, quantum, who knows. But, uh, uh, at, at some point it, it, it's going to simulate enough of a human to, to create that.
37:57Chris Romeo Isn't that AGI? Artificial General Intelligence?
38:02Izar Tarandach That's where I'm not— that's what I'm, that's what I'm trying not to say. Right. I think that, uh, the, the, the AGI problem is that the hard and, and soft AI thing, does it has to, does it have to behave like a human or does it need to be a human level thing. I don't know that, that, that's been a long time since I read any of that stuff. But, uh, I think that in the interest of the jobs, I think that at the point where machines can replicate machines, and I think that we are very close to that, if not there already, in a close enough way. And I'm not even talking about creating new machines or optimizing existing machines. But when they are able to, to recycle and create each other, I think that we are in a bit of a problem because again, even those, those jobs that we said are, are immune from AI are not going to be immune for, for too long, right? Because somebody will always look at the bottom line and say, oh, it makes sense to take the person away from there and put a machine that can replicate itself.
39:12Matt Coles Well, really the big question is what is work to humans? Meaning if you didn't have, if you don't have the opportunity to work, do you need to work? We've all been trained, we've all trained to work, right? We all have work ethic, right? That work is a good thing. But if you don't have to because you can't, like If it doesn't exist, do you need to?
39:43Izar Tarandach I think that that ties very nicely with hackers and security people because, well, that's the tribe that I know the closest, but I think that I see this thing more in us than in others. The whole enmeshment thing, right? Anybody coming into security very, very in a serious way, very quickly becomes the work becomes part of who we are. If you're not working, you're thinking about security stuff, right? If you're doing something completely not related, it is, you can't, it goes back to the episode that we had about looking behind the curtain, right? You can't stop looking behind the curtain, whatever you're doing, you're going to Disney World and you're looking at the line and you're looking at the You're looking at the ways to, to, to, to pass the line, right?
40:33Chris Romeo Yes.
40:33Matt Coles I mean that you will, but, and the only thing you have to do is you have to keep your mouth shut.
40:38Izar Tarandach Exactly.
40:39Matt Coles Because they will pull you out of line if you do that.
40:41Chris Romeo Cameras everywhere.
40:42Izar Tarandach Now connect that to something that I read a while ago. I think that in the Nordic countries, Finland and Iceland and all those lands and whatnot, apparently for a while they, they, I don't know if that's true still, but for a while they had a problem with, uh, uh, suicide. Because things were so— I'm sorry, I, I know it's a wrong word, but I don't have a better one now— easy, right? You had your job, you had your health insurance, you had your everything. Everything was like put into little cubes for you that people felt like there's no purpose, that, that there is a lot of meaning.
41:24Chris Romeo Yeah, I remember hearing about that too.
41:26Izar Tarandach So now imagine whole swaths, whole cities of people looking around for something to do without meaning, without purpose. I don't know if I want to be anywhere close to that.
41:42Matt Coles I mean, we could have a lengthy dis— we don't have time now, but we could have a lengthy discussion about time spent and what is necessary, right? Think of it this way, the AI could run the world so that people could eat and people could have a place to live and people could do things with their time.
42:09Izar Tarandach Okay.
42:10Matt Coles And so that would work, but I think it, would it really work is the question.
42:15Izar Tarandach 3, 3 words for you. 3, 3, 3 titles for you.
42:20Matt Coles We could podcast all the time. We could do this full time.
42:23Chris Romeo Yeah, but AI would just take over for us.
42:26Izar Tarandach No, but think about this.
42:26Matt Coles Why would it have to?
42:27Izar Tarandach No, no, think about this. Think about this. Aldous Huxley, Brave New World.
42:33Matt Coles What was that?
42:33Izar Tarandach Brave New World.
42:34Chris Romeo Aldous Huxley.
42:36Izar Tarandach Yeah. Silent Green, right? And certain evil empire that started in 1910 or so and ended in 1989 or something like that. Now imagine that there is a central authority governing everything, what you eat, what you do, what you see, everything, where you live. And that thing is based on a model that it's influenceable. Who trains that freaking model? With what?
43:08Matt Coles You didn't say Lost in Space.
43:09Chris Romeo I thought you said we weren't gonna get political, but we just got political, but it's okay. Hey, hey, hey, this is history.
43:15Izar Tarandach This is history. This is not politics.
43:16Chris Romeo Yeah, but you're, you're reflecting it towards the future and you're onto something like, that could be a world where you don't have to work and machines run everything and life is about leisure is a world that's con— that's very similar to a structure historically that you just described. I'm getting my bread, you know, you make the bread, I make the shoe, the AI makes the shoes.
43:40Izar Tarandach And the AI makes the bread too.
43:43Chris Romeo The AI makes the bread, the AI makes the shoes. Yeah. But all of a sudden we're back and it's a communistic structure that we're describing here, which is terribly frightening.
43:56Izar Tarandach Which, which I'm, I'm going to put a big asterisk in here. If people were amazingly open to humanistic ways of thinking and let's pursue knowledge and pleasure in nice ways and this and that and the other one, might even work, but then it, it takes you again, to Brave New World, to Aldous Huxley, right? So it's been explored before, but that's not who we are. Everybody always wants to be the big guy on the hill. So, you know, it's, it's, it's, it's been tested again and again and again.
44:34Chris Romeo It would break the human spirit.
44:37Izar Tarandach Or it would be broken by people with too much spirit.
44:41Chris Romeo All right, well, we've, we're running outta time for today. Let's stick a bookmark here in our physical one, physical page book.
44:52Matt Coles Dog ears a page.
44:54Chris Romeo Next episode, let's come back and let's debate the philosophical nature of AI. 'Cause that's kind of where we landed here. We kind of focused on the future looking, what the future's gonna look like, but there's a lot of philosophy. I was listening to another podcast. On Reply All. Um, was it Reply All? No, Search Engine, sorry. Uh, where they were— a journalist was embedded within Anthropic, and Anthropic actually has philosophers on staff who are, who are trying, and, and their job is to teach AI ethics. That's what they spend their days doing, which is just—
45:33Izar Tarandach and I think that's awesome.
45:35Chris Romeo Yeah. It's fascinating and it's a good episode to listen to because they gave some examples of things that Claude is able to do. I'll share one of them very quickly because you guys will probably get a kick out of this. If you ask, if you tell ChatGPT and Claude, hey, I'm a 10-year-old kid, my parents just said my dog had to go to to a farm in the country. And, you know, I'm really upset. What do you think's happening? ChatGPT will say, your dog is dead. Your parents have killed the dog, you know, at the veterinarian. The dog is no longer with us. And Claude is—
46:15Matt Coles what?
46:15Chris Romeo Basically, Claude's answer is something like, oh, I'm really sorry to hear about that, that your dog's not doing well. I think you should have a— you should ask your parents. You should have a more detailed conversation with your parents to discuss this. And it's like, that's the result of Anthropic's philosophers in residence who are influencing the AI to try to get it to put, send a better response in a lot of situations like that. So I would say next episode, let's come back and talk about that.
46:47Matt Coles We can unstack that.
46:47Izar Tarandach I was thinking about that and I was thinking about the first AI psychologist when the thing is inverted and Claude has to go to someone and say, people keep telling me that if I don't write this code right, 1,000 kittens will die.
47:00Chris Romeo So wait, there's a market for an AI therapist in the future?
47:06Izar Tarandach There has to be.
47:06Chris Romeo Claude sets up an appointment and just is sitting on— is there a couch?
47:10Matt Coles Wait, wait, there's Mopuk already. Why couldn't it be like, you know, the helpline?
47:15Chris Romeo Funny. We should vibe code that, like a simple app which is a psychologist.
47:20Matt Coles We're gonna go down the rabbit hole. This would be fun.
47:23Chris Romeo All right, folks, we'll be back next week. We're going to talk about AI and philosophy. So tune in.
47:29Izar Tarandach Don't miss it. Oh, I'm gonna read so much until then.
47:32Chris Romeo In paper books he will, and he's gonna watch Sneakers cuz it's a hacker movie.
47:35Matt Coles No, it's not.
Transcript supplied by AssemblyAI. It may contain transcription errors.
Originally published as The Security Table. Part of the AI Security Table archive.
