Skillset Over Experience: Rethinking Qualifications in Cybersecurity
With Chris Romeo, Izar Tarandach, and Matt Coles
Today we delve into the evolving landscape of cybersecurity hiring, debating the merits of prioritizing skills over degrees and experience. From discussing the value of critical thinking and hands-on skills to the potential role of AI in the workforce, the conversation navigates the complexities of hiring practices.
About this episode
Today we delve into the evolving landscape of cybersecurity hiring, debating the merits of prioritizing skills over degrees and experience. From discussing the value of critical thinking and hands-on skills to the potential role of AI in the workforce, the conversation navigates the complexities of hiring practices. We share personal anecdotes, insights from industry articles, and our experiences as hiring managers. Tune in for a humorous and thought-provoking discussion on what really matters when building a successful cybersecurity team.
CISOs Rethink Hiring to Emphasize Skills Over Degrees and Experience article
Follow AI Security Table:
➜ Home: https://securitytable.ai/
➜ X: https://x.com/AISecurityTable
➜ LinkedIn: https://www.linkedin.com/company/ai-security-table/
➜ YouTube: https://www.youtube.com/@AISecurityTable
Transcript · 40 min conversation
0:09Chris Romeo Hey folks, welcome to another episode of the Security Table. And today we really need to unpack Ezar's purchasing habits on the internet. I have a feeling that he sees an ad and he's like, that's something for me. So these are all the equivalent of late night QVC purchases.
0:27Izar Tarandach Seriously, like it's practical.
0:29Chris Romeo Is that a Sidekick? Is that a Sidekick? One of those little phones?
0:32Izar Tarandach No, but that's what I was thinking when I bought it. Okay, so with this I connect my phone and I have a nice mouse with separate buttons, right and left, and buttons here on the eyebrows. Full keyboard.
0:46Matt Coles Wait, on the eyebrows?
0:48Izar Tarandach Yeah, here on the eyebrows.
0:49Chris Romeo That's what they call it. It's like an infomercial. It's like he already knows the script. But wait, there's more.
0:55Matt Coles Oh wait, there's more.
0:56Izar Tarandach No, there isn't. That, that's all it is. But wait, there isn't anymore. So, but the good thing is that you're connected to your Android phone and immediately you have a, a new desktop.
1:08Matt Coles And immediately you get, uh, attacked by how many viruses and malware and you've, uh, checked its firmware thoroughly for—
1:15Izar Tarandach But no dudes.
1:17Chris Romeo Uh-huh. And is that really secure?
1:19Izar Tarandach As we know, Bluetooth is totally insecure.
1:21Matt Coles Uh, who's fully secure?
1:23Chris Romeo I was thinking the same thing.
1:25Matt Coles It exposes your data over Bluetooth LE for everybody to know. Full control.
1:33Chris Romeo And then he just left the show. Oh no, wait, he's back.
1:38Izar Tarandach I can't connect. You guys get it rolling. I'm getting Oh, I'm having a—
1:49Matt Coles He's having a moment.
1:50Izar Tarandach I'm having a wardrobe moment.
1:54Chris Romeo I thought your false teeth were coming out or something.
1:57Matt Coles I think he's trying to pull a Matrix.
1:59Chris Romeo What is he trying to do? Like, is he the Architect or what? Or is he Morpheus?
2:05Matt Coles I don't know. He's trying to be— Oh no, he's playing the guy from Hackers who had the— He had a strap on and he— strap for his bag and a keyboard attached to it, and he would roller skate around New York.
2:21Chris Romeo I could see he's roller skating around with a keyboard.
2:26Izar Tarandach Did I ever do that?
2:29Matt Coles Do you know how to roller skate or skateboard?
2:34Izar Tarandach Roller skate, but with a keyboard? Wait, we're talking that little Casio CS10 keyboard or a full 101 keys keyboard?
2:45Chris Romeo I mean, it's better.
2:46Matt Coles It's from Hackers. It'll be from Hackers. The guy from Hackers.
2:51Izar Tarandach Oh, that guy. No.
2:54Chris Romeo No.
2:55Izar Tarandach Okay. So what are we talking about today?
2:58Chris Romeo So we got this article from, where is it from? Somewhere. CSO Online.
3:04Matt Coles Mm.
3:04Izar Tarandach Oh, that's a nice source.
3:06Chris Romeo It's entitled CISOs Rethink Hiring to Emphasize Skills Over Degrees and Experience. So wait, hold on. I didn't read this title closely when we first talked about doing this. It's like, yeah, did you read that? It's like Jerry Maguire, like you had me at the title here. Like, wait, skills over degrees and experience. How can you have skills without experience?
3:32Izar Tarandach Yeah.
3:32Matt Coles So that's the nature of our shodanai.
3:36Chris Romeo Oh, I figured it out.
3:37Matt Coles Okay. So skill versus experience. So if we look at experience, I think here as principles. Oh, it seems that the hiring trend that they're suggesting here is finding people who know what to do, you know, which buttons to click, which APIs to call. What tasks to perform, but not those that have a background that teaches them principles so that they can figure out what to do later on the job. Don't need a college degree, 10 years, 20 years, 30 years of experience doesn't matter if you don't know which buttons to press.
4:31Izar Tarandach But Are we talking, one thing that I didn't get from the article, are we talking all jobs or entry jobs only?
4:38Matt Coles I don't know. That's a good question. If it's entry jobs, does it make a difference? I mean, think about that for a moment.
4:47Izar Tarandach If it's entry jobs, so from my personal experience hiring people, computer science graduates are not really expecting to be hired for entry jobs.
5:02Matt Coles Detail.
5:02Izar Tarandach What, what people are most looking for is someone— this is not going to go well together today.
5:21Chris Romeo Wait, are you literally biting your lip?
5:25Izar Tarandach Better not to guess what's happening.
5:28Chris Romeo Okay. Cause it's like, there's like that episode of The Office where Jim does that like 3 times in a row and he just finally just gives up and goes, I'm going home.
5:36Izar Tarandach That's it.
5:36Chris Romeo I'm going home.
5:38Izar Tarandach I, I'm pretty close to that. You are home. Anyway. Aren't you?
5:43Matt Coles You're somewhere.
5:44Izar Tarandach Right, right, right, right. Though anyway, uh, hopefully you can understand me now.
5:49Matt Coles But I just noticed your chair says GTFO, GTF office.
5:59Izar Tarandach Okay, so we are noticing way too many things around here. So stop noticing. So we were talking about the entry level or not. And I said that even if we pull things to the flavor of the hour, which is fire everybody and just have an AI do everything. People are just hiring for, at the entry level at least, for people who can push the button and get things running and working and operate all the nifty and nice tools that we have sucking our money and time.
6:41Chris Romeo Yeah.
6:41Izar Tarandach So in that sense, do you really need the certification? Do you really need a degree? No, you need to know the tool, right? You need to know which—
6:52Chris Romeo Let's back up and explore what the value of a degree is. So we all, each of us here has college degrees. Some of us have multiple college degrees. When I think about the value of a college degree as a hiring manager, and I think at last count I've hired about 50 people. In my career. So I've had a chance to hire people at a lot of different levels, a lot of different, you know, from executives all the way to entry-level folks. And when I think about a degree, one, I don't really care about where it's from. I'm not impressed by the fact that you went to some Ivy League school or something. That has no bearing on my decision process. I think of a degree as proof that you can show up somewhere for a period of time and complete a number of steps in a row. That's the value that I see of the degree. And yes, did you learn about, you know, philosophy and art history and are you a well-rounded human being? I guess, but that doesn't really make me money as a business owner, right? But so when you have a degree, I'm like, okay, at least this person could show up somewhere for a couple of years in a row and tick some boxes along the way. Then we start to get in the interview process to figure out what you really know. And what you can do for my business to make it successful. So, but what do you guys see as the value of the degree?
8:10Matt Coles I think it, I think really it's the, it isn't necessarily that you come out of a college degree with a ton of knowledge. You come out with the ability to acquire knowledge. So if you're looking for somebody to fill the creative role, to also fill creative roles. Yes, they have the ability to work through a process, a well-defined process. They should have the ability to work through a well-defined process, but they should also have the ability to figure out what goes wrong in that process, how to, you know, if deviations occur, they can get back on track without, oh, what's the next step in the scripts that I'm missing kind of thing. And also to fill more creative roles like, you know, architecture, in this case, I guess we're talking, you know, in this area, things like architecture or design or, you know, how to deal with people. So I think the college degree is an enabler. Most college programs, I think, are enablers for tasks that are not, you know, strictly procedural. Okay.
9:22Izar Tarandach I would say that in the present configuration, college degrees are a ticket to go past the recruiter gatekeeper.
9:30Matt Coles True.
9:32Chris Romeo Which is an AI gatekeeper these days from what I understand.
9:35Izar Tarandach Right. Today it is.
9:38Chris Romeo So if you don't have that degree, a lot of times you're still caught not being able to get through.
9:45Izar Tarandach And, and after I, I reached a certain level in my career, I started seeing that every new job that I went to, one of the first things they did was to actually call the university and check that the degree existed and that I actually had it.
10:00Matt Coles Oh, that's harsh.
10:02Izar Tarandach As part of the background check.
10:03Chris Romeo Well, because so many people are lying about it though. It's, it's a sad state of affairs, but it's not us, the people that have them, it's the people who are lying and saying, oh, I have a degree from Stanford. And then they get, somebody calls the reference checker, like, we've never heard of this person. They didn't go to this school.
10:20Izar Tarandach Notice, in my opinion, that goes back to the value, because if you feel that you can lie about something like that and get away with it, then to me that means that the degree itself is not giving you anything intrinsic that if you didn't have, somebody would notice.
10:35Chris Romeo Hmm, interesting.
10:35Izar Tarandach It's just, again, the tickets to get into the door.
10:38Chris Romeo Interesting. That's a good conclusion right there, that it's not the— if you can, if you can fake that you have it and nobody can tell the difference, then what's the value of it? Exactly. Wow.
10:53Matt Coles And that's the whole— That rooster, that thing would come home to roost as soon as that person gets into the job and is asked to do something necessarily.
11:01Izar Tarandach Unfortunately. They may totally be able to do it.
11:05Chris Romeo Unfortunately, I wish that was the case, Matt. And I think people working for any of us, that is the case. But, and there is just a— People just get away with whatever they want these days.
11:17Izar Tarandach Let me give you an example. This happened 30 years ago. I'm working in the university's data center. And so the door was open. Somebody comes in and says, hey, Zareh, I just got my PhD. Oh, that's awesome. Good for you. And he goes, and this actually happened. I got my BSc here. I got my master's here. I got now my doctorate here. I have never seen the computer that we work on. Is this it? And he pointed, he pointed to the air conditioning that was turned off at the moment.
11:52Matt Coles So when we were talking to him, when we're talking degrees here, you guys didn't specify what degree. Cause, cause there's a limit. Like, that work, that was my answer, and I think Chris's answer was for, you know, bachelor and maybe master's. But when you get up to that rarefied air of PhD, there's a lot of assumption about capability there.
12:25Izar Tarandach It just means that you know a lot about some very small thing.
12:29Matt Coles Right.
12:29Chris Romeo You should be able to take somebody's PhD back if that happens. That example you just gave.
12:34Izar Tarandach And hit them with it.
12:35Chris Romeo Yes, you should be able to be like, all right, listen, you don't have a PhD anymore. You're going to go back to, you go back to, you know, do not pass go, do not collect $200, back to square one.
12:44Matt Coles I mean, we know some, we know some very smart people with PhDs. We work with them closely.
12:48Chris Romeo Sure.
12:49Matt Coles There are some though that are in the wrong position for what they know and what they do.
12:55Izar Tarandach To be very honest, back in that time, there was a distinct difference between computer science and computer engineering. And most of the uses of a computer to the computer science people were to write articles in LaTeX and not try to test stuff. So yeah, the guy got away with it. But my point was that, and now I forgot my point, but something along the lines of practical versus— Practical versus theoretical?
13:35Matt Coles Or—
13:35Izar Tarandach I think that I am— I don't know if fortunate is the term, but because of the way that I came into the work, into the career, I think that the most talented people in this field that I have known growing up did not have degrees.
13:54Chris Romeo Yeah. I've known a few, I've known some that were mentors of mine that were either they didn't have degrees or they didn't have degrees in anything technology related. You know, they had a, one of the guys that was one of my mentors has had a master's in music, but he grew up in a time when there wasn't, there was no security, there was no cybersecurity degrees or anything. Like, I mean, he would have been in the university system in the 1950s.
14:19Izar Tarandach And now that you mention it, my first mentor, my, actually my guru, the man who I value above probably all other mentors that I had, he did not have a degree and he was one of the people that pushed the most powerfully for me to get mine finished.
14:40Chris Romeo He saw the value in it then.
14:43Izar Tarandach I believe so, yeah. Something that I didn't see at the time.
14:47Matt Coles So I think what you're, what I'm hearing from, from both of you is degrees can be valuable if the individual who gets them knows what to do with them is the wrong way to say this, but I don't know how else to describe it.
15:04Izar Tarandach Right.
15:04Matt Coles It's, it's a, it's being able to apply it. So the degree itself is huge. Is the gatekeeper. you know, task that, or, or, you know, the bottleneck for, for HR. But the degree and what it teaches requires something from the individual to apply it in a way that makes sense. And, and so this brings me back, brings me back to the topic at hand and actually a different article, um, that I didn't share with you guys, uh, beforehand. Um, I'm not going to share it now because I can't find it, but, uh, it talked about the one critical skill that people are looking for is critical thinking skills. And where do you get critical thinking skills? That comes from, I think, in part, from the degree program, right? The degree program teaches you how to think.
15:54Chris Romeo No. Critical thinking skills begin when you're a small child.
15:59Matt Coles Certainly, but the college process, the process going through college, is supposed to. Okay. When, when I went to college, it was teaching you how to think critically and up and how to apply it critically.
16:18Izar Tarandach So I would say that when you went to college, the world was a very different place.
16:25Matt Coles Yes, that's true. We're not talking today or anywhere in the past, like two decades.
16:33Izar Tarandach Nowadays, it's learn by rote or some other kind of learning that I don't want to touch in any way, shape, or form. But I would say that critical thinking is not a valued skill or a cultivated skill in today's—
16:55Matt Coles Well, so let's bring that back to cybersecurity. I'll pose a question to both of you. How much of cybersecurity function, I guess, you know, product security, cybersecurity, threat modeling, whatever, the whole field, the whole technical domain here, how much of it is rote and procedural? And how much of it requires critical thinking? In your mind?
17:24Izar Tarandach Now it's a very good time in the history of this whole thing to ask that question, I think, because now we are seeing where AI is getting in and staying and not getting kicked out again. And those are the places that I would say do not need the critical thinking. Where AI manages to encroach and stay, you don't need critical thinking.
17:48Matt Coles So highlight a couple of those areas. Are you thinking like in the security operations center? Or are you thinking about—
17:54Izar Tarandach Let's open a parenthesis here. We don't want to offend anybody. We're not saying that.
17:59Matt Coles I'm not, no, I'm, I'm asking you to, I'm asking you to describe places where you change our, that we change our approach.
18:05Chris Romeo What do you mean we don't want to offend anybody? We usually offend somebody every episode.
18:09Izar Tarandach What are you talking about? No, no, no, no, no. But when, when, when we offend people, it's more like, uh, DAST is dead. It's not like the job that you're doing could be done by an AI and nothing would get done.
18:18Chris Romeo Well, I mean, listen, it's, it's the reality of, it's, you know, to, we're not going to sit here and lie. Oh no, we don't think your job could be taken by AI. I'm sorry, security operations, that, that whole discipline is rife to be optimized by AI.
18:33Izar Tarandach Optimized. I'm going to go out and say the job as a human could do it optimally, should not be liable to be replaced by an AI. It can, and you will get perhaps 90%, or in some cases you would 110%.
18:53Matt Coles Yeah.
18:53Izar Tarandach Again, it depends on the person, right? But if it's being done at a level and in a way that is what we would like to see more than less, then it shouldn't be able to, to, to, to be replaced by an AI.
19:10Chris Romeo Well, because like you said, I think we have a trust problem. And so I'm not ready to sign off on any, any cybersecurity function, or really any function being outsourced 100% to AI until we figure out how to see inside of it. And right now you can't see inside of an LLM to know, can I put a repeat, can I run something twice and watch the repeatableness of the answer that comes from it? And so until I get that level of transparency and visibility, I will not authorize in my world letting anything be 100% AI controlled.
19:41Matt Coles So just a note, I mean, so first off, This is a great conversation, but I think we've strayed from the original. I was asking not can it, is it rote and procedural because it can be replaced by AI, but is it rote and procedural that skills-based learning is the way that you need to hire for it?
19:59Chris Romeo I think it's— Go ahead.
20:03Izar Tarandach Let's put it like this. Even in a SOC situation, okay, threat hunting.
20:07Matt Coles And by the way, I was using SOC as an example.
20:10Chris Romeo When you say—
20:11Izar Tarandach Because it's the thing that we are used to think of as rules working, right? You get input, you look at inputs, you get out. But threat hunting, for example, true if you have all the indicators and everything has been cataloged and everything is known, it's pattern matching, right? Machine can do it fine. But the new stuff, the new stuff or the stuff that doesn't quite sit in the pattern, Many times you say, hey, this was found by smell, or this was found by intuition. Somebody felt that something was wrong.
20:49Chris Romeo Yeah.
20:49Izar Tarandach Or we got an email from a guy that we never get an email from, or a friend of ours in FBI called and said, hey, we saw something outside. That kind of thing, the kind of serendipity that many times you'd like to talk about and say, this saved my skin. That we're not going to get that with AI and a computer science degree doesn't give it.
21:15Chris Romeo Yeah, so.
21:15Izar Tarandach A couple of months, a couple of years in the field talking to people, feeling stuff, that's what gives it to you.
21:21Chris Romeo And the best folks that I've seen in those jobs are the ones who are creating things to help them do their job better. So they're writing scripts to search the data in a way that nobody's ever done it before. There, so there's that human ingenuity. So that I would say is a skills-based, but the critical thinking is, those that have the high level of critical thinking are the ones that are able to write the scripts to find the stuff, to optimize. And ultimately, let's be honest, those are the ones that are, those are the folks that are getting promoted. The SOC is a gateway. To the rest of the company. It just is. We could say we don't like it, but that's the reality. A lot of entry-level positions start in the SOC, and then, but those people that are optimizing and using critical thinking are being offered jobs in other parts of the cybersecurity team because their value is being calculated.
22:17Izar Tarandach But now we just closed the loop. Yeah, we closed the loop. Here's the smart people writing the script that's going to optimize their job. That script gets translated into procedure and that gets AI'd out of people.
22:32Chris Romeo No, because there's always new scripts to write, right? And that's the thing about AI right now. Everybody thinks AI is the future. AI's never had an original thought. When it has an original thought, then we can start talking about how it's going to eliminate people from things. Now, can it eliminate truck drivers? Yes, but that's because when I think about having AI or self-driving trucks and things like that, delivering trucks, yes, there's some logistical things that have to happen, but when somebody's driving a truck to deliver something, they're not creating new processes or new, they're not coming up with new ways to deliver stuff on the fly, right? And so it's really that if you need critical thinking, that's like for me an example that, that AI can't take that thing over because AI can't critically think.
23:21Izar Tarandach But at the same time, do you want AI taking control of all the 18-wheelers out there across the roads, the same roads that you drive?
23:32Chris Romeo I mean, coming back to my original thing I said too is until we have the ability to see inside of it, I won't trust it and I won't sign off on driving next to an 18-wheeler. Now, do I think that self-driving 18-wheelers are going to take over the transportation industry? 100%. Do I think it's going to happen tomorrow? Nope. It's 25 years in the future. And everybody that I say that in front of keeps saying, oh, you don't know what you're talking about. Like, just watch. To do something like that, there is a public trust. And until the public trust tips in the direction of being able to do that, the government is going to stop that type of thing from happening. One, you're gonna have, your unemployment rate's gonna go, I don't know how many truck drivers are in the US, there's a lot of them. A lot of them. So if you start, if you flip the switch and said we're going self-driving on all the trucks and we're taking the people out of it, your unemployment rate's jumping by multiple points.
24:29Matt Coles Although interestingly enough, that same argument probably isn't being made for autonomous taxis. Or how many taxis, or there are, how many, well, planes are a different matter. Right? There's a number of fatalities metric when it comes to airplanes versus cars and trucks, right? But which pushes that decision, I think, further and further down the road. But the, you know, that argument that you just made about truck drivers could be said for taxis as well, but nobody's saying, you know, taxis need to be a protected Well, that's because taxis have been replaced by a marketplace of gig workers who are delivering the service.
25:16Chris Romeo And so there's, uh, those gig workers will likely just might, would migrate to other gig opportunities.
25:23Matt Coles They have, right? I mean, DoorDash exists because they've taken the taxi service and applied it to food delivery.
25:29Chris Romeo Yeah.
25:30Matt Coles Right. So they just value that a lot more.
25:30Chris Romeo Which is not as easy to have an AI get out of the car and walk in and pick up the food. Right now, I mean, in our area, we have drone deliveries that are in testing. So they're delivering DoorDash with drones. Unfortunately, not to my house. I'm too far away.
25:43Matt Coles Interesting on the truck drivers too, right? Some portion of truck drivers, well, all truck drivers today, if I understand correctly, have to repair or at least are responsible for when their truck breaks on the road with a load, with a haul. That they have to, you know, put all the safety cones out, they have to do all the pre-trip diagnostics and things like that. And so an AI would not be able to do that either. So you'd have some portion of the truck driving workforce that would be still necessary to do maintenance, but that may be localized as opposed to, you know, long-haul kind of things.
26:20Chris Romeo Yeah. Yeah. And then there's some differences between like if you own your own truck versus company trucks. And I think in the self-driving world, you're gonna see a lot of the individual operator owners being crushed by the mega corporations, which is just what happens in every—
26:38Matt Coles Yep.
26:39Chris Romeo Every environment where somebody can, you know, can dominate a particular part of the industry.
26:46Matt Coles And so, so here's a question. Okay.
26:50Izar Tarandach No, I would just say that I wouldn't want to be an independent operator and get to a position of, uh, dude, where's my truck? If the AI just drove away.
27:02Chris Romeo I mean, but if you could afford to have a self-driving truck as an independent operator, the amount of money you can make almost twice as much money because with the Department of Transportation and, and human drivers, a human driver can only drive 14 hours in a row and then they have to go offline for 10 hours, I believe. And then they also have a limit where they hit a certain number of days in a row, then they have to go into a 40-hour reset cycle where they're off the— they're out of the car, out of the truck for 40 hours, 38 hours.
27:36Izar Tarandach That's why my Amazon Overnights never is.
27:38Matt Coles But that's a safety thing.
27:39Chris Romeo I mean, that's— yeah, 100%. But, but if you go to self-driving trucks where it's AI driving the truck, guess what? AI doesn't need to take a break and have a 40-hour shutdown time. Now from a maintenance perspective, they'll have to do that. But yeah, but coming back around, like the whole reason I went to this example is, and I'm not diminishing truck drivers, they're the heartbeat of what makes things show up at your door. Like without truck drivers, Amazon Prime doesn't show up overnight or 2-day delivery on your, 'cause that stuff's not being flown around, it's being trucked at a super highly optimized perspective to get it to your door, right? So I'm not talking about—
28:17Matt Coles Well, and actually, I mean, you could extend that argument to trains as well. Right. I mean, you don't— it doesn't take a lot of people to drive a freight train.
28:24Chris Romeo Yeah.
28:25Matt Coles But, you know, same, same thing. Right. But anyway, go on with your— why did you— why did you go here from cybersecurity to truck driving?
28:33Chris Romeo Well, I mean, because it's a skills thing, right? We were talking about skills. And yes, driving a truck as a human being does require a bunch of skills. But— and you could argue that critical thinking, if you have to fix your truck on the side of the road— now, most people don't do that. Most drivers, just call for maintenance and maintenance comes and they have people to fix it. But when I think about the security operations center person and the application of critical thinking, I just see a lot more critical thinking being applied in the cybersecurity use case. And I guess I'm being maybe too stereotypical in a positive way because there's, that's a weird way to describe it. I don't know. I'm I'm, my brain's not operating well.
29:20Matt Coles You're positively stereotypical this morning.
29:23Chris Romeo But it's, it's, I'm being, it's stereotypical to say that everybody, like not everybody applies critical thinking in every job in cybersecurity. There are people that are at the top of their industry and people that are not. And, but I would argue that a lot of what's driven my own success is the ability to critically think about things and come up with solutions. That's, you know, I'm never the smartest guy in the room or smartest person in the room. Never happens. But I'm the one who knows how to ask the right questions and I can get everybody marching in a direction, you know, for success.
30:01Matt Coles It's funny you say that. Everyone loves to say that, but what's smart?
30:07Chris Romeo For me, it's true though. What's smart? But what's smart? Let's see. Area. I graduated high school with a 2.3 grade point average.
30:15Izar Tarandach So let's not talk degrees, please.
30:17Chris Romeo Oh yes. Yes.
30:17Matt Coles Let me, let me talk about my first year of college where I left my first year of college with a 0.9 GPA.
30:25Chris Romeo Dude, you had a lot of fun. You had a lot of fun though. Admit it. I know you did.
30:30Izar Tarandach What about me having to repeat infinitesimal calculus 6 times?
30:34Matt Coles I don't even know what infinitesimal calculus is.
30:36Chris Romeo Yeah, I don't even know what that is.
30:37Izar Tarandach What is that?
30:37Chris Romeo If you give me 5 chances, infinitesimal calculus, like, is that like— What is that?
30:41Matt Coles I can't even say it.
30:42Izar Tarandach What is it?
30:43Chris Romeo Yeah, say it again.
30:45Izar Tarandach It's infinitesimal. Infinitesimal calculus?
30:49Chris Romeo How do you even see it?
30:50Izar Tarandach It's a very big thing, but it's very interesting things that had to happen at a very, very small scale.
30:56Chris Romeo See, I have no idea what you're talking about.
30:57Izar Tarandach To me, it's like, go big or go home, so I couldn't care less.
31:00Matt Coles So what is your— your degree is in math, is it? Is it not?
31:03Izar Tarandach It's comp sci with a minor in math. But they only gave me the minor in maths on the condition that I never try to use it.
31:14Chris Romeo That's fair. I could see that. That makes sense.
31:19Izar Tarandach It was like everybody getting their degrees and it was with honors, with honors, with honors. Came my name and it was with much regret.
31:31Chris Romeo So, at least they didn't ask for it back. They didn't ask for it back.
31:34Matt Coles So, yeah. Not yet.
31:36Izar Tarandach Yeah, I don't think that they know that they have the capability, but anyway. So back to hiring people and all that stuff and AI and whatnot. So what's our scale of preference here? You're hiring somebody new to join your security department. In any entry, entry-level job.
32:03Chris Romeo I got some thoughts.
32:05Izar Tarandach We know that we are looking for critical thinking, but it could be argued that critical thinking is something that we might help a good candidate that doesn't have it develop in the job, right? That's what we are around for.
32:21Chris Romeo One of the things that I like that was in this article was this idea of assessment-focused hiring. And so scenario-based interviews, custom platforms, tailored tests to evaluate competencies. And this can be a sticky situation because like, especially in the creative world, often people will try to use this to get free work done, which I've never, I would never use this. I offered to pay people.
32:44Matt Coles Well, I've seen this before.
32:45Chris Romeo Yeah. And let me, let me, let me walk you through my kind of approach for certain, certain jobs that I'm hiring for. We do the initial interview, we do some, you know, some coworker and other leaders interviewing the person. If we decide, like somebody that was creating content for me, like learning content, we would then give them a homework assignment. And it was only this, I only, we only gave it out a few times. 'Cause like people had to basically be, okay, we like the person, we like the candidate. Now we need to see if they could do what we need them to do in the job. And so we would give them, and I would tell them, do not spend more than 2 hours on this. Now I'm sure people went away and did, but I told, and that's on them, right? Cause like I, I wasn't going to set the expectation. You should spend 2 weeks working on this for free. Like I just wanted to see, could they translate what we were trying to do, what we needed them to do into something tangible that I could see, okay, I see a, I see a thread connecting the two things that what I gave them the assignment and what they came up with. Now, some people went way overboard and did a lot with it, but they ended up getting the job most of the time because they demonstrated they could do it. So for me, that, that became a very crucial part of being able to understand, can somebody do the basic function of the job that I need them to do? And we had a lot of success hiring people like that. Some people would never, we'd never hear from them again. Strangest thing.
34:10Izar Tarandach You see, the interesting thing to me here is that you were in a position to take advantage of that because you knew how to interpret the results.
34:20Chris Romeo What do you mean take advantage of it?
34:22Izar Tarandach Of that process of like being able to get good people because they gave you good answers because you were in a position to understand those answers coming in.
34:32Chris Romeo Oh yeah. So I had an unfair advantage, you're saying?
34:35Izar Tarandach No.
34:36Matt Coles I think you used— if you're interviewing anybody, you should be in a position to take advantage of the answers they give you and interpret what they tell you.
34:44Izar Tarandach You use the word should very, very liberally here.
34:47Matt Coles I do.
34:49Izar Tarandach The problem is that in reality world, a lot of people ask questions that they don't know the answers for. And they're going more for, am I getting an answer that sounds plausible? Or is this person just stuttering and looking around and not looking me in the eye and they don't have an idea of what they're talking about?
35:09Chris Romeo Shame on a hiring manager if you don't know the core subject matter that you're hiring for.
35:15Izar Tarandach Oh man. Oh man.
35:16Chris Romeo I have—
35:17Izar Tarandach How many times have you seen—
35:18Chris Romeo I made somebody cry. I made someone almost cry once in an interview.
35:23Matt Coles Once?
35:23Izar Tarandach Because you've done it wrong.
35:24Chris Romeo Because I— he— listen, in my world, if you put something on your resume it's fair game. I'm coming for you. I'm going to ask you questions about it and I'm going to understand how, how much you actually know about it. And the funny thing is sometimes I maybe don't understand it that well, but I'll ask questions to see if you do. And this guy, I just caught him in 3 lies in a row of things that were on his resume. He's like, well, okay, I don't really have any experience in that. By the third one, he looked like he was going to cry. But I'm like, dude, you wrote it on your resume. Like, just put, be truthful on your resume. You would have been fine.
35:57Izar Tarandach Once upon a time, Matt interviewed me for a job.
36:00Chris Romeo What?
36:01Izar Tarandach And I came out of the interview, I came out of the interview thinking, finally somebody who asks questions that they know the answers to.
36:09Matt Coles Nice.
36:10Izar Tarandach I did.
36:10Matt Coles I must have had like a, I must have had a monster that day or something and I was completely like on, but.
36:14Izar Tarandach Several actually. And he came out of the interview thinking that I wasn't technical enough, so I probably didn't manage to answer the the question well.
36:25Chris Romeo Did you get the job?
36:26Izar Tarandach We still hired him.
36:27Chris Romeo Okay. Even against Matt's will.
36:30Izar Tarandach No, for you to see that the market has been shaky ever since. Well, it's not any of—
36:38Matt Coles This is also, this was also quite a while ago.
36:41Izar Tarandach It was quite a while ago.
36:42Chris Romeo In a galaxy far, far away.
36:44Matt Coles More than an AI year ago.
36:47Izar Tarandach Way more than an AI year ago.
36:49Chris Romeo That's a long time. All right. Any final thoughts here as we, uh, on this kind of idea of skills over degrees?
36:57Matt Coles Is this a good idea or a bad idea? For some roles, this is probably okay. For some roles, this is not going to end well, in my opinion. That's my final thought.
37:09Izar Tarandach Agree with Matt. And I add that we have been having the discussion a long time. And nothing changes. People still get good hires for bad places, bad hires for good places, and it's going to keep being like this. Well, now Lord only knows what's going to happen for the next, uh, few years, but if the pattern keeps, I think that it's going to keep being like this.
37:37Chris Romeo Yeah, that's true. I think that's the reality of it, but I don't know. I mean, this, the, the article even mentions this is a very small percentage of people that are taking this new approach right now. So we'll just have to wait and see if more people fall on this skills over degrees thing. I don't know. I don't know that I see it happening, but— Skills over experience, which is skills over experience, which it seems so tied together.
38:03Matt Coles It's also, I mean, it's also an age, potentially an ageist trap, right?
38:09Chris Romeo You're opening up a whole other can of worms there, Matt.
38:12Matt Coles I know. I know we're all of the age. We're all potential victims of it.
38:18Chris Romeo Yeah, that's a whole other episode.
38:19Izar Tarandach I do not want to start my week thinking about that.
38:22Chris Romeo Yeah, that's a whole other episode right there.
38:24Izar Tarandach But hey, one thing.
38:26Matt Coles Yeah.
38:26Izar Tarandach I'm going to invite everybody to go back into the archives and see our episode about, what was it? Having security guilt.
38:36Matt Coles Yeah, acting, is it like a trade? Is it like one of the trades?
38:40Chris Romeo Oh yeah. I was thinking about that too.
38:43Matt Coles Exactly, right? Because then it makes sense. You know, you set a baseline and those are the skills you need. And then you have value add with the critical thinking and the people skills and stuff. You know, people, you're dealing with people and not the tech. And it makes sense.
39:00Izar Tarandach Yeah. And you prove your skills along the way, not to your employers, but to your peers. So when you get from one level to the next, it's your peers saying you're entitled to that step level, not your workplace.
39:16Matt Coles And hiring managers then get the benefit of that. You have a trusted individual who's met a bar that's measurable and you have, and so you get a level of trust that you can then take advantage of. And I don't mean take advantage of in a bad way. I mean, it's a benefit from. Yeah.
39:35Izar Tarandach All right.
39:36Chris Romeo Well, we'll have to leave it here for today. Thanks folks for listening to another episode of the Security Table.
Transcript supplied by AssemblyAI. It may contain transcription errors.
Originally published as The Security Table. Part of the AI Security Table archive.
