Rethinking Security Conferences: Engagement and Innovation
With Chris Romeo, Izar Tarandach, and Matt Coles
In this episode Chris, Matt, and Izar discuss the current state of security conferences and gatherings for professionals in the field. They discuss the value and viability of different types of gatherings, the importance of networking and community-building at events, innovative approaches to conference formats and the need for something more engaging and participatory that caters to both introverts and extroverts.
About this episode
In this episode Chris, Matt, and Izar discuss the current state of security conferences and gatherings for professionals in the field. They discuss the value and viability of different types of gatherings, the importance of networking and community-building at events, innovative approaches to conference formats and the need for something more engaging and participatory that caters to both introverts and extroverts.
Personal experiences and preferences for conference attendance and speaking engagements are discussed along with hybrid approaches that combine presentations with facilitated discussions and interactive elements.
Follow AI Security Table:
➜ Home: https://securitytable.ai/
➜ X: https://x.com/AISecurityTable
➜ LinkedIn: https://www.linkedin.com/company/ai-security-table/
➜ YouTube: https://www.youtube.com/@AISecurityTable
Transcript · 26 min conversation
0:09Chris Romeo Wow, that would have been classic TV right there. He's art jumps into his chair following a countdown with the Muppet Show theme playing during his entry. All right, so here, here's the question of the day. So if you were one of the Muppets, which one would you be? That's, uh, yeah, it's something you got to really ponder there.
0:37Matt Coles So I don't know, would you want to be Beaker or the Professor?
0:43Chris Romeo I was thinking the Swedish Chef.
0:45Izar Tarandach I'll have to go with Waldorf.
0:50Chris Romeo Oh, is that one of the guys that's up in the top? Yes. Yeah. Every time I go to— I got to— every time I go to Walt Disney World, which has been often the last number of years, They have this Muppet Show 3D adventure show. One, it's air conditioned, so it's always a good stop. It's a good place for 20 minutes of air conditioning. But I don't know why, I just love, I love the Muppets, especially in 3D, cuz then they have Waldorf and the other guy sitting up in the top, like as animatronics and they're making comments during, during the performance. It's just like, yep.
1:24Matt Coles And it's, are you, you're both, you're both Waldorf and the other guy.
1:28Izar Tarandach You, the other guy's my alter ego. But their best quote is from the opening song. Why do we always come here? I guess we'll never know. It's just some kind of torture to have to watch this show. So that actually brings us to what we've been talking about today.
1:48Chris Romeo Probably that might resonate with some of our audience, actually. Like, why are we here?
1:56Matt Coles What am I?
1:56Chris Romeo Why did I download this? You know, I guess the internet's basically free. You know, the bits that you download are basically free. So, you know, it's, it's not too bad.
2:05Izar Tarandach That's what you get for listening to us in the gym.
2:08Matt Coles Yeah.
2:10Chris Romeo And the southern coast of Australia, or maybe the northern coast. I can't remember where our, where our fans are there, but all right. We should actually talk about something serious. So Matt, you were, you eloquently titled the episode and now I've forgotten what you said.
2:25Matt Coles The lightning round of how security professionals gather or something to that effect?
2:30Chris Romeo No, you know, the first time it was a much more eloquent description—
2:34Matt Coles It's Monday, I lost it!
2:37Chris Romeo Much better collection of words but so...
2:41Matt Coles Yeah yeah maah mah merm mermermah wah wuhwup Various Muppet noises being attempted here. Ohh, that's it! You're gettin' your alien aliens from uh Wrong. That's Sesame Street.
2:56Chris Romeo That's not, uh, that's not a totally different show. Come on. Not even in the same universe, I don't think. Oh, maybe it's in the same universe. Who knows?
3:03Izar Tarandach Okay.
3:06Chris Romeo Kermit has arrived.
3:06Matt Coles For those listening to us at the, listening to us but not watching us, go watch us. Yeah.
3:13Chris Romeo Kermit has entered the, uh, entered the chat room. And now he's running across. All right. So secure. So in general, we're talking about how security professionals gather. Are there too many opportunities for gathering? Is there— is the return on investment for gathering still vibrant?
3:39Matt Coles Still vibrant or still viable?
3:41Chris Romeo I don't know. Viable. We'll go with viable. I like that better.
3:46Izar Tarandach Viably vibrant.
3:49Matt Coles So yeah, and I guess to level set this conversation, right, just for our audience members, there's different, uh, different types of gatherings that we can talk about, right? There's, there's standards bodies, there's professional organizations and conferences, and then there's stuff that's sort of in between, right? Uh, and it's an interesting question. Actually, Chris, that you, that you're raising is, first off, is there enough? Is there enough? And/or is there too much of one or the other? Or one where, where security professionals can come together and exchange ideas or talk about stuff or learn or whatever they want to do?
4:32Chris Romeo Is it overload?
4:34Matt Coles And is it still valuable, both as a professional as well as maybe an organization that's sending these professionals places? If they're, if anyone's sending people places.
4:45Chris Romeo Oh, people are sending, definitely. There's a lot of, uh, a lot of people from a lot of different places at, uh, the conferences that I attend. So it seems like people are back now being sent out as a reward, which I always thought was kind of odd, like that was a reward somehow. She got sent to a city, you know. Uh, maybe with not, not enough sunshine, you got sent to that city and that was your reward for being a great employee, was that you get to travel to Fort Lauderdale for, uh, when they go to listen to one of us, clearly it's an award. It's true. Other people, I don't know, but that's true.
5:25Matt Coles It's true.
5:26Chris Romeo 3 of us, definitely. That's true.
5:28Izar Tarandach The, the thing that I've been thinking about is after Everybody got so used to watching things on webinars and things like that. I can only speak for myself. I'm exhausted. I can't watch webinars anymore. Like sometimes there's an interesting webinar and I do prefer when they hand out the PDF. You can download the PDF of the slides rather than watching the whole thing.
5:57Chris Romeo I don't know why.
5:58Izar Tarandach I mean, it's always fun to participate in one. I'm not going to to diminish that, but I, I, it's so rare for me nowadays to be able to sit down and watch 1 hour of something.
6:13Matt Coles But it's also because you're, you're what you're, I think what you're highlighting is what is a conference for, or what is a professional engagement interaction for? Is it for the, is it for learning? Is it for influencing or is it for networking?
6:35Izar Tarandach Conference, what is it good for?
6:38Matt Coles For?
6:39Chris Romeo So, I mean, I have a similar, I've had a similar experience to what Izar just described. I find myself not going to talks a lot at conferences, but I will go back and watch them on YouTube after. But I've developed this really bad habit. I grab the little slider, I start scrolling across, and I just look at the slide. I kind of process the slide. Okay, makes sense. I don't listen. I just, I just basically watch the talk in 2 or 3 minutes as I scroll. Now, sometimes I'll hit a slide and I'll be like, oh, that's interesting. And then I'll let it play for a while.
7:16Matt Coles You could put the talk on, on 2x or 4x playback speed and take care of it that way.
7:21Chris Romeo Yeah, but that still would take me 15 minutes.
7:24Izar Tarandach You can ask the freaking AI to summarize the talk.
7:29Chris Romeo I think that on, um, I don't trust it.
7:31Izar Tarandach Misler's Fabric, he has one recipe in there where you can actually ask it to watch the, or to read the transcript of the talk and then grade the the, the, the speaker in terms of, I think it was self-promotion, depth, or something else. It's, it's, it's really interesting.
7:54Matt Coles So you're all, you're both highlighting the, the purpose of, of the talks then are they're, they're educational. You wanna learn something from it. It's a lecture. It's not necessarily in as interactive. And especially if you're not there, you know, obviously you can't ask questions or anything. but is that really the best use of your time, right? Education is important. Yes, we should all be learning still, but when it comes to conferences, right, there are, so summer's coming up, hacker summer camp as people like to call it. I don't know, it's, we have BSides, Black Hat, DEF CON, OWASP, uh, OpenSSF just had a conference, uh, PancakesCon, uh, you know, a host of others that are happening or have happened. You get the same talks at the same, at the, at the each successive conference.
8:48Izar Tarandach Well, but, but that's because you have a lot of speakers who it's a seasonal thing. They get one talk and they just go with it like across the year.
8:57Chris Romeo Right.
8:58Izar Tarandach I, I myself, I had some years that I had 2 or 3 conferences And I personally prided myself to not use the same thing, even though I was talking about the same subject, just because I didn't want to go into YouTube later on and see myself in 3 different things talking about the same thing with the same slides. But you know, I think that at some point we have to turn the table and say, okay, what's in it for the speaker, right? So yeah, you have all this work of developing the slides, developing the talk. Getting over what we already discussed, imposter syndrome, getting over, uh, uh, public speaking anxiety and so on and so forth. And, but what, what do you get? What do you really get?
9:42Chris Romeo I, I have to say, you get, yeah, you get, that's true.
9:46Matt Coles That's true. And I, if you're new, if you're new, that may be more important than, that may be more important than somebody like yourself, right? Who's been out there for the past couple years and people know who you are, right?
9:56Chris Romeo By name.
9:57Matt Coles They know who who his art is. Well, but, uh, but you know, somebody who's starting out new and, and actually, so let me, let me flip the question there for both of you since you're both, you know, basically you said you're bored when you go listen to these things.
10:14Chris Romeo I didn't say, hold on.
10:15Izar Tarandach No, no, no, no, no, no, wait. It's not bored. It's not bored. First of all, there's a lot of stuff happening in my widescreen and a lot of it demands my attention. It's really hard for me to focus 1 hour on 1 thing. So it's not bored.
10:28Chris Romeo I wouldn't say I'm bored. I would say I'm searching for new ideas, new things that I've not seen before. And a lot of times when you go through a talk, 75% of it is things that you just are part of the lore of AppSec, things we all just agree on. So I'm looking for things that are new and that are challenging me. And those are the parts that I stop and let it play for a while. Cause I'm like, oh, okay, this is something I don't know. I'm trying to learn from it, but I also don't want to kind of learn, relearn things I think I already know.
11:01Matt Coles Do you think that, do you think that, oh, go ahead. Oh, you first.
11:04Izar Tarandach No, no, that, that is actually a good point. Cause, uh, briefly, I, I, I've been going to, to talks lately and watching talks more to learn about how the speaker delivers the talk than the actual content. I mean, if the content is, is, is interesting, usually I'll reach out to the speaker and talk more about it. On a different way, different venue. We have lots of stuff that we can use for that. But lately it's been a meta thing for me. I remember that in Dublin, watching Chris deliver his top 10 DevSecOps fails or something like that. I wasn't even remotely interested in the content, but the way that he was delivering, that was the thing for me. Or later on, I watched, um, Keynote talking about ice cream, and I'm like, okay, this thing begins with something that's completely devoid of any connection to whatever it is that the thing is about, but then it converges and it all makes sense. And so, so that's changing the way that I deliver my, my talks, right?
12:10Chris Romeo But now you're, you're in a different. Group, then you're in the 1%. I hate to call us the 1%, but the people that speak at conferences though are like 1% of the population of people that are coming to the event. And so we're kind of, we kind of gotta flip the table around and start thinking about this from the folks that are newer to our industry that are coming to these events, right? Like we go to these events to see friends, to connect, to hang out, to challenge each other, have deep technical conversations, things like that. But that's because we've all been in the industry for 20+ years at this point, and we have a network of people, you know, I mean, one of the, one of the best things is going to a conference and getting to spend an hour with Brook Schoenfeld. Yeah. Priceless, right? Because he just challenges you and, and he is just so gracious and, and, but that's part of the conference experience, like I don't go to a room to listen to somebody talk. I can't get that experience. Right. And so, but I think we, I'm kind of thinking about this more from my own perspective versus a lot of people that are going to these events are not speaking. Maybe they're newer to our industry, maybe they're more introverted, so they're not as connected to the community. And that's one of the things that I really try to do at events. Like if I go to one of the mixers or something, like I always scan the room to see who's on the outside of the room, who's kind of like, I'm here because they had a free, uh, taco bar, but I really don't know anybody and I don't really want to talk. And I, I search out those people 'cause I'm like, in that type of a setting, I can talk to you guys. I'm gonna see you guys at the event in other places. I'm not gonna go huddle up with you guys in that type of event. I'm gonna be like, okay, I'm gonna go find some people here and just talk, just start draw them into the event and make them feel like they're part of the conference.
14:05Matt Coles You know, that's why I like, that's why I liked PancakesCon as a concept, right? The notion there is that when you're a speaker, you have two parts to your presentation. You have the technical thing you're talking about, and then you're talking about something else, you know, probably pancake related, you know, maple syrup and that sort of thing, but not necessarily. So something of interest and something that you find interesting. And, you know, and that way you have a, you have a natural icebreaker for the presenter to the audience. But it's still a lecture. It's still a, it's still a presenter to the audience, right? Not an interaction.
14:44Chris Romeo I don't know if you guys ever went, did you guys ever go to one of the Source conferences they used to have in Boston?
14:49Matt Coles I spoke at one of those. Remember, this was our first Source. Actually, yeah, Isar and I spoke at Source back in 2011.
14:56Chris Romeo Do you remember?
14:57Matt Coles Oh, 2011, you're right. Yeah, I spoke before that with, uh, with somebody else, but, um, the speed networking that they would do with that, that was brilliant.
15:05Chris Romeo And no, I tried it.
15:06Izar Tarandach Tell me more about that.
15:07Chris Romeo So what would happen with speed networking is you'd have, uh, you'd have everybody there. There was a segment of the conference. Everybody's in the big room and I don't remember how he split people up, but basically the idea was you would, you would basically just walk around and talk to different people for like 2 minutes or something. And he gave you a question. That to, to kind of start the conversation. Like, what's something you like to do away from work?
15:32Matt Coles Uh, this was Rob Sheen. Rob Sheen did this, right?
15:34Chris Romeo Yes. Rob. Yeah, yeah, yeah. And so, but it was brilliant because what I found is you then you end up talking to 10 or 15 people in that segment and then you see them the whole rest of the conference. 'Cause it was only like a 400 or 500 person conference. And so then the, the following 2 days you're in the hallway like, hey, what's up? How's it going? You know, like, Like you just, it just broke down. It broke the ice with a number of people. And so I thought that was brilliant. And that's his is the only event I ever saw the source of conference. The only event I've ever saw anybody try to do that.
16:04Izar Tarandach So I think that I mentioned before this time in Lisbon at the OWASP, we are trying something similar with the meet the mentor thing. And we got something like, I think 16 mentor volunteers and 26 or 20 5 mentee interests and we're just going to put all of them in the room and try to like speed date everybody and see what happens. But that's the reason behind this whole thing is what can we give as added value to people coming physically to a conference, right? And again, if you think from the side of the speaker, Apart from the glory and the money.
16:49Matt Coles Wait, there's money?
16:51Izar Tarandach Wait, there's money? Wait, there's glory?
16:55Matt Coles Well, actually, there is value. You get a free pass to the conference.
16:59Izar Tarandach True.
17:00Chris Romeo That's true. That's true.
17:01Matt Coles That could be worth lots.
17:03Izar Tarandach But at the end of the day, what you get, and even probably not in most conferences, but in some conferences, what you get is some kind of feedback, right? And what I've been seeing, and I hope that I am totally wrong, but this is completely anecdotal and, and, and whatnot. You get 50 people in the room to listen to your talk, you get 25 surveys of feedback. From the answers, you can see that at least 12 people from those 25 got into the room by mistake. The other 13 got in that room because they think that they know the subject better than you, and they are really, really, really wanting to point out that you are completely wrong in everything that you said after good morning. The problem is that the same 13 people, when you say any questions, will go crickets. There's no engagement, right? So something is broken in the way that we participate in talks as well.
18:05Matt Coles And because we don't have an IRC, because you don't have an IRC or Slack channel running during the, during the talk for those people who want to engage but don't want to be physically engaged.
18:17Izar Tarandach So we are a bunch of introverts.
18:20Chris Romeo That's a good one. I've seen that happen once where I was speaking, it was at ISC² conference and they've gone to a hybrid. in-person, but there's an online component as well for people that can't travel. And so there is like a chat room kind of setting. And there, there, there are questions that will come out from that where people, you know, maybe some people are just, they'd rather not stand in front of the microphone. I don't know about you guys.
18:49Matt Coles DEF CON did that with a Discord channel. They had a Discord channel for a lot of, like AppSec Village would do that.
18:55Chris Romeo So you could throw your questions in and have a conversation there. So. Maybe there's a new, maybe we need a new paradigm in talks here.
19:02Izar Tarandach You know what? You just gave me an idea. Saturday I'll be holding the microphone for Adam's session on ThreatModCon. I'm going to create a parallel channel and let people ask through it. And hopefully something even anonymous. What could I use for that?
19:23Matt Coles Yeah, SurveyMonkey or something like that.
19:26Izar Tarandach No, it needs to be something real-time.
19:30Matt Coles Ah, that's a little bit harder. You need instant registration.
19:36Izar Tarandach Yeah, I'll have to think about that one, but it would be great to have one like that, like in my pocket. Nobody raises their hand, which I don't think is going to be the case, but if needed to have something that I can pull from my pocket and just say, oh, we have a question in the live channel.
19:51Matt Coles Yeah, but, but, you know, so I mean, this is— Chris is raising a really good point, uh, that we— again, it goes back to that question of what— why are you there? Are you there for the interaction? Are you there for the learning? Are you there for the influencing? And if you're an introvert, as many of us are, even those, those of us who have worked for, for a long time to overcome that introversion, Uh, and by the way, going to conferences is one way to, to help with that, either speaking or being part of the audience and actually raising your hand when, when it's time for questions. Uh, but maybe we, maybe we've done this to death. Maybe we need a more interactive format. So something like where the presenter is more of a moderator and discussion leader for, for a collection of folks either in-house or, uh, and, and or online, right? And that way, and, and whether it's online virtual or on, you know, you know, VR, or you're online, uh, just on chat, um, you know, but that way you have, uh, you know, alternative ways to interact and still, and that way people can feel part of a conversation and maybe the conversation gets outta hand a little bit, but that's okay, right?
21:08Chris Romeo Yeah.
21:08Matt Coles They, uh, they're to to present but also to learn from others.
21:12Chris Romeo RSA does what they call, uh, birds of a feather or tabletop.
21:18Izar Tarandach Yep.
21:18Chris Romeo Types of environments that are in that format where there's a particular topic, there's a moderator, but they specifically tell you in advance, your job is moderator, not here to give a talk. You're here to facilitate conversation amongst the people in the room. And some of those, like the best Birds of a Feather sessions like that are where you as the moderator say something to start and then you can't get a word in edgewise the rest of the time, which those are the best ones, right? Because then it's people learning from each other's experiences and it's a different experience than listening to a lecture. Maybe we need a hybrid. Maybe we need somebody to come in and present on a topic for 20 minutes and then facilitate a discussion amongst the rest of the people in the room.
22:04Matt Coles To, or even come with a, even come with a plan, a plan, you know, a sort of, not a, not a lecture plan, but, or a talking plan, but sort of some sort of structured, not a, I don't wanna say presentation, but something where, where that person is a subject matter expert in the, in the, in the concept, in the, whatever the, the topic is. And maybe there is a separate moderator to interact, moderate, the interaction, but it becomes a part, a part of, a part Q&A, a part lecture, and a part discussion. And that way you have the, the subject matter expert who can— I wouldn't structure it as a 20-minute lecture and then, and then discussion. Have it be, you know, top, define topic, uh, maybe talk and answer questions, or talk and ask questions, or talk and then have a discussion and then repeat over the course of whatever the timeframe is. So something where it becomes more active, but, but people can be, feel a part of the process.
23:09Izar Tarandach So on, on the part of the process thing, I, I learned a new format from, uh, Dustin Lair, what he calls a, a white paper presentation where it's birds of a feather, but everybody knows that at the end, everything that you said goes into a document. And becomes a white paper on that subject. So people can edit the paper after the session until everybody decides, yeah, we got a paper here, so let's close and publish.
23:34Matt Coles Interesting.
23:35Chris Romeo That's a neat idea. Yeah, that's pretty cool.
23:37Izar Tarandach And we're going to be trying it at the Developer Day later this year. That's going to be fun, I think.
23:46Chris Romeo I hope. And this is the OWASP San Francisco global event. That Isar is working with OWASP to do a developer day the day before the main conference runs, just to start putting a plug out there for this event. And the idea, Isar, is to invite all the developers you know, right? To come to this.
24:06Izar Tarandach To invite developers and security champions to come and tell us what we're doing wrong. Actually, to hear their side of the story, right?
24:15Chris Romeo We're talking— AKA what we're doing wrong.
24:18Izar Tarandach Yeah, we've been talking about ourselves for a long time. About how do you do these things for developers, right? But we never gave them a voice to come and talk to security people and say, listen, it's great what you're doing. We love you. There's nobody like you anywhere.
24:35Matt Coles Yeah.
24:35Chris Romeo But, but is always— Stay away.
24:39Izar Tarandach Stay away. But go away. Shut up.
24:44Chris Romeo No, I think it's good though. I think it's time for security people to close their mouths and open their ears and just listen to what, what's, how the decisions that we make and the things that we say, how those impact developers. So my hope is that you can get enough developers and security champions in the room so that we can hear. So we'll keep talking about it.
25:07Izar Tarandach We are hoping that since it's San Francisco, it's going to be easy to get them.
25:12Chris Romeo Nothing's easy.
25:13Izar Tarandach But, uh, Hopefully we, at least the Security Champions, we can get a good number in there.
25:18Chris Romeo If it was easy, everybody would do it. So, but yeah, so we'll, we'll, but we'll talk about that some more as, as the year progresses here. That's September.
25:27Izar Tarandach That's September.
25:29Chris Romeo Yeah. Yeah. September 2024. All right. Well, we got to wrap up for today, folks. Just a quick episode around the security table. We talked about the Muppets. We talked about, uh, security conferences in general, and hopefully left you with a few ideas for how we could maybe do things differently. We'll, we'll keep thinking about this and we'll bring this back up at some point in the future. So thanks for listening to the Security Table.
Transcript supplied by AssemblyAI. It may contain transcription errors.
Originally published as The Security Table. Part of the AI Security Table archive.
