Transcript: From Code to Careers: AI's Disruption of Software and Work Itself
0:00 Brad It's like this is just another tool we've got.
0:19 Brad Hi, Brad.
0:20 Brad Welcome back. Good to see you for another episode of How Many CPTOs Does It Take?
0:25 Scott Good to see you, Scott.
0:26 Brad Yeah, and today is just another check-in on AI.
0:30 Scott Checking
0:30 Brad I
0:30 Scott in on
0:31 Brad saw
0:31 Scott AI.
0:31 Brad something on LinkedIn the other day I wanted to kick
0:35 Scott Yeah.
0:36 Brad the conversation off with.
0:37 Brad Kick the conversation,
0:38 Brad kick off the conversation.
0:41 Brad You know Kent Beck?
0:42 Scott Yeah.
0:42 Brad Do you know that name?
0:43 Scott Yeah.
0:44 Brad For any of our listeners who don't know Kent Beck,
0:47 Brad they should probably go look that guy up.
0:49 Brad You know, he's a pretty big deal.
0:51 Brad I don't know if he's a big deal, but he's influential. He's influenced all of our lives in this business.
0:55 Brad So I follow Kent back on Instagram.
0:59 Brad No, incorrect,
1:00 Brad on LinkedIn.
1:01 Brad And although Kent Beck's Instagram feed would probably be pretty funny,
1:05 Brad but that's not where I follow him. I follow him on LinkedIn.
1:08 Brad And he posted this the other day.
1:11 Brad Vibe coding is only ever as good as the genie.
1:15 Brad augmented coding is as good as the augmented programmer and that programmer can get very, very good.
1:22 Scott And Yeah.
1:23 Brad I really like that take.
1:24 Brad That aligns with how I've been thinking about AI recently.
1:32 Scott Yeah.
1:33 Brad So where are you at on it?
1:34 Scott Okay,
1:35 Scott well,
1:35 Scott first of all, that comment totally resonates with me. I agree with that,
1:40 Scott especially for like the state of play today,
1:45 Scott you know, like I am an augmented programmer.
1:51 Scott Every programmer on my team is an augmented programmer.
1:54 Scott And I believe that the programmers who
2:00 Scott are embracing it more wholeheartedly, are improving their skills more rapidly.
2:10 Brad Mm
2:10 Scott And
2:11 Brad -hmm
2:11 Scott the ones that were already good developers that are using augmented programming or AI-assisted programming,
2:18 Scott that's what I'm interpreting augmented programmer to mean,
2:21 Scott the ones that were already good developers,
2:23 Scott man, they are just.
2:25 Scott rocket ships.
2:27 Scott They are getting so much more productivity and they already were good and now they're getting more.
2:34 Scott Vibe coding,
2:35 Scott I haven't really done that much vibe coding.
2:38 Scott I do throw problems at the AI in a vibe code like way.
2:43 Scott They,
2:43 Scott depending on the size of the problem,
2:46 Scott it either does fine or I just throw it away because it just doesn't work.
2:52 Scott So that's so I kind of I think that's right like five coatings only as good as the genie as whatever the You know little agent does
3:02 Brad Yeah.
3:03 Brad Yeah,
3:04 Brad that's right.
3:04 Brad I think, so this is a lead into a hot take I have about AI.
3:09 Scott Right
3:10 Brad Potentially controversial.
3:12 Brad It's a two-parter.
3:14 Brad It's my current thinking subject to change.
3:16 Brad This is a strong belief loosely held.
3:19 Scott Yeah, I love it.
3:21 Brad AI is uninteresting and bad,
3:25 Brad but the genie is out of the bottle and we can't put it back, so we have to deal with it.
3:32 Scott Say more.
3:35 Brad You touched on it a minute ago when you said these engineers who are talented are becoming more talented, more productive.
3:43 Brad And I would say one out of a thousand, sorry, 999 out of a thousand things I hear about with AI are just making people more productive to make things which ultimately just makes more money for...
3:59 Brad you know some capitalist and I'm not sure what good that does for the world now a friend of mine said well what good does for the world is in theory it should bring prices down and when prices come down people buy more stuff or can afford more stuff and can have a better quality of life so in theory it should be good for the world but the other side of that coin of course is
4:23 Brad there is a massive climate impact on this stuff and
4:26 Scott Yeah.
4:26 Brad um there's i also started to develop some worries about like military applications of these things which is a little bit scary to start to think about um and so like when i sort of step back i'm kind of asking myself like so let's just fast forward like 25 years when it's all kind of matured a lot like
4:47 Brad Will humanity be in a better spot that we're in now or will we be in a worse spot?
4:52 Brad And I kind of think we might, I think in best case we'll be in the same spot and we might be in a worse spot.
4:58 Brad Now, I did say, you know, one out of a thousand things has been good.
5:03 Brad And I haven't done a lot of research and in fact, anybody who's listening to this, I would love.
5:08 Brad Maybe find me on LinkedIn and send me links to things, other things that are like this.
5:13 Brad I did read one article where they were able to use some of these technologies. I think it was more of a machine learning thing than a generative AI,
5:20 Brad but to detect breast cancer five years earlier in people.
5:24 Brad And I thought to myself,
5:26 Brad well, that is good.
5:27 Scott Yeah.
5:28 Brad Like that's really, that's making humanity better off
5:30 Scott Yeah.
5:30 Brad than.
5:32 Brad We are now, but making it so that like someone can make, you know, yet another social music recommendation engine a little bit faster.
5:43 Brad I don't know how great that is, especially given the climate impacts.
5:45 Brad And I also wonder if we ever in this world actually decide to price climate into things,
5:51 Brad actually put a carbon tax on stuff.
5:53 Scott There was an article that one of our listeners shared with me after one of the podcasts that we talked about with AI where we kind of we were talking about the climate impact of it.
6:05 Scott I'll make sure to find it and link it in the show notes.
6:08 Scott But it was
6:09 Brad Mm-hmm,
6:09 Scott a
6:09 Brad mm
6:11 Scott pretty detailed analysis and it kind of came back with,
6:14 Scott well, you're not actually spending that much energy relative to, you know, things you do every day anyway,
6:24 Scott like turn on your lights.
6:26 Scott You know, you basically make a way, way, way bigger impact on the climate by not flying.
6:34 Scott You know, flying
6:35 Brad Well, slime's the worst.
6:36 Scott is the worst.
6:37 Scott So but even just like, you know, driving your car a couple blocks versus this.
6:43 Scott So but but that being said,
6:45 Scott I don't want to dismiss that concern because I do think that's a valid concern.
6:51 Scott I.
6:52 Brad Can I ask you a quick question real quick?
6:53 Scott Yeah, sure.
6:54 Brad Did you read Bill Gates'
6:55 Brad book,
6:56 Brad The Climate Breakthrough, how to avoid a climate catastrophe or breakthrough?
6:59 Scott I have not.
7:01 Brad It's fascinating.
7:02 Brad I really enjoyed it. It's short.
7:03 Brad It's like 125 pages.
7:05 Brad I'm sure you can find a PDF of it online because he was trying to get out of it, get it out to everybody.
7:09 Brad And it was a very nuts and bolts.
7:11 Brad Like imagine a pie chart of the entire economy,
7:14 Brad different sectors,
7:15 Brad agriculture,
7:16 Brad construction,
7:17 Brad things like that, healthcare,
7:18 Brad and like how much carbon each of those produced.
7:20 Scott Mm
7:20 Brad and then he broke down each slice of the pie chart like what were the problems in that space and where did we have solutions and where did we not have solutions as
7:28 Scott -hmm.
7:28 Brad a society and where did we have solutions that were cost affordable where did we have solutions that were not cost affordable and where did we not have solutions and it was just a very nuts and bolts like understanding to get an understanding of like where is
7:41 Brad I made the comment a minute ago, like air travel is the worst.
7:44 Brad Just give me a very good basic understanding of like,
7:46 Brad well, where are the real opportunities and costs?
7:48 Brad And like something that stuck in my mind was, you know, cement,
7:52 Brad cement's very carbon, produces a lot of carbon.
7:54 Brad We don't have a solution.
7:55 Brad Nobody's got an alternative
7:56 Scott Yeah,
7:56 Brad to
7:56 Scott I
7:56 Brad cement,
7:56 Scott think I'd
7:56 Brad right?
7:57 Scott seen that before.
7:58 Brad And
7:58 Scott Yeah.
7:58 Brad so it was just it's a quick read to just kind of like get a baseline of like facts.
8:04 Scott I will check it out.
8:05 Brad Anyway,
8:05 Brad you're you're you're going on somewhere.
8:07 Scott Well,
8:08 Scott I was going to say that.
8:10 Scott OK,
8:11 Scott so here's my here's my current take on this.
8:17 Scott I'm less worried about the climate impact,
8:20 Scott but I want to I'm not discounting that.
8:26 Scott I am a little bit, first of all, I'm cynical of the it's going to replace all developers in six months. It's going to replace all developers in, you know, a year.
8:41 Scott Um,
8:41 Scott because of what I just talked about, what we started this episode with this notion that you have to already be skilled to really be useful with it and that the other stuff really kind of, if anything,
8:52 Scott like all the vibe coding is probably creating more developer jobs because they're going to have to come back and fix all that garbage,
8:59 Scott you know?
8:59 Scott So there's, there's, I'm a little bit less worried about the sort of the really, really short term impact of this.
9:06 Scott But watching how quickly this is moving and someone who uses it regularly,
9:13 Scott I do think there comes a point in the not too distant future where enterprises that have software developers working for them, and I'm going to extend this to other white collar jobs,
9:27 Scott but enterprises that have.
9:30 Scott Software developers working for them are going to be hiring people like you and I as CTOs to say,
9:36 Scott hey,
9:36 Scott my competitor used to have 100 engineers and now they only have five and they're outpacing us.
9:46 Brad Mm
9:46 Scott Help
9:47 Brad -hmm.
9:47 Scott me help me cut my costs that way.
9:53 Scott Absolutely in the next,
9:55 Scott I have no doubt that in the next five years, a team of five engineers will outperform a team of 100 engineers from today.
10:07 Scott I'm certain of that based on what I'm seeing in this trajectory.
10:12 Brad Mm-hmm
10:13 Scott And so.
10:16 Scott It doesn't mean that no engineers are working and the AI is doing all of it,
10:20 Scott but I think that there's a very serious reckoning coming for like you said, this is basically similar to what you just said, which is like it just makes us more productive,
10:31 Scott right?
10:32 Scott Well,
10:32 Scott what happens when capitalism makes things more productive when you get more out of an individual worker than you did you previously got out of?
10:42 Scott 10 individual workers is you eliminate nine of those workers.
10:48 Brad Yeah, or you can produce more for the same cost.
10:53 Brad Like if I can produce,
10:54 Brad if I'm just thinking,
10:56 Brad maybe this only applies like a manufacturing, not a creative thing like software engineering, but if I have a factory, I can produce 100 widgets with 100 workers and I 10x their productivity and now I can make 1000 widgets with 100 workers.
11:10 Scott Yeah.
11:11 Brad My options are I could get whatever, get rid of 90% of the workers and make the same amount. But if I can, if there's the demand for my product.
11:19 Brad I can sell
11:21 Scott Well,
11:21 Brad more and I can bring the price down to sell more.
11:24 Scott yeah,
11:25 Scott I think, though, that I guess this is now this is my, you know, on the similar like dark turn that you're taking about like,
11:34 Scott hey, we're not just making anything better. I'm just I'm just putting on my my capitalist hat here. And I think that like.
11:43 Scott Like, I don't think that the limiting factor is the number of people writing code,
11:47 Scott right?
11:48 Scott Like most enterprises,
11:49 Scott that's not the limiting factor.
11:51 Scott If anything,
11:52 Scott you know, the limiting factor tends to be ideas,
11:56 Scott right?
11:57 Scott Like good ideas,
11:58 Scott right?
12:00 Scott And so maybe if you really did have an enterprise that is sitting there saying.
12:08 Scott Oh, it turns out like we have a lot of really great ideas and we're just unable to move as fast as we can to build them.
12:16 Scott Sure,
12:17 Scott for those enterprises,
12:18 Scott it's going to be a boon for them.
12:23 Brad Yeah, if you're a capital constrained enterprise.
12:27 Brad See,
12:27 Brad it's actually a boon for them.
12:29 Scott Well,
12:29 Brad Yeah,
12:29 Scott and this,
12:30 Brad interesting.
12:30 Scott by the way, this,
12:31 Scott by the way, is why I was so excited when we had when we chatted with Justin Kaufman and when we chatted with Justin Wolf and Joe Malik, those are two examples of something that I think for the next.
12:43 Scott five years is a really good example where if you are just two guys in a garage or one guy in a garage and you have this idea of something you want to implement that's a perfect example of a kind of a capital constrained software
12:57 Brad Mm-hmm,
12:57 Scott development exercise and
12:59 Brad mm-hmm.
13:00 Scott I there's no doubt in my mind that if you if you have if you're if you've got an idea you've got a smart engineer that knows how to build something and you've got the right ideas
13:10 Scott Then, boom,
13:11 Scott augmented generative AI,
13:13 Scott strong engineer,
13:15 Scott all of a sudden makes things so much easier to implement.
13:19 Scott So that I'm excited about.
13:22 Brad Mm-hmm.
13:22 Scott But there's, I mean, you know, you and I've been doing this engineering leadership thing, you know, CTO, VP,
13:29 Brad Long time.
13:30 Scott engineering manager for, you know, 20 plus years each, 25 years plus each.
13:36 Scott You know,
13:37 Scott like it's a bell curve about the talent of your engineers and that middle, that hump of that bell curve,
13:45 Scott that's where the productivity is being,
13:49 Scott you know, candidly, that's where productivity is wasted.
13:52 Brad What do you mean wasted?
13:53 Brad That isn't what I thought you were going to say, so now I'm curious.
13:55 Scott That's the team members.
14:00 Scott that are going to be easily replaced by a 10x engineer.
14:03 Scott If you're a 10x engineer already,
14:05 Scott and now you're getting augmented by AI,
14:08 Scott you become a 100x engineer.
14:11 Scott And it doesn't make sense for an enterprise to employ the other 90 engineers.
14:19 Brad Yeah,
14:20 Brad the thought that came to my mind when you were talking about that bell curve is
14:23 Brad for wherever you are on the curve right now at this moment in time and probably for the next few years at least at least the next two maybe more so wherever you are on the curve right now you have an opportunity to move yourself up the curve overall
14:40 Scott Well, the curve's just moving.
14:43 Brad the curve might be moving but you have a chance to get ahead of the curve right
14:47 Brad You know, if you were NX, you can get yourself to N plus something and be more valuable for a while, maybe advance your career or whatever.
14:55 Brad And, you know, maybe the rest of the world catches up to you or maybe you break out, break,
15:00 Brad you know, reach escape
15:01 Scott Break away.
15:02 Brad velocity.
15:03 Scott Yeah,
15:03 Brad Right.
15:03 Scott reach escape velocity.
15:04 Scott Right.
15:06 Scott For
15:06 Brad But
15:06 Scott sure,
15:06 Brad there's
15:07 Scott 100
15:07 Brad a.
15:07 Scott percent,
15:07 Scott we should be encouraging everybody to do this. I agree with that statement.
15:11 Scott Like now's your chance to get better.
15:15 Scott For sure.
15:15 Brad Yeah,
15:16 Brad it's an opportunity.
15:18 Brad And yeah,
15:19 Brad I think nobody quite knows like how much how much it's going to change the industry.
15:24 Brad But certainly, I think if you're on the
15:31 Brad I'm going to say leading edge,
15:33 Brad but the more the getting more out of an edge than others, you're just you're shifting yourself up the curve,
15:38 Brad which is good.
15:39 Scott Yeah, so here's an example of kind of why I think this is this here's an example of like the last couple of days I've been doing this experiment and I think it speaks to kind of like this story exactly.
15:53 Scott Right. So.
15:56 Scott You know, longtime listeners of the pod will know that we have a very simple website for the How Many CTOs pod.
16:06 Scott um dot com i mean cto's pod.com and i you know we when we first launched this thing we had this chance like well let's go just use some hosting service and there's like a plug and play things and you just you whatever do your thing and and they'll make it all fancy and stuff and you know you and i didn't really talk a lot about it but i kind of resisted that idea and said i kind of want to do something i want to like build a little website for us and a big reason behind that was because
16:30 Scott I wanted to keep my axe sharp,
16:32 Scott right?
16:32 Scott Like, yeah, let me let me kind of use it as an experimenting ground that I can play around with the latest technology.
16:39 Scott And and you you don't I'm sure you don't log into the website regularly, Scott,
16:46 Scott but just recently I was like, I'm just going to start throwing projects at.
16:51 Scott you know, open AI codecs and just let it do it and see what it comes back with. Now I won't merge it and deploy it unless it works,
17:00 Scott but
17:01 Brad Mm-hmm.
17:01 Scott I've just started giving it tasks and without,
17:07 Scott with very little, very little guidance on my part, just a paragraph at most or two sentence description of what I want.
17:16 Scott it's turning around and doing it um
17:19 Brad It's pretty cool.
17:19 Scott you know examples examples are things like here let me let me pull this up just kind of read off some examples of stuff i've asked for it to do recently so um i asked it to um create a patreon call to action component and add it to the home page you
17:39 Brad Yeah
17:40 Scott Right.
17:40 Scott I asked it to create a listen on all you listen on your favorite service call to action. And, you know, you can go look at the website now it it made this it just out of the box made this nice little clickable buttons that have like Apple podcast logos and Patreon logos and it just did it, you know, and
18:05 Scott I have my own personal website that, um,
18:08 Scott is just kind of like a personal brand website and I've been throwing tasks at that too. You know, like, um,
18:13 Scott you know, one of my pages on my personal website is about my mountaineering. And so it's like, how many mountains have I climbed on the Bolger list?
18:21 Scott And so I asked it, I go,
18:23 Scott Hey,
18:23 Scott in real time, go over to this website,
18:25 Scott Peak Bagger, find me and download all of my Bolger summits and.
18:30 Scott Print it in a cool little, you know, fancy looking HTML timeline thing.
18:39 Scott It's
18:39 Brad So
18:39 Scott doing it.
18:39 Brad you reminded me of something.
18:43 Brad it's like a tool it's a new tool that you've got and i remember many years ago
18:49 Brad i did a kitchen remodel in a house i lived i did not do the kitchen remodel um i
18:54 Scott You project
18:55 Brad did
18:55 Scott manage.
18:55 Brad do the demo i did do the i did do the demo which was super fun and i did help it was my friend who was really he was a carpenter and he really did the work and i helped out a little bit um but i wasn't i don't i
19:08 Brad I'm not great at it let's be honest I'm not great at it and but the thing I do remember was that when he started he kind of moved in like he didn't move into the house he moved into the
19:18 Brad brought all his tools basically and like our whole basement was filled with tools he had a tool for everything you
19:25 Scott Yeah.
19:25 Brad need to do one little thing oh i've got a tool for that you need to do this oh i got i got a specialized tool for that and of course carpentry has been thousands of years right maybe not thousands hundreds i don't know how long carpentry has been around but um and
19:37 Scott Well,
19:37 Brad so it's like this is just like oh
19:38 Scott supposedly what?
19:40 Scott Joseph was a carpenter, right?
19:42 Scott So it's been at least 2,000
19:43 Brad that's right
19:44 Scott years.
19:44 Brad yeah yeah jesus was a carpenter yeah
19:45 Brad Yeah, that's right.
19:46 Brad Well,
19:47 Brad this is actually this is a super big digression.
19:49 Brad I had this I had this I had this little talk that I give sometimes about why is your project behind schedule.
19:56 Brad And this is what I like to say. I say, look, depending on the research.
19:59 Brad to read dwellings places where people live are somewhat between somewhere between 5,000 and 11,000
20:07 Scott Right
20:07 Brad years old in Europe in Europe they found evidence of dwelling from 5,000 years ago in Asia they found evidence of dwelling from 11,000 years ago we've been building houses for so long that there are generally accepted ways for how to build them
20:24 Brad all sorts of standards and conventions and you know things like that in fact to the point where our governments have codified the proper way to build dwellings and we have inspectors that come ensure that it's being done the right way and
20:43 Brad the construction industry is notorious for being over budget and behind schedule
20:50 Brad Now we've been building software for what,
20:52 Brad 75 years maybe,
20:53 Brad you know, 80,
20:54 Brad something like that.
20:57 Brad There's no
20:57 Scott Yeah.
20:57 Brad generally accepted ways for doing anything.
21:00 Brad And when there is a generally accepted way for doing something,
21:02 Brad you know what we do?
21:03 Brad We encapsulate it into a library so we don't have to do it anymore.
21:06 Brad Every kitchen and bathroom that gets plumbed in the world, you've got to plumb it over and over again.
21:11 Brad Every time you want to make a, I don't know, HTTP request, you just use your library that someone did and do it over and over again.
21:17 Brad and so um i completely lost my
21:21 Scott Well,
21:21 Brad train of
21:22 Scott I thought think your
21:22 Brad but
21:22 Scott point is...
21:23 Brad are we talking about carpentry we digressed on carpentry we've been doing carpentry for a long long time okay so it's yes what i was getting at is it's like this is just another tool we've got and right right now the tool is good at doing you know relatively kind of simple things in the grand scheme of things um and maybe the tool will get better and better at doing
21:44 Brad more and more complicated things maybe we'll see fragmentation it won't be one giant LLM that can do all sorts of stuff but like here's my LLM for doing stupid web tasks and here's my LLM for making message cues here's my LLM for
21:59 Scott Yeah.
21:59 Brad doing this other specialized
22:00 Scott Well,
22:00 Brad thing because all these tools were specialized that my friend had
22:04 Scott yeah, that's fair.
22:06 Scott I think though that
22:09 Scott Again,
22:10 Scott this is obviously anecdotal on my part,
22:12 Scott but I've just watched the rapid change and how much better it has gotten month over month.
22:23 Brad Yep.
22:29 Scott I mean, obviously software is my expertise,
22:33 Scott right?
22:33 Scott That's what I've done my entire career.
22:35 Brad Mm
22:35 Scott And
22:35 Brad -hmm.
22:35 Scott so it's a little bit maybe naive of me to attempt to extrapolate to other office jobs.
22:49 Scott I think there are probably a lot of office jobs. And you remember when we talked to John Helm about it, he's like,
22:55 Scott you know, look, a lot of getting by in the world is just pattern recognition,
22:59 Scott right?
23:00 Brad Mm-hmm.
23:01 Scott And I think there are a lot of jobs that are essentially these kind of like mechanical
23:11 Scott pattern recognition if you see
23:15 Scott this than do that type jobs and just like we saw in the robotics you know not the industrial revolution but like you know the robotics revolution that happened in the last 50 years um you know like yeah sure there's still there's still auto manufacturing plants in the united states and in the world but
23:40 Scott Instead of having 100 human beings on the line,
23:44 Scott they have five human beings on the line and 100 robots.
23:50 Brad Yeah.
23:50 Scott And so I think that same sort of like consolidation is destined to happen to these types of jobs. And I rank like.
24:07 Scott software engineer is like one of the one of the ripest targets because you know that's where the that's where the llms have been getting all the practice you know but i think that um i don't see any reason why that same thing's not going to happen to accountants or
24:29 Scott I mean, I think there's going to be several jobs like lawyers and doctors and accountants that are essentially protected by, you know, essentially like licensure and like,
24:42 Brad Mm
24:42 Scott you
24:43 Brad -hmm.
24:43 Scott know, kind of regulatory constraints.
24:49 Scott But what does what does technology do when there's a regulatory constraint? It always goes around it.
24:56 Scott Right.
24:57 Brad Fine boy.
24:58 Brad So if you were giving advice to a young person, somebody who may be recent high school or college graduate,
25:07 Brad coming into the beginning of their adult life,
25:11 Brad beginning of their career with tremendous uncertainty about how the workplace is going to shape up,
25:18 Brad what advice would you give them?
25:22 Scott Man, I don't know.
25:25 Scott But
25:25 Brad It's
25:25 Scott buckle
25:26 Brad a tough one, right?
25:26 Scott up.
25:27 Scott I think that like, you know, one of the, you know, I think that like, there's this narrative that liberal arts education,
25:40 Scott right?
25:41 Scott People don't understand the word liberal in that context. A lot of times they think it's like a political statement,
25:45 Scott but really it just means the notion of like,
25:48 Scott you know.
25:50 Scott being fluid in your ability to take on new ideas and therefore explore new concepts.
25:56 Scott So I think that one of the biggest benefits of a liberal arts education is the ability to be adaptable and use critical thinking skills and problem-solving skills to apply to a lot of different topics.
26:12 Scott That's the essence in my mind.
26:15 Scott And I think that's going to be really important.
26:19 Scott I think flexibility,
26:20 Scott the ability to be, to adapt,
26:24 Scott the ability to try new tools,
26:27 Scott not be afraid of trying new tools,
26:29 Scott to try to apply your energy and your intellect and your problem solving and your critical thinking to any possible endeavor.
26:40 Scott I think
26:41 Brad Mm
26:41 Scott is going
26:41 Brad hmm.
26:41 Scott to be really important.
26:42 Scott That's one thing I would say.
26:46 Brad I think that tool that tools piece is valuable,
26:48 Brad like whether it's learning how to use Microsoft Excel or Google Sheets or whatever,
26:52 Brad just just knowing how to use these that are and they're evolving, too, but just having some.
26:58 Brad level of technical skill and today they do right i mean kids do they've been using these tools since elementary school or whatever but that's
27:05 Scott Yeah, so I would definitely say to people that if you're resistant to using generative AI,
27:11 Scott please try to get past that resistance because...
27:17 Scott it's going to be it's just like we said this before it's like a spell checker why would you not use a spell checker right
27:23 Brad Yeah.
27:23 Scott oh
27:24 Brad So here's a question for you.
27:26 Brad You said earlier,
27:27 Brad I mean, it's moving so fast.
27:29 Brad It's like you blink and it's changed.
27:33 Brad Every week there's new models, there's new technologies.
27:37 Brad You can't even,
27:38 Brad I mean, I can't even keep up. I've actually given up on trying to keep up.
27:41 Scott say no say no you're giving up
27:45 Brad well it's just it's too much like the stay current on what's really happening is really tough it's a full-time job uh so my my question for you is um okay i'm going to set up this question with kind of a funny little quote uh bill graham who was famous music promoter in the 60s and 70s promoted brought did had a lot to do with bringing the grateful
28:05 Brad dead to fame actually I don't think this is a Bill Graham quote this may be a Jerry Garcia
28:08 Scott Okay.
28:09 Brad quote he talked he said it was Jerry Garcia he said you know we only play one key but we play the shit out of that key
28:16 Scott Yep.
28:16 Brad um
28:19 Brad And so my question for you is, you know, if you're talking to a young person,
28:23 Brad do you think it's better for them to sort of try to stay current on what's happening or is it better to like the grateful there's like just find one
28:30 Scott No,
28:30 Brad tool that seems to work for you and just like get really good
28:33 Scott I
28:33 Brad at it.
28:33 Scott think generalists are the key to the future.
28:35 Scott I think specialization is a dangerous road.
28:39 Scott I think the more specialized you are, the more likely you are to be replaced by.
28:45 Scott uh an algorithm you know like a
28:48 Brad Interesting.
28:48 Scott uh you know one of the my one of my my buddies and i were
28:52 Scott out during a ski tour a couple weeks ago when we were talking about this notion and you know the highest paid salaried job in the U.S. is anesthesiologist now obviously people make more money doing other things like sales and they have you know compensation that's not just like salary based but like anesthesiologist most highly paid job
29:17 Scott hourly or being salaried um it's a hundred percent a structured algorithm now
29:26 Brad Mm-hmm.
29:26 Scott you've got somebody's life in your hands um and you've got to be paying attention to the specific details of this human being that's under your your you know anesthetic control but i think that's a great example of a highly specialized job
29:43 Scott takes years of specialized training and it is one thing you're sitting there you're not you're not involved in anything else that's happening to the patient you're just sitting there paying attention to the you know the real-time readouts of that patient and adjusting adjusting whatever you've given them that is 100 replaceable by a single anesthesiologist monitoring you know hundreds of
30:11 Scott technicians using AI to just mostly get called shots.
30:19 Brad Let me come at the question just a little bit differently.
30:21 Brad I mean, like.
30:22 Brad I'm 23 or 27. My age doesn't matter.
30:26 Brad I'm just, I could be 53.
30:28 Brad I'm in the workplace.
30:29 Brad Oh,
30:30 Brad this week, OpenAI introduced their new thing. Oh, this week, Gemini introduced
30:33 Scott Yeah.
30:33 Brad their new thing. Oh,
30:34 Brad this week, Cursor has
30:35 Scott I'm
30:36 Brad a new version.
30:36 Scott not paying
30:36 Brad Oh, there's
30:36 Scott attention
30:37 Brad this new thing
30:37 Scott to
30:37 Brad called that. WinServe.
30:38 Scott I'm not paying attention to that.
30:39 Brad Yeah.
30:39 Scott I'm more like, you know, every couple weeks I look at.
30:46 Scott i just look at what the what the current zeitgeist is and then i pick and choose and i'm not like i'm not i'm not one of these fanboys that's like constantly just reading hacker news to see the latest thing i don't think there's a ton of because it's churning too much right now so i think you have to avoid the churn like there's no value in that but just got to be looking at the trend line
31:08 Brad Well, that's what I mean. Like if I'm an engineer,
31:09 Brad is it better to just say, look,
31:11 Brad I'm just going to use cursor and figure out how to squeeze as much juice out of cursor or is it better for me to go,
31:18 Brad yeah,
31:19 Brad I've been using cursor,
31:20 Brad I've been using augment code,
31:21 Brad I've been using WinSurf, I've been using codex, whatever.
31:24 Brad I'm using sort of all of them or is it better just like, hey,
31:26 Brad I, you know.
31:27 Brad And I know cursor and I know how to squeeze all
31:30 Scott I
31:30 Brad the juice
31:30 Scott think it's way I I well I would I would say it this way this would be my advice my advice would be
31:37 Scott Up level what you're doing.
31:38 Scott If you came to me, if you're the engineer that comes to me and this is our one-on-one and we're kind of coaching here,
31:44 Scott I'd be like,
31:44 Scott hey, it's great that you're using cursor windsurf.
31:47 Scott You know, great.
31:47 Scott I go try other ones just to make sure.
31:51 Scott But what's really important,
31:53 Scott Scott,
31:54 Scott what I really want you to be doing right now is I want you to be paying really close attention to the way you prompt it and what its results look like.
32:01 Scott And I want you to be focusing on just like when I ask you to do a code review for Janet's PR that she just put up and I talk to you about how you as an engineer pay attention to another person's code,
32:14 Scott that's what I want you to optimize right now. I want you to be treating this thing like another engineer and I want you to focus on your skills about understanding complex software tasks,
32:24 Scott understanding what
32:27 Scott the current LLMs are good at and evaluating when they do it correctly.
32:32 Scott That's what's going to make you strongest. And what that's really about is that's not anything to do with cursor or WinSurf or which model was being used.
32:42 Scott Like none of that matters because none of those things are going to exist two years from now or none of them are going to exist in their current form two years from now.
32:50 Scott But what will exist is these AI assistants,
32:54 Scott AI agents,
32:55 Scott and they will evolve.
32:57 Scott in their ability for you to instruct them.
33:00 Scott And I want you to go up a level.
33:04 Scott Don't think about you're in cursor.
33:06 Scott I want you to think about you're collaborating with this agent.
33:12 Scott That's where I need to get you.
33:15 Brad That's great advice.
33:16 Brad This reminds me something. I have to look up something really quickly.
33:19 Brad Are you familiar with the Kinefin framework?
33:21 Scott No.
33:23 Brad Okay, C-Y-N-E-F-I-N,
33:26 Brad connection framework.
33:27 Brad So connection framework is a conceptual tool for understanding and managing situations,
33:34 Brad environments,
33:34 Scott I'm glad you picked that up.
33:35 Brad and yeah,
33:37 Brad and it describes four kinds of environments.
33:41 Brad Let's
33:42 Scott Oh,
33:42 Brad see here,
33:42 Scott yes.
33:42 Brad trying to find complex and chaotic.
33:46 Brad Simple has a very direct relationship between cause and effect.
33:52 Brad Complicated, there's a relationship, but it requires some sort of exploration or understanding or a sense of expert knowledge.
34:01 Brad Complex is the relationship can be only perceived in retrospect. You can't quite know it in advance.
34:06 Brad And chaotic is there's no relationship between.
34:08 Brad helping these things between cause and effect and so to some degree what AI is doing
34:15 Brad if simple is the most simple at the bottom and complex is at the top, it's sort of shifting us up a little bit, right?
34:24 Brad When you were typing your code,
34:25 Brad you're kind of somewhere in the simple complicated range,
34:28 Brad like cause and effect is very clear. I forgot this semicolon and now it doesn't work, right?
34:33 Brad And it's by talking to the...
34:36 Brad the agent or the bot or whatever you want to call it the ai and having it give you an answer and then having it's kind of moving us between more between complicated and complex which is now you're having to evaluate your prompt and the result that your prompt got which is not cause and effect well it is cause and effect but we definitely have to like probe and sense
34:57 Brad and analyze that cause and effect more than we used to have to.
35:00 Scott I had not heard of this framework with that name before,
35:03 Scott but I had recently I have recently been hearing about this this notion of like simple complicated and complex systems.
35:12 Scott And and I was listening to some I can't remember which podcast it was now that I think about it, but it was probably like I don't know what podcast it was, but there was some person on there and they were.
35:22 Scott They were basically saying that we humans,
35:27 Scott particularly scientists,
35:29 Scott particularly like policymakers,
35:31 Scott particularly like technologists, we convince ourselves that we can understand complex systems.
35:43 Scott But actually, we don't have any complex systems in the world yet.
35:48 Scott We have some very complicated systems, and we convince ourselves that those very complicated systems are complex systems.
35:57 Scott But actually, they're just very complicated.
35:59 Scott And the moment that we actually are confronted with a complex system.
36:04 Scott We are not going to be able to reason about it.
36:06 Scott And this particular person was raising this in the context of AI saying,
36:10 Scott true AGI will be our first real complex system that we do not really understand and cannot understand. And we are kidding ourselves when we – because a whole bunch of us think we already understand how to – there's some complex systems out there that we're figuring out.
36:30 Scott And he's like,
36:31 Scott no,
36:31 Scott no, no, no.
36:32 Scott Those are merely complex systems.
36:35 Brad So let me test that. I like that idea, but let me test it for a second.
36:39 Brad The weather,
36:40 Brad is
36:41 Scott I
36:41 Brad that complex or complicated or just very complicated?
36:44 Scott think that it's a very complicated system.
36:47 Scott It's a very complicated system,
36:48 Scott but we call it a complex system.
36:50 Scott That's a good example.
36:55 Brad Oh, yeah.
36:55 Brad I wonder if the distinction there is our ability to actually understand the relationships.
36:59 Brad We don't have it. Therefore,
37:00 Brad it seems complex to us.
37:02 Brad And but it's not actually complex if we were smarter,
37:06 Scott yeah like
37:06 Brad had
37:06 Scott there was this what
37:07 Brad more science
37:08 Scott was this
37:08 Brad or
37:08 Scott what
37:08 Brad whatever.
37:08 Scott was this thing that happened like um
37:11 Scott We just saw this where it's like a bunch of policy changes were made around the use of particular fuels for cross,
37:22 Scott you know, transatlantic and transpacific, you know, freighter systems. And those went into place internationally and we had a significant reduction in a particular greenhouse gas that was being emitted by these.
37:37 Scott you know freighters and it like materially like changed like yes like we are doing a better job and guess what happened ocean ocean temperatures have risen because this greenhouse gas was also effectively reflecting back sunlight
37:58 Scott So it was both trapping it down,
38:00 Scott but it was also reflecting it away.
38:02 Scott And so now we basically are actually like and someone could have definitely like said,
38:08 Scott hey, that that's like an understandable cause and effect, but they just didn't run all the numbers. So it is just a very complicated system.
38:16 Scott But then they're like, oops,
38:17 Scott didn't think about that one. That was a complex interaction.
38:22 Brad I think in the Knefet framework, at least, that would be called complex because
38:26 Scott Yeah, fair
38:27 Brad you can't understand until after the action occurs what is going to happen.
38:34 Scott enough.
38:34 Scott I definitely feel like with the dawn of more and more powerful AI models,
38:40 Scott I think we're moving into the zone of truly complex.
38:44 Brad Right. Well, it's where I was getting at is just you're talking about you're coaching an engineer saying pay attention to what the agent is doing or the AI is doing.
38:52 Brad It's like we're having to go from something which was very deterministic. I wrote this code.
38:57 Brad It does this thing.
38:59 Brad And sometimes it doesn't do what you think it does because you oh I didn't quite understand what was happening but in general the code does what you wanted it to do to now like you tell the AI to write something and it might not write at all what you expected because you didn't phrase it right it's it's much less clear to us.
39:16 Brad The inputs and outputs.
39:17 Scott Yeah, that does that kind of stuff to me all the time, which is why one of the reasons I like my experiment of like throwing random tasks at codex and just like looking at its pull request and like, you know, closing it with, you know, severe prejudice when it gets it wrong, you know, just like wrong.
39:35 Scott kill you know and and i'm not talking about super complicated things i'm asking it to do and it still fails to do it so it's still got a long ways but it's getting much better and i think that the concern i have for all those software engineers in that in that you know middle of that um bell curve is do they know good code when they see it do they
39:59 Brad Correct code when they see it.
40:02 Brad That's the most important thing.
40:04 Scott I mentioned this the other day. I might have said it on an episode we recorded last week or something.
40:10 Scott I was recently trying to use.
40:12 Scott to chat GPT codecs to try it out and I thought of a little idea for a mobile
40:17 Brad Yeah.
40:18 Scott app that I was like this would be fun and I thought well I'll try and do this I'll have the agent do it and the first step I said can you make me the boilerplate for a react native application and I don't have a lot of experience with react native I've made some hello world apps before some fart like a duck kind of apps and
40:37 Scott I guess you'd say quack like a duck, not fart like a duck,
40:40 Scott but whatever.
40:40 Scott I've made some of the last word, but I've never.
40:42 Scott So anyway,
40:42 Scott it spit out. It's OK.
40:43 Scott We did it for you.
40:44 Scott It spit out a pull request with 60 files.
40:48 Brad Yeah.
40:48 Scott And the very first thing I thought to myself was,
40:51 Scott I don't know if this is right.
40:53 Scott I don't know it I don't know I don't know enough about React Native to know
40:56 Brad Yep.
40:56 Scott if this is right and you know I didn't know what to do at that point I guess I got an idea for what to do but like it was kind of like this is interesting if you don't know what correct is you don't know I guess you know come back here we can go full circle
41:09 Brad Yeah,
41:09 Brad we'll have an AI check it out.
41:11 Scott you know what Kent Beck is mostly known for test
41:15 Brad Tell me.
41:18 Scott driven development
41:19 Brad Yeah.
41:21 Scott It's one of his big claims of fame. He was an early pioneer of test driven development.
41:24 Brad Yeah.
41:24 Scott I don't know if he's mostly known for it, but he's probably mostly known for extreme programming,
41:28 Scott but he's known for test driven development. And I guess test driven development is really key when you're having the AI write stuff for you because it.
41:39 Scott confirmed that it's doing the right thing even
41:40 Brad Yeah.
41:41 Scott if you don't know what the right thing is i don't know how that's what i was i was going to do test-driven development in a very manual way i was going to manual test i was going to try and load the react native app in my emulator and see if it worked and then i guess i knew if it was working to work right so essentially testing qa is going to become more and more important
42:00 Brad And yes,
42:01 Brad I agree.
42:01 Brad And,
42:02 Brad um,
42:04 Brad If the developers don't learn how to recognize good quality code,
42:10 Brad guess what recognizing good quality code is?
42:14 Brad It's pattern recognition.
42:16 Scott It's true.
42:16 Brad And so it's already the case that GitHub Copilot,
42:20 Brad when I open up a pull request on any of my repositories, there's a nice little GitHub little Copilot icon sitting on the pull request and it's got a little smiling face and it says, click here to have me code review this pull request.
42:35 Scott Mm-hmm.
42:35 Brad And it's, I'll tell you, I do that on all my pull requests on all of the projects I work on.
42:40 Brad And nine times out of 10,
42:42 Brad it basically just describes exactly what I did and offers no feedback.
42:47 Brad One time out of 10,
42:48 Brad it will offer comments on,
42:52 Brad hey, this line of code, you're doing this, consider doing that.
42:56 Brad And of the one time out of 10 that it gives me feedback.
43:00 Brad um one time out of 10 of those i go oh yeah that's actually good feedback i should fix that yep
43:09 Scott Yeah.
43:09 Scott So this is interesting.
43:11 Scott You might remember a number of episodes ago, we talked about this paper that had come across my desk from OpenAI,
43:18 Scott where they went and got a bunch of jobs off Upwork.
43:22 Scott And they had
43:25 Scott two agents or two bots or two AIs whatever I don't know I don't even know what to call them these days sometimes
43:29 Brad Right.
43:29 Scott but they had they had two robots I'm just gonna call them robots robot one did the coding robot two did the evaluation
43:37 Scott and the evaluation was more successful only about 20 if you remember only about I
43:43 Brad Oh, it's 30%, right?
43:45 Scott think it was 25% of the 26% of the tasks were successful but
43:51 Scott evaluating if they were successful was about 41 percent
43:55 Brad Yeah.
43:56 Scott recall so the code review part is more effective with the AI and in fact that matches my real-world experience in the sense of the first thing we've had the most success with at TaskRabbit is with using AI in our code reviews.
44:13 Scott We don't use GitHub Copilot. We use a different thing called CodeRabbit. No pun intended.
44:18 Scott It's in
44:18 Brad Yeah, yeah, totally.
44:19 Scott our engineers really like it for exactly the reason you're talking about. It suggests tests that may have been missed, all sorts of stuff like that.
44:28 Brad Okay,
44:28 Brad so let's say here's my question for you, Scott.
44:33 Brad The genie is out of the bottle.
44:34 Brad We both acknowledge that.
44:37 Brad I suspect.
44:39 Brad That we've got this, you know, we've got this concern for somewhere between 50 to 90% of all engineers working today that they will be outperformed by the top 10% engineers that are augmented.
45:05 Brad Can we as CTOs, as technology leaders,
45:10 Brad how do we prepare our enterprises and our teams for this future?
45:20 Brad And recognizing that, right,
45:22 Brad like we, of course, we have a duty to our employees,
45:26 Brad but we also have a duty to our shareholders and our customers and our other stakeholders.
45:33 Brad I'm just curious,
45:35 Brad you know, deep accountability and deep thoughts on deep troubling events coming.
45:44 Scott Yeah. I think we've touched on one or two of the things, which is continuing to encourage coach train people with these things.
45:52 Scott Like that's like a duty to our teams, like to help them be the best they can be.
45:57 Scott You talked earlier about good ideas.
46:00 Scott Um,
46:01 Scott to some degree,
46:04 Scott this gets into the product management space,
46:05 Scott right,
46:06 Scott which is if your enterprise can generate more good idea, more, more ideas and more better ideas to understand what the better ones are,
46:13 Scott then you're going to still have a demand for more engineers for engineers in general.
46:21 Scott be another piece um I think probably something that fits with this I just I'm just thinking of this notion right now that as I thought of that notion probably getting an organization to where it can experiment really rapidly if all of a sudden I can produce code really quickly and I can and I and I don't know if my a lot of these ideas I don't know if they're going to be good or bad
46:42 Brad Yeah.
46:42 Scott so how can I test how can I get
46:44 Scott build kind of test these things really quickly not test like qa but like experiment with your customers get them in front of customers um pretty good maybe there's actually a story in here which is we talked about test automation
46:58 Scott and test driven development there might be a story in here which is um
47:04 Scott If an implication of AI is that demand for QA is going to go up,
47:10 Scott there's kind of two stories there. One is, well,
47:14 Scott there's some job preservation if you can be good at that and not as a traditional sort of important click manual tester,
47:20 Scott but building that automation. But there's another story in there,
47:23 Scott which is like, well,
47:24 Scott on the whole, as an industry, we can make better products now,
47:28 Scott better higher quality products.
47:29 Scott Um,
47:30 Scott but I do want to come back and just not leave this point that that point of about evaluating and testing ideas,
47:38 Scott generating, evaluating and testing ideas,
47:41 Scott which is a collaboration between the product management function and the engineering function is maybe going to become a lot more valuable.
47:50 Scott It'll be interesting to see from the economic perspective,
47:52 Scott will companies try to cut costs or will they realize that they can get more for their money and will they try to do more?
47:59 Scott And really, I think that's a function of, right,
48:00 Scott is there more demand out there, right?
48:02 Scott That's what we talked about.
48:03 Scott Are you demand constrained?
48:04 Brad Right. Well,
48:05 Brad this is why it's a it's a tricky feedback loop. Right.
48:08 Brad Because if we start to see a contraction in.
48:14 Brad white collar jobs across the board because there's efficiency gains that come out of it, then that starts to also
48:22 Scott Mm
48:22 Brad impact,
48:22 Scott -hmm.
48:23 Brad you know.
48:24 Brad Because we're a largely consumer-driven economy,
48:28 Brad so if our
48:29 Scott Yeah.
48:29 Brad highest earners are losing their jobs, then it doesn't matter if there's better ideas, if the general consumer market is contracting,
48:41 Brad then enterprises are going to be forced to.
48:45 Brad to cut
48:45 Scott That's
48:45 Brad costs.
48:46 Scott very scary.
48:46 Scott And,
48:47 Scott you know, this,
48:48 Scott what we're talking about with engineers has been happening in the creative space for, I don't know, 10 to 15 years.
48:56 Scott You know, ad agencies can generate creative with way less people. Look,
49:00 Scott it's all about these phones,
49:01 Scott right?
49:01 Brad Yep.
49:02 Scott You know,
49:02 Scott it went from you used to need a whole crew to make a TV commercial,
49:08 Scott but now you're just making a video.
49:11 Scott for a little screen on social media on TikTok and you can do it with one of these guys and now AI is going to do that they've been experiencing this contraction for 15 years and you know our gut challenges by it of course so now this this part's all super scary
49:26 Scott um you know you can if you want to i don't want to go too far into politics but like you can see how this leads to universal basic income i don't know if this country would ever do universal basic income but you can see how like that becomes a necessity
49:37 Brad Well, that's one of the reasons that Sam Altman is like.
49:43 Brad as backing UBI as aggressively as he is open AI you know he believes
49:48 Scott Is
49:49 Brad it yeah
49:49 Scott that right? I didn't know he was kind of.
49:50 Brad yeah he's got like world world coin or something like that that's like a basically UBI
49:57 Scott So I have a type of hypothesis or a theory to run by you by UBI and tell me what you think.
50:06 Scott you know people say oh UBI that's bad people everyone's just going to sit around all day and do nothing but I sort of believe like the human spirit actually needs to do something not every human spirit but 98% of the human spirits out there need to do something for meaning in their life and
50:21 Brad Yeah.
50:22 Scott sometimes that is productive work and sometimes it's you know
50:26 Scott being a clergy minister type person and sometimes it's working out whatever those things people need
50:31 Brad Being
50:32 Scott to do things
50:32 Brad a for poet.
50:32 Scott their souls yeah um and sometimes those things make you know people yeah people need to do things for their souls and so i've been thinking recently like you know maybe the the moral hazard of ubi which is people will just sit around and drink diet coke all day isn't a real moral hazard because
50:50 Scott people will just have to do something.
50:52 Scott I mean, there will be maybe a greater percentage of people who don't do anything,
50:55 Scott but most people will just be like, I can't sit around all day.
50:58 Scott I just need to do something.
51:01 Brad Yeah, I mean, it's definitely hard to have this conversation without getting into politics and philosophy and morality, but I generally reject the notion of moral hazard.
51:13 Brad I think that's a, that's like a, I fundamentally believe that's a story that's told by those in power to.
51:23 Brad Keep other people out of power.
51:26 Scott Well,
51:26 Scott this kind of connects back to me. This is a great spot to end. It kind of connects back to our John Helm episode when he said, can you have general AI, general intelligence without emotion?
51:35 Brad Yeah.
51:35 Scott And it all gets these conversations always lead to some of these ethical questions,
51:40 Scott you know, societal ethical questions.
51:43 Scott Well,
51:44 Scott should we end it there for today?
51:44 Brad Let's end it on...
51:47 Brad You got to come down to emotion.
51:49 Scott Yeah.
51:50 Scott Pop quiz.
51:51 Brad Yes.
51:52 Scott Of the top 10 articles on Hacker News today,
51:56 Scott how many are about AI?
52:01 Brad Seven.
52:02 Scott I haven't clicked into the articles. I'm only just reading the headlines,
52:06 Scott but I believe it is only one.
52:08 Brad Oh,
52:08 Brad wow.
52:09 Brad There you go.
52:10 Brad That's
52:10 Scott surprising
52:11 Brad why I don't spend any
52:11 Scott right
52:11 Brad time on it. I already said I don't read Hacker News.
52:16 Scott i don't typically read it either but i just pulled it up when you mentioned it all right
52:20 Brad This
52:20 Scott browns
52:21 Brad was fun,
52:21 Scott let's catch
52:21 Brad Scott.
52:21 Scott up always
52:22 Brad Good talking to you.
52:22 Scott see
52:23 Brad All right. Have a good you one.
52:24 Scott next week
52:24 Brad Cheers.
52:26 Brad This episode of How Many CTOs Does It Take podcast was edited by Safran Hepagow.
52:31 Brad Our theme song was AI Generated by Brad.
52:34 Scott Please follow us on all the social media platforms at at how many CTOs pod You can find us on YouTube LinkedIn Instagram Facebook threads X TikTok and patreon or at our website at how many CTOs pod comm and remember to rate review and subscribe on the podcast platform of your choice