Transcript: The End of Programming As We Know It? Justin Kaufman's tips on building fast with AI
0:00 Brad I have the ability to focus my energy and my problem solving on honestly more interesting problems.
0:23 Brad This is like, this has been such a fun conversation,
0:26 Brad Justin,
0:26 Brad and I feel like we've went and we've touched on some really.
0:30 Scott really cool journey about this amazing product that you've built and we've really touched on like how you've built this thing and why you're why you're getting so much joy out of it no pun intended and why I think that this moment of technology has made it possible if there's a I guess the the question I have for you would be
0:58 Scott Being that you've been in the trenches now as a very, very small team moving really, really, really fast,
1:04 Scott building something very,
1:05 Scott very cool,
1:06 Scott have you reached an opinion about where what's going to happen to the software programming jobs now that AI is where it's at at this point?
1:19 Scott Are you generally?
1:22 Scott uh bearish on you know our our software developers going to go away uh and if you're not a embedded product uh visionary then you've got no hope or what's what's your take on this will ai kill software engineering jobs
1:41 Brad Eventually.
1:43 Brad Eventually,
1:43 Brad I think it will.
1:44 Brad I don't have a, I'm not going to speculate as to the timeline on that.
1:50 Brad Seeing what I've seen happen on the screen,
1:53 Brad just even in the last week, and by the way, last week, it was a model that's now outdated.
1:59 Brad And so maybe it would have taken less time if I did it now.
2:04 Brad Seeing that stuff unfold in front of my eyes,
2:07 Brad I don't, I mean, I think it's a cynical take,
2:11 Brad but unfortunately,
2:13 Brad it's also a realistic take. There's just no way a company is going to spend money on something.
2:17 Brad that they can push a button and at least spend a lot less on and make happen almost instantly.
2:24 Brad So I think eventually the answer to the question,
2:28 Brad what's going to happen with the current sort of incarnation of a software engineer,
2:33 Brad it doesn't seem like that has a long lifespan given the developments.
2:41 Brad That said,
2:41 Brad I think that there is going to be a continuing lifespan for it, a longer lifespan for it in certain industries.
2:49 Brad You know, one of the risks that you have with AI is that it makes a mistake and depending on the kind of company you are,
2:55 Brad risk tolerance is going to differ wildly. Like if you're a bank and you have one software engineer running rogue doing Claude code all day and unfortunately Claude code decides to like reassign, you know, a billion dollars to 10 million different people.
3:12 Brad That's not an acceptable risk for that industry.
3:14 Brad And so I think there's going to be a lot of time before AI takes over in that and in healthcare and so on.
3:22 Brad But I'm an optimist to a fault sometimes,
3:27 Brad and I don't think about it as like.
3:30 Brad software engineers going away.
3:32 Brad I think that what makes a software engineer a valuable person in the economy is that they're problem solvers. Like they are able to come into a new situation with all kinds of noise and uncertainties and say this is the best way.
3:52 Brad To solve this problem, you know, we need we need to be able to chat with a doctor.
3:55 Brad This is the best way to build that.
3:58 Brad And right now, the problem they're solving is at one level of the technology spectrum,
4:03 Brad right? Like they're trying to figure out what the architecture of code to do that is.
4:08 Brad And the truth is like that that's been solved enough and will eventually have been solved enough that it doesn't need to be answered that way anymore,
4:16 Brad right?
4:16 Brad Like it's...
4:18 Brad That may become a solved problem,
4:19 Brad whereas there are still going to be problems like what is the best experience we can give a user?
4:26 Brad One thing that has been interesting,
4:28 Brad and this is just my final anecdote on this question,
4:30 Brad is I do these riddles and I do them every day.
4:34 Brad And in fact, today,
4:35 Brad this is what I wrote about in the blurb that I send after people solve it.
4:40 Brad I answered the question that I get quite a bit, which is why don't you just use AI?
4:45 Brad to generate the riddles like you wouldn't be like staying like up at night trying to figure out you know a riddle when it doesn't come easily and sometimes they don't and the answer to the question why don't I use AI to generate these riddles is because AI is not good at generating riddles if you try to generate a riddle with AI even even if I feed it as training data all of the ones I've written it still does something like you know what's black and white and red all over
5:11 Brad And the truth is, it's great at understanding the technical form of a riddle. It's great looking at its training data and understanding what it is I'm asking for.
5:20 Brad But the kinds of riddles I write actually have a voice and they have some, there's creativity behind it.
5:28 Brad So it still can't solve that problem.
5:30 Brad Like GPT-5 probably still won't be able to solve that problem. And it means that I'm trying to solve a different problem.
5:38 Brad I'm not going to like today,
5:39 Brad I wouldn't have spent almost any time trying to solve the problem of how do I code the text that goes out to people. I probably would have been able to pass that off and I would have been delighted for it, by the way, because I didn't enjoy that.
5:51 Brad But instead,
5:52 Brad I have the ability to focus my energy and my problem solving on.
5:57 Brad honestly more interesting problems like what is it like to receive a riddle for a person like and what makes them want to come back the next day and these are things that I think it's going to be quite a bit of time before AI catches up on so software engineers are just going to change
6:11 Scott In some ways, the way I think about it and what I hear you saying is that the engineering part of what we do is moving up the stack.
6:20 Scott I think you maybe have described it this way, Brad.
6:23 Scott In some ways, AI is just the latest compiler,
6:26 Scott right?
6:27 Scott We're writing in a different language. It's a natural language prompt,
6:31 Scott which the generative AI compiles into some code, which then gets compiled into some other code and ultimately gets compiled down into bits,
6:38 Scott right?
6:39 Scott And so we're kind of moving up the stack almost like, for lack of a better description,
6:45 Scott the product requirements document is the code now.
6:49 Scott And,
6:49 Scott That's
6:49 Scott you
6:50 Scott it.
6:50 Scott know, there's Gherkin, right,
6:52 Scott where you write these test automations using this Gherkin format.
6:55 Scott You guys know what that is?
6:56 Scott It's almost like we're pushing our way up almost to test-driven development,
7:00 Scott but it's requirement-driven development, and it gets compiled all the way down.
7:07 Brad What about you guys? What's your experience been like with the AI stuff happening?
7:13 Brad You're at TaskRabbit now?
7:14 Brad Is that right,
7:14 Scott I
7:14 Brad Scott?
7:14 Scott am.
7:15 Scott My,
7:16 Scott well,
7:17 Brad Is that recent?
7:17 Scott a company,
7:18 Scott a startup I was at got acquired about a year ago.
7:21 Scott And so that's how I ended up there.
7:22 Brad Got it.
7:24 Scott Our team has been experimenting with it and using it more and more and some people having a lot of great success.
7:30 Scott I have a great success story to share from just this week. We have a channel where people sort of post things they did that worked or didn't work or whatever.
7:38 Scott One engineer had a React app.
7:40 Scott It wasn't real big.
7:41 Scott It was about three or four thousand lines of code.
7:43 Scott It had three percent test coverage.
7:47 Scott He said it took him about four or five hours of writing some prompt and then writing some different prompts and so on and so forth and got it to greater than 90% test coverage.
7:58 Scott And, you know, to me that is a very high leverage for five hours.
8:05 Scott It wrote 160 tests.
8:08 Scott So I don't think you could have written 160 tests in that time and it started out, you know, at first it wrote like 40 and then he had to keep on prompting it to get it to do different things and he did like, you know, he did have to correct some stuff and so on and so forth, but he got it to a pretty good spot and so the team, the engineers are learning how to use the tool.
8:28 Scott and to get really productive another example someone someone who's sort of like one of our SREs the other day he posts this message I'm never writing another shell script again and just sort of narrated his prompts of like how I got you know
8:46 Scott uh i don't know what he was using but whatever whatever it was to write this shell script that he that he didn't quite know how to do and he didn't have a lot of shell scripting experience and so on so forth and he had somebody like he didn't consider himself an expert so people are using it and um more and more and i think it's good i don't think they're at where you're at where they're but we also have a little bit different code base um as well so
9:11 Scott I think there's something there. Is it going to replace engineers?
9:15 Scott I don't know.
9:16 Scott Because I don't know yet if it can handle the complexity that's out there.
9:21 Scott I mean, just...
9:24 Scott I don't know just like scaling and security and things like that it might not have yet it's going to need something there for a while but it's a new era that's for sure and the people this is the one thing I've been preaching to my team and I preach it to people on this podcast I preach it to my kids everybody the people who learn how to use it are going to go further in their careers than the people who don't
9:45 Scott um and the analogy i use is like the ide um i'm old enough when we started doing this and visual studio was relatively new and there were some people who were like well you know why would you use that right and it's like look what all this stuff it does for you has a debugger in it i mean i'm sure that vm remex had a debugger in it too but um
10:04 Scott And I'm not trying to get into those kind of religious wars,
10:07 Scott but the point is, is that some people embrace those tools and others didn't.
10:12 Scott And I think that we're in a phase, a part of the cycle where you don't have to embrace it,
10:20 Scott but the people who do embrace it, it's going to boost their careers.
10:24 Scott Yeah, I mean, I.
10:27 Scott I am a big believer of where you're at,
10:29 Scott Justin, being the cutting edge of what people are, people that take your path of like, I'm a super small team and we're just going to use AI to build things as fast as possible.
10:41 Scott I think that's the path forward.
10:42 Scott And I think that for an organization like that's got legacy code and a larger team, I think it's going to be much harder for them to adopt, you know, our team.
10:52 Scott there's like eight of us and i am insisting that everybody should be using ai and um i you know i'm writing a ton of code as part of this code base that i'm working on and i would say that my coding productivity is a problem i mean i already was a pretty fast developer like i could code pretty fast anyway um but i think with ai i'm like it you know
11:17 Scott at least 5x of what i was in my normal state so literally just today like we had a bunch of old code that we didn't have any unit tests for and while in the middle of just like you know prepping for like uh you know a bunch of meetings today it's in the background i had writing unit tests and it like you know a whole bunch of stuff went from zero coverage to 100 coverage and i can just give it super simple prompts and boom immediately i have high quality unit tests
11:42 Scott I do almost all of my technical reasoning.
11:46 Scott I open up chat GPT and I start talking with it like
11:49 Scott Yeah.
11:49 Scott here's a problem that I want to solve.
11:51 Scott Here's what I'm currently thinking.
11:53 Scott Maybe here's some code that we have.
11:56 Scott Let's talk through how to do this.
12:00 Scott And I think that it and so it's writing my technical documents for me. But again,
12:05 Scott it's like I use it as a collaborator. So it's like I'm I'm challenging it.
12:10 Scott I'm asking it to challenge me and then together we get a result. And
12:14 Brad Yep
12:14 Scott then and it's it's.
12:18 Scott It's everything that I do. It's touching
12:21 Brad Yeah,
12:21 Scott everything.
12:21 Brad it's a good resource.
12:22 Brad I would say, Scott,
12:24 Brad to respond to your opinion that, you know, when can it handle the complexity of some of these bigger code bases, I think that is the question.
12:35 Brad And that's sort of the thing that the industry is waiting for.
12:38 Brad As a sort of piece of advice or an insight that I've gleaned over the past little while,
12:44 Brad and again, this was just a happy accident,
12:46 Brad but if you're able to create a monolith for your repository,
12:52 Scott it handles it better.
12:54 Brad well,
12:54 Brad it's not just that it handles it better,
12:56 Brad it almost does the testing for you because when you want to make a change,
13:01 Brad you can ask as part of the task that you've assigned it.
13:06 Brad To make sure that that works across all of the different things.
13:10 Brad And so, you know, what I want to impart here is that there's a good rationale,
13:17 Brad I think, even if you don't think the tools are at the point of being able to really go nuts on an entire big legacy code base today,
13:26 Brad I think there's still a rationale.
13:29 Brad for migrating some of that stuff into at least a place, whether it's a monolith or something else that you can do,
13:36 Brad where it's easy for whatever's looking at it. I mean, by the way, easy for a person too,
13:41 Brad right?
13:41 Brad But also easy for an AI to be able to see the whole thing because the more splintered it is,
13:47 Brad the more likely it is to make a change that, like you said, it didn't understand the complexities of this problem because it couldn't know that like this client.
13:54 Brad client needs this in a certain format and so it changed it and it broke and and the other thing I'll the other technical thing I'll pitch here is another accident I decided to go with GraphQL for the back end because I don't know it was just hyped and I was like that looks shiny who doesn't rest anymore right it turns turns out the learning curve on GraphQL was a little bit higher than I wanted it to be but but the incredible thing about GraphQL
14:21 Brad is if you're going to have any kind of ai working inside your apps um you know my entire app really is ai because it's getting messages and figuring out what to say so the whole thing is ai but it's also trying to figure out what actions it can take like do we give this person a refund because they're upset like our restaurant doesn't do any customer service like 100 of our cases are resolved by the bot so the bot can take actions and
14:46 Brad If you have your APIs,
14:48 Brad and this is possible in REST too, by the way, but GraphQL just sort of forces you to do it because basically you're writing a schema and that describes all the queries and all the mutations that you can do.
14:59 Brad If you have that, all of your operations that are possible in your ecosystem in one document,
15:05 Brad it is extremely easy to feed that entire document to the AI system that you're using and tell it you have the authority to call this one, this one, this one, and this one, and this is the signature.
15:17 Brad And then suddenly your AI system, I mean, there's, it's a little scary actually, but it's incredibly powerful and like.
15:24 Brad And the only negative call I get about this is sometimes they're like, the thing is giving too many promotions, like people are asking for promotion and it's giving it, it's always people pleasing and got to pull back on that.
15:35 Scott Pull back on the people pleasing.
15:36 Brad That's right.
15:37 Brad But those are the two pieces of advice I would say if you have, if you have the bandwidth at whatever code base you're working on.
15:44 Brad to sort of maneuver it in a way that will make it easier for your team to get gains from those systems that are out there and that are you know definitely evolving quickly get stuff in one place get it in like a consolidated format and uh and you'll just see like these incredible things that are possible even today
16:02 Scott It's the revenge of the monolith.
16:04 Brad Maybe,
16:04 Scott Right.
16:05 Scott Well,
16:05 Brad maybe.
16:05 Scott there's the title of the episode.
16:06 Scott There you go.
16:07 Brad That's it.
16:08 Scott All right. Thanks a lot,
16:10 Scott Justin.
16:10 Brad See you guys.
16:11 Brad All right. Bye.
16:11 Brad Take care.
16:13 Scott This episode of How Many CTOs Does It Take? podcast was edited by Saffron Epigow.
16:18 Scott Our theme song was AI generated by Brad.
16:21 Scott Please follow us on all the social media platforms at at HowManyCTOsPod. You can find us on YouTube,
16:28 Scott LinkedIn,
16:29 Scott Instagram,
16:30 Scott Facebook,
16:30 Scott Threads, X,
16:31 Scott TikTok, and Patreon,
16:33 Scott or at our website at HowManyCTOsPod.com.
16:37 Scott And remember to rate, review,
16:39 Scott and subscribe on the podcast platform of your choice.