DiscoverThe Vernon Richard ShowSix Hard Lessons From Building With AI Agents
Six Hard Lessons From Building With AI Agents

Six Hard Lessons From Building With AI Agents

Update: 2025-08-04
Share

Description

In this episode of the Vernon Richard show, the hosts discuss their experiences with AI tools and agents, focusing on the challenges and lessons learned from using these technologies in coding and software engineering. They explore best practices for utilizing AI effectively, the importance of context in interactions with AI, and the future of AI agents in the workplace. The conversation highlights the balance between leveraging AI for efficiency while maintaining control and understanding of the underlying processes.

Links to stuff we mentioned during the pod:

00:00 - Intro
01:17 - Welcome
01:30 - TANGENT BEGINS... All kinds of egregious waffling follows. Skip to the actual content at 08:34
01:31 - Rich VS Tree Stump
01:57 - What on earth did Rich need the pulley for?
02:26 - Vern's nerdy confession and pulley confusion
02:52 - Does Rich live next door to Tony Stark?!
03:22 - What to do when you need a steel RSJ
03:35 - We admit defeat. 03:36 - Welcome to Rich's Garden Adventures Podcast!
07:25 - What has Vern been up to?
08:34 - We attempt to segue into the episode at last!
08:35 - TANGENT ENDS...
08:51 - Rich’s POC: using agents to help build AI tools
09:45 - The Replit disaster: vibe coding meets deleted production data 11:12 - Sociopathic assistants and the case for AI gaslighting 11:55 - Vernon wants his team experimenting with AI tools
12:50 - Rich explains the context for his latest AI adventures
13:18 - Rich’s bench project and ā€œputting the engineering hat onā€Ā 
15:22 - Setting up the stack and staying in controlĀ 
16:53 - A familiar story: things were going fine until they weren’tĀ 
17:00 - Ask vs Edit vs Agent mode in Copilot explainedĀ 
19:06 - The innocent linting error that spiralled out of controlĀ 
21:16 - Stuck in a loop: ā€œI didn’t know what it was doing, but I let it keep goingā€Ā 
22:11 - The fateful click: ā€œI’m going to reset the DBā€Ā 
23:10 - The aftermath: no data, no damage… but very nearlyĀ 
23:33 - Security wake-up call: agents are acting as youĀ 
24:39 - You can’t fix what you don’t know it brokeĀ 
25:52 - Can you interrupt an agent mid-task?Ā 
27:14 - When agents get ā€œare you sure?ā€ momentsĀ 
28:15 - Tea breaks as a dev strategy: outsourcing work to agentsĀ 
29:24 - Jason Aborn vs Keith & Maaike: where Rich sits on the AI enthusiasm spectrumĀ 
30:41 - Tip1. The first of Rich’s 6 agent tips: commit after every interaction
32:12 - Why trusting the ā€œkeep allā€ button is riskyĀ 
34:01 - Writing your own commits vs letting the agent do itĀ 
35:26 - When agents lose the plot: reset instead of fixingĀ 
36:55 - ā€œYou’re insane now, GPT. I’m giving you a break.ā€Ā 
37:54 - Tip 2: Make the task as small as possibleĀ 
39:59 - The middle ground between 'ask' and full agent delegationĀ 
41:12 - Tip 3: Ask the agent to break the task down for youĀ 
43:36 - The order matters: why you shouldn’t start with the form UIĀ 
44:33 - Vernon compares it to shell command pipelinesĀ 
45:09 - It can now open browsers and run Playwright tests (!)Ā 
46:23 - Star Trek and the rise of the engineer-agent hybridĀ 
47:57 - Tips 4–6: Test often, review the code, use other modelsĀ 
49:39 - Pattern drift and the importance of prompt templatesĀ 
50:51 - Vernon’s nemesis: m dashes, emojis, and being ignored by GPTĀ 
51:48 - Context engineering vs prompt engineeringĀ 
52:43 - When codebases get too big for agents to copeĀ 
53:40 - Why agents sometimes act dumber than your IDEĀ 
54:32 - The danger of outsourcing good practices to AIĀ 
54:48 - Spoilers: Rich’s upcoming keynote at TestItĀ 
55:01 - Agents don’t ask why — they just keep goingĀ 
56:42 - Goals vs loops: when failure isn’t part of the planĀ 
58:32 - The question of efficiency: is training agents worth it?Ā 
59:47 - Rich’s take: we’ll buy agents like we buy SaaSĀ 
61:08 ...

CommentsĀ 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Six Hard Lessons From Building With AI Agents

Six Hard Lessons From Building With AI Agents

Vernon Richards and Richard Bradshaw