Discover
The Attention Mechanism with Andrew Mayne
The Attention Mechanism with Andrew Mayne
Author: Dog and Pony Show Audio Productions
Subscribed: 6Played: 174Subscribe
Share
© Dog and Pony Show Audio Productions
Description
Andrew Mayne, former science communicator at OpenAI, takes you through the latest in Artificial Intelligence.
Hosted by Justin Robert Young.
Hosted on Acast. See acast.com/privacy for more information.
46 Episodes
Reverse
Andrew and Justin reconvene to discuss Anthropic's recent claims that Chinese AI labs are utilizing Claude to improve their own models, before turning their attention to Anthropic's ongoing rocky relationship with the Pentagon. Elsewhere, the two ponder what's happening with local town board meetings grabbing headlines for turning away data centers — and whether a NIMBY response to data centers could cost these towns more than they thing — before Justin shares his experience of building his first iOS app with Codex.Chapters00:00 - Intro01:30 - Anthropic and China14:11 - Anthropic and the Pentagon21:05 - Data Centers vs. Town Boards36:13 - Codex and Utilizing AI Intelligently Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin discuss the recent acqui-hire Peter Steinberger, the founder behind OpenClaw (né Clawdbot, né Moltbot), with his project remaining open-source. The two also discuss the reaction to the depreciation of GPT-4o, which left plenty of users feeling burned, and the recent high-profile departures of various employees who got their exit letters published in outlets like The New York Times. Is it a sign of the times, or just evidence of culture clash?Chapters00:00 - Intro01:49 - OpenClaw Acqui-hire14:03 - Death of GPT-4o28:29 - Departure Letters and AI Work Culture48:08 - Brief Codex Thoughts49:19 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin catch up after a Super Bowl that was chock full of various AI ads. The two touch on the ongoing feud between Anthropic and OpenAI over ads, partially fought out, ironically enough, in those very same ad campaigns. After talking through OpenAI's own Codex ad and the launch of its standalone Mac app, the two tackle compute constraints, Elon's pivot to the moon, and more. Chapters00:00 - Intro and Super Bowl Ads10:01 - Codex19:19 - Compute Constraints and Space25:50 - Elon Pivots from Mars to the Moon30:10 - New OpenAI Podcast Episode and Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin talk through the recent viral success of Clawdbot, an open-source AI personal assistant that's taken the web by storm over the weekend. After Justin debates installing it on a Mac Mini, the two discuss the other Claude — namely, Claude's founder Dario Amodei, who continues to issue "dire warnings" over the rise of AI.Chapters00:00 - Intro00:47 - Clawdbot09:26 - Dario Amodei's Dire Warnings37:06 - The near-future of AI-generated art44:58 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin walk through OpenAI CFO Sarah Frier's latest blog post digging into the company's annual revenue compared to its current demand, alongside some thoughts shared by Sarah with Andrew on the official OpenAI Podcast. The two also dig into OpenAI's announcement of ads in its free tier and what it might for the future of the platform before digging into some of the discovery coming out of the Elon-OpenAI lawsuit.Chapters00:00 - Intro00:44 - Revenue and Demand for ChatGPT10:29 - OpenAI Ads22:08 - Elon Musk's Lawsuit (and general Elon thoughts)34:16 - Wrap-up (and brief thoughts on the Cerebras deal) Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin dive into the two big stories facing the world of AI this week. First, ChatGPT Health is here, designed to deliver specific answers tailored to healthcare and wellness. Is this the future of visiting a doctor, and what concerns face this sort of technology moving forward? Then they turn to Google, who are partnering with Apple to provide models for the company's next-gen Siri assistant. Does this prove OpenAI is a larger rival to Apple than Google, and what does this say about the modern state of the brand behind the iPhone?Chapters00:00 - Intro01:11 - ChatGPT Heatlh14:11 - Apple-Google Partnership47:49 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin talk through Nvidia's $20 billion deal to both acquire the talent and license the tech offered by Groq, a chip company focused on lowering inference costs. The two also offer their AI predictions for 2026 and ponder whether Jony Ive and Sam Altman's OpenAI hardware project will show up before year's end.Chapters00:00 - Intro00:30 - Nvidia and Groq16:17 - 2026 Predictions23:13 - OpenAI Hardware27:02 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin tackle the biggest question surrounding AI right now: are we in a bubble? The two discuss how the market reacts to AI-centric news, slowdowns in hiring, and why product matters more than just simple models. Plus, a little talk on the rumor of ads finding their way to ChatGPT's free tier, and Thrive Capital's investment in OpenAI.Chapters00:00 - Intro00:45 - Is there an AI bubble?17:39 - OpenAI's lasting impact26:45 - Products over models40:52 - Ads in ChatGPT47:20 - OpenAI and Thrive Capital50:03 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin dive into the launch of Atlas, OpenAI's new browser set to square off with Chrome in the race to an AI-centric web client. The duo also breaks down Google's flaws in building out its AI toolset, Meta's recent layoffs from its own AI team, and the joys of using Sora over the past month.Chapters00:00 - Intro and Atlas14:10 - Sora thoughts21:43 - Google's AI efforts23:52 - Meta Layoffs36:17 - Is there an AI bubble?50:10 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin talk about a busy week's worth of AI news, including the looming launch of ChatGPT's Sora 2. The pair also discuss Google's current successes at AI with Nano Banana and the rise of Gemini to the top of the App Store charts, OpenAI's new Instant Checkout feature in ChatGPT, and dish out some advice on what to focus on when learning AI tools.Chapters00:00 - Intro01:16 - Google's AI successes11:48 - Sora 228:13 - Instant Checkout in ChatGPT37:17 - AI advice49:38 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin address the growing concerns that AI development could result in an explosion of job losses. The two work through whether industries heavily impacted by AI could turn towards replacing humans entirely, or if a hybrid approach brings about an improved society for all. They also address some recent AI news, including Nvidia's investment in OpenAI and Meta's recent live demo failures centered around their smart glasses.Chapters00:00 - Intro and Nvidia investment12:08 - AI pessimism and job concerns42:12 - Meta's live demo fails48:22 - iOS 26 and Apple thoughts54:26 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Following Ezra Klein's editorial celebration of ChatGPT 5 in the NY Times over the weekend, Andrew and Justin break down the reaction to OpenAI's latest model, as well as their own feelings on it. After touching on both the "95%" report out of MIT and the AI 2027 scenario sweeping the web, the two talk about the pro-AI Super PAC started by, among others, Andreessen Horowitz and OpenAI's Greg Brockman. How will this affect where AI stands in the political races to come?Chapters00:00 - Ezra Klein <3 ChatGPT 59:56 - MIT's 95% Report15:35 - AI 202726:06 - $100m Super PAC42:04 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
After a busy few weeks, Andrew and Justin reconvene to talk through all of the AI-centric news that has hit your feed over the summer. From the launch of ChatGPT 5 and the subsequent news cycles surrounding personality changes and reliability, to Elon's war against App Store charts and the battle against compute constraints, there's plenty to get through. It's the opposite of whatever an AI Winter is supposed to be.Chapters00:00 - Intro00:41 - ChatGPT 5 launch and fallout08:52 - 4o vs. 5 Personality17:25 - Elon, Grok, and App Store charts22:41 - Genie 3 and Google23:53 - Compute constraints31:11 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin tackle Meta's recent push to recruit the best minds working on AI today through any means — mostly monetary — necessary. They also touch on Apple's struggles in this field, OpenAI's recent lawsuit over their new hardware initiative with Jony Ive, and their expectations around whatever Sam and Jony have in the works.00:00 - Meta's AI Recruitment Push12:35 - Looking Back at Meta's Strategy21:00 - Meta's Potential AI Future27:55 - OpenAI io Lawsuit35:30 - OpenAI Hardware Expectations42:02 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
On this episode, Justin and Andrew break down Andrew’s new role as host of the official OpenAI podcast — including behind-the-scenes insights, why Sam Altman welcomed tough questions, and what it means for transparency in AI. Then, they dive into Tesla’s Robotaxi rollout in Austin, Elon’s sensor philosophy, and what autonomy could mean for accessibility. Finally, they geek out over ByteDance’s shockingly cheap and fast video model, and why the future of animation might cost just a few cents.Chapters00:00 - Intro00:25 - OpenAI Podcast12:05 - Tesla's Robotaxis27:10 - ByteDance's Video Model35:23 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
A look at a New York Times article about poor mental health outcomes from ChatGPT. Also, the first Veo3 advertisement. Chapters00:44 Ethical Considerations in AI Technology03:33 AI's Influence on Storytelling and Audience Engagement06:32 The Balance Between Human and AI Contributions09:23 The Future of AI in Advertising and Marketing Hosted on Acast. See acast.com/privacy for more information.
In the wake of WWDC, Andrew and Justin convene to discuss whether Apple's lack of AI advancements is spelling a troubling sign for the company's future dominance in the tech landscape. Elsewhere, Justin hates OpenAI's new Advanced Voice Mode and its constant giggling, Meta drops some serious cash to continue funding their AI initiative, and a quick dip into the Elon of it all.Chapters00:00 - Intro01:19 - Xcode and ChatGPT 07:08 - Apple Intelligence and its New Research Paper18:51 - OpenAI's Advanced Voice Mode25:34 - Meta's AI Investment33:31 - Elon40:32 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Justin and Andrew dig into a busy news cycle, with Veo 3 stealing the show at Google I/O. After breaking down the company's latest video generation model and some communication challenges facing Anthropic, they arrive at the biggest AI news of the week: OpenAI's hardware tease. With a Jony Ive partnership locked down, Justin and Andrew discuss the legacy of Steve Jobs and how Sam Altman plays into it, what the gadget could actually be, and whether this could be the biggest tech launch since the iPhone.Chapters00:00:00 - Intro00:00:51 - Google I/O and Veo 300:11:37 - Google AI Ultra Subscriptions00:17:45 - Anthropic Controversy00:22:08 - OpenAI and Jony Ive Partnership00:37:50 - Operator o3 update and wrap-up Hosted on Acast. See acast.com/privacy for more information.
Justin and Andrew discuss the challenges Apple faces in the AI landscape in the wake of a blockbuster new report from Bloomberg's Mark Gurman. They explore the decline and failed potential of Siri, the evolving nature of search engines, and the potential future of AI integration in everyday technology. Then the pair turn their attention to the implications of new agentic technologies like Model Context Protocol (MCP), which was featured heavily at Microsoft Build 2025.Chapters00:00 - Intro and Nvidia Stock02:12 - Apple's AI Missteps and Market Position09:47 - Siri's Decline and Apple's AI Vulnerability13:45 - The Future of Search and Apple's Position18:11 - The Impact of AI on Search Engine Dynamics23:41 - MCP: A New Paradigm in AI Interaction30:10 - The Future of Browsers and AI Integration Hosted on Acast. See acast.com/privacy for more information.
Justin and Andrew dive into the growing debate over whether we’ve already crossed the AGI threshold — or if we’ll even know when we do. From Tyler Cowen’s “AGI moment” with OpenAI’s o3 model to the jagged frontier of modern evals, they explore why defining intelligence is more subjective than ever.Chapters00:00 - Intro02:20 - The AGI Moment10:22 - Is o3 or Gemini 2.5 AGI?14:50 - The Pseudosingularity20:16 - Humanity's Last Exam Hosted on Acast. See acast.com/privacy for more information.




