DiscoverThe Attention Mechanism with Andrew Mayne
The Attention Mechanism with Andrew Mayne
Claim Ownership

The Attention Mechanism with Andrew Mayne

Author: Dog and Pony Show Audio Productions

Subscribed: 6Played: 150
Share

Description

Andrew Mayne, former science communicator at OpenAI, takes you through the latest in Artificial Intelligence.


Hosted by Justin Robert Young.


Hosted on Acast. See acast.com/privacy for more information.

36 Episodes
Reverse
Robot-mancers

Robot-mancers

2025-09-2355:11

Andrew and Justin address the growing concerns that AI development could result in an explosion of job losses. The two work through whether industries heavily impacted by AI could turn towards replacing humans entirely, or if a hybrid approach brings about an improved society for all. They also address some recent AI news, including Nvidia's investment in OpenAI and Meta's recent live demo failures centered around their smart glasses.Chapters00:00 - Intro and Nvidia investment12:08 - AI pessimism and job concerns42:12 - Meta's live demo fails48:22 - iOS 26 and Apple thoughts54:26 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Super P-AI-C

Super P-AI-C

2025-08-2545:30

Following Ezra Klein's editorial celebration of ChatGPT 5 in the NY Times over the weekend, Andrew and Justin break down the reaction to OpenAI's latest model, as well as their own feelings on it. After touching on both the "95%" report out of MIT and the AI 2027 scenario sweeping the web, the two talk about the pro-AI Super PAC started by, among others, Andreessen Horowitz and OpenAI's Greg Brockman. How will this affect where AI stands in the political races to come?Chapters00:00 - Ezra Klein <3 ChatGPT 59:56 - MIT's 95% Report15:35 - AI 202726:06 - $100m Super PAC42:04 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
A Busy AI Summer

A Busy AI Summer

2025-08-1832:00

After a busy few weeks, Andrew and Justin reconvene to talk through all of the AI-centric news that has hit your feed over the summer. From the launch of ChatGPT 5 and the subsequent news cycles surrounding personality changes and reliability, to Elon's war against App Store charts and the battle against compute constraints, there's plenty to get through. It's the opposite of whatever an AI Winter is supposed to be.Chapters00:00 - Intro00:41 - ChatGPT 5 launch and fallout08:52 - 4o vs. 5 Personality17:25 - Elon, Grok, and App Store charts22:41 - Genie 3 and Google23:53 - Compute constraints31:11 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Andrew and Justin tackle Meta's recent push to recruit the best minds working on AI today through any means — mostly monetary — necessary. They also touch on Apple's struggles in this field, OpenAI's recent lawsuit over their new hardware initiative with Jony Ive, and their expectations around whatever Sam and Jony have in the works.00:00 - Meta's AI Recruitment Push12:35 - Looking Back at Meta's Strategy21:00 - Meta's Potential AI Future27:55 - OpenAI io Lawsuit35:30 - OpenAI Hardware Expectations42:02 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Meta Podcasting

Meta Podcasting

2025-06-2435:58

On this episode, Justin and Andrew break down Andrew’s new role as host of the official OpenAI podcast — including behind-the-scenes insights, why Sam Altman welcomed tough questions, and what it means for transparency in AI. Then, they dive into Tesla’s Robotaxi rollout in Austin, Elon’s sensor philosophy, and what autonomy could mean for accessibility. Finally, they geek out over ByteDance’s shockingly cheap and fast video model, and why the future of animation might cost just a few cents.Chapters00:00 - Intro00:25 - OpenAI Podcast12:05 - Tesla's Robotaxis27:10 - ByteDance's Video Model35:23 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
A look at a New York Times article about poor mental health outcomes from ChatGPT. Also, the first Veo3 advertisement. Chapters00:44 Ethical Considerations in AI Technology03:33 AI's Influence on Storytelling and Audience Engagement06:32 The Balance Between Human and AI Contributions09:23 The Future of AI in Advertising and Marketing Hosted on Acast. See acast.com/privacy for more information.
An AI-Lite WWDC

An AI-Lite WWDC

2025-06-1041:11

In the wake of WWDC, Andrew and Justin convene to discuss whether Apple's lack of AI advancements is spelling a troubling sign for the company's future dominance in the tech landscape. Elsewhere, Justin hates OpenAI's new Advanced Voice Mode and its constant giggling, Meta drops some serious cash to continue funding their AI initiative, and a quick dip into the Elon of it all.Chapters00:00 - Intro01:19 - Xcode and ChatGPT 07:08 - Apple Intelligence and its New Research Paper18:51 - OpenAI's Advanced Voice Mode25:34 - Meta's AI Investment33:31 - Elon40:32 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
From I/O to io

From I/O to io

2025-05-2739:21

Justin and Andrew dig into a busy news cycle, with Veo 3 stealing the show at Google I/O. After breaking down the company's latest video generation model and some communication challenges facing Anthropic, they arrive at the biggest AI news of the week: OpenAI's hardware tease. With a Jony Ive partnership locked down, Justin and Andrew discuss the legacy of Steve Jobs and how Sam Altman plays into it, what the gadget could actually be, and whether this could be the biggest tech launch since the iPhone.Chapters00:00:00 - Intro00:00:51 - Google I/O and Veo 300:11:37 - Google AI Ultra Subscriptions00:17:45 - Anthropic Controversy00:22:08 - OpenAI and Jony Ive Partnership00:37:50 - Operator o3 update and wrap-up Hosted on Acast. See acast.com/privacy for more information.
Apple's AI Dilemma

Apple's AI Dilemma

2025-05-2038:36

Justin and Andrew discuss the challenges Apple faces in the AI landscape in the wake of a blockbuster new report from Bloomberg's Mark Gurman. They explore the decline and failed potential of Siri, the evolving nature of search engines, and the potential future of AI integration in everyday technology. Then the pair turn their attention to the implications of new agentic technologies like Model Context Protocol (MCP), which was featured heavily at Microsoft Build 2025.Chapters00:00 - Intro and Nvidia Stock02:12 - Apple's AI Missteps and Market Position09:47 - Siri's Decline and Apple's AI Vulnerability13:45 - The Future of Search and Apple's Position18:11 - The Impact of AI on Search Engine Dynamics23:41 - MCP: A New Paradigm in AI Interaction30:10 - The Future of Browsers and AI Integration Hosted on Acast. See acast.com/privacy for more information.
AGI is a Vibe Now

AGI is a Vibe Now

2025-04-2230:12

Justin and Andrew dive into the growing debate over whether we’ve already crossed the AGI threshold — or if we’ll even know when we do. From Tyler Cowen’s “AGI moment” with OpenAI’s o3 model to the jagged frontier of modern evals, they explore why defining intelligence is more subjective than ever.Chapters00:00 - Intro02:20 - The AGI Moment10:22 - Is o3 or Gemini 2.5 AGI?14:50 - The Pseudosingularity20:16 - Humanity's Last Exam Hosted on Acast. See acast.com/privacy for more information.
The Tip Jar AI Model

The Tip Jar AI Model

2025-04-0832:12

Meta announces not one, not two, but three LLaMA 4 models — and somehow the most impressive one isn’t actually available. Andrew and Justin dive into the weird timing of the release, the confusion around Chatbot Arena scores, and why the open-weight community is raising eyebrows. Plus: what does “open” really mean anymore, and are we on the edge of an eval collapse?Chapters00:00 - Intro00:30 - Llama 406:01 - Open Source vs. Open Weight11:54 - AI Monetization21:37 - A Pending Eval Crisis?31:46 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.
Manus a Manus

Manus a Manus

2025-03-1531:59

Andrew and Justin discuss Manus AI from hype to results. Hosted on Acast. See acast.com/privacy for more information.
Perplexity's Comet

Perplexity's Comet

2025-02-2536:48

Agentic browsers are coming. What should we — and Google — expect?Chapters00:00 Intro and Grok's Hardcoded AI Bias06:43 Claude 3.7 Sonnet is Here13:06 Agentic Browsers and the Future of Web Interaction19:11 The Impending Disruption of Google Search26:46 Veo 2's Avengers-sized pricing36:11 Outro Hosted on Acast. See acast.com/privacy for more information.
Is Grok Tops?

Is Grok Tops?

2025-02-2027:56

Grok3 is out. Is it the best AI in the world?Chapters00:00 Introduction to AI and Quantum Computing03:00 Grok 3 and Its Implications06:13 Evaluating Grok 3's Performance08:55 The AI Chatbot Arena12:10 Comparative Analysis of AI Models14:54 The Future of AI Development18:14 Elon Musk and the AI Landscape20:57 Conclusion and Future Outlook Hosted on Acast. See acast.com/privacy for more information.
Multiple browser agents push Operator and Elon attempts to buy OpenAI Hosted on Acast. See acast.com/privacy for more information.
DeepSeek rioted the markets last week and this week OpenAI releases o3 and Deep Research. What does it mean? We tell you! Hosted on Acast. See acast.com/privacy for more information.
Chapters00:00 The Rise of DeepSeek05:50 Market Reactions: Understanding the Financial Impact11:40 Innovation and Efficiency: The Future of AI Models17:14 China's Role in AI Development: Opportunities and Concerns23:13 The Compute Debate: Training vs. Operation29:27 Cultural Relevance and the Future of AI35:39 The Road Ahead: Predictions and Opportunities Hosted on Acast. See acast.com/privacy for more information.
To The Cosmos

To The Cosmos

2025-01-1430:00

Justin and Andrew discuss their holiday experiences, particularly focusing on theme parks and the latest innovations in technology. They delve into Nvidia's Cosmos, a generative video model for robotics, and the implications of AI export restrictions proposed by the Biden administration. The conversation wraps up with a review of the Meta Ray Bans, highlighting their functionality and potential in everyday use.Chapters00:00 Welcome Back and Holiday Reflections03:01 Theme Park Experiences and Expectations05:58 Nvidia's Cosmos and Robotics Innovations12:05 AI Export Restrictions and Global Implications21:04 Meta Ray Bands Review and AI Integration Hosted on Acast. See acast.com/privacy for more information.
Justin Young and Andrew Mayne discuss Shipmas as well as a major update in the Hunter DeButts controversy and a look at the capabilities of Google's new deep research service. Hosted on Acast. See acast.com/privacy for more information.
Sora Debuts

Sora Debuts

2024-12-1034:36

Andrew Mayne and Justin Robert Young discuss the recent announcements from OpenAI, particularly focusing on the launch of Sora, OpenAI's new video engine. They explore the features of Sora, the pricing models introduced, and the implications of AI development in the current tech landscape, especially in relation to Google. The discussion also touches on the collaborative features of Sora, the advancements in AI model trainability, and the overall excitement surrounding the future of AI technology.Chapters00:00 Introduction to Sora and OpenAI's Shipmas06:14 The Impact of Sora on Video Production11:50 The Future of AI in Content Creation18:09 OpenAI's New Training Capabilities24:51 The Anticipation and Fatigue of AI Releases30:58 The Future of AI: Opportunities and Challenges Hosted on Acast. See acast.com/privacy for more information.
loading
Comments