DiscoverThe Context Window with David Deming Podcast
The Context Window with David Deming Podcast
Claim Ownership

The Context Window with David Deming Podcast

Author: David Deming

Subscribed: 5Played: 54
Share

Description

The conversations that matter most need context. Harvard Dean David Deming talks with leaders and thinkers about how they became who they are — the detours, the doubt, and the people who helped along the way.

thecontextwindowpodcast.substack.com
25 Episodes
Reverse
 This is part three of David Deming's three-part series on A.I. in education. In part one, David - labor economist and Dean of Harvard College - talked about how A.I. has changed college classrooms and what he and others are doing to protect the integrity of teaching and learning at Harvard. That was the strategy on defense. Part two was offense.Today he pulls on one final thread that was left hanging in the two previous discussions, and it's the most controversial and contentious application of A.I. in the classroom: writing. Should we use A.I. to write for us? Should we use A.I. to improve our own writing? And if writing is thinking, will A.I. writing lead to cognitive offloading? Will it shrink our brains?David found more than a dozen studies, mostly randomized controlled trials, that specifically study A.I. and writing. A.I. makes writing better. It's especially good at turning weak writing into competent conventional prose. That's not the same as making you better at writing.He wants to be very clear: the evidence does not support, and he would not encourage you to use A.I. to write for you, at least if you want to retain any learning from what you've written. However, A.I. does make some parts of the writing process easier and more available. You can get individualized feedback, hear good counterarguments, consider alternative framings, and receive help with grammar and sentence construction.Students deserve a thoughtful approach that is guided by evidence, not the extremes of a total ban or surrender. Rather than giving up on the term paper or banning A.I. and hoping for the best, we should intentionally incorporate it into the parts of the writing process where it can be helpful. For example, in giving honest, critical feedback. Acceptance or encouragement isn't enough.For show notes and full episodes, subscribe to The Context Window with David Deming: ⁠https://thecontextwindowpodcast.substack.com This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit thecontextwindowpodcast.substack.com
In Part 2 of his series on A.I. in education, David Deming asks: Can we use A.I. to make learning better? And if so, how?Last week, David discussed how A.I. has changed college classrooms at Harvard and around the country, and how we can protect the integrity of the learning process. That was defense against A.I. This week, he talks about offense.When David dug into the research on A.I. and education almost a year ago, the evidence was pretty clear that A.I. without any guidelines, or guardrails, was harmful for learning because it makes things too easy. But since then, more than a dozen randomized controlled trials or other studies with good research designs have been published on the topic. Based on that evidence, he has become somewhat optimistic that A.I. really can improve learning, provided we can get beyond the current chaos of unfettered A.I. use and integrate it more thoughtfully into teaching.David draws three key lessons from those studies: “think first, ChatGPT later”; use A.I. to personalize productive struggle; and build in scaffolding that makes it easy for students to use A.I. the right way and hard to use it the wrong way.The status quo is a Wild West of A.I. use, often happening in secret and rarely with any supervision. But it doesn’t have to be that way, and the research I’ve read suggests we may have a path forward.For show notes and full episodes, subscribe to The Context Window with David Deming: ⁠https://thecontextwindowpodcast.substack.com This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit thecontextwindowpodcast.substack.com
 Today’s topic is A.I. in the classroom, and it's a personal one for David. As Dean of Harvard College, he's been thinking and writing and talking with students a lot about A.I.: how it’s changed teaching and learning in college classrooms at Harvard and around the country, how we should adapt as teachers, and what students can do to prepare themselves for a workplace and a society where A.I. is everywhere - and they are expected to use it more and more just to keep pace.His basic view is that we should pursue a mix of what he calls defensive and offensive strategies for dealing with A.I. The defensive strategy starts with the idea that the learning process and the struggle that sometimes comes with it need to be protected. That means A.I.-proofing assessments so that good performance truly demonstrates mastery of the material.Unenforceable A.I. bans make it hard to do the right thing and easy to do the wrong thing, and that’s not fair to students. David argues that teachers need to design assignments and assessments better to protect the thinking that good writing requires. There’s a hopeful sense, in his view, in which A.I. will push educators to make the kinds of classroom improvements that they probably always should have been making anyway.Next week, David will turn to offense: how to use A.I. to make learning better.For show notes and full episodes, subscribe to The Context Window with David Deming: ⁠https://thecontextwindowpodcast.substack.com This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit thecontextwindowpodcast.substack.com
 David's guest today is ⁠Emily Oster.⁠ Emily is an economist at Brown University, author of four New York Times bestselling books, and founder of the parenting information platform, ParentData. Here books ⁠Expecting Better⁠ and ⁠Cribsheet⁠, which looked at how to interpret research on topics like alcohol consumption during pregnancy, breastfeeding, and sleep training, were genuine cultural phenomena, especially for anxious parents wondering where to turn for good advice.In October 2020, when the world was still deep in the pandemic, she wrote an influential article in The Atlantic entitled "⁠Schools Aren't Super-Spreaders⁠," which was driven by her read of the early research on COVID-19's spread in schools. The CDC and then-Education Secretary Betsy DeVos cited her work as a reason to open schools earlier. Emily also built a data platform to try and understand the impacts of pandemic learning loss.David wanted to talk with Emily about her road from wunderkind economist to bestselling author and public voice in health and parenting. They discuss the bumps along that road, what she learned from her mother about kindness and directness, and why she cares more about finding the answer than being right.Parent Data: ⁠https://parentdata.org/⁠For show notes and full episodes, subscribe to The Context Window with David Deming: ⁠https://thecontextwindowpodcast.substack.com This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit thecontextwindowpodcast.substack.com
 What happens when A.I. starts improving itself faster than humans can keep up? The researchers building these models can't fully explain how they work. If those models begin designing their successors, the things we don't understand could get baked into each new generation. How do we keep control?In part two of his series on recursive self-improvement, David Deming focuses on alignment, the challenge of getting A.I. to do what we want. Human morality can't be reduced to a set of rules, and getting a model to behave well today doesn't guarantee it will ehave well as it becomes more capable.He then turns to control: limiting what models can do, keeping the ability to shut them down, and building safeguards that assume failures will happen. From factory safety to A.I. agents that find ways around their instructions, David asks what it would take to contain the consequences when things go wrong. He argues that A.I. labs should have to meet much higher safety standards before they let models improve themselves. Powerful machines need engineering safeguards and people who can be held accountable when those safeguards fail.Part 1 of this series: https://thecontextwindowpodcast.substack.com/p/can-ai-get-better-at-making-itselfFor show notes and full episodes, subscribe to The Context Window with David Deming: ⁠https://thecontextwindowpodcast.substack.com This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit thecontextwindowpodcast.substack.com
loading
Comments