TeachLab Presents The Homework Machine

The timing of the arrival of AI has been bad for many schools and teachers. In the Fall of 2022, schools were just emerging from the extraordinary challenges brought by the pandemic. Teacher morale and turnover are at historic lows. Some school districts are on a good footing, and have the resources and stability to adapt, and even experiment with using AI to support learning, but many teachers tell us generative AI has just been one more thing they have to deal with, often without the support they would like. At a moment when unprecedented sums are being invested in AI development — including many billions devoted to AI powered education technology — teachers wonder if our priorities are in the right place. This episode was produced by Steven Jackson and Jesse Dukes. We had editing from Ruxandra Guidi and Alexandra Salomon. Reporting and research from Holly McDede and Andrew Meriwether. Reporting and research for the series from Chris Bagg, Andrew Parsons, Natasha Esteves, and Marnette Federis. Sound design and music supervision by Steven Jackson.Production help from Yebu Ji. Data analysis from Manee Ngozi Nnamani and Manasa Kudumu. Administrative support from Jessica Rondon. Special thanks to Josh Sheldon and Eric Klopfer.Original music for this series was created by Steven Jackson, Andrew Meriwether and Jesse Dukes, as part of the music project Cue Shop. Thanks to Will Grueb, Andy Wilds, and the MIT Music Department for letting us use the MIT Harpsichord.The research and reporting you heard in this episode was supported by the Spencer Foundation, the Kapor Foundation, the Jameel World Education Lab, the Social and Ethical Responsibility of Computing initiative at MIT, and the RAISE initiative, Responsible AI for Social Empowerment and Education also at MIT. We had support from Google’s Academic Research Awards program.Please take our Listener Survey for a chance to win a $25 gift card.

https://docs.google.com/forms/d/15pFzNFcJ08xBSTnoE2-YJyoxsdIW5cKDnjrpBfBAf7U/edit

We keep saying that most ed tech is invited into schools, but generative AI crashed the party. But the truth in, some teachers have invited AI into schools. Some think it’s been great, and others see opportunities as well as challenges. We visit four classrooms where students and teachers are using AI in ways they say are innovative, fulfilling, and effective: a student in Oregon who worked with her teacher to expand the scope of her assignments with AI; a Southern California instructor using AI to bypass busywork and focus on the creative aspects of filmmaking; a teacher in Illinois deploying AI to provide targeted feedback; and, finally, a former engineer whose students use AI coding tools to make circuitboards…play Rick Astley? And we ask the question: What are the human teachers doing to create conditions in which AI can support learning? This episode was produced by Jesse Dukes. We had editing from Alexandra Salomon and Ruxandra Guidi. Reporting and research from Chris Bagg, and Andrew Parsons. Additional reporting from Andrew Meriwether, Holly McDede, Natasha Esteves, and Marnette Federis. Sound design and music supervision by Steven Jackson. Thanks to Jerry Shaw for digging up some of those Arduino Uno songs. The “Uptown Funk” was a simulation, created in our studios. Production help from Yebu Ji. Data analysis from Manee Ngozi Nnamani and Manasa Kudumu. Administrative support from Jessica Rondon. Special thanks to Josh Sheldon and Eric Klopfer. Original music for this series was created by Steven Jackson, Andrew Meriwether and Jesse Dukes, as part of the music project Cue Shop. Thanks to Will Grueb, Andy Wilds, and the MIT Music Department for letting us use the MIT Harpsichord.The research and reporting you heard in this episode was supported by the Spencer Foundation, the Kapor Foundation, the Jameel World Education Lab, the Social and Ethical Responsibility of Computing initiative at MIT, and the RAISE initiative, Responsible AI for Social Empowerment and Education also at MIT.We had support from Google’s Academic Research Awards program.

Education technology companies have been falling over themselves to provide AI powered tools for schools, and to convince schools to buy their product. The array of AI powered products is dizzying, and while some can likely be put to good use, it can be hard for school leaders to gauge which are worth adopting. One school system in Iowa, Winterset Community School District has gone all in on generative AI, piloting at least three AI powered products and encouraging faculty and students to experiment with AI. They kindly let us visit for a week, and we dive in to see what they’re excited about, and what has been challenging. This episode was produced by Andrew Meriwether and Jesse Dukes. We had editing from Ruxandra Guidi and Alexandra Salomon. Reporting and research for the Homework Machine from Natasha Esteves, Holly McDede, Andrew Parsons, Marnette Federis, and Chris Bagg. Sound design and music supervision by Steven Jackson. Production help from Yebu Ji. Data analysis from Manee Ngozi Nnamani and Manasa Kudumu. Special thanks to Josh Sheldon and Eric Klopfer. Administrative support from Jessica Rondon. Thanks to Chad Sussex and everybody at Winterset who spoke to Andrew Meriwether. We’re happy to share that AI Express: Leading the Future of Learning — written by Chad Sussex and Sandy Groom-Meeks, who guided the AI journey for Winterset — is now available. This book offers school leaders and educators a practical roadmap for safely and effectively implementing AI in schools. Find the book here: https://bit.ly/AIExpress_AmazonOriginal music for this series was created by Steven Jackson, Andrew Meriwether and Jesse Dukes, as part of the music project Cue Shop. Thanks to Will Grueb, Andy Wilds, and the MIT Music Department for letting us use the MIT Harpsichord. The research and reporting you heard in this episode was supported by the Spencer Foundation, the Kapor Foundation, the Jameel World Education Lab, the Social and Ethical Responsibility of Computing initiative at MIT, and the RAISE initiative, Responsible AI for Social Empowerment and Education also at MIT. We had support from Google’s Academic Research Awards program.

We’re halfway through “The Homework Machine” series, and as our production team works to finish the final episodes, we check in with Teaching Systems Lab director Justin Reich, who is returning to the classroom after a full year of sabbatical. Justin has been nervous, since some of the assignments he’s relied on in the past are not “AI-proof”. He tells us how he plans to adapt, We want to share A Guide to AI in Schools: Perspectives for the Perplexed the guidebook authored by TSL, based on the interviews we conducted for “The Homework Machine”. Justin is a fan of these protocols for evaluating student work:

We’re about halfway through The Homework Machine min-series, and we have more episodes coming. We're taking a break this week, which gives us the opportunity to share an episode of one of our favorite education podcasts with you.Mindshift from KQED features in depth interviews and reports from classroom about education and educators. We particularly enjoy this episode about a shift to teach contemporary poets, alongside the classics.Hanif Abduraqqib. Sarah Kay. Elizabeth Acevedo. Clint Smith. Do any of these names sound familiar? How about Amanda Gorman? All of these writers are part of America’s thriving contemporary poetry scene. But you won’t find them in many text books, because high school poetry units tend to focus on dead poets, like Robert Frost, Walt Whitman and Edgar Allen Poe. North Carolina teacher Melissa Smith is working to change that. For the last seven years, she’s been diversifying the canon in her classroom, and encouraging other teachers to do the same with the hashtag #teachlivingpoets. The shift has inspired teachers across the country to get creative with how they teach students things like tone, rhythm and structure in poetry. And it’s inspired students to connect with and see reflections of themselves in the poets they study.We have more episodes of the Homework Machine coming in a little over a week. In the meantime, please take our listener survey. (We'll enter you in a drawing to win a $25 gift card).https://forms.gle/KwPGTeVYZh2mo6gF7

Students tell us that they know learning in schools is important. But sometimes, turning to ChatGPT to get their work done feels like the best option. AI might help with what they perceive as busy work, or they might be confused about what counts as a legitimate use, and what counts as cheating.And sometimes, students tell us, they know they’re crossing a line. When that happens, it’s usually because they’ve hit a wall in the learning process, and generative AI presents a quick and easy way through the blockage. For teachers, there is no single, off the shelf solution, that will ensure students make wise decisions, but understanding why students turn to AI can be a helpful starting point.This episode was produced by Andrew Meriwether Jesse Dukes. We had editing from Ruxandra Guidi and Alexandra Salomon. Reporting and research from Natasha Esteves, Holly McDede, Andrew Parsons, Marnette Federis, and Chris Bagg. Sound design and music supervision by Steven Jackson. Production help from Yebu Ji. Data analysis from Manee Ngozi Nnamani and Manasa Kudumu. Special thanks to Josh Sheldon and Eric Klopfer. Administrative support from Jessica Rondon.Featured guests include Miriam Reichenberg, Kaitleen Evangelista, as well as anonymous students. Thanks to InTandem for facilitating interviews.Thanks to Greer Murphy and Jessa Kirk, at UC Santa Cruz's Academic Integrity Office. Check out Greer Murphy's co-authored survey of academic integrity policies.Original music for this series was created by Steven Jackson, Andrew Meriwether and Jesse Dukes, as part of the music project Cue Shop. Thanks to Will Grueb, Andy Wilds, and the MIT Music Department for letting us use the MIT Harpsichord.The research and reporting you heard in this episode was supported by the Spencer Foundation, the Kapor Foundation, the Jameel World Education Lab, the Social and Ethical Responsibility of Computing initiative at MIT, and the RAISE initiative, Responsible AI for Social Empowerment and Education also at MIT.We had support from Google’s Academic Research Awards program.

Teachers have all sorts of opinions about AI. Some are optimistic, some are pessimistic. But the most common topic that came up in our interviews was cheating.While students have always taken shortcuts to complete their work, ChatGPT and other generative AI have a historically unique power to quickly, convincingly and comprehensively do a students’ assignment. This is proving a powerful temptation to students.So how do teachers help their students make good decisions? Teachers know that schools have historically struggled to manage discipline fairly but they also recognize that letting students get away with cheating isn’t doing them a favor. Teachers share how they’re navigating the Scylla and Charybdis of school discipline in the AI age.Listen to a bleeped version of this episode (Coming soon!).Transcript coming soon!This episode was produced by Jesse Dukes with Yebu Ji.Editing: Alexandra Salomon and Ruxandra GuidiReporting and research from Natasha Esteves, Andrew Meriwether, Holly McDede, Andrew Parsons, Marnette Federis, and Chris Bagg.Sound design and music supervision by Steven Jackson.Production assistance from Nathan Ray.Data analysis from Manee Ngozi Nnamani and Manasa Kudumu.Special thanks to Josh Sheldon, Camila Lee, Liz Hutner, and Eric Klopfer.Administrative support from Jessica Rondon.Thanks to the teachers who spoke to us including Joe O'Hara, Alec Jensen, Schuyler Hunt, Anna Rose Pandey, Ray Salazar, and Jessica Petit-Frere. And thanks to all the teachers and students who partipated in our research.Thanks to Greer Murphy and Jessa Kirk, at UC Santa Cruz's Office of Academic Integrity. Check out Greer Murphy's co-authored survey of academic integrity policies.The research and reporting you heard in this episode was supported by the Spencer Foundation, the Kapor Foundation, the Jameel World Education Lab, the Social and Ethical Responsibility of Computing initiative at MIT, and the RAISE initiative, Responsible AI for Social Empowerment and Education also at MIT.We had support from Google’s Academic Research Awards program.The Homework Machine is a program of the MIT Teaching Systems Lab, Justin Reich, director.

ChatGPT is the most well known of the Large Language Models (LLMs) but what is an LLM? We go deep into how this remarkable new technology is built, and why their performance is inconsistent — or jagged — across similar tasks. We dive into the techniques AI engineers use to align these tools’ behavior with our values, and explain why they don’t always work, and sometimes we get hallucinations or biased output.  This episode was produced by Steven Jackson and Jesse DukesEditing:  Alexandra Salomon and Ruxandra Guidi  Reporting and research from Holly McDede, Natasha Esteves, Andrew Parsons, Andrew Meriwether, Marnette Federis, and Chris Bagg.Sound design and music supervision by Steven Jackson. Production assistance from Yebu Ji and Nathan Ray. Data analysis from Manee Ngozi Nnamani and Manasa Kudumu. Special thanks to Josh Sheldon, Camila Lee, Liz Hutner, and Eric Klopfer. Administrative support from Jessica Rondon. The research and reporting you heard in this episode was supported by the Spencer Foundation, the Kapor Foundation, the Jameel World Education Lab, the Social and Ethical Responsibility of Computing initiative at MIT, and the RAISE initiative, Responsible AI for Social Empowerment and Education also at MIT. We had support from Google’s  Academic Research Awards program. The Homework Machine is a program of the MIT Teaching Systems Lab, Justin Reich, director. 

In late November of 2022, ChatGPT was released to the public as a free research preview. Students quickly realized ChatGPT was pretty good at doing their homework for them. Schools scrambled to figure out what to do:  Ban it? Embrace it? Teachers and students found themselves adapting to a new reality. Buckle Up, Here it Comes kicks off “The Homework Machine” a mini series in the Teachlab podcast. Hosts Jesse Dukes and Justin Reich share stories of teachers and students reacting to the arrival of an exciting, alarming, and strange new technology. Producer: Jesse DukesEditors: Ruxandra Guidi and Alexandra Salomon.Reporting and research: Holly McDede, Natasha Esteves, Andrew Meriwether, and Chris Bagg. Sound design and music supervision: Steven Jackson. Data analysis: Manee Ngozi Nnamani and Manasa Kudumu. Special thanks to Josh Sheldon, Camila Lee, Liz Hutner, and Eric Klopfer. Administrative support from Jessica Rondon. The research and reporting you heard in this episode was supported by the Spencer Foundation, the Kapor Foundation, the Jameel World Education Lab, the Social and Ethical Responsibility of Computing initiative at MIT, and the RAISE initiative, Responsible AI for Social Empowerment and Education also at MIT. Additional support from Google’s Academic Research Awards program. InTandem facilitated some of our student interviews. Full episode transcript. 

Generative AI is not like other education technologies, which schools often invite into the classroom. This one crashed the party. And then, it started re-arranging the furniture. We wanted to learn more, so in a little over a year, the Teaching Systems Lab has talked to over 90 teachers and 30 students about the impact of Generative AI. Some are excited about AI's potential to transform education for the better. Others are troubled by the temptations of a machine that can quickly and convincingly do many homework assignments. And some think AI is just a shiny object – a distraction from the much larger problems facing education.Over the next seven episodes, we'll try to answer the question: Is AI a game-changing tool, a threat to critical thinking, another ed tech fad? … or something else? Media requests can go to jpd009@mit.edu.  

School leaders, education researchers, and others often point to a study conducted by Stanford researchers that suggested the arrival of generative AI in K-12 school has not meaningfully increased the percentage of students who acknowledge some kind of academic dishonesty. Sometimes, school leaders or experts suggest it means there’s “nothing to see here” when it comes to tools like ChatGPT and worries about students bypassing learning. Researcher + Journalist Jesse Dukes joins Justin to dive into the specifics of that study, and compare it with anecdotes from interviews with students and teachers.  This episode was produced by Andrew Meriwether and Jesse Dukes. We had additional reporting from Holly McDede  and research help from Natasha Esteves and Manassa Kudumu. Thanks to the Spencer Foundation and the Social and Ethical Responsibilities of Computing Initiative at MIT for funding our ongoing  research into the arrival of generative AI in schools. And thanks to the Kapor Foundation for funding Jesse’s work in California with KALW public radio. Thanks to all of the teachers and administrators who have talked with us.  If you want to take our survey, or learn more about our research into Generative AI and K12 education, head over to tsl.mit.edu/ai and if you want to volunteer for the sister study, in California, visit Jesse’s Linktree.

Justin Reich and researcher and producer Jesse Dukes argue that AI in requires a new theoretical framework. Generative AI, unlike many teaching technologies, is an "arrival" technology, meaning it will be present in school environments regardless of what choices school leaders make about whether to adopt it. Their new preprint Toward a New Theory of Arrival Technologies: The Case of ChatGPT and the Future of Education Technology after Adoption explores the idea of "arrival technologies"But rather than summarize it, hey, why not let the arrival technology do it? So we turn to Google's new tool, Notebook LM for a "Deep Dive Conversation" to summarize the article. Thanks to the Spencer Foundation and the Social and Ethical Responsibilities of Computing initiative at MIT for funding our ongoing  research into the arrival of generative AI in schools. Thanks to all of the teachers and administrators who have talked with us.  This episode was produced by Jesse Dukes. We had research help from Chris Bagg, Manasa Kudumu, Natasha Esteves, and Andrew Meriwether. If you want to take our survey, or learn more about our research into Generative AI and K12 education, head over to tsl.mit.edu and if you want to volunteer for the sister study, in California, visit Jesse’s Linktree.  

Jesse Dukes reports from a two day training one school district offered its teachers, all to help them adapt to the arrival of generative AI in schools. That training proved helpful to teachers, but it’s not clear how much professional development most American teachers are getting, and it appears many are getting little or none.  Episode produced by Jesse DukesResearch by Chris Bagg, Andrew Meriwether, and Natashas Esteves. Editorial support by Natasha Esteves. Additional research from Manasa Kudumu. Thanks for the school district that let us visit (you know who are!) Thanks to all the teachers who talked with us for our ongoing research into the arrival of generative AI in school environments. Learn more at tsl.mit.edu/AI. 

We've just wrapped up a school year, so our team researching the arrival of generative AI in classrooms shares  some fun and inspiring moments of teachers adapting to the new reality. We hear from teachers who role modeled the use of as a tool or resource for students, or to generate amusing and weird curricula. This episode was produced by Andrew Meriwether and Jesse Dukes, and features research by Natasha Esteves, Chris Bagg, Andrew Meriwether, and Jesse Dukes. Original song "The AI is a Hummin'" written by Jesse Dukes with help from Bing CoPilot, and performed by Jesse Dukes. To learn more about our ongoing research, take a survey, or volunteer to be interviewed, visit https://tsl.mit.edu/AI/.  

The Arrival of AI powered tools like ChatGPT (now GPT4) in schools has generated concerns that students would use the tool to bypass cognition, or, “cheat” as we colloquially call it. And, it appears many students are doing just that. Early on in our research project about generative AI’s arrival in schools, it seems that English, ELL, and Social Studies at upper levels are particularly likely to encounter students using AI, without permission, to complete assignments. Justin talks to Jesse Dukes who shares a few examples of how teachers are managing this new challenge, and they discuss the wider implications for teaching, ethics, and student well being. This episode was produced by Jesse Dukes. We had research help from Natasha Esteves, Andrew Meriwether, and Chris Bagg. Thanks to the Spencer Foundation for funding our research, and to all the teachers and administrators who agreed to speak with us. 

Justin spoke at the Connecticut Association of Boards of Education in November of 2023. You can see his graphics and outline.tsl.mit.edu/AI/ has more generative AI related resources, including our SURVEY for educators, school leaders, students, and parents. Jesse Dukes is leading our current project about the experiences of teachers and students with generative AI this school year. 

Today we share another great episode from our friends at Upper MiddleBrow. As students, parents, and teachers happily (or wrenchingly) returned to school, Upper MiddleBrow invited TeachLab host Justin Reich to talk about stories with teachers. They identify many examples of bad teachers and bad teaching in fiction, and while film and TV often present sympathetic teacher protagonists, they wonder if the Great American Teacher novel is yet to be written. Resources and LinksCheck out Upper MiddleBrow, a podcast where hosts Jesse Dukes and Chris Bagg discuss high-craft works of popular cultureOrder Justin Reich’s new book Iterate: The Secret to Innovation in SchoolsSee Upper MiddleBrow’s Teacher Protagonist’s graphicWatch our documentary film We Have to Do Something Different Follow TeachLab on Twitter and YouTubeFollow our host Justin Reich on Twitter

Civics 101 is a podcast refresher course on the basics of how the U.S. government works, born from the brain trust at New Hampshire Public Radio and hosted by Hannah McCarthy and Nick Capodice. This is the second part in their series about the state of civic education in the US. In this episode, TeachLab host Justin Reich joins the Civics 101 team  to talk about how teachers choose what to teach, so-called "divisive concepts laws," and how we can approach disagreements without falling prey to "division actors."This episode features: Justin Reich, Director at MIT Teaching Systems Lab and host of the TeachLab podcastLouise Dube, Executive Director of iCivics and member of the Implementation Consortium at Educating for American DemocracyCherylAnne Amendola,  Department Chair and teacher at Montclair Kimberly Academy and host of the podcast Teaching History Her Way Resources and LinksCheck out Civics 101: A Podcast, a production of New Hampshire Public RadioOrder Justin Reich’s new book Iterate: The Secret to Innovation in SchoolsClick here to see a map of all the states that have passed legislation limiting what teachers can say regarding race, sex, gender, etc. Click here to see the Interactive Roadmap by Educating for American Democracy.Watch our documentary film We Have to Do Something Different Transcript https://sonix.ai/share/XBF9ue1HSi1uek4spV3fHohu Follow TeachLab on Twitter and YouTubeFollow our host Justin Reich on Twitter

Civics 101 is a podcast refresher course on the basics of how the U.S. government works, born from the brain trust at New Hampshire Public Radio and hosted by Hannah McCarthy and Nick Capodice. Today is the first part in their series about the state of civic education in the US. In this episode, the Civics 101 team gauges how we're doing civics-wise and then delve into the perpetually controversial history of history; have we ever agreed upon a narrative for our nation that we can teach students?Walking us through the past, present, and future of social studies and civic education are Danielle Allen, James Bryant Conant University Professor at Harvard University, and Adam Laats, Historian and Professor of Teaching, Learning and Educational Leadership at Binghamton University.  Resources and LinksCheck out Civics 101: A Podcast, a production of New Hampshire Public RadioOrder Justin Reich’s new book Iterate: The Secret to Innovation in SchoolsWatch our documentary film We Have to Do Something Different Follow TeachLab on Twitter and YouTubeFollow our host Justin Reich on Twitter