DiscoverChatEDU – The AI & Education PodcastCounting What Counts: The Push to Measure AI Literacy | Ep. 76
Counting What Counts: The Push to Measure AI Literacy | Ep. 76

Counting What Counts: The Push to Measure AI Literacy | Ep. 76

Update: 2025-09-19
Share

Description

In this episode of ChatEDU (Counting What Counts: The Push to Measure AI Literacy), Matt & Liz start with a tech glitch & a visit with Aura, a Tesla voice model pretending to be a therapist. They shift to copyright lawsuits, student safety, & the need to define & measure AI literacy in schools.


Story #1: The Rundown


$1.5B Settlement: Anthropic agrees to pay authors for pirated training data. A major legal turning point. The court delays the deal & demands transparency & clear author rights.


Character.AI Report: 669 harmful chatbot interactions with kids found in 50 hours of testing.


FTC Investigation: The FTC opens a formal inquiry into AI companions & their impact on minors.


NotebookLM Upgrades: Flashcards, quizzes, audio guides, & LMS support added to Google’s AI study tool.


SETDA 2025 Report: AI is now the top state edtech priority. Device bans are rising, but so is investment in AI PD.


Curtin Disables AI Detection: Turnitin’s AI-writing detector will be turned off to support trust & modern assessment.


Detectors Still Struggle: Most AI detectors fail key benchmarks. Pangram is the only one showing strong results.


Open-Source AI Textbooks: A new tool lets educators build AI-powered textbooks from OER with no coding.


NYT Teen Contest: Students ages 13–19 can submit creative projects on life with AI. Due Oct 22.



Story #2: Social Learning in the Age of AI


A new study shows AI is replacing peer-to-peer learning. Students are skipping group study & turning to chatbots. The result is less collaboration, less creativity, & more isolation. Matt & Liz unpack the impact on student motivation & mentorship.



Story #3: Beneath the Surface – AI Literacy & the Measurement Gap


Schools are racing to teach AI, but how do we know students are learning what matters?


TeachAI ScenariosReady-to-use lessons that build source-checking & ethical use skills.


AI QuestA game-based platform from Google & Stanford where students train models & solve real problems.


ETS OpinionWithout shared definitions & measurement, AI literacy risks becoming a buzzword.


Liz shares how her new student-facing course approaches skills, reflection, & real-world prompts.



Bright Byte: Alter Ego


MIT’s new wearable lets users silently communicate with machines by detecting muscle signals in the jaw & throat. Built to support people with ALS & MS, this tool brings AI & accessibility together.



Links & Resources


NotebookLM

https://notebooklm.google/


AI Scenarios

ailiteracyframework.org


AI Quest

https://blog.google/outreach-initiatives/education/ai-quests/


ETS Opinion

https://hechingerreport.org/opinion-schools-cannot-teach-ai-literacy-without-a-way-to-measure-it/


Character.AI

https://www.ftc.gov/news-events/news/press-releases/2025/09/ftc-launches-inquiry-ai-chatbots-acting-companions


SETDA 2025

https://www.setda.org/priorities/state-trends/


Anthropic Settlement

https://www.npr.org/2025/09/05/nx-s1-5529404/anthropic-settlement-authors-copyright-ai


Judge Pushback

https://news.bloomberglaw.com/ip-law/anthropic-judge-blasts-copyright-pact-as-nowhere-close-to-done


Curtin Disables Detection

https://www.curtin.edu.au/news/oasis-news/update-on-turnitin-ai-detection-tool/


NBER Study

https://www.nber.org/papers/w34223


GenerativeTextbooks.org


NYT Contesthttps://www.nytimes.com/2025/09/05/learning/growing-up-with-ai-a-multimedia-challenge-for-teenagers-and-educators.html


Alter Ego

https://decrypt.co/338527/near-telepathic-wearable-communicate-silently-devices



Announcements


Check out the new Student AI Course for middle & high school. Email Matt & Liz at chatedu@edadvance.org 


The Fall Micro-Credential is open. Join us for the educator & school leader course starting in October -  skills21.org/ai/micro



Sponsors

The National Center for Next Generation Manufacturing. Explore their October 15–17 Summit in Rochester Hills, MI. www.nextgenmfg.org


EDIAThe AI-powered platform helping schools reduce absences & boost achievement edia.app/contact

Comments 
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Counting What Counts: The Push to Measure AI Literacy | Ep. 76

Counting What Counts: The Push to Measure AI Literacy | Ep. 76

Matt Mervis and Dr. Elizabeth Radday