In March 2024, I opened Facebook and saw Jensen Huang's face. The Nvidia CEO was offering investment advice, speaking directly to me in Mandarin. Of course, it was not really Huang. It was an AI-generated scam, and I was far from the first to be targeted: across Taiwan, a flood of scams was defrauding millions of citizens.

We faced a dilemma. Taiwan has the freest internet in Asia; any content regulation is unacceptable. Yet AI was being used to weaponize that freedom against the citizenry.

Our response — and its success — demonstrates something fundamental about how AI alignment must work. We did not ask experts to solve it. We did not let a handful of researchers decide what counted as “fraud.” Instead, we sent 200,000 random text messages asking citizens: what should we do together?

Four hundred forty-seven everyday Taiwanese — mirroring our entire population by age, education, region, occupation — deliberated in groups of 10. They were not seeking perfect agreement but uncommon ground — ideas that people with different views could still find reasonable. Within months, we had unanimous parliamentary support for new laws. By 2025, the scam ads were gone.

This is what I call [...]

---

Outline:

(01:44 ) AI Alignment Today Is Fundamentally Flawed

(03:45 ) The Stakes Are High

(07:42 ) Attentiveness in Practice

(09:21 ) Industry Norms

(10:36 ) Market Design

(11:59 ) Community-Scale Assistants

(13:10 ) From 1% pilots to 99% adoption

(14:24 ) Attentiveness Works

(16:44 ) Discussion about this post

---

First published:

November 3rd, 2025

Source:

https://aifrontiersmedia.substack.com/p/ai-alignment-cannot-be-top-down

---

Narrated by TYPE III AUDIO.

---