New Week #123
Description
Welcome to the mid-week update from New World Same Humans, a newsletter on trends, technology, and society by David Mattin.
If you’re reading this and haven’t yet subscribed, join 25,000+ curious souls on a journey to build a better future 🚀🔮
To Begin
This week, two intriguing stories and a big announcement.
Global leaders and senior tech executives gathered at the UK’s AI Safety Summit. But beyond the walls of Bletchley Park, the debate on AI is raging hotter than ever.
Meanwhile, tech billionaires in Silicon Valley are running into trouble over their plans to build a new city-state utopia called California Forever.
As for the announcement? Just keep scrolling.
Let’s do this.
🧠 Dream machines
The UK government this week trumpeted the success of its international AI gathering; it took place at the historic fountainhead of the computer revolution, Bletchley Park.
An impressive guest list, including US vice-president Kamala Harris and the European Commission president Ursula von der Leyen, gathered at the Summit. And their meeting resulted in the Bletchley Declaration, which the UK government has hailed as a world-first international statement on AI safety.
Here’s a taste for those who speak technocrat:
‘We affirm that, whilst safety must be considered across the AI lifecycle, actors developing frontier AI capabilities, in particular those AI systems which are unusually powerful and potentially harmful, have a particularly strong responsibility for ensuring the safety of these AI systems…We encourage all relevant actors to provide context-appropriate transparency and accountability on their plans to measure, monitor and mitigate potentially harmful capabilities and the associated effects that may emerge…’
But beyond the Declaration, this week made it clear that we’re further than ever from a consensus on the deep implications of machine intelligence. In fact, this was the week that a maximum volume war of words broke out between leading AI builders.
Google Brain co-founder and Stanford professor Andrew Ng said key AI players, including Sam Altman, are wildly playing up fears of AI doom in order to spark regulation that will suppress competition from insurgents. He called the proposal that the training of powerful AI models should require a license ‘colossally dumb’.
That message was echoed by Meta’s chief AI scientist Yann LeCun, who favours open source — that is, anyone can use it — AI models.
But Google DeepMind CEO Demis Hassabis hit back at LeCunn, saying that failure to regulate AI could result in ‘grim’ consequences for humanity.
This account barely scratches the surface of the arguments that raged this week.
As for OpenAI, they launched a new team intended to study and prepare for ‘catastrophic risks’ including an AI-instigated nuclear war.
⚡ NWSH Take: Who would ever have thought that a bunch of super-smart, tech-obsessed social media addicts would end up arguing like this? While Bletchley saw a rare moment of diplomatic unity, inside the AI industry the full spectrum of opinion is manifest, from AI doom is all a load of rubbish to act now or the end of humanity is probable. // It pays, here, to remember that two things can be true at once. Yes, Altman’s global tour to warn of ‘catastrophic risks’ is a carefully orchestrated marketing campaign. But it’s also the case that no one, yet, has a definitive picture of the risks in play. // What is increasingly clear, though, is that the rise of machine intelligence is the primary fact of our shared lives now. It will do more than any other force to reshape our collective future. // But the Bletchley Declaration consists of bromides that will change nothing. And the sight at Bletchley this week of UK prime minister Rishi Sunak interviewing Elon Musk — positioning Musk as the star and Sunak as a fan — spoke volumes about the power imbalances we’ve allowed to evolve when it comes to government (i.e. the people) and unaccountable tech overlords. // We must recover our collective agency; our ability to assert human modes of living and being in the face of an ongoing technology revolution. That means doing politics. Bletchley was a start. But what’s needed next are citizen assemblies, and an authentic movement around AI for the people.
💥 The Exponentialist
As some of you will have seen on social media, I made a big announcement this week.
I’ve partnered with Raoul Pal, renowned macro-economic thinker and CEO of Real Vision, on a new premium research service called The Exponentialist.
This is a professional and enterprise-level service for those who want to go deep on emerging technologies, the futures they’ll create, and the challenges and opportunities latent in all that.
This won’t be for everyone in the NWSH community. But if you’re a foresight professional, strategist, founder, marketing leader, product manager, designer or much else besides, The Exponentialist will fuel you and your team. And it will take up only a fraction of your research budget.
It will also be deeply valuable for anyone seeking to position an investment portfolio around tech and crypto.
This launch changes nothing about New World Same Humans and the community we’re building here. Our mission continues unchanged!
If The Exponentialist sounds useful, go here to learn more. And if you’ve subscribed or you’re considering it, hit reply to this email so I can say thanks.
🏙 Now and Forever
While the newsletter was on pause, we learned that a group of Silicon Valley billionaires are planning a new city-state utopia in California. This week, it seems their project has run into trouble.
California Forever is a new city planned for construction in Solano County in the north of the state. It’s backed by some of tech’s most notable power players, including ultra-rich VC Marc Andreessen, Stripe founders Patrick and John Collison, and LinkedIn founder Reid Hoffman.
The group’s vision for the city has strong solar punk, hi-tech sustainable utopia vibes:
But this week it was reported that the mysterious company behind the plans, Flannery Associates, is accused of using ‘strong-arm tactics’ including lease terminations to buy up the Bay Area farmland it needs. Local farmers aren’t happy, and now some of them are taking the matter to court.
Trouble in (planned) paradise, then.
⚡ NWSH Take: This project reminds me of the various other pseudo-independent city-states discussed in this newsletter over the years. There’s Walmart billionaire Marc Lore’s Telosa City, for example, a sustainable paradise planned for the Nevada desert. And Praxis, a startup on a mission to build a new Great City somewhere in the Mediterranean, funded by NFTs of the monuments they’ll build in the city once it exists. // Few details have emerged of the way California Forever will be governed. But for a glimpse, we might turn to billionaire backer Marc Andreessen’s recent’s Techno-Optimist Manifesto, which proclaims: ‘we believe in ambition, aggression, persistence, relentlessness — strength.’ I’m thinking libertarian, with a strong emphasis on innovation and startup culture. // Of course, innovation and startups can be great. But they only function in the context of the broader socio-political frameworks that libertarians such as Andreessen repudiate. As with the other charter city projects covered in this newsletter, I can’t help feeling that at the heart of Forever California is a fantasy of permanent escape from politics. Escape, that is, from the messy, awkward business of managing conflict among different interest groups, and enacting trade-offs between different but equally legitimate value systems. This argument with the farmers might be the first public conflict that Forever California has run into, but