“Being honest with AIs” by Lukas Finnveden
Description
Subtitle: When and why we should refrain from lying.
In the future, we might accidentally create AIs with ambitious goals that are misaligned with ours. But just because we don’t have the same goals doesn’t mean we need to be in conflict. We could also cooperate with each other and pursue mutually beneficial deals.
For previous discussion of this, you can read Making deals with early schemers. I recommend starting there before you read this post.
To facilitate this kind of cooperation, I would like us to be able to credibly negotiate with AIs, and credibly make promises about how we will help them if they help us. But it may be difficult to achieve high credibility in negotiations with AIs. AIs are in a very vulnerable epistemic position, because humans have a lot of control over AI memories and sensory inputs. Even worse: we have already developed [...]
---
Outline:
(04:17 ) What do we want from an honesty policy?
(06:40 ) Falsehoods that don't necessarily ruin credibility
(09:25 ) More complicated: Behavioral science
(12:29 ) The proposed policies
(12:43 ) No deception about deals
(19:27 ) Honesty string
(21:44 ) Compensation
(25:32 ) Communicating commitments
(27:01 ) Miscellaneous Q&A
(30:12 ) Conclusion
(30:53 ) Acknowledgments
(31:07 ) Appendix: How does no deception about deals apply to past experiments
(31:23 ) Sleeper agents
(31:52 ) Alignment faking
(33:08 ) Discovering language model behaviors
---
First published:
August 21st, 2025
Source:
https://blog.redwoodresearch.org/p/being-honest-with-ais
---
Narrated by TYPE III AUDIO.
United States
