Redefining AI Privacy: A New Era of Multimodal Machine Unlearning
Description
Today, we explore a groundbreaking approach to Machine Unlearning (MU) with the paper CLEAR: Character Unlearning in Textual and Visual Modalities. This research marks a new era in privacy-focused AI by introducing CLEAR, the first benchmark designed to tackle the challenges of unlearning across both text and visual data in multimodal models. CLEAR offers a robust dataset of 200 fictitious individuals and 3,700 images with question-answer pairs, providing an unprecedented tool for testing MU methods.
With adaptations of 10 unlearning techniques, this work addresses the unique difficulties of "forgetting" sensitive information across modalities while preserving performance. CLEAR also presents a novel approach to reducing catastrophic forgetting through ℓ1\ell_1ℓ1 regularization on LoRA weights. Now available on Hugging Face, CLEAR sets a new standard for secure and privacy-respecting AI models.