DiscoverMicrosoft Threat Intelligence PodcastMicrosoft’s Yonatan Zunger on Red Teaming Generative AI
Microsoft’s Yonatan Zunger on Red Teaming Generative AI

Microsoft’s Yonatan Zunger on Red Teaming Generative AI

Update: 2024-11-06
Share

Description

In this episode of the Microsoft Threat Intelligence Podcast host Sherrod DeGrippo is joined by Yonatan Zunger, CVP of AI Safety and Security at Microsoft. The conversation delves into the critical role of the AI Red Team, which focuses on identifying vulnerabilities in AI systems. Yonatan emphasizes the importance of ensuring the safety of Microsoft’s AI products and the innovative methods the team employs to simulate potential threats, including how they assess risk and develop effective responses. This engaging dialogue offers insights into the intersection of technology, security, and human behavior in the evolving landscape of AI.  


 

In this episode you’ll learn:      

  


  • Why securing AI systems requires understanding their unique psychology 

  • The importance of training and technical mitigations to enhance AI safety 

  • How financial incentives drive performance improvements in AI systems 


Some questions we ask:     

  


  • How does Retrieval Augmented Generation (RAG) work? 

  • What are the potential risks with data access and permissions in AI systems? 

  • Should users tell language models that accuracy affects their rewards to improve responses? 


Resources:  

View Yonatan Zunger on LinkedIn  

View Sherrod DeGrippo on LinkedIn  

 

Related Microsoft Podcasts:                   



Discover and follow other Microsoft podcasts at microsoft.com/podcasts  

 

Get the latest threat intelligence insights and guidance at Microsoft Security Insider 

 

 

The Microsoft Threat Intelligence Podcast is produced by Microsoft and distributed as part of N2K media network.

Comments 
loading
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Microsoft’s Yonatan Zunger on Red Teaming Generative AI

Microsoft’s Yonatan Zunger on Red Teaming Generative AI

Microsoft