DiscoverThe Azure PodcastEpisode 502 - Azure Open AI and Security
Episode 502 - Azure Open AI and Security

Episode 502 - Azure Open AI and Security

Update: 2024-08-15
Share

Description

Azure Open AI is widely used in industry but there are number of security aspects that must be taken into account when using the technology. Luckily for us, Audrey Long, a Software Engineer at Microsoft, security expert and renowned conference speaker, gives us insights into securing LLMs and provides various tips, tricks and tools to help developers use these models safely in their applications.


 


Media file: https://azpodcast.blob.core.windows.net/episodes/Episode502.mp3


YouTube: https://youtu.be/64Achcz97PI


Resources:


AI Tooling:



  1. Azure AI Tooling Announcing new tools in Azure AI to help you build more secure and trustworthy generative AI applications | Microsoft Azure Blog

    • Prompt Shields to detect and block prompt injection attacks, including a new model for identifying indirect prompt attacks before they impact your model, coming soon and now available in preview in Azure AI Content Safety. 

    • Groundedness detection to detect “hallucinations” in model outputs, coming soon. 

    • Safety system messagesto steer your model’s behavior toward safe, responsible outputs, coming soon.

    • Safety evaluations to assess an application’s vulnerability to jailbreak attacks and to generating content risks, now available in preview.  

    • Risk and safety monitoring to understand what model inputs, outputs, and end users are triggering content filters to inform mitigations, coming soon, and now available in preview in Azure OpenAI Service.



  2. AI Defender for Cloud


  3.  AI Red Teaming Tool



AI Development Considerations:


 



  1. AI Assessment from Microsoft
Comments 
loading
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Episode 502 - Azure Open AI and Security

Episode 502 - Azure Open AI and Security

Cynthia Kreng, Kendall Roden, Cale Teeter, Evan Basalik, Russell Young and Sujit D'Mello