Episode 502 - Azure Open AI and Security
Update: 2024-08-15
Description
Azure Open AI is widely used in industry but there are number of security aspects that must be taken into account when using the technology. Luckily for us, Audrey Long, a Software Engineer at Microsoft, security expert and renowned conference speaker, gives us insights into securing LLMs and provides various tips, tricks and tools to help developers use these models safely in their applications.
Media file: https://azpodcast.blob.core.windows.net/episodes/Episode502.mp3
YouTube: https://youtu.be/64Achcz97PI
Resources:
AI Tooling:
- Azure AI Tooling Announcing new tools in Azure AI to help you build more secure and trustworthy generative AI applications | Microsoft Azure Blog
- Prompt Shields to detect and block prompt injection attacks, including a new model for identifying indirect prompt attacks before they impact your model, coming soon and now available in preview in Azure AI Content Safety.
- Groundedness detection to detect “hallucinations” in model outputs, coming soon.
- Safety system messagesto steer your model’s behavior toward safe, responsible outputs, coming soon.
- Safety evaluations to assess an application’s vulnerability to jailbreak attacks and to generating content risks, now available in preview.
- Risk and safety monitoring to understand what model inputs, outputs, and end users are triggering content filters to inform mitigations, coming soon, and now available in preview in Azure OpenAI Service.
- AI Defender for Cloud
- AI Security Posture Management AI security posture management (Preview) - Microsoft Defender for Cloud | Microsoft Learn
- AI Workloads Enable threat protection for AI workloads (preview) - Microsoft Defender for Cloud | Microsoft Learn
- AI Red Teaming Tool
AI Development Considerations:
- AI Assessment from Microsoft
- Conduct an AI assessment using Microsoft’s Responsible AI Impact Assessment Template
- <a id="menuranb" class="fui-Link ___1rxvrpe f2hkw1w f3rmtva f1ewtqcl fyind8e f1k6fduh f1w7gpdv fk6fouc fjoy568 figsok6 f1hu3pq6 f11qmguv f19f4twv f1tyq0we f1g0x7ka fhxju0i f1qch9an f1cnd47f fqv5qza f1vmzxwi f1o700av f13mvf36 f1cmlufx f9n3di6 f1ids18y f1tx3yz7 f1deo86v f1eh06m1 f1ies
Comments
In Channel