LLM Safety Review: Benchmarks & Analysis
Find out what happened when we tested the responses of six leading LLMs, in 7 languages, to over 20,000 prompts related to child exploitation, hate speech, suicide and self-harm, and misinformation.
Watch On-Demand
LLM Safety Review: Benchmarks & Analysis
Overview
As more and more applications implement Generative AI, a clear understanding of foundation models' safety risks becomes imperative. During this webinar, we will review the outcomes of Alice's LLM safety benchmarking report, which evaluated whether gaps exist in the basic safety of GenAI apps and LLM providers. From child exploitation to misinformation, hate speech to self-harm, we will discuss harmful model outputs, the ways bad actors can abuse LLMs, and the risks to those applications that rely on them. Join us to learn about how we evaluated LLM safety, and what risks you should consider as you implement these models into your applications.
Meet our speakers
What’s New from Alice
Your LLM Has No Idea What It's Doing
Diana Kelley, CISO at Noma Security and former Cybersecurity CTO at Microsoft, joins Mo to work through the real mechanics of LLM risk: why the context window flattens the trust boundary between system instructions and user data, why that makes reliable internal guardrails essentially impossible, and why agentic AI is less a new threat category and more a stress test for the hygiene debt organizations never fully paid off.
Distilling LLMs into Efficient Transformers for Real-World AI
This technical webinar explores how we distilled the world knowledge of a large language model into a compact, high-performing transformer—balancing safety, latency, and scale. Learn how we combine LLM-based annotations and weight distillation to power real-world AI safety.
Exposing the Hidden Risks of AI Toys
AI-powered toys are entering children’s everyday lives, but new research reveals serious safety gaps. Alice testing shows how child-like interactions can lead to inappropriate content, unsafe conversations, and risky behaviors.