Distilling LLMs into Efficient Transformers for Real-World AI
This technical webinar explores how we distilled the world knowledge of a large language model into a compact, high-performing transformer—balancing safety, latency, and scale. Learn how we combine LLM-based annotations and weight distillation to power real-world AI safety.
Watch On-Demand
Watch On-Demand
Distilling LLMs into Efficient Transformers for Real-World AI
Overview
Building GenAI systems is easy. But making them safe, scalable, and accurate in the real world? That’s where things get tricky.
In this technical webinar, Shiri Simon Segal, our Sr. Data Scientist, shares how her tam uses dual knowledge distillation to turn large foundation models into efficient transformers that stay aligned, compliant, and abuse-aware, under real-world pressure.
You’ll learn:
- Why accuracy is essential for GenAI safety
- How label-based and feature-based distillation work together
- How we use LLMs for high-quality automated annotation
- How we applied this technique in one of the most challenging abuse areas, through a real-world case study
- Practical tips for building safer, scalable models
Watch now and see what it takes to turn raw LLM power into safe, production-ready AI.
Meet our speakers
What’s New from Alice
Curiouser Soundbites: The AI Risk Debt Your Enterprise Is Already Carrying
Chances are your enterprise AI is moving a lot faster than your visibility into it and Alison Cossette has a lot to say about that. She joined Mo on Curiouser & Curiouser to get into the risk debt that's quietly building inside agentic systems, why observability and traceability aren't optional anymore, and what leaders actually need to do about it.
Afraid AI Will Replace You? Here's the One Skill It Can't
James Villarrubia went from building AI for NASA's drone and aerospace programs to becoming CTO of a travel tech company. In this episode, he and Mo get into why curiosity might be the most important skill in the AI era, what happens to our brains when we stop pushing back on the answers we get, and why the people most resistant to AI might actually be seeing something the rest of us are missing.
It Takes AI to Break AI: The Case for AI Red Teaming
As AI systems gain autonomy, organizations need security approaches built specifically for AI behavior. Learn why AI-driven red teaming is becoming a critical defense layer.
Evaluation of Instagram Teen Accounts
This report evaluates default and opt-in content protections under real-world and adversarial conditions. The study examines safeguard effectiveness, resilience against attempts to surface inappropriate content, and platform improvements made following testing.