NEW YORK, July 23rd, 2024 — Alice, formerly ActiveFence, the leading technology solution for Trust and Safety intelligence, management, and content moderation, is proud to announce a new industry breakthrough. ActiveFence has developed algorithms that can detect newly generated or manipulated Child Sexual Abuse Material (CSAM), going beyond the detection of CSAM already present in existing databases.
ActiveFence’s detection automation solution, ActiveScore, utilizes AI to identify harmful content on a large scale. The key advantage of our AI models in CSAM detection lies in their ability to identify new and previously unreported content.
The production, distribution, and consumption of CSAM have been significant societal issues for decades. With the internet’s widespread use and the rise of file-sharing websites, social media platforms, and Generative AI (GenAI), the situation has worsened. CSAM is inherently evasive, as bad actors continuously generate new items and manipulate previously reported ones to evade detection. This makes it nearly impossible for platforms to effectively detect and remove CSAM without the right AI models.
ActiveFence’s AI algorithms identify novel CSAM across different modalities such as video, image, and text. Trained on proprietary sources of data, our text detectors can detect sex solicitation, CSAM discussions, and estimate a user’s age. These detectors also identify the use of specific keywords and emojis, multilingual terminology, and GenAI text prompt manipulation techniques. For image detection, our computer vision detectors can identify indicators of CSAM in images, including identifying specific body parts and estimating age.
VP of Data and AI, PhD Matar Haller:“While image hashing and matching have been effective, they are not enough, especially in the GenAI era, where the bar of entry for creating new and therefore unindexed CSAM has been drastically lowered. Integrating AI detection models is critical to ensure we are able to effectively and efficiently detect at scale.”
Future technological advancements will further enhance CSAM detection by identifying even more subtle features and patterns that traditional methods often miss. These advancements will play a vital role in countering the evolving tactics of child predators, particularly as generative AI continues to evolve.
To learn more about how ActiveFence safeguards online platforms and users against online harm, please visit our website at alice.io
About ActiveFence:
ActiveFence is the leading Trust and Safety provider for online platforms, protecting over three billion users daily from malicious behavior and content. Trust and Safety teams of all sizes rely on ActiveFence to keep their users safe from the widest spectrum of online harms, including child abuse, disinformation, hate speech, terror, fraud, and more. We offer a full stack of capabilities with our deep intelligence research, AI-driven harmful content detection and moderation platform. ActiveFence protects platforms globally, in over 100 languages, letting people interact and thrive safely online.
Alice Data Advantage
Alice is the world’s largest collector and manager of adversarial intelligence data. Our data is the cornerstone for protecting platform, tech, and users online.
Learn More >What’s New from Alice
Curiouser Soundbites: The AI Risk Debt Your Enterprise Is Already Carrying
Chances are your enterprise AI is moving a lot faster than your visibility into it and Alison Cossette has a lot to say about that. She joined Mo on Curiouser & Curiouser to get into the risk debt that's quietly building inside agentic systems, why observability and traceability aren't optional anymore, and what leaders actually need to do about it.
Afraid AI Will Replace You? Here's the One Skill It Can't
James Villarrubia went from building AI for NASA's drone and aerospace programs to becoming CTO of a travel tech company. In this episode, he and Mo get into why curiosity might be the most important skill in the AI era, what happens to our brains when we stop pushing back on the answers we get, and why the people most resistant to AI might actually be seeing something the rest of us are missing.
It Takes AI to Break AI: The Case for AI Red Teaming
As AI systems gain autonomy, organizations need security approaches built specifically for AI behavior. Learn why AI-driven red teaming is becoming a critical defense layer.
Evaluation of Instagram Teen Accounts
This report evaluates default and opt-in content protections under real-world and adversarial conditions. The study examines safeguard effectiveness, resilience against attempts to surface inappropriate content, and platform improvements made following testing.