.png&w=3840&q=90)
.png&w=3840&q=90)
How we built a 25MB AI model that detects grooming, bullying, and other risks in real-time on your child's device — without ever sending their messages to a server.
Every parent faces the same impossible choice: monitor your child's messages and invade their privacy, or trust blindly and hope for the best. Existing safety tools force this tradeoff — they either upload private conversations to remote servers for analysis, or rely on simple keyword filters that miss nuanced threats and flag innocent messages.
Today we're introducing Horizon, SafeCircle's on-device AI model that changes this equation entirely. It detects real safety risks — grooming, bullying, threats, and more — in under 100 milliseconds, directly on your child's phone. No messages are ever sent to our servers. No one reads their conversations. Not even us.
Server-side content moderation works by sending your child's messages to a company's cloud infrastructure, where AI models scan them for risks. This approach has two fundamental flaws:
Keyword-based filtering is the alternative, but it's trivially circumvented ("meet me at the p4rk") and generates endless false positives from normal teenage conversation.
Horizon takes a fundamentally different approach. Instead of sending data to the cloud, we bring the AI to the device.
The system uses two models working in tandem:
Horizon identifies seven categories of risk, each trained on thousands of realistic conversation examples:
For each detection, Horizon provides a severity rating (none through critical), a confidence score, and — critically — an explanation of which specific words or phrases triggered the alert.
This isn't privacy by policy. It's privacy by architecture. The 25MB model file lives on the device. Inference happens on the device. Message content never touches a network connection.
There's no server to breach. No database of children's messages to leak. No employee who could access private conversations. The mathematical impossibility of extracting training data from a neural network means that even the model file itself reveals nothing about any individual child's messages.
Building a model this small without sacrificing accuracy required solving several hard problems:
Knowledge distillation — We don't just compress the model; we teach the small model to replicate the reasoning patterns of the large model. When the teacher model says "this is 70% grooming, 20% isolation, 10% benign," that uncertainty itself is valuable training signal.
Dual-head classification — A single forward pass through the model simultaneously classifies both the risk category and severity level, keeping inference under our 100ms target.
Explainability — Using Integrated Gradients, we compute which specific tokens in the conversation most influenced the model's decision. Parents see why something was flagged, not just that it was.
Horizon is currently trained on English-language conversations. We're actively expanding to Spanish, Portuguese, and French. We're also working on temporal pattern detection — identifying risk that emerges across multiple conversations over days or weeks, not just within a single message.
The full technical paper, including mathematical formulations, architecture details, and training methodology, is available for download below.