Brifing

WhatsApp Enhances User Safety with Scam Alert Feature

New end-to-end encrypted scam detection system now in beta testing.

Facebook Engineering3 min

1New Approach to Combat Scams

WhatsApp is developing a new feature called Scam Alert to protect users against evolving fraud techniques. The feature uses an on-device machine learning model to detect suspicious messages. While personal messages remain protected by end-to-end encryption, the system doesn't send any message content to servers. Currently in beta, the feature welcomes feedback from security researchers to improve its effectiveness before wide release.

2Advantages of On-Device Processing

The Scam Alert model operates entirely on the user's device without transmitting message content externally. This approach is optimized for performance and battery efficiency. The model's compact size and simplicity allow for independent audits. WhatsApp emphasizes the system's verifiable behavior, enabling security experts to validate its operations transparently.

3User Control and Transparency

The feature puts users in full control with optional activation. When the model detects potential fraud, it displays a visible warning. Users can choose to report, block, or continue the conversation. For false positives, users can mark chats as trusted. WhatsApp publishes model weights publicly to ensure transparency about the system's capabilities and limitations.

4Privacy and Security Safeguards

The system architecturally prevents message content from leaving devices. Anonymous aggregate statistics are collected using differential privacy techniques. Data processing occurs in secure Trusted Execution Environments (TEEs). WhatsApp's experience with privacy-preserving systems informed this infrastructure design, which remains open to independent security audits.

5Transparent Model Deployment

WhatsApp cannot deliver targeted models to specific users. All model versions are logged in a public transparency ledger before deployment. This approach enables independent verification of model behavior. The system's exclusive focus on scam detection is verifiable through published model weights. Users can audit system operations through in-app logs.

6User Participation and Improvement

Users contribute to system refinement by flagging incorrect warnings. For trusted chats, an option exists to share the last five messages with WhatsApp to improve accuracy. The system adapts to evolving scam tactics through continuous updates. Beta testing and bug bounty programs help stress-test the infrastructure before full release.

7Technical Implementation Details

Scam Alert utilizes a confidential federated analytics pipeline built on Trusted Execution Environments (TEEs) and Confidential Virtual Machines (CVMs). While message content stays on-device, anonymous metrics are protected by differential privacy. The design incorporates lessons from Meta's previous privacy-focused systems. The architecture supports independent security validation through researcher access.

8Scam Detection Model Mechanics

The model learns from scam conversations reported by WhatsApp users. It probabilistically classifies messages based on conversational patterns and linguistic signals. Messages from unknown contacts receive special scrutiny. Detection decisions ultimately remain with users. Continuous refinements aim to reduce false positives while maintaining high fraud detection rates.

9Balancing Privacy and Security

WhatsApp aims to balance security features with message privacy protections. Scam Alert enhances safety without compromising end-to-end encryption guarantees. Design principles emphasize user control, data minimization, and independent verification. The system aligns with privacy-by-design concepts and complies with EU data protection regulations.

10Beta Process and Community Engagement

The feature is currently available to beta testers, with active solicitation of security researcher feedback. WhatsApp expanded its bug bounty program to stress-test the system. In-app logs enable user verification of system behavior. Beta feedback will guide final improvements before public release. The company promotes transparent communication about feature development.

11Future Development Roadmap

WhatsApp will continuously monitor Scam Alert's performance and accuracy. The model will update to address emerging scam tactics. User reports and feedback will drive system improvements. No firm timeline exists for general availability. The company commits to extensive testing before full deployment to all WhatsApp users worldwide.

12Milestone in Digital Security

WhatsApp's Scam Alert represents a significant advancement in balancing digital communication security with privacy preservation. On-device machine learning enables effective fraud prevention without compromising user confidentiality. The system's transparent, verifiable design raises industry standards for security features. This approach may influence other messaging platforms. The feature underscores WhatsApp's commitment to user safety.

Original article: Facebook Engineering — WhatsApp, Dolandırıcılık Uyarısı Özelliğiyle Kullanıcı Güvenliğini Artırıyor