# Meta's Two Breakthroughs in Ad Ranking Architecture Multi-stage design and target-aware attention drive significant ad performance improvements - **Source:** [Facebook Engineering](https://engineering.fb.com) - **Published:** 2026-08-05 - **Topic:** [Data & AI](https://brifing.si/c/data-ai) - **Original article:** - **On Brifing:** https://brifing.si/s/2c18acf4-d628-4f38-9ecf-7041da3e0cec ## Sequence Learning in Advertising Meta's platforms process billions of daily user interactions. While traditional systems use static features, the 2024 sequence learning approach models action timing and order, delivering up to 6% conversion lift. This method captures ad preferences more dynamically by analyzing behavioral sequences rather than isolated events. ## Limitations of Hybrid Models Current hybrid systems split processing between user event sequences and sparse feature interactions. Though meeting production demands, this architecture suffers from lossy knowledge transfer between components, reliance on manual feature engineering, and scaling ceilings. These constraints necessitated architectural innovation. ## Multi-Stage Architecture Design The new system decouples heavy offline user modeling from lightweight online ranking tasks. The offline stage processes thousands of interactions to create deep behavioral embeddings, while the online stage combines these with real-time ad candidates. This separation optimizes resource utilization across the pipeline. ## Offline User Modeling The offline module employs deep transformer layers to handle sequences of thousands of interactions. It maintains strict separation between user features and ad candidates, generating universal embeddings. These precomputed representations are cached for rapid access during online serving. ## Online Ranking Innovations The online phase merges offline embeddings with fresh user signals and ad candidate information. It meets strict latency budgets while leveraging precomputed deep representations. This architecture increases model complexity without proportional growth in serving costs. ## Dense Tokenization Breakthrough Unlike traditional systems, the new approach unifies sparse features and behavioral data into a single dense vocabulary. This lets attention mechanisms discover interactions directly from data, eliminating manual feature engineering overhead that previously constrained model capabilities. ## Target-Aware Attention Mechanism Tokenized features undergo processing via memory-efficient multi-head attention. Each layer weights user historical behaviors against the specific ad being scored. Stacked attention blocks with stable distributions progressively distill long sequences into compact, high-fidelity representations. ## Predictable Scaling Laws When tested on production traffic, the system demonstrates LLM-style predictable scaling laws. Delivering 6% conversion lift on Instagram, 3% on Facebook, and 3.5% higher ad clicks, these innovations became core components of Meta's Generative Ads Recommendation Model (GEM). ## Sources covering this story - https://engineering.fb.com/2026/08/05/ml-applications/from-user-sequences-to-scaling-laws-a-multi-stage-architecture-for-metas-ads-ranking/ — --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._