Meta Revises Commercial Terms Following Backlash Over Web Scraping
Meta modifies controversial scraping language after publishers express concerns regarding AI training permissions.
1Initial Terms Sparked Outrage
Meta initially proposed updates to its commercial terms scheduled for October 30. The language explicitly granted the company rights to use automated tools to crawl, index, and analyze content from domains associated with business accounts. This move triggered immediate alarm among digital publishers who feared their proprietary content would be used for AI training.
2Removal of AI Training Language
Following swift industry backlash, Meta quietly updated the terms to remove specific references to AI training. The revised text now states that scraping is intended to develop, improve, and maintain advertising and business products. Despite this change, the core mechanism allowing Meta to access external websites remains largely intact within the updated agreement.
3Scope of Data Collection
The updated terms authorize Meta to use bots, crawlers, and spiders to access any URL associated with a business account. This includes content made available through Meta products or services. The company claims these permissions are necessary to provide commercial features, yet critics argue the language remains broad enough to encompass extensive data harvesting.
4Official Stance on Crawling
Spokesperson Andy Stone stated that the company only clarified existing practices rather than expanding them. He emphasized that the terms apply strictly to advertising and business products. Meta maintains that these updates do not alter how the company utilizes web crawlers or how content owners can signal their preferences using standard robots.txt files.
5Legal and Technical Limitations
Legal experts remain skeptical, noting the terms represent a substantial expansion of Meta's scraping permissions. While Meta claims it respects robots.txt files, these instructions are not legally binding. Many AI companies have historically bypassed these protocols, leaving publishers with limited technical recourse to prevent their content from being indexed by Meta's automated systems.
6Tense Relationship With Publishers
This controversy occurs against a backdrop of deteriorating relations between Meta and news organizations. Meta ceased paying for news content in 2022 and eliminated its dedicated news tab in 2024. Although the company has secured limited deals for AI chatbot content, the current scraping dispute further alienates traditional media outlets and industry groups.
7Industry Leaders Voice Opposition
Media organizations have strongly condemned the policy shift. Danielle Coffey, CEO of the News/Media Alliance, labeled the rules as outrageous and potentially illegal. Similarly, Theo Bamber of the UK's News Media Association described the update as a shameless landgrab attempt, highlighting the deep distrust between major publishers and the social media giant.
8Future Implications for Content
The dispute underscores the ongoing tension between platform operators and content creators regarding data ownership. As Meta continues to integrate advanced automation into its business products, the legal definition of authorized crawling remains a critical battleground. Publishers must now decide whether to maintain business accounts while facing these broad, potentially intrusive data collection policies.