Whalesbook
The Data Collision: AI's Hunger vs. Publisher Survival
This initiative tackles a crucial moment where AI systems' huge demand for data clashes with the publishing industry's growing fight for survival. As AI models develop, they rely on vast datasets, requiring a clear commercial system to pay for this content. The new Content Monetization Protocol (CoMP) from IAB Tech Lab aims to create this system, offering a standard way to license content that is currently taken without payment. Publishers, already facing big drops in traffic and revenue, see CoMP as a way to fix an unfair situation. AI developers, in turn, could gain a more predictable and lawful way to source their data.
The AI Data Hunger and Publisher Crisis
AI systems fundamentally depend on information, a key ingredient that has never had a clear payment system. This has hit the publishing industry hard, with search traffic dropping drastically. Some reports show drops over 50% and even up to 89% in certain cases. AI-generated summaries in search results lead to "zero-click" searches, which means fewer people visit publisher websites. This is slashing ad income and subscription sales. Content has become the infrastructure for AI products, often without any fair exchange of value. Anthony Katsur, CEO of IAB Tech Lab, pointed out this imbalance, saying information is the only input lacking a strong system for payment, showing the need for clear terms and sustainability.
CoMP: A Standardized Path for Content Payment
IAB Tech Lab's CoMP is designed to fix this issue by setting up a standard process for AI systems to make commercial deals with content owners before they access or use the material. The system supports both direct deals and marketplaces, allowing one protocol instead of many different custom setups. This aims to cut down on custom work and extra costs for AI developers, while giving publishers a clear way to earn money from their content. The protocol assumes publishers will use security measures like Content Delivery Networks (CDNs) to control access, creating a base for commercial talks. Industry players, like Bertelsmann, have backed such universal standards for fair payment in the AI world.
Existing Deals and Market Trends
The CoMP protocol arrives as AI content licensing is rapidly changing. Major AI companies are already making direct, expensive deals with publishers. For example, Meta reportedly agreed to a $50 million annual deal with News Corp, and OpenAI has a multi-year agreement worth $250 million with the same company. While these deals offer new income, they also show how complex and costly custom negotiations can be. The AI licensing market for training data has grown since 2023, with deals including flat fees, revenue sharing, and other types of value exchange. IAB Tech Lab hopes its universal standard will make these deals easier and smoother, encouraging more adoption across the digital media industry. IAB Tech Lab has a history of creating industry standards like ads.txt and the Open Measurement SDK, which helped improve openness and compatibility. However, the success of any standard depends on widespread industry agreement and adoption.
Concerns and Risks for the Protocol
Despite the good intentions behind CoMP, several challenges and risks could limit its success. The protocol relies heavily on publishers using strong security measures, like CDNs, to control access. However, AI crawlers are becoming better at bypassing these defenses with rapidly changing tools. CoMP is also a voluntary technical standard, not a legally binding rule. Publishers have found that paying for content licenses hasn't stopped traffic declines; one analysis showed websites with AI licensing agreements experienced click-through rates drop more than 6.5 times in 2025. This suggests that even if AI companies pay for training data, the main problem of reduced website visits continues, making publisher content just a resource for AI instead of a place for people to visit. The high cost and effort of negotiating individual deals could also be too much for smaller publishers, worsening the market imbalance. AI developers might also push back or create less publisher-friendly systems, especially in countries with laws that allow more AI data use. The public comment period, while important for feedback, also creates a window for potential issues to arise, which could delay or weaken the protocol's impact.
The Path Forward
CoMP's success depends on many in the industry adopting it and providing feedback during its public comment period, which ends on April 9, 2026. IAB Tech Lab aims to help create a more sustainable global information market where AI development can grow without hurting the content creators that power it. Input from many different groups, including publishers, AI developers, and tech providers, will shape how the protocol develops. Its final impact will show whether CoMP can create a truly standard and workable way to pay for content, or if it becomes just another part of an already unequal digital economy.