Secure your place at the Digiday Publishing Summit in Vail, March 23-25
This article is a WTF explainer, in which we break down media and marketing’s most confusing terms. More from the series →
Publishers have a new tool in their efforts to limit AI’s threat to their businesses. And it’s from the company behind one of the predominant threats.
In August, OpenAI announced that website owners can now block its GPTBot web crawler from accessing their webpages’ content. Since then, 12% of the 1000 most-visited sites online have done so, according to Originality AI. The list of sites shutting themselves off to OpenAI’s web crawlers includes publishers such as Bloomberg, CNN and The New York Times.
As Digiday has covered, publishers have had a hard time protecting against generative AI tools like ChatGPT sidestepping their paywalls and siphoning their content to inform the large language models. OpenAI’s announcement, however, makes that undertaking much easier.
For those unfamiliar with what a web crawler like OpenAI’s GPTBot is, not to mention how websites are able block their access, check out the explainer video skit below.
More in Media
Layoffs hit LADbible Group’s social video team amid slower user-generated content growth
Social-first publisher LADbible is in the middle of a second round of layoffs to its social video team, having suffered massive drop-off in Facebook video engagement.
AI surfacing is messy: Data shows publisher visibility and traffic often misalign
Reports tracking publishers in AI chatbots abound but conflicting rankings and uneven referral traffic reveal the murkiness of AI visibility.
GEO hype busted: How it differs (and how it doesn’t) from SEO
GEO is flooding media execs’ inboxes. But SEO veterans say these AI visibility services may not be as revolutionary as they seem.