AI course: crawlers – to block or not to block?

Let’s discuss an apparently technical yet crucial aspect of digital journalism: the use of the robots.txt file and whether to block or allow AI crawlers

The Fix Newsletter

Everything you need to know about European media market every week in your inbox

36 articles • 0 Followers

Subscribe to The Fix's newsletter courses

How using AI translation tools for minority languages can boost subscriptions

by Romain Chauvet•May 23, 2025 6:10 AM

How using AI translation tools for minority languages can boost subscriptions

FOIAbot: building an AI assistant for public records requests

by Alberto Puliafito•May 1, 2025 11:17 AM

FOIAbot: building an AI assistant for public records requests

by Dusica Tomovic•April 29, 2025 11:14 AM

AI course: crawlers – to block or not to block?

Everything you need to know about European media market every week in your inbox

Most popular

Taking journalism to the stage: lessons from newsrooms turning reporting into performance

Independent French media outlets are creating a content distribution platform to fight against the web giants

Technical support for media in Ukraine: the “Voices of Ukraine” programme from The Fix Foundation and ECPMF

Plain X – an AI-assisted platform for publishers to reduce the workload of content adaptation and reach a wider audience

How Sweden’s largest daily newspaper built its own chatbot to let users choose how they consume news

Canadian publishers are still adapting two years after Meta's news ban

Subscribe to The Fix's newsletter courses

Related Articles

How using AI translation tools for minority languages can boost subscriptions

FOIAbot: building an AI assistant for public records requests

Innovative app gives citizen journalism a voice in Montenegro