8 August 2023
OpenAI launches web crawling GPTBot, sparking blocking effort by website owners and creators - 2023-08-08 20:31:43Z
Title:OpenAI launches web crawling GPTBot, sparking blocking effort by website owners and creators Summary: When OpenAI added the GPTBot support page, it also introduced a way to block the service from scraping your website through robots.txt files. Link: OpenAI launches web crawling GPTBot, sparking blocking effort by website owners and creators
