Kristi Hines / Search Engine Journal:
OpenAI details GPTBot, which the company uses to crawl the web for data to improve its AI models, and how site admins can opt out using robots.txt — Learn more about OpenAI’s web crawler, GPTBot, and how to restrict or limit its access to your website content.
Lees verder op Tech Meme