How to Prevent OpenAI and Google From Training Their LLMs on Your Website's Data

From AI Wiki
See also: Guides

You can prevent OpenAI and Google from training your large language models (LLMs) on your website's data, content or information by adding these 4 lines to your website's robot.txt file:

User-agent: GPTBot
Disallow: /

User-agent: Google-Extended
Disallow: /

The first 2 lines prevent OpenAI's models like ChatGPT, GPT-4, GPT-5 from training on your website's content.

The last 2 lines prevent Google's models like Bard, Gemini from training on your website's content.

The code above blocks the models from using your data for the entire website. If you only want to block the models from specific sections or directories of your website, you can do this:

User-agent: GPTBot
Disallow: /name-of-the-section

User-agent: Google-Extended
Disallow: /name-of-the-section