lewis/lewisdale.dev
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Ban ChatGPT from scraping me

Browse Source
This commit is contained in:
Lewis Dale 2023-08-25 13:44:00 +01:00
parent a59e9abb7f
commit 0e543bc94a
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
src/robots.txt
View File

@ -1,6 +1,9 @@
User-Agent: Bytespider User-Agent: Bytespider
Disallow: / Disallow: /
User-agent: GPTBot
Disallow: /
User-Agent: * User-Agent: *
Allow: / Allow: /
Disallow: /assets/ Disallow: /assets/