Lewis Dale
|
1f9ddb8025
|
Fix robots.txt
Build and copy to prod / build-and-copy (push) Failing after 36s
|
2024-07-29 18:36:10 +01:00 |
|
Lewis Dale
|
18f056e68a
|
Update robots.txt
Build and copy to prod / build-and-copy (push) Has been cancelled
|
2024-07-29 18:34:27 +01:00 |
|
Lewis Dale
|
0fe1ff83c3
|
Fuck off, AI bots
Build and copy to prod / build-and-copy (push) Successful in 2m26s
|
2024-05-09 14:01:50 +01:00 |
|
Lewis Dale
|
1956bb83be
|
Revert robots.txt - accidentally blocking archive.org among others
|
2024-01-09 08:06:57 +00:00 |
|
Lewis Dale
|
782022754c
|
Blog all of the DarkAgent spiders. Go away, nasty robots
|
2024-01-08 08:11:53 +00:00 |
|
Lewis Dale
|
b0bc736a7e
|
Add sitemap
|
2023-11-28 20:52:20 +00:00 |
|
Lewis Dale
|
0e543bc94a
|
Ban ChatGPT from scraping me
|
2023-08-25 13:44:00 +01:00 |
|
Lewis Dale
|
475bd4d66d
|
Add robots.txt
|
2023-05-11 10:30:52 +01:00 |
|
Lewis Dale
|
9df34b87e3
|
Add robots.txt
|
2023-05-11 10:30:28 +01:00 |
|