6 Commits

Author	SHA1	Message	Date
Lewis Dale	1956bb83be	Revert robots.txt - accidentally blocking archive.org among others	2024-01-09 08:06:57 +00:00
Lewis Dale	782022754c	Blog all of the DarkAgent spiders. Go away, nasty robots	2024-01-08 08:11:53 +00:00
Lewis Dale	b0bc736a7e	Add sitemap	2023-11-28 20:52:20 +00:00
Lewis Dale	0e543bc94a	Ban ChatGPT from scraping me	2023-08-25 13:44:00 +01:00
Lewis Dale	475bd4d66d	Add robots.txt	2023-05-11 10:30:52 +01:00
Lewis Dale	9df34b87e3	Add robots.txt	2023-05-11 10:30:28 +01:00