6 Commits

Author	SHA1	Message	Date
Helen Chong	a5fc743bee	Block iaskspider/2.0	2024-09-08 12:40:18 +08:00
Helen Chong	b08bcd7a89	Add AI2Bot and Ai2Bot-Dolma	2024-08-30 13:52:46 +08:00
Helen Chong	bc2a14037d	Add Webzio-Extended	2024-08-28 22:14:03 +08:00
Helen Chong	6079a96d4a	Remove AppleBot	2024-08-20 09:59:57 +08:00
Helen Chong	828e99044d	Remove default user agent block	2024-08-20 08:39:53 +08:00
Helen Chong	1283149564	Add robots.txt	2024-08-20 00:05:19 +08:00