Helen Chong
|
111ea627df
|
Add imgproxy, NovaAct and Operator
|
2025-04-19 07:28:55 +08:00 |
|
Helen Chong
|
6a24d8109e
|
Block Brightbot 1.0
|
2025-02-17 11:16:42 +08:00 |
|
Helen Chong
|
e531d560bd
|
Update SemrushBot agents
|
2025-02-09 09:24:05 +08:00 |
|
Helen Chong
|
678d5ddd5f
|
Block SemrushBot
|
2025-01-22 17:32:10 +08:00 |
|
Helen Chong
|
26f946d430
|
Block cohere-training-data-crawler
|
2025-01-05 15:53:45 +08:00 |
|
Helen Chong
|
92904193fa
|
Exclude CCBot from blocking
|
2024-12-10 17:05:59 +08:00 |
|
Helen Chong
|
72fb410503
|
Update bad bot block list
|
2024-12-03 22:16:02 +08:00 |
|
Helen Chong
|
8ddc5f9276
|
Block DuckAssistBot
|
2024-11-08 23:17:14 +08:00 |
|
Helen Chong
|
0c2a819b7d
|
Block ISSCyberRiskCrawler
|
2024-10-01 13:18:26 +08:00 |
|
Helen Chong
|
a404ac8093
|
Update list of bad bots to block
|
2024-09-29 09:55:21 +08:00 |
|
Helen Chong
|
a5fc743bee
|
Block iaskspider/2.0
|
2024-09-08 12:40:18 +08:00 |
|
Helen Chong
|
b08bcd7a89
|
Add AI2Bot and Ai2Bot-Dolma
|
2024-08-30 13:52:46 +08:00 |
|
Helen Chong
|
bc2a14037d
|
Add Webzio-Extended
|
2024-08-28 22:14:03 +08:00 |
|
Helen Chong
|
6079a96d4a
|
Remove AppleBot
|
2024-08-20 09:59:57 +08:00 |
|
Helen Chong
|
828e99044d
|
Remove default user agent block
|
2024-08-20 08:39:53 +08:00 |
|
Helen Chong
|
1283149564
|
Add robots.txt
|
2024-08-20 00:05:19 +08:00 |
|