5 Commits

Author	SHA1	Message	Date
Helen Chong	4d88d0033b	Dynamically generate bad bots to block by fetching remote list	2024-08-20 09:53:37 +08:00
Helen Chong	31631b9fe6	Remove slash from permalink	2024-08-20 09:17:10 +08:00
Helen Chong	6300906b81	Remove default crawler block	2024-08-20 08:38:24 +08:00
Helen Chong	85337c4d33	Move up sitemap in robots.txt	2024-08-20 08:35:09 +08:00
Helen Chong	f62720694f	Add robots.txt	2024-08-19 23:59:30 +08:00