Leilukin/leilukin-site
1
0
Fork 0
mirror of https://github.com/helenclx/leilukin-site.git synced 2025-04-03 16:20:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Remove default crawler block

Browse Source
This commit is contained in:
Helen Chong 2024-08-20 08:38:24 +08:00
parent 85337c4d33
commit 6300906b81
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/robots.txt.njk
View File

@ -5,7 +5,7 @@ eleventyExcludeFromCollections: true
Sitemap: {{ sitemeta.siteUrl }}/sitemap/ Sitemap: {{ sitemeta.siteUrl }}/sitemap/
User-agent: * User-agent: *
Disallow: / Disallow:
User-agent: Amazonbot User-agent: Amazonbot
User-agent: Applebot User-agent: Applebot