Leilukin/leilukin-site
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Remove default crawler block

Browse Source
This commit is contained in:
Leilukin 2024-08-20 08:38:24 +08:00 committed by Helen Chong
parent 92385bb9e5
commit c85555269c
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/robots.txt.njk
View File

@ -5,7 +5,7 @@ eleventyExcludeFromCollections: true
Sitemap: {{ sitemeta.siteUrl }}/sitemap/ Sitemap: {{ sitemeta.siteUrl }}/sitemap/
User-agent: * User-agent: *
Disallow: / Disallow:
User-agent: Amazonbot User-agent: Amazonbot
User-agent: Applebot User-agent: Applebot