Leilukin
/
leilukin-site
mirror of https://github.com/helenclx/leilukin-site.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Remove default crawler block

This commit is contained in:
Helen Chong 2024-08-20 08:38:24 +08:00
parent 85337c4d33
commit 6300906b81
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/robots.txt.njk
View File

@ -5,7 +5,7 @@ eleventyExcludeFromCollections: true
Sitemap: {{ sitemeta.siteUrl }}/sitemap/ Sitemap: {{ sitemeta.siteUrl }}/sitemap/
User-agent: * User-agent: *
Disallow: / Disallow:
User-agent: Amazonbot User-agent: Amazonbot
User-agent: Applebot User-agent: Applebot