Leilukin
/
leilukin-tumbleblog
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Add Webzio-Extended

This commit is contained in:
Helen Chong 2024-08-28 22:14:03 +08:00
parent 6079a96d4a
commit bc2a14037d
2 changed files with 3 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
.htaccess
View File

@ -52,5 +52,6 @@ RewriteCond %{HTTP_USER_AGENT} (cohere-ai) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (facebookexternalhit) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (facebookexternalhit) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (img2dataset) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (img2dataset) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (omgili) [NC,OR] RewriteCond %{HTTP_USER_AGENT} (omgili) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (omgilibot) [NC] RewriteCond %{HTTP_USER_AGENT} (omgilibot) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (Webzio-Extended) [NC]
RewriteRule .* https://nocommercialuse.org/ [L] RewriteRule .* https://nocommercialuse.org/ [L]

1
robots.txt
View File

@ -33,4 +33,5 @@ User-agent: facebookexternalhit
User-agent: img2dataset User-agent: img2dataset
User-agent: omgili User-agent: omgili
User-agent: omgilibot User-agent: omgilibot
User-agent: Webzio-Extended
Disallow: / Disallow: /