fuck it, drop 100 megabytes into the repo. Also new post
This commit is contained in:
parent
9aa51cfcd4
commit
b83a3c8fb0
24 changed files with 204 additions and 23 deletions
|
|
@ -25,9 +25,6 @@ Disallow: /
|
|||
User-agent: Twingly Recon
|
||||
Disallow: /
|
||||
|
||||
User-agent: www.deadlinkchecker.com
|
||||
Disallow: /rollcall.html
|
||||
|
||||
User-agent: Googlebot
|
||||
Disallow: /identity/
|
||||
Disallow: /webring.html
|
||||
|
|
@ -36,6 +33,9 @@ Disallow: /blog/
|
|||
User-agent: Googlebot-Image
|
||||
Disallow: /
|
||||
|
||||
User-agent: Google-Extended
|
||||
Disallow: /
|
||||
|
||||
User-agent: PageThing
|
||||
Disallow: /
|
||||
|
||||
|
|
@ -54,9 +54,6 @@ Disallow: /
|
|||
User-agent: GPTBot
|
||||
Disallow: /
|
||||
|
||||
User-agent: Google-Extended
|
||||
Disallow: /
|
||||
|
||||
User-agent: *
|
||||
Disallow: /
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue