lethe/mayvaneday
1
0
Fork 0
Code Releases Activity

first commit

Browse source
This commit is contained in:
Mori Aokigahara 2021-11-12 20:02:11 -06:00
commit 289d9cb49b
273 changed files with 12085 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

52
robots.txt Executable file
View file

@ -0,0 +1,52 @@
User-agent: webproxy-mozz
Disallow:
User-agent: serpstatbot
Disallow: /
User-agent: ltx71
Disallow: /
User-agent: oBot
Disallow: /
User-agent: DuckDuckBot
Disallow:
User-agent: ia_archiver
Disallow: /
User-agent: ltx71 - (http://ltx71.com/)
Disallow: /
User-agent: BLEXBot
Disallow: /
User-agent: Twingly Recon
Disallow: /
User-agent: www.deadlinkchecker.com
Disallow: /rollcall.html
User-agent: Googlebot
Disallow: /identity/
Disallow: /webring.html
Disallow: /blog/
User-agent: Googlebot-Image
Disallow: /
User-agent: PageThing
Disallow: /
User-agent: adsbot
Disallow: /
User-agent: SurdotlyBot
Disallow: /
User-agent: DataForSeoBot
Disallow: /
User-agent: *
Disallow: /