skorotkiewicz/rDrama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

sfd

Browse source
This commit is contained in:
Aevann1 2021-09-24 21:49:53 +02:00
parent 1d2e53d9a0
commit 65c67aa7f4
1 changed files with 0 additions and 16 deletions
Download patch file Download diff file Expand all files Collapse all files

16
files/assets/robots.txt
View file

@ -1,18 +1,2 @@
User-Agent: *
Disallow: /admin/*
Disallow: /submit
Disallow: /settings
Disallow: /me
User-Agent: DotBot
User-Agent: TurnitinBot
User-Agent: Huaweisymantecspider
User-Agent: SiteSnagger
User-Agent: TeleportPro
User-Agent: Xaldon_WebSpider
User-Agent: MJ12bot
User-Agent: SEMrushBot
User-Agent: AhrefsBot
User-Agent: CCBot
User-agent: SBSearch
Disallow: /