skorotkiewicz/rDrama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

fds

Browse source
This commit is contained in:
Aevann1 2021-09-24 21:55:08 +02:00
parent 53e91de4db
commit 482a3064a9
1 changed files with 2 additions and 17 deletions
Download patch file Download diff file Expand all files Collapse all files

19
files/assets/robots.txt
View file

@ -1,18 +1,3 @@
User-Agent: *
Disallow: /admin/*
Disallow: /submit
Disallow: /settings
Disallow: /me
User-Agent: DotBot
User-Agent: TurnitinBot
User-Agent: Huaweisymantecspider
User-Agent: SiteSnagger
User-Agent: TeleportPro
User-Agent: Xaldon_WebSpider
User-Agent: MJ12bot
User-Agent: SEMrushBot
User-Agent: AhrefsBot
User-Agent: CCBot
User-agent: SBSearch
User-agent: *
Allow: /logged_out/*
Disallow: /