meta is getting out of hand
This commit is contained in:
parent
ce62cba295
commit
eb790eb8fc
|
|
@ -46,6 +46,9 @@ Disallow: /
|
|||
User-agent: facebookexternalhit
|
||||
Disallow: /
|
||||
|
||||
User-agent: meta-externalagent
|
||||
Disallow: /
|
||||
|
||||
User-Agent: MJ12bot
|
||||
Disallow: /
|
||||
|
||||
|
|
|
|||
Loading…
Reference in New Issue