meta is getting out of hand
This commit is contained in:
parent
ce62cba295
commit
eb790eb8fc
|
|
@ -46,6 +46,9 @@ Disallow: /
|
||||||
User-agent: facebookexternalhit
|
User-agent: facebookexternalhit
|
||||||
Disallow: /
|
Disallow: /
|
||||||
|
|
||||||
|
User-agent: meta-externalagent
|
||||||
|
Disallow: /
|
||||||
|
|
||||||
User-Agent: MJ12bot
|
User-Agent: MJ12bot
|
||||||
Disallow: /
|
Disallow: /
|
||||||
|
|
||||||
|
|
|
||||||
Loading…
Reference in New Issue