6 lines
107 B
Plaintext
6 lines
107 B
Plaintext
|
# www.robotstxt.org/
|
||
|
|
# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
|
||
|
|
|
||
|
|
User-agent: *
|
||
|
|
|