robots.txt redirection disabled. you can now set up your own /robots.txt file for your website to tell clankers to behave.
the default robots.txt file prevented our websites from appearing in the results of search engine lookups, an intentional tradeoff so that the file remain simple.
this is no longer the case: try searching something and see what you get!
information on robots.txt