---- robots.txt (contents follow) User-agent: * Disallow: /terms-use.html/ Disallow: /privacy-policy.html/ Disallow: /advertising.html/ Disallow: /add-website.html/ Disallow: /free-listing.html/ Disallow: /contact-us.html/ Disallow: /websites-for-kids.html/ Disallow: /masters/ Disallow: /docs/ Disallow: /forms/ ---- end (Contents above)