# /robots.txt for http://www.pedregal.com User-agent: * Disallow: /cgi-bin/ Disallow: /statistics/ Disallow: /member/ Disallow: /subdomains/dev/