# /robots.txt file for any tag web site # mail webmaster@webcrawler.com for constructive criticism User-agent: * Disallow: