# Robots.txt file for http://www.exploreweb.com/ # User-agent: * Disallow: /images/ Disallow: /01downloads/ Disallow: /cms/ Disallow: /Scripts/ Disallow: /contents Disallow: /css/ Disallow: /img/ Disallow: /includes/ Disallow: /js/ Disallow: /styles/ Sitemap: http://www.exploreweb.com/sitemap.xml