# Visit http://www.robotstxt.org/wc/faq.html for more information about this file # Allows indexing of all site pages User-agent: * Disallow: /Down.aspx User-agent: SemrushBot Disallow: /